This document discusses IBM's vision for combining Hadoop and data warehousing (DW) platforms into a unified "Hadoop DW". It describes how big data is driving new use cases that require analyzing diverse data types at extreme scales. Hadoop provides a massively parallel processing framework for advanced analytics on polystructured data, while DW focuses on structured data. The emergence of Hadoop DW will provide a single platform for all data types and workloads through tight integration of Hadoop and DW capabilities.
BSC 3362 - Big Data and Social Analytics - IOD Conference (IBM)Mark Heid
Big Data and Social Analytics - at IBM's Information on Demand Conference. Aya Soffer | Director, Information Management & Analytics Research & Mark Heid | Program Director, Social
Analytics
The flexibility of Apache Hadoop is one of its biggest assets – enabling businesses to generate value from data that was previously considered too expensive to be stored and processed in traditional databases – but also results in Hadoop meaning different things to different people. In this session 451 Research’s Matt Aslett will explore the impact that Hadoop is having on the traditional data processing landscape, examining the expanding ecosystem of vendors and their relationships with Apache Hadoop, investigating the increasing variety of Hadoop use-cases, and exploring adoption trends around the world.
Hadoop, Big Data, and the Future of the Enterprise Data Warehousetervela
Under the umbrella of big data, the nature of data warehousing inside enterprises is undergoing a massive transformation. Originally designed as a clearinghouse for organizing data to discover and analyze historical trends, business units are now putting extreme pressure on their data groups to enhance their services. Their goals: provide better customer service, real-time marketing, and more efficient business operations.
In this webcast, Big Data expert Barry Thompson will discuss how will enterprise data warehouses are evolving to meet these challenges. Some of the topics we will cover include:
- How Hadoop and other big data technologies are coexisting with traditional data warehouses
- Dealing with multiple big data sources – and multiple versions of the truth
- Techniques like warehouse replication and parallel data loading that enable platforms with different levels of service for different types of applications
BSC 3362 - Big Data and Social Analytics - IOD Conference (IBM)Mark Heid
Big Data and Social Analytics - at IBM's Information on Demand Conference. Aya Soffer | Director, Information Management & Analytics Research & Mark Heid | Program Director, Social
Analytics
The flexibility of Apache Hadoop is one of its biggest assets – enabling businesses to generate value from data that was previously considered too expensive to be stored and processed in traditional databases – but also results in Hadoop meaning different things to different people. In this session 451 Research’s Matt Aslett will explore the impact that Hadoop is having on the traditional data processing landscape, examining the expanding ecosystem of vendors and their relationships with Apache Hadoop, investigating the increasing variety of Hadoop use-cases, and exploring adoption trends around the world.
Hadoop, Big Data, and the Future of the Enterprise Data Warehousetervela
Under the umbrella of big data, the nature of data warehousing inside enterprises is undergoing a massive transformation. Originally designed as a clearinghouse for organizing data to discover and analyze historical trends, business units are now putting extreme pressure on their data groups to enhance their services. Their goals: provide better customer service, real-time marketing, and more efficient business operations.
In this webcast, Big Data expert Barry Thompson will discuss how will enterprise data warehouses are evolving to meet these challenges. Some of the topics we will cover include:
- How Hadoop and other big data technologies are coexisting with traditional data warehouses
- Dealing with multiple big data sources – and multiple versions of the truth
- Techniques like warehouse replication and parallel data loading that enable platforms with different levels of service for different types of applications
Every now and then something comes along that has the potential to change the face of business as we know it. Currently big data is being touted as that thing, and CIOs everywhere need to get a grip on what it is and how it can benefit their company.
Embedded Analytics: The Next Mega-Wave of InnovationInside Analysis
Could embedded analytics change the way consumers do business? A whole range of Web-based and traditional software providers are now embedding analytical power into their applications such that users can do more complex analysis of their data. The use cases span such industries as eCommerce, telecom, security and other such data-intensive verticals. As a result of this trend, the providers and their customers can gain greater insights about their businesses and thus improve decisions.
Check out this episode of The Briefing Room to hear Analyst John Myers of EMA explain how delivering embedded analytics can expand the value of analysis to customers and partners all over the world, while raising the bar for how business is done. Myers will be briefed by Susan Davis of Infobright, who will tout her company’s success in enabling solution providers to deliver real-time analytical capabilities to their customers.
Big data is one of the most popular terms in the IT industry during the past decade. The word is vague and broad enough that essentially every one of us is living in a big-data world. Every time you do a google search, like a post in Facebook, write something in WeChat or view some item on Amazon, you both use and contribute to someone's big data system. Managing so much data across many computers introduce unique challenges. In this talk, we review the landscape of big data platforms and discuss some lessons we learned from building them.
Agile Data Rationalization for Operational IntelligenceInside Analysis
The Briefing Room with Eric Kavanagh and Phasic Systems
Live Webcast Mar. 26, 2013
The complexity of today's information architectures creates a wide range of challenges for executives trying to get a strategic view of their current operations. The data and context locked in operational systems often get diluted during the normalization processes of data warehousing and other types of analytic solutions. And the ultimate goal of seeing the big picture gets derailed by a basic inability to reconcile disparate organizational views of key information assets and rules.
Register for this episode of The Briefing Room to learn from Bloor Group CEO Eric Kavanagh, who will explain how a tightly controlled methodology can be combined with modern NoSQL technology to resolve both process and system complexities, thus enabling a much richer, more interconnected information landscape. Kavanagh will be briefed by Geoffrey Malafsky of Phasic Systems who will share his company's tested methodology for capturing and managing the business and process logic that run today's data-driven organizations. He'll demonstrate how a “don't say no” approach to entity definitions can dissolve previously intractable disagreements, opening the door to clear, verifiable operational intelligence.
Visit: http://www.insideanalysis.com
Hadoop World 2011: Advancing Disney’s Data Infrastructure with Hadoop - Matt ...Cloudera, Inc.
This is the story of why and how Hadoop was integrated into the Disney data infrastructure. Providing data infrastructure for Disney’s, ABC’s and ESPN’s Internet presences is challenging. Doing so requires cost effective, performant, scalable and highly available solutions. Information requirements from the business add the need for these solutions work together; providing consistent acquisition, storage and access to data. Burdened with a heavily laden commercial RDBMS infrastructure, Hadoop provided an opportunity to solve some challenging use cases at Disney. The deployment of Hadoop helped Disney to address growing costs, scalability, and data availability. In addition, it provids our businesses with new data driven business to consumer opportunities.
Progress with confidence into next generation ITPaul Muller
The keynote from my recent Amazing Summer 2012 tour where I spoke about the need for us to flip out thinking from traditional change control to a more forward looking approach by moving change and security up to the design phase.
The Big Picture: Big Data for the New Wave of AnalyticsInside Analysis
The Briefing Room with Neil Raden and MarkLogic
Live Webcast on Oct. 2, 2012
Understanding context is a critical success factor for any decision-maker. Getting a clear view of the big picture can help guide all kinds of important decisions. That's why many organizations are focused on weaving together structured and "unstructured" data, to create a strategic view of enterprise issues and opportunities. The answers are usually found somewhere in between a SQL query and a Google-style search.
Check out this episode of The Briefing Room to learn from veteran Analyst Neil Raden of Hired Brains, who will explain how a new breed of analytical applications can generate a wide range of targeted insights. He'll be briefed by Steve Guttman of MarkLogic, who will tout his company's Enterprise NoSQL database, which combines the durability of traditional relational databases, with the versatility of modern Big Data engines. He'll also discuss real-world examples of new applications for various industries.
Every now and then something comes along that has the potential to change the face of business as we know it. Currently big data is being touted as that thing, and CIOs everywhere need to get a grip on what it is and how it can benefit their company.
Embedded Analytics: The Next Mega-Wave of InnovationInside Analysis
Could embedded analytics change the way consumers do business? A whole range of Web-based and traditional software providers are now embedding analytical power into their applications such that users can do more complex analysis of their data. The use cases span such industries as eCommerce, telecom, security and other such data-intensive verticals. As a result of this trend, the providers and their customers can gain greater insights about their businesses and thus improve decisions.
Check out this episode of The Briefing Room to hear Analyst John Myers of EMA explain how delivering embedded analytics can expand the value of analysis to customers and partners all over the world, while raising the bar for how business is done. Myers will be briefed by Susan Davis of Infobright, who will tout her company’s success in enabling solution providers to deliver real-time analytical capabilities to their customers.
Big data is one of the most popular terms in the IT industry during the past decade. The word is vague and broad enough that essentially every one of us is living in a big-data world. Every time you do a google search, like a post in Facebook, write something in WeChat or view some item on Amazon, you both use and contribute to someone's big data system. Managing so much data across many computers introduce unique challenges. In this talk, we review the landscape of big data platforms and discuss some lessons we learned from building them.
Agile Data Rationalization for Operational IntelligenceInside Analysis
The Briefing Room with Eric Kavanagh and Phasic Systems
Live Webcast Mar. 26, 2013
The complexity of today's information architectures creates a wide range of challenges for executives trying to get a strategic view of their current operations. The data and context locked in operational systems often get diluted during the normalization processes of data warehousing and other types of analytic solutions. And the ultimate goal of seeing the big picture gets derailed by a basic inability to reconcile disparate organizational views of key information assets and rules.
Register for this episode of The Briefing Room to learn from Bloor Group CEO Eric Kavanagh, who will explain how a tightly controlled methodology can be combined with modern NoSQL technology to resolve both process and system complexities, thus enabling a much richer, more interconnected information landscape. Kavanagh will be briefed by Geoffrey Malafsky of Phasic Systems who will share his company's tested methodology for capturing and managing the business and process logic that run today's data-driven organizations. He'll demonstrate how a “don't say no” approach to entity definitions can dissolve previously intractable disagreements, opening the door to clear, verifiable operational intelligence.
Visit: http://www.insideanalysis.com
Hadoop World 2011: Advancing Disney’s Data Infrastructure with Hadoop - Matt ...Cloudera, Inc.
This is the story of why and how Hadoop was integrated into the Disney data infrastructure. Providing data infrastructure for Disney’s, ABC’s and ESPN’s Internet presences is challenging. Doing so requires cost effective, performant, scalable and highly available solutions. Information requirements from the business add the need for these solutions work together; providing consistent acquisition, storage and access to data. Burdened with a heavily laden commercial RDBMS infrastructure, Hadoop provided an opportunity to solve some challenging use cases at Disney. The deployment of Hadoop helped Disney to address growing costs, scalability, and data availability. In addition, it provids our businesses with new data driven business to consumer opportunities.
Progress with confidence into next generation ITPaul Muller
The keynote from my recent Amazing Summer 2012 tour where I spoke about the need for us to flip out thinking from traditional change control to a more forward looking approach by moving change and security up to the design phase.
The Big Picture: Big Data for the New Wave of AnalyticsInside Analysis
The Briefing Room with Neil Raden and MarkLogic
Live Webcast on Oct. 2, 2012
Understanding context is a critical success factor for any decision-maker. Getting a clear view of the big picture can help guide all kinds of important decisions. That's why many organizations are focused on weaving together structured and "unstructured" data, to create a strategic view of enterprise issues and opportunities. The answers are usually found somewhere in between a SQL query and a Google-style search.
Check out this episode of The Briefing Room to learn from veteran Analyst Neil Raden of Hired Brains, who will explain how a new breed of analytical applications can generate a wide range of targeted insights. He'll be briefed by Steve Guttman of MarkLogic, who will tout his company's Enterprise NoSQL database, which combines the durability of traditional relational databases, with the versatility of modern Big Data engines. He'll also discuss real-world examples of new applications for various industries.
Analyze This! Best Practices For Big And Fast DataEMC
During this recorded webcast, you will hear from Judith Hurwitz, noted analyst and author of Hybrid Cloud for Dummies and Bill Schmarzo, EMC Consulting’s CTO for EIMA. You will learn What is big fast data and how your organization will benefit from this transformation in data management.
Big Data World Forum (BDWF http://www.bigdatawf.com/) is specially designed for data-driven decision makers, managers, and data practitioners, who are shaping the future of the big data.
Big Data Beyond Hadoop*: Research Directions for the FutureOdinot Stanislas
Michael Wrinn
Research Program Director, University Research Office,
Intel Corporation
Jason Dai
Engineering Director and Principal Engineer,
Intel Corporation
Presented during the Open Source Conference 2012, organized by Accenture and Redhat on December 14th 2012. This presentation discusses an open source Big Data case study.
By Jonathan Bender, Consultant, Accenture Technology Labs
Analytic Platforms in the Real World with 451Research and Calpont_July 2012Calpont Corporation
Matt Aslett, 451 Research, and Bob Wilkinson, VP Engineering for Calpont, discuss the emergence of the analytic platform, its place the new ecosystem for Big Data, considerations for selection, and applied use cases of Calpont’s analytic platform, InfiniDB, in Telco and Mobile Advertising.
Infochimps #1 Big Data Platform for the CloudBrian Krpec
The Infochimps Platform is the simplest, fastest, and most flexible way to implement proven big data infrastructure in the cloud. Scalably and affordably ingest data from wherever you need — your in-house systems, external data feeds, data from the web, or our Data Marketplace. Make it useful with in-stream data decoration and augmentation. Store and analyze it in the best place for your application. Hadoop, NoSQL, real-time analytics — how do you tie it all together? The Infochimps Platform takes the mystery and difficulty out of big data and seamlessly integrates it with your existing environment, so you can focus on gaining business insights from your data fast.
Modernizing Your IT Infrastructure with Hadoop - Cloudera Summer Webinar Seri...Cloudera, Inc.
You will also learn how to understand key challenges when deploying a Hadoop cluster in production, manage the entire Hadoop lifecycle using a single management console, deliver integrated management of the entire cluster to maximize IT and business agility.
Can you teach coding to kids in a mobile game app in local languages. Do you need to be good in English to learn coding in R or Python?
How young can we train people in coding-
something we worked on for six months but now we are giving up due to lack of funds is this idea.
Feel free to use it, it is licensed cc-by-sa
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Now if you recall, I talked about the EDW not going away and the Big Data system working with it. Just a couple of slides ago I talked about the IBM Big Data platform and I included commentary about IBM Information Server for integration and that’s what this slide is showing here. We know that we are now faced with two complementary analytical approaches – we have this traditional approach, we have this new approach – and when we bring these together, we need some help to figure out a way to get from the left sphere to the right sphere and that’s going to be enterprise integration. So IBM provides that; for example IIS has readers for HDFS and natively within DB2 is a UDF that can call a MapReduce program, and more. If you look at this slide, you can see that if you live in the SQL world, you can talk to the Big Data world, and vice versa.
Key Points IBM research developed a sophisticated text analytics engine – similar technology to what was demonstrated in Watson Its purpose is to identify meaning within text We have pre-built 100s of rules (annotators) that understand textual meaning – names (e.g., what is a first name v a last name), addresses (what is a street, apartment) among others. The annotators are context sensitive and discover the relationship between terms even if they are separate by text – for example, it discovers that Iker Casillas is a “keeper” even though the phrase “for Spain” is in between them Accuracy – our text analytics engine is very accurate and we’ve done testing that indicates it is 2-3x more accurate than some alternatives It is also highly performant – it is designed for use in Big Data and map reduce parallel processing
Key Points - Integrate v3 – the point is to have one platform to manage all of the data – there’s no point in having separate silos of data, each creating separate silos of insight. From the customer POV (a solution POV) big data has to be bigger than just one technology Analyze v3 – very important point – we see big data as a viable place to analyze and store data. New technology is not just a pre-processor to get data into a structured DW for analysis. Significant area of value add by IBM – and the game has changed – unlike DBs/SQL, the market is asking who gets the better answer and therefore sophistication and accuracy of the analytics matters Visualization – need to bring big data to the users – spreadsheet metaphor is the key to doing son Development – need sophisticated development tools for the engines and across them to enable the market to develop analytic applications Workload optimization – improvements upon open source for efficient processing and storage Security and Governance – many are rushing into big data like the wild west. But there is sensitive data that needs to be protected, retention policies need to be determined – all of the maturity of governance for the structured world can benefit the big data world