The document discusses big data and analytics. It notes that expectations for business intelligence are changing as data grows exponentially in volume, velocity, variety and complexity. Big data requires new approaches and tools that can handle unstructured data, scale easily, and perform analytics in real-time. The document provides examples of how various industries like pharmaceuticals, financial services, and manufacturing can gain insights from big data through applications like fraud detection, customer management, and supply chain optimization.
TeraStream - Data Integration/Migration/ETL/Batch ToolDataStreams
TeraStream™ is leading the Korean data migration and ETL market. Take a look at the powerful performances, features and user conveniences of TeraStream™
Korean No. 1 company which has expertise in total data management and big data processing. Provide high performance software products and professional consulting services for data integration & migration, data governance, data warehouse and big data processing & storage.
Blueprint Series: Banking In The Cloud – Ultra-high Reliability ArchitecturesMatt Stubbs
Data architecture for a challenger bank.Speaker: Jason Maude, Head of Technology Advocacy, Starling BankSpeaker Bio: Jason Maude is a coder, coach, and public speaker. He has over a decade of experience working in the financial sector, primarily in creating and delivering software. He is passionate about explaining complex technical concepts to those who are convinced that they won't be able to understand them. He currently works at Starling Bank as their Head of Technology Advocacy and host of the Starling podcast.Filmed at Skills Matter/Code Node London on 9th May 2019 as part of the Big Data LDN Meetup Blueprint Series.Meetup sponsored by DataStax.
Evolving a data supply chain and disrupting the Google model of ignoring data ownership and the Facebook model of co-opting data ownership. The data supply chain model assumes the person or the owner of the device that creates data is the owner of that data and should have the right to trade in in an open marketplace.
Everyone knows there's too much big data. But what's the best way to harness the power of big data? This presentation discusses three analytic engines that companies big and small are using to capture, store, transform and use big data. Also included are case studies of big data in action.
TeraStream - Data Integration/Migration/ETL/Batch ToolDataStreams
TeraStream™ is leading the Korean data migration and ETL market. Take a look at the powerful performances, features and user conveniences of TeraStream™
Korean No. 1 company which has expertise in total data management and big data processing. Provide high performance software products and professional consulting services for data integration & migration, data governance, data warehouse and big data processing & storage.
Blueprint Series: Banking In The Cloud – Ultra-high Reliability ArchitecturesMatt Stubbs
Data architecture for a challenger bank.Speaker: Jason Maude, Head of Technology Advocacy, Starling BankSpeaker Bio: Jason Maude is a coder, coach, and public speaker. He has over a decade of experience working in the financial sector, primarily in creating and delivering software. He is passionate about explaining complex technical concepts to those who are convinced that they won't be able to understand them. He currently works at Starling Bank as their Head of Technology Advocacy and host of the Starling podcast.Filmed at Skills Matter/Code Node London on 9th May 2019 as part of the Big Data LDN Meetup Blueprint Series.Meetup sponsored by DataStax.
Evolving a data supply chain and disrupting the Google model of ignoring data ownership and the Facebook model of co-opting data ownership. The data supply chain model assumes the person or the owner of the device that creates data is the owner of that data and should have the right to trade in in an open marketplace.
Everyone knows there's too much big data. But what's the best way to harness the power of big data? This presentation discusses three analytic engines that companies big and small are using to capture, store, transform and use big data. Also included are case studies of big data in action.
Slides from my keynote this afternoon in Paris at the Enterprise 2.0 SUMMIT. Overview of where social business is, what the macro trends are, and the story about consumerization, big data, analytics, and much more.
Big Data World Forum (BDWF http://www.bigdatawf.com/) is specially designed for data-driven decision makers, managers, and data practitioners, who are shaping the future of the big data.
Navigating the Complex World of Compliance GuidelinesDATAVERSITY
Regulatory guidelines include many mandates for organizations to interpret and implement to protect their data. You know that you’re supposed to be monitoring and auditing certain data elements to demonstrate compliance, but how can you be sure you’re auditing the right things and translating the requirements correctly? IDERA’s Kim Brushaber will help to simplify and address some of the compliance concerns for complex data environments.
ADV Slides: The World in 2045 – What Has Artificial Intelligence Created?DATAVERSITY
How will technology and society change in the next 25 years? We have been discussing how technology has evolved in the last few years; in this episode, we look forward to the next 25 years.
The year 2045 may seem far away, but we already have predictions about the technological innovations prevalent in 2045. Hint: Artificial intelligence will have a huge impact.
The Future for Smart Technology ArchitectsPaul Preiss
The future of software and even hardware is based in ever more complex abilities to adapt to highly dynamic change and input. The Internet of Things brings with it input from billions of sources locally and around the globe and for intelligent architects this represents an opportunity to create deep competitive advantage and customer loyalty.
The Japanese have used intelligent systems for years from cars to trains to vacuum cleaners and there will continue to be smarter and smarter systems. Architects around the world must include this thinking into their designs and strategies. Adaptive social networks, individually designed health care, just in time 3d printing are only some of the components of this coming era.
How to include smart system thinking into designs
How to get started with smart tools like inferencing, fuzzy, neural and other technologies
When to think smart and when to avoid
Possible outcomes to strive for today in preparing your architecture for the age of smart systems
Estimating the Total Costs of Your Cloud Analytics PlatformDATAVERSITY
Organizations today need a broad set of enterprise data cloud services with key data functionality to modernize applications and utilize machine learning. They need a platform designed to address multi-faceted needs by offering multi-function Data Management and analytics to solve the enterprise’s most pressing data and analytic challenges in a streamlined fashion. They need a worry-free experience with the architecture and its components.
Speed Matters - Intelligent Strategies to Accelerate Data-Driven DecisionsDATAVERSITY
COVID-19 has shown us the importance of data in being able to quickly make decisions when market variables are out of our control. In order to accelerate and harness the process, an organization needs an agile approach to data integration and analytics that avoids the limitations of predefined schemas and data models.
Learn from 451 Research, now part of S&P Global Market Intelligence, a leading global IT research and advisory firm, and Qlik about best practices that can help you accelerate the data to decision path with agility. You’ll understand how to:
-Rethink traditional assumptions about data management and analytic roles and technologies
-Recognize trends that drive the demand to reduce the time required to investigate, analyze and take action on business data.
See a new state of business intelligence, where the data pipeline is optimized to enable organizations to make decisions and act in real-time. Seeking alternatives to the traditional approaches to become more agile in today’s evolving market and economy? Then don’t miss this presentation!
ADV Slides: Modern Analytic Data Architecture Maturity ModelingDATAVERSITY
Maturity frameworks have varying levels of Data Management maturity. Each level corresponds to not only increased data maturity, but also increased organizational maturity and bottom-line ROI. There are recommended targets to achieve an effective information management program. The speaker’s maturity framework sequences the information management activities for your consideration. It is based on real client roadmaps. This webinar promises to offer a wealth of ideas for key quick wins to benefit the organization’s information management program.
Attendees can self-assess their current information management capabilities as we go through data strategy, organization, architecture, and technology, yielding an overall view of the current level of information management maturity.
This webinar provides a foundation for enhancing current data and analytic capabilities and updating the strategy and plans for achievement of improved information management maturity, aligned with major initiatives.
Where the Warehouse Ends: A New Age of Information AccessInside Analysis
The Briefing Room with Barry Devlin and Composite Software
Live Webcast May 21, 2013
All good things must come to an end, and even though the data warehouse will remain a prominent force in the information age, the handwriting is all over the enterprise: the center of gravity is moving. Whether due to Big Data or real-time demands, Cloud computing or globalization, today's leading organizations have analytical needs that the warehouse simply cannot accommodate. That's why data virtualization continues to attract attention.
Register for this episode of The Briefing Room to hear veteran Analyst Barry Devlin explain why the traditional model for data warehousing is being outmoded by a range of more flexible methods for accessing and analyzing information assets. He'll be briefed by David Besemer of Composite Software who will discuss how his company's data virtualization platform can be used to provide access to all manner of information sources, including data warehouses, Big Data silos, as well as partner and public data sources on demand.
Visit: http://www.insideanalysis.com
Slides from my keynote this afternoon in Paris at the Enterprise 2.0 SUMMIT. Overview of where social business is, what the macro trends are, and the story about consumerization, big data, analytics, and much more.
Big Data World Forum (BDWF http://www.bigdatawf.com/) is specially designed for data-driven decision makers, managers, and data practitioners, who are shaping the future of the big data.
Navigating the Complex World of Compliance GuidelinesDATAVERSITY
Regulatory guidelines include many mandates for organizations to interpret and implement to protect their data. You know that you’re supposed to be monitoring and auditing certain data elements to demonstrate compliance, but how can you be sure you’re auditing the right things and translating the requirements correctly? IDERA’s Kim Brushaber will help to simplify and address some of the compliance concerns for complex data environments.
ADV Slides: The World in 2045 – What Has Artificial Intelligence Created?DATAVERSITY
How will technology and society change in the next 25 years? We have been discussing how technology has evolved in the last few years; in this episode, we look forward to the next 25 years.
The year 2045 may seem far away, but we already have predictions about the technological innovations prevalent in 2045. Hint: Artificial intelligence will have a huge impact.
The Future for Smart Technology ArchitectsPaul Preiss
The future of software and even hardware is based in ever more complex abilities to adapt to highly dynamic change and input. The Internet of Things brings with it input from billions of sources locally and around the globe and for intelligent architects this represents an opportunity to create deep competitive advantage and customer loyalty.
The Japanese have used intelligent systems for years from cars to trains to vacuum cleaners and there will continue to be smarter and smarter systems. Architects around the world must include this thinking into their designs and strategies. Adaptive social networks, individually designed health care, just in time 3d printing are only some of the components of this coming era.
How to include smart system thinking into designs
How to get started with smart tools like inferencing, fuzzy, neural and other technologies
When to think smart and when to avoid
Possible outcomes to strive for today in preparing your architecture for the age of smart systems
Estimating the Total Costs of Your Cloud Analytics PlatformDATAVERSITY
Organizations today need a broad set of enterprise data cloud services with key data functionality to modernize applications and utilize machine learning. They need a platform designed to address multi-faceted needs by offering multi-function Data Management and analytics to solve the enterprise’s most pressing data and analytic challenges in a streamlined fashion. They need a worry-free experience with the architecture and its components.
Speed Matters - Intelligent Strategies to Accelerate Data-Driven DecisionsDATAVERSITY
COVID-19 has shown us the importance of data in being able to quickly make decisions when market variables are out of our control. In order to accelerate and harness the process, an organization needs an agile approach to data integration and analytics that avoids the limitations of predefined schemas and data models.
Learn from 451 Research, now part of S&P Global Market Intelligence, a leading global IT research and advisory firm, and Qlik about best practices that can help you accelerate the data to decision path with agility. You’ll understand how to:
-Rethink traditional assumptions about data management and analytic roles and technologies
-Recognize trends that drive the demand to reduce the time required to investigate, analyze and take action on business data.
See a new state of business intelligence, where the data pipeline is optimized to enable organizations to make decisions and act in real-time. Seeking alternatives to the traditional approaches to become more agile in today’s evolving market and economy? Then don’t miss this presentation!
ADV Slides: Modern Analytic Data Architecture Maturity ModelingDATAVERSITY
Maturity frameworks have varying levels of Data Management maturity. Each level corresponds to not only increased data maturity, but also increased organizational maturity and bottom-line ROI. There are recommended targets to achieve an effective information management program. The speaker’s maturity framework sequences the information management activities for your consideration. It is based on real client roadmaps. This webinar promises to offer a wealth of ideas for key quick wins to benefit the organization’s information management program.
Attendees can self-assess their current information management capabilities as we go through data strategy, organization, architecture, and technology, yielding an overall view of the current level of information management maturity.
This webinar provides a foundation for enhancing current data and analytic capabilities and updating the strategy and plans for achievement of improved information management maturity, aligned with major initiatives.
Where the Warehouse Ends: A New Age of Information AccessInside Analysis
The Briefing Room with Barry Devlin and Composite Software
Live Webcast May 21, 2013
All good things must come to an end, and even though the data warehouse will remain a prominent force in the information age, the handwriting is all over the enterprise: the center of gravity is moving. Whether due to Big Data or real-time demands, Cloud computing or globalization, today's leading organizations have analytical needs that the warehouse simply cannot accommodate. That's why data virtualization continues to attract attention.
Register for this episode of The Briefing Room to hear veteran Analyst Barry Devlin explain why the traditional model for data warehousing is being outmoded by a range of more flexible methods for accessing and analyzing information assets. He'll be briefed by David Besemer of Composite Software who will discuss how his company's data virtualization platform can be used to provide access to all manner of information sources, including data warehouses, Big Data silos, as well as partner and public data sources on demand.
Visit: http://www.insideanalysis.com
The Briefing Room with Mark Madsen and Hortonworks
Slides from the Live Webcast on Oct. 16, 2012
The power of Hadoop cannot be denied, as evidenced by the fact that all the biggest closed-source vendors in the world of data management have embraced this open-source project with virtually open arms. But Hadoop is not a data warehouse, nor ever will it likely be. Rather, it's ideal role for now is to augment traditional data warehousing and business intelligence. As an adjunct, Hadoop provides an amazing mechanism for storing and analyzing Big Data. The key is to manage expectations and move forward carefully.
Check out this episode of The Briefing Room to hear veteran Analyst Mark Madsen of Third Nature, who will explain how, where, when and why to leverage the open-source elephant in the enterprise. He'll be briefed by Jim Walker of Hortonworks who will tout his company's vision for the future of Big Data management. He'll provide details on their data platform and how it can be used to complete the picture of information management. He'll also discuss how the Hortonworks partner network can help companies get big value from Big Data.
Visit: http://www.insideanalysis.com
Evaluating Big Data Predictive Analytics PlatformsTeradata Aster
Mike Gualtieri, Principal Analyst, Forrester Research, presents at the Big Analytics Roadshow, 2012 in New York City on December 12, 2012
Presentation title: Evaluating Big Data Predictive Analytics Platforms
Abstract: Great. You have Big Data. Now what? You have to analyze it to find game-changing predictive models that you can use to make smart decisions, reduce risk, or deliver breakthrough customer experiences. Big Data Predictive Analytics solutions are software and/or hardware solutions that allow firms to discover, evaluate, optimize, and deploy predictive models by analyzing big data sources. In this session, Forrester Principal Analyst Mike Gualtieri will discuss the key criteria you should use to evaluate Big Data Predictive Analytics platforms to meet your specific needs.
For more content from the same event, including a discussion of Customer Profitability Analysis and Big Data tools, please see:
meetup.com/Analytics-and-Data-in-Financial-Services/pages/Big_Data_meet_Customer_Profitability_Analytics/
Big Data LDN 2018: INTELLIGENCE EVERYWHERE – POWER TO THE PEOPLEMatt Stubbs
Date: 13th November 2018
Location: Self-Service Analytics Theatre
Time: 11:50 - 12:20
Speaker: Matt Pepper
Organisation: MIcroStretegy
About: In this session, Matt Pepper will demonstrate how MicroStrategy enables an Enterprise to provide:
• Governed Data Discovery at scale
• Freedom for departments to build applications whilst remaining compliant
• The capability to link disparate data into a cohesive platform
• The right information to the right person, in the right format, at the right time
Global Business Intelligence (BI) software vendor, Yellowfin, and Actian Corporation, pioneers of the record-breaking analytical database Vectorwise, will host a series of Big Data and BI Best Practices Webinars.
These are the slides from that presentation.
The Big Data & BI Best Practices Webinars and associated slides examine the phenomenal growth in business data and outline strategies for effectively, efficiently and quickly harnessing and exploring ‘Big Data’ for competitive advantage.
About ActuateOne for Utility Analytics
Water and Energy Utilities are under tremendous pressure to demonstrate progress in asset optimization, grid optimization and performance gains across traditional business drivers such as customers, revenue protection, utility regulatory compliance and financials. ActuateOne for Utility Analytics provides a comprehensive portfolio of software and utility analytics industry expertise to ensure today’s utility leaders and customers always have access to the right information, insight and collaborative capabilities for accurate and informed decisions. Delivered through a single platform, ActuateOne for Utility Analytics ignites any utility or grid Analytics initiative with integrated asset optimization dashboards, grid optimization dashboards, utility compliance reports as well as Transformer Management Scorecards, Substation & Equipment Management Scorecards and Utility KPI Dashboards which help today’s Utility enhance performance and maximize grid performance.
http://www.actian.com/
Watch Glen Rabie, CEO of Yellowfin, and Fred Gallahger, GM of Actian Vectorwise take you through 7 of the Best Practices for Big Data and BI.
Big Data, Hadoop, Hortonworks and Microsoft HDInsightHortonworks
Big Data is everywhere. And at the center of the big data discussion is Apache Hadoop, a next-generation enterprise data platform that allows you to capture, process and share the enormous amounts of new, multi-structured data that doesn’t fit into transitional systems.
With Microsoft HDInsight, powered by Hortonworks Data Platform, you can bridge this new world of unstructured content with the structured data we manage today. Together, we bring Hadoop to the masses as an addition to your current enterprise data architectures so that you can amass net new insight without net new headache.
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
PHP Frameworks: I want to break free (IPC Berlin 2024)Ralf Eggert
In this presentation, we examine the challenges and limitations of relying too heavily on PHP frameworks in web development. We discuss the history of PHP and its frameworks to understand how this dependence has evolved. The focus will be on providing concrete tips and strategies to reduce reliance on these frameworks, based on real-world examples and practical considerations. The goal is to equip developers with the skills and knowledge to create more flexible and future-proof web applications. We'll explore the importance of maintaining autonomy in a rapidly changing tech landscape and how to make informed decisions in PHP development.
This talk is aimed at encouraging a more independent approach to using PHP frameworks, moving towards a more flexible and future-proof approach to PHP development.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
Let's dive deeper into the world of ODC! Ricardo Alves (OutSystems) will join us to tell all about the new Data Fabric. After that, Sezen de Bruijn (OutSystems) will get into the details on how to best design a sturdy architecture within ODC.
КАТЕРИНА АБЗЯТОВА «Ефективне планування тестування ключові аспекти та практ...QADay
Lviv Direction QADay 2024 (Professional Development)
КАТЕРИНА АБЗЯТОВА
«Ефективне планування тестування ключові аспекти та практичні поради»
https://linktr.ee/qadayua
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
7. copyright: Sixth Sense Advisors Inc @2012 7
Big Data
Big Data can be defined as data that can grow in volume, velocity, variety and complexity at
unprecedented pace. The growth and complexity present challenges with the capture, storage,
management, analysis and visualization using the typical BI tool stack
8. copyright: Sixth Sense Advisors Inc @2012 8
Tapping into the data
Business Infrastructure
Today we do Big or Small
Structured data
compute with Small and
used today
Large structured data sets
Big Data Big Data will mean Big or
existing across Small compute with Big
the enterprise data sets, not always
that can be available in structured or
made available semi-structured formats
to business
9. copyright: Sixth Sense Advisors Inc @2012 9
Analytics
• Analytics is the key visualization technique to analyze and
monetize from Big Data
• The field of analytics is resurging from the advent of Big
Data
• Social Analytics
• Sensor Analytics
• Text Analytics
• Deep Data Mining
• Analytics needs metadata for integration
• Applications
• Fraud Detection
• Campaign Optimization
• Demand and Supply Optimization
• Forecast Optimization
10. copyright: Sixth Sense Advisors Inc @2012
Long Tail
The New Way
(with a bigger, longer tail)
The Old Way
(Pareto Principle, Control
or 80/20 rule)
Source: http://en.wikipedia.org/wiki/The_Long_Tail
20%
When Web 2.0 is applied…
11. copyright: Sixth Sense Advisors Inc @2012
2008 US Presidential Elections
$32 million raised from 275,000 people
who gave $100 or less
12. copyright: Sixth Sense Advisors Inc @2012
Long Tail Example
Web 2.0 significantly increases
total value contributed/received
by aggregating the long tail of
smaller value donors.
High $ value
donors,
Small
constellation
Source: http://en.wikipedia.org/wiki/The_Long_Tail
20%
Low $ value donors,
Larger constellation
BIG
Data
15. copyright: Sixth Sense Advisors Inc @2012 15
What do we collect
• Facebook has an average of 30 billion pieces of content added
every month
• YouTube receives 24hours of video, every minute
• 5 Billion mobile phones in use in 2010
• A leading retailer in the UK collects 1.5 billion pieces of
information to adjust prices and promotions
• Amazon.com: 30% of sales is out of its recommendation engine
• A Boeing Jet Engine produces 20TB/Hour for engineers to
examine in real time to make improvements
17. copyright: Sixth Sense Advisors Inc @2012 17
Why DWBI Fails Repeatedly
Lost value =
Business Value Sum
(Latencies)+
Business Situation Opportunity
Cost
Data Latency
Value
Lost
Data is ready
Analysis Latency
Information is available
Decision Latency
Decision is made
Action time or Action distance
Time
Base Graph Courtesy – Dr. Richard Hackathorn
18. copyright: Sixth Sense Advisors Inc @2012 18
The Data Landscape
Datamarts
Transactional Reports
Systems ODS & Analytical
Databases
Dashboar
Enterprise ds
Datawarehous Datamarts
Transactional
Systems ODS e
& Analytical
Databases Analytic
Models
Other
Transactional
Applicatio
ODS Datamarts ns
Systems
& Analytical
Databases
Data Transformation
19. copyright: Sixth Sense Advisors Inc @2012 19
ACID Kills
• Atomic – All of the work in a transaction completes
(commit) or none of it completes
• Consistent – A transaction transforms the database
from one consistent state to another consistent state.
Consistency is defined in terms of constraints.
• Isolated – The results of any changes made during a
transaction are not visible until the transaction has
committed.
• Durable – The results of a committed transaction
survive failures
20. copyright: Sixth Sense Advisors Inc @2012 20
BIG
Data
Scenarios
EXAMPLES
To: Bob.Collins@bankwithus.com
Dear Mr. Collins,
This email is in reference to my bank account which has
been efficiently handled by your bank for more than five
years. There has been no problem till date until last week
the situation went out of the hand.
I have deposited one of my high amount cheque to my
bank account no: 65656512 which was to be credited
same day but due to your staff carelessness it wasn’t
done and because of this negligence my reputation in the
market has been tarnished. Furthermore I had issued one
payment cheque to the party which was showing
bounced due to “Insufficient balance” just because my
cheque didn’t make on time.
My relationship with your bank has matured with the time
and it’s a shame to tell you about this kind of services are
not acceptable when it is question of somebody’s
reputation. I hope you got my point and I am attaching a
copy of the same for further rapid procedures and remit
into my account in a day.
Yours sincerely
Daniel Carter
Ph: 564-009-2311
21. copyright: Sixth Sense Advisors Inc @2012 21
BIG Data Text Example
• We
will
o9en
imply
addi>onal
informa>on
in
spoken
language
by
the
way
we
place
stress
on
words.
• The
sentence
"I
never
said
she
stole
my
money"
demonstrates
the
importance
stress
can
play
in
a
sentence,
and
thus
the
inherent
difficulty
a
natural
language
processor
can
have
in
parsing
it.
• "I
never
said
she
stole
my
money"
-‐
Someone
else
said
it,
but
I
didn't.
• "I
never
said
she
stole
my
money"
-‐
I
simply
didn't
ever
say
it.
• "I
never
said
she
stole
my
money"
-‐
I
might
have
implied
it
in
some
way,
but
I
never
explicitly
said
it.
• "I
never
said
she
stole
my
money"
-‐
I
said
someone
took
it;
I
didn't
say
it
was
she.
• "I
never
said
she
stole
my
money"
-‐
I
just
said
she
probably
borrowed
it.
• "I
never
said
she
stole
my
money"
-‐
I
said
she
stole
someone
else's
money.
• "I
never
said
she
stole
my
money"
-‐
I
said
she
stole
something,
but
not
my
money
• Depending
on
which
word
the
speaker
places
the
stress,
this
sentence
could
have
several
dis>nct
meanings.
Example Source: Wikepedia
22. copyright: Sixth Sense Advisors Inc @2012 22
Pattern Detection
Clustering Techniques Utilities
K-Means Accuracy Measures
Maximin Range Filters
Agglomerative K-Fold Cross Validation
Divisive Merge & Subset
Regression Vector Magnitude
Classification Techniques
Native Bayes Examples
Neural Networks • Text – OCR, Machine, Digital
Back Propogational • Face recognition, verification, retrieval.
Recursively Splitting • Finger prints recognition.
K-Nearest Neighbor • Speech recognition.
Minimum Distance • Medical diagnosis: X-Ray, EKG analysis
• Machine diagnostics data
Reduction Techniques • Geological data
Backward Elimination • Automated Target Recognition (ATR).
Forward Selection • Image segmentation and analysis (recognition
Attribute Removal from aerial or satelite photographs).
Principal Components
25. copyright: Sixth Sense Advisors Inc @2012 25
Performance
Re-Engineering a Ferrari Engine in a Yugo does not make the fastest
race car.
+ New Data Types
Current
Data + New volume • POOR
Management + New Analytics Performance
Platform • Failed
+ New Data Retention
(RDBMS + ETL Programs
+BI) + New Data Workloads
26. copyright: Sixth Sense Advisors Inc @2012 26
Big
Data
and
You
• You
need
to
write
data
quickly
and
reliably
• Incoming
data
streams
are
different
in
type,
size,
complexity
• But
wri>ng
it
to
disk
or
memory
is
not
the
ul>mate
goal
• You
need
to
validate
data
in
real-‐>me
• You
need
to
count
and
aggregate
as
your
write
• You
need
to
analyze
in
real-‐>me
as
later
even
if
seconds
later
is
historical
• You
need
to
scale-‐up
and
scale-‐out
on
demand
28. copyright: Sixth Sense Advisors Inc @2012 28
Data Warehouse Appliance
High Availability • A Data Warehouse (DW)
Appliance is an integrated
Standard SQL Interface set of servers, storage,
OS, database and
Advanced Compression interconnect specifically
preconfigured and tuned
MPP for the rigors of data
warehousing.
Leverages existing BI, ETL and OLTP investments
• DW appliances offer an
Hadoop & MapReduce Interface / Embedded attractive price /
performance value
Minimal disk I/O bottleneck; simultaneously load & query proposition and are
frequently a fraction of the
Auto Database Management cost of traditional data
warehouse solutions.
31. copyright: Sixth Sense Advisors Inc @2012 31
Hadoop & RDBMS Analogy
RDBMS Hadoop
Sports car: Cargo train:
• refined • rough
• has a lot of features • missing a lot of luxury
• accelerates very fast • slow to accelerate
• pricey • carries almost anything
• expensive to maintain
• moves a lot of stuff very
efficiently
* Original Slide Author- Amr Adwallah , CloudEra
38. copyright: Sixth Sense Advisors Inc @2012 38
Map Reduce
n Technique for indexing and searching large data volumes
n Two Phases, Map and Reduce
n Map
n Extract sets of Key-Value pairs from underlying data
n Potentially in Parallel on multiple machines
n Reduce
n Merge and sort sets of Key-Value pairs
n Results may be useful for other searches
45. copyright: Sixth Sense Advisors Inc @2012 45
Big Data Challenges
• Integration to the EDW is still an open issue – Big Data
reduces to small metrics, and this translates into the
current state issues faced with EDW data
• Big Data requires lot of Taxonomy processing especially
in Content related Search
• There are several applications that need high
performing memory architectures as data is compute
intensive – example image processing of brain scans
• Technology is improving by the day, but integration and
deployment are becoming equally complex.