Benny Schnaider - the future of big data quality @IGTCloud

•

0 likes•165 views

Avner Algom

Benny Schnaider, VP SW development at Oracle The future of Big data quality

Technology

The future of Big Data quality
Benny Schnaider
VP Software Development, Oracle
BIG DATA

Machine Translation
Competition
101110 010101

I would like to present to the committee...
Ich möchte dem Ausschuss vorstellen...
Je voudrais présenter au comité...
196 1799 2005

It takes X2 data to achieve 0.5% quality
results improvement
8

Works great but still not
“bullet-proof”

(‫)יסבחהום‬ "‫להם‬ ‫טוב‬ ‫"בוקר‬
"Ysabechhum"
(‫)ידבחהום‬ "‫אותם‬ ‫"לשחוט‬
"Ydbachhum"
‫ﯾﺻﺑﺣﮭم‬‫ﯾدﺑﺣﮭم‬

Recent industry contact noted having
real visibility into extracting $100/car
of annual data-related revenue
Connected car data worth $1.5 Trillion.

How do we price data?
011010000110010101101100011100000110100001100101011011000
111000001101000011001010000110010101101100011100000110100
001100101011011000111000001101000011001010110110001110000
011010000110010101101100011100000110100001100101011011000
111000001101000011001010110110001110000011010000110010101
101100011100000110100001100101011011000111000001101011011
000111000001101000011001010110110001110000011010000110010
101101100011100000110100001100101011011000111000001101000
011001010110110001110000011010000110010101101100011100000
110100011001010110110001110000011010000110010101101100011
100000110100001100101011011000111000001101000011001010110
110001110000011010000011001010110110001110000011010000110
010101101100011100000110100001100101011011000111000001101
000011001010110110001110000011010000110010101101100011100
000110100001100101011011000111000001101000
$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$
$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$
$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$
$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$
$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$
$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$
$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$
$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$
$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$
$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$
$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$
$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$
$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$
$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$
$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$

Big DataApplications
Cleansing
Algorithms
More data

Big DataApplications
Cleansing
Algorithms
More data
Value Based
Data

Benny Schnaider
VP Software Development, Oracle
THANK YOU

Similar to Benny Schnaider - the future of big data quality @IGTCloud

Impact of web latency on conversion rates

Alistair Croll

AI in Manufacturing - John.pdf

John Chang

Nvidia and ibm presentation feb18

IBM Sverige

Bill Barney's Key Note at the Wan Summit

William Barney

Benefits of AI, Global Manufacturing.

George Benaroya

RWS GE presentation by Sue Siegel

Rich Gardner

N. Ahmad, Digitalites activities: methodological challenges and empirical pit...

Istituto nazionale di statistica

2018 McRock Capital IIoT Symposium: IoT Reality Check, Maciej Kranz, Cisco

MTechHub

Where Do We Go From Here V01

ParkWood Advisors LLC

Snaplogic Academy Launch - Chennai

Karthik Sirasanagandla

The Next BIG Thing in SCM - AI @ CSCMP Barcelona

Thorsten Schroeer

The zen of business intelligence

Philipp Freytag von Loringhoven

IOT Paris Seminar 2015 - Enabling Transformation to the IOT

MongoDB

Going Cloud First at the FT

Amazon Web Services

How to achieve productivity gains through digitisation (CIHT Annual Conferenc...

Causeway Technologies

Technological advances in robotics, artificial intelligence (AI), and machine learning are ushering in a new age of automation, as machines increasingly match or outperform humans in a range of performance capabilities required for work activities. New research from the McKinsey Global Institute analyzes the automation potential of the global economy, the technical and economic factors that will determine the pace of adoption of automation technologies in the workplace, and their likely impact on global productivity and GDP growth.

James Manyika at AI Frontiers: A Future That Works: Automation, Employment, a...

AI Frontiers

Excelling in The New Era of Big Data

Happiest Minds Technologies

Ai driven rpa work fusion kyle hoback cwin18_nyc

Capgemini

Traversing the Digital Vortex, Lux Rao, Director & Leader, Digital Transforma...

Rahul Neel Mani

PowerPoint by Mr. Andy Wyckoff, Director of Science, Technology and Innovation, Skills Summit 2018, Porto. SSESSION 1: UNDERSTAND – Risks and opportunities in a digital world: the changing landscape of skills needs Objective: Build a common understanding of how the digital revolution transforms economies and societies, how the skills that people need in everyday life and in the workplace are changing, and which groups of the population are most at risk of being left behind

Ensuring growth, productivity and well-being in the face of the digital trans...

EduSkills OECD

Similar to Benny Schnaider - the future of big data quality @IGTCloud (20)

Impact of web latency on conversion rates

AI in Manufacturing - John.pdf

Nvidia and ibm presentation feb18

Bill Barney's Key Note at the Wan Summit

Benefits of AI, Global Manufacturing.

RWS GE presentation by Sue Siegel

N. Ahmad, Digitalites activities: methodological challenges and empirical pit...

2018 McRock Capital IIoT Symposium: IoT Reality Check, Maciej Kranz, Cisco

Where Do We Go From Here V01

Snaplogic Academy Launch - Chennai

The Next BIG Thing in SCM - AI @ CSCMP Barcelona

The zen of business intelligence

IOT Paris Seminar 2015 - Enabling Transformation to the IOT

Going Cloud First at the FT

How to achieve productivity gains through digitisation (CIHT Annual Conferenc...

James Manyika at AI Frontiers: A Future That Works: Automation, Employment, a...

Excelling in The New Era of Big Data

Ai driven rpa work fusion kyle hoback cwin18_nyc

Traversing the Digital Vortex, Lux Rao, Director & Leader, Digital Transforma...

Ensuring growth, productivity and well-being in the face of the digital trans...

Recently uploaded

JohnPollard-hybrid-app-RailsConf2024.pptx

JohnPollard37

Dubai, often portrayed as a shimmering oasis in the desert, faces its own set of challenges, including the occasional threat of flooding. Despite its reputation for opulence and modernity, the emirate is not immune to the forces of nature. In recent years, Dubai has experienced sporadic but significant floods, testing the resilience of its infrastructure and communities. Among the critical lifelines in this bustling metropolis is the Dubai International Airport, a bustling hub that connects the city to the world. This article explores the intersection of Dubai flood events and the resilience demonstrated by the Dubai International Airport in the face of such challenges.

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Orbitshub

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Edi Saputra

Decarbonising Commercial Real Estate: The Role of Operational Performance

IES VE

CNIC Information System with Pakdata Cf In Pakistan

danishmna97

Key topics covered: - Real-world examples of Choreo's comprehensive coverage from application design and deployment, security, scaling, and monitoring - Running different types of workloads, such as web applications, APIs, microservices, integrations, and tasks at scale, and wire them together to deliver seamless omnichannel digital experiences - How Choreo improves the developer experience by eliminating repetition, silos, and redundancy through enhanced discoverability and self-serviceability

Choreo: Empowering the Future of Enterprise Software Engineering

WSO2

At its core, the challenge of managing Human Resources data is an integration challenge: estimates range from 2-3 HR systems in use at a typical SMB, up to a few dozen systems implemented amongst enterprise HR departments, and these systems seldom integrate seamlessly between themselves. Providing a multi-tenant, cloud-native solution to integrate these hundreds of HR-related systems, normalize their disparate data models and then render that consolidated information for stakeholder decision making has been a substantial undertaking, but one significantly eased by leveraging Ballerina. In this session, we’ll cover: The overall software architecture for VHR’s Cloud Data Platform Critical decision points leading to adoption of Ballerina for the CDP Ballerina’s role in multiple evolutionary steps to the current architecture Roadmap for the CDP architecture and plans for Ballerina WSO2’s partnership in bringing continual success for the CD

Less Is More: Utilizing Ballerina to Architect a Cloud Data Platform

WSO2

Retrieval augmented generation (RAG) is the most popular style of large language model application to emerge from 2023. The most basic style of RAG works by vectorizing your data and injecting it into a vector database like Milvus for retrieval to augment the text output generated by an LLM. This is just the beginning. One of the ways that we can extend RAG, and extend AI, is through multilingual use cases. Typical RAG is done in English using embedding models that are trained in English. In this talk, we’ll explore how RAG could work in languages other than English. We’ll explore French, Chinese, and Polish.

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Zilliz

Key topics covered: - Understanding the basics of IAM and its significance in the modern enterprise. IAM in a platformless environment - Tackling real-world issues like prioritizing frictionless yet secure user access, securing high-value APIs, integrating to business, compliance, and adapting to cloud native environments with scalable solutions - Practical demonstrations of how WSO2 products can be instrumental in deploying efficient IAM solutions - Preparing for upcoming trends and innovations in identity management

Navigating Identity and Access Management in the Modern Enterprise

WSO2

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Juan lago vázquez

Architecting Cloud Native Applications

WSO2

In this session, we will discuss the journey of API governance from its initial, ungoverned state to the development of sophisticated models that tackle contemporary challenges. We'll explore how APIs have become essential in the intersection of business and technology, adapting to advancements and evolving needs. We'll focus on how organizations have moved from launching to monetizing APIs, using models like pay-per-use and subscriptions, and finding the right balance between technical implementation and business strategy. We'll also highlight the impact of governance on monetization strategies, especially how data security, compliance, and service quality influence pricing. Real-world examples will demonstrate the effective integration of governance with monetization, including AI's role in dynamic pricing. Looking ahead, we'll share insights into future trends in API governance and monetization, emphasizing the importance of adaptability, continuous learning, and innovation.

API Governance and Monetization - The evolution of API governance

WSO2

Effective data discovery is crucial for maintaining compliance and mitigating risks in today's rapidly evolving privacy landscape. However, traditional manual approaches often struggle to keep pace with the growing volume and complexity of data. Join us for an insightful webinar where industry leaders from TrustArc and Privya will share their expertise on leveraging AI-powered solutions to revolutionize data discovery. You'll learn how to: - Effortlessly maintain a comprehensive, up-to-date data inventory - Harness code scanning insights to gain complete visibility into data flows leveraging the advantages of code scanning over DB scanning - Simplify compliance by leveraging Privya's integration with TrustArc - Implement proven strategies to mitigate third-party risks Our panel of experts will discuss real-world case studies and share practical strategies for overcoming common data discovery challenges. They'll also explore the latest trends and innovations in AI-driven data management, and how these technologies can help organizations stay ahead of the curve in an ever-changing privacy landscape.

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc

Explore the latest trends and insights on JavaScript usage with Pixlogix's informative blog. Discover key statistics and facts about JavaScript's role in web development, its popularity among developers, and its impact on modern websites. Stay updated with the evolving landscape of JavaScript frameworks and libraries, and learn how they're shaping the future of web development. Gain valuable insights to enhance your JavaScript skills and stay ahead in the digital realm.

JavaScript Usage Statistics 2024 - The Ultimate Guide

Pixlogix Infotech

In today's digital world, trust is key to customer relationships, but keeping it is a huge challenge. Customers are well-informed and empowered, quick to change brands if their trust is broken, even if it costs them more. This puts a lot of pressure on organizations to handle trust and safety issues with great care and transparency. The challenge, however, is real. Fragmented solutions have left privacy, legal, and security teams in a perpetual cycle of catch-up, struggling to update privacy notices, manage customer data rights, and answer lengthy security questionnaires—all while trying to prove ROI to the business. It's a thankless job, filled with repetition, tedious tasks, and constant interdepartmental coordination. Combine this with fast regulatory changes and the quick evolution of AI, and it becomes overwhelming. Join this webinar to learn more about TrustArc's new innovative solution Trust Center, the only unified, no-code online hub for trust and safety information built for privacy, security, compliance, and legal teams. Trust Center streamlines your path to compliance, shortens the pre-sales cycle, and reduces both legal and regulatory risks, saving time, effort, and cost. This webinar will review: - Why companies are building unified Trust Centers for a robust privacy program. - How unified Trust Centers streamline sales cycles, ensure regulatory compliance, and reduce operational bottlenecks. - How compliance, legal, security, GRC, and privacy teams benefit from a unified Trust Center in terms of needs, pains, and outcomes. - How TrustArc Trust Center saves time and work while reducing legal, reputational, and compliance risk by effectively managing policies, notices, terms, and disclosures, and providing real-time updates on subprocessors.

TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...

TrustArc

Following the popularity of “Cloud Revolution: Exploring the New Wave of Serverless Spatial Data,” we’re thrilled to announce this much-anticipated encore webinar. In this sequel, we’ll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you’re building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

The integration landscape is changing rapidly with the introduction of technologies like GraphQL, gRPC, stream processing, iPaaS, and platformless. However, not all existing applications and industries can keep up with these new technologies. Certain industries, like manufacturing, logistics, and finance, still rely on well-established EDI-based message formats. Some applications use XML or CSV with file-based communications, while others have strict on premises deployment requirements. This talk focuses on how Ballerina's built-in integration capabilities can bridge the gap between "old" and "new" technologies, modernizing enterprise applications without disrupting business operations.

Modernizing Legacy Systems Using Ballerina

WSO2

DBX First Quarter 2024 Investor Presentation

Dropbox

Elevate Developer Efficiency & build GenAI Application with Amazon Q

Bhuvaneswari Subramani

The microservices honeymoon is over. When starting a new project or revamping a legacy monolith, teams started looking for alternatives to microservices. The Modular Monolith, or 'Modulith', is an architecture that reaps the benefits of (vertical) functional decoupling without the high costs associated with separate deployments. This talk will delve into the advantages and challenges of this progressive architecture, beginning with exploring the concept of a 'module', its internal structure, public API, and inter-module communication patterns. Supported by spring-modulith, the talk provides practical guidance on addressing the main challenges of a Modultith Architecture: finding and guarding module boundaries, data decoupling, and integration module-testing. You should not miss this talk if you are a software architect or tech lead seeking practical, scalable solutions. About the author With two decades of experience, Victor is a Java Champion working as a trainer for top companies in Europe. Five thousands developers in 120 companies attended his workshops, so he gets to debate every week the challenges that various projects struggle with. In return, Victor summarizes key points from these workshops in conference talks and online meetups for the European Software Crafters, the world’s largest developer community around architecture, refactoring, and testing. Discover how Victor can help you on victorrentea.ro : company training catalog, consultancy and YouTube playlists.

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024

Victor Rentea

Recently uploaded (20)

JohnPollard-hybrid-app-RailsConf2024.pptx

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Decarbonising Commercial Real Estate: The Role of Operational Performance

CNIC Information System with Pakdata Cf In Pakistan

Choreo: Empowering the Future of Enterprise Software Engineering

Less Is More: Utilizing Ballerina to Architect a Cloud Data Platform

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Navigating Identity and Access Management in the Modern Enterprise

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Architecting Cloud Native Applications

API Governance and Monetization - The evolution of API governance

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

JavaScript Usage Statistics 2024 - The Ultimate Guide

TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Modernizing Legacy Systems Using Ballerina

DBX First Quarter 2024 Investor Presentation

Elevate Developer Efficiency & build GenAI Application with Amazon Q

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024

Benny Schnaider - the future of big data quality @IGTCloud

1. The future of Big Data quality Benny Schnaider VP Software Development, Oracle BIG DATA

2. The more data the better

3. Machine Translation Competition 101110 010101

4. Rule based machine Translation

6. I would like to present to the committee... Ich möchte dem Ausschuss vorstellen... Je voudrais présenter au comité... 196 1799 2005

8. It takes X2 data to achieve 0.5% quality results improvement 8

9. 2005 Statistical machine Translation

10. Works great but still not “bullet-proof”

11. (‫)יסבחהום‬ "‫להם‬ ‫טוב‬ ‫"בוקר‬ "Ysabechhum" (‫)ידבחהום‬ "‫אותם‬ ‫"לשחוט‬ "Ydbachhum" ‫ﯾﺻﺑﺣﮭم‬‫ﯾدﺑﺣﮭم‬

12. The state of big data processing today

13. 70%

14. 14 IoT

15. Scylla Cassandra Alternative

16. ▪ ▪ o o ▪ • ▪ o

17.

18. ▪ o ▪ o o ▪ o

19. ▪ o o ▪ o o ▪ o ▪

20. So what makes data valuable?

21. Connected Car

22. Recent industry contact noted having real visibility into extracting $100/car of annual data-related revenue Connected car data worth $1.5 Trillion.

23. Sample Rate

24. Accuracy

25. Real-time

26. How do we price data? 011010000110010101101100011100000110100001100101011011000 111000001101000011001010000110010101101100011100000110100 001100101011011000111000001101000011001010110110001110000 011010000110010101101100011100000110100001100101011011000 111000001101000011001010110110001110000011010000110010101 101100011100000110100001100101011011000111000001101011011 000111000001101000011001010110110001110000011010000110010 101101100011100000110100001100101011011000111000001101000 011001010110110001110000011010000110010101101100011100000 110100011001010110110001110000011010000110010101101100011 100000110100001100101011011000111000001101000011001010110 110001110000011010000011001010110110001110000011010000110 010101101100011100000110100001100101011011000111000001101 000011001010110110001110000011010000110010101101100011100 000110100001100101011011000111000001101000 $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$ $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$ $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$ $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$ $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$ $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$ $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$ $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$ $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$ $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$ $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$ $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$ $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$ $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$ $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$

27. Big DataApplications Cleansing Algorithms More data

28. What if data could ‘store value’?

29. Utility

30. Value Store

31. Data Piracy my music 2004 mp3’s

32. We need a new technology

33. Blockchain

34.

35. 35 Trust

36. Authentic

37. Marketplace

38. Big DataApplications Cleansing Algorithms More data Value Based Data