Introduction to Big Data

•

0 likes•360 views

Moshe Kaplan

As part of the Tel Aviv University MBA Data Science Practice

Technology

Big Data:
Challenges and Opportunities
moshe.kaplan@brightaqua.com
http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan2
@2014

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
The Consumer Revolution
3
http://topyaps.com/wp-content/uploads/2013/03/You-are-the-product.-You-feeling-something.jpg

$http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan At the fraction of the cost… 4$

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan5
http://lifehacker.com/5697167/if-youre-not-paying-for-it-youre-the-product

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
Transportation
6

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
Moovit
7

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
The Medical Market Opportunities
8

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
MediSafe
9

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan10

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
Askem
11

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
Major Enablers:
Mobile, Cloud and IT Commoditization
12

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
The Prime Suspect
13

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan14
Assumptions…

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
RDBMS Are Here from the 70s
15
http://ksnicolas.weebly.com/nicolass-blog/in-my-time-machine-i-went-to

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
A Blog Case Study in MySQL
http://www.slideshare.net/nateabele/building-apps-with-mongodb

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
RDBMS Are Great
publishedbodyslugTitleid
17
bodyemailauthorpost_idid
Posts
Comments

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
Secured and Reliable for the Enterprise
18
https://vladmihalcea.com/tag/acid/

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan19
Assumptions…

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
Where did it Fail?
Get an Answer, Fast and Cheap

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
Where did it Fail?
I Just Want “Class Persistency Storage”
and Changing Schema on Demand

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
Where did it Fail?
Be Always Available, Even w/ an Old Answer

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
Where did it Fail?
Get Me Fast and Good Enough Answer

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
Where did it Fail?
Data is Too Big, and Storage is $$$
But CPU and Network are Even More
http://www.powerbyte.com/Isilon.html

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
Software Providers
25

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
It is all great, but…
I Need to Meet Compliance
http://www.vision7.com/app_system/lib/image/content/PCI_compliance.jpg

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
It is all great, but…
I Need a Vendor

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
It is all great, but…
I Need Reporting
http://www.novell.com/communities/node/5851/get-ready-sentinel-61

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
It is all great, but…
I Need Transactions
http://www.novell.com/communities/node/5851/get-ready-sentinel-61

$http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan It is all great, but… We Need Training for the Data Analysts db.article.aggregate( { $group : { _id : "$author", docsPerAuthor : { $sum : 1 }, viewsPerAuthor : { $sum : "$pageViews" } }} ); < SUM(pageViews) < SUM(1) = N < GROUP BY author$

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
The VP R&D Open Seminar
BIG DATA ARCHITECTURES
31

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
OLTP vs OLAP
32
https://www.linkedin.com/pulse/big-data-analytics-reference-architectures-facebook-sahu

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
And How it Looks
33
https://www.linkedin.com/pulse/big-data-analytics-reference-architectures-facebook-sahu

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
The VP R&D Open Seminar
SCALING TO
HIGH THROUGHPUT
Redis
34

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
Key Value Store (with benefits)
insert
get
multiget
remove
truncate
35
<Key, Value>
http://wiki.apache.org/cassandra/API

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
1 Minute Installation
http://mariuszprzydatek.com/2014/08/23/amazon-aws-installing-
redis-on-ebs/
36

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
Fast. Very Fast
37

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
The VP R&D Open Seminar
SCALING COMPLEX DATA
MongoDB
38

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
When Should I Choose NoSQL?
Eventually Consistent
Document Store
Key Value
39
http://guyharrison.squarespace.com/blog/tag/nosqlhttps://en.wikipedia.org/wiki/Eric_Brewer_(scientist)

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
What mongoDB is Made of?
40
http://www.10gen.com/products/mongodb

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
Why MongoDB?
What? Why?
JSON End to End
No Schema “No DBA”, Just Serialize
Write 10K Inserts/sec on virtual machine
Read Similar to MySQL
HA 10 min to setup a cluster
Sharding Out of the Box
LBS Great for that
No Schema None: no downtime to create new columns
Buzz Trend is with NoSQL
41

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
The VP R&D Open Seminar
DESIGN FOR NOSQL
MongoDB
42

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
Database for Software Engineers
Class
Subclass
Document
Subdocument

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
Same Terminology
Database  Database
Table  Collection
Row  Document

http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com © Moshe Kaplan
as a SW Engineer would like it to be…
http://www.slideshare.net/nateabele/building-apps-with-mongodb

Viewers also liked

Необычные СПА процедуры мира

Айназ Волкова

Piet daas big_data_official_statistics_target_groningen

Piet J.H. Daas

Lex Pater (Flevoziekenhuis) - Slim omgaan met ziekenhuisdata

AlmereDataCapital

Relaciones laborales en Salud Publica

Segundo Villanueva Novoa

Delitos Contra la Administración pública

Jhon Abad Robles

October 2016 classes

Colleen Mcgraw

Qué y a dónde más parte 1 de 3

gotsis

Revolucioindustrial

finamorenoo

Minions Case Study - UK

Sian O'Flaherty

Sotfware libre: Jonathan L, Adriannys G, Johana R, Krismar P, Francisco O, Ka...

Universidad Politécnica "Jose Antonio Anzoategui"

VIII SEMINARIO DE INNOVACIÓN Y EMPRENDIMIENTO EN GESTIÓN Y SERVICIOS - Liz Al...

CONSEJERIA DE SALUD DE LA JUNTA DE ANDALUCIA

Today, our everyday access to technology permits a health monitoring that can complement the traditional methods in Healthcare and Public Health. In this paper, we present some of this available technology, with a particular focus on disease detection, topological data analysis, and media monitoring tools, made available by the AILAB at the JSI and the ISI Foundation. This technology is ready to be adapted to research and commercial problems in the context of health systems.

Supporting epidemic intelligence, personalised and public health with advance...

Joao Pita Costa

Erasure Coding and Tiering.

Red_Hat_Storage

AppHotels es la primera aplicación en el mundo para sistemas Móvil con la cual tu hotel administrará autónomamente los contenidos, las ofertas y un sistema de reserva en línea para que tus clientes reserven en tiempo real. Todas las informaciones y toda la interacción posible entre tus clientes y tú directamente en sus teléfonos. Tu hotel siempre en el bolsillo de tus clientes. Nuestra plataforma única en el mundo permite administrar rápida y fácilmente la customización de la App y es suficientemente versátil como para permitir tener un producto personalizado al mismo precio de un producto industrializado. ¡Tenemos los precios más baratos! Consulta nuestro listín de precios en www.ithotelsolutions.com Otra novedad absoluta es el manejo de las informaciones turísticas de tu territorio; AppHotels las administrará directamente en varios idiomas. Excelencias turísticas, eventos, museos y todo lo que el territorio ofrece siempre estará actualizado, geolocalizado hasta con realidad aumentada y con función de navegador. La App ha sido desarrollada para funcionar en sistemas operativos iOS (Apple) y Android (Google, HTC, Samsung, LG, Acer, Sony Ericsson, Motorola) La App está traducida en dos idiomas (italiano e inglés) pero se puede traducir a todos los idiomas que el hotel desee. El grafismo de la App se puede escoger entre los tres skins Tourist, Business o Luxury o se puede elegir uno personalizado. La App estará dividida en 4 macroáreas: Reserva en línea, Ofertas y Servicios, Informaciones, Público. ¡Cuidado! Nuestra App es auténtica, no es ni una WEB-APP ni un sitio Móvil.

IT Hotel Solutions - APPHotels iPhone & Android

IT Hotel Solutions

The Second Web

John Blossom

Viewers also liked (15)

Необычные СПА процедуры мира

Piet daas big_data_official_statistics_target_groningen

Lex Pater (Flevoziekenhuis) - Slim omgaan met ziekenhuisdata

Relaciones laborales en Salud Publica

Delitos Contra la Administración pública

October 2016 classes

Qué y a dónde más parte 1 de 3

Revolucioindustrial

Minions Case Study - UK

Sotfware libre: Jonathan L, Adriannys G, Johana R, Krismar P, Francisco O, Ka...

VIII SEMINARIO DE INNOVACIÓN Y EMPRENDIMIENTO EN GESTIÓN Y SERVICIOS - Liz Al...

Supporting epidemic intelligence, personalised and public health with advance...

Erasure Coding and Tiering.

IT Hotel Solutions - APPHotels iPhone & Android

The Second Web

Similar to Introduction to Big Data

The api economy

Moshe Kaplan

Big Data Workshop

Moshe Kaplan

We all want to be quicker, more productive and collaborate rapidly on any device at any time. The good news is that our technology continues to innovate at the speed of light. The bad news is true adoption is sorely lacking, we often stick to what we know. Join Heather Newman, Microsoft MVP and Chief Marketing Officer of Content Panda, as she uses real-world use cases to provide you the blueprint for a metamorphic change in employee productivity and simple tips and tricks for using Microsoft Teams and Microsoft Planner on the go. You’ll leave this session with a clear understanding of how your employees can leverage both Microsoft Teams and Planner together with OneNote, OneDrive and SharePoint. Shazam!

SharePoint Saturday Cape Town 2019 - - Without Change, There Would Be No Butt...

Heather Newman

Big Data Seminar: Analytics, Hadoop, Map Reduce, Mongo and other great stuff

Moshe Kaplan

UK Community day 20180206 PowerApps hackathon

Penny Coventry

Web Systems Architecture by Moshe Kaplan

Moshe Kaplan

Notes on Deploying Machine-learning Models at Scale

Deep Kayal

Microsoft Teams and Planner Global Azure Bootcamp

Heather Newman

敏捷開發心法

Bryan Yang

Do I Use Planner, Project Online, or Azure DevOps?

Christian Buckley

Office 365 Tour South Africa - Port Elizabeth - Without Change, There Would B...

Heather Newman

Scale and Cloud Design Patterns

Moshe Kaplan

Lean methodology sfd szeged 2011

Kristof Van Tomme

Overview MSBizApps & MPP - Cork PBI UG

Clifton Lenne

Starter Kit for Collaboration from Karuana @ Microsoft IT

Karuana Gatimu

MongoDB training for java software engineers

Moshe Kaplan

Harnessing the cloud to create social mobile apps that scale

Abe Pachikara

The Future of Forecasting and Budgeting

James Myers

Microsoft 365 Copilot is a revolutionary productivity assistant that leverages large language models (LLMs) and your organisational data to help you create, communicate, and collaborate more effectively across Microsoft 365 apps. Copilot can assist you with various tasks, such as drafting emails, making presentations, processing data, and finding insights. But to make the most of this game-changing technology, you must master three key aspects: adoption, data security, and governance. In this two-part session, a Microsoft 365 expert, Nikki will guide you through these aspects and show you how to use Copilot to boost your productivity, creativity, and confidence. In the first part of the session, Nikki will focus on adoption. She will explain that Copilot is not just a tool—it’s a mindset. It’s about embracing AI as a partner, not a threat. It’s about creating a culture of AI literacy in your organisation, where everyone can use Copilot’s features and understand its limits. It’s about using Copilot to enhance your skills and outcomes, not to replace them. Key takeaways: – What Microsoft 365 Copilot is, and how it works – How to build your business case for Microsoft 365 Copilot – How to adopt Microsoft 365 Copilot in your organisation and overcome common barriers and challenges

Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...

Nikki Chapple

Surge engr 245 lean launchpad stanford 2020

Stanford University

Similar to Introduction to Big Data (20)

The api economy

Big Data Workshop

SharePoint Saturday Cape Town 2019 - - Without Change, There Would Be No Butt...

Big Data Seminar: Analytics, Hadoop, Map Reduce, Mongo and other great stuff

UK Community day 20180206 PowerApps hackathon

Web Systems Architecture by Moshe Kaplan

Notes on Deploying Machine-learning Models at Scale

Microsoft Teams and Planner Global Azure Bootcamp

敏捷開發心法

Do I Use Planner, Project Online, or Azure DevOps?

Office 365 Tour South Africa - Port Elizabeth - Without Change, There Would B...

Scale and Cloud Design Patterns

Lean methodology sfd szeged 2011

Overview MSBizApps & MPP - Cork PBI UG

Starter Kit for Collaboration from Karuana @ Microsoft IT

MongoDB training for java software engineers

Harnessing the cloud to create social mobile apps that scale

The Future of Forecasting and Budgeting

Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...

Surge engr 245 lean launchpad stanford 2020

More from Moshe Kaplan

Spark and C Integration

Moshe Kaplan

Git Tutorial

Moshe Kaplan

Redis training for java software engineers

Moshe Kaplan

This week I had a session w/ one the Israeli largest Telcos, regarding BillRun!, their new billing solution: an open source billing solution that is based on MongoDB. We covered in this 3 days course: 1) NoSQL background, 2) MongoDB introduction and setup; 3) NoSQL Data Model; 4) NoSQL query language and aggregation framework; 5) Performance tuning; 6) Operations: backup, restore, monitoring and security and 7) HA and scale using Replica set and Sharding

MongoDB from Basics to Scale

Moshe Kaplan

MongoDB Best Practices for Developers

Moshe Kaplan

Introduction to MongoDB

Moshe Kaplan

MySQL Multi Master Replication

Moshe Kaplan

mongoDB Performance

Moshe Kaplan

MySQL crash course by moshe kaplan

Moshe Kaplan

Expert Days: The VP R&D Open Seminar: Project Management

Moshe Kaplan

As technical leader you face a challenge: more traffic, more users, more connected systems and more features. The results can be lack of system performance. If you want to be ready for the day of doom, if you want to solve issues before business will get mad or just want to be the hero of the day, this is the workshop for you. In this workshop we'll cover all aspects of modern web systems and will analyze all the things that can go wrong. More important we will understand what is a clutter and what should be taken care of using a set of simple tools and steps. Among the covered items in this workshop: databases, your code, application servers, web servers, system aspects, storages, network and even the browser.

Expert Days 2011: The VP R&D Open Seminar: Systems Performance Seminar

Moshe Kaplan

How MySQL become an Internet standard? based on a presentation I gave at the Database2011 conference: Who uses MySQL? (everyone inc. Facebook, Twitter and Google), What are MySQL limitations? (multi threading, INSERTS, SELECTS), How the big boys solved these issues? (Sharding, Partitioning), What are the pros and cons for each Sharding strategy? (Vertical, Horizonal: directory based, static hashing, signature based), How to implement Sharding from an applicative view? How to take care of reporting? What are the emerging solutions in this field? (Gizzard, ScaleBase, Xeround and Akibian)

Database2011 MySQL Sharding

Moshe Kaplan

Cloud Computing Design Best Practices

Moshe Kaplan

Better Gantts and Project Management

Moshe Kaplan

Better Gantts and Project Management

Moshe Kaplan

Better gantts and project management

Moshe Kaplan

Extract The Traffic From The Db

Moshe Kaplan

In the last past months we at RockeTier were working with several large organizations in three aspects: 1) boosting existing software performance (lean projects); 2) design new systems which are capable process billions of events per day based on commodity hardware and software and 3) establishing processes in large organization that support the life cycle of performance from event management, problem management to establishing a continues performance boosting to the organization systems from RFI to production. This presentation was presented to a large telecommunication industry company. This company is considering implementing a 360 degrees performance boosting project along its main product lines.

Organization Wide Performance Methodology (ITIL)

Moshe Kaplan

More from Moshe Kaplan (18)

Spark and C Integration

Git Tutorial

Redis training for java software engineers

MongoDB from Basics to Scale

MongoDB Best Practices for Developers

Introduction to MongoDB

MySQL Multi Master Replication

mongoDB Performance

MySQL crash course by moshe kaplan

Expert Days: The VP R&D Open Seminar: Project Management

Expert Days 2011: The VP R&D Open Seminar: Systems Performance Seminar

Database2011 MySQL Sharding

Cloud Computing Design Best Practices

Better Gantts and Project Management

Better gantts and project management

Extract The Traffic From The Db

Organization Wide Performance Methodology (ITIL)

Recently uploaded

Following the popularity of “Cloud Revolution: Exploring the New Wave of Serverless Spatial Data,” we’re thrilled to announce this much-anticipated encore webinar. In this sequel, we’ll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you’re building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

CNIC Information System with Pakdata Cf In Pakistan

danishmna97

Strategies for Landing an Oracle DBA Job as a Fresher

Remote DBA Services

Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...

Zilliz

Corporate and higher education. Two industries that, in the past, have had a clear divide with very little crossover. The difference in goals, learning styles and objectives paved the way for differing learning technologies platforms to evolve. Now, those stark lines are blurring as both sides are discovering they have content that’s relevant to the other. Join Tammy Rutherford as she walks through the pros and cons of corporate and higher ed collaborating. And the challenges of these different technology platforms working together for a brighter future.

Corporate and higher education May webinar.pptx

Rustici Software

The Good, the Bad and the Governed - Why is governance a dirty word? David O'Neill, Chief Operating Officer - APIContext Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

apidays

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

sammart93

Dubai, often portrayed as a shimmering oasis in the desert, faces its own set of challenges, including the occasional threat of flooding. Despite its reputation for opulence and modernity, the emirate is not immune to the forces of nature. In recent years, Dubai has experienced sporadic but significant floods, testing the resilience of its infrastructure and communities. Among the critical lifelines in this bustling metropolis is the Dubai International Airport, a bustling hub that connects the city to the world. This article explores the intersection of Dubai flood events and the resilience demonstrated by the Dubai International Airport in the face of such challenges.

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Orbitshub

Axa Assurance Maroc - Insurer Innovation Award 2024

The Digital Insurer

Following the popularity of "Cloud Revolution: Exploring the New Wave of Serverless Spatial Data," we're thrilled to announce this much-anticipated encore webinar. In this sequel, we'll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you're building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

Manulife - Insurer Transformation Award 2024

The Digital Insurer

ICT role in 21st century education and its challenges

rafiqahmad00786416

Scaling API-first – The story of a global engineering organization Ian Reasor, Senior Computer Scientist - Adobe Radu Cotescu, Senior Computer Scientist - Adobe Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

apidays

Boost Fertility New Invention Ups Success Rates.pdf

sudhanshuwaghmare1

Abhishek Deb(1), Mr Abdul Kalam(2) M. Des (UX) , School of Design, DIT University , Dehradun. This paper explores the future potential of AI-enabled smartphone processors, aiming to investigate the advancements, capabilities, and implications of integrating artificial intelligence (AI) into smartphone technology. The research study goals consist of evaluating the development of AI in mobile phone processors, analyzing the existing state as well as abilities of AI-enabled cpus determining future patterns as well as chances together with reviewing obstacles as well as factors to consider for more growth.

Exploring the Future Potential of AI-Enabled Smartphone Processors

debabhi2

DBX First Quarter 2024 Investor Presentation

Dropbox

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

MadyBayot

Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on the deployment of external web forms using Jotform for Bonterra Impact Management. This solution can be customized to your organization’s needs and deployed to support the common use cases below: - Intake and consent - Assessments - Surveys - Applications - Program registration Interested in deploying web form automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Jeffrey Haguewood

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Zilliz

💉💊+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHABI}}+971581248768 +971581248768 Mtp-Kit (500MG) Prices » Dubai [(+971581248768**)] Abortion Pills For Sale In Dubai, UAE, Mifepristone and Misoprostol Tablets Available In Dubai, UAE CONTACT DR.Maya Whatsapp +971581248768 We Have Abortion Pills / Cytotec Tablets /Mifegest Kit Available in Dubai, Sharjah, Abudhabi, Ajman, Alain, Fujairah, Ras Al Khaimah, Umm Al Quwain, UAE, Buy cytotec in Dubai +971581248768''''Abortion Pills near me DUBAI | ABU DHABI|UAE. Price of Misoprostol, Cytotec” +971581248768' Dr.DEEM ''BUY ABORTION PILLS MIFEGEST KIT, MISOPROTONE, CYTOTEC PILLS IN DUBAI, ABU DHABI,UAE'' Contact me now via What's App…… abortion Pills Cytotec also available Oman Qatar Doha Saudi Arabia Bahrain Above all, Cytotec Abortion Pills are Available In Dubai / UAE, you will be very happy to do abortion in Dubai we are providing cytotec 200mg abortion pill in Dubai, UAE. Medication abortion offers an alternative to Surgical Abortion for women in the early weeks of pregnancy. We only offer abortion pills from 1 week-6 Months. We then advise you to use surgery if its beyond 6 months. Our Abu Dhabi, Ajman, Al Ain, Dubai, Fujairah, Ras Al Khaimah (RAK), Sharjah, Umm Al Quwain (UAQ) United Arab Emirates Abortion Clinic provides the safest and most advanced techniques for providing non-surgical, medical and surgical abortion methods for early through late second trimester, including the Abortion By Pill Procedure (RU 486, Mifeprex, Mifepristone, early options French Abortion Pill), Tamoxifen, Methotrexate and Cytotec (Misoprostol). The Abu Dhabi, United Arab Emirates Abortion Clinic performs Same Day Abortion Procedure using medications that are taken on the first day of the office visit and will cause the abortion to occur generally within 4 to 6 hours (as early as 30 minutes) for patients who are 3 to 12 weeks pregnant. When Mifepristone and Misoprostol are used, 50% of patients complete in 4 to 6 hours; 75% to 80% in 12 hours; and 90% in 24 hours. We use a regimen that allows for completion without the need for surgery 99% of the time. All advanced second trimester and late term pregnancies at our Tampa clinic (17 to 24 weeks or greater) can be completed within 24 hours or less 99% of the time without the need surgery. The procedure is completed with minimal to no complications. Our Women's Health Center located in Abu Dhabi, United Arab Emirates, uses the latest medications for medical abortions (RU-486, Mifeprex, Mifegyne, Mifepristone, early options French abortion pill), Methotrexate and Cytotec (Misoprostol). The safety standards of our Abu Dhabi, United Arab Emirates Abortion Doctors remain unparalleled. They consistently maintain the lowest complication rates throughout the nation. Our Physicians and staff are always available to answer questions and care for women in one of the most difficult times in their lives. The decision to have an abortion at the Abortion Cl

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@

Recently uploaded (20)

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

CNIC Information System with Pakdata Cf In Pakistan

Strategies for Landing an Oracle DBA Job as a Fresher

Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...

Corporate and higher education May webinar.pptx

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Axa Assurance Maroc - Insurer Innovation Award 2024

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Manulife - Insurer Transformation Award 2024

ICT role in 21st century education and its challenges

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Boost Fertility New Invention Ups Success Rates.pdf

Exploring the Future Potential of AI-Enabled Smartphone Processors

DBX First Quarter 2024 Investor Presentation

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

Introduction to Big Data

1. Big Data: Challenges and Opportunities moshe.kaplan@brightaqua.com http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com

3. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan The Consumer Revolution 3 http://topyaps.com/wp-content/uploads/2013/03/You-are-the-product.-You-feeling-something.jpg

4. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan At the fraction of the cost… 4

5. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan5 http://lifehacker.com/5697167/if-youre-not-paying-for-it-youre-the-product

8. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan The Medical Market Opportunities 8

12. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan Major Enablers: Mobile, Cloud and IT Commoditization 12

15. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan RDBMS Are Here from the 70s 15 http://ksnicolas.weebly.com/nicolass-blog/in-my-time-machine-i-went-to

16. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan A Blog Case Study in MySQL http://www.slideshare.net/nateabele/building-apps-with-mongodb

17. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan RDBMS Are Great publishedbodyslugTitleid 17 bodyemailauthorpost_idid Posts Comments

18. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan Secured and Reliable for the Enterprise 18 https://vladmihalcea.com/tag/acid/

20. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan Where did it Fail? Get an Answer, Fast and Cheap

21. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan Where did it Fail? I Just Want “Class Persistency Storage” and Changing Schema on Demand

22. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan Where did it Fail? Be Always Available, Even w/ an Old Answer

23. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan Where did it Fail? Get Me Fast and Good Enough Answer

24. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan Where did it Fail? Data is Too Big, and Storage is $$$ But CPU and Network are Even More http://www.powerbyte.com/Isilon.html

26. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan It is all great, but… I Need to Meet Compliance http://www.vision7.com/app_system/lib/image/content/PCI_compliance.jpg

27. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan It is all great, but… I Need a Vendor

28. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan It is all great, but… I Need Reporting http://www.novell.com/communities/node/5851/get-ready-sentinel-61

29. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan It is all great, but… I Need Transactions http://www.novell.com/communities/node/5851/get-ready-sentinel-61

30. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan It is all great, but… We Need Training for the Data Analysts db.article.aggregate( { $group : { _id : "$author", docsPerAuthor : { $sum : 1 }, viewsPerAuthor : { $sum : "$pageViews" } }} ); < SUM(pageViews) < SUM(1) = N < GROUP BY author

31. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan The VP R&D Open Seminar BIG DATA ARCHITECTURES 31

32. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan OLTP vs OLAP 32 https://www.linkedin.com/pulse/big-data-analytics-reference-architectures-facebook-sahu

33. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan And How it Looks 33 https://www.linkedin.com/pulse/big-data-analytics-reference-architectures-facebook-sahu

34. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan The VP R&D Open Seminar SCALING TO HIGH THROUGHPUT Redis 34

35. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan Key Value Store (with benefits) insert get multiget remove truncate 35 <Key, Value> http://wiki.apache.org/cassandra/API

36. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan 1 Minute Installation http://mariuszprzydatek.com/2014/08/23/amazon-aws-installing- redis-on-ebs/ 36

38. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan The VP R&D Open Seminar SCALING COMPLEX DATA MongoDB 38

39. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan When Should I Choose NoSQL? Eventually Consistent Document Store Key Value 39 http://guyharrison.squarespace.com/blog/tag/nosqlhttps://en.wikipedia.org/wiki/Eric_Brewer_(scientist)

40. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan What mongoDB is Made of? 40 http://www.10gen.com/products/mongodb

41. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan Why MongoDB? What? Why? JSON End to End No Schema “No DBA”, Just Serialize Write 10K Inserts/sec on virtual machine Read Similar to MySQL HA 10 min to setup a cluster Sharding Out of the Box LBS Great for that No Schema None: no downtime to create new columns Buzz Trend is with NoSQL 41

42. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan The VP R&D Open Seminar DESIGN FOR NOSQL MongoDB 42

43. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan Database for Software Engineers Class Subclass Document Subdocument

44. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan Same Terminology Database  Database Table  Collection Row  Document

45. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan A Blog Case Study in MySQL http://www.slideshare.net/nateabele/building-apps-with-mongodb

46. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com © Moshe Kaplan as a SW Engineer would like it to be… http://www.slideshare.net/nateabele/building-apps-with-mongodb

Introduction to Big Data

Recommended

Recommended

More Related Content

Viewers also liked

Viewers also liked (15)

Similar to Introduction to Big Data

Similar to Introduction to Big Data (20)

More from Moshe Kaplan

More from Moshe Kaplan (18)

Recently uploaded

Recently uploaded (20)

Introduction to Big Data