SlideShare a Scribd company logo
MongoDB 3.4
The Leading Non-Relational
Database Evolved
Jason Ma
Andrew Morgan
Introduction
Multi-model done right
Mission Critical Applications
Modernized tooling
Q&A
Agenda
Evolution of MongoDB
Hash-Based Sharding
Roles
Kerberos
On-Prem Monitoring
2.4 2.6 3.0 3.2
$out
Index Intersection
Text Search
Field-Level
Redaction
LDAP & x509
Auditing
Document Validation
$lookup
Fast Failover
Simpler Scalability
Aggregation ++
Encryption At Rest
In-Memory Storage
Engine
BI Connector
MongoDB Compass
APM Integration
Profiler Visualization
Auto Index Builds
Backups to File System
Doc-Level
Concurrency
Compression
Storage Engine API
≤50 replicas
Auditing ++
Ops Manager
Intra-cluster compression
Views
Log Redaction
Linearizable Reads
Graph Processing
Decimal
Collations
Faceted Navigation
Spark Connector ++
Zones ++
Aggregation ++
Auto-balancing ++
ARM, Power, zSeries support
BI Connector ++
Compass ++
Hardware Monitoring
Server Pool
LDAP Authorization
Encrypted Backups
Cloud Foundry Integration
3.4
Multi-model done right. Other vendors sell you multiple products. MongoDB gives
you multiple models in one database: document, graph, key value, and search with
faceted navigation.
Mission-critical apps. Stronger security, broader platform support, and Zones
make MongoDB ready for the most demanding mission-critical deployments.
Modernized tooling. A sophisticated range of tools and integrations provide
powerful capabilities for Data Analysts, DBAs, and Operations teams.
MongoDB 3.4 Themes
Multi-Model
Done Right
• Enables processing of graph data natively within
MongoDB with $graphLookup operator
• Uncover indirect or transitive relationships in
operational data
• Recommendation engines, MDM, fraud models, social
networks, etc.
Graph Processing
$graphLookup Example
_id: 3
friends[0].id: 193
db.users.aggregate(
[
{$match: {_id: 3}},
{"$graphLookup": {
from: "users",
startWith: "$friends.id",
connectFromField: "friends.id",
connectToField: "_id",
maxDepth: 2,
depthField: "depth",
as: "target"}
}
],
{allowDiskUse: true}).pretty()
Graph Processing
{
"target": {
"_id": 678,
"meetupCount": 98,
"details": [
{
"firstName": "Jesse",
"lastName": "Bennett"
}
]
},
"requestIntroFrom": {
"id": 541,
"details": [
{
"firstName" : "Arthur",
"lastName" : "Boyd",
"contact" : {
"email" : "aboydf0@canalblog.com",
"phone" : "86-(656)576-9389"
}}]}}
Graph Processing
https://github.com/am-MongoDB/meetupGraph
Faceted Navigation
• Grouping data into related categories for intuitive
exploration & discovery
• Used in search and analytics applications
• New aggregation pipeline stages for faceting,
bucketing & sorted counts across multiple
dimensions
• Eliminates requirement for external search engine
https://github.com/am-MongoDB/TVnav
Faceted Navigation
Faceted Navigation
Faceted Navigation
db.products.aggregate([
{$match: {category: "TV"}},
{$facet: {
price: [
{$bucket: {
groupBy: "$price",
boundaries: [0, 200, 699, 1000, 1500],
default: "Over 1500",
output: {"count": {$sum: 1}}
}},
{$project: {
lowerPriceBound: "$_id",
count: 1,
_id: 0}}],
brands: [
{$sortByCount: "$brand" },
{$project: {
brand: "$_id",
count: 1,
_id: 0}}],
…
}}
Faceted Navigation
{"price" : [
{"count" : 29,
"lowerPriceBound" : 0},
{"count" : 272,
"lowerPriceBound" : 200},
{"count" : 165,
"lowerPriceBound" : 699},
{
"count" : 260,
"lowerPriceBound" : 1000
},
{"count" : 274,
"lowerPriceBound" : "Over 1500"
],
"brands" : [
{"count" : 277,
"brand" : "SAMSUNG"},
{"count" : 169,
"brand" : "PANASONIC"},
• Data set, query and results:
• https://github.com/am-MongoDB/TVnav
Faceted Navigation
• Powerful data processing pipeline for
analytics & transformations
• 25+ enhancements simplify app code
• Performance improvements with query
optimizer moving $match stage earlier to
use indexes
New Stages
Array
Operators
String & Date
Operators
$graphLookup
$facet
$bucket
$bucketAuto
$sortbyCount
$addFields
$replaceRoot
$in
$indexOfArray
$range
$reverseArray
$reduce
$zip
$indexOfBytes
$indexOfCP
$split
$strLenBytes
$strLenCP
$substrBytes
$substrCP
$isoDayOfWeek
$isoWeek
$isoWeekYear
Advanced Analytics
Aggregation Framework Enhancements
• Create powerful visualizations & analytics from
SQL-based BI tooling
• Auto-schema sampling
• Eliminates ETL
• Higher performance with rewritten SQL layer
• More processing pushed down to the database
• Simplified installation and authentication
Advanced Analytics
MongoDB Connector for BI
“We reduced 100+ lines of integration code to just a single line after moving to the MongoDB Spark connector.”
- Early Access Tester, Multi-National Banking Group Group
Analytics Application
Scala, Java, Python, R APIs
SQL
Machine
Learning
Libraries
Streaming Graph
Spark
Worker
Spark
Worker
Spark
Worker
Spark
Worker
MongoDB Connector for Spark
Advanced Analytics
MongoDB Connector for Apache Spark
• Native Scala connector, certified by Databricks
• Exposes all Spark APIs & libraries
• Efficient data filtering with predicate pushdown,
secondary indexes, & in-database
aggregations
• Locality awareness to reduce data movement
• Updated with Spark 2.0 support
• Text comparisons and sorting using language-
specific rules
• 100+ different languages & locales
• Over 2x as many as offered by most RDBMs
• Case sensitivity, treatments of numbers
• Collection | View | Index | Operation
Collations
db.customers.createIndex(
{last_name: 1, first_name : 1 },
{name: "german_name_index",
collation: {locale: "de"},
partialFilterExpression: {
language: "German" }})
db.createView(
"germanSpeakers",
"customers",
[{$match: {
language: "German",
last_name: {$exists: true}}}],
{collation: {locale: "de"}})
Collations
• Support for the IEEE 754-2008 decimal128 type in
server and drivers
• Database stores exact values to eliminate
rounding errors for high-precision calculations,
complex financial & scientific apps
Decimal128
Decimal Data Type
Mission-Critical
Applications
Partition data across distributed clusters based on
data locality policies
• Support distributed local writes
• Easily adhere to data sovereignty requirements
• Enable deployment patterns such as tiered
storage
MongoDB Zones can now be configured visually from Ops Manager
Zones
Seamless and elastic scalability in response to
dynamic application demands
• Improved balancing of data across nodes with
parallel data migrations
• Faster replica set synchronization with optimized
initial sync process
Elastic Clusters
With snappy compression algorithm, network traffic
can be compressed by up to 70%
• Performance benefits in bandwidth-constrained
environments
• Significantly reduce network costs
Intra-Cluster Compression
maxStalenessMS Read Preference
• Choose how and when to route queries to secondary replicas
• Only read from replicas that are within a defined consistency
window
• Improved data quality while scaling reads across secondaries
linearizable Read Concern for the strongest
consistency guarantees of any database
• Ensure that a node is the primary at the time of read
• Ensure that data returned will not be rolled back if another
node is subsequently elected as primary
Improved Tunable Consistency
LDAP authentication & authorization reduces
administrative overhead & TCO
• Users stored in LDAP server can be mapped to
MongoDB roles
• Native platform libraries to integrate with LDAP;
no need for external dependencies and
configuration
LDAP Authorization
Define dynamically generated non-materialized views
to expose selected data from underlying collection(s)
• Reduces risk of sensitive data exposure
• Separately specified permissions levels
• Allows organizations to more easily meet compliance
standards in regulated industries
• Can generate additional fields
Read-Only Views
Collation/Views Example
db.createView(
"germanSpeakersRedacted",
"customers",
[
{$match: {
language: "German",
last_name: {
$exists: true}}},
{$project: {
salary: 0,
country: 0,
language: 0
}
}
],
{collation: {locale: "de"}}
)
use admin
db.createRole(
{
role: "germanViewer",
privileges: [
{resource: {
db: "production",
collection:
germanSpeakersRedacted"},
actions: ["find"]}
],
roles: []
}
)
Collation/Views Example
Support the growing demand to run the database on
a more diverse range of platforms
• ARM v8-64 bit support allows customers to take advantage of
power-efficient servers being deployed into ultra dense data
center racks
• IBM Power8 and zSeries support provides seamless migration
for enterprises modernizing legacy workloads. Available for
MongoDB Enterprise Server.
Expanded Platform Support
Modernized
Tooling
• MongoDB 3.2
• Visualize Indexes
• Query Performance
• MongoDB 3.4
• MongoDB Compass enhancements
• Modify documents
• Create document validation rules
• Optimize query performance with visual explain
plans, index usage, and real-time statistics
• Create and remove indexes
• All controlled from a single intuitive and
sophisticated GUI
MongoDB Compass 3.4
Real Time Performance Stats
• View key
MongoDB metrics
that are
happening in real-
time
• Operation
statistics (inserts,
deletes, queries,
etc)
• Read/Write Load,
Network load,
Memory usage
Insert, Delete, Modify Documents
● Clone, modify existing documents, insert new documents, and delete
existing documents
● For now, applicable to one document at time
Document Validation Rule Builder
● MongoDB Compass allows users to view, add, and modify document
validation rules through its GUI
● Different teams can enforce schema consistency, reducing risk and
increasing productivity between teams
Visualize Explain Plans
● View key
information about
the execution of a
query
● Identify slow
running queries
and optimize
query
performance
View Index Utilization
● Visualization of
index utilization
● View type of
index, size of
index, usage of
index, and
properties of
index
Create and Remove Indexes
● Create and
Remove indexes
in GUI
● Enhances ability
for users to
identify and fix
issues from the
GUI
MongoDB Ops Manager 3.4
Ops Manager allows you leverage and automate the best
practices we’ve learned from thousands of deployments in
a comprehensive application that helps you run MongoDB
safely and reliably.
Benefits include:
10x-20x more efficient operations
Complete performance visibility
Protection from data loss
Assisted performance optimization
Meet SLAs, Cut management overhead
Scale easily, Follow best practices
Without Ops Manager
● Install, Configure
○ 150+ steps
● Upgrades, downgrades
○ 100+ steps
● Scale out, move servers, resize oplog, etc
○ 10-180+ steps
With Ops Manager
or
Ops Mgr (app)
150+ steps -> 1 click
Ops Mgr (API)
• Ops Manager agent installed to pool via
configuration management tools
• Server pools exposed to internal teams, ready
for provisioning into local groups
• Allow administrators to create true, on demand
database resources for private cloud
environments
Ops Manager
Server Pools to Automate Provisioning of MongoDB
• MongoDB and Pivotal co-engineered
Cloud Foundry integration
• BOSH installs the Ops Manager agent
• Calls the Ops Manager API to provision,
configure, monitor & backup the cluster
• Enables users to integrate MongoDB as
an on-demand DBaaS resource within
Cloud Foundry platforms
Ops Manager
Cloud Foundry Integration
• Finer grained telemetry data: collected
every 10 seconds vs every 60 seconds
• Configurable retention policies
• Simplified & extended management
• Single agent to collect both database
and hardware telemetry
• Hardware metrics now collected for
Windows & OSX hosts
Ops Manager
Higher Resolution Monitoring
• Atlas and Cloud Manager have their own
encrypted backup solution that is
dependent on encrypted hardware
• Ops Manager 3.4
• Native backup encryption solution for
PII information (HIPAA, PCI, FERPA,
etc)
• Encrypt backup snapshots;
encryption keys stored on KMIP
server
Ops Manager
Encrypted Backups
KMIP Appliance
Master Key
Multi-model done right. Other vendors sell you multiple products. MongoDB gives
you multiple models in one database: document, graph, key value, and search with
faceted navigation.
Mission-critical apps. Stronger security, broader platform support, and Zones
make MongoDB ready for the most demanding mission-critical deployments.
Modernized tooling. A sophisticated range of tools and integrations provide
powerful capabilities for Data Analysts, DBAs, and Operations teams.
MongoDB 3.4 Themes
• Take the M034: New Features and Tools in MongoDB
3.4 training
• https://university.mongodb.com/courses/M034/about
• Read the What’s New in MongoDB 3.4 Whitepaper
• https://www.mongodb.com/collateral/mongodb-3-4-whats-new
3.4
Next Steps
Backup
Content Repo
IoT Sensor
Backend
Customer Data
Real-Time
Analytics
Single View
MongoDB Query Language: K-V, Aggregations & Transformations, Graph, Faceted Navigation, JOINs, Geospatial
MongoDB Data Model: Document, Key-Value, Graph, Tabular, Files
WT MMAP
Available in MongoDB 3.4
Management
Security
In-memory Encrypted 3rd party
Multimodel Done Right

More Related Content

What's hot

MongoDB Breakfast Milan - Mainframe Offloading Strategies
MongoDB Breakfast Milan -  Mainframe Offloading StrategiesMongoDB Breakfast Milan -  Mainframe Offloading Strategies
MongoDB Breakfast Milan - Mainframe Offloading Strategies
MongoDB
 
RedisConf18 - Remote Monitoring & Controlling Scienific Instruments
RedisConf18 - Remote Monitoring & Controlling Scienific InstrumentsRedisConf18 - Remote Monitoring & Controlling Scienific Instruments
RedisConf18 - Remote Monitoring & Controlling Scienific Instruments
Redis Labs
 

What's hot (20)

MongoDB Atlas
MongoDB AtlasMongoDB Atlas
MongoDB Atlas
 
Webinar: Serverless Architectures with AWS Lambda and MongoDB Atlas
Webinar: Serverless Architectures with AWS Lambda and MongoDB AtlasWebinar: Serverless Architectures with AWS Lambda and MongoDB Atlas
Webinar: Serverless Architectures with AWS Lambda and MongoDB Atlas
 
Webinar: Simplifying the Database Experience with MongoDB Atlas
Webinar: Simplifying the Database Experience with MongoDB AtlasWebinar: Simplifying the Database Experience with MongoDB Atlas
Webinar: Simplifying the Database Experience with MongoDB Atlas
 
Webinar: Faster Big Data Analytics with MongoDB
Webinar: Faster Big Data Analytics with MongoDBWebinar: Faster Big Data Analytics with MongoDB
Webinar: Faster Big Data Analytics with MongoDB
 
Big Data Redis Mongodb Dynamodb Sharding
Big Data Redis Mongodb Dynamodb ShardingBig Data Redis Mongodb Dynamodb Sharding
Big Data Redis Mongodb Dynamodb Sharding
 
AWS Lambda, Step Functions & MongoDB Atlas Tutorial
AWS Lambda, Step Functions & MongoDB Atlas TutorialAWS Lambda, Step Functions & MongoDB Atlas Tutorial
AWS Lambda, Step Functions & MongoDB Atlas Tutorial
 
MongoDB 3.2 Feature Preview
MongoDB 3.2 Feature PreviewMongoDB 3.2 Feature Preview
MongoDB 3.2 Feature Preview
 
Introducing NoSQL and MongoDB to complement Relational Databases (AMIS SIG 14...
Introducing NoSQL and MongoDB to complement Relational Databases (AMIS SIG 14...Introducing NoSQL and MongoDB to complement Relational Databases (AMIS SIG 14...
Introducing NoSQL and MongoDB to complement Relational Databases (AMIS SIG 14...
 
Overcoming Today's Data Challenges with MongoDB
Overcoming Today's Data Challenges with MongoDBOvercoming Today's Data Challenges with MongoDB
Overcoming Today's Data Challenges with MongoDB
 
MongoDB Breakfast Milan - Mainframe Offloading Strategies
MongoDB Breakfast Milan -  Mainframe Offloading StrategiesMongoDB Breakfast Milan -  Mainframe Offloading Strategies
MongoDB Breakfast Milan - Mainframe Offloading Strategies
 
MongoDB Europe 2016 - Ops Manager and Cloud Manager
MongoDB Europe 2016 - Ops Manager and Cloud ManagerMongoDB Europe 2016 - Ops Manager and Cloud Manager
MongoDB Europe 2016 - Ops Manager and Cloud Manager
 
Maximizing MongoDB Performance on AWS
Maximizing MongoDB Performance on AWSMaximizing MongoDB Performance on AWS
Maximizing MongoDB Performance on AWS
 
Power Real Estate Property Analytics with MongoDB + Spark
Power Real Estate Property Analytics with MongoDB + SparkPower Real Estate Property Analytics with MongoDB + Spark
Power Real Estate Property Analytics with MongoDB + Spark
 
An Enterprise Architect's View of MongoDB
An Enterprise Architect's View of MongoDBAn Enterprise Architect's View of MongoDB
An Enterprise Architect's View of MongoDB
 
Apache Kafka - Scalable Message-Processing and more !
Apache Kafka - Scalable Message-Processing and more !Apache Kafka - Scalable Message-Processing and more !
Apache Kafka - Scalable Message-Processing and more !
 
Building a Scalable and Modern Infrastructure at CARFAX
Building a Scalable and Modern Infrastructure at CARFAXBuilding a Scalable and Modern Infrastructure at CARFAX
Building a Scalable and Modern Infrastructure at CARFAX
 
Apache Kafka - Scalable Message-Processing and more !
Apache Kafka - Scalable Message-Processing and more !Apache Kafka - Scalable Message-Processing and more !
Apache Kafka - Scalable Message-Processing and more !
 
RedisConf18 - Remote Monitoring & Controlling Scienific Instruments
RedisConf18 - Remote Monitoring & Controlling Scienific InstrumentsRedisConf18 - Remote Monitoring & Controlling Scienific Instruments
RedisConf18 - Remote Monitoring & Controlling Scienific Instruments
 
Transforming a Large Mission-Critical E-Commerce Platform from a Relational A...
Transforming a Large Mission-Critical E-Commerce Platform from a Relational A...Transforming a Large Mission-Critical E-Commerce Platform from a Relational A...
Transforming a Large Mission-Critical E-Commerce Platform from a Relational A...
 
MongoDB Evenings DC: Get MEAN and Lean with Docker and Kubernetes
MongoDB Evenings DC: Get MEAN and Lean with Docker and KubernetesMongoDB Evenings DC: Get MEAN and Lean with Docker and Kubernetes
MongoDB Evenings DC: Get MEAN and Lean with Docker and Kubernetes
 

Similar to MongoDB 3.4 webinar

Eagle6 mongo dc revised
Eagle6 mongo dc revisedEagle6 mongo dc revised
Eagle6 mongo dc revised
MongoDB
 
Final_CloudEventFrankfurt2017 (1).pdf
Final_CloudEventFrankfurt2017 (1).pdfFinal_CloudEventFrankfurt2017 (1).pdf
Final_CloudEventFrankfurt2017 (1).pdf
MongoDB
 

Similar to MongoDB 3.4 webinar (20)

MongodB Internals
MongodB InternalsMongodB Internals
MongodB Internals
 
MongoDB 4.0 새로운 기능 소개
MongoDB 4.0 새로운 기능 소개MongoDB 4.0 새로운 기능 소개
MongoDB 4.0 새로운 기능 소개
 
Neue Features in MongoDB 3.6
Neue Features in MongoDB 3.6Neue Features in MongoDB 3.6
Neue Features in MongoDB 3.6
 
Data Con LA 2022 - What's new with MongoDB 6.0 and Atlas
Data Con LA 2022 - What's new with MongoDB 6.0 and AtlasData Con LA 2022 - What's new with MongoDB 6.0 and Atlas
Data Con LA 2022 - What's new with MongoDB 6.0 and Atlas
 
Simplifying & accelerating application development with MongoDB's intelligent...
Simplifying & accelerating application development with MongoDB's intelligent...Simplifying & accelerating application development with MongoDB's intelligent...
Simplifying & accelerating application development with MongoDB's intelligent...
 
Novedades de MongoDB 3.6
Novedades de MongoDB 3.6Novedades de MongoDB 3.6
Novedades de MongoDB 3.6
 
Mongo db 3.4 Overview
Mongo db 3.4 OverviewMongo db 3.4 Overview
Mongo db 3.4 Overview
 
Scaling MongoDB
Scaling MongoDBScaling MongoDB
Scaling MongoDB
 
Webinar: The Anatomy of the Cloudant Data Layer
Webinar: The Anatomy of the Cloudant Data LayerWebinar: The Anatomy of the Cloudant Data Layer
Webinar: The Anatomy of the Cloudant Data Layer
 
Eagle6 mongo dc revised
Eagle6 mongo dc revisedEagle6 mongo dc revised
Eagle6 mongo dc revised
 
Eagle6 Enterprise Situational Awareness
Eagle6 Enterprise Situational AwarenessEagle6 Enterprise Situational Awareness
Eagle6 Enterprise Situational Awareness
 
Integrating technology to your startup
Integrating technology to your startupIntegrating technology to your startup
Integrating technology to your startup
 
What's new in MongoDB 3.6?
What's new in MongoDB 3.6?What's new in MongoDB 3.6?
What's new in MongoDB 3.6?
 
Final_CloudEventFrankfurt2017 (1).pdf
Final_CloudEventFrankfurt2017 (1).pdfFinal_CloudEventFrankfurt2017 (1).pdf
Final_CloudEventFrankfurt2017 (1).pdf
 
Webinar: “ditch Oracle NOW”: Best Practices for Migrating to MongoDB
 Webinar: “ditch Oracle NOW”: Best Practices for Migrating to MongoDB Webinar: “ditch Oracle NOW”: Best Practices for Migrating to MongoDB
Webinar: “ditch Oracle NOW”: Best Practices for Migrating to MongoDB
 
Ops Jumpstart: MongoDB Administration 101
Ops Jumpstart: MongoDB Administration 101Ops Jumpstart: MongoDB Administration 101
Ops Jumpstart: MongoDB Administration 101
 
MongoDB - A next-generation database that lets you create applications never ...
MongoDB - A next-generation database that lets you create applications never ...MongoDB - A next-generation database that lets you create applications never ...
MongoDB - A next-generation database that lets you create applications never ...
 
QuerySurge Slide Deck for Big Data Testing Webinar
QuerySurge Slide Deck for Big Data Testing WebinarQuerySurge Slide Deck for Big Data Testing Webinar
QuerySurge Slide Deck for Big Data Testing Webinar
 
Dataweek-Talk-2014
Dataweek-Talk-2014Dataweek-Talk-2014
Dataweek-Talk-2014
 
Benjamin Guinebertière - Microsoft Azure: Document DB and other noSQL databas...
Benjamin Guinebertière - Microsoft Azure: Document DB and other noSQL databas...Benjamin Guinebertière - Microsoft Azure: Document DB and other noSQL databas...
Benjamin Guinebertière - Microsoft Azure: Document DB and other noSQL databas...
 

More from Andrew Morgan

More from Andrew Morgan (14)

PistonHead's use of MongoDB for Analytics
PistonHead's use of MongoDB for AnalyticsPistonHead's use of MongoDB for Analytics
PistonHead's use of MongoDB for Analytics
 
Joins and Other MongoDB 3.2 Aggregation Enhancements
Joins and Other MongoDB 3.2 Aggregation EnhancementsJoins and Other MongoDB 3.2 Aggregation Enhancements
Joins and Other MongoDB 3.2 Aggregation Enhancements
 
Document validation in MongoDB 3.2
Document validation in MongoDB 3.2Document validation in MongoDB 3.2
Document validation in MongoDB 3.2
 
What's new in MySQL Cluster 7.4 webinar charts
What's new in MySQL Cluster 7.4 webinar chartsWhat's new in MySQL Cluster 7.4 webinar charts
What's new in MySQL Cluster 7.4 webinar charts
 
MySQL High Availability Solutions - Feb 2015 webinar
MySQL High Availability Solutions - Feb 2015 webinarMySQL High Availability Solutions - Feb 2015 webinar
MySQL High Availability Solutions - Feb 2015 webinar
 
FOSDEM 2015 - NoSQL and SQL the best of both worlds
FOSDEM 2015 - NoSQL and SQL the best of both worldsFOSDEM 2015 - NoSQL and SQL the best of both worlds
FOSDEM 2015 - NoSQL and SQL the best of both worlds
 
MySQL Replication: What’s New in MySQL 5.7 and Beyond
MySQL Replication: What’s New in MySQL 5.7 and BeyondMySQL Replication: What’s New in MySQL 5.7 and Beyond
MySQL Replication: What’s New in MySQL 5.7 and Beyond
 
NoSQL and SQL - Why Choose? Enjoy the best of both worlds with MySQL
NoSQL and SQL - Why Choose? Enjoy the best of both worlds with MySQLNoSQL and SQL - Why Choose? Enjoy the best of both worlds with MySQL
NoSQL and SQL - Why Choose? Enjoy the best of both worlds with MySQL
 
MySQL Cluster - Latest Developments (up to and including MySQL Cluster 7.4)
MySQL Cluster - Latest Developments (up to and including MySQL Cluster 7.4)MySQL Cluster - Latest Developments (up to and including MySQL Cluster 7.4)
MySQL Cluster - Latest Developments (up to and including MySQL Cluster 7.4)
 
OUG Scotland 2014 - NoSQL and MySQL - The best of both worlds
OUG Scotland 2014 - NoSQL and MySQL - The best of both worldsOUG Scotland 2014 - NoSQL and MySQL - The best of both worlds
OUG Scotland 2014 - NoSQL and MySQL - The best of both worlds
 
NoSQL & SQL - Best of both worlds - BarCamp Berkshire 2013
NoSQL & SQL - Best of both worlds - BarCamp Berkshire 2013NoSQL & SQL - Best of both worlds - BarCamp Berkshire 2013
NoSQL & SQL - Best of both worlds - BarCamp Berkshire 2013
 
NoSQL and SQL - blending the best of both worlds
NoSQL and SQL - blending the best of both worldsNoSQL and SQL - blending the best of both worlds
NoSQL and SQL - blending the best of both worlds
 
Mysql cluster introduction
Mysql cluster introductionMysql cluster introduction
Mysql cluster introduction
 
Developing high-throughput services with no sql ap-is to innodb and mysql clu...
Developing high-throughput services with no sql ap-is to innodb and mysql clu...Developing high-throughput services with no sql ap-is to innodb and mysql clu...
Developing high-throughput services with no sql ap-is to innodb and mysql clu...
 

Recently uploaded

Prosigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology SolutionsProsigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology Solutions
Prosigns
 

Recently uploaded (20)

Breaking the Code : A Guide to WhatsApp Business API.pdf
Breaking the Code : A Guide to WhatsApp Business API.pdfBreaking the Code : A Guide to WhatsApp Business API.pdf
Breaking the Code : A Guide to WhatsApp Business API.pdf
 
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital TransformationWSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
 
A Comprehensive Appium Guide for Hybrid App Automation Testing.pdf
A Comprehensive Appium Guide for Hybrid App Automation Testing.pdfA Comprehensive Appium Guide for Hybrid App Automation Testing.pdf
A Comprehensive Appium Guide for Hybrid App Automation Testing.pdf
 
Cyaniclab : Software Development Agency Portfolio.pdf
Cyaniclab : Software Development Agency Portfolio.pdfCyaniclab : Software Development Agency Portfolio.pdf
Cyaniclab : Software Development Agency Portfolio.pdf
 
Prosigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology SolutionsProsigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology Solutions
 
Crafting the Perfect Measurement Sheet with PLM Integration
Crafting the Perfect Measurement Sheet with PLM IntegrationCrafting the Perfect Measurement Sheet with PLM Integration
Crafting the Perfect Measurement Sheet with PLM Integration
 
Advanced Flow Concepts Every Developer Should Know
Advanced Flow Concepts Every Developer Should KnowAdvanced Flow Concepts Every Developer Should Know
Advanced Flow Concepts Every Developer Should Know
 
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
 
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
 
AI/ML Infra Meetup | ML explainability in Michelangelo
AI/ML Infra Meetup | ML explainability in MichelangeloAI/ML Infra Meetup | ML explainability in Michelangelo
AI/ML Infra Meetup | ML explainability in Michelangelo
 
top nidhi software solution freedownload
top nidhi software solution freedownloadtop nidhi software solution freedownload
top nidhi software solution freedownload
 
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
 
Accelerate Enterprise Software Engineering with Platformless
Accelerate Enterprise Software Engineering with PlatformlessAccelerate Enterprise Software Engineering with Platformless
Accelerate Enterprise Software Engineering with Platformless
 
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
 
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.ILBeyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
 
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...
 
SOCRadar Research Team: Latest Activities of IntelBroker
SOCRadar Research Team: Latest Activities of IntelBrokerSOCRadar Research Team: Latest Activities of IntelBroker
SOCRadar Research Team: Latest Activities of IntelBroker
 
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume MontevideoVitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume Montevideo
 
iGaming Platform & Lottery Solutions by Skilrock
iGaming Platform & Lottery Solutions by SkilrockiGaming Platform & Lottery Solutions by Skilrock
iGaming Platform & Lottery Solutions by Skilrock
 
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
 

MongoDB 3.4 webinar

  • 1. MongoDB 3.4 The Leading Non-Relational Database Evolved Jason Ma Andrew Morgan
  • 2. Introduction Multi-model done right Mission Critical Applications Modernized tooling Q&A Agenda
  • 3. Evolution of MongoDB Hash-Based Sharding Roles Kerberos On-Prem Monitoring 2.4 2.6 3.0 3.2 $out Index Intersection Text Search Field-Level Redaction LDAP & x509 Auditing Document Validation $lookup Fast Failover Simpler Scalability Aggregation ++ Encryption At Rest In-Memory Storage Engine BI Connector MongoDB Compass APM Integration Profiler Visualization Auto Index Builds Backups to File System Doc-Level Concurrency Compression Storage Engine API ≤50 replicas Auditing ++ Ops Manager Intra-cluster compression Views Log Redaction Linearizable Reads Graph Processing Decimal Collations Faceted Navigation Spark Connector ++ Zones ++ Aggregation ++ Auto-balancing ++ ARM, Power, zSeries support BI Connector ++ Compass ++ Hardware Monitoring Server Pool LDAP Authorization Encrypted Backups Cloud Foundry Integration 3.4
  • 4. Multi-model done right. Other vendors sell you multiple products. MongoDB gives you multiple models in one database: document, graph, key value, and search with faceted navigation. Mission-critical apps. Stronger security, broader platform support, and Zones make MongoDB ready for the most demanding mission-critical deployments. Modernized tooling. A sophisticated range of tools and integrations provide powerful capabilities for Data Analysts, DBAs, and Operations teams. MongoDB 3.4 Themes
  • 6. • Enables processing of graph data natively within MongoDB with $graphLookup operator • Uncover indirect or transitive relationships in operational data • Recommendation engines, MDM, fraud models, social networks, etc. Graph Processing
  • 8. db.users.aggregate( [ {$match: {_id: 3}}, {"$graphLookup": { from: "users", startWith: "$friends.id", connectFromField: "friends.id", connectToField: "_id", maxDepth: 2, depthField: "depth", as: "target"} } ], {allowDiskUse: true}).pretty() Graph Processing
  • 9. { "target": { "_id": 678, "meetupCount": 98, "details": [ { "firstName": "Jesse", "lastName": "Bennett" } ] }, "requestIntroFrom": { "id": 541, "details": [ { "firstName" : "Arthur", "lastName" : "Boyd", "contact" : { "email" : "aboydf0@canalblog.com", "phone" : "86-(656)576-9389" }}]}} Graph Processing https://github.com/am-MongoDB/meetupGraph
  • 11. • Grouping data into related categories for intuitive exploration & discovery • Used in search and analytics applications • New aggregation pipeline stages for faceting, bucketing & sorted counts across multiple dimensions • Eliminates requirement for external search engine https://github.com/am-MongoDB/TVnav Faceted Navigation
  • 13. Faceted Navigation db.products.aggregate([ {$match: {category: "TV"}}, {$facet: { price: [ {$bucket: { groupBy: "$price", boundaries: [0, 200, 699, 1000, 1500], default: "Over 1500", output: {"count": {$sum: 1}} }}, {$project: { lowerPriceBound: "$_id", count: 1, _id: 0}}], brands: [ {$sortByCount: "$brand" }, {$project: { brand: "$_id", count: 1, _id: 0}}], … }}
  • 14. Faceted Navigation {"price" : [ {"count" : 29, "lowerPriceBound" : 0}, {"count" : 272, "lowerPriceBound" : 200}, {"count" : 165, "lowerPriceBound" : 699}, { "count" : 260, "lowerPriceBound" : 1000 }, {"count" : 274, "lowerPriceBound" : "Over 1500" ], "brands" : [ {"count" : 277, "brand" : "SAMSUNG"}, {"count" : 169, "brand" : "PANASONIC"},
  • 15. • Data set, query and results: • https://github.com/am-MongoDB/TVnav Faceted Navigation
  • 16. • Powerful data processing pipeline for analytics & transformations • 25+ enhancements simplify app code • Performance improvements with query optimizer moving $match stage earlier to use indexes New Stages Array Operators String & Date Operators $graphLookup $facet $bucket $bucketAuto $sortbyCount $addFields $replaceRoot $in $indexOfArray $range $reverseArray $reduce $zip $indexOfBytes $indexOfCP $split $strLenBytes $strLenCP $substrBytes $substrCP $isoDayOfWeek $isoWeek $isoWeekYear Advanced Analytics Aggregation Framework Enhancements
  • 17. • Create powerful visualizations & analytics from SQL-based BI tooling • Auto-schema sampling • Eliminates ETL • Higher performance with rewritten SQL layer • More processing pushed down to the database • Simplified installation and authentication Advanced Analytics MongoDB Connector for BI
  • 18. “We reduced 100+ lines of integration code to just a single line after moving to the MongoDB Spark connector.” - Early Access Tester, Multi-National Banking Group Group Analytics Application Scala, Java, Python, R APIs SQL Machine Learning Libraries Streaming Graph Spark Worker Spark Worker Spark Worker Spark Worker MongoDB Connector for Spark Advanced Analytics MongoDB Connector for Apache Spark • Native Scala connector, certified by Databricks • Exposes all Spark APIs & libraries • Efficient data filtering with predicate pushdown, secondary indexes, & in-database aggregations • Locality awareness to reduce data movement • Updated with Spark 2.0 support
  • 19. • Text comparisons and sorting using language- specific rules • 100+ different languages & locales • Over 2x as many as offered by most RDBMs • Case sensitivity, treatments of numbers • Collection | View | Index | Operation Collations
  • 20. db.customers.createIndex( {last_name: 1, first_name : 1 }, {name: "german_name_index", collation: {locale: "de"}, partialFilterExpression: { language: "German" }}) db.createView( "germanSpeakers", "customers", [{$match: { language: "German", last_name: {$exists: true}}}], {collation: {locale: "de"}}) Collations
  • 21. • Support for the IEEE 754-2008 decimal128 type in server and drivers • Database stores exact values to eliminate rounding errors for high-precision calculations, complex financial & scientific apps Decimal128 Decimal Data Type
  • 23. Partition data across distributed clusters based on data locality policies • Support distributed local writes • Easily adhere to data sovereignty requirements • Enable deployment patterns such as tiered storage MongoDB Zones can now be configured visually from Ops Manager Zones
  • 24. Seamless and elastic scalability in response to dynamic application demands • Improved balancing of data across nodes with parallel data migrations • Faster replica set synchronization with optimized initial sync process Elastic Clusters
  • 25. With snappy compression algorithm, network traffic can be compressed by up to 70% • Performance benefits in bandwidth-constrained environments • Significantly reduce network costs Intra-Cluster Compression
  • 26. maxStalenessMS Read Preference • Choose how and when to route queries to secondary replicas • Only read from replicas that are within a defined consistency window • Improved data quality while scaling reads across secondaries linearizable Read Concern for the strongest consistency guarantees of any database • Ensure that a node is the primary at the time of read • Ensure that data returned will not be rolled back if another node is subsequently elected as primary Improved Tunable Consistency
  • 27. LDAP authentication & authorization reduces administrative overhead & TCO • Users stored in LDAP server can be mapped to MongoDB roles • Native platform libraries to integrate with LDAP; no need for external dependencies and configuration LDAP Authorization
  • 28. Define dynamically generated non-materialized views to expose selected data from underlying collection(s) • Reduces risk of sensitive data exposure • Separately specified permissions levels • Allows organizations to more easily meet compliance standards in regulated industries • Can generate additional fields Read-Only Views
  • 29. Collation/Views Example db.createView( "germanSpeakersRedacted", "customers", [ {$match: { language: "German", last_name: { $exists: true}}}, {$project: { salary: 0, country: 0, language: 0 } } ], {collation: {locale: "de"}} ) use admin db.createRole( { role: "germanViewer", privileges: [ {resource: { db: "production", collection: germanSpeakersRedacted"}, actions: ["find"]} ], roles: [] } )
  • 31. Support the growing demand to run the database on a more diverse range of platforms • ARM v8-64 bit support allows customers to take advantage of power-efficient servers being deployed into ultra dense data center racks • IBM Power8 and zSeries support provides seamless migration for enterprises modernizing legacy workloads. Available for MongoDB Enterprise Server. Expanded Platform Support
  • 33. • MongoDB 3.2 • Visualize Indexes • Query Performance • MongoDB 3.4 • MongoDB Compass enhancements • Modify documents • Create document validation rules • Optimize query performance with visual explain plans, index usage, and real-time statistics • Create and remove indexes • All controlled from a single intuitive and sophisticated GUI MongoDB Compass 3.4
  • 34. Real Time Performance Stats • View key MongoDB metrics that are happening in real- time • Operation statistics (inserts, deletes, queries, etc) • Read/Write Load, Network load, Memory usage
  • 35. Insert, Delete, Modify Documents ● Clone, modify existing documents, insert new documents, and delete existing documents ● For now, applicable to one document at time
  • 36. Document Validation Rule Builder ● MongoDB Compass allows users to view, add, and modify document validation rules through its GUI ● Different teams can enforce schema consistency, reducing risk and increasing productivity between teams
  • 37. Visualize Explain Plans ● View key information about the execution of a query ● Identify slow running queries and optimize query performance
  • 38. View Index Utilization ● Visualization of index utilization ● View type of index, size of index, usage of index, and properties of index
  • 39. Create and Remove Indexes ● Create and Remove indexes in GUI ● Enhances ability for users to identify and fix issues from the GUI
  • 40. MongoDB Ops Manager 3.4 Ops Manager allows you leverage and automate the best practices we’ve learned from thousands of deployments in a comprehensive application that helps you run MongoDB safely and reliably. Benefits include: 10x-20x more efficient operations Complete performance visibility Protection from data loss Assisted performance optimization Meet SLAs, Cut management overhead Scale easily, Follow best practices
  • 41. Without Ops Manager ● Install, Configure ○ 150+ steps ● Upgrades, downgrades ○ 100+ steps ● Scale out, move servers, resize oplog, etc ○ 10-180+ steps
  • 42. With Ops Manager or Ops Mgr (app) 150+ steps -> 1 click Ops Mgr (API)
  • 43. • Ops Manager agent installed to pool via configuration management tools • Server pools exposed to internal teams, ready for provisioning into local groups • Allow administrators to create true, on demand database resources for private cloud environments Ops Manager Server Pools to Automate Provisioning of MongoDB
  • 44. • MongoDB and Pivotal co-engineered Cloud Foundry integration • BOSH installs the Ops Manager agent • Calls the Ops Manager API to provision, configure, monitor & backup the cluster • Enables users to integrate MongoDB as an on-demand DBaaS resource within Cloud Foundry platforms Ops Manager Cloud Foundry Integration
  • 45. • Finer grained telemetry data: collected every 10 seconds vs every 60 seconds • Configurable retention policies • Simplified & extended management • Single agent to collect both database and hardware telemetry • Hardware metrics now collected for Windows & OSX hosts Ops Manager Higher Resolution Monitoring
  • 46. • Atlas and Cloud Manager have their own encrypted backup solution that is dependent on encrypted hardware • Ops Manager 3.4 • Native backup encryption solution for PII information (HIPAA, PCI, FERPA, etc) • Encrypt backup snapshots; encryption keys stored on KMIP server Ops Manager Encrypted Backups KMIP Appliance Master Key
  • 47. Multi-model done right. Other vendors sell you multiple products. MongoDB gives you multiple models in one database: document, graph, key value, and search with faceted navigation. Mission-critical apps. Stronger security, broader platform support, and Zones make MongoDB ready for the most demanding mission-critical deployments. Modernized tooling. A sophisticated range of tools and integrations provide powerful capabilities for Data Analysts, DBAs, and Operations teams. MongoDB 3.4 Themes
  • 48. • Take the M034: New Features and Tools in MongoDB 3.4 training • https://university.mongodb.com/courses/M034/about • Read the What’s New in MongoDB 3.4 Whitepaper • https://www.mongodb.com/collateral/mongodb-3-4-whats-new 3.4 Next Steps
  • 50. Content Repo IoT Sensor Backend Customer Data Real-Time Analytics Single View MongoDB Query Language: K-V, Aggregations & Transformations, Graph, Faceted Navigation, JOINs, Geospatial MongoDB Data Model: Document, Key-Value, Graph, Tabular, Files WT MMAP Available in MongoDB 3.4 Management Security In-memory Encrypted 3rd party Multimodel Done Right