3.4 Overview
Engineer Lead
MongoDB University
Certification
In-person training
Sometimes I do talks, like this one
Hi, I’m
Norberto
3
3.4 Themes
Mission-critical apps. Stronger security, broader platform support, and Zones
make MongoDB ready for the most demanding mission-critical deployments.
Multimodel done right. Other vendors sell you multiple products. MongoDB
gives you multiple models in one database: document, graph, key value, and
search with faceted navigation.
Modernized tooling. A sophisticated range of tools and integrations provide
powerful capabilities for Data Analysts, DBAs, and Operations teams.
4
Designed for mission-critical apps
Zones
● Geo. distribution
● Tiered Storage
● Application
Affinity
Advanced Security
● Native LDAP
authorization
● Read-only views
for field-level
security
Elastic Clusters
● Scale up and
down without
disruption
● Faster auto-
balance and
initial sync
Tunable Consistency
● Linearizable
reads
● Maximum lag
setting for
secondary reads
5
Multimodel done right
MongoDB Storage Engines
MongoDB QueryLanguage (MQL) + Native Drivers
WiredTiger Encrypted
In-
memory
Column-
oriented*
LSM*
MongoDB Data Models
Relational Graph Key/ValueDocument
● Graph processing
○ Recursive joins
● Enhanced analytics
○ Faceted navigation
○ Spark connector
○ SQL interface for BI
○ 20+ other new expressions,
including pipeline branching
● Expanded data management
○ Decimal support
○ Collations for 100+ languages
* Future storage engines (not in 3.4)
6
Modernized tooling
● MongoDB Compass
○ Visualize query plans
○ Build validation rules
○ Modify documents
○ View server and index stats
● MongoDB as a Service
○ Server Pools
○ Cloud Foundry integration
● Monitoring
○ Finer time granularity
○ Hardware stats
Graph Processing
• Enables processing ofgraph & hierarchical data natively
within MongoDB with $graphLookup operator
• Uncover indirector transitive relationships in operational data
• Recommendation engines,MDM,fraud models,social
networks, etc.
Faceted Navigation
• Grouping data into related categories for intuitive exploration
& discovery
• Used in search and analytics applications
• New aggregation pipeline stages for faceting, bucketing &
sorted counts across multiple dimensions
• Eliminates requirementfor external search engine
Collations
• Extend global reach ofapps with collations,which allow
proper text comparisons and sorting by applying language-
specific rules
• MongoDB 3.4 adds supportfor 100+ differentlanguages &
locales throughoutthe query language and indexes
• Over 2x as many as offered by most RDBMS
Decimal Data Type
• Supportfor the IEEE 754-2008 decimal128 type in server and
drivers
• Enables correct storage,comparing and sorting of
decimal values
• Database stores exact values to eliminate rounding errors for
high-precision calculations,complex financial & scientific
apps
Decimal128
Advanced Analytics
• Powerful data processing pipeline for analytics &
transformations
• 25+ enhancements simplify app code
• Performance improvements with query optimizer moving
$match stage earlier to use indexes
New Stages Array
Operators
String & Date
Operators
$graphLookup
$facet
$bucket
$bucketAuto
$sortbyCount
$addFields
$replaceRoot
$in
$indexOfArray
$range
$reverseArray
$reduce
$zip
$indexOfBytes
$indexOfCP
$split
$strLenBytes
$strLenCP
$substrBytes
$substrCP
$isoDayOfWeek
$isoWeek
$isoWeekYear
MongoDB Connector for BI
• Create powerful visualizations & analytics from SQL-based BI
tooling
• Auto-schema sampling
• Eliminates ETL
• Higher performance with re-written SQL layer
• More processing pushed down to the database
• Simplified installation and authentication
13
MongoDB Atlas: Hosted database service
● Automated: The easiest way to build, launch, and scale apps on
MongoDB
● Secured: VPC peering, SSL/TLS, encrypted storage volumes,
IP whitelists, authentication/authorization via SCRAM-SHA1, and
more
● Highly available: Deployments distributed across 3 AWS
availability zones
● High performance: WiredTiger storage engine for demanding
workloads
Try MongoDB Atlas for free with $25 Promo Code: GOATLAS25
Improved Tunable Consistency
• maxStalenessMS
• Choose how and when to route queries to secondary replicas
• Only read from replicas that are within a defined consistency
window
• Improved data quality while scaling reads across secondaries
• readConcern “linearizable” for the strongest consistency
guarantees of any database
• Ensure that a node is the primary at the time of read
• Ensure that data returned will not be rolled back if another
node is subsequently elected as primary
Zones
• Partition data across distributed clusters based on data
locality policies
• Supportdistributed local writes
• Easily adhere to data sovereignty requirements
• Enable deploymentpatterns such as tiered storage
• Can be configured visually from MongoDB Ops Manager
LDAP Authorization
• LDAP authentication & authorization reduces administrative
overhead & TCO
• User privileges can be managed centrally in LDAP and
mapped to MongoDB roles withoutrequiring duplication
• Native platform libraries to integrate with LDAP; no need
for external dependencies and configurations;adds
LDAP supportfor Windows
Read-Only Views
• MongoDB 3.4 allows administrators to define dynamically
generated views that expose a subsetof data from the
underlying collection
• Reduces risk of sensitive data exposure
• Views do not affect source collections
• Separately specified permissions levels
• Allows organizations to more easily meet compliance
standards in regulated industries
Expanded Platform Support
• MongoDB 3.4 supports the growing demand to run the
database on a more diverse range of platforms
• ARM v8-64 bit supportallows customers to take
advantage of power-efficientservers being deployed into
ultra dense data center racks
• IBM Power8 and zSeries support provides seamless
migration for enterprises modernizing legacy workloads.
Available for MongoDB Enterprise Server.
APM Integration
• Monitor MongoDB alongside the rest of your app
infrastructure by using our RESTful API
• Leverage packaged integrations with leading APM
platforms such as New Relic
Visual Query Profiler
• Identify the slow-running queries across your
cluster with just the click of a button
Index Suggestions
• Index suggestions to improve your query
performance
Automated Index Builds
• Automate rolling index builds to reduce operational
overhead and the risk of failovers
Server Pools
• Allocate and create pre-provisioned server pools
• Ops Manager agentinstalled to pool via
configuration managementtools
• Server pools exposed to internal teams, ready for
provisioning into local groups
• Allow administrators to create true, on demand
database resources for private cloud environments
High Resolution Monitoring
• Finer grained telemetry data:collected every 10
seconds vs every 60 seconds
• Configurable retention policies
• Simplified & extended management
• Single agentto collectboth database and
hardware telemetry
• Hardware metrics now collected for Windows &
OSX hosts
MongoDB Compass
• Visualize & explore
your schema with an
intuitive GUI
• Gain quick insights
about your data with
easy-to-read
histograms
• Build queries with a
few clicks
• Drill down to view
individual documents
in your collection
• Understand and
resolve performance
issues with visual
explain plans
• Check index
utilization
Debug &
Optimize
Visualize &
Explore
The GUI for MongoDB
Visual explain plans and full CRUD functionality are currently in beta.
• Insert new
documents or clone
existing documents
• Modify documents in
place using the
powerful visual
editor
• Delete documents in
just a few clicks
Insert, Modify, &
Delete
MongoDB Compass
Visualize and explore
• Visually explore the structure of your data to
understand the schema and identify anomalies
• Gain insights with histograms that display the
distribution of values across your fields
• Perform ad hoc complex queries with just a few clicks
MongoDB Compass
Visualize and explore: Interactive maps for geospatial data
MongoDB Compass is the best way to visualize, understand, and work
with your geospatial data.
• Compass detects your geospatial dataandpopulates it on an
interactive map
• Automatically generategeospatial queries by drawing on the
interactive map with your mouse
• Use Compass to significantly reduce the effort requiredwhen working
with geospatial data
Interactive maps for geospatial data are currently in beta.
MongoDB Compass
Insert, modify & delete: Full CRUD functionality
Modify your data using MongoDB Compass.
• Insert new documents or clone existing documents
• Modify existing documents with greater confidence using
the powerful visual editor
• Delete documents in just a few clicks
Full CRUD functionality is currently in beta.
MongoDB Compass
Debug and optimize: Visual explain plans
Understand how queries are running through a GUI that
allows you to easily identify and resolve performance issues.
• View key information aboutthe execution plan of a query
• Visualize differentexplain stages in an easy-to-understand
tree format
Visual explain plans are currently in beta.
MongoDB Compass
Debug and optimize: Index details
MongoDB Compass allows you to view index details for a given
collection:
• Type of index: regular, text, geospatial, or hashed
• Size of index: how much space the index uses
• Index utilization: how many times the index has been used
• Special properties: unique index, compound index, etc.
MongoDB Compass
Newest features
• Schema and query optimization
• MongoDB Compass enhancements
• Modify documents
• Create document validation rules
• Optimize query performance with visual explain plans,
index usage, and real-time statistics
• All controlled from a single intuitive and sophisticated GUI
https://university.mongodb.com/courses/M034/about
M034: New Features and Tools in MongoDB 3.4
Links and
References
• MongoDB Compass
• https://www.mongodb.com/produ
cts/compass
• MongoDB Atlas
• https://www.mongodb.com/cloud/
atlas
• MongoDB 3.4
• https://www.mongodb.com/mong
odb-3.4
Norberto Leite
norberto@mongodb.com
@nleite
https://www.linkedin.com/in/norbertoleite/
Mongo db 3.4 Overview

Mongo db 3.4 Overview

  • 1.
  • 2.
    Engineer Lead MongoDB University Certification In-persontraining Sometimes I do talks, like this one Hi, I’m Norberto
  • 3.
    3 3.4 Themes Mission-critical apps.Stronger security, broader platform support, and Zones make MongoDB ready for the most demanding mission-critical deployments. Multimodel done right. Other vendors sell you multiple products. MongoDB gives you multiple models in one database: document, graph, key value, and search with faceted navigation. Modernized tooling. A sophisticated range of tools and integrations provide powerful capabilities for Data Analysts, DBAs, and Operations teams.
  • 4.
    4 Designed for mission-criticalapps Zones ● Geo. distribution ● Tiered Storage ● Application Affinity Advanced Security ● Native LDAP authorization ● Read-only views for field-level security Elastic Clusters ● Scale up and down without disruption ● Faster auto- balance and initial sync Tunable Consistency ● Linearizable reads ● Maximum lag setting for secondary reads
  • 5.
    5 Multimodel done right MongoDBStorage Engines MongoDB QueryLanguage (MQL) + Native Drivers WiredTiger Encrypted In- memory Column- oriented* LSM* MongoDB Data Models Relational Graph Key/ValueDocument ● Graph processing ○ Recursive joins ● Enhanced analytics ○ Faceted navigation ○ Spark connector ○ SQL interface for BI ○ 20+ other new expressions, including pipeline branching ● Expanded data management ○ Decimal support ○ Collations for 100+ languages * Future storage engines (not in 3.4)
  • 6.
    6 Modernized tooling ● MongoDBCompass ○ Visualize query plans ○ Build validation rules ○ Modify documents ○ View server and index stats ● MongoDB as a Service ○ Server Pools ○ Cloud Foundry integration ● Monitoring ○ Finer time granularity ○ Hardware stats
  • 7.
    Graph Processing • Enablesprocessing ofgraph & hierarchical data natively within MongoDB with $graphLookup operator • Uncover indirector transitive relationships in operational data • Recommendation engines,MDM,fraud models,social networks, etc.
  • 8.
    Faceted Navigation • Groupingdata into related categories for intuitive exploration & discovery • Used in search and analytics applications • New aggregation pipeline stages for faceting, bucketing & sorted counts across multiple dimensions • Eliminates requirementfor external search engine
  • 9.
    Collations • Extend globalreach ofapps with collations,which allow proper text comparisons and sorting by applying language- specific rules • MongoDB 3.4 adds supportfor 100+ differentlanguages & locales throughoutthe query language and indexes • Over 2x as many as offered by most RDBMS
  • 10.
    Decimal Data Type •Supportfor the IEEE 754-2008 decimal128 type in server and drivers • Enables correct storage,comparing and sorting of decimal values • Database stores exact values to eliminate rounding errors for high-precision calculations,complex financial & scientific apps Decimal128
  • 11.
    Advanced Analytics • Powerfuldata processing pipeline for analytics & transformations • 25+ enhancements simplify app code • Performance improvements with query optimizer moving $match stage earlier to use indexes New Stages Array Operators String & Date Operators $graphLookup $facet $bucket $bucketAuto $sortbyCount $addFields $replaceRoot $in $indexOfArray $range $reverseArray $reduce $zip $indexOfBytes $indexOfCP $split $strLenBytes $strLenCP $substrBytes $substrCP $isoDayOfWeek $isoWeek $isoWeekYear
  • 12.
    MongoDB Connector forBI • Create powerful visualizations & analytics from SQL-based BI tooling • Auto-schema sampling • Eliminates ETL • Higher performance with re-written SQL layer • More processing pushed down to the database • Simplified installation and authentication
  • 13.
    13 MongoDB Atlas: Hosteddatabase service ● Automated: The easiest way to build, launch, and scale apps on MongoDB ● Secured: VPC peering, SSL/TLS, encrypted storage volumes, IP whitelists, authentication/authorization via SCRAM-SHA1, and more ● Highly available: Deployments distributed across 3 AWS availability zones ● High performance: WiredTiger storage engine for demanding workloads Try MongoDB Atlas for free with $25 Promo Code: GOATLAS25
  • 14.
    Improved Tunable Consistency •maxStalenessMS • Choose how and when to route queries to secondary replicas • Only read from replicas that are within a defined consistency window • Improved data quality while scaling reads across secondaries • readConcern “linearizable” for the strongest consistency guarantees of any database • Ensure that a node is the primary at the time of read • Ensure that data returned will not be rolled back if another node is subsequently elected as primary
  • 15.
    Zones • Partition dataacross distributed clusters based on data locality policies • Supportdistributed local writes • Easily adhere to data sovereignty requirements • Enable deploymentpatterns such as tiered storage • Can be configured visually from MongoDB Ops Manager
  • 16.
    LDAP Authorization • LDAPauthentication & authorization reduces administrative overhead & TCO • User privileges can be managed centrally in LDAP and mapped to MongoDB roles withoutrequiring duplication • Native platform libraries to integrate with LDAP; no need for external dependencies and configurations;adds LDAP supportfor Windows
  • 17.
    Read-Only Views • MongoDB3.4 allows administrators to define dynamically generated views that expose a subsetof data from the underlying collection • Reduces risk of sensitive data exposure • Views do not affect source collections • Separately specified permissions levels • Allows organizations to more easily meet compliance standards in regulated industries
  • 18.
    Expanded Platform Support •MongoDB 3.4 supports the growing demand to run the database on a more diverse range of platforms • ARM v8-64 bit supportallows customers to take advantage of power-efficientservers being deployed into ultra dense data center racks • IBM Power8 and zSeries support provides seamless migration for enterprises modernizing legacy workloads. Available for MongoDB Enterprise Server.
  • 19.
    APM Integration • MonitorMongoDB alongside the rest of your app infrastructure by using our RESTful API • Leverage packaged integrations with leading APM platforms such as New Relic
  • 20.
    Visual Query Profiler •Identify the slow-running queries across your cluster with just the click of a button
  • 21.
    Index Suggestions • Indexsuggestions to improve your query performance
  • 22.
    Automated Index Builds •Automate rolling index builds to reduce operational overhead and the risk of failovers
  • 23.
    Server Pools • Allocateand create pre-provisioned server pools • Ops Manager agentinstalled to pool via configuration managementtools • Server pools exposed to internal teams, ready for provisioning into local groups • Allow administrators to create true, on demand database resources for private cloud environments
  • 24.
    High Resolution Monitoring •Finer grained telemetry data:collected every 10 seconds vs every 60 seconds • Configurable retention policies • Simplified & extended management • Single agentto collectboth database and hardware telemetry • Hardware metrics now collected for Windows & OSX hosts
  • 25.
    MongoDB Compass • Visualize& explore your schema with an intuitive GUI • Gain quick insights about your data with easy-to-read histograms • Build queries with a few clicks • Drill down to view individual documents in your collection • Understand and resolve performance issues with visual explain plans • Check index utilization Debug & Optimize Visualize & Explore The GUI for MongoDB Visual explain plans and full CRUD functionality are currently in beta. • Insert new documents or clone existing documents • Modify documents in place using the powerful visual editor • Delete documents in just a few clicks Insert, Modify, & Delete
  • 26.
    MongoDB Compass Visualize andexplore • Visually explore the structure of your data to understand the schema and identify anomalies • Gain insights with histograms that display the distribution of values across your fields • Perform ad hoc complex queries with just a few clicks
  • 27.
    MongoDB Compass Visualize andexplore: Interactive maps for geospatial data MongoDB Compass is the best way to visualize, understand, and work with your geospatial data. • Compass detects your geospatial dataandpopulates it on an interactive map • Automatically generategeospatial queries by drawing on the interactive map with your mouse • Use Compass to significantly reduce the effort requiredwhen working with geospatial data Interactive maps for geospatial data are currently in beta.
  • 28.
    MongoDB Compass Insert, modify& delete: Full CRUD functionality Modify your data using MongoDB Compass. • Insert new documents or clone existing documents • Modify existing documents with greater confidence using the powerful visual editor • Delete documents in just a few clicks Full CRUD functionality is currently in beta.
  • 29.
    MongoDB Compass Debug andoptimize: Visual explain plans Understand how queries are running through a GUI that allows you to easily identify and resolve performance issues. • View key information aboutthe execution plan of a query • Visualize differentexplain stages in an easy-to-understand tree format Visual explain plans are currently in beta.
  • 30.
    MongoDB Compass Debug andoptimize: Index details MongoDB Compass allows you to view index details for a given collection: • Type of index: regular, text, geospatial, or hashed • Size of index: how much space the index uses • Index utilization: how many times the index has been used • Special properties: unique index, compound index, etc.
  • 31.
    MongoDB Compass Newest features •Schema and query optimization • MongoDB Compass enhancements • Modify documents • Create document validation rules • Optimize query performance with visual explain plans, index usage, and real-time statistics • All controlled from a single intuitive and sophisticated GUI
  • 32.
  • 33.
    Links and References • MongoDBCompass • https://www.mongodb.com/produ cts/compass • MongoDB Atlas • https://www.mongodb.com/cloud/ atlas • MongoDB 3.4 • https://www.mongodb.com/mong odb-3.4 Norberto Leite norberto@mongodb.com @nleite https://www.linkedin.com/in/norbertoleite/