The document discusses building a mobile scavenger hunt app. It will allow users to create scavenger hunts by marking waypoints on a map. Players can then search for nearby scavenger hunts and track their progress as they visit each waypoint. The app will also include social features like allowing users to follow each other and exchange messages. It describes the basic requirements, schema design including a waypoint collection with geo-spatial indexes, and mobile/server architecture with a REST API.
This series will follow the development of "Walking Tour", a mobile app that guides users through a given city, feeding the tourist with historical blurbs about the spot in which they currently stand. Users can act as virtual tour guides, uploading their own content to "tag" the location with their own histories. We'll user MongoDB's geo-indexing capabilities to bring the application to life.
Today's customers demand applications which integrate intelligently with data from mobile, social media, and cloud sources. A system of engagement meets these expectations by applying data and analytics drawn from an array of master systems. Relational databases are overwhelmed by the enormous variety in data structures, scale and performance required, but in this webinar you'll learn how to use MongoDB to meet the challenge.
Dev Jumpstart: Schema Design Best PracticesMongoDB
New to MongoDB? We’ll discuss the tradeoff of various data modeling strategies in MongoDB. This talk will jumpstart your knowledge of how to work with documents, evolve your schema, and common schema design patterns. MongoDB’s basic unit of storage is a document. No prior knowledge of MongoDB is assumed.
This series will follow the development of "Walking Tour", a mobile app that guides users through a given city, feeding the tourist with historical blurbs about the spot in which they currently stand. Users can act as virtual tour guides, uploading their own content to "tag" the location with their own histories. We'll user MongoDB's geo-indexing capabilities to bring the application to life.
Today's customers demand applications which integrate intelligently with data from mobile, social media, and cloud sources. A system of engagement meets these expectations by applying data and analytics drawn from an array of master systems. Relational databases are overwhelmed by the enormous variety in data structures, scale and performance required, but in this webinar you'll learn how to use MongoDB to meet the challenge.
Dev Jumpstart: Schema Design Best PracticesMongoDB
New to MongoDB? We’ll discuss the tradeoff of various data modeling strategies in MongoDB. This talk will jumpstart your knowledge of how to work with documents, evolve your schema, and common schema design patterns. MongoDB’s basic unit of storage is a document. No prior knowledge of MongoDB is assumed.
MongoDB Europe 2016 - Debugging MongoDB PerformanceMongoDB
Asya is back, and so is Sherlock Holmes and his techniques to gather and analyze data from your poorly performing MongoDB clusters. In this advanced talk we take a deep look at all the diagnostic data that lives inside MongoDB - how to interrogate and interpret it to help you solve those frustrating performance bottlenecks that we all face occasionally.
Aggregation pipeline has been able to power your analysis of data since version 2.2. In 4.2 we added more power and now you can use it for more powerful queries, updates, and outputting your data to existing collections. Come hear how you can do everything with the pipeline, including single-view, ETL, data roll-ups and materialized views.
Presented by Norberto Leite, Developer Advocate, MongoDB
Deploying any software can be a challenge if you don't understand how resources are used or how to plan for the capacity of your systems. Whether you need to deploy or grow a single MongoDB instance, replica set, or tens of sharded clusters then you probably share the same challenges in trying to size that deployment. This session will cover what resources MongoDB uses, and how to plan for their use in your deployment. Topics covered will include understanding how to model and plan capacity needs for new and growing deployments. The goal of this session will be to provide you with the tools needed to be successful in managing your MongoDB capacity planning tasks.
MongoDB Days UK: Securing Your Deployment with MongoDB EnterpriseMongoDB
Presented by Mat Keep, Principal Product Manager, MongoDB
Security is more critical than ever with new computing environments in the cloud and expanding access to the Internet. There are a number of security protection mechanisms available for MongoDB to ensure you have a stable and secure architecture for your deployment. We'll walk through general security threats to databases and specifically how they can be mitigated for MongoDB deployments. Topics will include:
- General security tools
- How to configure those for MongoDB
- Security features available in MongoDB such as LDAP, SSL, x.509, authentication, and encryption
Presented by Ruben Terceno, Senior Solutions Architect, MongoDB
Getting ready to deploy? MongoDB is designed to be simple to administer and to manage. An understanding of best practices can ensure a successful implementation. This talk will introduce you to Cloud Manager, the easiest way to run MongoDB in the cloud. We'll walk through demos of provisioning, expanding and contracting clusters, managing users, and more. Cloud Manager makes operations effortless, reducing complicated tasks to a single click. You can now provision machines, configure replica sets and sharded clusters, and upgrade your MongoDB deployment all through the Cloud Manager interface. You'll walk from this session knowing that you can run MongoDB with confidence.
Internet of Things Cologne 2015: MongoDB Technical PresentationMongoDB
The value of the fast-growing class of NoSQL databases is the ability to handle high velocity volumes of data. And also enabling greater agility using dynamic schemas. MongoDB gives you those benefits while also providing a rich querying capability, and a document model for developer productivity. Learn about the reasons for MongoDB's popularity, and how you can leverage the core concepts of NoSQL to build robust and highly scalable IoT applications.
This is the story of a how small team at Rakuten made its first foray into MongoDB and agile development. In this talk, we'll describe how a group of MongoDB newbies approached development, schema design, ODMs, and AWS best practices. We'll discuss how we evaluated MongoDB and other new databases; things we did to speed up development, like automated testing; and how we worked with ops to make this a success. Finally, we'll share some positive outcomes, like how we got to production faster than ever before.
Presented by Dan Harabagiu, Head of Platform Development, ProSiebenSat.1
At ProSiebenSat.1, we set out to build and Single Sign On service (or SSO), a web service that provides the user with the ability to easily login and be recognised across multiple web platforms and digital assets. We decided to build the solution in-house, and chose MongoDB for the project. In this session we’ll discuss why we chose to use the MEAN stack for our SSO, how we adjusted and re-adjusted our data models for optimum performance and how and why we decided to create a sharded environment to achieve 520,000 requests per minute.
Evolution and Scaling of MongoDB Management Service Running on MongoDBMongoDB
"MongoDB isn't just software we release; it's software we rely on every day as part of the MongoDB Management Service (MMS). We use MongoDB to store monitoring data and backups for the databases of over 50,000 customers. Get the inside scoop on running an overwhelmingly write-heavy application as MMS engineers Steve Briskin and John Morales explain the tweaks and optimizations they use to get most out of every machine, including:
- RRD schema design to balance write throughput and read latency
- Warming indexes before inserts
- Backup snapshot storage design optimized for insert-only workloads
They will also discuss the process of migrating to 3.0 and how it has simplified their lives."
MongoDB and Spring - Two leaves of a same treeMongoDB
Enterprise systems evolve at a tremendous pace these days. All sorts of new frameworks, databases, operating systems and multiple deployment strategies and infrastructures to adjust to ever growing business demands.
Hermes: Free the Data! Distributed Computing with MongoDBMongoDB
Moving data throughout an organization is an art form. Whether mastering the art of ETL or building micro services, we are often left with either business logic embedded where it doesn't belong or monolithic apps that do too much. In this talk, we will show you how we built a persisted messaging bus to ‘Free the Data’ from the apps, making it available across the organization without having to write custom ETL code. This in turn makes it possible for business apps to be standalone, testable and more reliable. We will discuss the basic architecture and how it works, go through some code samples (server side and client side), and present some statistics and visualizations.
MongoDB Days UK: Scaling MongoDB with Docker and cgroupsMongoDB
Presented by Marco Bonezzi, Technical Services Engineer, MongoDB
Experience level: Advanced
There is no doubt that users always look for new ways to scale their applications. Along this trend, the use of Docker as the container technology is becoming more frequent to deploy and easily manage complex architectures like sharded clusters in MongoDB. One of the challenges of scaling MongoDB using containers technology is to understand how to implement your cluster while monitoring and controlling resource usage of each component. This session focuses on combining MongoDB sharded clusters and Docker containers with cgroups to successfully control resource usage of a MongoDB cluster with the WiredTiger storage engine.
Mobile 2: What's My Place in the Universe? Using Geo-Indexing to Solve Existe...MongoDB
Second in the mobile series. Our mobile application takes shape as we build out a schema to support geo-specific data and friend finding. Learn how to use MongoDB geo-indexing for real-time proximity matching and gather analytics with the aggregation framework.
Webinar: MongoDB and Polyglot Persistence ArchitectureMongoDB
Polyglot persistence is about using multiple databases in concert with one another as part of a larger datastore ecosystem. The advantage is that your database layer uses a set of specialized tools to deliver overall value and functionality while simplifying data modeling by separating command and query responsibilities. The arrival of MongoDB and it’s flexible schemas further increases the possibilities of polyglot architectures.
MongoDB Europe 2016 - Debugging MongoDB PerformanceMongoDB
Asya is back, and so is Sherlock Holmes and his techniques to gather and analyze data from your poorly performing MongoDB clusters. In this advanced talk we take a deep look at all the diagnostic data that lives inside MongoDB - how to interrogate and interpret it to help you solve those frustrating performance bottlenecks that we all face occasionally.
Aggregation pipeline has been able to power your analysis of data since version 2.2. In 4.2 we added more power and now you can use it for more powerful queries, updates, and outputting your data to existing collections. Come hear how you can do everything with the pipeline, including single-view, ETL, data roll-ups and materialized views.
Presented by Norberto Leite, Developer Advocate, MongoDB
Deploying any software can be a challenge if you don't understand how resources are used or how to plan for the capacity of your systems. Whether you need to deploy or grow a single MongoDB instance, replica set, or tens of sharded clusters then you probably share the same challenges in trying to size that deployment. This session will cover what resources MongoDB uses, and how to plan for their use in your deployment. Topics covered will include understanding how to model and plan capacity needs for new and growing deployments. The goal of this session will be to provide you with the tools needed to be successful in managing your MongoDB capacity planning tasks.
MongoDB Days UK: Securing Your Deployment with MongoDB EnterpriseMongoDB
Presented by Mat Keep, Principal Product Manager, MongoDB
Security is more critical than ever with new computing environments in the cloud and expanding access to the Internet. There are a number of security protection mechanisms available for MongoDB to ensure you have a stable and secure architecture for your deployment. We'll walk through general security threats to databases and specifically how they can be mitigated for MongoDB deployments. Topics will include:
- General security tools
- How to configure those for MongoDB
- Security features available in MongoDB such as LDAP, SSL, x.509, authentication, and encryption
Presented by Ruben Terceno, Senior Solutions Architect, MongoDB
Getting ready to deploy? MongoDB is designed to be simple to administer and to manage. An understanding of best practices can ensure a successful implementation. This talk will introduce you to Cloud Manager, the easiest way to run MongoDB in the cloud. We'll walk through demos of provisioning, expanding and contracting clusters, managing users, and more. Cloud Manager makes operations effortless, reducing complicated tasks to a single click. You can now provision machines, configure replica sets and sharded clusters, and upgrade your MongoDB deployment all through the Cloud Manager interface. You'll walk from this session knowing that you can run MongoDB with confidence.
Internet of Things Cologne 2015: MongoDB Technical PresentationMongoDB
The value of the fast-growing class of NoSQL databases is the ability to handle high velocity volumes of data. And also enabling greater agility using dynamic schemas. MongoDB gives you those benefits while also providing a rich querying capability, and a document model for developer productivity. Learn about the reasons for MongoDB's popularity, and how you can leverage the core concepts of NoSQL to build robust and highly scalable IoT applications.
This is the story of a how small team at Rakuten made its first foray into MongoDB and agile development. In this talk, we'll describe how a group of MongoDB newbies approached development, schema design, ODMs, and AWS best practices. We'll discuss how we evaluated MongoDB and other new databases; things we did to speed up development, like automated testing; and how we worked with ops to make this a success. Finally, we'll share some positive outcomes, like how we got to production faster than ever before.
Presented by Dan Harabagiu, Head of Platform Development, ProSiebenSat.1
At ProSiebenSat.1, we set out to build and Single Sign On service (or SSO), a web service that provides the user with the ability to easily login and be recognised across multiple web platforms and digital assets. We decided to build the solution in-house, and chose MongoDB for the project. In this session we’ll discuss why we chose to use the MEAN stack for our SSO, how we adjusted and re-adjusted our data models for optimum performance and how and why we decided to create a sharded environment to achieve 520,000 requests per minute.
Evolution and Scaling of MongoDB Management Service Running on MongoDBMongoDB
"MongoDB isn't just software we release; it's software we rely on every day as part of the MongoDB Management Service (MMS). We use MongoDB to store monitoring data and backups for the databases of over 50,000 customers. Get the inside scoop on running an overwhelmingly write-heavy application as MMS engineers Steve Briskin and John Morales explain the tweaks and optimizations they use to get most out of every machine, including:
- RRD schema design to balance write throughput and read latency
- Warming indexes before inserts
- Backup snapshot storage design optimized for insert-only workloads
They will also discuss the process of migrating to 3.0 and how it has simplified their lives."
MongoDB and Spring - Two leaves of a same treeMongoDB
Enterprise systems evolve at a tremendous pace these days. All sorts of new frameworks, databases, operating systems and multiple deployment strategies and infrastructures to adjust to ever growing business demands.
Hermes: Free the Data! Distributed Computing with MongoDBMongoDB
Moving data throughout an organization is an art form. Whether mastering the art of ETL or building micro services, we are often left with either business logic embedded where it doesn't belong or monolithic apps that do too much. In this talk, we will show you how we built a persisted messaging bus to ‘Free the Data’ from the apps, making it available across the organization without having to write custom ETL code. This in turn makes it possible for business apps to be standalone, testable and more reliable. We will discuss the basic architecture and how it works, go through some code samples (server side and client side), and present some statistics and visualizations.
MongoDB Days UK: Scaling MongoDB with Docker and cgroupsMongoDB
Presented by Marco Bonezzi, Technical Services Engineer, MongoDB
Experience level: Advanced
There is no doubt that users always look for new ways to scale their applications. Along this trend, the use of Docker as the container technology is becoming more frequent to deploy and easily manage complex architectures like sharded clusters in MongoDB. One of the challenges of scaling MongoDB using containers technology is to understand how to implement your cluster while monitoring and controlling resource usage of each component. This session focuses on combining MongoDB sharded clusters and Docker containers with cgroups to successfully control resource usage of a MongoDB cluster with the WiredTiger storage engine.
Mobile 2: What's My Place in the Universe? Using Geo-Indexing to Solve Existe...MongoDB
Second in the mobile series. Our mobile application takes shape as we build out a schema to support geo-specific data and friend finding. Learn how to use MongoDB geo-indexing for real-time proximity matching and gather analytics with the aggregation framework.
Webinar: MongoDB and Polyglot Persistence ArchitectureMongoDB
Polyglot persistence is about using multiple databases in concert with one another as part of a larger datastore ecosystem. The advantage is that your database layer uses a set of specialized tools to deliver overall value and functionality while simplifying data modeling by separating command and query responsibilities. The arrival of MongoDB and it’s flexible schemas further increases the possibilities of polyglot architectures.
Parse has one of the world's largest and most complicated MongoDB deployments, with millions of collections, tens of millions of indexes, and hundreds of thousands of different workload types. In this talk we'll cover our experiences evaluating all three major storage engines — mmapv1, WiredTiger, and RocksDB, sharing benchmarks and compression rates and and fun anecdotes from all three. Igor Canadi will do a deeper dive into RocksDB — what is RocksDB, what is LSM storage, and what are a few of the similarities and differences between RocksDB and WiredTiger. We will then talk about why we are pursuing RocksDB as our primary workload storage engine moving forward, and share some thoughts about the future of MongoDB storage engine innovation.
Our Application development is nearing completion. It's time to prepare our cluster for production, but are we sure the system is capable of handing the load? Have we achieved high availability? What preflight checks should we be running. Learn how Dev & Ops work together to achieve production readiness and plan for scale, availability, monitoring.
Webinar: Enterprise Data Management in the Era of MongoDB and Data LakesMongoDB
With so much talk of how Big Data is revolutionizing the world and how a data lake with Hadoop and/or Spark will solve all your data problems, it is hard to tell what is hype, reality, or somewhere in-between.
In working with dozens of enterprises in varying stages of their enterprise data management (EDM) strategy, MongoDB enterprise architect, Matt Kalan, sees the same challenges and misunderstandings arise again and again.
In this session, he will explain common challenges in data management, what capabilities are necessary, and what the future state of architecture looks like. MongoDB is uniquely capable of filling common gaps in the data lake strategy.
This session also includes a live Q&A portion during which you are encouraged to ask questions of our team.
MongoDB Drivers And High Availability: Deep DiveMongoDB
MongoDB has separate drivers for ten programming languages, and all are responsible for connecting to replica sets or groups of mongos. What algorithms do they use to find servers, connect to them, discover their state, choose which ones to use, and survive failovers? A. Jesse Jiryu Davis, a Staff Engineer on the MongoDB Drivers Team, is the author of the Server Discovery And Monitoring Spec. He will explain the inner workings of MongoDB drivers and their behavior within complex server topologies.
Securing MongoDB to Serve an AWS-Based, Multi-Tenant, Security-Fanatic SaaS A...MongoDB
MongoDB introduces new capabilities that change the way micro-services interact with the database, capabilities that are either absent or exist only partially in high-end commercial databases such as Oracle. In this session I will share from my experiences building a cloud-based, multi-tenant SaaS application with extreme security requirements. We will cover topics including considerations for storing multi-tenant data in the database, best practices for authentication and authorization, and performance considerations specific to security in MongoDB.
MongoDB 3.0 introduces a new pluggable storage engine API and a new storage engine called WiredTiger. The engineering team behind WiredTiger team has a long and distinguished career, having architected and built Berkeley DB, now the world's most widely used embedded database. In this talk we will describe our original design goals for WiredTiger, including considerations we made for heavily threaded hardware, large on-chip caches, and SSD storage. We'll also look at some of the latch-free and non-blocking algorithms we've implemented, as well as other techniques that improve scaling, overall throughput and latency. Finally, we'll take a look at some of the features we hope to incorporate into WiredTiger and MongoDB in the future.
Users demand applications which integrate intelligently with data from mobile, social media and cloud sources. A system of engagement meets these expectations by applying data and analytics drawn from an array of master systems. The enormous scale and performance required overwhelm relational approaches, but we can use MongoDB to meet the challenge. We'll learn to capture and transmit data changes among disparate systems, expose batch data as interactive operational queries and build systems with strong division of concerns, agility and flexibility
Slide notes from Desert Code Camp 2014. This talk focuses on using the MEAN Stack to build an app that uses Facebook authentication for access, demonstrates advanced permissions for reading an authenticated user's Facebook data, and generating a data visualization using the D3.js library and custom Angular directives.
Start visualizing, analyzing and exploring Instagram feeds/influencer from South Tyrol & Trentino and inquiries/bookings from Touristic Portals from South Tyrol (BigData4Tourism working group) with Elastic.
Building a Scalable Inbox System with MongoDB and Javaantoinegirbal
Many user-facing applications present some kind of news feed/inbox system. You can think of Facebook, Twitter, or Gmail as different types of inboxes where the user can see data of interest, sorted by time, popularity, or other parameter. A scalable inbox is a difficult problem to solve: for millions of users, varied data from many sources must be sorted and presented within milliseconds. Different strategies can be used: scatter-gather, fan-out writes, and so on. This session presents an actual application developed by 10gen in Java, using MongoDB. This application is open source and is intended to show the reference implementation of several strategies to tackle this common challenge. The presentation also introduces many MongoDB concepts.
Extensible RESTful Applications with Apache TinkerPopVarun Ganesh
Presented at Graph Day SF 2018.
You are into data analytics. You come across a source of data and you realise that it is an intuitive case for a Knowledge Graph and that there is much value to be gained by incorporating it into one. How do you take this from zero to product while ensuring that it is well-tested, extensible, scalable and plays nicely with other components and services?
Slack, with its various interactions among its users is a prime candidate for this. Join us as we take you through our journey of conceptualizing Slack user data as a knowledge graph, evaluating different frameworks, incorporating business logic using TinkerPop with an extensible DSL and exposing it all through a familiar RESTful interface that allows us to effectively handle an ever-growing and dynamic graph.
Wie für viele andere Plattformen, so ist auch für XING die Öffnung der Rechenzentrumsgrenzen mit Hilfe von externen APIs, z.B. zur Partnerintegration, ein wichtiges Thema. In diesem Vortrag werfen wir einen Blick auf die Interna der (API-)Entwicklung bei XING: Architektur der Plattform, Historie der verschiedenen APIs, Entwicklungsprozesse, best practices beim API-Design, enge Zusammenarbeit mit einzelnen Consumern sowie (rechtliche) Herausforderungen bei der Datenweitergabe via API.
Advanced Document Modeling Techniques from a High-Scale Commerce PlatformMongoDB
The Mozu Commerce Platform’s Content Management System empowers merchants to model, author, publish and query their commerce and website content. In this talk, we will discuss inventive techniques used to build a high-scale Content Management System on MongoDB. This presentation will explore tangible, real world examples of compensating actions, virtual joins and benign writes and wrongs. If you’re ready to move beyond simple document modeling and CRUD operations or if you’d just like to see what is possible with MongoDB, then this talk will provide you with advanced patterns and use cases that take advantage of them.
Building a complete social networking platform presents many challenges at scale. Socialite is a reference architecture and open source Java implementation of a scalable social feed service built on DropWizard and MongoDB. We'll provide an architectural overview of the platform, explaining how you can store an infinite timeline of data while optimizing indexing and sharding configuration for access to the most recent window of data. We'll also dive into the details of storing a social user graph in MongoDB.
Media owners are turning to MongoDB to drive social interaction with their published content. The way customers consume information has changed and passive communication is no longer enough. They want to comment, share and engage with publishers and their community through a range of media types and via multiple channels whenever and wherever they are. There are serious challenges with taking this semi-structured and unstructured data and making it work in a traditional relational database. This webinar looks at how MongoDB’s schemaless design and document orientation gives organisation’s like the Guardian the flexibility to aggregate social content and scale out.
Similar to 1140 p2 p04_and_1350_p2p05_and_1440_p2p06 (20)
MongoDB SoCal 2020: Migrate Anything* to MongoDB AtlasMongoDB
During this talk we'll navigate through a customer's journey as they migrate an existing MongoDB deployment to MongoDB Atlas. While the migration itself can be as simple as a few clicks, the prep/post effort requires due diligence to ensure a smooth transfer. We'll cover these steps in detail and provide best practices. In addition, we’ll provide an overview of what to consider when migrating other cloud data stores, traditional databases and MongoDB imitations to MongoDB Atlas.
MongoDB SoCal 2020: Go on a Data Safari with MongoDB Charts!MongoDB
These days, everyone is expected to be a data analyst. But with so much data available, how can you make sense of it and be sure you're making the best decisions? One great approach is to use data visualizations. In this session, we take a complex dataset and show how the breadth of capabilities in MongoDB Charts can help you turn bits and bytes into insights.
MongoDB SoCal 2020: Using MongoDB Services in Kubernetes: Any Platform, Devel...MongoDB
MongoDB Kubernetes operator and MongoDB Open Service Broker are ready for production operations. Learn about how MongoDB can be used with the most popular container orchestration platform, Kubernetes, and bring self-service, persistent storage to your containerized applications. A demo will show you how easy it is to enable MongoDB clusters as an External Service using the Open Service Broker API for MongoDB
MongoDB SoCal 2020: A Complete Methodology of Data Modeling for MongoDBMongoDB
Are you new to schema design for MongoDB, or are you looking for a more complete or agile process than what you are following currently? In this talk, we will guide you through the phases of a flexible methodology that you can apply to projects ranging from small to large with very demanding requirements.
MongoDB SoCal 2020: From Pharmacist to Analyst: Leveraging MongoDB for Real-T...MongoDB
Humana, like many companies, is tackling the challenge of creating real-time insights from data that is diverse and rapidly changing. This is our journey of how we used MongoDB to combined traditional batch approaches with streaming technologies to provide continues alerting capabilities from real-time data streams.
MongoDB SoCal 2020: Best Practices for Working with IoT and Time-series DataMongoDB
Time series data is increasingly at the heart of modern applications - think IoT, stock trading, clickstreams, social media, and more. With the move from batch to real time systems, the efficient capture and analysis of time series data can enable organizations to better detect and respond to events ahead of their competitors or to improve operational efficiency to reduce cost and risk. Working with time series data is often different from regular application data, and there are best practices you should observe.
This talk covers:
Common components of an IoT solution
The challenges involved with managing time-series data in IoT applications
Different schema designs, and how these affect memory and disk utilization – two critical factors in application performance.
How to query, analyze and present IoT time-series data using MongoDB Compass and MongoDB Charts
At the end of the session, you will have a better understanding of key best practices in managing IoT time-series data with MongoDB.
Join this talk and test session with a MongoDB Developer Advocate where you'll go over the setup, configuration, and deployment of an Atlas environment. Create a service that you can take back in a production-ready state and prepare to unleash your inner genius.
MongoDB .local San Francisco 2020: Powering the new age data demands [Infosys]MongoDB
Our clients have unique use cases and data patterns that mandate the choice of a particular strategy. To implement these strategies, it is mandatory that we unlearn a lot of relational concepts while designing and rapidly developing efficient applications on NoSQL. In this session, we will talk about some of our client use cases, the strategies we have adopted, and the features of MongoDB that assisted in implementing these strategies.
MongoDB .local San Francisco 2020: Using Client Side Encryption in MongoDB 4.2MongoDB
Encryption is not a new concept to MongoDB. Encryption may occur in-transit (with TLS) and at-rest (with the encrypted storage engine). But MongoDB 4.2 introduces support for Client Side Encryption, ensuring the most sensitive data is encrypted before ever leaving the client application. Even full access to your MongoDB servers is not enough to decrypt this data. And better yet, Client Side Encryption can be enabled at the "flick of a switch".
This session covers using Client Side Encryption in your applications. This includes the necessary setup, how to encrypt data without sacrificing queryability, and what trade-offs to expect.
MongoDB .local San Francisco 2020: Using MongoDB Services in Kubernetes: any ...MongoDB
MongoDB Kubernetes operator is ready for prime-time. Learn about how MongoDB can be used with most popular orchestration platform, Kubernetes, and bring self-service, persistent storage to your containerized applications.
MongoDB .local San Francisco 2020: Go on a Data Safari with MongoDB Charts!MongoDB
These days, everyone is expected to be a data analyst. But with so much data available, how can you make sense of it and be sure you're making the best decisions? One great approach is to use data visualizations. In this session, we take a complex dataset and show how the breadth of capabilities in MongoDB Charts can help you turn bits and bytes into insights.
MongoDB .local San Francisco 2020: From SQL to NoSQL -- Changing Your MindsetMongoDB
When you need to model data, is your first instinct to start breaking it down into rows and columns? Mine used to be too. When you want to develop apps in a modern, agile way, NoSQL databases can be the best option. Come to this talk to learn how to take advantage of all that NoSQL databases have to offer and discover the benefits of changing your mindset from the legacy, tabular way of modeling data. We’ll compare and contrast the terms and concepts in SQL databases and MongoDB, explain the benefits of using MongoDB compared to SQL databases, and walk through data modeling basics so you feel confident as you begin using MongoDB.
MongoDB .local San Francisco 2020: MongoDB Atlas JumpstartMongoDB
Join this talk and test session with a MongoDB Developer Advocate where you'll go over the setup, configuration, and deployment of an Atlas environment. Create a service that you can take back in a production-ready state and prepare to unleash your inner genius.
MongoDB .local San Francisco 2020: Tips and Tricks++ for Querying and Indexin...MongoDB
Query performance should be the unsung hero of an application, but without proper configuration, can become a constant headache. When used properly, MongoDB provides extremely powerful querying capabilities. In this session, we'll discuss concepts like equality, sort, range, managing query predicates versus sequential predicates, and best practices to building multikey indexes.
MongoDB .local San Francisco 2020: Aggregation Pipeline Power++MongoDB
Aggregation pipeline has been able to power your analysis of data since version 2.2. In 4.2 we added more power and now you can use it for more powerful queries, updates, and outputting your data to existing collections. Come hear how you can do everything with the pipeline, including single-view, ETL, data roll-ups and materialized views.
MongoDB .local San Francisco 2020: A Complete Methodology of Data Modeling fo...MongoDB
Are you new to schema design for MongoDB, or are you looking for a more complete or agile process than what you are following currently? In this talk, we will guide you through the phases of a flexible methodology that you can apply to projects ranging from small to large with very demanding requirements.
MongoDB .local San Francisco 2020: MongoDB Atlas Data Lake Technical Deep DiveMongoDB
MongoDB Atlas Data Lake is a new service offered by MongoDB Atlas. Many organizations store long term, archival data in cost-effective storage like S3, GCP, and Azure Blobs. However, many of them do not have robust systems or tools to effectively utilize large amounts of data to inform decision making. MongoDB Atlas Data Lake is a service allowing organizations to analyze their long-term data to discover a wealth of information about their business.
This session will take a deep dive into the features that are currently available in MongoDB Atlas Data Lake and how they are implemented. In addition, we'll discuss future plans and opportunities and offer ample Q&A time with the engineers on the project.
MongoDB .local San Francisco 2020: Developing Alexa Skills with MongoDB & GolangMongoDB
Virtual assistants are becoming the new norm when it comes to daily life, with Amazon’s Alexa being the leader in the space. As a developer, not only do you need to make web and mobile compliant applications, but you need to be able to support virtual assistants like Alexa. However, the process isn’t quite the same between the platforms.
How do you handle requests? Where do you store your data and work with it to create meaningful responses with little delay? How much of your code needs to change between platforms?
In this session we’ll see how to design and develop applications known as Skills for Amazon Alexa powered devices using the Go programming language and MongoDB.
MongoDB .local Paris 2020: Realm : l'ingrédient secret pour de meilleures app...MongoDB
aux Core Data, appréciée par des centaines de milliers de développeurs. Apprenez ce qui rend Realm spécial et comment il peut être utilisé pour créer de meilleures applications plus rapidement.
MongoDB .local Paris 2020: Upply @MongoDB : Upply : Quand le Machine Learning...MongoDB
Il n’a jamais été aussi facile de commander en ligne et de se faire livrer en moins de 48h très souvent gratuitement. Cette simplicité d’usage cache un marché complexe de plus de 8000 milliards de $.
La data est bien connu du monde de la Supply Chain (itinéraires, informations sur les marchandises, douanes,…), mais la valeur de ces données opérationnelles reste peu exploitée. En alliant expertise métier et Data Science, Upply redéfinit les fondamentaux de la Supply Chain en proposant à chacun des acteurs de surmonter la volatilité et l’inefficacité du marché.
12. 12
Waypoint
{ _id: ObjectId(),
user: UUID,
tour: UUDI
name: "Doug's Dogs",
desc: "The best hot-dog",
clues: [
"Hungry for a Coney Island?",
"Ask for Dr. Frankenfurter",
"Look for the hot dog stand"
],
"geometry": {
"type": "Point",
"coordinates": [125.6, 10.1] }
};
13. 13
Waypoint
{ _id: ObjectId(),
user: UUID,
tour: UUDI
name: "Doug's Dogs",
desc: "The best hot-dog",
clues: [
"Hungry for a Coney Island?",
"Ask for Dr. Frankenfurter",
"Look for the hot dog stand"
],
"geometry": {
"type": "Point",
"coordinates": [125.6, 10.1] }
};
14. 14
Waypoint
{ _id: ObjectId(),
user: UUID,
tour: UUDI
name: "Doug's Dogs",
desc: "The best hot-dog",
clues: [
"Hungry for a Coney Island?",
"Ask for Dr. Frankenfurter",
"Look for the hot dog stand"
],
"geometry": {
"type": "Point",
"coordinates": [125.6, 10.1] }
};
Geospacial Index:
ensureIndex(
{ geometry: “2dsphere” }
)
27. 30
Notifications / Messaging
Message
{
sender: “Hypatia”,
recipients: [
“Democritus”,
“Euripides”,
“Eratosthenes”
]
date: ISODate(),
message: “truth is a point of view, and
so is changeable”
}
28. 31
Notifications / Messaging
Message
{
sender: “Hypatia”,
recipients: [
“Democritus”,
“Euripides”,
“Eratosthenes”
]
date: ISODate(),
message: “truth is a point of view, and
so is changeable”
}
db.messages.find(
{ recipients: “Democritus”}
);
33. 36
One Document per Message per Recipient
{
sender: “Hypatia”,
recipient: “Democritus”,
date: ISODate(),
message: “truth is a point of view, and so is changeable”
}
{
sender: “Hypatia”,
recipient: “Euripides”,
date: ISODate(),
message: “truth is a point of view, and so is changeable”
}
{
sender: “Hypatia”,
recipient: “Eratosthenes”,
date: ISODate(),
message: “truth is a point of view, and so is changeable”
}
50. 60
The Scavenger Hunt App
Basic Requirements
• Mark target points
• Identify our users
51. 61
The Scavenger Hunt App
Basic Requirements
• Mark target points
• Identify our users
• Mark users’ progress
during hunts
52. 62
Waypoint
{ _id: ObjectId(),
user: UUID,
tour: UUDI
name: "Doug's Dogs",
desc: "The best hot-dog",
clues: [
"Hungry for a Coney Island?",
"Ask for Dr. Frankenfurter",
"Look for the hot dog stand"
],
"geometry": {
"type": "Point",
"coordinates": [125.6, 10.1] }
};
53. 63
Waypoint
{ _id: ObjectId(),
user: UUID,
tour: UUDI
name: "Doug's Dogs",
desc: "The best hot-dog",
clues: [
"Hungry for a Coney Island?",
"Ask for Dr. Frankenfurter",
"Look for the hot dog stand"
],
"geometry": {
"type": "Point",
"coordinates": [125.6, 10.1] }
};
Geospacial Index:
ensureIndex(
{ geometry: “2dsphere” }
)
87. 97
Coordinate Reference System
• A system to locate geographical entities
• WGS84 datum
• Geoid - the shape of the surface of the oceans
• EGM96 gravitational model
"crs": {
"type": "name",
"properties": {
"name": "urn:ogc:def:crs:OGC:1.3:CRS84"
}
}
103. 113
Sizing
• Indexes need to be in RAM
• Working set needs to be in RAM
• I/O Bandwidth
- write load
- Index updates
- Working set migration
{ _id: ObjectId(),
tour: UUID,
user: UUID,
name: "Doug's Dogs",
desc: "The best hot-dog",
clues: [
"Hungry for a Coney Island?",
"Ask for Dr. Frankenfurter",
"Look for the hot dog stand"
]
"geometry": {
"type": "Point",
"coordinates": [125.6, 10.1]
}
}
107. 120
Load Testing
• Test it like you use it, benchmarks don’t count
• Test to failure
• Instrument your code!
108. 121
Load Testing
• Test it like you use it, benchmarks don’t count
• Test to failure
• Instrument your code!
https://github.com/breinero/Firehose
https://github.com/ParsePlatform/flashback
109. 122
Load Testing
• Test it like you use it, benchmarks don’t count
• Test to failure
• Instrument your code!
There’s me
119. 132
Security
• Firewall
• Bind ip
• Encrypt Networks
• Enable Access Control
• Don’t enable REST interface
• Auditing
Limit Exposure
and use
Principal of Least Privileges
120. 133
Tuning
Best Practices
• Disable Transparent hugepages
• NTP to synchronize time
• Set ulimits
• Use XFS or Ext4
• Don’t use NFS
• Disable NUMA
• Have swap
Read Production Notes
Tunables
• Set IO Scheduler NOOP
• Adjust readaheads ( MMapV1 )
• Avoid cgroups
• SE Linux (?)
• RAID
140. 156
Client Side
• Don’t use ensureIndex() in application
• Look out for connection bombs
--maxConnect
• DO use operation timeouts
• DON’T cause socket timeouts
Lower keepalives
• Avoid retry bombs
141. 157
Requirements & Specs
Make a DevOps Contract
• Database Access Requirements
• Database Access Fulfillment Specification
• Cluster Configuration
• Monitoring and Alerting Specification