MongoDB and Azure Data Bricks - Microsoft
•Download as PPTX, PDF•
2 likes•648 views
A brief update on Microsoft’s recent history in Open Source with specific emphasis on Azure Databricks, a fast, easy and collaborative Apache Spark-based analytics service. You will learn how to integrate MongoDB Atlas with Azure Databricks using the MongoDB Connector for Spark.
Recommended
More Related Content
What's hot
What's hot (20)
Similar to MongoDB and Azure Data Bricks - Microsoft
Similar to MongoDB and Azure Data Bricks - Microsoft (20)
More from MongoDB
More from MongoDB (20)
Recently uploaded
Recently uploaded (20)
MongoDB and Azure Data Bricks - Microsoft
- 1. MongoDB & Azure Data Bricks
- 2. NICK WALLACE Director, Azure Open Source Strategy Microsoft UK MOSTAFA ZAKARIA Solutions Architect MongoDB
- 3. Microsoft is a company of and for developers
- 4. The competitive landscape had shifted…new and surprising partnerships were needed. “…it was certain that we need to make first-class support for Linux in Azure. We made that decision by the time got to the parking lot. This may sound like a purely technical dilemma, but it also posed a profound cultural challenge.”
- 6. Azure Open Source timeline
- 8. ~50% of Azure compute is Linux
- 9. ~50% of Azure compute is Linux 60% of solutions in Azure Marketplace Linux based
- 10. ~50% of Azure compute is Linux 60% of solutions in Azure Marketplace Linux based Strategic partnerships with OSS providers
- 11. Our approach to open source on Azure
- 14. Business Intelligence, Analytics, Machine Learning Process data in MongoDB with the massive parallelism of Spark, it's machine learning libraries, and streaming API ● Process data “in place”, avoiding the latency otherwise required by an incremental ETL task. ● Reduced Operational Complexity and Faster Time-To-Analytics ● Aggregation pre-filtering in combination with secondary indexing means that an analytics query only draws that data required ● Multiple Language APIs
- 15. JSON JSON JSON JSON JSON JSON JSON JSON JSON JSON JSON Business Intelligence, Analytics, Machine Learning Process data in MongoDB with the massive parallelism of Spark, it's machine learning libraries, and streaming API ● Process data “in place”, avoiding the latency otherwise required by an incremental ETL task ● Aggregation pre-filtering in combination with secondary indexing means that an analytics query only draws that data required ● Reads from secondaries isolate analytics workload from business critical operations ● Shard aware for data locality
- 16. WRIT E READ Primar y 2ndary 2ndary Business Intelligence, Analytics, Machine Learning Process data in MongoDB with the massive parallelism of Spark, it's machine learning libraries, and streaming API ● Process data “in place”, avoiding the latency otherwise required by an incremental ETL task ● Aggregation pre-filtering in combination with secondary indexing means that an analytics query only draws that data required ● Reads from secondaries isolate analytics workload from business critical operations ● Shard aware for data locality
- 17. Business Intelligence, Analytics, Machine Learning Process data in MongoDB with the massive parallelism of Spark, it's machine learning libraries, and streaming API ● Process data “in place”, avoiding the latency otherwise required by an incremental ETL task ● Aggregation pre-filtering in combination with secondary indexing means that an analytics query only draws that data required ● Reads from secondaries isolate analytics workload from business critical operations ● Multiple language APIs
- 18. Demo
- 20. Thank you!
Editor's Notes
- Microsoft was founded and managed by people who were originally developers. In other words we were made by developers for developers and for a long time Windows was the predominant platform for application development. Our second CEO wasn’t a developer but when he was on stage was known for showing….great enthusiasm…… for developers
- Our third and current CEO, Satya Nadella, was also a developer and prior to becoming CEO in 2014 he managed the Azure business. In 2017 Satya published a book called Hit Refresh. And in his book - which provided the inspiration for this talk - he mentions our approach to Open Source. Couple of points - It was clear that we had to rethink our approach to partnering, that Linux and OSS workloads needed to become first class citizens on Azure that we needed to undergo a profound cultural change
- So Satya says…… ‘Comments’ were made about Linux and Linux was viewed as a competitor to Windows….indeed Azure was called Windows Azure up until 2014…………..but the world had changed…we saw the rise of Enterprise Linux and Public Cloud and so we set about specifically making Linux a first class citizen on Azure, completely opening up our approach to partnering and becoming more and more active in the Open Source world in general
- Whilst we have been making contributions to the linux kernel for about 9 year with our work on Hyper-V. Our efforts in Open source Really started to pick up in 2014. You can see the timeline here from then to the present day. Satya first publicly mentioned that MS loves Linux – article that Hell Had Frozen Over
- This has taken us to a point….. that today we are really proud to say that approximately half of Azure – at the compute level – is Linux based. That over 60% of solutions provided on the Azure marketplace at Linux based….. and that we have a robust partner ecosystem with all the main players in the open source world.
- This has taken us to a point….. that today we are really proud to say that approximately half of Azure – at the compute level – is Linux based. That over 60% of solutions provided on the Azure marketplace at Linux based….. and that we have a robust partner ecosystem with all the main players in the open source world.
- This has taken us to a point….. that today we are really proud to say that approximately half of Azure – at the compute level – is Linux based. That over 60% of solutions provided on the Azure marketplace at Linux based….. and that we have a robust partner ecosystem with all the main players in the open source world.
- This has taken us to a point….. that today we are really proud to say that approximately half of Azure – at the compute level – is Linux based. That over 60% of solutions provided on the Azure marketplace at Linux based….. and that we have a robust partner ecosystem with all the main players in the open source world.
- And this change shows in Microsoft’s approach to open source in the cloud today We start with enablement, providing that first-class support. Not just for Linux but for MongoDB, Python, Java, Node.js & Terraform. But it’s also about integrating open source into our platform, and doing so in an open way. Today, when you get managed Hadoop, or Kubernetes, or Postgres on Azure, you are getting Hadoop, Kubernetes or Postgres. We’re building this cloud in the open. And we’re also releasing more of our portfolio as open source. We open sourced .NET Core, Visual Studio Code is open source And where we Enable, Integrate and Release we continually contribute upstream to Open Source projects But to me, the key to our approach is the ecosystem. Community governance and commercial partners. ……one of the most important partners for us is MongoDB
- Just a quick recap on Microsoft Azure…….In order to help organizations meet data residency, sovereignty and compliance requirements, we have a worldwide network of 54 Microsoft-managed Azure regions. We offer the infrastructure, applications and core computing needs that our customers want. We are also investing aggressively in the AI space – we are looking to provide a rich set of AI services – both finished AI models – speech/image detection and object motion etc for any developer to make apps smarter. We also have AI tooling for devs to create customer models as part of their apps and data. We have more compliance than any other cloud…….>90% of Fortune500 companies are deployed on Azure today. This also enables joint customer to deploy MongoDB solutions onto a hyperscale public cloud and rapidly create a global footprint using the MongoDB solution they already know and love