Software warstories mba-club
•Download as PPTX, PDF•
0 likes•272 views
The document discusses lessons learned from software business experiences, including that software should do a few things well without negatively impacting users' computers. It recommends keeping development teams small by having no more than two people per feature and three parallel features. While fashion trends change, software fashion should be tailored to customers' needs without obsessing over changes. Constants to expect are that more developers will likely lead to more concurrent features, software slows faster than hardware speeds up, 10% of developers write 80% of code, and 5% of developers create 50% of bugs. It also notes that funding a development team costs $10,000 per member per month.
Report
Share
Report
Share
Recommended
How MongoDB is Being Used in China - Case Studies
We will discuss a variety of use cases for MongoDB in China's Internet industry across several verticals, sizes, and applications. This discussion will include reasons for using MongoDB, experiences, issues, and successes.
MongoDB at Flight Centre Ltd
How MongoDB has empowered the business to rapidly respond to market conditions .
By Michael Frost, Web Solution Architect at Flight Centre Ltd. Presented at MongoDB Sydney, 2012.
Building Expedia’s Travel Graph using MongoDB
1. Expedia built a travel graph using MongoDB to power their Scratchpad note-taking tool, handling 20-40 million writes and 40-60 million reads per day.
2. The initial MongoDB deployment struggled with performance as traffic increased, requiring optimizations like additional shards and provisioned IOPS.
3. The travel graph ecosystem has expanded to include three shards, increased data retention, and geo-distributed secondary reads to support over 80 million queries daily while providing a unified travel planning experience.
Starting out with MongoDB
An Introduction to MongoDB
MongoDB is a rapidly growing noSQL database solution used by many major companies and favored by startups for its simple design and setup. Its greatest advantage is the ability to use the unstructured data type, BSON, which allows developers to avoid writing, maintaining and upgrading schema. Unlike some SQL options, it has scaling and redundancy built-in and allows for quick ad-hoc querying of any data. This talk will go over the basics of data insertion/retrieval, compare querying between SQL and MongoDB, work through some advanced queries like map/reduce and aggregation, and look at the more sophisticated features from a 10,000 ft view.
Bio: Matt Warren is a graduate of Northeastern University and has been working in Systems Administration and Engineering for 8 years. His career started at Smarter Travel Media and most recently he is working for Boston-based ground travel startup, Wanderu. He specializes in scaling solutions to handle the traffic loads of high performance, e-commerce websites. In September of 2015, he became organizer of the Boston MongoDB Meetup.
Event: http://w3.abcd.harvard.edu/ai1ec_event/intro-to-mongodb/
Mongo DB: Operational Big Data Database
MongoDB is the leading NoSQL database due to a plenitude of reasons, open source, general purpose, document oriented database supported by a large community and educational platform. It's horizontal scalability features allows this to fit in the operational big data scenarios where the business needs point to realtime analytics and ever-increasing data sets. This talk will focus on the usage of MongoDB for big data operational purposes and why it's ideal to be used in such scenarios. Also integration with other notable big data technology out there like Hadoop and BI tools.
Norberto Leite - Senior Solutions Architect, @MongoDB.
Mongo DB presentation during the Pentaho & Big Data Ecosystem - Live Seminar 2013
OTA Platform with MongoDB
This document summarizes an OTA (Online Travel Agency) platform that uses MongoDB as its database. The platform allows one stop shopping for hotels, flights, tours and other travel products. It also facilitates B2B travel. MongoDB is used because it is fast, allows flexible schema design, and saves time on database tasks like handling dynamic data through embedded documents. Some data is stored in referenced collections to handle large amounts of data like room rates and media files.
Shaping the Future of Travel with MongoDB
1. The document discusses how Amadeus customized MongoDB for real-time analytics workloads. It covers how they implemented microsharding, optimized OS and kernel settings, aligned shards and replicas, used cgroups and compressed memory to improve performance.
2. The customizations allowed MongoDB to efficiently utilize their hardware, improve concurrency and scaling. While not a perfect fit out of the box, with optimizations MongoDB was able to meet their enterprise requirements for real-time analytics.
3. The document concludes that MongoDB is a good fit after customizations, and future features may improve its capabilities further for their analytical workloads.
MongoDB World 2016 : Advanced Aggregation
This document discusses MongoDB's aggregation framework and provides an example of creating a summary of test results from a public MOT (Ministry of Transport) dataset containing over 25 million records. It shows how to use aggregation pipeline stages like $match, $project, $group to filter the data to only cars from 2013, calculate the age of each car, and then group the results to output statistics on counts, average mileages, and number of passes for each make and age combination. The aggregation framework allows processing large collections in parallel and creating new data from existing data.
Recommended
How MongoDB is Being Used in China - Case Studies
We will discuss a variety of use cases for MongoDB in China's Internet industry across several verticals, sizes, and applications. This discussion will include reasons for using MongoDB, experiences, issues, and successes.
MongoDB at Flight Centre Ltd
How MongoDB has empowered the business to rapidly respond to market conditions .
By Michael Frost, Web Solution Architect at Flight Centre Ltd. Presented at MongoDB Sydney, 2012.
Building Expedia’s Travel Graph using MongoDB
1. Expedia built a travel graph using MongoDB to power their Scratchpad note-taking tool, handling 20-40 million writes and 40-60 million reads per day.
2. The initial MongoDB deployment struggled with performance as traffic increased, requiring optimizations like additional shards and provisioned IOPS.
3. The travel graph ecosystem has expanded to include three shards, increased data retention, and geo-distributed secondary reads to support over 80 million queries daily while providing a unified travel planning experience.
Starting out with MongoDB
An Introduction to MongoDB
MongoDB is a rapidly growing noSQL database solution used by many major companies and favored by startups for its simple design and setup. Its greatest advantage is the ability to use the unstructured data type, BSON, which allows developers to avoid writing, maintaining and upgrading schema. Unlike some SQL options, it has scaling and redundancy built-in and allows for quick ad-hoc querying of any data. This talk will go over the basics of data insertion/retrieval, compare querying between SQL and MongoDB, work through some advanced queries like map/reduce and aggregation, and look at the more sophisticated features from a 10,000 ft view.
Bio: Matt Warren is a graduate of Northeastern University and has been working in Systems Administration and Engineering for 8 years. His career started at Smarter Travel Media and most recently he is working for Boston-based ground travel startup, Wanderu. He specializes in scaling solutions to handle the traffic loads of high performance, e-commerce websites. In September of 2015, he became organizer of the Boston MongoDB Meetup.
Event: http://w3.abcd.harvard.edu/ai1ec_event/intro-to-mongodb/
Mongo DB: Operational Big Data Database
MongoDB is the leading NoSQL database due to a plenitude of reasons, open source, general purpose, document oriented database supported by a large community and educational platform. It's horizontal scalability features allows this to fit in the operational big data scenarios where the business needs point to realtime analytics and ever-increasing data sets. This talk will focus on the usage of MongoDB for big data operational purposes and why it's ideal to be used in such scenarios. Also integration with other notable big data technology out there like Hadoop and BI tools.
Norberto Leite - Senior Solutions Architect, @MongoDB.
Mongo DB presentation during the Pentaho & Big Data Ecosystem - Live Seminar 2013
OTA Platform with MongoDB
This document summarizes an OTA (Online Travel Agency) platform that uses MongoDB as its database. The platform allows one stop shopping for hotels, flights, tours and other travel products. It also facilitates B2B travel. MongoDB is used because it is fast, allows flexible schema design, and saves time on database tasks like handling dynamic data through embedded documents. Some data is stored in referenced collections to handle large amounts of data like room rates and media files.
Shaping the Future of Travel with MongoDB
1. The document discusses how Amadeus customized MongoDB for real-time analytics workloads. It covers how they implemented microsharding, optimized OS and kernel settings, aligned shards and replicas, used cgroups and compressed memory to improve performance.
2. The customizations allowed MongoDB to efficiently utilize their hardware, improve concurrency and scaling. While not a perfect fit out of the box, with optimizations MongoDB was able to meet their enterprise requirements for real-time analytics.
3. The document concludes that MongoDB is a good fit after customizations, and future features may improve its capabilities further for their analytical workloads.
MongoDB World 2016 : Advanced Aggregation
This document discusses MongoDB's aggregation framework and provides an example of creating a summary of test results from a public MOT (Ministry of Transport) dataset containing over 25 million records. It shows how to use aggregation pipeline stages like $match, $project, $group to filter the data to only cars from 2013, calculate the age of each car, and then group the results to output statistics on counts, average mileages, and number of passes for each make and age combination. The aggregation framework allows processing large collections in parallel and creating new data from existing data.
Quality - Douglas Crockford
The document discusses the importance of quality and maintainability in software development. It notes that software projects often go over budget, over time, and fail to meet requirements due to a lack of quality practices. It emphasizes that programmers should focus on writing readable, well-architected code and refactoring regularly to remove cruft and bugs. Frequent code reviews are recommended to catch problems early and improve code quality.
ATLUG comes to you ICS.UG 2015
A collection of FIVE presentations given at the recent ATLUG Day of Champions event. The Impact of Mobile on Human Perception explore the changes that mobile is driving on user expectations of software. Lotus Notes: Live Long and Prosper look at trends in technology to predict the future for Notes applications. Three short (4-minute) presentations then give ideas and best practices on a range of techniques that can be used to prepare Notes applications for that future.
Craftsmanship
Computer systems are broken from top to bottom due to changing requirements, stakeholders, resources, and environments over long projects. Technical debt grows non-linearly with large, complex projects that develop inertia. Diversity in technologies, languages, and architectures emerges from solving different problems, but also introduces maintenance issues. Well-designed software strives for minimal and simple APIs between components to reduce complexity. Craftsmanship requires focusing effort where it matters most through autonomous engineering practices, careful API design, and right-sizing architectural components for agility and maintainability.
Techopics
This document summarizes various technology topics including online storage options, security cameras, RFID tags, wireless data speeds, digitizing collections, 3D printers, training programs, and technology competencies. It discusses online backup services, external hard drives, ransomware, camera systems, RFID tag pricing compared to other security methods, wireless network bandwidth guidelines, large format scanners, DSLR scanning, and evaluating online resources. It also outlines regional music projects, oral history initiatives, WordPress themes, logo design, patron time management software, BYOD policies, wireless printing, 3D printing requirements, knitting groups, efficient searching techniques, and potential training topics.
Agile Methodologies And Extreme Programming - Svetlin Nakov
1. Agile development and Extreme Programming (XP) are methodologies that focus on iterative development, collaboration, and adaptability.
2. XP consists of 12 key practices including simple design, test-driven development, pair programming, and small releases. It aims to improve quality, reduce risks, and adapt to changing requirements.
3. While XP works well for some projects and teams, its practices may not be suitable or flexible enough for all situations. Developers should understand the principles behind XP and tailor practices as needed for their specific projects.
Tech Essentials Webinar
This document provides an overview of nonprofit technology essentials presented by NPower Michigan. It discusses computing trends like operating systems and mobile devices. Top nonprofit tech resources like TechSoup.org and Idealware.org are covered. The presentation reviews infrastructure needs such as computers, printers, internet, backup, and phone systems. It also discusses software including office suites, databases, and online collaboration tools. Overall the document aims to educate nonprofits on important technology topics and resources.
ConFoo 2017: Introduction to performance optimization of .NET web apps
This document discusses performance optimization of .NET web apps. It defines performance as response time and resource utilization. It emphasizes measuring performance before and during optimization to identify the right things to optimize. A variety of tools are presented for different levels of performance monitoring and profiling, including Application Performance Monitoring, lightweight code profilers, and code profilers for highest detail. Best practices like leveraging load balancers and avoiding implicit transactions are also recommended.
Ch01lect1 et
This document discusses an introduction to software engineering. It begins by defining what a computer program and software are, noting that software includes computer programs, configuration files, user documentation, support services, and system documentation. The document then discusses some key attributes of software like maintainability, dependability, efficiency, and usability. It notes that software engineering is needed for medium to large projects involving teams to deal with complexity and change. The document discusses why software development is difficult due to changes in requirements and technology, complex problem and solution domains, and difficult management of development processes. It describes how abstraction, decomposition, and hierarchy can be used to deal with complexity. Finally, it discusses different models used in software engineering like object, functional, dynamic
Characteristics of computer
this slides describe characteristics of computer briefly , but very special and nice design , every people can understand easily without problem , specially students of computer science or the students that study in one of the computer departments , this is very usefull ..
this slides describe Functions of computer
and basic parts of computer and How are computers used today and etc ...
the student that present this slide , by 90 percentage can score complete mark , because nicelly prepared ...
Agile Methodologies And Extreme Programming
The document discusses Agile development and Extreme Programming (XP). It provides an overview of 12 key practices of XP, including planning games, small releases, test-driven development, pair programming, collective ownership, continuous integration and 40-hour work weeks. It also discusses how XP aims to solve software engineering problems through intensive teamwork, handling changes and staff turnover, and involving customers.
IT overview for nonprofits by Dave Cortright (IT4NP)
Information, tips and resources for managing the tech side of the org. Presented to The Greater Sum virtual incubator in July 2020. For more info check out http://it4np.com
Lean Startup, Hardware Edition
Everybody knows all about lean startup, MVP, customer development and product/market fit (or at least, we hope everybody does). The key tenets make total sense: MVP as the smallest possible thing you can build to complete a build-measure-learn cycle; the need for speed; charge from day one if you can and so on. A software startup can easily go through two or three build-measure-learn cycle in a couple of months.
But what if your startup is creating a hardware product, where it takes 6 months or more to manufacture the smallest possible thing you can test with?
In this talk we will explore creative ways to apply key tenets of lean startup and customer development to hardware startups (ranging from consumer electronics to industrial products), where each product development and manufacturing cycle can run 6 months or longer. With minor tweaks, the same principles that help build great software startups quickly can be used to avoid capital expenditure mistakes in hardware startups. Join the conversation.
KEYNOTE | WHAT'S COMING IN THE NEXT 10 YEARS OF DEVOPS? // ELLEN CHISA, bolds...
Fifteen years ago, we'd barely started to use S3, and ten years ago DevOps was the new thing. Today, we can add a new tool, technology, or trick every week, and more and more work is shifted into the application developer's workflow. If security, resiliency, and incident response become part of product teams, where will we be ten years from now, and what should we do today to get ready?
Eliminate 7 Mudas
Business is all about Numbers & Speed, Professionalism is all about realization of Commitments. How to make these two ends meet.. is by reducing Waste.
GOOGLE Apps
This document summarizes the benefits of using Google Apps for business challenges around information overload, collaboration, and mobile access. It highlights key Google Apps tools like Gmail, Talk, Groups, Calendar, and Docs. It also discusses the lower costs of Google Apps compared to on-premise solutions and their increased reliability, security, and frequent updates. The document promotes Google Apps Premier Edition starting at $50 per user per year and encourages solution providers to discuss custom integration services.
10 Big Ideas from Industry
Advice on structured software development for academics. Presented to Maths and Physics PhD students and researchers at Queens University Belfast.
20070921 Uni Softwareengineering
The document summarizes Tony Bibbs' presentation on software development at the University of Northern Iowa. It discusses his background and career in software engineering. It then outlines the evolution of software development practices at his company, including establishing formal processes and frameworks to improve quality and productivity. The goals are to minimize bugs, standardize development, foster collaboration among skilled developers, and establish testing practices. Examples of successful projects are provided.
Alphabet soup deployment
This document discusses various tools for deploying Windows 7 and Office 2010, including MDT, WDS, MAP, ACT, and SCCM. It explains what each tool is used for, such as MAP for inventorying systems and ACT for testing application compatibility. The document then discusses challenges of the deployment like migrating users and applications to the new systems. It provides recommendations on using tools like MDT and hard link migration to automate much of the process and minimize downtime for users.
Super Sizing Youtube with Python
This document summarizes Mike Solomon's experience scaling YouTube's architecture using Python. It discusses:
1) Starting simply with all services on the same boxes before gradually separating services like search and thumbnails onto their own machines.
2) Systematically removing bottlenecks revealed by user demand growth and replacing components to maintain scalability.
3) Using caching, database partitioning, and bulk data migration techniques to scale the MySQL database horizontally as user traffic increased.
4) Favoring simplicity, customizing open source software, and taking a "Pythonic" approach to build scalable, transparent APIs.
Os Solomon
This document summarizes Mike Solomon's experience scaling YouTube's architecture using Python. It discusses:
1) Starting simply with all services on the same boxes before gradually separating services like search and thumbnails onto specialized machines.
2) Systematically removing bottlenecks revealed by user demand growth and replacing components to continuously improve.
3) Using Python's flexibility to enable migrating databases and services with minimal disruption.
4) Balancing machine resources by overlaying orthogonal tasks on the same hardware.
MongoDB Schema Design
An overview of how MongoDB's flexible schema changes the way you think about schema design. We discussion nested objects and denormalisation.
The Rise of Microservices
The document discusses the rise of microservices architecture as an alternative to monolithic architecture. It notes that microservices allow applications to be built as independent, isolated components with well-defined interfaces. This makes microservices easier to develop, maintain, and scale compared to monolithic applications. The document also discusses how technologies like containers, orchestration, and MongoDB can help power microservices architectures and address challenges around security, resilience, and elasticity. In conclusion, it argues that microservices lower risk and increase developer productivity compared to monolithic applications.
More Related Content
Similar to Software warstories mba-club
Quality - Douglas Crockford
The document discusses the importance of quality and maintainability in software development. It notes that software projects often go over budget, over time, and fail to meet requirements due to a lack of quality practices. It emphasizes that programmers should focus on writing readable, well-architected code and refactoring regularly to remove cruft and bugs. Frequent code reviews are recommended to catch problems early and improve code quality.
ATLUG comes to you ICS.UG 2015
A collection of FIVE presentations given at the recent ATLUG Day of Champions event. The Impact of Mobile on Human Perception explore the changes that mobile is driving on user expectations of software. Lotus Notes: Live Long and Prosper look at trends in technology to predict the future for Notes applications. Three short (4-minute) presentations then give ideas and best practices on a range of techniques that can be used to prepare Notes applications for that future.
Craftsmanship
Computer systems are broken from top to bottom due to changing requirements, stakeholders, resources, and environments over long projects. Technical debt grows non-linearly with large, complex projects that develop inertia. Diversity in technologies, languages, and architectures emerges from solving different problems, but also introduces maintenance issues. Well-designed software strives for minimal and simple APIs between components to reduce complexity. Craftsmanship requires focusing effort where it matters most through autonomous engineering practices, careful API design, and right-sizing architectural components for agility and maintainability.
Techopics
This document summarizes various technology topics including online storage options, security cameras, RFID tags, wireless data speeds, digitizing collections, 3D printers, training programs, and technology competencies. It discusses online backup services, external hard drives, ransomware, camera systems, RFID tag pricing compared to other security methods, wireless network bandwidth guidelines, large format scanners, DSLR scanning, and evaluating online resources. It also outlines regional music projects, oral history initiatives, WordPress themes, logo design, patron time management software, BYOD policies, wireless printing, 3D printing requirements, knitting groups, efficient searching techniques, and potential training topics.
Agile Methodologies And Extreme Programming - Svetlin Nakov
1. Agile development and Extreme Programming (XP) are methodologies that focus on iterative development, collaboration, and adaptability.
2. XP consists of 12 key practices including simple design, test-driven development, pair programming, and small releases. It aims to improve quality, reduce risks, and adapt to changing requirements.
3. While XP works well for some projects and teams, its practices may not be suitable or flexible enough for all situations. Developers should understand the principles behind XP and tailor practices as needed for their specific projects.
Tech Essentials Webinar
This document provides an overview of nonprofit technology essentials presented by NPower Michigan. It discusses computing trends like operating systems and mobile devices. Top nonprofit tech resources like TechSoup.org and Idealware.org are covered. The presentation reviews infrastructure needs such as computers, printers, internet, backup, and phone systems. It also discusses software including office suites, databases, and online collaboration tools. Overall the document aims to educate nonprofits on important technology topics and resources.
ConFoo 2017: Introduction to performance optimization of .NET web apps
This document discusses performance optimization of .NET web apps. It defines performance as response time and resource utilization. It emphasizes measuring performance before and during optimization to identify the right things to optimize. A variety of tools are presented for different levels of performance monitoring and profiling, including Application Performance Monitoring, lightweight code profilers, and code profilers for highest detail. Best practices like leveraging load balancers and avoiding implicit transactions are also recommended.
Ch01lect1 et
This document discusses an introduction to software engineering. It begins by defining what a computer program and software are, noting that software includes computer programs, configuration files, user documentation, support services, and system documentation. The document then discusses some key attributes of software like maintainability, dependability, efficiency, and usability. It notes that software engineering is needed for medium to large projects involving teams to deal with complexity and change. The document discusses why software development is difficult due to changes in requirements and technology, complex problem and solution domains, and difficult management of development processes. It describes how abstraction, decomposition, and hierarchy can be used to deal with complexity. Finally, it discusses different models used in software engineering like object, functional, dynamic
Characteristics of computer
this slides describe characteristics of computer briefly , but very special and nice design , every people can understand easily without problem , specially students of computer science or the students that study in one of the computer departments , this is very usefull ..
this slides describe Functions of computer
and basic parts of computer and How are computers used today and etc ...
the student that present this slide , by 90 percentage can score complete mark , because nicelly prepared ...
Agile Methodologies And Extreme Programming
The document discusses Agile development and Extreme Programming (XP). It provides an overview of 12 key practices of XP, including planning games, small releases, test-driven development, pair programming, collective ownership, continuous integration and 40-hour work weeks. It also discusses how XP aims to solve software engineering problems through intensive teamwork, handling changes and staff turnover, and involving customers.
IT overview for nonprofits by Dave Cortright (IT4NP)
Information, tips and resources for managing the tech side of the org. Presented to The Greater Sum virtual incubator in July 2020. For more info check out http://it4np.com
Lean Startup, Hardware Edition
Everybody knows all about lean startup, MVP, customer development and product/market fit (or at least, we hope everybody does). The key tenets make total sense: MVP as the smallest possible thing you can build to complete a build-measure-learn cycle; the need for speed; charge from day one if you can and so on. A software startup can easily go through two or three build-measure-learn cycle in a couple of months.
But what if your startup is creating a hardware product, where it takes 6 months or more to manufacture the smallest possible thing you can test with?
In this talk we will explore creative ways to apply key tenets of lean startup and customer development to hardware startups (ranging from consumer electronics to industrial products), where each product development and manufacturing cycle can run 6 months or longer. With minor tweaks, the same principles that help build great software startups quickly can be used to avoid capital expenditure mistakes in hardware startups. Join the conversation.
KEYNOTE | WHAT'S COMING IN THE NEXT 10 YEARS OF DEVOPS? // ELLEN CHISA, bolds...
Fifteen years ago, we'd barely started to use S3, and ten years ago DevOps was the new thing. Today, we can add a new tool, technology, or trick every week, and more and more work is shifted into the application developer's workflow. If security, resiliency, and incident response become part of product teams, where will we be ten years from now, and what should we do today to get ready?
Eliminate 7 Mudas
Business is all about Numbers & Speed, Professionalism is all about realization of Commitments. How to make these two ends meet.. is by reducing Waste.
GOOGLE Apps
This document summarizes the benefits of using Google Apps for business challenges around information overload, collaboration, and mobile access. It highlights key Google Apps tools like Gmail, Talk, Groups, Calendar, and Docs. It also discusses the lower costs of Google Apps compared to on-premise solutions and their increased reliability, security, and frequent updates. The document promotes Google Apps Premier Edition starting at $50 per user per year and encourages solution providers to discuss custom integration services.
10 Big Ideas from Industry
Advice on structured software development for academics. Presented to Maths and Physics PhD students and researchers at Queens University Belfast.
20070921 Uni Softwareengineering
The document summarizes Tony Bibbs' presentation on software development at the University of Northern Iowa. It discusses his background and career in software engineering. It then outlines the evolution of software development practices at his company, including establishing formal processes and frameworks to improve quality and productivity. The goals are to minimize bugs, standardize development, foster collaboration among skilled developers, and establish testing practices. Examples of successful projects are provided.
Alphabet soup deployment
This document discusses various tools for deploying Windows 7 and Office 2010, including MDT, WDS, MAP, ACT, and SCCM. It explains what each tool is used for, such as MAP for inventorying systems and ACT for testing application compatibility. The document then discusses challenges of the deployment like migrating users and applications to the new systems. It provides recommendations on using tools like MDT and hard link migration to automate much of the process and minimize downtime for users.
Super Sizing Youtube with Python
This document summarizes Mike Solomon's experience scaling YouTube's architecture using Python. It discusses:
1) Starting simply with all services on the same boxes before gradually separating services like search and thumbnails onto their own machines.
2) Systematically removing bottlenecks revealed by user demand growth and replacing components to maintain scalability.
3) Using caching, database partitioning, and bulk data migration techniques to scale the MySQL database horizontally as user traffic increased.
4) Favoring simplicity, customizing open source software, and taking a "Pythonic" approach to build scalable, transparent APIs.
Os Solomon
This document summarizes Mike Solomon's experience scaling YouTube's architecture using Python. It discusses:
1) Starting simply with all services on the same boxes before gradually separating services like search and thumbnails onto specialized machines.
2) Systematically removing bottlenecks revealed by user demand growth and replacing components to continuously improve.
3) Using Python's flexibility to enable migrating databases and services with minimal disruption.
4) Balancing machine resources by overlaying orthogonal tasks on the same hardware.
Similar to Software warstories mba-club (20)
Agile Methodologies And Extreme Programming - Svetlin Nakov
Agile Methodologies And Extreme Programming - Svetlin Nakov
ConFoo 2017: Introduction to performance optimization of .NET web apps
ConFoo 2017: Introduction to performance optimization of .NET web apps
IT overview for nonprofits by Dave Cortright (IT4NP)
IT overview for nonprofits by Dave Cortright (IT4NP)
KEYNOTE | WHAT'S COMING IN THE NEXT 10 YEARS OF DEVOPS? // ELLEN CHISA, bolds...
KEYNOTE | WHAT'S COMING IN THE NEXT 10 YEARS OF DEVOPS? // ELLEN CHISA, bolds...
More from Joe Drumgoole
MongoDB Schema Design
An overview of how MongoDB's flexible schema changes the way you think about schema design. We discussion nested objects and denormalisation.
The Rise of Microservices
The document discusses the rise of microservices architecture as an alternative to monolithic architecture. It notes that microservices allow applications to be built as independent, isolated components with well-defined interfaces. This makes microservices easier to develop, maintain, and scale compared to monolithic applications. The document also discusses how technologies like containers, orchestration, and MongoDB can help power microservices architectures and address challenges around security, resilience, and elasticity. In conclusion, it argues that microservices lower risk and increase developer productivity compared to monolithic applications.
Back to Basics 2017 - Your First MongoDB Application
A basic introduction to the CRUD operators for MongoDB followed by an introduction to indexes and how to use the explain plans.
Back to Basics 2017 - Introduction to NoSQL
This document provides an overview of an introduction to NoSQL webinar. It discusses why NoSQL databases were created, the different types of NoSQL databases including key-value stores, column stores, graph stores, multi-model databases and document stores. It provides details on MongoDB, describing how MongoDB stores data as JSON-like documents with dynamic schemas and supports features like indexing, aggregation and geospatial queries. The webinar agenda is also outlined.
Python Ireland Conference 2016 - Python and MongoDB Workshop
This document provides an agenda and overview for a MongoDB and Python workshop. It begins with an introduction to NoSQL databases and MongoDB. It then covers how to install and run MongoDB, create a simple blog application to demonstrate working with MongoDB documents, and how to efficiently create large amounts of sample data. The document is intended to guide attendees through hands-on examples for getting started with MongoDB and developing applications using Python.
Server discovery and monitoring with MongoDB
This document discusses server discovery and monitoring in MongoDB drivers. It explains how drivers discover MongoDB servers, monitor server topology changes, and handle failures. The driver is responsible for authenticating connections, converting data between BSON and Python, error handling, managing connections to replica sets and sharded clusters, and retrying operations in case of failures. It provides examples of API calls and discusses configuration options like connectTimeoutMS and serverTimeoutMS that control connection behavior.
Event sourcing the best ubiquitous pattern you have never heard off
The document discusses event sourcing and command query responsibility segregation (CQRS). It provides examples of how event sourcing works by capturing a series of events rather than just the final state. This allows reconstructing data changes over time and acts as an audit log. CQRS further separates reading data for queries from writing data from commands to allow optimizing each separately. MongoDB can be used to build both an event store and separate query data store to implement these patterns.
EuroPython 2016 : A Deep Dive into the Pymongo Driver
A detailed overview of how the Pymongo MongoDB driver handles replica set connection and fail over.
Introduction to NoSQL
Basic across the board intro covering a lot of topics. RDBMS, Column Stores, Graph Stores and Hadoop.
Introduction to CQRS and Event Sourcing
Basic intro to Command Query Responsibility Segregation (CQRS) and Event Sourcing. Tip of the the hat to Greg Young for the ideas in this talk.
Back to Basics Webinar 3 - Thinking in Documents
- The document discusses modeling data in MongoDB based on cardinality and access patterns.
- It provides examples of embedding related data for one-to-one and one-to-many relationships, and references for large collections.
- The document recommends considering read/write patterns and embedding objects for efficient access, while breaking out data if it grows too large.
Back to Basics Webinar 2 - Your First MongoDB Application
How to build a MongoDB application from scratch in the MongoDB Shell and Python. How to add indexes and use explain to make sure you are using them properly.
Back to Basics Webinar 1 - Introduction to NoSQL
The document provides information about an introductory webinar on NoSQL databases and MongoDB. It includes the webinar agenda which covers why NoSQL databases exist, the different types of NoSQL databases including key-value, column, graph and document stores, and details on MongoDB including how it uses JSON-like documents, ensures data durability through replica sets, and scales through sharding. It also advertises a follow up webinar on building a first MongoDB application and provides a registration link.
Cloud Computing - Halfway through the revolution
This document discusses the ongoing revolution of cloud computing and its impacts. It notes how cloud computing has made infrastructure resources like storage, bandwidth and compute power effectively unlimited and commoditized through services with simple APIs. It also discusses how cloud computing and software as a service have disrupted industries like print journalism, education and manufacturing. Finally, it raises several key ongoing challenges around privacy, data organization and control in the cloud era.
Enterprise mobility for fun and profit
The document discusses the growth of mobile apps and enterprise mobility. It notes that smartphone adoption has reached a tipping point, with Android and the iPad growing significantly. It describes how software as a service providers like Netflix, Amazon, and Salesforce have disrupted traditional industries. The document outlines how enterprises are increasingly developing their own mobile apps for functions like order processing, data capture, and self-service. It recommends that enterprises develop integrated mobile strategies that view mobile as a new critical channel. The future is predicted to involve augmented reality, multiple platforms, internet-connected devices, and mobile becoming integrated into all business functions and models.
How to run a company for 2k a year
The document discusses how to run a company in Ireland on $2000 a year through cloud-based software as a service (SaaS) providers. It lists 11 common SaaS tools including websites, CRM, project management, accounting, and cloud storage and their annual prices. The total of all 11 services is $1974.99, leaving $25.01 remaining in the $2000 budget.
Mobile monday mhealth
This document discusses mHealth and mobile applications for healthcare. It provides examples of several mHealth apps, including:
1) My Healthy World, a social/community healthcare app for tablets that allows sharing and tracking health metrics.
2) Courtagen, a mobile app for physicians that allows ordering and tracking genetic diagnostic tests in a secure and HIPAA-compliant way.
3) Several other apps discussed including ones for managing care through provider directories, refilling prescriptions, and gathering hospital information.
The document also discusses key trends in mHealth like data analytics, compliance with HIPAA, and opportunities in mobilizing healthcare professionals and patients.
Cloudsplit original
This document discusses making cloud computing services smarter by providing real-time analytics and cost monitoring. It outlines key cloud computing concepts like virtual infrastructure, pay-as-you-go models, and common service types (IaaS, PaaS, SaaS). The document proposes a new software stack that would provide analytics on cloud usage patterns, performance metrics, and cost comparisons to help users better understand and reduce their cloud spending. It presents the business plan, launch timeline, and financial projections for bringing this solution to market.
Harness the web and grow your business
The document discusses how businesses can harness the power of the web and social media to grow. It outlines that the web is a network of networks, people, and things that provides universal and global access. It emphasizes that businesses must distinguish themselves as a good signal on this amplifier by being engaged on platforms like Twitter, blogs, mailing lists and Facebook. It provides tips for getting started with social media such as blogging regularly, starting an online group, and using metrics to measure progress. Businesses are warned that they must converse authentically to build connections and avoid potential pitfalls like poor content that could damage their reputation.
Internet Safety and Chldren
The document discusses risks and opportunities children face online. It summarizes research from a 2010 EU Kids Online survey of 25,000 children which found that internet use provides both opportunities and risks for children. While many fears about online risks exist, actual reported harm is often lower. Risky behavior tends to come from older, male, or more vulnerable children and increases with greater internet use and knowledge, though harm may decrease with age. The document provides strategies for parents to engage with children online to help manage risks.
More from Joe Drumgoole (20)
Back to Basics 2017 - Your First MongoDB Application
Back to Basics 2017 - Your First MongoDB Application
Python Ireland Conference 2016 - Python and MongoDB Workshop
Python Ireland Conference 2016 - Python and MongoDB Workshop
Event sourcing the best ubiquitous pattern you have never heard off
Event sourcing the best ubiquitous pattern you have never heard off
EuroPython 2016 : A Deep Dive into the Pymongo Driver
EuroPython 2016 : A Deep Dive into the Pymongo Driver
Back to Basics Webinar 2 - Your First MongoDB Application
Back to Basics Webinar 2 - Your First MongoDB Application
Software warstories mba-club
- 1. Joe Drumgoole 28-Oct-2009 Software Business War Stories
- 2. Generics
- 6. CR2
- 7. Cape Clear
- 9. PutPlace
- 10. CloudSplit
- 11. Great Software Does what it says on the tin Does a few things very well Doesn’t eat your PC Doesn’t eat someone else’s PC Gently delights the user
- 12. Team Size Two people per feature No more than 3 features in parallel Big Team = Many Features Keep the team small
- 13. The Demands of Fashion Many silver bullets Go with the flow Tailor the fashion to the customer Don’t obsess Prepare for and expect change
- 14. Constants X developers will tend to lead to X+1 concurrent features Software will get slower faster than hardware will get faster 80% of your software will be written by 10% of your developers 50% of you bugs will be created by 5% of your developers It costs 10k per month per member to fund a software development team
- 15. Q&A