Five things you need to ask your VM Admin (and you may not like the answers!)
A few key concepts detailed are:
1) Shifting how we understand cost in our virtual infrastructure
2) The predominant role that storage plays in VM reliability
3) Real world issues with multi-hypervisor environments
4) Tackling administration issues in a holistic way
Optimal Azure Database Development by Karel CoenyeITProceed
In traditional on-premises SQL Server, the process of doing initial capacity planning is often separated from the process of running an application in production. When using Azure SQL Database, it is generally recommended to interleave the process of running and tuning an application. The model of paying for capacity on-demand allows you to tune your application to use the minimum resources needed and will give you an immediate return on invest In this session we will show you techniques to optimize your database design so that you achive optimal cost/performance figures from the beginning.
Originally known for a "fail whale" that occurred frequently on the site, Twitter has changed significantly to make sure we are available no matter what is happening around the world without a blip.
This goal felt unattainable three years ago, when the 2010 World Cup put Twitter squarely in the center of a real-time, global conversation. The influx of Tweets—from every shot on goal, penalty kick, and yellow or red card—repeatedly took its toll and made Twitter unavailable for short periods of time. Engineering worked throughout the nights during this time, desperately trying to find and implement order-of-magnitudes of efficiency gains. Unfortunately, those gains were quickly swamped by Twitter’s rapid growth, and engineering had started to run out of low-hanging fruit to fix.
After that experience, we determined we needed to step back. We then determined we needed to re-architect the site to support the continued growth of Twitter and to keep it running smoothly. Since then we’ve worked hard to make sure that the service is resilient to the world’s impulses. We’re now able to withstand events like Castle in the Sky viewings, the Super Bowl, and the global New Year’s Eve celebration. This re-architecture has not only made the service more resilient when traffic spikes to record highs, but also provides a more flexible platform on which to build more features faster, including synchronizing direct messages across devices, Twitter cards that allow Tweets to become richer and contain more content, and a rich search experience that includes stories and users. And more features are coming.
This talk will cover some of the lessons learned and changes made to not only grow, but also to become more resilient to world events and less fragile to whales.
Modern Cloud Fundamentals: Misconceptions and Industry TrendsChristopher Bennage
A discussion of misconceptions, problems, and industry trends that hinder adoption of cloud technology; with an emphasis on scenarios that appear to work but fail at critical moments.
Be sure to read the notes!
Five things you need to ask your VM Admin (and you may not like the answers!)
A few key concepts detailed are:
1) Shifting how we understand cost in our virtual infrastructure
2) The predominant role that storage plays in VM reliability
3) Real world issues with multi-hypervisor environments
4) Tackling administration issues in a holistic way
Optimal Azure Database Development by Karel CoenyeITProceed
In traditional on-premises SQL Server, the process of doing initial capacity planning is often separated from the process of running an application in production. When using Azure SQL Database, it is generally recommended to interleave the process of running and tuning an application. The model of paying for capacity on-demand allows you to tune your application to use the minimum resources needed and will give you an immediate return on invest In this session we will show you techniques to optimize your database design so that you achive optimal cost/performance figures from the beginning.
Originally known for a "fail whale" that occurred frequently on the site, Twitter has changed significantly to make sure we are available no matter what is happening around the world without a blip.
This goal felt unattainable three years ago, when the 2010 World Cup put Twitter squarely in the center of a real-time, global conversation. The influx of Tweets—from every shot on goal, penalty kick, and yellow or red card—repeatedly took its toll and made Twitter unavailable for short periods of time. Engineering worked throughout the nights during this time, desperately trying to find and implement order-of-magnitudes of efficiency gains. Unfortunately, those gains were quickly swamped by Twitter’s rapid growth, and engineering had started to run out of low-hanging fruit to fix.
After that experience, we determined we needed to step back. We then determined we needed to re-architect the site to support the continued growth of Twitter and to keep it running smoothly. Since then we’ve worked hard to make sure that the service is resilient to the world’s impulses. We’re now able to withstand events like Castle in the Sky viewings, the Super Bowl, and the global New Year’s Eve celebration. This re-architecture has not only made the service more resilient when traffic spikes to record highs, but also provides a more flexible platform on which to build more features faster, including synchronizing direct messages across devices, Twitter cards that allow Tweets to become richer and contain more content, and a rich search experience that includes stories and users. And more features are coming.
This talk will cover some of the lessons learned and changes made to not only grow, but also to become more resilient to world events and less fragile to whales.
Modern Cloud Fundamentals: Misconceptions and Industry TrendsChristopher Bennage
A discussion of misconceptions, problems, and industry trends that hinder adoption of cloud technology; with an emphasis on scenarios that appear to work but fail at critical moments.
Be sure to read the notes!
Introducing Platform Cache, a new feature that will allow you to create more efficient and performant applications. Store data which is needed between requests without going back to the database. Share information between sessions without the need re-calculate. Take a tour of this new feature and how to get the most from it.
The have no fear guide to virtualizing databasesSolarWinds
When it comes to a successful database virtualization journey, there are things you must know before you start. In this presentation you will:
-Review terms and concepts for VMware, by far the most common virtualization platform
-Examine how to use vSphere (the VMware admin console)
-Explore the differences between virtual and physical host metrics a
-Learn to overcome the shortcomings of virtualizing your database environment
Capacity - Ransomware - Protection - Three Windows File Server Upgrades to AvoidStorage Switzerland
For most enterprises, optimizing your Windows fileserver means buying a new, bigger server with more capacity and better network connections. Or it means buying a dedicated Network Attached Storage (NAS) system. Then they feel they need to add new ransomware and data protection software. All of these "solutions" are expensive, involve a costly data migration and don't really increase IT efficiency. In this webinar, experts from Storage Switzerland and Caringo teach you how data management can eliminate the need for additional Windows file servers, capacity and protection.
Lessons in moving from physical hosts to mesosRaj Shekhar
(speaker notes here : https://docs.google.com/document/d/12mXLYEFkEEd0pwOwD8bC1JQ8CPpx_PiRPXikHZ6MMYQ/pub )
t.co is the URL shortening service created by Twitter. As part of scaling up, t.co moved to using Mesos. We saw significant gain is deployment speed, scalability and reduction in operational headaches.
This talk will provide an introduction to Mesos+Aurora, and cover how t.co service migrated from running on physical hardware to Mesos. It will also cover the challenges t.co had during the migration, the "gotchas" and debugging techniques for uncovering performance issues.
Agenda:
- Introduction to Mesos + Aurora
- Benefits of moving to Mesos
- Migration steps for moving from t.co to Mesos
- Challenges faced and how t.co overcame them
Five things virtualization has changed in your dr planJosh Mazgelis
Are you still rolling with the changes? Virtualization has made a huge impact on the way we deploy our computer workloads, and with that it has also changed the ways in which we protect them. The business continuity plans in place for IT even just five years ago look very different than what many companies have in place today. Keeping on top of these changes will help you understand your recovery capabilities, and your limitations as well. Join us with our friends at Neverfail and make sure you're keeping your IT business continuity plans spicy and fresh!
This slide deck explains a bit how to deal best with state in scalable systems, i.e. pushing it to the system boundaries (client, data store) and trying to avoid state in-between.
Then it picks arbitrarily two scenarios - one in the frontend part and one in the backend part of a system and shows concrete techniques to deal with them.
In the frontend part is examined how to deal with session state of servlet containers in scalable scenarios and introduces the concept of a shared session cache layer. Also an example implementation using Redis is shown.
In the backend part it is examined how to deal with potential data inconsistencies that can occur if maximum availability of the data store is required and eventual consistency is used. The normal way is to resolve inconsistencies manually implementing business specific logic or - even worse - asking the user to resolve it. A pure technical solution called CRDTs (Conflict-free Replicated Data Types) is then shown. CRDTs, based on sound mathematical concepts, are self-stabilizing data structures that offer a generic way to resolve inconsistencies in an eventual consistent data store. Besides some theory also some examples are shown to provide a feeling how CRDTs feel in practice.
Storage in the data center has evolved from islands of server attached storage to shared networked storage. But in both cases storage needed to be specifically designed for the workload it was on. This has lead to storage hardware sprawl.
In this Slideshare of our recent webinar you will learn what hardware sprawl is and how you can stop it. For full audio go to: http://bit.ly/storagesprawl
Not a DBA but your work thinks you are? This is the session for you. We will give you a crash course into the most valuable variables, places to look, and gotcha's. This is not designed to replace traditional training but rather to ensure you at least have the most basic skills to ensure your foray into the world of MySQL DBA's gets off on a good foot.
Is your flash system up to the challenge? Attend this webinar and learn how you can optimize your SQL Server performance. Hear how the pros pinpoint performance bottlenecks and leverage the latest advancements in storage technology to decrease access latency and IO wait times. By the end of the webinar you’ll have the tools and information you need to recommend the best approach for your SQL Server environment.
Performance Optimization of Cloud Based Applications by Peter Smith, ACLTriNimbus
Peter Smith, PhD, Principal Software Engineer at ACL talks about Performance Optimization of Cloud Based Applications at TriNimbus' 2017 Canadian Executive Cloud & DevOps summit in Vancouver
Introducing Platform Cache, a new feature that will allow you to create more efficient and performant applications. Store data which is needed between requests without going back to the database. Share information between sessions without the need re-calculate. Take a tour of this new feature and how to get the most from it.
The have no fear guide to virtualizing databasesSolarWinds
When it comes to a successful database virtualization journey, there are things you must know before you start. In this presentation you will:
-Review terms and concepts for VMware, by far the most common virtualization platform
-Examine how to use vSphere (the VMware admin console)
-Explore the differences between virtual and physical host metrics a
-Learn to overcome the shortcomings of virtualizing your database environment
Capacity - Ransomware - Protection - Three Windows File Server Upgrades to AvoidStorage Switzerland
For most enterprises, optimizing your Windows fileserver means buying a new, bigger server with more capacity and better network connections. Or it means buying a dedicated Network Attached Storage (NAS) system. Then they feel they need to add new ransomware and data protection software. All of these "solutions" are expensive, involve a costly data migration and don't really increase IT efficiency. In this webinar, experts from Storage Switzerland and Caringo teach you how data management can eliminate the need for additional Windows file servers, capacity and protection.
Lessons in moving from physical hosts to mesosRaj Shekhar
(speaker notes here : https://docs.google.com/document/d/12mXLYEFkEEd0pwOwD8bC1JQ8CPpx_PiRPXikHZ6MMYQ/pub )
t.co is the URL shortening service created by Twitter. As part of scaling up, t.co moved to using Mesos. We saw significant gain is deployment speed, scalability and reduction in operational headaches.
This talk will provide an introduction to Mesos+Aurora, and cover how t.co service migrated from running on physical hardware to Mesos. It will also cover the challenges t.co had during the migration, the "gotchas" and debugging techniques for uncovering performance issues.
Agenda:
- Introduction to Mesos + Aurora
- Benefits of moving to Mesos
- Migration steps for moving from t.co to Mesos
- Challenges faced and how t.co overcame them
Five things virtualization has changed in your dr planJosh Mazgelis
Are you still rolling with the changes? Virtualization has made a huge impact on the way we deploy our computer workloads, and with that it has also changed the ways in which we protect them. The business continuity plans in place for IT even just five years ago look very different than what many companies have in place today. Keeping on top of these changes will help you understand your recovery capabilities, and your limitations as well. Join us with our friends at Neverfail and make sure you're keeping your IT business continuity plans spicy and fresh!
This slide deck explains a bit how to deal best with state in scalable systems, i.e. pushing it to the system boundaries (client, data store) and trying to avoid state in-between.
Then it picks arbitrarily two scenarios - one in the frontend part and one in the backend part of a system and shows concrete techniques to deal with them.
In the frontend part is examined how to deal with session state of servlet containers in scalable scenarios and introduces the concept of a shared session cache layer. Also an example implementation using Redis is shown.
In the backend part it is examined how to deal with potential data inconsistencies that can occur if maximum availability of the data store is required and eventual consistency is used. The normal way is to resolve inconsistencies manually implementing business specific logic or - even worse - asking the user to resolve it. A pure technical solution called CRDTs (Conflict-free Replicated Data Types) is then shown. CRDTs, based on sound mathematical concepts, are self-stabilizing data structures that offer a generic way to resolve inconsistencies in an eventual consistent data store. Besides some theory also some examples are shown to provide a feeling how CRDTs feel in practice.
Storage in the data center has evolved from islands of server attached storage to shared networked storage. But in both cases storage needed to be specifically designed for the workload it was on. This has lead to storage hardware sprawl.
In this Slideshare of our recent webinar you will learn what hardware sprawl is and how you can stop it. For full audio go to: http://bit.ly/storagesprawl
Not a DBA but your work thinks you are? This is the session for you. We will give you a crash course into the most valuable variables, places to look, and gotcha's. This is not designed to replace traditional training but rather to ensure you at least have the most basic skills to ensure your foray into the world of MySQL DBA's gets off on a good foot.
Is your flash system up to the challenge? Attend this webinar and learn how you can optimize your SQL Server performance. Hear how the pros pinpoint performance bottlenecks and leverage the latest advancements in storage technology to decrease access latency and IO wait times. By the end of the webinar you’ll have the tools and information you need to recommend the best approach for your SQL Server environment.
Performance Optimization of Cloud Based Applications by Peter Smith, ACLTriNimbus
Peter Smith, PhD, Principal Software Engineer at ACL talks about Performance Optimization of Cloud Based Applications at TriNimbus' 2017 Canadian Executive Cloud & DevOps summit in Vancouver
It's harder than ever to predict the load your application will need to handle in advance, so how do you design your architecture so you can afford to implement as you go and be ready for whatever comes your way. It's easy to focus on optimizing each part of your application but your application architecture determines the options you have to make big leaps in scalability. In this talk we'll cover practical patterns you can build today to meet the needs of rapid development while still creating systems that can scale up and out. Specific code examples will focus on .NET but the principles apply across many technologies. Real world systems will be discussed based on our experience helping customers around the world optimize their enterprise applications.
Adding Value in the Cloud with Performance TestRodolfo Kohn
System quality attributes such performance, scalability, and availability are among the main concerns for cloud application developers and product managers. There are many examples of notable system failures that show how a company business can be affected during key events like a Cyber Monday. However, many difficulties come up when a team intends to consciously manage these type of quality attributes during development and operations. It is possible to group these difficulties in two main aspects: human aspects and technical aspects. During this presentation, I will share main technical difficulties we had to deal with in the last seven years working with different cloud services as well as key technical performance, scalability, and availability issues we were able to find and solve. It is about cases that are relevant through different products, technologies, and teams.
Some of the most common questions we hear from users relate to capacity planning and hardware choices. How many replicas do I need? Should I consider sharding right away? How much RAM will I need for my working set? SSD or HDD? No one likes spending a lot of cash on hardware and cloud bills can just be as painful. MongoDB is different from traditional RDBMSs in its resource management, so you need to be mindful when deciding on the cluster layout and hardware. In this talk we will review the factors that drive the capacity requirements: volume of queries, access patterns, indexing, working set size, among others. Attendees will gain additional insight as we go through a few real-world scenarios, as experienced with MongoDB Inc customers, and come up with their ideal cluster layout and hardware.
Silicon Valley Code Camp 2015 - Advanced MongoDB - The SequelDaniel Coupal
MongoDB presentation from Silicon Valley Code Camp 2015.
Walkthrough developing, deploying and operating a MongoDB application, avoiding the most common pitfalls.
Scaling a High Traffic Web Application: Our Journey from Java to PHP120bi
What makes an application scale? What should you worry about early on and what can wait?
Over the last 3 years, Achievers has learned many lessons and gained fundamental knowledge on scaling our SaaS platform. CTO Dr. Aris Zakinthinos will present and discuss the decisions we’ve made including language choice, server architecture, and much more; join us while we share tips, tricks, and things to absolutely avoid.
Throughout the evening you will have the opportunity to talk to the development team behind the Achievers Platform and ask questions on scaling best practices.
Choosing the right parallel compute architecture corehard_by
Multi-core architecture is the present and future way in which the market is addressing Moore’s law limitations. Multi-core workstations, high performance computers, GPUs and the focus on hybrid/ public cloud technologies for offloading and scaling applications is the direction development is heading. Leveraging multiple cores in order to increase application performance and responsiveness is expected especially from classic high-throughput executions such as rendering, simulations, and heavy calculations. Choosing the correct multi-core strategy for your software requirements is essential, making the wrong decision can have serious implications on software performance, scalability, memory usage and other factors. In this overview, we will inspect various considerations for choosing the correct multi-core strategy for your application’s requirement and investigate the pros and cons of multi-threaded development vs multi-process development. For example, Boost’s GIL (Generic Image Library) provides you with the ability to efficiently code image processing algorithms. However, deciding whether your algorithms should be executed as multi-threaded or multi-process has a high impact on your design, coding, future maintenance, scalability, performance, and other factors.
A partial list of considerations to take into account before taking this architectural decision includes:
- How big are the images I need to process
- What risks can I have in terms of race-conditions, timing issues, sharing violations – does it justify multi-threading programming?
- Do I have any special communication and synchronization requirements?
- How much time would it take my customers to execute a large scenario?
- Would I like to scale processing performance by using the cloud or cluster?
We will then examine these issues in real-world environments. In order to learn how this issue is being addressed in a real-world scenario, we will examine common development and testing environments we are using in our daily work and compare the multi-core strategies they have implemented in order to promote higher development productivity.
Capacity Planning For Your Growing MongoDB ClusterMongoDB
Your MongoDB deployment is growing, but are you prepared for that growth? Capacity planning is an essential practice when deploying any database system. You need to understand your usage patterns and determine the appropriate hardware based on your application's needs. Scaling reads and scaling writes will require different types of resources. With the proper tools in place, you can understand your working set, gain visibility into when it's time to add resources or start sharding and avoid performance issues. In this session, you'll learn how to use MongoDB Management Service and other tools to identify patterns and predict growth, ensuring your success with MongoDB.
The venerable Servlet Container still has some performance tricks up its sleeve - this talk will demonstrate Apache Tomcat's stability under high load, describe some do's (and some don'ts!), explain how to performance test a Servlet-based application, troubleshoot and tune the container and your application and compare the performance characteristics of the different Tomcat connectors. The presenters will share their combined experience supporting real Tomcat applications for over 20 years and show how a few small changes can make a big, big difference.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
2. The Challenge?
• You have an app that works
• You have users that like it
Awesome
• Performance is suffering as you scale.
• Reliability is getting worse, not better.
• As your data sets grow,
the problems are more pronounced.
• The operations team are talking about problems, not
solutions
Not so awesome
6. What is the root cause?
• Take the time to understand what happens when your code
asks the server to do some task.
select * from
some_production_table_with_100,000,000_records
Is really not the same workload as
select * from some_dev_table_with_100_records
• Look for evidence in logs and tools that provide real insight.
8. Issues of priority…
• Disk drive, single user
session
• Disk drives, Multiple
users….
9. Issues of Scale…
• Fetching Blocks, single
user session
• Fetching Blocks,
enterprise workload
10. Storage
• Many database and operating system vendor
recommendations are woefully out of date.
• Modern techniques utilising flash in the right way can deliver
millions of random IOPS.
• SAN and flash vendors have made dramatic changes over the
last few years that invalidate many of the old
recommendations.
• Some principles still hold and are important for optimised
performance
– 1 process writes to each disk group
– Avoid reads and writes occurring simultaneously if possible
11. CPU
• CPUs are not all created equal.
• Use SpecInt to compare if it matters for your workload.
• Split up the work and scale wide if you can. There is a reason
the web scale companies have.
• Don’t process work now that can wait until later.
• Later might be in a few seconds and on another box.
• Schedule intensive workloads like reports.
• Don’t expect your laptop and the production server to scale
the same way.
12. Memory
• Memory is addressable in various forms with performance
tradeoffs for capacity.
• Use the lowest latency one you can afford.
Memory Type Typical Capacity Approximate
Access time
CPU cache 30MB < 10 ns
DDR3 64GB <100ns
SSD ~ 800GB <20,000ns
FC or SAS ~ 1TB <20,000,000ns
SATA 4TB + <8,000,000ns
13. Network
• Why is it that we conceptualise networks from an individual
point of view?
15. Network
• Latency & Bandwidth are not the same thing.
– Think satellite delay on a TV interview
• In this context we use these definitions
– Latency is the amount of time a network takes to reach the other end.
– Bandwidth is the rate at which we can successfully transmit data to the
other end.
• This is why you need to test your app through a latency
generator.
– There are capable free open source tools such as WANEM
16. Middleware
• Websphere, WebLogic, JBOSS, Tomcat
– Garbage collection tradeoffs between JVM size and system
memory/CPU capacities.
• Django
– Read HighPerformanceDjango by the team from Lincoln Loop
– Sponsored by the Common Code team
17. SQL databases
• Microsoft SQL, Oracle DB, PostgreSQL & MySQL.
• Various strengths & weaknesses for each but have some key
things in common.
• Offload reporting away from OLTP workloads
• Indexes are important
• Transaction Logs are a performance bottleneck
• Think deeply about scaling out
• Think about caching queries
• Backups are critical because you will need to restore one day
18. Backup is about Restore
• Enterprise wide backup will find all your infrastructure failings
by pushing more data for longer while other work continues.
• Test your restores. Really, test them.
• Offload large backups away from your production systems.
19. Questions?
How to get in touch?
James Clifford
Email: james@proitconsulting.com.au
Phone: 0421 648 034
Brenton Carbins
Email: brenton@proitconsulting.com.au
Phone: 0409 779 230
