This document discusses how Instructure has moved to an "all-in" approach on AWS. It begins with Instructure hosting its entire application on a single EC2 instance, which does not provide redundancy or scalability. The document then outlines how Instructure improved its architecture by leveraging various AWS services: using Amazon VPC for networking; splitting the application across multiple EC2 instances and an Amazon RDS database for separation of concerns; adding an Elastic Load Balancer and additional Availability Zones for failover and redundancy; and offloading static content to Amazon S3 and CloudFront to improve performance. This "all-in" approach allows Instructure to build a scalable and resilient architecture utilizing AWS' full range of services.
AWS Deployment Best Practices - AWS Symposium 2014 - Washington D.C. Amazon Web Services
Description: This session will feature best practices in the real world for deploying AWS cloud services. You will hear about cloud use cases, governance, security, cloud architecture, optimizing costs, and leveraging appropriate support offerings. The session will provide insight into experience from hundreds of government customers’ AWS adoption and highlight lessons learned along the way.
AWS Deployment Best Practices - AWS Symposium 2014 - Washington D.C. Amazon Web Services
Description: This session will feature best practices in the real world for deploying AWS cloud services. You will hear about cloud use cases, governance, security, cloud architecture, optimizing costs, and leveraging appropriate support offerings. The session will provide insight into experience from hundreds of government customers’ AWS adoption and highlight lessons learned along the way.
Moving Workloads into AWS GovCloud (US) - AWS Symposium 2014 - Washington D.C. Amazon Web Services
In a 2012 IDC study, researchers found that customers who migrated to AWS broke even in just seven months and experienced a 626% five-year return on investment. Furthermore, public sector customers’ typical migration needs make this even easier, faster, and more cost effective. Learn how to identify the best workloads to move, the logistics of this transition (“lift-and-shift” or a phased approach), and the benefits your organization will experience from day one.
Federal Compliance Deep Dive: FISMA, FedRAMP, and Beyond - AWS Symposium 2014...Amazon Web Services
Security is your number one priority and it is ours too. With customers around the world across all industries, it is our top priority to ensure the underlying cloud infrastructure is secure and compliant. This presentation will address our shared security/responsibility model, specific compliance requirements such as FedRAMP, DISA/DoD Cloud Security Models, and detail the specific AWS compliance programs that supports our customers in these compliance environments.
AWS GovCloud (US) Fundamentals: Past, Present, and Future - AWS Symposium 201...Amazon Web Services
Come learn all about our AWS GovCloud (US) region. Discover the features and benefits of this government-oriented community cloud, learn about exciting new features, and get a sneak peek into where we are headed in the future.
Revolutionising Cloud Operations with AWS Config, AWS CloudTrail and AWS Clou...Amazon Web Services
The rate of change is typically higher within AWS than you would experience in an on-premises environment. Automation becomes standard, and the metric and logs you need to track will change. The AWS Operational Checklist provides a blueprint to increase the likelihood of successful deployments and frustration- free operations. This session dives deep into several patterns from the checklist and shows how to apply and extend these patterns to support the Hybrid Cloud using AWS services such as AWS Config, AWS Cloudtrail and AWS CloudWatch. Practical examples will demonstrate how these services can be combined with other AWS tools such as the AWS CLI and PowerShell in order to maximize the benefit to your organisation.
Speaker: Matt House, Solutions Architect, Amazon Web Services
Cloud computing has become the new normal. In today's session we will explore why customers are choosing to migrate 'all in' to AWS. We cover the benefits and best practice for migration. You will hear from our customers on the decision making process they followed before moving to AWS. This session will cover the key considerations in assessing the opportunity, building the business case, project plan, selecting the right migration strategy, and partner selection.
Speaker: Paul Woodward, Account Manager, Amazon Web Services
Featured Customer - Cromwell Property Gorup
Moving Workloads into AWS GovCloud (US) - AWS Symposium 2014 - Washington D.C. Amazon Web Services
In a 2012 IDC study, researchers found that customers who migrated to AWS broke even in just seven months and experienced a 626% five-year return on investment. Furthermore, public sector customers’ typical migration needs make this even easier, faster, and more cost effective. Learn how to identify the best workloads to move, the logistics of this transition (“lift-and-shift” or a phased approach), and the benefits your organization will experience from day one.
Federal Compliance Deep Dive: FISMA, FedRAMP, and Beyond - AWS Symposium 2014...Amazon Web Services
Security is your number one priority and it is ours too. With customers around the world across all industries, it is our top priority to ensure the underlying cloud infrastructure is secure and compliant. This presentation will address our shared security/responsibility model, specific compliance requirements such as FedRAMP, DISA/DoD Cloud Security Models, and detail the specific AWS compliance programs that supports our customers in these compliance environments.
AWS GovCloud (US) Fundamentals: Past, Present, and Future - AWS Symposium 201...Amazon Web Services
Come learn all about our AWS GovCloud (US) region. Discover the features and benefits of this government-oriented community cloud, learn about exciting new features, and get a sneak peek into where we are headed in the future.
Revolutionising Cloud Operations with AWS Config, AWS CloudTrail and AWS Clou...Amazon Web Services
The rate of change is typically higher within AWS than you would experience in an on-premises environment. Automation becomes standard, and the metric and logs you need to track will change. The AWS Operational Checklist provides a blueprint to increase the likelihood of successful deployments and frustration- free operations. This session dives deep into several patterns from the checklist and shows how to apply and extend these patterns to support the Hybrid Cloud using AWS services such as AWS Config, AWS Cloudtrail and AWS CloudWatch. Practical examples will demonstrate how these services can be combined with other AWS tools such as the AWS CLI and PowerShell in order to maximize the benefit to your organisation.
Speaker: Matt House, Solutions Architect, Amazon Web Services
Cloud computing has become the new normal. In today's session we will explore why customers are choosing to migrate 'all in' to AWS. We cover the benefits and best practice for migration. You will hear from our customers on the decision making process they followed before moving to AWS. This session will cover the key considerations in assessing the opportunity, building the business case, project plan, selecting the right migration strategy, and partner selection.
Speaker: Paul Woodward, Account Manager, Amazon Web Services
Featured Customer - Cromwell Property Gorup
It goes without saying that we value each and every partner that we work with here at Amazon Web Services. For that reason, we want to share with you how to become a registered partner on the AWS Partner Network (APN). The APN is a network of thousands of APN Partners globally who are dedicated to taking cloud computing to the next level. The goal of the APN is to enable APN Partners to successfully build their business on AWS, by providing valuable technical, business, marketing, and go-to-market (GTM) support. And we want to walk you through how to get there! We strive to provide APN Partners with the tools and support that they need to successfully work with AWS. Learn how to partner with AWS and take your business to the next level!
In this presentation you will learn:
1. How to Partner with AWS and be successful
2. Re: cap from re: Invent (new announcements across segment) 3. Learn about AWS Partner Wins
4. How to sign up to become an AWS partner
Whether you’re a cash-strapped startup or an enterprise trying to optimizing spend, it pays to run cost-efficient architectures on AWS. Come learn about cost planning, monitoring, and optimization strategies, featuring real AWS customer use cases.
40, 1173 & 516. What do these numbers mean? Since inception AWS has introduced more than 40 major new services, released over 1173 new services and features, with 516 new features and services announced in 2014 alone. How you use the AWS platform last year may be very different to how you utilise it today to maximize innovation, outcomes and remaining competitive. In this advanced technical session an AWS Solution Architect will address technical requirements for successfully deploying and managing applications on the AWS platform, how solutions were potentially architected previously, both off-cloud and on-cloud, and some of the best practice recommendations on AWS today.
Speaker: Dean Samuels, Solutions Architect, Amazon Web Services
(DVO205) Monitoring Evolution: Flying Blind to Flying by InstrumentAmazon Web Services
Today, AdRoll runs its infrastructure by instrumentation: constantly asking empirical questions, analyzing data for answers, and designing new features with instrumentation in mind to understand how functionality will work upon release. AdRoll’s development methodology did not start out this way, however. It took a cultural shift and many new tools and processes to adopt this approach. In this session, AdRoll and Datadog will discuss how to evolve your organization from a state of “flying blind” to a culture focused on monitoring and data-based decisions. Session sponsored by Datadog.
AWS Summit Auckland 2014 | Scaling on AWS for the First 10 Million UsersAmazon Web Services
You have attended AWS training. Gathered all the relevant information about AWS services but how do you now show the value of the AWS Cloud to your business. This session will run through how you would build a business case for the cloud including TCO and cost comparisons.
Learn how to use Amazon Web Services (AWS). This "how-to" session will cover the basics to get started with AWS. After a brief overview, this session will dive into discussions of core AWS services and provide demonstrations of how to set up and utilize those services. Demonstrations and discussions will include:
- Setting up and connecting to your first Elastic Compute Cloud (EC2) virtual machine
- How to backup and restore your virtual machine instance
- How to set an email alert for changes in your virtual machine instance
- How to upload files to Amazon's Simple Storage Service (S3) and make them publicly available on the Internet
Intended for customers who have (or will have) thousands of instances on AWS, this session is about reducing the complexity of managing costs for these large fleets so they run efficiently. Attendees will learn about common roadblocks that prevent large customers from cost optimizing, tools they can use to efficiently remove those roadblocks, and techniques to monitor their rate of cost optimization. The session will include a case study that will talk in detail about the millions of dollars saved using these techniques. Customers will learn about a range of templates they can use to quickly implement these techniques, and also partners who can help them implement these templates.
Develop faster and smarter using cloud native SDK’s, services and orchestration tools. Embrace agile and automation techniques to improve quality and reduce risk, accelerate innovation.
AWS Service Drill Downs - AWS Symposium 2014 - Washington D.C. Amazon Web Services
This session will highlight the breadth and depth of services that make up the AWS platform. Participants will learn about the AWS Global Infrastructure, Networking, Compute, Storage, Database, Application Services, and Deployment & Administration. This session is designed for technical decision-makers to come away with a top-level understanding of AWS building block cloud services.
AWS APAC Webinar Week - Introduction to Cloud Computing With Amazon Web ServicesAmazon Web Services
Join this foundational session to understand the core concepts of “Cloud Computing” and different attributes such as reliability, fault tolerance, elasticity, scalability and pay-as-you-go pricing. Whether you are a startup who wants to accelerate growth without a big upfront investment in cash or time for technology or an Enterprise looking for IT innovation, agility and resiliency while reducing costs, the AWS Cloud provides a complete set of infrastructure services at zero upfront costs which are available with a few clicks and within minutes. Join this webinar to learn more about the benefits of Cloud Computing.
Microservices and serverless for MegaStartups - DLD TLV 2017Boaz Ziniman
Microservices and Serverless computing allow you to build and run simpler and more efficient applications, while improving your agility and saving a lot of money.
The ability to deploy your applications without the need for provisioning or managing servers opens for startups new opportunities to build web, mobile, and IoT backends; run stream processing or big data workloads; run chatbots, and more, without the investment in hardware or professional manpower to run this hardware.
In this session, we will learn how to get started with Microservices and Serverless computing with AWS Lambda, which lets you run code without provisioning or managing servers.
Similar to Using AWS Services to Go “All In” on AWS (20)
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Amazon Web Services
Il Forecasting è un processo importante per tantissime aziende e viene utilizzato in vari ambiti per cercare di prevedere in modo accurato la crescita e distribuzione di un prodotto, l’utilizzo delle risorse necessarie nelle linee produttive, presentazioni finanziarie e tanto altro. Amazon utilizza delle tecniche avanzate di forecasting, in parte questi servizi sono stati messi a disposizione di tutti i clienti AWS.
In questa sessione illustreremo come pre-processare i dati che contengono una componente temporale e successivamente utilizzare un algoritmo che a partire dal tipo di dato analizzato produce un forecasting accurato.
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Amazon Web Services
La varietà e la quantità di dati che si crea ogni giorno accelera sempre più velocemente e rappresenta una opportunità irripetibile per innovare e creare nuove startup.
Tuttavia gestire grandi quantità di dati può apparire complesso: creare cluster Big Data su larga scala sembra essere un investimento accessibile solo ad aziende consolidate. Ma l’elasticità del Cloud e, in particolare, i servizi Serverless ci permettono di rompere questi limiti.
Vediamo quindi come è possibile sviluppare applicazioni Big Data rapidamente, senza preoccuparci dell’infrastruttura, ma dedicando tutte le risorse allo sviluppo delle nostre le nostre idee per creare prodotti innovativi.
Ora puoi utilizzare Amazon Elastic Kubernetes Service (EKS) per eseguire pod Kubernetes su AWS Fargate, il motore di elaborazione serverless creato per container su AWS. Questo rende più semplice che mai costruire ed eseguire le tue applicazioni Kubernetes nel cloud AWS.In questa sessione presenteremo le caratteristiche principali del servizio e come distribuire la tua applicazione in pochi passaggi
Vent'anni fa Amazon ha attraversato una trasformazione radicale con l'obiettivo di aumentare il ritmo dell'innovazione. In questo periodo abbiamo imparato come cambiare il nostro approccio allo sviluppo delle applicazioni ci ha permesso di aumentare notevolmente l'agilità, la velocità di rilascio e, in definitiva, ci ha consentito di creare applicazioni più affidabili e scalabili. In questa sessione illustreremo come definiamo le applicazioni moderne e come la creazione di app moderne influisce non solo sull'architettura dell'applicazione, ma sulla struttura organizzativa, sulle pipeline di rilascio dello sviluppo e persino sul modello operativo. Descriveremo anche approcci comuni alla modernizzazione, compreso l'approccio utilizzato dalla stessa Amazon.com.
Come spendere fino al 90% in meno con i container e le istanze spot Amazon Web Services
L’utilizzo dei container è in continua crescita.
Se correttamente disegnate, le applicazioni basate su Container sono molto spesso stateless e flessibili.
I servizi AWS ECS, EKS e Kubernetes su EC2 possono sfruttare le istanze Spot, portando ad un risparmio medio del 70% rispetto alle istanze On Demand. In questa sessione scopriremo insieme quali sono le caratteristiche delle istanze Spot e come possono essere utilizzate facilmente su AWS. Impareremo inoltre come Spreaker sfrutta le istanze spot per eseguire applicazioni di diverso tipo, in produzione, ad una frazione del costo on-demand!
In recent months, many customers have been asking us the question – how to monetise Open APIs, simplify Fintech integrations and accelerate adoption of various Open Banking business models. Therefore, AWS and FinConecta would like to invite you to Open Finance marketplace presentation on October 20th.
Event Agenda :
Open banking so far (short recap)
• PSD2, OB UK, OB Australia, OB LATAM, OB Israel
Intro to Open Finance marketplace
• Scope
• Features
• Tech overview and Demo
The role of the Cloud
The Future of APIs
• Complying with regulation
• Monetizing data / APIs
• Business models
• Time to market
One platform for all: a Strategic approach
Q&A
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Amazon Web Services
Per creare valore e costruire una propria offerta differenziante e riconoscibile, le startup di successo sanno come combinare tecnologie consolidate con componenti innovativi creati ad hoc.
AWS fornisce servizi pronti all'utilizzo e, allo stesso tempo, permette di personalizzare e creare gli elementi differenzianti della propria offerta.
Concentrandoci sulle tecnologie di Machine Learning, vedremo come selezionare i servizi di intelligenza artificiale offerti da AWS e, anche attraverso una demo, come costruire modelli di Machine Learning personalizzati utilizzando SageMaker Studio.
OpsWorks Configuration Management: automatizza la gestione e i deployment del...Amazon Web Services
Con l'approccio tradizionale al mondo IT per molti anni è stato difficile implementare tecniche di DevOps, che finora spesso hanno previsto attività manuali portando di tanto in tanto a dei downtime degli applicativi interrompendo l'operatività dell'utente. Con l'avvento del cloud, le tecniche di DevOps sono ormai a portata di tutti a basso costo per qualsiasi genere di workload, garantendo maggiore affidabilità del sistema e risultando in dei significativi miglioramenti della business continuity.
AWS mette a disposizione AWS OpsWork come strumento di Configuration Management che mira ad automatizzare e semplificare la gestione e i deployment delle istanze EC2 per mezzo di workload Chef e Puppet.
Scopri come sfruttare AWS OpsWork a garanzia e affidabilità del tuo applicativo installato su Instanze EC2.
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsAmazon Web Services
Vuoi conoscere le opzioni per eseguire Microsoft Active Directory su AWS? Quando si spostano carichi di lavoro Microsoft in AWS, è importante considerare come distribuire Microsoft Active Directory per supportare la gestione, l'autenticazione e l'autorizzazione dei criteri di gruppo. In questa sessione, discuteremo le opzioni per la distribuzione di Microsoft Active Directory su AWS, incluso AWS Directory Service per Microsoft Active Directory e la distribuzione di Active Directory su Windows su Amazon Elastic Compute Cloud (Amazon EC2). Trattiamo argomenti quali l'integrazione del tuo ambiente Microsoft Active Directory locale nel cloud e l'utilizzo di applicazioni SaaS, come Office 365, con AWS Single Sign-On.
Dal riconoscimento facciale al riconoscimento di frodi o difetti di fabbricazione, l'analisi di immagini e video che sfruttano tecniche di intelligenza artificiale, si stanno evolvendo e raffinando a ritmi elevati. In questo webinar esploreremo le possibilità messe a disposizione dai servizi AWS per applicare lo stato dell'arte delle tecniche di computer vision a scenari reali.
Amazon Web Services e VMware organizzano un evento virtuale gratuito il prossimo mercoledì 14 Ottobre dalle 12:00 alle 13:00 dedicato a VMware Cloud ™ on AWS, il servizio on demand che consente di eseguire applicazioni in ambienti cloud basati su VMware vSphere® e di accedere ad una vasta gamma di servizi AWS, sfruttando a pieno le potenzialità del cloud AWS e tutelando gli investimenti VMware esistenti.
Molte organizzazioni sfruttano i vantaggi del cloud migrando i propri carichi di lavoro Oracle e assicurandosi notevoli vantaggi in termini di agilità ed efficienza dei costi.
La migrazione di questi carichi di lavoro, può creare complessità durante la modernizzazione e il refactoring delle applicazioni e a questo si possono aggiungere rischi di prestazione che possono essere introdotti quando si spostano le applicazioni dai data center locali.
Crea la tua prima serverless ledger-based app con QLDB e NodeJSAmazon Web Services
Molte aziende oggi, costruiscono applicazioni con funzionalità di tipo ledger ad esempio per verificare lo storico di accrediti o addebiti nelle transazioni bancarie o ancora per tenere traccia del flusso supply chain dei propri prodotti.
Alla base di queste soluzioni ci sono i database ledger che permettono di avere un log delle transazioni trasparente, immutabile e crittograficamente verificabile, ma sono strumenti complessi e onerosi da gestire.
Amazon QLDB elimina la necessità di costruire sistemi personalizzati e complessi fornendo un database ledger serverless completamente gestito.
In questa sessione scopriremo come realizzare un'applicazione serverless completa che utilizzi le funzionalità di QLDB.
Con l’ascesa delle architetture di microservizi e delle ricche applicazioni mobili e Web, le API sono più importanti che mai per offrire agli utenti finali una user experience eccezionale. In questa sessione impareremo come affrontare le moderne sfide di progettazione delle API con GraphQL, un linguaggio di query API open source utilizzato da Facebook, Amazon e altro e come utilizzare AWS AppSync, un servizio GraphQL serverless gestito su AWS. Approfondiremo diversi scenari, comprendendo come AppSync può aiutare a risolvere questi casi d’uso creando API moderne con funzionalità di aggiornamento dati in tempo reale e offline.
Inoltre, impareremo come Sky Italia utilizza AWS AppSync per fornire aggiornamenti sportivi in tempo reale agli utenti del proprio portale web.
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareAmazon Web Services
Molte organizzazioni sfruttano i vantaggi del cloud migrando i propri carichi di lavoro Oracle e assicurandosi notevoli vantaggi in termini di agilità ed efficienza dei costi.
La migrazione di questi carichi di lavoro, può creare complessità durante la modernizzazione e il refactoring delle applicazioni e a questo si possono aggiungere rischi di prestazione che possono essere introdotti quando si spostano le applicazioni dai data center locali.
In queste slide, gli esperti AWS e VMware presentano semplici e pratici accorgimenti per facilitare e semplificare la migrazione dei carichi di lavoro Oracle accelerando la trasformazione verso il cloud, approfondiranno l’architettura e dimostreranno come sfruttare a pieno le potenzialità di VMware Cloud ™ on AWS.
Amazon Elastic Container Service (Amazon ECS) è un servizio di gestione dei container altamente scalabile, che semplifica la gestione dei contenitori Docker attraverso un layer di orchestrazione per il controllo del deployment e del relativo lifecycle. In questa sessione presenteremo le principali caratteristiche del servizio, le architetture di riferimento per i differenti carichi di lavoro e i semplici passi necessari per poter velocemente migrare uno o più dei tuo container.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...Neo4j
Leonard Jayamohan, Partner & Generative AI Lead, Deloitte
This keynote will reveal how Deloitte leverages Neo4j’s graph power for groundbreaking digital twin solutions, achieving a staggering 100x performance boost. Discover the essential role knowledge graphs play in successful generative AI implementations. Plus, get an exclusive look at an innovative Neo4j + Generative AI solution Deloitte is developing in-house.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
Dr. Sean Tan, Head of Data Science, Changi Airport Group
Discover how Changi Airport Group (CAG) leverages graph technologies and generative AI to revolutionize their search capabilities. This session delves into the unique search needs of CAG’s diverse passengers and customers, showcasing how graph data structures enhance the accuracy and relevance of AI-generated search results, mitigating the risk of “hallucinations” and improving the overall customer journey.
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
Sudheer Mechineni, Head of Application Frameworks, Standard Chartered Bank
Discover how Standard Chartered Bank harnessed the power of Neo4j to transform complex data access challenges into a dynamic, scalable graph database solution. This keynote will cover their journey from initial adoption to deploying a fully automated, enterprise-grade causal cluster, highlighting key strategies for modelling organisational changes and ensuring robust disaster recovery. Learn how these innovations have not only enhanced Standard Chartered Bank’s data infrastructure but also positioned them as pioneers in the banking sector’s adoption of graph technology.
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionAggregage
Join Maher Hanafi, VP of Engineering at Betterworks, in this new session where he'll share a practical framework to transform Gen AI prototypes into impactful products! He'll delve into the complexities of data collection and management, model selection and optimization, and ensuring security, scalability, and responsible use.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Unlocking Productivity: Leveraging the Potential of Copilot in Microsoft 365, a presentation by Christoforos Vlachos, Senior Solutions Manager – Modern Workplace, Uni Systems
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
In his public lecture, Christian Timmerer provides insights into the fascinating history of video streaming, starting from its humble beginnings before YouTube to the groundbreaking technologies that now dominate platforms like Netflix and ORF ON. Timmerer also presents provocative contributions of his own that have significantly influenced the industry. He concludes by looking at future challenges and invites the audience to join in a discussion.
2. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Going “all in” on AWS
During this session, we will walk through an
all-in example architecture and learn how
Instructure is using AWS in true all-in
fashion.
4. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
0
100
200
300
400
500
600
700
800
900
1,000
1,100
1,200
1,300
1,400
1,500
5. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Built for scale
Vector-scaling engine
Peak concurrent user
count: 216,100
Number of production
clusters: 47
Number of servers
online at peak: 1,700
Amazon EC2 Amazon VPCAmazon S3 Amazon RDSAmazon SES Amazon EMRAmazon Redshift
6. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
So you’ve decided to go all in on AWS
7. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
This is an excellent decision, but what
does it really mean to go “all in?”
8. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Technically, this web app is “all in”
• A single EC2 instance
– with full stack on this host
• web app
• database
• management
• and so on…
• A single Elastic IP
address
EC2 instance
Elastic IP
User
9. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Technically “all in,” but…
• Will scale up to a certain
point
• No failover
• No redundancy
• Too many eggs in one
basket EC2 instance
Elastic IP
User
10. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Technically “all in,” but…
• Will scale up to a certain
point
• No failover
• No redundancy
• Too many eggs in one
basket EC2 instance
Elastic IP
User
11. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Single instance = simple approach
• Simplest approach
• Can now leverage PIOPs
• High I/O instances
• High memory instances
• High CPU instances
• High storage instances
• Easy to change instance sizes
• Will hit an endpoint eventually
c3.8xlarge
m3.2xlarge
t2.micro
12. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
“We’re gonna need a bigger box”
• Simplest approach
• Can now leverage PIOPs
• High I/O instances
• High memory instances
• High CPU instances
• High storage instances
• Easy to change instance sizes
• Will hit an endpoint eventually,
and doesn’t take advantage of
what AWS has to offer
c3.8xlarge
m3.2xlarge
t2.micro
13. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
This is how the “very bad day” started
• A single EC2 instance
– With full stack on this host
• Web app
• Database
• Management
• And so on…
• A single Elastic IP
EC2 instance
Elastic IP
User
14. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
We can rebuild. We have the
technology. We can make it
better, faster, stronger.
15. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
First things first: the network
Let’s lay the groundwork for
going “all in” by using
Amazon VPC
virtual private cloud
16. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
What is Amazon VPC?
17. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
What is Amazon VPC?
• A private, isolated section of the AWS cloud
• A virtual network topology you can deploy and
customize
• Complete control of your networking
18. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Put simply, it is a virtual data center
you can build and control on AWS!
19. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
• VPC
• Your virtual data center on
AWS
• Block of IP addresses that
define your network (typically,
RFC 1918)
• Can span multiple Availability
Zones
• Default VPCs
VPC
Availability Zone A Availability Zone B
VPC CIDR: 10.1.0.0 /16
20. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
• Range of IP addresses in
your VPC IP range
• Lives inside an Availability
Zone
• Can provide security at the
subnet or network level
with ACLs
• Can route at the subnet
level
• Default VPC subnets
VPC subnet
Subnet
Availability Zone A
Subnet
Availability Zone B
10.1.1.0/24 10.1.10.0/24
VPC CIDR: 10.1.0.0 /16
21. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Instructure’s “cluster” architecture
• SSD-backed EBS volumes
• Multi-AZ VPCs
22. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Slowly taking eggs out of the basket…
Next, let’s separate our
single host into more
than one:
• web
• database
– Use Amazon RDS to make
your life easier
Web
instance
Elastic IP
address
RDS DB
instance
User
23. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Amazon RDS: Managed SQL in the cloud
• simple and fast to deploy
• handles repetitive
management tasks
• compatible with your
applications
• fast, predictable performance
• simple and fast to scale
• secure
• cost-effective
- And introducing
Amazon Aurora
24. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Choose Multi-AZ for greater availability,
durability
• With Multi-AZ operation, your database is synchronously
replicated to another Availability Zone in the same AWS region
• Failover occurs automatically in response to the most important
failure scenarios
• Planned maintenance is applied first to backup
25. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Instructure’s “cluster” architecture
• SSD-backed EBS volumes
• Multi-AZ VPCs
• Sharded PostgeSQL databases
• Intelligent routing of SQL calls
26. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Now in preview: Amazon RDS for
Aurora
• Amazon Aurora: the relational database reinvented for the cloud
– Up to five times better performance than MySQL
– At a price point 1/10 of a commercial database
– Designed for drop-in compatibility with MySQL 5.6
• Pay only for the storage you use
• Runs in Amazon VPC; offers encryption at rest and in transit
• Amazon RDS handles administrative tasks for Aurora
27. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Amazon Aurora: High availability by
default
• Your data is replicated 6
ways across 3 Availability
Zones
• Storage grows up to
64 TB seamlessly
• Up to 15 Aurora replicas
with instant crash recovery
AZ 1 AZ 2 AZ 3
Virtualized, cross-AZ storage layer
28. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Head to the next level
Next, let’s address our lack of
failover and redundancy
issues:
• Load balancer
• Another web instance
– In another Availability
Zone
• RDS Multi-AZ
web
instance
RDS DB Instance
active (Multi-AZ)
Availability Zone Availability Zone
web
instance
RDS DB instance
standby (Multi-AZ)
Elastic Load
Balancing
user
29. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
• Create highly scalable applications
• Distribute load across EC2 instances
in multiple Availability Zones Feature Details
Available Load balances across instances in multiple
Availability Zones
Health checks Automatically checks health of instances and
takes them in or out of service
Session stickiness Routes requests to the same instance
Secure sockets layer Supports SSL offload from web and application
servers with flexible cipher support
Monitoring Publishes metrics to CloudWatch and can get
logs of requests processed
Elastic Load
Balancing
Elastic Load Balancing
30. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Instructure’s “cluster” architecture
• SSD-backed EBS volumes
• Multi-AZ VPCs
• Sharded PostgeSQL databases
• Intelligent routing of SQL calls
• No single points of failure
• Tight integration with ELB
31. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
This will take us pretty far, but
we care about performance
and efficiency, so let’s
improve further
32. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
web
instance
RDS DB instance
active (Multi-AZ)
Availability Zone
Elastic Load
Balancing
user
Let’s lighten the load on our
web and database instances:
• Move static content from
the web instance to
Amazon S3 and Amazon
CloudFront
Shift some load around
33. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
web
instance
RDS DB instance
active (Multi-AZ)
Availability Zone
Elastic Load
Balancing
Amazon S3
Amazon
CloudFrontuser
Let’s lighten the load on our
web and database instances:
• Move static content from
the web instance to
Amazon S3 and Amazon
CloudFront
Shift some load around
34. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Amazon S3
Amazon S3 is cloud storage for the
Internet:
• Object-based storage
• 11 9s of durability
• Good for things like the following:
– Static assets ( css, js, images,
videos )
– Backups
– Logs
– Ingest of files for processing
• “Infinitely scalable”
• Objects up to 5 TB in size
• Can host static websites
• Supports fine-grained permission control
• Ties in well with CloudFront
• Acts as a logging endpoint for S3,
CloudFront, Billing and Cost
Management, ELB, CloudTrail, and more
• Supports encryption at transit and at rest
• Reduced redundancy is 1/3 cheaper
• Amazon Glacier for super long-term
storage at 1/3 the cost of S3
Amazon S3
35. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Instructure’s “cluster” architecture
• SSD-backed EBS volumes
• Multi-AZ VPCs
• Sharded PostgeSQL databases
• Intelligent routing of SQL calls
• No single points of failure
• Tight integration with ELB
• Heavy use of S3
36. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Amazon S3
Instructure uses S3 to store:
- course data
- student submissions
- logs
- database backups
- performance metric data
- application elements
- CSS
Amazon S3
37. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
CloudFront
CloudFront is a web service for scalable content
delivery:
• Cache static content at the edge for faster delivery
• Helps lower load on origin infrastructure
• Dynamic and static content
• Streaming video
• Zone apex support
• Custom SSL certificates
• Low TTLs (as short as 0 seconds)
• Lower costs for origin fetches (between
S3, EC2, and CloudFront)
• Optimized to work with EC2, S3, Elastic Load
Balancing, and Route 53
ResponseTime
ServerLoad
Response
Time
Server
Load
Response
Time
Serve
rLoad
No CDN CDN for static
content
CDN for static
and dynamic
content
0
10
20
30
40
50
60
70
80
8:00
AM
9:00
AM
10:00
AM
11:00
AM
12:00
PM
1:00
PM
2:00
PM
3:00
PM
4:00
PM
5:00
PM
6:00
PM
7:00
PM
8:00
PM
9:00
PM
Volumeofdata
delivered(Gbps)
38. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Shift some load around
Let’s lighten the load on our
web and database instances:
• Move static content from
the web instance to
Amazon S3 and Amazon
CloudFront
• Move session/state and
DB caching to Amazon
ElastiCache
web
instance
RDS DB instance
active (Multi-AZ)
Availability Zone
Elastic Load
Balancing
Amazon S3
Amazon
CloudFront
user
39. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Shift some load around
Let’s lighten the load on our
web and database instances:
• Move static content from
the web instance to
Amazon S3 and Amazon
CloudFront
• Move session/state and
database caching to
Amazon ElastiCache
web
instance
RDS DB instance
active (Multi-AZ)
Availability Zone
Elastic Load
Balancing
Amazon S3
Amazon
CloudFront
user
ElastiCache
40. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Amazon ElastiCache
• Hosted Memcached and Redis
– Speaks same API as traditional open source
Memcached and Redis
• Scale from one to many nodes
• Self healing (replaces dead instance)
• Very fast (single-digit millisecond speeds usually (or less))
• Local to a single Availability Zone for Memcache, with no
persistence or replication
• With Redis, can put a replica in a different Availability Zone
with persistence
• Use Auto Discovery to simplify growing and shrinking
clusters without affecting your application
41. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Instructure’s “cluster” architecture
• SSD-backed EBS volumes
• Multi-AZ VPCs
• Sharded PostgeSQL databases
• Intelligent routing of SQL calls
• No single points of failure
• Tight integration with ELB
• Heavy use of S3
• Redis caching layer
42. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Shift some load around
Let’s lighten the load on our
web and database instances:
• Move static content from the
web instance to Amazon S3
and Amazon CloudFront
• Move session/state and
database caching to
ElastiCache
• Move dynamic content from
the load balancer to Amazon
CloudFront
web
instance
RDS DB instance
active (Multi-AZ)
Availability Zone
Elastic Load
Balancing
Amazon S3
Amazon
CloudFront
user
ElastiCache
43. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Shift some load around:
Let’s lighten the load on our
web and database instances:
• Move static content from the
web instance to Amazon S3
and Amazon CloudFront
• Move session/state and DB
caching to ElastiCache
• Move dynamic content
from the ELB to Amazon
CloudFront
web
instance
RDS DB instance
active (Multi-AZ)
Availability Zone
Elastic Load
Balancing
Amazon S3
Amazon
CloudFront
user
ElastiCache
44. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Now let’s add Route 53
45. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Add Route 53
Availability Zone
Amazon
Route 53
user
Amazon S3
Amazon
CloudFront
Availability Zone
Elastic Load
Balancing
RDS DB instance
read replica
web
instance
web
instance
web
instance
ElastiCache RDS DB instance
read replica
web
instance
web
instance
web
instance
ElastiCacheRDS DB instance
standby (Multi-AZ)
RDS DB instance
active (Multi-AZ)
46. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Route 53 is a highly
available and scalable
cloud-based
domain name service
47. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
What is highly available?
The Route 53 SLA is 100%
availability per month
SLA details: https://aws.amazon.com/route53/sla/
48. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Route 53 features
• Latency-based routing
– Route end users to the AWS region that
provides the lowest possible latency
• Geo DNS
– Route end users to an endpoint you specify
based on the end users’ geographic
location
49. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Route 53 features (continued)
• Weighted round robin
– Specify the frequency (“weights”) with
which different DNS responses are
returned to end users
• DNS failover
– Route your website visitors to an alternate
location to avoid site outages
50. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Route 53 features (continued)
• Health checks
– Monitor the health and performance of your
web resources
• Private DNS for Amazon VPC
– Manage custom domain names for your
internal, non-public AWS resources
• Domain registration
51. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Instructure’s “cluster” architecture
• SSD-backed EBS volumes
• Multi-AZ VPCs
• Sharded PostgeSQL databases
• Intelligent routing of SQL calls
• No single points of failure
• Tight integration with ELB
• Heavy use of S3
• Redis caching layer
• Asynchronous job service layer
• Managed with enterprise CM
52. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Thank You.
This presentation will be loaded to SlideShare the week following the Symposium.
http://www.slideshare.net/AmazonWebServices
AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Editor's Notes
Instructure makes software that makes people smarter
We are built on the time tested and battle proven AWS cloud hosting platform. Upon this foundation, we built out our own innovative cloud scaling technology; the Vector Predictive Scaling Engine and the sharding of the PostgreSQL databases.
This here is the most basic set up you would need to serve up a web application. We have Route53 for DNS, an EC2 instance running our webapp and database, and an Elastic IP attached to the EC2 instance so Route53 can direct traffic to us. Now in scaling this infrastructure, the only real option we have is to get a bigger EC2 instance…
So while we could reach potentially a few hundred or few thousand users supported by this single instance, its not a long term play.
So while we could reach potentially a few hundred or few thousand users supported by this single instance, its not a long term play.
Scaling the one EC2 instance we have to a larger one is the most simple approach to start with. There are a lot of different AWS instance types to go with depending on your work load. Some have high I/O, CPU, Memory, or local storage. You can also make use of EBS-Optimized instances and Provisioned IOPs to help scale the storage for this instance quite a bit.
The key concern here, is that you WILL hit an endpoint, where we just don’t have a bigger instance class out yet, and so scaling this way while it can get you over an initial hump, really isn’t going to get us very far.
The date was August 20t, 2012, and it started out like any other day. But this day would be a turning point for Instructure as we learned a valuable lesson about having all of your technology stack on single instances. Turns out, this is a really bad idea, especially as the “thundering herd” of Fall Semester started logging on to register for courses. I was not at Instructure for our very bad day, but to this day, there are those still suffering from PTSD.
http://blog.canvaslms.com/blog/bid/210688/A-Bad-Day-for-Canvas
So while we could reach potentially a few hundred or few thousand users supported by this single instance, its not a long term play.
A private space you can build apps and services on AWS
Or maybe a set of software defined networking tools that allow you to define your own network footprint in the cloud
With multiple physical datacenters underneath the covers
VPC = Virtual Private Cloud
This is your virtual data center on AWS
You start by defining a CIDR Block of IPs that define your network (typically RFC 1918)
ONE NOTE: A VPC is a virtual datacenter that can span multiple AZs or multiple AWS physical datacenters so it is an HA datacenter in a sense
When you create a new account today, you automatically get what is called a Default VPC
A default VPC is where any untargeted launches of EC2 instances will go.
In other words, if you do not specify a VPC, your EC2 instances will go in the default VPC we created for you.
A subnet is a range of IPs in your VPC IP range. You can divide up your overall VPC IP range into multiple subnets for different uses and purposes.
A subnet lives inside an AZ
Can provide security at the subnet or network level with ACLs
Each subnet can also be routed differently
Going back to default VPC, each default VPC will have a default subnet in each AZ with a route to the Internet GW (which we will discuss in the next slide)
In this example…
Today, we have 47 production clusters distributed across five AWS regions. These loosely coupled clusters make up the Canvas global platform and allow for load balancing and seamless migration of data from one cluster to another should hot spots form
So for this scenario today, we’re going to go with RDS and MYSQL as our database engine.
Amazon Relational Database Service (Amazon RDS) is a managed service that makes it easy to set up, operate, and scale a relational database in the cloud. It provides cost-efficient and resizable capacity, while managing time-consuming database administration tasks, freeing you up to focus on your applications and business.
Amazon RDS gives you access to the capabilities of a familiar MySQL, Oracle, SQL Server, or PostgreSQL database. This means that the code, applications, and tools you already use today with your existing databases should work seamlessly with Amazon RDS. Amazon RDS automatically patches the database software and backs up your database, storing the backups for a user-defined retention period. You benefit from the flexibility of being able to scale the compute resources or storage capacity associated with your relational database instance via a single API call or few clicks of the AWS Management Console. In addition, Amazon RDS makes it easy to use replication to enhance database availability, improve data durability, or scale beyond the capacity constraints of a single database instance for read-heavy database workloads. As with all Amazon Web Services, there are no up-front investments required, and you pay only for the resources you use.
A database instance is a virtual database server in the cloud,with the compute and storage resources you specify. You can create and delete DB Instances, define/refine infrastructure attributes of your DB Instance(s), and control access and security via the AWS Management Console, Amazon RDS APIs, and Command Line Tools. You can run one or more DB Instances, and each DB Instance can support one or more databases or database schemas, depending on engine type.
DB Instances are simple to create, using either the AWS Management Console, Amazon RDS APIs, or Command Line Tools. To launch a DB Instance using the AWS Management Console, click "RDS," then the "Launch a DB Instance" button on the "Amazon RDS" tab. From there, you can specify the fundamental parameters for your DB instance:
DB engine: MySQL, Oracle, Microsoft SQL Server, PostgreSQL (and, now in preview, Amazon Aurora)
DB engine version (optional)
License Model (optional)
DB Instance type
Amount of allocated storage (in GB)
Whether your DB Instance should run as a Multi-AZ deployment
Storage type
DB Instance identifier
Master user name
Master user password
You also have the ability to change your DB Instance’s backup retention policy, preferred backup window, and scheduled maintenance window. Alternatively, you can create your DB Instance using the CreateDBInstance API or rds-create-db-instance command.
The automated backup feature of Amazon RDS enables point-in-time recovery of your DB Instance. You can initiate a point-in-time restore and specify any second during your retention period, up to the Latest Restorable Time.
Amazon RDS provides backup storage up to 100% of your provisioned database storage at no additional charge. For example, if you have 10GB-months of provisioned database storage, we will provide up to 10GB-months of backup storage at no additional charge.
Amazon RDS allows you to control if and when the relational database software powering your DB Instance is upgraded to new versions supported by Amazon RDS. This provides you with the flexibility to maintain compatibility with specific engine versions, test new versions with your application before deploying in production, and perform version upgrades on your own terms and timelines.
We’ll explain Multi-AZ on the next slide.
Amazon RDS Multi-AZ deployments provide enhanced availability and durability for Database (DB) Instances, making them a natural fit for production database workloads. When you provision a Multi-AZ DB Instance, Amazon RDS automatically creates a primary DB Instance and synchronously replicates the data to a standby instance in a different Availability Zone (AZ). Each AZ runs on its own physically distinct, independent infrastructure, and is engineered to be highly reliable. In case of an infrastructure failure (for example, instance hardware failure, storage failure, or network disruption), Amazon RDS performs an automatic failover to the standby, so that you can resume database operations as soon as the failover is complete. Since the endpoint for your DB Instance remains the same after a failover, your application can resume database operation without the need for manual administrative intervention.
Multi-AZ is available for all RDS engines.
Because Multi-AZ minimizes the downtime impact of scheduled maintenance, it gives value even to deployments in which the app servers are in a single AZ. But it’s still best to have the instances spread across multiple Azs.
Today, we have 47 production clusters distributed across five AWS regions. These loosely coupled clusters make up the Canvas global platform and allow for load balancing and seamless migration of data from one cluster to another should hot spots form
Amazon Aurora is a MySQL-compatible relational database management system (RDBMS) that combines the speed and availability of high-end commercial databases with the simplicity and cost-effectiveness of open source databases. Amazon Aurora provides up to five times better performance than MySQL at a price point one tenth that of a commercial RDBMS while delivering similar performance and availability. Amazon Aurora joins MySQL, Oracle, Microsoft SQL Server, and PostgreSQL as the fifth relational database engine available to customers through Amazon RDS. Amazon RDS handles routine database tasks such as provisioning, patching, backup, recovery, failure detection, and repair.
Amazon Aurora uses SSL to secure data in transit and encrypts data at rest. If you choose to enable encryption of data at rest, all data written to Amazon Aurora storage will be encrypted as well as all backups stored in Amazon S3.
There is no up-front commitment with Amazon RDS Aurora; you simply pay a monthly charge for each instance that you launch. And, when you’re finished with an Amazon Aurora DB Instance, you can easily delete it. You do not need to over-provision storage as a safety margin. You only pay for the storage you actually consume on an hourly basis.
Each 10GB chunk of your database volume is replicated six ways, across three Availability Zones. Amazon Aurora storage is fault-tolerant, transparently handling the loss of up to two copies of data without affecting database write availability and up to three copies without affecting read availability. Amazon Aurora storage is also self-healing. Data blocks and disks are continuously scanned for errors and replaced automatically.
Amazon Aurora will automatically grow the size of your database volume as your database storage needs grow. Your volume will grow in increments of 10 GB up to a maximum of 64 TB or a maximum volume size you define. You don't need to provision excess storage for your database to handle future growth.
You can create Amazon Aurora Replicas and serve high-volume application read traffic from multiple instances, thereby increasing aggregate read throughput. Amazon Aurora Replicas share the same underlying storage as the source instance, lowering costs and avoiding the need to perform writes at the replica nodes. This frees up more processing power to serve read requests and reduces the replica lag time – often down to single digit milliseconds. You can create up to 15 Amazon Aurora Replicas per Amazon Aurora database.
Aurora automatically and continuously backs up your data to Amazon S3.
Next up we need to address the lack of failover and redundancy in our infrastructure. We’re going to do this by adding in another webapp instance, and enabling the Multi-AZ feature of RDS, which will give us a standby instance in a different AZ from the Primary. We’re also going to replace our EIP with an Elastic Load Balancer to share the load between our two web instances
For those who aren’t familiar yet with ELB( Elastic Load Balancer ), it is a highly scalable load balancing service that you can put infront of tiers of your application where you have multiple instances that you want to share load across. ELB is a really great service, in that it does a lot for you without you having to do much. It will create a self-healing/self-scaling LB that can do things such as SSL termination, handle sticky Sessions, have multiple listeners. It will also do health checks back to the instances behind it, and puts a bunch of metrics into CloudWatch for you as well. This is a key service in building highly available infrastructures on AWS.
Today, we have 47 production clusters distributed across five AWS regions. These loosely coupled clusters make up the Canvas global platform and allow for load balancing and seamless migration of data from one cluster to another should hot spots form
but its not that efficient in both performance or cost, and since those are important too, let’s clean up this infrastructure a bit.
The biggest things we can do, and these are incredibly important, is lighten up some of the work our webapp is doing, as well as make life easier for our database. We can start by moving any static assets from our webapp instances to S3, and then serving those objects via CloudFront. We can also move things like session information, and any other temporary application data to a memory based cache like one supported by ElastiCache or DynamoDB. We can also use this same cache to store some of our database query results which will help us from hitting the database too much.
The biggest things we can do, and these are incredibly important, is lighten up some of the work our webapp is doing, as well as make life easier for our database. We can start by moving any static assets from our webapp instances to S3, and then serving those objects via CloudFront. We can also move things like session information, and any other temporary application data to a memory based cache like one supported by ElastiCache or DynamoDB. We can also use this same cache to store some of our database query results which will help us from hitting the database too much.
Talk about S3
Today, we have 47 production clusters distributed across five AWS regions. These loosely coupled clusters make up the Canvas global platform and allow for load balancing and seamless migration of data from one cluster to another should hot spots form
Talk about S3
Talk about CloudFront. Make sure to mention the two charts to the right. Static content will certainly speed up your site, but Static&Dynamic content is even better. The chart down below is showing data from a real customer who went from very little traffic, to a huge spike of over 60gigabits per second, without having to do anything on their side, or notify AWS at all.
Serving our static assets through CloudFront is going to be a massive performance boost to our end-users, but CloudFront can do much more.
Serving our static assets through CloudFront is going to be a massive performance boost to our end-users, but CloudFront can do much more.
Talk about elasticache. Now supports Redis which is new! We could use Memcache/Redis as a place to store database query information for content that doesn’t change often, like our end-users’s name or email, or what is in their cart. We should try and do this as often as possible.
Today, we have 47 production clusters distributed across five AWS regions. These loosely coupled clusters make up the Canvas global platform and allow for load balancing and seamless migration of data from one cluster to another should hot spots form
Imagine for instance if you cached the search pages for highly requested queries. This could take load off your search, off your web application, your database, etc. So now we can see here that we’ve got CloudFront in front of both S3 and our ELB. Now that we’ve got that covered, lets move back to the session information, and database queries we can be caching as well.
So let’s actually go and pump the entire site through CloudFront. This could allow us to cache all sorts of page content at the edge, and greatly speed up our site performance to our end users, while significantly lowering the load on our infrastructure.
Read slide
If we add in auto-scaling, our caching layer(both inside, and outside our infrastructure), and the read-replicas with MySQL, we can now handle a pretty serious load. This could potentially even get us into the millions of users by itself if continued to be scaled horizontally and vertically.
Today, we have 47 production clusters distributed across five AWS regions. These loosely coupled clusters make up the Canvas global platform and allow for load balancing and seamless migration of data from one cluster to another should hot spots form