This document discusses how to make a web application scalable on the cloud. It describes using read replicas in MySQL for scalable databases. It also discusses scaling web servers by launching more instances and using a load balancer. Challenges discussed include session management, software updates, and log collection across dynamic instances. Solutions proposed include using Memcached for sessions, version control for code/plugins, and Rsyslog with S3 and Hadoop for log analysis.
DB proxy server test: run tests on tens of virtual machines with Jenkins, Vag...Timofey Turenko
The presentation describes CI environment for our product - Maxscale - database proxy server. To test such product we need a setup that consists of tens of machines: locally hosted virtual machines as well as machines from different clouds. All our Jenkins jobs are implemented in the form of Jenkins Job Builder code. Presentations also tells about our tool to manage virtual machines (wrapper over Vagrant)- MDBCI.
(Click 2nd slide for video) Deploy PHP apps faster in 2017. This talk focuses on how PHP developers can use simple Ansible scripts to rapidly configure new dev and production servers from scratch, and deploy their apps. No more "snowflake servers"!
This is a general introduction to DevOps essentials and Ansible, with a few extras for PHP developers, including some best practice tips and overview of two major Ansible-based PHP projects, Drupal-VM and Trellis (modern WordPress setup).
Ansible is a Configuration Management System that is very simple to use, because of its straightforward and robust model for managing automation and it’s low barrier to entry for ease of use in both development and production.
During OpenStack development, Ansible can be used in conjunction with Vagrant and Devstack to manage complex, multi-node development environments with relative ease.
In this presentation, Juergen Brendel and David Lapsley review Ansible and provide some sample playbooks to get developers up and running quickly. They also describes how to use Ansible, Vagrant, Devstack, and OpenStack to accelerate OpenStack development cycles.
Powerpoint file(incl. animations!): http://db.tt/oQiXb9lq
This is the slides of the presentation "Wordpress optimization" who presented at WordCamp 2013.
How to improve your wordpress performance and speed up your website more than 700% faster!
DB proxy server test: run tests on tens of virtual machines with Jenkins, Vag...Timofey Turenko
The presentation describes CI environment for our product - Maxscale - database proxy server. To test such product we need a setup that consists of tens of machines: locally hosted virtual machines as well as machines from different clouds. All our Jenkins jobs are implemented in the form of Jenkins Job Builder code. Presentations also tells about our tool to manage virtual machines (wrapper over Vagrant)- MDBCI.
(Click 2nd slide for video) Deploy PHP apps faster in 2017. This talk focuses on how PHP developers can use simple Ansible scripts to rapidly configure new dev and production servers from scratch, and deploy their apps. No more "snowflake servers"!
This is a general introduction to DevOps essentials and Ansible, with a few extras for PHP developers, including some best practice tips and overview of two major Ansible-based PHP projects, Drupal-VM and Trellis (modern WordPress setup).
Ansible is a Configuration Management System that is very simple to use, because of its straightforward and robust model for managing automation and it’s low barrier to entry for ease of use in both development and production.
During OpenStack development, Ansible can be used in conjunction with Vagrant and Devstack to manage complex, multi-node development environments with relative ease.
In this presentation, Juergen Brendel and David Lapsley review Ansible and provide some sample playbooks to get developers up and running quickly. They also describes how to use Ansible, Vagrant, Devstack, and OpenStack to accelerate OpenStack development cycles.
Powerpoint file(incl. animations!): http://db.tt/oQiXb9lq
This is the slides of the presentation "Wordpress optimization" who presented at WordCamp 2013.
How to improve your wordpress performance and speed up your website more than 700% faster!
Chef Provisioning a Chef Server Cluster - ChefConf 2015Chef
This talk is an exploration of how to build Chef Server 12 clusters with Chef Provisioning, including premium features like Chef Reporting and Chef Analytics. I will cover several new capabilities and tools in the Chef ecosystem that makes it easier than ever before to build and manage scalable Chef Server clusters.
https://youtu.be/HUQA1Ikm5Iw
SCALE12X Build a Cloud Day: Chef: The Swiss Army Knife of Cloud InfrastructureMatt Ray
Chef is an open source configuration management and automation framework used to configure, deploy and manage infrastructure of every type. Deploying to the cloud has made it easy to run large numbers of
servers and Chef makes it even easier to deploy to nearly every public and private cloud platform as well as virtualized and physical servers. This talk will provide a quick introduction to Chef and is intended for sysadmins and developers familiar with the concepts behind managing applications and infrastructure in the cloud, without diving too deeply into technical specifics.
Handling 10k requests per second with Symfony and Varnish - SymfonyCon Berlin...Alexander Lisachenko
It is believed that the Symfony framework is quite heavy and it can be difficult to develop a website that will be able to work under the high load. It is true, but does this mean that it is impossible to implement a dynamic caching and to update only a small part of entire page as data is updated? This talk will give your an answer to that. It is Varnish, ESI-blocks and load balancing. With hundreds of thousands of unique visitors and million hits a day, we continue to use Symfony, and do not see any problems.
Service Delivery Assembly Line with Vagrant, Packer, and AnsibleIsaac Christoffersen
Leverage Packer, Vagrant, and Ansible as part of a service delivery pipeline. Streamline your continuous delivery process while also targeting multiple cloud providers.
CIRCUIT 2015 - AEM Infrastructure Automation with Chef CookbooksICF CIRCUIT
Drew Glass - Hero Digital
Push button deployments can automate AEM infrastructure to reduce costs and defects. Chef is a platform that enables this by transforming infrastructure into code using DevOps practices. AEM Author, Publish and Dispatcher instances can be fully configured and deployed as code with Chef. In this talk we will discuss how the open source AEM Chef Cookbook can be used to automate the deployment of AEM instances with Chef features like recipes, attributes, providers and resources. Out of the box, the AEM Chef Cookbook supports:
- Unattended installation of AEM Author, Publish, and Dispatcher nodes.
- Automatic search for and configuration of AEM cluster members using Chef searches.
- Configuration for replication agents using the replicator provider.
- Configurations for Dispatcher farms with the farm provider.
- Deploying and removing AEM packages with the package provider.
We will also discuss how AEM can be automated to supported different SSO and deployment scenarios like cold standby. Finally, we will cover how to extend the Cookbook to support your project specific needs.
Covers a broad overview of how to use AWS for building a scalable web app. Covers some of the AWS services in depth, and also gives recommendations on many services.
This presentation explains how to deploy and use the Integrated Caching feature on Netscaler. I gave this presentation to Citrix staff, customers and partners in worldwide in 2011. The presentation covers best practices and gotchas :) Integrated Caching is an excellent feature that can greatly improve the performance of your website.
Optimizing WordPress for Performance - WordCamp HoustonChris Olbekson
Speeding up websites is important- Not just to site owners but to all Internet users. In this session, we’ll look at some techniques you can use to speed up your WordPress site including optimizing theme files and database queries, caching and some tips on improving server performance. Note: This talk will be geared towards users who have a basic understanding of theme template files and experience with web development tools, such as Firebug.
Chef Provisioning a Chef Server Cluster - ChefConf 2015Chef
This talk is an exploration of how to build Chef Server 12 clusters with Chef Provisioning, including premium features like Chef Reporting and Chef Analytics. I will cover several new capabilities and tools in the Chef ecosystem that makes it easier than ever before to build and manage scalable Chef Server clusters.
https://youtu.be/HUQA1Ikm5Iw
SCALE12X Build a Cloud Day: Chef: The Swiss Army Knife of Cloud InfrastructureMatt Ray
Chef is an open source configuration management and automation framework used to configure, deploy and manage infrastructure of every type. Deploying to the cloud has made it easy to run large numbers of
servers and Chef makes it even easier to deploy to nearly every public and private cloud platform as well as virtualized and physical servers. This talk will provide a quick introduction to Chef and is intended for sysadmins and developers familiar with the concepts behind managing applications and infrastructure in the cloud, without diving too deeply into technical specifics.
Handling 10k requests per second with Symfony and Varnish - SymfonyCon Berlin...Alexander Lisachenko
It is believed that the Symfony framework is quite heavy and it can be difficult to develop a website that will be able to work under the high load. It is true, but does this mean that it is impossible to implement a dynamic caching and to update only a small part of entire page as data is updated? This talk will give your an answer to that. It is Varnish, ESI-blocks and load balancing. With hundreds of thousands of unique visitors and million hits a day, we continue to use Symfony, and do not see any problems.
Service Delivery Assembly Line with Vagrant, Packer, and AnsibleIsaac Christoffersen
Leverage Packer, Vagrant, and Ansible as part of a service delivery pipeline. Streamline your continuous delivery process while also targeting multiple cloud providers.
CIRCUIT 2015 - AEM Infrastructure Automation with Chef CookbooksICF CIRCUIT
Drew Glass - Hero Digital
Push button deployments can automate AEM infrastructure to reduce costs and defects. Chef is a platform that enables this by transforming infrastructure into code using DevOps practices. AEM Author, Publish and Dispatcher instances can be fully configured and deployed as code with Chef. In this talk we will discuss how the open source AEM Chef Cookbook can be used to automate the deployment of AEM instances with Chef features like recipes, attributes, providers and resources. Out of the box, the AEM Chef Cookbook supports:
- Unattended installation of AEM Author, Publish, and Dispatcher nodes.
- Automatic search for and configuration of AEM cluster members using Chef searches.
- Configuration for replication agents using the replicator provider.
- Configurations for Dispatcher farms with the farm provider.
- Deploying and removing AEM packages with the package provider.
We will also discuss how AEM can be automated to supported different SSO and deployment scenarios like cold standby. Finally, we will cover how to extend the Cookbook to support your project specific needs.
Covers a broad overview of how to use AWS for building a scalable web app. Covers some of the AWS services in depth, and also gives recommendations on many services.
This presentation explains how to deploy and use the Integrated Caching feature on Netscaler. I gave this presentation to Citrix staff, customers and partners in worldwide in 2011. The presentation covers best practices and gotchas :) Integrated Caching is an excellent feature that can greatly improve the performance of your website.
Optimizing WordPress for Performance - WordCamp HoustonChris Olbekson
Speeding up websites is important- Not just to site owners but to all Internet users. In this session, we’ll look at some techniques you can use to speed up your WordPress site including optimizing theme files and database queries, caching and some tips on improving server performance. Note: This talk will be geared towards users who have a basic understanding of theme template files and experience with web development tools, such as Firebug.
DevOps, Continuous Integration and Deployment on AWS: Putting Money Back into...Amazon Web Services
Organizations around the globe are leveraging the cloud to accomplish world-changing missions. This session will address how AWS can help organizations put more money toward their mission and scale outreach and operations to achieve more with less. Hear some of AWS’s most advanced customers on how their organizations handle DevOps, continuous integration and deployment. Learn how these practices allow them to rapidly develop, iterate, test and deploy highly-scalable web applications and core operational systems on AWS. The discussion will focus on best practices, lessons learned, and the specific technologies and services they use.
Scaling drupal horizontally and in cloudVladimir Ilic
Vancouver Drupal group presentation for April 25, 2013.
How to deploy Drupal on
- multiple web servers,
- multiple web and database servers, and
- how to join all that together and make site deployed on Amazon Cloud (Virtual Private Cloud) inside
- one availability zone
- multiple availability zones deployment.
Session cover details about what you need in order to get Drupal deployed on separate servers, what are issues/concerns, and how to solve them.
Introduction to Apache CloudStack by David Nalleybuildacloud
Apache CloudStack is a mature, easy to deploy IaaS platform. That doesn't mean that it can be done without thought or preparation. Learn how CloudStack can be most efficiently deployed, and the problems to avoid in the process.
About David Nalley
David is a recovering sysadmin with a decade of experience. He’s a committer on the Apache CloudStack (incubating) project, a contributor to the Fedora Project and the Vice President of Infrastructure at the Apache Software Foundation.
Scaling on EC2 in a fast-paced environment (LISA'11 - Full Paper)Nicolas Brousse
Managing a server infrastructure in a fastpaced environment like a start-up is challenging. You have little time for provisioning, testing and planning but still you need to prepare for scaling when your product reaches the tipping point. Amazon EC2 is one of the cloud providers that we experimented with while growing our infrastructure from 20 servers to 500 servers. In this paper we will go over the pros and cons of managing EC2 instances with a mix of Bind, LDAP, SimpleDB and Python scripts; how we kept a smooth working process by using NFS, auto-mount and shell-scripting; why we switched from managing our instances based on tailor-made AMI/Shell-scripting to the official Ubuntu AMI, Cloud-init and puppet; and finally, we will go over some rules we had to follow carefully to be able to handle billions of daily non-static http request across multiple Amazon EC2 regions.
Ansible: How to Get More Sleep and Require Less CoffeeSarah Z
Why you need automation, configuration management and remote execution in your life. An intro to Ansible and how it can make your life in Ops infinitely easier.
- TeamSQL AWS Architecture
- VPC Introduction (Public, private subnets) and Demo
- EC2 Introduction and Demo
- RDS Introduction and Demo
- Introduction to Cloudformation
- A simple Cloudformation Script and make it live (Creating EC2 with Cloudformation)
- Deleting Cloudformation Stack
- More advanced Cloudformation Script and make it live
(Cloudformation parameters, VPC, public, private subnets, RDS, ElasticBeanstalk, ElastiCache)
- Updating Cloudformation Stack
- Hands on - Advanced Cloudformation Script
In an increasingly competitive marketplace, speed and business agility are paramount. And integration between customer-facing systems and back-end applications is more crucial than ever.
At this event, you'll learn how open source software built by communities, like Apache Camel, Docker, Kubernetes, OpenShift Origin, and Fabric8, can help organizations integrate services and establish effective continuous integration and delivery (CI/CD) pipelines.
A presentation on how applying Cloud Architecture Patterns using Docker Swarm as orchestrator is possible to create reliable, resilient and scalable FIWARE platforms.
A presentation about deploy, scaling and the coordination problem. We will focus on redis as a coordination system in order to simplify the migration to ETCd as coordination system
Realtime and remote service integration into the our AngularJS Application, a travel around the best servies to build a serverless application. AWS Lambda, DynamoDB.
How to manage in the best way foldering, routing and resources in a AngularJS app: integrate tools like Yeoman, Grunt, Bower and other open Angular modules.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
3. RDBMS – START FROM THE END
• MySQL
• RDBMS
• Relational Database Management System
• How it scales?
• Read Replica
• Pros (In terms of scalability)
• Simple to do
• Simple management
• Cons
• You can scale only read operations
• The master instance has to handle all write operations
(bottleneck on writes)
CORLEY SRL – WWW.CORLEY.IT
4. READ REPLICA ON AWS
• From RDS service tab on the AWS console right
click on a running instance and create a Read
Replica DB Instance
• Configure the read-replica and create it through
the graphical console.
CORLEY SRL – WWW.CORLEY.IT
5. IN ORDER TO PROMOTE A SLAVE TO MASTER?
Similar to master creation
• Select a read-replica
• Right-click and promote Read Replica
Discover more on RDS:
• http://aws.typepad.com/aws/amazon-rds/
CORLEY SRL – WWW.CORLEY.IT
6. NOW HAVE A LOOK ON WEB INSTANCES
• All web instances scales out
instead scales up
• Scale out? What it means?
• Instead increase VM performances
(more RAM, more CPU, more IO etc.
etc.) open new VM and serve requests
from these instances
• Load balancer route incoming
connections to VMs using common
algorithms
• Round robin techniques
• Based on VMs average load
CORLEY SRL – WWW.CORLEY.IT
7. PROBLEMS… WE NEVER TALK ABOUT…
• Session management
• If we open and close servers runtime we have to maintain
PHP sessions in order to handle user logins and other
features related to sessions
• Database connections
• All MySQL connectors handle just one connection… No
“x” RDB connections a the same time…
• Software and Plugins maintenance
• How can we have the same version of WordPress and WP
Plugins if VMs starts and stops continuously? How can we
handle software updates?
• What about logs? How can we centralize the log
management?
CORLEY SRL – WWW.CORLEY.IT
8. DELEGATE SESSION MANAGEMENT TO MEMCACHE
• Memcache(d) servers are not only useful
distributed in RAM caching servers but also
they can manage PHP session for us.
• Memcache infrastructure is simple to create and
maintain
• Elasticache Service of AWS
• No software modification
• We have just to configure the PHP interpreter
(compile with memcache/memcached support)
session.save_handler = memcache
session.save_path = "tcp://1.cache.group.domain.tld:11211"
CORLEY SRL – WWW.CORLEY.IT
9. DELEGATE CONNECTIONS TO MYSQL NATIVE DRIVER
• MySQL native driver?
• Available from PHP >=5.3
• Compile PHP with mysqlnd support
• --with-mysqli=mysqlnd --with-pdo=mysqlnd --with-
mysql=mysqlnd
• WARN mysql extension is deprecated as of PHP
5.5.0
• Delegate to “mysqlnd_ms” the master/slave
management
• http://www.php.net/manual/en/book.mysqlnd-
ms.php
CORLEY SRL – WWW.CORLEY.IT
10. DELEGATE CONNECTIONS TO MYSQL NATIVE DRIVER
The simple JSON configuration is divided
in two main section
{
"myapp": {
"master": { • Master
"master_0": { • Slaves
"host": "localhost",
"port": "3306"
} “myapp” is the hostname that we use
},
"slave": {
instead the real mysql host address.
"slave_0": {
"host": "192.168.2.27", Eg.
"port": "3306"
} • mysql_connect(“myapp”, “user”,
} “passwd”);
} • new
} Mysqli(“myapp”, “user”, “passwd”
);
• new
PDO(“mysql:dbname=testdb;host=my
app”);
CORLEY SRL – WWW.CORLEY.IT
11. START TALKING ABOUT ELASTIC COMPUTE CLOUD
• ELB – Elastic Load Balancer
• Distributed load balancer on AWS regions (eu-west-1, 2, 3 you
have to select in how many region you are available)
• Watch EC2 status thanks to a ping strategy
• Page check every x minutes/seconds
• Turn on/off EC2 instances automatically thanks to alarms
(CloudWatch raise alarms)
• Receive Alarms from CloudWatch and engage scale operations
• You can raise CPU alarms, Network Alarms, VM status alarms and many
others in order to increase or decrease the actual number of EC2
• Scale strategy is not simple and you have to understand how your
application works
• CPU is the simplest way but remember that the bandwidth is limited by
network interfaces and bottlenecks can obfuscate the CPU alarm and your
application stucks in weird and strange situations.
CORLEY SRL – WWW.CORLEY.IT
12. AUTOSCALING WITH ELB + EC2 + CLOUDWATCH
• If servers start and stops continuously, we have to
find solutions to stay fresh and updated also on
software
• When a server starts, it has to create a valid
environment in order to provides web pages.
Strategies?
• Compile and bundle all softwares in one instance image
• It is very simple but all software becomes old very quickly and
when you have to release an update you have to compile a new
image and update all load balancers configurations. It is a long and
complex operation
• Use EC2_USER_DATA feature provided by AWS
• You can run a shell script when your instances bootstraps. It is more
flexible because you can create a skeleton (PHP + libraries) and
download all software runtime during the boot operation
CORLEY SRL – WWW.CORLEY.IT
13. THE PROBLEM WITH SOFTWARE MANAGEMENT
Use SVN (Subversion) to download the latest version of
WordPress
Probably is not a good idea use the “trunk” but you can use tags in order to stay
aligned in all VMs
svn checkout http://core.svn.wordpress.org/tags/3.5.1/ mywebsite
http://codex.wordpress.org/Installing/Updating_WordPress_with_Su
bversion
Use SVN externals to download your plugins
cd mywebsite/wp-content/plugins/
svn propset svn:externals akismet
http://plugins.svn.wordpress.org/akismet/tags/2.5.7/
svn up
Create/Download your WordPress configuration file
during VM bootstrap
CORLEY SRL – WWW.CORLEY.IT
14. HOW WE CAN DOWNLOAD WP AND PLUGINS?
• If you ran 10 servers execute
commands could be hard. You can use
tools to run command on a server list
• Capistrano (Ruby)
• https://github.com/capistrano/capistrano
• Fabric (Python)
• https://github.com/fabric/fabric
• Use CLOTH for AWS EC2 instances
• https://github.com/garethr/cloth
CORLEY SRL – WWW.CORLEY.IT
15. HOW TO UPDATE CONFIGURATIONS RUNTIME?
#! /usr/bin/env python
from __future__ import with_statement
from fabric.api import *
from fabric.contrib.console import confirm EC2 instances are dynamic with don’t know
address, for that reason we can use tagging
from cloth.tasks import * system to execute commands on a group of
instances
env.user = "root"
env.directory = '/mnt/wordpress' fab nodes:"^production.*" tail
env.key_filename = ['/home/walter/Amazon/wp-
cms.pem'] Execute the “tail” command on all instances
with a name that starts with “production.”
@task
def reload(): Eg.
"Reload Apache configuration" • production.web-1
run('/etc/init.d/apache2 reload') • production.log
• production.mongodb
@task
def tail():
"Tail Apache logs"
run('tail /var/log/syslog')
CORLEY SRL – WWW.CORLEY.IT
16. EXAMPLE OF FABRIC – USAGE WITH CLOTH
• We create and destroy instances thanks to alarms but
when we close an instance we lose immediately all
apache logs (or equivalent)
• How we can manage logs?
• The simplest way is to use Rsyslog clusters
• Rsyslog is an opensource software that forwarding log
messages in an IP network
• Rsyslog implement the basic syslog protol
• That means that we can configure apache logs to “syslog”
instead using normal text files.
• In this way we can collect all logs in one group of VM and
work on these files later thanks to other technologies.
CORLEY SRL – WWW.CORLEY.IT
17. ALSO LOG MANAGEMENT IS NOT SIMPLE…
• Collecting logs is not the latest operation
because you have to analyse and reduce
information
• Move logs to S3 bucket – Time based
• Analyze logs with Hadoop
• Map Reduce on the cloud with Elastic Map Reduce service
(EMR)
• Use script languages on top of Hadoop in order to
simply the log analysis
• HIVE – Data Warehouse infrastructure (data
summarization)
• Pig – High level platform for creating MapReduce program
CORLEY SRL – WWW.CORLEY.IT