The document discusses Valentino Volonghi's presentation on effective use of Amazon EC2. It provides examples of how AdRoll migrated their infrastructure from self-hosted servers to using Amazon EC2 and other AWS services like S3 and CloudFront. It highlights benefits of EC2 like automatic scaling, easy software upgrades, low latency network access, and real-time monitoring. It also discusses strategies used for deploying application servers on EC2 using custom AMIs and boto monitoring.
CommunityOneEast 09 - Running Java On Amazon EC2Chris Richardson
The Amazon Elastic Compute Cloud (EC2) is a virtualized computing environment where you rapidly provision and manage servers via a web services API. It is ideally suited to running Java applications because it allows you to develop applications using standard software packages such as Glassfish and MySQL. However, because it is a cloud, some aspects of EC2 are very different than a traditional, physical computing environment, which impacts how you handle security, networking, storage and availability.
SD Forum Java SIG - Running Java Applications On Amazon EC2Chris Richardson
The Amazon Elastic Compute Cloud (EC2) is ideally suited to running Java applications. It lets you develop using standard Java software packages such as Tomcat and MySQL and rapidly deploy applications on servers that are provisioned and managed via a web services API. However, because it is a cloud, some aspects of EC2 are very different than a traditional, physical computing environment. In this session you will learn about those differences and how they impact how you handle security, networking, storage and availability. We describe how to use EC2 and the other Amazon web services to develop and deploy Java applications. You will learn how to use EC2 availability zones to deploy highly available applications. We also discuss how to architect secure applications for Amazon EC2.
GDD Brazil 2010 - What's new in Google App Engine and Google App Engine For B...Patrick Chanezon
Learn what's new with App Engine. We'll take a whirlwind tour through the changes since last year.
We'll top it off with a glimpse into some new features that we've planned for the year ahead. This session will include an overview of Google App Engine for Business.
GDG DevFest Romania - Architecting for the Google Cloud PlatformMárton Kodok
Learn about FaaS, PaaS architectural patterns that make use of Cloud Functions, Pub/Sub, Dataflow, Kubernetes and platforms that hides the management of servers from the user and have changed how we develop and deploy future software.
We discuss the difference between an event-driven approach - this means that you can trigger a function whenever something interesting happens within the cloud environment - and the simpler HTTP approach. Quota and pricing of per invocation, and the advantages and disadvantages of the serverless systems.
GDG Heraklion - Architecting for the Google Cloud PlatformMárton Kodok
Learn about cloud components, architecture overviews to build an app using GCP components.
You will get hands-on information on how to build highly scalable and flexible applications optimized to run in GCP on the same infrastructure that powers Google. We will discuss cloud concepts and highlights various design patterns and best practices.
By the end of the session you will have hands-on experience to build a basic cloud application, it could be a simple web tier, powered by highly distributed database, background tasks executed on a pub/subsystem, and you get information how to go next level with advanced concepts like analytics warehouse, recommendation engines, and ML.
Optimizing Cost and Capacity for Compute - CMP302 - Santa Clara AWS SummitAmazon Web Services
Amazon EC2 offers a wide variety of compute instances via highly flexible pricing options that are well suited for every use case, including web services, containerized workloads, batch processing, big data, CI/CD, and supercomputing. In this session, learn how you can optimize your workloads running on EC2 for cost and performance, all while handling peak demand. See demos on how to deploy highly-available cost-optimized workloads at scale using EC2 Launch Templates, EC2 Fleet, and EC2 Auto Scaling
CommunityOneEast 09 - Running Java On Amazon EC2Chris Richardson
The Amazon Elastic Compute Cloud (EC2) is a virtualized computing environment where you rapidly provision and manage servers via a web services API. It is ideally suited to running Java applications because it allows you to develop applications using standard software packages such as Glassfish and MySQL. However, because it is a cloud, some aspects of EC2 are very different than a traditional, physical computing environment, which impacts how you handle security, networking, storage and availability.
SD Forum Java SIG - Running Java Applications On Amazon EC2Chris Richardson
The Amazon Elastic Compute Cloud (EC2) is ideally suited to running Java applications. It lets you develop using standard Java software packages such as Tomcat and MySQL and rapidly deploy applications on servers that are provisioned and managed via a web services API. However, because it is a cloud, some aspects of EC2 are very different than a traditional, physical computing environment. In this session you will learn about those differences and how they impact how you handle security, networking, storage and availability. We describe how to use EC2 and the other Amazon web services to develop and deploy Java applications. You will learn how to use EC2 availability zones to deploy highly available applications. We also discuss how to architect secure applications for Amazon EC2.
GDD Brazil 2010 - What's new in Google App Engine and Google App Engine For B...Patrick Chanezon
Learn what's new with App Engine. We'll take a whirlwind tour through the changes since last year.
We'll top it off with a glimpse into some new features that we've planned for the year ahead. This session will include an overview of Google App Engine for Business.
GDG DevFest Romania - Architecting for the Google Cloud PlatformMárton Kodok
Learn about FaaS, PaaS architectural patterns that make use of Cloud Functions, Pub/Sub, Dataflow, Kubernetes and platforms that hides the management of servers from the user and have changed how we develop and deploy future software.
We discuss the difference between an event-driven approach - this means that you can trigger a function whenever something interesting happens within the cloud environment - and the simpler HTTP approach. Quota and pricing of per invocation, and the advantages and disadvantages of the serverless systems.
GDG Heraklion - Architecting for the Google Cloud PlatformMárton Kodok
Learn about cloud components, architecture overviews to build an app using GCP components.
You will get hands-on information on how to build highly scalable and flexible applications optimized to run in GCP on the same infrastructure that powers Google. We will discuss cloud concepts and highlights various design patterns and best practices.
By the end of the session you will have hands-on experience to build a basic cloud application, it could be a simple web tier, powered by highly distributed database, background tasks executed on a pub/subsystem, and you get information how to go next level with advanced concepts like analytics warehouse, recommendation engines, and ML.
Optimizing Cost and Capacity for Compute - CMP302 - Santa Clara AWS SummitAmazon Web Services
Amazon EC2 offers a wide variety of compute instances via highly flexible pricing options that are well suited for every use case, including web services, containerized workloads, batch processing, big data, CI/CD, and supercomputing. In this session, learn how you can optimize your workloads running on EC2 for cost and performance, all while handling peak demand. See demos on how to deploy highly-available cost-optimized workloads at scale using EC2 Launch Templates, EC2 Fleet, and EC2 Auto Scaling
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
Generating a custom Ruby SDK for your web service or Rails API using Smithyg2nightmarescribd
Have you ever wanted a Ruby client API to communicate with your web service? Smithy is a protocol-agnostic language for defining services and SDKs. Smithy Ruby is an implementation of Smithy that generates a Ruby SDK using a Smithy model. In this talk, we will explore Smithy and Smithy Ruby to learn how to generate custom feature-rich SDKs that can communicate with any web service, such as a Rails JSON API.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
Neuro-symbolic is not enough, we need neuro-*semantic*
Effective EC2
1. Effective EC2
PyCon Italia Qu4ttro - May 7/8/9 2010
Valentino Volonghi - valentino@adroll.com
Wednesday, May 19, 2010
2. Buzz
Why I’ll never own another server...
Joe Stump - Digg Lead Architect, CTO SimpleGeo
http://stu.mp/2010/04/why-ill-never-own-another-server.html
Cloud computing economies of scale
James Hamilton - VP & Distinguished Engineer, Amazon Web Services
http://live.visitmix.com/MIX10/Sessions/EX01
Moving to the cloud
Reddit Team
http://blog.reddit.com/2009/11/moving-to-cloud.html
Effective EC2 - Valentino Volonghi
Wednesday, May 19, 2010
5. Google AppEngine
• Transparently scalable
• No maintenance headaches
• Software must be written ad hoc
• Little control over infrastructure
Effective EC2 - Valentino Volonghi
Wednesday, May 19, 2010
6. Rackspace Cloud
• CloudServers/CloudFiles/CloudSites
• Some nice additional features
• Fewer datacenters and can’t pick them
• 12/11/07, 09/07/08, 03/11/09
Effective EC2 - Valentino Volonghi
Wednesday, May 19, 2010
8. Amazon AWS
• 4 independent regions - 10 data centers
• 3rd party vendor support
• Well integrated services accessible via API
• “Poor” single-node performance
• Flexible upper limits
Effective EC2 - Valentino Volonghi
Wednesday, May 19, 2010
9. Amazon AWS
Amazon Web Services can be as big
as our retail business
Andy Jassy - Amazon Senior VP Cloud Computing Business
Revenue: Market Share:
$650.000.000 77%
Effective EC2 - Valentino Volonghi Source: www.businessweek.com/technology/content/apr2010/tc20100428_085106.htm
Wednesday, May 19, 2010
10. AdRoll
• Scaling High ROI Display Advertising
• 60M paid campaigns impressions
• 200M advertiser pixels impressions
• 99% of requests below 3ms think time
• Realtime Dynamic Ads
Effective EC2 - Valentino Volonghi
Wednesday, May 19, 2010
11. AdRoll 2008
• ServePath Housing
• NaviSite CDN with mod_python
• Self-Hosted DNS
• MySQL DB
• NFS
Effective EC2 - Valentino Volonghi
Wednesday, May 19, 2010
12. AdRoll 2009
• ServePath Housing
• Amazon EC2 auto-managed AdServers
• Amazon S3/CloudFront CDN
• Dynect DNS Global Server Load Blancing
• MySQL DB
• NFS
Effective EC2 - Valentino Volonghi
Wednesday, May 19, 2010
17. Migration
Phase I - May 2009
Effective EC2 - Valentino Volonghi
Wednesday, May 19, 2010
18. New Ad Servers
• Very Quick & faultless boot procedure
• Easy software upgrade
• Low latency network
• Real time monitoring
Effective EC2 - Valentino Volonghi
Wednesday, May 19, 2010
19. New Ad Servers
• Custom bundled AMI stored in S3
• Python deploys the AdServer on boot
• Hidden real load test
• Boto monitoring
Effective EC2 - Valentino Volonghi
Wednesday, May 19, 2010
20. Boto monitoring
def regional_max_allocation(start_adserver=ec2.Image.start_adserver):
zones = [zone.name for zone in ec2.bconn.get_all_zones()]
(availables_with_ip, availables_without_ip,
software_failures, startings) = get_instances_by_status()
def setup_candidate(failure=None, free_ip=None):
if availables_without_ip:
new_instance = get_instance_in_unused_zone(availables_with_ip,
availables_without_ip,
lenient=True)
if failure is not None:
free_ip = failure.disassociate_elastic()
availables_without_ip.remove(new_instance)
availables_with_ip.add(new_instance)
new_instance.associate_elastic(free_ip)
return
if startings:
startings.pop()
return
start_adserver("adserver-" + utils.uuid(),
zone=get_unused_zone(availables_with_ip,
zones))
for software_failure in software_failures:
setup_candidate(failure=software_failure)
free_ips = ec2.get_all_free_elastic_ip(default=[])
for free_ip in free_ips:
Effective EC2 - Valentino Volonghi setup_candidate(free_ip=free_ip)
Wednesday, May 19, 2010
21. Migration
Phase 2 - March 2010
Effective EC2 - Valentino Volonghi
Wednesday, May 19, 2010
22. Preparation
• SQLAlchemy is awesome
• PostgreSQL 5-10x faster than MySQL
• 1 EBS is slower than 8 in RAID!! :)
• m1.small instances are useless
Effective EC2 - Valentino Volonghi
Wednesday, May 19, 2010
23. Automated Deploy
• Stock Ubuntu AMI
• Setup scripts on S3
• Fabric
➡ 5 minutes to boot a new instance
➡ No maintenance overhead
Effective EC2 - Valentino Volonghi
Wednesday, May 19, 2010
26. Generic Instance
• m1.large - 7.5 GB RAM - 2 VCPU
• 1 EBS with 500GB space
• Store frequently changed data
• Exact copies of each other
Effective EC2 - Valentino Volonghi
Wednesday, May 19, 2010
27. Web Instance
• c1.medium - 1.7 GB RAM - 2 VCPU
• No EBS
• Amazon ELB frontend
• Easily replaceable
• Logs aggregated separately in real time
Effective EC2 - Valentino Volonghi
Wednesday, May 19, 2010
29. runurl
by Eric Hammond. Download and run any script from
any URL.
Effective EC2 - Valentino Volonghi
Wednesday, May 19, 2010
30. ec2-consistent-snapshot
by Eric Hammond, atomic snapshot of EBS volumes
with xfs filesystem.
Effective EC2 - Valentino Volonghi
Wednesday, May 19, 2010
31. Eric Hammond
If you want to know more about Amazon AWS,
he’s the one you want to talk to.
Effective EC2 - Valentino Volonghi
Wednesday, May 19, 2010
32. Use Public addresses
Public addresses are automatically resolved to internal
addresses when possible.
Effective EC2 - Valentino Volonghi
Wednesday, May 19, 2010
33. Use ELB and
Cloudwatch
Very useful for latency and load monitoring… It also
makes scaling the web frontend extremely easy!
Effective EC2 - Valentino Volonghi
Wednesday, May 19, 2010
34. EBS RAID
EBS is cheap. Instead of one big EBS create one big
soft-RAID/LVM volume from many of them, it’s faster
and safer.
Effective EC2 - Valentino Volonghi
Wednesday, May 19, 2010
35. SMTPAuth / SendGrid
Mail sending from Amazon EC2 was/is crippled. Use a
third party service to improve deliverability.
Effective EC2 - Valentino Volonghi
Wednesday, May 19, 2010
36. Use /etc/hosts
Setting up a DNS is a lot of work at the beginning. Use
SSH key names to setup a custom /etc/hosts file in each
instance.
Effective EC2 - Valentino Volonghi
Wednesday, May 19, 2010
37. new_lines = ["127.0.0.1 localhost"]
for reservation in conn.get_all_instances():
for instance in reservation.instances:
if instance.state == "running":
KEYS.discard(instance.key_name)
new_lines.append(
"%s %s.internal %s" % (
socket.gethostbyname(instance.public_dns_name),
instance.key_name,
instance.key_name)
)
for missing_key in KEYS:
new_lines.append(
"127.0.0.1 %s.internal %s" % (missing_key, missing_key)
)
f = open('/etc/hosts.new', 'wb')
f.write("n".join(new_lines))
f.write("n")
f.flush()
f.close()
shutil.move('/etc/hosts.new', '/etc/hosts')
Effective EC2 - Valentino Volonghi
Wednesday, May 19, 2010