Event machine

•Download as KEY, PDF•

5 likes•1,047 views

almeidaricardo

Technology

PostRank Tools

• Mysql, Ruby (API), Rails, Sinatra, Phyton,
Java, JRuby, EC2, Nagios, Ganglia, Solr
• Eventmachine, RabbitMQ
• From XMPP to AMQP
• Cassandra, Goliath
http://webpulp.tv/post/4184040219/scaling-postrank-using-ruby-and-eventmachine-with-ilya

Event Machine

• Fast, simple event-processing library for Ruby
programs

• Event-driven I/O
• Reactor pattern

Designed to

• Extremely high scalability, performance and stability
• An API that eliminates the complexities of high-
performance threaded network programming

Social Core

• Escalabilidade
• Disponibilidade - Todos requests devem ser
respondidos

• Consistência

Architectures
Job Manager
GET / POST Queue
Server Event

Process

Tools
• Rails 3.1.0.rc6

• Ruby 1.9.2-head

• Event-Machine

• Thin

• Goliath

• Mysql (gem mysql2 v 0.3.6)

• MongoDB

• RabbitMQ (AMQP)

EM-Tools

• https://github.com/eventmachine/eventmachine/wiki
• https://github.com/igrigorik/em-http-request
• https://github.com/igrigorik/em-synchrony
• https://github.com/postrank-labs/goliath

Benchmarks

• ApacheBench,Version 2.3
• Autoperf (httperf)

Sleep Select (1 sec)

• Tools:
• ApacheBench
• Rails 3.1.0.rc6 + Ruby 1.9.2-head + Mysql +
webrick

https://gist.github.com/1166610

Sleep Select (1 sec)

• ab -c 10 -n 10 'http://localhost:3000/people/wait'

• Time taken for tests: 11.255 seconds

https://gist.github.com/1166610

Sleep Select (1 sec)
• Tools: Assync Rails

• ApacheBench
• webrick
• Rails 3.1.0.rc6 + Ruby 1.9.2-head + Mysql + Thin
+ EventMachine

https://gist.github.com/1166610

Sleep Select (1 sec)

• ab -c 10 -n 10 'http://localhost:3000/people/wait'

• Time taken for tests: 2.371 seconds

https://gist.github.com/1166610

Goliath
• Heartbeat

• Assync Upload

• Routes

• Validations

Sleep Select (1 sec)
• Tools:
• ApacheBench
• Rails 3.1.0.rc6 + Thin
• Ruby 1.9.2-head + EventMachine + Mysql +
Goliath

https://gist.github.com/1166462

Sleep Select (1 sec)

• ab -c 10 -n 10 'http://0.0.0.0:9000/wait?format=json'

• Time taken for tests: 2.198 seconds

https://gist.github.com/1166610

HTTP assinc
Req/Resp no MongoDB
• Tools:
• ApacheBench
• Mysql
• Ruby 1.9.2-head + EventMachine + Goliath +
MongoDB

HTTP assinc
Req/Resp no MongoDB
• ab -c 10 -n 10 'http://0.0.0.0:9000/teste?format=json'

• Time taken for tests: 0.209 seconds

HTTP assinc
Req/Resp no MongoDB
• ab -c 50 -n 50 'http://0.0.0.0:9000/teste?format=json'

• Time taken for tests: 1.105 seconds

Domínios

• AAPG • Facebook

• Anotations • Twitter

• Activity (New) • Google+

http://www.slideshare.net/hungryblank/distributed-and-concurrent-programming-with-rabbitmq-and-eventmachine-rails-underground-2009

SPDY

http://www.igvita.com/2011/04/07/life-beyond-http-11-googles-spdy/

Obrigado!
Ricardo Almeida
@almeidaricardo

What's hot

Since moving to a 6 monthly release cadence, the Java platform is evolving more dynamically than ever before. It can be quite a challenge to stay on top of all the changes and new features. In this talk we're going to explore the most important developments in the Java API: which classes have been added, and what has been removed? Join Duke, the Java mascot, for a trip to space and learn which exciting new APIs provided by the Java platform can help him with his journey: The Java Vector API for utilizing the SIMD capabilities of modern CPU architectures The Foreign Linker API for integrating with native code The JFR Event Streaming API for publishing JDK Flight Recorder Events We'll also take a look at some useful changes to the Java runtime, such as CDS archives for a faster spaceship..., uhm, application launch!

To the moon and beyond with Java 17 APIs! | DevNation Tech Talk

Red Hat Developers

Rust with-kafka-07-02-2019

Gerard Klijs

[En] IPVS for Docker Containers

Andrey Sibirev

Scapy the packet 途中01

saba syake

The current craze of Docker has everyone sticking their processes inside a container… but do you really understand cgroups and how they work? Do you understand the difference between CPU Sets and CPU Shares? Spark is a Scala application that lives inside a Java Runtime, do you understand the consequence of what impact the cgroup constraints have on the JRE? This talk starts with a deep understand of Java’s memory management and GC characteristics and how JRE characteristics change based on core count. We will continue the talk looking at containers and how resource isolation works.

Jörg Schad - NO ONE PUTS Java IN THE CONTAINER - Codemotion Milan 2017

Codemotion

Scapy talk

Ashwin Patil, GCIH, GCIA, GCFE

fsharp goodness for everyday work

Uladzimir Shchur

WTF is Twisted?

hawkowl

Load Balancing in the Cloud using Nginx & Kubernetes

Lee Calcote

Docker and Fluentd

SATOSHI TAGOMORI

Sysdig monitor - a brief introduction

Daniel Kerwin

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/2PeX3wC. Steve Klabnik gives an overview of Rust’s history, diving into the technical details of how the design has changed, and talks about the difficulties of adding a major new feature to a programming language. Filmed at qconnewyork.com. Steve Klabnik is on the core team of Rust, leads the documentation team, and is an author of "The Rust Programming Language”. He is a frequent speaker at conferences and is a prolific open source contributor, previously working on projects such as Ruby and Ruby on Rails.

Rust's Journey to Async/await

C4Media

Support of containerized workloads in ONAP

Victor Morales

Capistrano demo

Edward Meehan

Asynchronous Python with Twisted

Adam Englander

Have you ever thought how to deploy Cloud Native Java Applications (Spring Boot) on Kubernetes? Kubernetes has now become a de-facto standard for deploying Cloud Native Applications, but still there is myth that they are not ready for Java workloads. The aim of this session is to break that myth to show Kubernetes is well suited for Cloud Native Java applications. The session starts with a brief history of Microservices; the framework, the libraries, the platform and the tools that have been part of every cloud native applications and how they become deprecated with Cloud Native Java applications deployed to Kubernetes. The session explores the cloud native characteristics such as Discovery, Blue/Green Deployments, Elasticity, Canary Deployments, Resiliency, Pipeline(CI/CD), Authentication etc., becomes implicit characteristics to your Spring Boot Java applications that are deployed on Kubernetes/OpenShift. In this session, we will see how to build, debug, deploy and discover Spring Boot applications on Kubernetes, covering in depth details of the tools, libraries and platform that could be used to make your spring boot deployment smooth and easy.

KUBEBOOT - SPRING BOOT DEPLOYMENT ON KUBERNETES HAS NEVER BEEN SO EASY

Red Hat Developers

Apache Camel has fundamentally changed the way Java developers build system-to-system integrations by using enterprise integration patterns (EIP) with modern microservice architectures. In this session, we’ll show you best practices with Camel and EIPs, in the world of Spring Boot microservices running on Kubernetes. We'll also discuss practices how to build truly cloud-native distributed and fault-tolerant microservices and we’ll introduce the upcoming Camel 3.0 release, which includes serverless capabilities via Camel K. This talk is a mix with slides and live demos.

Integrating microservices with apache camel on kubernetes

Claus Ibsen

The details of CI/CD environment for Ruby

Hiroshi SHIBATA

Three engineers, at various points, each take their own approach adding Rust to a C codebase, each being more and more ambitious. I initially just wanted to replace the server’s networking and event loop with an equally fast Rust implementation. We’d reuse many core components that were in C and just call into them from Rust. Surely it wouldn’t be that much code… Pelikan is Twitter’s open source and modular framework for in-memory caching, allowing us to replace Memcached and Redis forks with a single codebase and achieve better performance. At Twitter, we operate hundreds of cache clusters storing hundreds of terabytes of small objects in memory. In-memory caching is critical, and demands performance, reliability, and efficiency. In this talk, I’ll share my adventures in working on Pelikan and how rewriting it in Rust can be more than just a meme.

Whoops! I Rewrote It in Rust

ScyllaDB

Pharo VM Performance

Pharo

What's hot (20)

To the moon and beyond with Java 17 APIs! | DevNation Tech Talk

Rust with-kafka-07-02-2019

[En] IPVS for Docker Containers

Scapy the packet 途中01

Jörg Schad - NO ONE PUTS Java IN THE CONTAINER - Codemotion Milan 2017

Scapy talk

fsharp goodness for everyday work

WTF is Twisted?

Load Balancing in the Cloud using Nginx & Kubernetes

Docker and Fluentd

Sysdig monitor - a brief introduction

Rust's Journey to Async/await

Support of containerized workloads in ONAP

Capistrano demo

Asynchronous Python with Twisted

KUBEBOOT - SPRING BOOT DEPLOYMENT ON KUBERNETES HAS NEVER BEEN SO EASY

Integrating microservices with apache camel on kubernetes

The details of CI/CD environment for Ruby

Whoops! I Rewrote It in Rust

Pharo VM Performance

Similar to Event machine

Host Health Monitoring with Docker Run

Noah Zoschke

At Booking.com, we have a constant flow of events coming from various applications and internal subsystems. This critical data needs to be stored for real-time, medium and long term analysis. Events are schema-less, making it difficult to use standard analysis tools.This presentation will explain how we built a storage and analysis solution based on Riak. The talk will cover: data aggregation and serialization, Riak configuration, solutions for lowering the network usage, and finally, how Riak's advanced features are used to perform real-time data crunching on the cluster nodes.

Using Riak for Events storage and analysis at Booking.com

Damien Krotkine

The Architecture of PicCollage Server

Lin Jen-Shin

Impression of Rails 3

Kosuke Matsuda

Rack

shaokun

Efficiently parallelizing mutually exclusively tasks can be a challenging problem when done at scale. Yelp's recent in-house product, Seagull, demonstrates how an intelligent scheduling system can use several open-source products to provide a highly scalable and fault-tolerant distributed system. Learn how Yelp built Seagull with a variety of Amazon Web Services to concurrently execute thousands of tasks that can greatly improve performance. Seagull combines open-source software like ElasticSearch, Mesos, Docker, and Jenkins with Amazon Web Services (AWS) to parallelize Yelp's testing suite. Our current use case of Seagull involves distributively running Yelp's test suite that has over 55,000 test cases. Using our smart scheduling, we can run one of our largest test suites to process 42 hours of serial work in less than 10 minutes using 200 r3.8xlarge instances from Amazon Elastic Compute Cloud (Amazon EC2). Seagull consumes and produces data at very high rates. On a typical day, Seagull writes 60 GBs of data and consumes 20 TBs of data. Although we are currently using Seagull to parallelize test execution, it can efficiently parallelize other types of independent tasks.

(ARC348) Seagull: How Yelp Built A System For Task Execution

Amazon Web Services

Ship It ! with Ruby/ Rails Ecosystem

Yi-Ting Cheng

EventMachine

Stoyan Zhekov

Rails Performance

Wen-Tien Chang

2017 Codemotion OWASP ZAP in CI/CD

Simon Bennetts

Taking Spinnaker for a spin @ London DevOps Meetup 36

aleonhardt

Puppet Camp New York 2014: Streamlining Puppet Development Workflow

Puppet

Steamlining your puppet development workflow

Tomas Doran

Don’t Forget About Your Past—Optimizing Apache Druid Performance With Neil Buesing | Current 2022 Businesses need to react to results immediately; to achieve this, real-time processing is becoming a requirement in many analytic verticals. But sometimes, the move from batch to real-time can leave you in a pinch. How do you handle and correct mistakes in your data? How do you migrate a new system to real-time along with historical data? Let’s start with how to run Apache Druid locally with your containerized-based development environment. While streaming real-time events from Kafka into Druid, an S3 Complaint Store captures messages via Kafka Connect, for historical processing. An exploration of performance implications when the real-time stream of events contains historical data and how that affects performance and the techniques to prevent those issues, leaving a high-performance analytic platform supporting real-time and historical processing. You’ll leave with the tools of doing real-time analytic processing and historical batch processing from a single source of truth. Your Druid cluster will have better rollups (pre-computed aggregates) and fewer segments, which reduces cost and improves query performance.

Don’t Forget About Your Past—Optimizing Apache Druid Performance With Neil Bu...

HostedbyConfluent

Slides from a talk given at DevSecCon on 206h October 2016 http://www.devseccon.com/blog/session/automating-owasp-zap/ The OWASP Zed Attack Proxy (ZAP) is one of the world’s most popular and best maintained free security tools. In this workshop you will learn how to automate security tests using ZAP. These tests can then be included in your continuous integration / delivery pipeline. Simon will cover the range of integration options available and then walk you through automating ZAP against a test application. The ZAP UI will be used to explain the concepts and python scripting used to drive ZAP via its API – this can then also be used to drive ZAP in daemon mode. This workshop is aimed at anyone interested in automating ZAP for security testing, including developers, functional testers (QA) and security/pentesters.

Automating OWASP ZAP - DevCSecCon talk

Simon Bennetts

Simon Bennetts - Automating ZAP

DevSecCon

The OWASP Zed Attack Proxy (ZAP) is one of the world’s most popular and best maintained free and open source security tools. This talk by the ZAP project lead will focus on embedding ZAP in continuous integration / delivery pipelines in order to automate security tests. Simon will cover the range of integration options available and explain how ZAP is being integrated into the Mozilla Cloud Services CD pipeline. He will also explain and demonstrate how to drive the ZAP API, which gives complete control over the ZAP daemon.

Security Testing with OWASP ZAP in CI/CD - Simon Bennetts - Codemotion Amster...

Codemotion

Counters with Riak on Amazon EC2 at Hackover

Andrei Savu

Titanium 3.2 CLI - TiAppCamp2 - 11/2/2013

Chris Barber

IVS CTO Night And Day 2018 Winter - [re:Cap] Serverless & Mobile

Amazon Web Services Japan

Similar to Event machine (20)

Host Health Monitoring with Docker Run

Using Riak for Events storage and analysis at Booking.com

The Architecture of PicCollage Server

Impression of Rails 3

Rack

(ARC348) Seagull: How Yelp Built A System For Task Execution

Ship It ! with Ruby/ Rails Ecosystem

EventMachine

Rails Performance

2017 Codemotion OWASP ZAP in CI/CD

Taking Spinnaker for a spin @ London DevOps Meetup 36

Puppet Camp New York 2014: Streamlining Puppet Development Workflow

Steamlining your puppet development workflow

Don’t Forget About Your Past—Optimizing Apache Druid Performance With Neil Bu...

Automating OWASP ZAP - DevCSecCon talk

Simon Bennetts - Automating ZAP

Security Testing with OWASP ZAP in CI/CD - Simon Bennetts - Codemotion Amster...

Counters with Riak on Amazon EC2 at Hackover

Titanium 3.2 CLI - TiAppCamp2 - 11/2/2013

IVS CTO Night And Day 2018 Winter - [re:Cap] Serverless & Mobile

Recently uploaded

This presentation explores the impact of HTML injection attacks on web applications, detailing how attackers exploit vulnerabilities to inject malicious code into web pages. Learn about the potential consequences of such attacks and discover effective mitigation strategies to protect your web applications from HTML injection vulnerabilities. for more information visit https://bostoninstituteofanalytics.org/category/cyber-security-ethical-hacking/

HTML Injection Attacks: Impact and Mitigation Strategies

Boston Institute of Analytics

A Principled Technologies deployment guide Conclusion Deploying VMware Cloud Foundation 5.1 on next gen Dell PowerEdge servers brings together critical virtualization capabilities and high-performing hardware infrastructure. Relying on our hands-on experience, this deployment guide offers a comprehensive roadmap that can guide your organization through the seamless integration of advanced VMware cloud solutions with the performance and reliability of Dell PowerEdge servers. In addition to the deployment efficiency, the Cloud Foundation 5.1 and PowerEdge solution delivered strong performance while running a MySQL database workload. By leveraging VMware Cloud Foundation 5.1 and PowerEdge servers, you could help your organization embrace cloud computing with confidence, potentially unlocking a new level of agility, scalability, and efficiency in your data center operations.

Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...

Principled Technologies

Tata AIG General Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

Created by Mozilla Research in 2012 and now part of Linux Foundation Europe, the Servo project is an experimental rendering engine written in Rust. It combines memory safety and concurrency to create an independent, modular, and embeddable rendering engine that adheres to web standards. Stewardship of Servo moved from Mozilla Research to the Linux Foundation in 2020, where its mission remains unchanged. After some slow years, in 2023 there has been renewed activity on the project, with a roadmap now focused on improving the engine’s CSS 2 conformance, exploring Android support, and making Servo a practical embeddable rendering engine. In this presentation, Rakhi Sharma reviews the status of the project, our recent developments in 2023, our collaboration with Tauri to make Servo an easy-to-use embeddable rendering engine, and our plans for the future to make Servo an alternative web rendering engine for the embedded devices industry. (c) Embedded Open Source Summit 2024 April 16-18, 2024 Seattle, Washington (US) https://events.linuxfoundation.org/embedded-open-source-summit/ https://ossna2024.sched.com/event/1aBNF/a-year-of-servo-reboot-where-are-we-now-rakhi-sharma-igalia

A Year of the Servo Reboot: Where Are We Now?

Igalia

The presentation explores the development and application of artificial intelligence (AI) from its inception to its current status in the modern world. The term "artificial intelligence" was first coined by John McCarthy in 1956 to describe efforts to develop computer programs capable of performing tasks that typically require human intelligence. This concept was first introduced at a conference held at Dartmouth College, where programs demonstrated capabilities such as playing chess, proving theorems, and interpreting texts. In the early stages, Alan Turing contributed to the field by defining intelligence as the ability of a being to respond to certain questions intelligently, proposing what is now known as the Turing Test to evaluate the presence of intelligent behavior in machines. As the decades progressed, AI evolved significantly. The 1980s focused on machine learning, teaching computers to learn from data, leading to the development of models that could improve their performance based on their experiences. The 1990s and 2000s saw further advances in algorithms and computational power, which allowed for more sophisticated data analysis techniques, including data mining. By the 2010s, the proliferation of big data and the refinement of deep learning techniques enabled AI to become mainstream. Notable milestones included the success of Google's AlphaGo and advancements in autonomous vehicles by companies like Tesla and Waymo. A major theme of the presentation is the application of generative AI, which has been used for tasks such as natural language text generation, translation, and question answering. Generative AI uses large datasets to train models that can then produce new, coherent pieces of text or other media. The presentation also discusses the ethical implications and the need for regulation in AI, highlighting issues such as privacy, bias, and the potential for misuse. These concerns have prompted calls for comprehensive regulations to ensure the safe and equitable use of AI technologies. Artificial intelligence has also played a significant role in healthcare, particularly highlighted during the COVID-19 pandemic, where it was used in drug discovery, vaccine development, and analyzing the spread of the virus. The capabilities of AI in healthcare are vast, ranging from medical diagnostics to personalized medicine, demonstrating the technology's potential to revolutionize fields beyond just technical or consumer applications. In conclusion, AI continues to be a rapidly evolving field with significant implications for various aspects of society. The development from theoretical concepts to real-world applications illustrates both the potential benefits and the challenges that come with integrating advanced technologies into everyday life. The ongoing discussion about AI ethics and regulation underscores the importance of managing these technologies responsibly to maximize their their benefits while minimizing potential harms.

Artificial Intelligence: Facts and Myths

Joaquim Jorge

The 7 Things I Know About Cyber Security After 25 Years | April 2024

Rafal Los

Partners Life - Insurer Innovation Award 2024

The Digital Insurer

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

Join our latest Connector Corner webinar to discover how UiPath Integration Service revolutionizes API-centric automation in a 'Quote to Cash' process—and how that automation empowers businesses to accelerate revenue generation. A comprehensive demo will explore connecting systems, GenAI, and people, through powerful pre-built connectors designed to speed process cycle times. Speakers: James Dickson, Senior Software Engineer Charlie Greenberg, Host, Product Marketing Manager

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

DianaGray10

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Edi Saputra

🐬 The future of MySQL is Postgres 🐘

RTylerCroy

Data Cloud, More than a CDP by Matt Robison

Anna Loughnan Colquhoun

Automating Google Workspace (GWS) & more with Apps Script

wesley chun

MySQL Webinar, presented on the 25th of April, 2024. Summary: MySQL solutions enable the deployment of diverse Database Architectures tailored to specific needs, including High Availability, Disaster Recovery, and Read Scale-Out. With MySQL Shell's AdminAPI, administrators can seamlessly set up, manage, and monitor these solutions, ensuring efficiency and ease of use in their administration. MySQL Router, on the other hand, provides transparent routing from the application traffic to the backend servers in the architectures, requiring minimal configuration. Completely built in-house and supported by Oracle, these solutions have been adopted by enterprises of all sizes for their business-critical applications. In this presentation, we'll delve into various database architecture solutions to help you choose the right one based on your business requirements. Focusing on technical details and the latest features to maximize the potential of these solutions.

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Miguel Araújo

AWS Community Day CPH - Three problems of Terraform

Andrey Devyatkin

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

sammart93

The value of a flexible API Management solution for Open Banking Steve Melan, Manager for IT Innovation and Architecture - State's and Saving's Bank of Luxembourg Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The value of a flexible API Management solution for O...

apidays

Axa Assurance Maroc - Insurer Innovation Award 2024

The Digital Insurer

Scaling API-first – The story of a global engineering organization

Radu Cotescu

Recently uploaded (20)

HTML Injection Attacks: Impact and Mitigation Strategies

Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...

Tata AIG General Insurance Company - Insurer Innovation Award 2024

A Year of the Servo Reboot: Where Are We Now?

Artificial Intelligence: Facts and Myths

The 7 Things I Know About Cyber Security After 25 Years | April 2024

Partners Life - Insurer Innovation Award 2024

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

🐬 The future of MySQL is Postgres 🐘

Data Cloud, More than a CDP by Matt Robison

Automating Google Workspace (GWS) & more with Apps Script

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

AWS Community Day CPH - Three problems of Terraform

How to Troubleshoot Apps for the Modern Connected Worker

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Apidays New York 2024 - The value of a flexible API Management solution for O...

Axa Assurance Maroc - Insurer Innovation Award 2024

Scaling API-first – The story of a global engineering organization

Event machine

1. Event Machine Ricardo Almeida @almeidaricardo https://github.com/eventmachine/eventmachine

3. PostRank Tools • Mysql, Ruby (API), Rails, Sinatra, Phyton, Java, JRuby, EC2, Nagios, Ganglia, Solr • Eventmachine, RabbitMQ • From XMPP to AMQP • Cassandra, Goliath http://webpulp.tv/post/4184040219/scaling-postrank-using-ruby-and-eventmachine-with-ilya

4. Ilya Grigorik

7. Event Machine • Fast, simple event-processing library for Ruby programs • Event-driven I/O • Reactor pattern

8. Designed to • Extremely high scalability, performance and stability • An API that eliminates the complexities of high- performance threaded network programming

10. Social Core • Escalabilidade • Disponibilidade - Todos requests devem ser respondidos • Consistência

11. Architectures Job Manager GET / POST Queue Server Event Process

12. Tools • Rails 3.1.0.rc6 • Ruby 1.9.2-head • Event-Machine • Thin • Goliath • Mysql (gem mysql2 v 0.3.6) • MongoDB • RabbitMQ (AMQP)

13. EM-Tools • https://github.com/eventmachine/eventmachine/wiki • https://github.com/igrigorik/em-http-request • https://github.com/igrigorik/em-synchrony • https://github.com/postrank-labs/goliath

14. Benchmarks • ApacheBench,Version 2.3 • Autoperf (httperf)

15. Provas!!

16. Sleep Select (1 sec) • Tools: • ApacheBench • Rails 3.1.0.rc6 + Ruby 1.9.2-head + Mysql + webrick https://gist.github.com/1166610

17. Sleep Select (1 sec) • ab -c 10 -n 10 'http://localhost:3000/people/wait' • Time taken for tests: 11.255 seconds https://gist.github.com/1166610

18. Sleep Select (1 sec) • Tools: Assync Rails • ApacheBench • webrick • Rails 3.1.0.rc6 + Ruby 1.9.2-head + Mysql + Thin + EventMachine https://gist.github.com/1166610

19. Sleep Select (1 sec) • ab -c 10 -n 10 'http://localhost:3000/people/wait' • Time taken for tests: 2.371 seconds https://gist.github.com/1166610

20. Goliath • Heartbeat • Assync Upload • Routes • Validations

21. Sleep Select (1 sec) • Tools: • ApacheBench • Rails 3.1.0.rc6 + Thin • Ruby 1.9.2-head + EventMachine + Mysql + Goliath https://gist.github.com/1166462

22. Goliath + ActiveRecord

23. Sleep Select (1 sec) • ab -c 10 -n 10 'http://0.0.0.0:9000/wait?format=json' • Time taken for tests: 2.198 seconds https://gist.github.com/1166610

24. HTTP assinc Req/Resp no MongoDB • Tools: • ApacheBench • Mysql • Ruby 1.9.2-head + EventMachine + Goliath + MongoDB

25. HTTP assinc Req/Resp no MongoDB • ab -c 10 -n 10 'http://0.0.0.0:9000/teste?format=json' • Time taken for tests: 0.209 seconds

26. HTTP assinc Req/Resp no MongoDB • ab -c 50 -n 50 'http://0.0.0.0:9000/teste?format=json' • Time taken for tests: 1.105 seconds

27. EM + RabbitMQ

28. EM + RabbitMQ

29. Domínios • AAPG • Facebook • Anotations • Twitter • Activity (New) • Google+

30. http://www.slideshare.net/hungryblank/distributed-and-concurrent-programming-with-rabbitmq-and-eventmachine-rails-underground-2009

31. http://www.slideshare.net/hungryblank/distributed-and-concurrent-programming-with-rabbitmq-and-eventmachine-rails-underground-2009

32. http://www.slideshare.net/hungryblank/distributed-and-concurrent-programming-with-rabbitmq-and-eventmachine-rails-underground-2009

33. SPDY http://www.igvita.com/2011/04/07/life-beyond-http-11-googles-spdy/

34. Obrigado! Ricardo Almeida @almeidaricardo