The real-time web
•Download as ODP, PDF•
1 like•672 views
The document discusses real-time web technologies like webhooks, callbacks, and notifications. It provides examples of how these techniques enable data synchronization between services, chaining of server-to-server event processing, and opportunities for users and developers to modify and extend functionality. It also questions whether HTTP is the best protocol and how servers will handle high loads of event-driven processes.
Report
Share
Report
Share
![[object Object],[object Object],[object Object]](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)
Recommended
GreenButton-201502
The author explains continuous integration to their parents by describing how they automated the provisioning of cloud infrastructure on Amazon Web Services (AWS) using configuration files, source control, and a Jenkins continuous integration system. The Jenkins project checks out configuration files from source control, manipulates them to deploy AWS resources like servers and databases, and allows developers to build test environments by clicking a green button, saving significant time compared to manual deployment.
Beyond Fault Tolerance with Actor Programming
Actor Programming is a software building approach that lets you can go beyond fault tolerance and achieve Resilience, which is the capacity of a system to self-heal and spring back into a fresh shape. First I'll introduce the difference between Reactive Programming and Reactive Systems, and then we'll go over a couple of implementation examples using Scala and Akka.
The coupled GitHub repository with the code is here: https://github.com/ticofab/ActorDemo
OpenWhisk Go/Swift/Binaries Runtime
The document discusses new runtimes in OpenWhisk for supporting Go, Swift, and binary actions. Specifically:
- A new ActionLoop runtime was created to efficiently support Go actions and be more performant than the Docker skeleton runtime.
- The ActionLoop runtime was extended to support generic binaries, scripting languages like Bash and Haskell, and compiling Go and Swift actions from source code.
- Images with the ActionLoop runtime can be used both to execute actions directly and to compile Go and Swift actions offline.
Crash reports pycodeconf
This document provides an overview of Socorro, Mozilla's system for processing Firefox crash reports with Python. It describes the basic architecture, how a crash report moves through the system from collection to processing to storage in databases. It also discusses the scale of Socorro, currently processing over 2.5 million crash reports per day and storing over 110 terabytes of crash data. The document outlines Socorro's implementation including the various components, tools, and techniques used to manage complexity at this large scale.
Microservices: 5 things I wish I'd known - Vincent Kok - Codemotion Amsterdam...
Microservices are hot! A lot of companies are experimenting with this architectural pattern that greatly benefits the software development process. When adopting new patterns we always encounter that moment where we think 'if only I knew this three months ago'. This talk will be a sneak peak into the world of microservices at Atlassian and reveal what we've learned about microservices: how to arrange, configure and build your code efficiently; deployment and testing; and how to operate effectively in this environment. In this talk you will learn how to immediately apply five simple strategies.
2012 07 making disqus realtime@euro python
1) DISQUS implemented a real-time component to increase user engagement by getting new data to users quickly.
2) The architecture uses Redis for pub/sub messaging between frontend Flask servers using Gunicorn and gevent, and backend Python services that format and publish messages.
3) Testing was important to ensure the real-time system could handle DISQUS's large traffic, and metrics were used to measure and optimize performance.
The RED Method: How To Instrument Your Services
Slides from my talk at London Go User Group.
The RED Method defines three key metrics you should measure for every microservice in your architecture; inspired by the USE Method from Brendan Gregg, it gives developers a template for instrumenting their services and building dashboards in a consistent, repeatable fashion.
In this talk we will discuss patterns of application instrumentation, where and when they are applicable, and how they can be implemented with Prometheus. We’ll cover Google’s Four Golden Signals, the RED Method, the USE Method, and Dye Testing. We’ll also discuss why consistency is an important approach for reducing cognitive load. Finally we’ll talk about the limitations of these approaches and what can be done to overcome them.
eZ Publish Asynchronous Content Publishing
A 10 minutes flash talk given at the eZ Systems winter conference 2011 in Nice about the new eZ Publish Asynchronous Content Publishing feature.
Recommended
GreenButton-201502
The author explains continuous integration to their parents by describing how they automated the provisioning of cloud infrastructure on Amazon Web Services (AWS) using configuration files, source control, and a Jenkins continuous integration system. The Jenkins project checks out configuration files from source control, manipulates them to deploy AWS resources like servers and databases, and allows developers to build test environments by clicking a green button, saving significant time compared to manual deployment.
Beyond Fault Tolerance with Actor Programming
Actor Programming is a software building approach that lets you can go beyond fault tolerance and achieve Resilience, which is the capacity of a system to self-heal and spring back into a fresh shape. First I'll introduce the difference between Reactive Programming and Reactive Systems, and then we'll go over a couple of implementation examples using Scala and Akka.
The coupled GitHub repository with the code is here: https://github.com/ticofab/ActorDemo
OpenWhisk Go/Swift/Binaries Runtime
The document discusses new runtimes in OpenWhisk for supporting Go, Swift, and binary actions. Specifically:
- A new ActionLoop runtime was created to efficiently support Go actions and be more performant than the Docker skeleton runtime.
- The ActionLoop runtime was extended to support generic binaries, scripting languages like Bash and Haskell, and compiling Go and Swift actions from source code.
- Images with the ActionLoop runtime can be used both to execute actions directly and to compile Go and Swift actions offline.
Crash reports pycodeconf
This document provides an overview of Socorro, Mozilla's system for processing Firefox crash reports with Python. It describes the basic architecture, how a crash report moves through the system from collection to processing to storage in databases. It also discusses the scale of Socorro, currently processing over 2.5 million crash reports per day and storing over 110 terabytes of crash data. The document outlines Socorro's implementation including the various components, tools, and techniques used to manage complexity at this large scale.
Microservices: 5 things I wish I'd known - Vincent Kok - Codemotion Amsterdam...
Microservices are hot! A lot of companies are experimenting with this architectural pattern that greatly benefits the software development process. When adopting new patterns we always encounter that moment where we think 'if only I knew this three months ago'. This talk will be a sneak peak into the world of microservices at Atlassian and reveal what we've learned about microservices: how to arrange, configure and build your code efficiently; deployment and testing; and how to operate effectively in this environment. In this talk you will learn how to immediately apply five simple strategies.
2012 07 making disqus realtime@euro python
1) DISQUS implemented a real-time component to increase user engagement by getting new data to users quickly.
2) The architecture uses Redis for pub/sub messaging between frontend Flask servers using Gunicorn and gevent, and backend Python services that format and publish messages.
3) Testing was important to ensure the real-time system could handle DISQUS's large traffic, and metrics were used to measure and optimize performance.
The RED Method: How To Instrument Your Services
Slides from my talk at London Go User Group.
The RED Method defines three key metrics you should measure for every microservice in your architecture; inspired by the USE Method from Brendan Gregg, it gives developers a template for instrumenting their services and building dashboards in a consistent, repeatable fashion.
In this talk we will discuss patterns of application instrumentation, where and when they are applicable, and how they can be implemented with Prometheus. We’ll cover Google’s Four Golden Signals, the RED Method, the USE Method, and Dye Testing. We’ll also discuss why consistency is an important approach for reducing cognitive load. Finally we’ll talk about the limitations of these approaches and what can be done to overcome them.
eZ Publish Asynchronous Content Publishing
A 10 minutes flash talk given at the eZ Systems winter conference 2011 in Nice about the new eZ Publish Asynchronous Content Publishing feature.
OpenWhisk Go Runtime
This document discusses developing a Go runtime for Apache OpenWhisk to improve upon the existing DockerSkeleton approach. The key points are:
1) The current DockerSkeleton approach has some limitations like being fragile and having potential race conditions.
2) The new design keeps the Python proxy but uses a Go executable that runs as a Unix command, reading input and writing output on stdin/stdout/stderr.
3) An initial implementation has been done in a GitHub repository replacing DockerSkeleton with a Go server and refactoring to a piped loop. Testing with a Swift executable showed promising performance improvements over DockerSkeleton.
BETTER THAN GOOGLE
I invite you all to try the new EntireWeb.com Search Engine in a few seconds, and let me know if it's really better than Google or not
DevOps Fest 2019. Игорь Фесенко. DevOps: Be good, Get good or Give up
В данной презентации, мы рассмотрим три ключевых момента в культуре DevOps, а именно Continuous Integration, Continuous Delivery и Post-Production фазы, и как методом проб и ошибок менялись наши подходы.
Доклад построен на базе опыта построения и постоянной модернизации приложений для интеграции глобальных экосистем.
Когда есть требования по поводу производительности, безопасности, и высокой доступности распределенного приложения некоторые стандартные подходы могут усложнить нашу жизнь, и я продемонстрирую с какими проблемами нам пришлось столкнуться и какие решения были использованы.
Amazon Aws Presentation Drupal
Amazon Web Services offers several cloud computing services including Mechanical Turk (MTurk), Simple Queue Service (SQS), Simple Storage Service (S3), and Elastic Compute Cloud (EC2). MTurk allows users to submit human intelligence tasks and pay workers to complete them. SQS provides a queue system to communicate between distributed applications. S3 provides storage buckets for files. EC2 offers virtual servers that can be configured and deployed on demand in the cloud.
Monitoring kubernetes with prometheus
Marcus Maxwell discusses his experience helping enterprises adopt DevOps practices including Kubernetes and Prometheus. He notes that initially many had questions about monitoring new applications and infrastructure in Kubernetes. Prometheus addressed these by allowing applications to expose metrics and also supporting pushing metrics. Over time, the Prometheus community has grown significantly, making it easier for developers to adopt with more documentation, success stories, and available dashboards and tools.
Mistral Atlanta design session
This document provides an overview of Mistral, an OpenStack workflow service. It describes Mistral's architecture and capabilities for defining, executing, and monitoring workflows. Workflows in Mistral are graphs of tasks with control and data flow. The current version supports basic task types like SSH and REST calls. Future plans include improving the workflow definition syntax, adding standard OpenStack actions, and developing the Horizon dashboard interface.
So you think JSON is cool?
A 5 minutes rundown on some of the most glaring downsides of microservices/SOA using JSON endpoints instead of proper interfaces.
Moving Quickly with Data Services in the Cloud
How is cloud changing data storage options for development teams at Thomson Reuters? Come hear how projects are changing the way they work with data in the cloud and what role a centralized cloud team can play in helping your business get products to market more quickly without worry about ending up on the front page of the news as the latest data breach. Any storage medium is up for discussion, but we’ll be primarily sticking to relational databases, elastic search, NoSQL and object storage. This will be useful to both teams that are looking to just get started in AWS to teams who already have production workloads in AWS. Although it assumes a basic knowledge of the relational database, elastic search, and NoSQL options in AWS, you will be able to get value if you haven’t used those technologies before.
The RED Method: How To Instrument Your Services
The document describes the RED method for instrumentation and monitoring of services. The RED method involves monitoring the rate, errors, and duration of requests for each service. It can be implemented in Prometheus by instrumenting code to collect metrics on request count, status codes, and response durations. These core metrics provide insight into a service's traffic, errors, and performance. The RED method complements the USE method for resources and the "Four Golden Signals" of latency, traffic, errors, and saturation for monitoring each service.
Stress Testing at Twitter: a tale of New Year Eves
Failure testing is a fundamental piece of Twitter’s reliability engineering. Over the years, we developed a rich toolchain that allows us to detect and fix scalability problems long before they happen. In this talk, we’ll cover some of the strategies we employ and discuss our always evolving approach to API stress testing and its “unit test” equivalent, redline testing.
Software Carpentry - Version control slides
This document provides an overview of version control systems and how they can be used to track changes to code and documents. It discusses how version control allows users to keep track of changes like a lab notebook, roll back to previous versions, back up work, collaborate remotely, resolve conflicts, and work on files from multiple locations. It describes centralized and distributed version control systems as well as remote repositories. It focuses on explaining how to use the distributed version control system Git, including commits, checkouts, branching, merging, and working with remote repositories. It concludes with recommendations around workflows and best practices when using version control in collaborative projects.
Pywps
PyWPS is a Python-based implementation of the OGC Web Processing Service (WPS) standard that allows users to expose processes via WPS. It supports various geospatial libraries and tools like GRASS GIS, GDAL, and R. PyWPS acts as a thin wrapper between these processing backends and the WPS protocol. Users code custom processes that PyWPS makes available via WPS. It has been used in several projects and applications.
CLI utility in ClojureScript running on Node.js
Slides for the talk I gave in Vilnius Clojure meetup about my experience in building Clojure CLI application on Node.js platform
State of the CLI- Kat Marchan
Kat, one of the core developers on the npm CLI, will give an overview of the current state of the CLI, the ongoing work this year, and give a few hints about what you can expect to see in the (near?) future!
Run C++ as serverless with GCP Cloud Functions
Runcy Oommen discusses using Google Cloud Functions with C++. Cloud Functions allows code to be written in Node.js or Python and executed in corresponding runtimes. It can access GCP services and be triggered by events from HTTP, Cloud Storage, Cloud Pub/Sub, and Firebase. The document walks through building a C++ addon for Cloud Functions using V8, binding.gyp, and Node.js to invoke the native code. It describes uploading the files, testing the function, and depicting the overall flow.
Top 23 Things Not to Do in AWS
Mistakes to avoid in AWS include:
1) Leaving AWS credentials in code repositories which allows unauthorized access.
2) Having overly permissive inbound security group rules.
3) Not automating the termination of instances which can incur unnecessary costs.
4) Failing to monitor and optimize resources like CPU credits which can impact performance.
Node withoutservers aws-lambda
Node Without Servers: Event-Driven Computing with AWS Lambda describes AWS Lambda and how it allows running code without servers. Lambda runs code in response to events, scales automatically, and charges only for the compute time used. Code runs in isolated execution environments called functions in response to events from sources like S3, DynamoDB, Kinesis and custom applications. Functions can be triggered from various AWS services and SDKs. Lambda functions are independent, stateless and ephemeral to provide flexibility and auto-scaling.
Hands-off logging for OpenShift in AWS
Your logging stack is running as an app in your OpenShift platform and something goes wrong within the platform itself, how do you make sure you can still access the logs to diagnose the problem? We take you through our journey in running OpenShift on AWS and how we came to a good answer to that question.
TDC2017 | São Paulo - Trilha Containers How we figured out we had a SRE team ...
Trilha Containers How we figured out we had a SRE team at - Traefik: Dynamic container load balancer for containers
Hejfaktura
This document summarizes a painless invoicing solution for small businesses. It uses Django, MySQL, MongoDB, Memcached, RabbitMQ, Celery, Gunicorn, Nginx, and other technologies in a virtual environment deployed on a single 512MB VPS. Invoices are generated with Reportlab PDFLib and cached with johnny-cache. The frontend uses Compass, Blueprint grid, Coffeescript, jQuery and other libraries. Development is done in Vim on a Mac Air using IPython, Python debugger and Git.
NoséSiesa[1]..
El documento discute las diferencias entre el amor verdadero y otras emociones como el nerviosismo, la inseguridad, la coquetería, la casualidad, el deseo, el aburrimiento y la admiración. Explica que el amor surge a través del respeto, la comunicación, la convivencia, la paciencia, el diálogo y el tiempo. El amor solo se realiza cuando se expresa, intenta y vive con la otra persona, lo que llena de ganas de vivir y hace que las personas crezcan espiritualmente.
FLES
The document proposes adopting a Foreign Language Elementary School (FLES) program to expand Spanish instruction at an elementary school. It outlines goals of increasing Spanish instruction time, incorporating Spanish into other subjects like art and music, and improving Spanish literacy. Schedules for 2nd and 5th grades are presented showing how instructional time would be allocated between core academic subjects, Spanish instruction, art, music, and recess under the FLES model.
More Related Content
What's hot
OpenWhisk Go Runtime
This document discusses developing a Go runtime for Apache OpenWhisk to improve upon the existing DockerSkeleton approach. The key points are:
1) The current DockerSkeleton approach has some limitations like being fragile and having potential race conditions.
2) The new design keeps the Python proxy but uses a Go executable that runs as a Unix command, reading input and writing output on stdin/stdout/stderr.
3) An initial implementation has been done in a GitHub repository replacing DockerSkeleton with a Go server and refactoring to a piped loop. Testing with a Swift executable showed promising performance improvements over DockerSkeleton.
BETTER THAN GOOGLE
I invite you all to try the new EntireWeb.com Search Engine in a few seconds, and let me know if it's really better than Google or not
DevOps Fest 2019. Игорь Фесенко. DevOps: Be good, Get good or Give up
В данной презентации, мы рассмотрим три ключевых момента в культуре DevOps, а именно Continuous Integration, Continuous Delivery и Post-Production фазы, и как методом проб и ошибок менялись наши подходы.
Доклад построен на базе опыта построения и постоянной модернизации приложений для интеграции глобальных экосистем.
Когда есть требования по поводу производительности, безопасности, и высокой доступности распределенного приложения некоторые стандартные подходы могут усложнить нашу жизнь, и я продемонстрирую с какими проблемами нам пришлось столкнуться и какие решения были использованы.
Amazon Aws Presentation Drupal
Amazon Web Services offers several cloud computing services including Mechanical Turk (MTurk), Simple Queue Service (SQS), Simple Storage Service (S3), and Elastic Compute Cloud (EC2). MTurk allows users to submit human intelligence tasks and pay workers to complete them. SQS provides a queue system to communicate between distributed applications. S3 provides storage buckets for files. EC2 offers virtual servers that can be configured and deployed on demand in the cloud.
Monitoring kubernetes with prometheus
Marcus Maxwell discusses his experience helping enterprises adopt DevOps practices including Kubernetes and Prometheus. He notes that initially many had questions about monitoring new applications and infrastructure in Kubernetes. Prometheus addressed these by allowing applications to expose metrics and also supporting pushing metrics. Over time, the Prometheus community has grown significantly, making it easier for developers to adopt with more documentation, success stories, and available dashboards and tools.
Mistral Atlanta design session
This document provides an overview of Mistral, an OpenStack workflow service. It describes Mistral's architecture and capabilities for defining, executing, and monitoring workflows. Workflows in Mistral are graphs of tasks with control and data flow. The current version supports basic task types like SSH and REST calls. Future plans include improving the workflow definition syntax, adding standard OpenStack actions, and developing the Horizon dashboard interface.
So you think JSON is cool?
A 5 minutes rundown on some of the most glaring downsides of microservices/SOA using JSON endpoints instead of proper interfaces.
Moving Quickly with Data Services in the Cloud
How is cloud changing data storage options for development teams at Thomson Reuters? Come hear how projects are changing the way they work with data in the cloud and what role a centralized cloud team can play in helping your business get products to market more quickly without worry about ending up on the front page of the news as the latest data breach. Any storage medium is up for discussion, but we’ll be primarily sticking to relational databases, elastic search, NoSQL and object storage. This will be useful to both teams that are looking to just get started in AWS to teams who already have production workloads in AWS. Although it assumes a basic knowledge of the relational database, elastic search, and NoSQL options in AWS, you will be able to get value if you haven’t used those technologies before.
The RED Method: How To Instrument Your Services
The document describes the RED method for instrumentation and monitoring of services. The RED method involves monitoring the rate, errors, and duration of requests for each service. It can be implemented in Prometheus by instrumenting code to collect metrics on request count, status codes, and response durations. These core metrics provide insight into a service's traffic, errors, and performance. The RED method complements the USE method for resources and the "Four Golden Signals" of latency, traffic, errors, and saturation for monitoring each service.
Stress Testing at Twitter: a tale of New Year Eves
Failure testing is a fundamental piece of Twitter’s reliability engineering. Over the years, we developed a rich toolchain that allows us to detect and fix scalability problems long before they happen. In this talk, we’ll cover some of the strategies we employ and discuss our always evolving approach to API stress testing and its “unit test” equivalent, redline testing.
Software Carpentry - Version control slides
This document provides an overview of version control systems and how they can be used to track changes to code and documents. It discusses how version control allows users to keep track of changes like a lab notebook, roll back to previous versions, back up work, collaborate remotely, resolve conflicts, and work on files from multiple locations. It describes centralized and distributed version control systems as well as remote repositories. It focuses on explaining how to use the distributed version control system Git, including commits, checkouts, branching, merging, and working with remote repositories. It concludes with recommendations around workflows and best practices when using version control in collaborative projects.
Pywps
PyWPS is a Python-based implementation of the OGC Web Processing Service (WPS) standard that allows users to expose processes via WPS. It supports various geospatial libraries and tools like GRASS GIS, GDAL, and R. PyWPS acts as a thin wrapper between these processing backends and the WPS protocol. Users code custom processes that PyWPS makes available via WPS. It has been used in several projects and applications.
CLI utility in ClojureScript running on Node.js
Slides for the talk I gave in Vilnius Clojure meetup about my experience in building Clojure CLI application on Node.js platform
State of the CLI- Kat Marchan
Kat, one of the core developers on the npm CLI, will give an overview of the current state of the CLI, the ongoing work this year, and give a few hints about what you can expect to see in the (near?) future!
Run C++ as serverless with GCP Cloud Functions
Runcy Oommen discusses using Google Cloud Functions with C++. Cloud Functions allows code to be written in Node.js or Python and executed in corresponding runtimes. It can access GCP services and be triggered by events from HTTP, Cloud Storage, Cloud Pub/Sub, and Firebase. The document walks through building a C++ addon for Cloud Functions using V8, binding.gyp, and Node.js to invoke the native code. It describes uploading the files, testing the function, and depicting the overall flow.
Top 23 Things Not to Do in AWS
Mistakes to avoid in AWS include:
1) Leaving AWS credentials in code repositories which allows unauthorized access.
2) Having overly permissive inbound security group rules.
3) Not automating the termination of instances which can incur unnecessary costs.
4) Failing to monitor and optimize resources like CPU credits which can impact performance.
Node withoutservers aws-lambda
Node Without Servers: Event-Driven Computing with AWS Lambda describes AWS Lambda and how it allows running code without servers. Lambda runs code in response to events, scales automatically, and charges only for the compute time used. Code runs in isolated execution environments called functions in response to events from sources like S3, DynamoDB, Kinesis and custom applications. Functions can be triggered from various AWS services and SDKs. Lambda functions are independent, stateless and ephemeral to provide flexibility and auto-scaling.
Hands-off logging for OpenShift in AWS
Your logging stack is running as an app in your OpenShift platform and something goes wrong within the platform itself, how do you make sure you can still access the logs to diagnose the problem? We take you through our journey in running OpenShift on AWS and how we came to a good answer to that question.
TDC2017 | São Paulo - Trilha Containers How we figured out we had a SRE team ...
Trilha Containers How we figured out we had a SRE team at - Traefik: Dynamic container load balancer for containers
Hejfaktura
This document summarizes a painless invoicing solution for small businesses. It uses Django, MySQL, MongoDB, Memcached, RabbitMQ, Celery, Gunicorn, Nginx, and other technologies in a virtual environment deployed on a single 512MB VPS. Invoices are generated with Reportlab PDFLib and cached with johnny-cache. The frontend uses Compass, Blueprint grid, Coffeescript, jQuery and other libraries. Development is done in Vim on a Mac Air using IPython, Python debugger and Git.
What's hot (20)
DevOps Fest 2019. Игорь Фесенко. DevOps: Be good, Get good or Give up
DevOps Fest 2019. Игорь Фесенко. DevOps: Be good, Get good or Give up
Stress Testing at Twitter: a tale of New Year Eves
Stress Testing at Twitter: a tale of New Year Eves
TDC2017 | São Paulo - Trilha Containers How we figured out we had a SRE team ...
TDC2017 | São Paulo - Trilha Containers How we figured out we had a SRE team ...
Viewers also liked
NoséSiesa[1]..
El documento discute las diferencias entre el amor verdadero y otras emociones como el nerviosismo, la inseguridad, la coquetería, la casualidad, el deseo, el aburrimiento y la admiración. Explica que el amor surge a través del respeto, la comunicación, la convivencia, la paciencia, el diálogo y el tiempo. El amor solo se realiza cuando se expresa, intenta y vive con la otra persona, lo que llena de ganas de vivir y hace que las personas crezcan espiritualmente.
FLES
The document proposes adopting a Foreign Language Elementary School (FLES) program to expand Spanish instruction at an elementary school. It outlines goals of increasing Spanish instruction time, incorporating Spanish into other subjects like art and music, and improving Spanish literacy. Schedules for 2nd and 5th grades are presented showing how instructional time would be allocated between core academic subjects, Spanish instruction, art, music, and recess under the FLES model.
Concurrency
This document discusses concurrency in Ruby. It begins by explaining that most modern computer architectures use multiple processors or cores, requiring programs to be parallelized to take advantage of this. It then discusses different approaches to concurrency in Ruby including processes, threads, fibers, and actors. It also covers challenges with shared state and different languages that take functional or message-passing approaches to make concurrency easier.
Concurrency
This document discusses concurrency in Ruby and other languages. It covers concepts like processes, threads, fibers, actors, and shared state. For Ruby, it describes how MRI uses green threads due to the GIL, while other implementations like JRuby use native threads. It also discusses approaches to concurrency like message passing in Erlang's actor model, channels in Go, and software transactional memory in Clojure. The challenges of shared state and potential solutions like immutable data and message passing are also covered.
Barcamp Ghent2009
thought experiment about how to find objects in the home quicky using technology (while tidying up and putting the objects in the right place is obviously the correct solution)
Ruby goes to Hollywood
The document discusses concurrency and the actor model in Ruby. It describes several Ruby libraries that implement the actor model, including Rubinius Actors, Revactor, and Celluloid. Celluloid code is provided as an example of how to model a barber shop simulation using actors, with Barber and Shop classes that inherit from Celluloid::Actor. Erlang and Elixir code for similar barber shop simulations using the actor model is also shown for comparison. The document notes advantages of the actor model like avoiding shared mutable state and its decentralized nature, but also potential issues like livelocks and deadlocks. It concludes by questioning if better concurrency primitives could be added to Ruby's standard library.
Oauth
This document summarizes OAuth, an open standard for authorization that allows websites or applications to access user information from another website but limits the scope of information received. The summary covers:
- A brief history of OAuth and its development starting in 2007.
- How OAuth works by having a consumer site request access from a service provider to access limited, read-only resources for a user after the user authorizes access.
- Current implementations of OAuth by companies like Google, AOL, Yahoo and Amazon for their APIs.
- Resources for learning more about OAuth specifications and related data portability standards.
12 Hours To Rate A Rails Application
In some situations, it's useful to be able to evaluate a Rails application quickly.
I talk about how I work to get the most data as possible to get a good picture of whether an application is well-maintained, and will be easy to maintain later.
Ruby goes to hollywood
The document discusses concurrency and the actor model. It notes that as processors are no longer getting significantly faster, programs need to be parallelized to run faster. The actor model is introduced as a way to build concurrent programs where actors communicate asynchronously by message passing and have no shared state, avoiding issues like race conditions. Several Ruby libraries and frameworks for implementing the actor model are described, including Celluloid and Akka. The advantages of the actor model like encapsulation and decentralization are highlighted, though issues like potential for livelocks are also noted.
Creating Killer Blog Content that Builds Your Business Can Be Fast & Easy
Sure, there are plenty of places you can get free or nearly free content. But if you’re using your blog to market yourself and your business, crappy articles and a constant parade of guest posts are going to hurt far more than they help.
This WordCamp Raleigh presentation talked about how to quickly and easily create compelling, quality content that turns prospects into customers and clients.
We’ll cover how to write titles that “had them at hello,” painless ways to write posts that highlight your expertise, and even a few secrets from the copywriting world that get visitors' attention and keep them coming back for more.
3 Deadly Mistakes of Sales Copy
Are you making any mistakes with your sales copy that are turning new clients and customers away? In this short presentation to the Glazer-Kennedy Raleigh Chapter, I tackle three of the most common copywriting mistakes and how to fix them.
how to rate a Rails application
Talk given at Euruko 2010: the talk describes how to quickly evaluate the quality of a Rails codebase. Ruby metrics are explained in detail.
Viewers also liked (13)
Creating Killer Blog Content that Builds Your Business Can Be Fast & Easy
Creating Killer Blog Content that Builds Your Business Can Be Fast & Easy
Similar to The real-time web
Command & [e]Mission Control: Using Command and Event Buses to create a CQRS-...
Command buses allow sending command objects to trigger actions in the domain layer. Event buses publish event objects to notify listeners of actions. This decouples components and improves testability. The Action-Domain-Responder pattern uses command/event buses between an action, domain services, and responder to abstract interactions. Adapters like controllers turn requests into commands while responders assemble responses from events. This approach improves agility by allowing the domain to evolve independently of interfaces.
Real time Web Application with XMPP and Wave
This is the slide of my talk given at Erlang Factory 2010 in San Francisco. It introduces XMPP, Wave and ProcessOne Wave server implementation, to build realtime web collaborative platform.
Woo: Writing a fast web server @ ELS2015
Eitaro Fukamachi presented on writing the fast web server Woo in Common Lisp. He discussed three tactics for achieving speed: using a multithreaded event-driven architecture instead of prefork, developing a fast HTTP parser instead of regular expressions, and using the libev event library. Benchmarks showed Woo was 1.6 times faster than Node.js. The goal was to create the fastest HTTP server in Common Lisp.
Flexible and Real-Time Stream Processing with Apache Flink
This document provides an overview of stream processing with Apache Flink. It discusses the rise of stream processing and how it enables low-latency applications and real-time analysis. It then describes Flink's stream processing capabilities, including pipelining of data, fault tolerance through checkpointing and recovery, and integration with batch processing. The document also summarizes Flink's programming model, state management, and roadmap for further development.
2011 06-30-hadoop-summit v5
Data Freeway is a system developed by Facebook to handle large volumes of data in real-time at scale. It includes components like Scribe for distributed logging, Calligraphus for persisting logs to HDFS, and Puma for real-time analytics on the data. The system is designed to handle over 10GB/second of data reliably with low latency of less than 10 seconds for 99% of data. It provides a simple interface for applications to access real-time data streams through tools like ptail. The system is open source and used at Facebook to power applications like real-time search, spam detection, and metrics analysis.
Scalable Apache for Beginners
The document discusses performance optimization and benchmarking for Apache web servers. It covers measuring performance metrics like requests per second, latency, and scalability. Common bottlenecks like file descriptors, memory usage, and CPU overload are examined. Next generation improvements for platforms like Linux, Solaris, and 64-bit architectures that can boost Apache performance are also reviewed.
You got your browser in my virtual machine
This document provides an overview of WebExtensions, isomorphic applications, and JavaScript frameworks like React. It discusses how WebExtensions allow add-ons to be built for browsers using JavaScript and HTML to monitor user activity, inspect page contents, and add new controls. Isomorphic applications allow the same code to run on both client and server. React uses immutable state and a virtual DOM. Redux uses a single immutable state tree updated via reducers. The FilterBubbler analyzes a user's browsing history using classifiers to visualize their "filter bubble".
Firefox Crash Reporting (@ Open Source Bridge)
Socorro is Mozilla's crash analysis system that collects, processes, and analyzes crash reports from Firefox. It receives over 2,300 crashes per minute and stores over 110 terabytes of crash data across 120 physical servers. Socorro provides various reports and visualizations to help Mozilla engineers analyze crashes and regressions. Upcoming work includes improving search, analytics, querying capabilities, and configuration management to further scale the system.
Flink Streaming Hadoop Summit San Jose
This document provides an overview of Apache Flink, an open-source stream processing framework. It discusses the rise of stream processing and how Flink enables low-latency applications through features like pipelining, operator state, fault tolerance using distributed snapshots, and integration with batch processing. The document also outlines Flink's roadmap, which includes graduating its DataStream API, fully managing windowing and state, and unifying batch and stream processing.
Serverless forwardjs
This document discusses serverless computing and functions as a service. It defines serverless computing as building applications that do not require server management, instead being executed on demand in response to events. It describes how serverless platforms handle tasks like provisioning, maintenance, scaling and billing. Examples of serverless use cases include APIs, backend services, event-driven programming and processing unpredictable traffic. The document then discusses Apache OpenWhisk as an open source serverless platform and how it works.
Serverless computing
This document provides information on serverless computing platforms from Azure, AWS, and Google. It outlines the supported programming languages and runtimes for each platform's functions as well as common event sources that can trigger function execution, such as S3 buckets, queues, and HTTP requests. It also lists serverless database options and notes that serverless computing allows for automatic scaling of resources and reduced management overhead compared to traditional reserved servers.
Python tools for testing web services over HTTP
This document discusses tools for testing web services over HTTP in Python. It introduces HTTPie, a command line tool for making HTTP requests, and Behave, a behavior-driven development tool that uses the Gherkin language to write human-readable test cases. The document provides examples of using HTTPie to debug services and Behave steps to test authentication on a sample API.
WebCamp 2016: PHP.Алексей Петров.PHP at Scale: System Architect Toolbox
WebCamp 2016: PHP.Алексей Петров.PHP at Scale: System Architect Toolbox
Website: http://webcamp.in.ua/devops.html#theme
Facebook: https://www.facebook.com/WebCamp/
VK: https://vk.com/webcamp
Twitter: https://twitter.com/WebCampOdessa
Youtube: http://bit.ly/2bsQ0LO
Stephan Ewen - Experiences running Flink at Very Large Scale
This talk shares experiences from deploying and tuning Flink steam processing applications for very large scale. We share lessons learned from users, contributors, and our own experiments about running demanding streaming jobs at scale. The talk will explain what aspects currently render a job as particularly demanding, show how to configure and tune a large scale Flink job, and outline what the Flink community is working on to make the out-of-the-box for experience as smooth as possible. We will, for example, dive into - analyzing and tuning checkpointing - selecting and configuring state backends - understanding common bottlenecks - understanding and configuring network parameters
Etl is Dead; Long Live Streams
Neha Narkhede talks about the experience at LinkedIn moving from batch-oriented ETL to real-time streams using Apache Kafka and how the design and implementation of Kafka was driven by this goal of acting as a real-time platform for event data. She covers some of the challenges of scaling Kafka to hundreds of billions of events per day at Linkedin, supporting thousands of engineers, etc.
OpenWhisk: Where Did My Servers Go?
This document discusses serverless computing and the OpenWhisk platform. It describes how OpenWhisk allows developers to build event-driven applications without managing servers. OpenWhisk provides a programming model based on actions that are triggered by events to execute code without worrying about scaling. It also offers an open source implementation that can run locally or on IBM Bluemix and supports various use cases like serverless apps, IoT, and chatbots.
Building Event-Based Systems for the Real-Time Web
- Event-based systems use events like data updates to trigger actions in real-time, while batch systems periodically process accumulated data
- Building distributed, event-based systems allows applications to scale horizontally by decomposing them into loosely coupled components that communicate asynchronously through messaging
- The publish-subscribe pattern is well-suited for event-based architectures, with systems like RabbitMQ providing message brokers that route events from publishers to subscriber queues based on topics
OpenFaaS KubeCon Zero to Serverless in 60 seconds anywhere
OpenFaaS KubeCon Zero to Serverless in 60 seconds anywhere. This talk is an update on Serverless Functions Made Simple with OpenFaaS and Kubernetes.
Web technologies lesson 1
The document provides an overview of key web technologies including HTML, CSS, JavaScript, PHP, databases, servers, and browsers. It discusses common technology stacks like LAMP and explains concepts like compiled vs scripting languages. Open source software is also defined and compared to proprietary software.
Behind the scenes of Real-Time Notifications
The document discusses the history and techniques for implementing real-time web applications, including Java Applets, Flash, XMLHttpRequest, Comet, Server-Sent Events, WebSockets, and Socket.io. It covers early techniques like hidden iframes and XHR polling that had flaws like lack of error handling. Long polling techniques like XHR long polling are described as an improvement. Implementation examples using Facebook, Node.js, and a PHP to Node.js integration are provided to illustrate real-world uses.
Similar to The real-time web (20)
Command & [e]Mission Control: Using Command and Event Buses to create a CQRS-...
Command & [e]Mission Control: Using Command and Event Buses to create a CQRS-...
Flexible and Real-Time Stream Processing with Apache Flink
Flexible and Real-Time Stream Processing with Apache Flink
WebCamp 2016: PHP.Алексей Петров.PHP at Scale: System Architect Toolbox
WebCamp 2016: PHP.Алексей Петров.PHP at Scale: System Architect Toolbox
Stephan Ewen - Experiences running Flink at Very Large Scale
Stephan Ewen - Experiences running Flink at Very Large Scale
Building Event-Based Systems for the Real-Time Web
Building Event-Based Systems for the Real-Time Web
OpenFaaS KubeCon Zero to Serverless in 60 seconds anywhere
OpenFaaS KubeCon Zero to Serverless in 60 seconds anywhere
More from ehuard
Euroclojure 2017
This document summarizes a presentation on Clojure data science tools. It discusses basic tooling for data analysis in Clojure, including data structures, Clojure spec for data validation, and libraries for statistics and machine learning. It also provides two examples: analyzing a survey on universal basic income and building a neural network for digit recognition. The presentation outlines plans to continue improving notebooks, adding features to existing libraries, and integrating more Java libraries.
Ruby hollywood nordic
This document discusses actors and concurrency in programming. It introduces the actor model from 1973 which uses actors as the primitive unit of concurrency with no shared mutable state and a partial order of execution. It then discusses different implementations of the actor model in Ruby including Rubinius Actors and Celluloid, as well as other languages like Erlang, Scala, and Clojure. It concludes by questioning if better concurrency primitives could be added to programming language standard libraries.
Ruby hollywood
This document discusses concurrency and the actor model. It introduces actors as a way to handle concurrency without shared state. Various Ruby libraries and frameworks that implement the actor model are presented, including Rubinius Actors, Revactor, Concurrent Ruby, Erlectricity for communicating with Erlang processes, and RubyOnAkka for interacting with Akka actors from Ruby. The document concludes by considering changes to make concurrency easier in Ruby itself, such as controlling shared state through keywords.
Concurrency: Rubies, plural
The document discusses various approaches to concurrency in Ruby including fibers, coroutines, processes, threads, and shared state. It covers topics like cooperative vs preemptive scheduling, context switching performance of different approaches, synchronizing access to shared resources using techniques like semaphores, and how languages like Clojure handle concurrency using software transactional memory. Examples are provided showing implementations of coroutines, processes, and threads in Ruby.
12 hours to rate a rails application
improved version of 12 hours to rate a rails application - modified after feedback from Euruko and ScotRuby.
As presented at Railsconf
Tokyo Cabinet
Tokyo Cabinet is a high-performance embedded database that provides key-value, B-tree, and table data storage. It has APIs for Perl, Java, Lua, and Ruby. Tokyo Cabinet Hash and Btree databases allow fast storage and retrieval of data. Tokyo Tyrant adds network functionality, allowing remote access via its own protocol or HTTP. It also enables features like replication and Lua scripting. Tokyo Dystopia provides full-text search capabilities. Ruby libraries exist to interface with Tokyo Cabinet and Tokyo Tyrant from Ruby applications.
Rails and the internet of things
The internet of thing is hot. This talk describes the trends that led to this phenomenon.
Augmented reality links online content to physical object - i talk about the different ways this can happen.
Then i talk about physical computing: making things talk, using Arduino, mainly.
More from ehuard (7)
Recently uploaded
“I’m still / I’m still / Chaining from the Block”
“An Outlook of the Ongoing and Future Relationship between Blockchain Technologies and Process-aware Information Systems.” Invited talk at the joint workshop on Blockchain for Information Systems (BC4IS) and Blockchain for Trusted Data Sharing (B4TDS), co-located with with the 36th International Conference on Advanced Information Systems Engineering (CAiSE), 3 June 2024, Limassol, Cyprus.
Full-RAG: A modern architecture for hyper-personalization
Mike Del Balso, CEO & Co-Founder at Tecton, presents "Full RAG," a novel approach to AI recommendation systems, aiming to push beyond the limitations of traditional models through a deep integration of contextual insights and real-time data, leveraging the Retrieval-Augmented Generation architecture. This talk will outline Full RAG's potential to significantly enhance personalization, address engineering challenges such as data management and model training, and introduce data enrichment with reranking as a key solution. Attendees will gain crucial insights into the importance of hyperpersonalization in AI, the capabilities of Full RAG for advanced personalization, and strategies for managing complex data integrations for deploying cutting-edge AI solutions.
Building Production Ready Search Pipelines with Spark and Milvus
Spark is the widely used ETL tool for processing, indexing and ingesting data to serving stack for search. Milvus is the production-ready open-source vector database. In this talk we will show how to use Spark to process unstructured data to extract vector representations, and push the vectors to Milvus vector database for search serving.
Pushing the limits of ePRTC: 100ns holdover for 100 days
At WSTS 2024, Alon Stern explored the topic of parametric holdover and explained how recent research findings can be implemented in real-world PNT networks to achieve 100 nanoseconds of accuracy for up to 100 days.
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Are you ready to revolutionize how you handle data? Join us for a webinar where we’ll bring you up to speed with the latest advancements in Generative AI technology and discover how leveraging FME with tools from giants like Google Gemini, Amazon, and Microsoft OpenAI can supercharge your workflow efficiency.
During the hour, we’ll take you through:
Guest Speaker Segment with Hannah Barrington: Dive into the world of dynamic real estate marketing with Hannah, the Marketing Manager at Workspace Group. Hear firsthand how their team generates engaging descriptions for thousands of office units by integrating diverse data sources—from PDF floorplans to web pages—using FME transformers, like OpenAIVisionConnector and AnthropicVisionConnector. This use case will show you how GenAI can streamline content creation for marketing across the board.
Ollama Use Case: Learn how Scenario Specialist Dmitri Bagh has utilized Ollama within FME to input data, create custom models, and enhance security protocols. This segment will include demos to illustrate the full capabilities of FME in AI-driven processes.
Custom AI Models: Discover how to leverage FME to build personalized AI models using your data. Whether it’s populating a model with local data for added security or integrating public AI tools, find out how FME facilitates a versatile and secure approach to AI.
We’ll wrap up with a live Q&A session where you can engage with our experts on your specific use cases, and learn more about optimizing your data workflows with AI.
This webinar is ideal for professionals seeking to harness the power of AI within their data management systems while ensuring high levels of customization and security. Whether you're a novice or an expert, gain actionable insights and strategies to elevate your data processes. Join us to see how FME and AI can revolutionize how you work with data!
Best 20 SEO Techniques To Improve Website Visibility In SERP
Boost your website's visibility with proven SEO techniques! Our latest blog dives into essential strategies to enhance your online presence, increase traffic, and rank higher on search engines. From keyword optimization to quality content creation, learn how to make your site stand out in the crowded digital landscape. Discover actionable tips and expert insights to elevate your SEO game.
Video Streaming: Then, Now, and in the Future
In his public lecture, Christian Timmerer provides insights into the fascinating history of video streaming, starting from its humble beginnings before YouTube to the groundbreaking technologies that now dominate platforms like Netflix and ORF ON. Timmerer also presents provocative contributions of his own that have significantly influenced the industry. He concludes by looking at future challenges and invites the audience to join in a discussion.
20240605 QFM017 Machine Intelligence Reading List May 2024
Everything I found interesting about machines behaving intelligently during May 2024
TrustArc Webinar - 2024 Global Privacy Survey
How does your privacy program stack up against your peers? What challenges are privacy teams tackling and prioritizing in 2024?
In the fifth annual Global Privacy Benchmarks Survey, we asked over 1,800 global privacy professionals and business executives to share their perspectives on the current state of privacy inside and outside of their organizations. This year’s report focused on emerging areas of importance for privacy and compliance professionals, including considerations and implications of Artificial Intelligence (AI) technologies, building brand trust, and different approaches for achieving higher privacy competence scores.
See how organizational priorities and strategic approaches to data security and privacy are evolving around the globe.
This webinar will review:
- The top 10 privacy insights from the fifth annual Global Privacy Benchmarks Survey
- The top challenges for privacy leaders, practitioners, and organizations in 2024
- Key themes to consider in developing and maintaining your privacy program
20240607 QFM018 Elixir Reading List May 2024
Everything I found interesting about the Elixir programming ecosystem in May 2024
Essentials of Automations: The Art of Triggers and Actions in FME
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
Presentation of the OECD Artificial Intelligence Review of Germany
Consult the full report at https://www.oecd.org/digital/oecd-artificial-intelligence-review-of-germany-609808d6-en.htm
UiPath Test Automation using UiPath Test Suite series, part 5
Welcome to UiPath Test Automation using UiPath Test Suite series part 5. In this session, we will cover CI/CD with devops.
Topics covered:
CI/CD with in UiPath
End-to-end overview of CI/CD pipeline with Azure devops
Speaker:
Lyndsey Byblow, Test Suite Sales Engineer @ UiPath, Inc.
Artificial Intelligence for XMLDevelopment
In the rapidly evolving landscape of technologies, XML continues to play a vital role in structuring, storing, and transporting data across diverse systems. The recent advancements in artificial intelligence (AI) present new methodologies for enhancing XML development workflows, introducing efficiency, automation, and intelligent capabilities. This presentation will outline the scope and perspective of utilizing AI in XML development. The potential benefits and the possible pitfalls will be highlighted, providing a balanced view of the subject.
We will explore the capabilities of AI in understanding XML markup languages and autonomously creating structured XML content. Additionally, we will examine the capacity of AI to enrich plain text with appropriate XML markup. Practical examples and methodological guidelines will be provided to elucidate how AI can be effectively prompted to interpret and generate accurate XML markup.
Further emphasis will be placed on the role of AI in developing XSLT, or schemas such as XSD and Schematron. We will address the techniques and strategies adopted to create prompts for generating code, explaining code, or refactoring the code, and the results achieved.
The discussion will extend to how AI can be used to transform XML content. In particular, the focus will be on the use of AI XPath extension functions in XSLT, Schematron, Schematron Quick Fixes, or for XML content refactoring.
The presentation aims to deliver a comprehensive overview of AI usage in XML development, providing attendees with the necessary knowledge to make informed decisions. Whether you’re at the early stages of adopting AI or considering integrating it in advanced XML development, this presentation will cover all levels of expertise.
By highlighting the potential advantages and challenges of integrating AI with XML development tools and languages, the presentation seeks to inspire thoughtful conversation around the future of XML development. We’ll not only delve into the technical aspects of AI-powered XML development but also discuss practical implications and possible future directions.
Programming Foundation Models with DSPy - Meetup Slides
Prompting language models is hard, while programming language models is easy. In this talk, I will discuss the state-of-the-art framework DSPy for programming foundation models with its powerful optimizers and runtime constraint system.
How to Get CNIC Information System with Paksim Ga.pptx
Pakdata Cf is a groundbreaking system designed to streamline and facilitate access to CNIC information. This innovative platform leverages advanced technology to provide users with efficient and secure access to their CNIC details.
Recently uploaded (20)
Full-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalization
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
The real-time web
- 1. The Real-Time web Elise Huard
- 13. http://www.igvita.com/2009/06/29/http-pubsub-webhooks-pubsubhubbub/ http://www.slideshare.net/progrium/using-web-hooks http://www.postbin.org http://watercoolr.nuklei.com/ http://juggernaut.rubyforge.org/ http://www.pachube.com/