Socket Utilization in Node.js
•
0 likes•762 views
This document discusses socket utilization in Node.js and how to improve it. It notes that while Node's HTTP module supports keep-alive, connections are only kept alive if there are pending requests, otherwise each request closes the connection. This can lead to high numbers of TIME_WAIT sockets and potential crashes. It recommends using libraries like request or keep-alive-agent to better manage sockets, and tuning options like maxSockets and idleTimeout. Tests show a keep-alive agent can increase throughput, response time, and transactions per second while avoiding issues from closed connections. Upgrading Node can also improve socket management across multiple hosts.
Report
Share
Report
Share
Download to read offline
Recommended
Container coneu2016 lab
This document outlines an agenda for a lab comparing Docker Swarm mode, Kubernetes, and Apache Mesos for container orchestration. The lab will be run either on HPE infrastructure accessed via OpenVPN or locally using Vagrant and virtual machines. Setup instructions and detailed lab steps are provided at a GitHub link. The goal is to give participants hands-on experience with each orchestrator in less than two hours without becoming an expert.
Added value, Rosie Meek, Offenders and the Third Sector May 2012
The study aimed to explore perceptions of the role and impact of third sector organizations (TSOs) in offender resettlement through interviews with key stakeholders. It found that TSOs were perceived as providing valuable support from custody to community through links to outside resources. Interviewees felt TSO staff were more independent, understanding and able to advocate for offenders compared to probation officers. Volunteers were seen as particularly caring due to their unpaid status. However, TSOs were also perceived as overstretched and inconsistent at times due to limited resources. The discussion examined opportunities and challenges for TSOs in supporting offender resettlement.
Effective Treatment For Criminal Offenders
The document discusses more effective treatment approaches for criminal offenders compared to punitive measures. It notes that crime and punishment alone do not work and that the legislature has begun to acknowledge this. The document also references complications like increased criminality and substance abuse and asks what can be done. In conclusion, it lists references on topics like treatment retention for drug offenders and developing employment services for criminal justice clients in drug treatment programs.
Stage bij Novire | Hoe werkt dat?
In dit document staat beschreven hoe we de stages bij Novire aanpakken en vorm geven
Leaving Prison
Several organizations provide support to individuals leaving prison by helping with issues like housing, employment, education, and social exclusion. They offer services like advocacy, referrals to legal aid, mentoring connections to local churches, and guidance on disclosure of criminal records. Their goals are to help break the cycle of reoffending by providing the social and practical support needed for successful rehabilitation and reintegration into society.
Transforming rehabilitation
The presentation was part of NCVO's skills and information workshops on 7 – 18 October 2013.
The presentation was by NCVO, ACEVO and Candour Collaborations and explores the facts around transforming rehabilitation procurement.
Find out more about NCVO's work on transforming rehabilitation: http://blogs.ncvo.org.uk/2013/01/10/transforming-rehabilitation/
Partnership working, Alice Mills, Offenders and the Third Sector, May 2012
Partnership working, Alice Mills, Offenders and the Third Sector, May 2012Third Sector Research Centre
The document discusses the challenges and benefits of partnerships between criminal justice staff and third sector organizations who provide services in prisons, noting tensions between security/risk agendas versus rehabilitation, but also finding that most staff now recognize the importance of third sector expertise in helping prisoners; it describes how voluntary sector coordinators can help bridge differences and facilitate cooperation between groups.Tackling the multiple and complex needs of short sentenced prisoners
Dominic Williamson from the Revolving Doors Agency gave a presentation about short sentenced prisoners and how to stop the revolving door of reoffending. He discussed that short sentenced prisoners, who serve less than 12 months, make up the majority of prisoners but receive little rehabilitation support. They have high rates of reoffending due to multiple complex needs including homelessness, substance abuse issues, and mental health problems. Effective interventions involve assertive outreach, building trust, coordinating wraparound services, and promoting self-efficacy, hope, and motivation in the individual. Providing long-term, community-based support that addresses an individual's specific needs and goals can help reduce reoffending rates.
Recommended
Container coneu2016 lab
This document outlines an agenda for a lab comparing Docker Swarm mode, Kubernetes, and Apache Mesos for container orchestration. The lab will be run either on HPE infrastructure accessed via OpenVPN or locally using Vagrant and virtual machines. Setup instructions and detailed lab steps are provided at a GitHub link. The goal is to give participants hands-on experience with each orchestrator in less than two hours without becoming an expert.
Added value, Rosie Meek, Offenders and the Third Sector May 2012
The study aimed to explore perceptions of the role and impact of third sector organizations (TSOs) in offender resettlement through interviews with key stakeholders. It found that TSOs were perceived as providing valuable support from custody to community through links to outside resources. Interviewees felt TSO staff were more independent, understanding and able to advocate for offenders compared to probation officers. Volunteers were seen as particularly caring due to their unpaid status. However, TSOs were also perceived as overstretched and inconsistent at times due to limited resources. The discussion examined opportunities and challenges for TSOs in supporting offender resettlement.
Effective Treatment For Criminal Offenders
The document discusses more effective treatment approaches for criminal offenders compared to punitive measures. It notes that crime and punishment alone do not work and that the legislature has begun to acknowledge this. The document also references complications like increased criminality and substance abuse and asks what can be done. In conclusion, it lists references on topics like treatment retention for drug offenders and developing employment services for criminal justice clients in drug treatment programs.
Stage bij Novire | Hoe werkt dat?
In dit document staat beschreven hoe we de stages bij Novire aanpakken en vorm geven
Leaving Prison
Several organizations provide support to individuals leaving prison by helping with issues like housing, employment, education, and social exclusion. They offer services like advocacy, referrals to legal aid, mentoring connections to local churches, and guidance on disclosure of criminal records. Their goals are to help break the cycle of reoffending by providing the social and practical support needed for successful rehabilitation and reintegration into society.
Transforming rehabilitation
The presentation was part of NCVO's skills and information workshops on 7 – 18 October 2013.
The presentation was by NCVO, ACEVO and Candour Collaborations and explores the facts around transforming rehabilitation procurement.
Find out more about NCVO's work on transforming rehabilitation: http://blogs.ncvo.org.uk/2013/01/10/transforming-rehabilitation/
Partnership working, Alice Mills, Offenders and the Third Sector, May 2012
Partnership working, Alice Mills, Offenders and the Third Sector, May 2012Third Sector Research Centre
The document discusses the challenges and benefits of partnerships between criminal justice staff and third sector organizations who provide services in prisons, noting tensions between security/risk agendas versus rehabilitation, but also finding that most staff now recognize the importance of third sector expertise in helping prisoners; it describes how voluntary sector coordinators can help bridge differences and facilitate cooperation between groups.Tackling the multiple and complex needs of short sentenced prisoners
Dominic Williamson from the Revolving Doors Agency gave a presentation about short sentenced prisoners and how to stop the revolving door of reoffending. He discussed that short sentenced prisoners, who serve less than 12 months, make up the majority of prisoners but receive little rehabilitation support. They have high rates of reoffending due to multiple complex needs including homelessness, substance abuse issues, and mental health problems. Effective interventions involve assertive outreach, building trust, coordinating wraparound services, and promoting self-efficacy, hope, and motivation in the individual. Providing long-term, community-based support that addresses an individual's specific needs and goals can help reduce reoffending rates.
Introduction to gRPC (Application) Presentation
In gRPC, a client application can directly call a method on a server application on a different machine as if it were a local object, making it easier for you to create distributed applications and services. As in many RPC systems, gRPC is based on the idea of defining a service, specifying the methods that can be called remotely with their parameters and return types. On the server side, the server implements this interface and runs a gRPC server to handle client calls. On the client side, the client has a stub (referred to as just a client in some languages) that provides the same methods as the server.
Introduction to gRPC Presentation (Java)
gRPC, which stands for Remote Procedure Call, is an open-source framework developed by Google. It is designed for building efficient and scalable distributed systems. gRPC enables communication between client and server applications by defining a set of services and message types using Protocol Buffers (protobuf) as the interface definition language. gRPC provides a way for applications to call methods on a remote server as if they were local procedures, making it a powerful tool for building distributed and microservices-based architectures.
Counting image views using redis cluster
Streaming Logs and Processing View Counts using Redis Cluster
Seandon Mooy
(Imgur)
When you browse through Imgur, you notice that each user's post includes the number of views for that particular post. Imgur processes over 3 billion views per month and powers our view count feature using Redis. In this talk, we cover our current architecture for streaming logs and processing view counts using Redis Cluster, as well as some of the alternatives we explored and why we chose Redis.
Low latency for high throughput
Unless you have a problem which scales to many independent tasks easily e.g. web services, you may find that the best way to improve throughput is by reducing latency. This talk starts with Little's Law and it's consequences for high performance computing.
Storm Real Time Computation
Storm is a distributed real-time computation framework created by Nathan Marz at BackType/Twitter to analyze tweets, links, and users on Twitter in real-time. It provides scalability, fault tolerance, and guarantees of data processing. Storm addresses problems with Hadoop like lack of real-time processing, long latency, and tedious coding through its stream processing capabilities and by being stateless. It has features like scalability, fault tolerance through Zookeeper, and guarantees of at least once processing.
Introduction to ZooKeeper - TriHUG May 22, 2012
Presentation given at TriHUG (Triangle Hadoop User Group) on May 22, 2012. Gives a basic overview of Apache ZooKeeper as well as some common use cases, 3rd party libraries, and "gotchas"
Demo code available at https://github.com/mumrah/trihug-zookeeper-demo
Automating the Hunt for Non-Obvious Sources of Latency Spreads
False sharing references and power management can trigger wide latency spreads, but are neither directly observable nor easily traced to causes. This talk describes how to diagnose the problems quickly, and outlines several remedies.
Deterministic behaviour and performance in trading systems
Peter Lawrey gave a presentation on deterministic behavior and performance in trading. Some key points:
- Using lambda functions and state machines can help make systems more deterministic and easy to reason about.
- Recording all inputs and outputs allows systems to be replayed and upgraded deterministically. This supports testing.
- Little's Law relates throughput, latency, and number of workers. For trading systems, reducing latency increases throughput.
- Avoiding "coordinated omission" is important for accurate latency testing.
- In Java 8, escape analysis and inlining can avoid object creation with lambdas, improving performance.
- Systems using Chronicle Queue can achieve low 25 microsecond latency while ensuring data is
gen_udp and gen_tcp in Elixir
* gen_udp and gen_tcp
* managing pool of sockets using dynamic supervisors
* pattern matching on binary data
* sending chunks of data over the socket
2012 07 making disqus realtime@euro python
1) DISQUS implemented a real-time component to increase user engagement by getting new data to users quickly.
2) The architecture uses Redis for pub/sub messaging between frontend Flask servers using Gunicorn and gevent, and backend Python services that format and publish messages.
3) Testing was important to ensure the real-time system could handle DISQUS's large traffic, and metrics were used to measure and optimize performance.
(WEB401) Optimizing Your Web Server on AWS | AWS re:Invent 2014
Tuning your EC2 web server will help you to improve application server throughput and cost-efficiency as well as reduce request latency. In this session we will walk through tactics to identify bottlenecks using tools such as CloudWatch in order to drive the appropriate allocation of EC2 and EBS resources. In addition, we will also be reviewing some performance optimizations and best practices for popular web servers such as Nginx and Apache in order to take advantage of the latest EC2 capabilities.
VISUG - Approaches for application request throttling
Speaking from experience building a SaaS: users are insane. If you are lucky, they use your service, but in reality, they probably abuse. Crazy usage patterns resulting in more requests than expected, request bursts when users come back to the office after the weekend, and more! These all pose a potential threat to the health of our web application and may impact other users or the service as a whole. Ideally, we can apply some filtering at the front door: limit the number of requests over a given timespan, limiting bandwidth, ...
In this talk, we’ll explore the simple yet complex realm of rate limiting. We’ll go over how to decide on which resources to limit, what the limits should be and where to enforce these limits – in our app, on the server, using a reverse proxy like Nginx or even an external service like CloudFlare or Azure API management. The takeaway? Know when and where to enforce rate limits so you can have both a happy application as well as happy customers.
Low level java programming
How is OpenHFT used? (real world use cases)
Where to start with low latency?
What simple things can you do about it, when you know you have a problem?
QCon NY 2014 - Evolving REST for an IoT World
This document discusses evolving Representational State Transfer (REST) protocols for Internet of Things (IoT) applications. It outlines common REST and IoT communication patterns like request/response and publish/subscribe. It also reviews existing protocols like HTTP, MQTT, CoAP and newer ones like HTTP/2, WebSocket that aim to efficiently support asynchronous request/response for IoT. The document suggests possible approaches like combining WebSocket with MQTT or CoAP to sustain REST principles while meeting IoT requirements like lightweight protocols and efficient handling of data.
Apache Kafka Reliability Guarantees StrataHadoop NYC 2015
Kafka provides reliability guarantees through replication and configuration settings. It replicates data across multiple brokers to protect against failures. Producers can ensure data reaches the brokers through configuration of request.required.acks. Consumers can commit offsets to prevent data loss. Monitoring is also important to detect any potential data loss between producers and consumers.
Kafka Reliability - When it absolutely, positively has to be there
Kafka provides reliability guarantees through replication and configuration settings. It replicates data across multiple brokers to protect against failures. Producers can ensure data is committed to all in-sync replicas through configuration settings like request.required.acks. Consumers maintain offsets and can commit after processing to prevent data loss. Monitoring is also important to detect any potential issues or data loss in the Kafka system.
uWSGI - Swiss army knife for your Python web apps
uWSGI is a full-stack tool for building hosting services that acts as an application server for Python web apps using the WSGI specification. It provides a pluggable architecture, versatility, high performance, low resource usage, and reliability. Configuration options are extensive and allow for processes, threads, reloading, monitoring and more. Proper configuration and testing is required to optimize performance for production deployments.
Quick QUIC Technical Update (2017)
This document summarizes a presentation about the QUIC protocol. It begins with an overview of QUIC and its goals of eliminating overhead from the strict layering of TCP, TLS, and HTTP. It then discusses problems with the traditional protocols like multiple roundtrips needed for HTTP requests, TCP handshake overhead, and inefficient usage of bandwidth. QUIC aims to address these by being UDP-based and combining connection establishment and encryption with sending and receiving data in one roundtrip or less. The presentation also covers how prior protocols like SPDY and HTTP/2 improved performance but were still bottlenecked by relying on TCP. It concludes with an explanation of bufferbloat and how excessive buffering in network nodes can increase latency and jitter.
Apache Kafka – (Pattern and) Anti-Pattern
Speaker: Damien Gasparina, Engineer, Confluent
Here's how to fail at Apache Kafka brilliantly!
https://www.meetup.com/Paris-Data-Engineers/events/260694777/
Approaches to application request throttling
Speaking from experience building MyGet.org: users are insane. If you are lucky, they use your service, but in reality, they probably abuse. Crazy usage patterns resulting in more requests than expected, request bursts when users come back to the office after the weekend, and more! These all pose a potential threat to the health of our web application and may impact other users or the service as a whole. Ideally, we can apply some filtering at the front door: limit the number of requests over a given timespan, limiting bandwidth, ...
In this talk, we’ll explore the simple yet complex realm of rate limiting. We’ll go over how to decide on which resources to limit, what the limits should be and where to enforce these limits – in our app, on the server, using a reverse proxy like Nginx or even an external service like CloudFlare or Azure API management. The takeaway? Know when and where to enforce rate limits so you can have both a happy application as well as happy customers.
QCon London 2020: Streaming a million likes/second Real-time interactions on...
This document discusses building real-time systems to support large scale live video streaming and interactions. It describes using technologies like EventSource interfaces, Akka actors and distributed systems to handle millions of concurrent users, connections and real-time events. Key challenges discussed include scaling the delivery pipeline, managing multiple connections and live videos, and supporting high throughput of events like 10,000 concurrent viewers and 100 likes per second.
QCon SF 2022: The Secret to Finding Impactful Projects to Land a Staff-Plus E...
https://qconsf.com/presentation/oct2022/secret-finding-impactful-projects-land-staff-plus-engineer-role
So, you want to be a Staff-Plus Engineer at your organization. Are you one of a hundred engineers vying for that big new shiny project to get you there?
Let me tell you a little secret: Listen to what your peers and managers are complaining about. Are they drowned in production issues on an old unreliable system that no one wants to touch? Are they stuck waiting for approvals from design committees? Are they struggling to make large-scale interactive applications work across data centers? Or is the business losing money on over-provisioned hardware in the cloud?
These tedious unattractive problems could be your biggest opportunities to solve hard technical issues while having a massive impact on your entire organization.
In this talk, we will use some real-world examples to unpack how to recognize such problems, broaden your scope, and embrace the soft skills needed to tackle them at scale to land a Staff-Plus Engineer role.
More Related Content
Similar to Socket Utilization in Node.js
Introduction to gRPC (Application) Presentation
In gRPC, a client application can directly call a method on a server application on a different machine as if it were a local object, making it easier for you to create distributed applications and services. As in many RPC systems, gRPC is based on the idea of defining a service, specifying the methods that can be called remotely with their parameters and return types. On the server side, the server implements this interface and runs a gRPC server to handle client calls. On the client side, the client has a stub (referred to as just a client in some languages) that provides the same methods as the server.
Introduction to gRPC Presentation (Java)
gRPC, which stands for Remote Procedure Call, is an open-source framework developed by Google. It is designed for building efficient and scalable distributed systems. gRPC enables communication between client and server applications by defining a set of services and message types using Protocol Buffers (protobuf) as the interface definition language. gRPC provides a way for applications to call methods on a remote server as if they were local procedures, making it a powerful tool for building distributed and microservices-based architectures.
Counting image views using redis cluster
Streaming Logs and Processing View Counts using Redis Cluster
Seandon Mooy
(Imgur)
When you browse through Imgur, you notice that each user's post includes the number of views for that particular post. Imgur processes over 3 billion views per month and powers our view count feature using Redis. In this talk, we cover our current architecture for streaming logs and processing view counts using Redis Cluster, as well as some of the alternatives we explored and why we chose Redis.
Low latency for high throughput
Unless you have a problem which scales to many independent tasks easily e.g. web services, you may find that the best way to improve throughput is by reducing latency. This talk starts with Little's Law and it's consequences for high performance computing.
Storm Real Time Computation
Storm is a distributed real-time computation framework created by Nathan Marz at BackType/Twitter to analyze tweets, links, and users on Twitter in real-time. It provides scalability, fault tolerance, and guarantees of data processing. Storm addresses problems with Hadoop like lack of real-time processing, long latency, and tedious coding through its stream processing capabilities and by being stateless. It has features like scalability, fault tolerance through Zookeeper, and guarantees of at least once processing.
Introduction to ZooKeeper - TriHUG May 22, 2012
Presentation given at TriHUG (Triangle Hadoop User Group) on May 22, 2012. Gives a basic overview of Apache ZooKeeper as well as some common use cases, 3rd party libraries, and "gotchas"
Demo code available at https://github.com/mumrah/trihug-zookeeper-demo
Automating the Hunt for Non-Obvious Sources of Latency Spreads
False sharing references and power management can trigger wide latency spreads, but are neither directly observable nor easily traced to causes. This talk describes how to diagnose the problems quickly, and outlines several remedies.
Deterministic behaviour and performance in trading systems
Peter Lawrey gave a presentation on deterministic behavior and performance in trading. Some key points:
- Using lambda functions and state machines can help make systems more deterministic and easy to reason about.
- Recording all inputs and outputs allows systems to be replayed and upgraded deterministically. This supports testing.
- Little's Law relates throughput, latency, and number of workers. For trading systems, reducing latency increases throughput.
- Avoiding "coordinated omission" is important for accurate latency testing.
- In Java 8, escape analysis and inlining can avoid object creation with lambdas, improving performance.
- Systems using Chronicle Queue can achieve low 25 microsecond latency while ensuring data is
gen_udp and gen_tcp in Elixir
* gen_udp and gen_tcp
* managing pool of sockets using dynamic supervisors
* pattern matching on binary data
* sending chunks of data over the socket
2012 07 making disqus realtime@euro python
1) DISQUS implemented a real-time component to increase user engagement by getting new data to users quickly.
2) The architecture uses Redis for pub/sub messaging between frontend Flask servers using Gunicorn and gevent, and backend Python services that format and publish messages.
3) Testing was important to ensure the real-time system could handle DISQUS's large traffic, and metrics were used to measure and optimize performance.
(WEB401) Optimizing Your Web Server on AWS | AWS re:Invent 2014
Tuning your EC2 web server will help you to improve application server throughput and cost-efficiency as well as reduce request latency. In this session we will walk through tactics to identify bottlenecks using tools such as CloudWatch in order to drive the appropriate allocation of EC2 and EBS resources. In addition, we will also be reviewing some performance optimizations and best practices for popular web servers such as Nginx and Apache in order to take advantage of the latest EC2 capabilities.
VISUG - Approaches for application request throttling
Speaking from experience building a SaaS: users are insane. If you are lucky, they use your service, but in reality, they probably abuse. Crazy usage patterns resulting in more requests than expected, request bursts when users come back to the office after the weekend, and more! These all pose a potential threat to the health of our web application and may impact other users or the service as a whole. Ideally, we can apply some filtering at the front door: limit the number of requests over a given timespan, limiting bandwidth, ...
In this talk, we’ll explore the simple yet complex realm of rate limiting. We’ll go over how to decide on which resources to limit, what the limits should be and where to enforce these limits – in our app, on the server, using a reverse proxy like Nginx or even an external service like CloudFlare or Azure API management. The takeaway? Know when and where to enforce rate limits so you can have both a happy application as well as happy customers.
Low level java programming
How is OpenHFT used? (real world use cases)
Where to start with low latency?
What simple things can you do about it, when you know you have a problem?
QCon NY 2014 - Evolving REST for an IoT World
This document discusses evolving Representational State Transfer (REST) protocols for Internet of Things (IoT) applications. It outlines common REST and IoT communication patterns like request/response and publish/subscribe. It also reviews existing protocols like HTTP, MQTT, CoAP and newer ones like HTTP/2, WebSocket that aim to efficiently support asynchronous request/response for IoT. The document suggests possible approaches like combining WebSocket with MQTT or CoAP to sustain REST principles while meeting IoT requirements like lightweight protocols and efficient handling of data.
Apache Kafka Reliability Guarantees StrataHadoop NYC 2015
Kafka provides reliability guarantees through replication and configuration settings. It replicates data across multiple brokers to protect against failures. Producers can ensure data reaches the brokers through configuration of request.required.acks. Consumers can commit offsets to prevent data loss. Monitoring is also important to detect any potential data loss between producers and consumers.
Kafka Reliability - When it absolutely, positively has to be there
Kafka provides reliability guarantees through replication and configuration settings. It replicates data across multiple brokers to protect against failures. Producers can ensure data is committed to all in-sync replicas through configuration settings like request.required.acks. Consumers maintain offsets and can commit after processing to prevent data loss. Monitoring is also important to detect any potential issues or data loss in the Kafka system.
uWSGI - Swiss army knife for your Python web apps
uWSGI is a full-stack tool for building hosting services that acts as an application server for Python web apps using the WSGI specification. It provides a pluggable architecture, versatility, high performance, low resource usage, and reliability. Configuration options are extensive and allow for processes, threads, reloading, monitoring and more. Proper configuration and testing is required to optimize performance for production deployments.
Quick QUIC Technical Update (2017)
This document summarizes a presentation about the QUIC protocol. It begins with an overview of QUIC and its goals of eliminating overhead from the strict layering of TCP, TLS, and HTTP. It then discusses problems with the traditional protocols like multiple roundtrips needed for HTTP requests, TCP handshake overhead, and inefficient usage of bandwidth. QUIC aims to address these by being UDP-based and combining connection establishment and encryption with sending and receiving data in one roundtrip or less. The presentation also covers how prior protocols like SPDY and HTTP/2 improved performance but were still bottlenecked by relying on TCP. It concludes with an explanation of bufferbloat and how excessive buffering in network nodes can increase latency and jitter.
Apache Kafka – (Pattern and) Anti-Pattern
Speaker: Damien Gasparina, Engineer, Confluent
Here's how to fail at Apache Kafka brilliantly!
https://www.meetup.com/Paris-Data-Engineers/events/260694777/
Approaches to application request throttling
Speaking from experience building MyGet.org: users are insane. If you are lucky, they use your service, but in reality, they probably abuse. Crazy usage patterns resulting in more requests than expected, request bursts when users come back to the office after the weekend, and more! These all pose a potential threat to the health of our web application and may impact other users or the service as a whole. Ideally, we can apply some filtering at the front door: limit the number of requests over a given timespan, limiting bandwidth, ...
In this talk, we’ll explore the simple yet complex realm of rate limiting. We’ll go over how to decide on which resources to limit, what the limits should be and where to enforce these limits – in our app, on the server, using a reverse proxy like Nginx or even an external service like CloudFlare or Azure API management. The takeaway? Know when and where to enforce rate limits so you can have both a happy application as well as happy customers.
Similar to Socket Utilization in Node.js (20)
Automating the Hunt for Non-Obvious Sources of Latency Spreads
Automating the Hunt for Non-Obvious Sources of Latency Spreads
Deterministic behaviour and performance in trading systems
Deterministic behaviour and performance in trading systems
(WEB401) Optimizing Your Web Server on AWS | AWS re:Invent 2014
(WEB401) Optimizing Your Web Server on AWS | AWS re:Invent 2014
VISUG - Approaches for application request throttling
VISUG - Approaches for application request throttling
Apache Kafka Reliability Guarantees StrataHadoop NYC 2015
Apache Kafka Reliability Guarantees StrataHadoop NYC 2015
Kafka Reliability - When it absolutely, positively has to be there
Kafka Reliability - When it absolutely, positively has to be there
More from Akhilesh Gupta
QCon London 2020: Streaming a million likes/second Real-time interactions on...
This document discusses building real-time systems to support large scale live video streaming and interactions. It describes using technologies like EventSource interfaces, Akka actors and distributed systems to handle millions of concurrent users, connections and real-time events. Key challenges discussed include scaling the delivery pipeline, managing multiple connections and live videos, and supporting high throughput of events like 10,000 concurrent viewers and 100 likes per second.
QCon SF 2022: The Secret to Finding Impactful Projects to Land a Staff-Plus E...
https://qconsf.com/presentation/oct2022/secret-finding-impactful-projects-land-staff-plus-engineer-role
So, you want to be a Staff-Plus Engineer at your organization. Are you one of a hundred engineers vying for that big new shiny project to get you there?
Let me tell you a little secret: Listen to what your peers and managers are complaining about. Are they drowned in production issues on an old unreliable system that no one wants to touch? Are they stuck waiting for approvals from design committees? Are they struggling to make large-scale interactive applications work across data centers? Or is the business losing money on over-provisioned hardware in the cloud?
These tedious unattractive problems could be your biggest opportunities to solve hard technical issues while having a massive impact on your entire organization.
In this talk, we will use some real-world examples to unpack how to recognize such problems, broaden your scope, and embrace the soft skills needed to tackle them at scale to land a Staff-Plus Engineer role.
Codemotion 2019: A million likes/second: Real-time interactions on Live Video
Codemotion 2019 Conference Presentation
When someone like Reid Hoffman streams a live video on LinkedIn about a popular topic like startups, tens of thousands of viewers will watch it concurrently. Typically, hundreds of likes on the video will be distributed in real-time to all of these viewers. That amounts to a million likes/second distributed to viewers per live video. How do we make this massive real-time interaction possible across the globe? In this talk, I’ll do a technical deep-dive into how we use the Play/Akka Framework and a scalable distributed system to enable live interactions like likes/comments at massive scale.
Realtime Content Delivery: Powering dynamic instant experiences
Most mobile applications rely on the traditional request-response paradigm for communicating with the server. However, modern apps demand more. Likes and comments stream in as you watch a Periscope video or read a Facebook post. Typing indicators tell you whether your friend is typing a response back to you on iMessage. In this talk, I share best practices, tools and methodologies for pushing realtime content to mobile devices from our experiences while building Realtime Messaging at LinkedIn.
Midwest.io 2014: Lightning fast mobile development at scale
Lightning fast mobile development at scale - Midwest.io 2014, Kansas City
http://www.midwest.io/sessions/#monday-1a
Video: https://www.youtube.com/watch?v=B2ZNDKDQuWE
Mdevcon 2014: Lightning fast mobile development at scale
Lightning fast mobile development at scale - Mobile developers conference 2014, Amsterdam
http://mdevcon.com/posts/2014/01/09/akhilesh-gupta/
More from Akhilesh Gupta (6)
QCon London 2020: Streaming a million likes/second Real-time interactions on...
QCon London 2020: Streaming a million likes/second Real-time interactions on...
QCon SF 2022: The Secret to Finding Impactful Projects to Land a Staff-Plus E...
QCon SF 2022: The Secret to Finding Impactful Projects to Land a Staff-Plus E...
Codemotion 2019: A million likes/second: Real-time interactions on Live Video
Codemotion 2019: A million likes/second: Real-time interactions on Live Video
Realtime Content Delivery: Powering dynamic instant experiences
Realtime Content Delivery: Powering dynamic instant experiences
Midwest.io 2014: Lightning fast mobile development at scale
Midwest.io 2014: Lightning fast mobile development at scale
Mdevcon 2014: Lightning fast mobile development at scale
Mdevcon 2014: Lightning fast mobile development at scale
Recently uploaded
HCL Notes and Domino License Cost Reduction in the World of DLAU
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-and-domino-license-cost-reduction-in-the-world-of-dlau/
The introduction of DLAU and the CCB & CCX licensing model caused quite a stir in the HCL community. As a Notes and Domino customer, you may have faced challenges with unexpected user counts and license costs. You probably have questions on how this new licensing approach works and how to benefit from it. Most importantly, you likely have budget constraints and want to save money where possible. Don’t worry, we can help with all of this!
We’ll show you how to fix common misconfigurations that cause higher-than-expected user counts, and how to identify accounts which you can deactivate to save money. There are also frequent patterns that can cause unnecessary cost, like using a person document instead of a mail-in for shared mailboxes. We’ll provide examples and solutions for those as well. And naturally we’ll explain the new licensing model.
Join HCL Ambassador Marc Thomas in this webinar with a special guest appearance from Franz Walder. It will give you the tools and know-how to stay on top of what is going on with Domino licensing. You will be able lower your cost through an optimized configuration and keep it low going forward.
These topics will be covered
- Reducing license cost by finding and fixing misconfigurations and superfluous accounts
- How do CCB and CCX licenses really work?
- Understanding the DLAU tool and how to best utilize it
- Tips for common problem areas, like team mailboxes, functional/test users, etc
- Practical examples and best practices to implement right away
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...Edge AI and Vision Alliance
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/06/building-and-scaling-ai-applications-with-the-nx-ai-manager-a-presentation-from-network-optix/
Robin van Emden, Senior Director of Data Science at Network Optix, presents the “Building and Scaling AI Applications with the Nx AI Manager,” tutorial at the May 2024 Embedded Vision Summit.
In this presentation, van Emden covers the basics of scaling edge AI solutions using the Nx tool kit. He emphasizes the process of developing AI models and deploying them globally. He also showcases the conversion of AI models and the creation of effective edge AI pipelines, with a focus on pre-processing, model conversion, selecting the appropriate inference engine for the target hardware and post-processing.
van Emden shows how Nx can simplify the developer’s life and facilitate a rapid transition from concept to production-ready applications.He provides valuable insights into developing scalable and efficient edge AI solutions, with a strong focus on practical implementation.AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
Imagine a world where machines not only perform tasks but also learn, adapt, and make decisions. This is the promise of Artificial Intelligence (AI), a technology that's not just enhancing our lives but revolutionizing entire industries.
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays, June 2024 with Maria Copot 20
Project Management Semester Long Project - Acuity
Acuity is an innovative learning app designed to transform the way you engage with knowledge. Powered by AI technology, Acuity takes complex topics and distills them into concise, interactive summaries that are easy to read & understand. Whether you're exploring the depths of quantum mechanics or seeking insight into historical events, Acuity provides the key information you need without the burden of lengthy texts.
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for life science domain, where you retriever information from biomedical knowledge graphs using LLMs to increase the accuracy and performance of generated answers
How to Get CNIC Information System with Paksim Ga.pptx
Pakdata Cf is a groundbreaking system designed to streamline and facilitate access to CNIC information. This innovative platform leverages advanced technology to provide users with efficient and secure access to their CNIC details.
OpenID AuthZEN Interop Read Out - Authorization
During Identiverse 2024 and EIC 2024, members of the OpenID AuthZEN WG got together and demoed their authorization endpoints conforming to the AuthZEN API
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-und-domino-lizenzkostenreduzierung-in-der-welt-von-dlau/
DLAU und die Lizenzen nach dem CCB- und CCX-Modell sind für viele in der HCL-Community seit letztem Jahr ein heißes Thema. Als Notes- oder Domino-Kunde haben Sie vielleicht mit unerwartet hohen Benutzerzahlen und Lizenzgebühren zu kämpfen. Sie fragen sich vielleicht, wie diese neue Art der Lizenzierung funktioniert und welchen Nutzen sie Ihnen bringt. Vor allem wollen Sie sicherlich Ihr Budget einhalten und Kosten sparen, wo immer möglich. Das verstehen wir und wir möchten Ihnen dabei helfen!
Wir erklären Ihnen, wie Sie häufige Konfigurationsprobleme lösen können, die dazu führen können, dass mehr Benutzer gezählt werden als nötig, und wie Sie überflüssige oder ungenutzte Konten identifizieren und entfernen können, um Geld zu sparen. Es gibt auch einige Ansätze, die zu unnötigen Ausgaben führen können, z. B. wenn ein Personendokument anstelle eines Mail-Ins für geteilte Mailboxen verwendet wird. Wir zeigen Ihnen solche Fälle und deren Lösungen. Und natürlich erklären wir Ihnen das neue Lizenzmodell.
Nehmen Sie an diesem Webinar teil, bei dem HCL-Ambassador Marc Thomas und Gastredner Franz Walder Ihnen diese neue Welt näherbringen. Es vermittelt Ihnen die Tools und das Know-how, um den Überblick zu bewahren. Sie werden in der Lage sein, Ihre Kosten durch eine optimierte Domino-Konfiguration zu reduzieren und auch in Zukunft gering zu halten.
Diese Themen werden behandelt
- Reduzierung der Lizenzkosten durch Auffinden und Beheben von Fehlkonfigurationen und überflüssigen Konten
- Wie funktionieren CCB- und CCX-Lizenzen wirklich?
- Verstehen des DLAU-Tools und wie man es am besten nutzt
- Tipps für häufige Problembereiche, wie z. B. Team-Postfächer, Funktions-/Testbenutzer usw.
- Praxisbeispiele und Best Practices zum sofortigen Umsetzen
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Are you ready to revolutionize how you handle data? Join us for a webinar where we’ll bring you up to speed with the latest advancements in Generative AI technology and discover how leveraging FME with tools from giants like Google Gemini, Amazon, and Microsoft OpenAI can supercharge your workflow efficiency.
During the hour, we’ll take you through:
Guest Speaker Segment with Hannah Barrington: Dive into the world of dynamic real estate marketing with Hannah, the Marketing Manager at Workspace Group. Hear firsthand how their team generates engaging descriptions for thousands of office units by integrating diverse data sources—from PDF floorplans to web pages—using FME transformers, like OpenAIVisionConnector and AnthropicVisionConnector. This use case will show you how GenAI can streamline content creation for marketing across the board.
Ollama Use Case: Learn how Scenario Specialist Dmitri Bagh has utilized Ollama within FME to input data, create custom models, and enhance security protocols. This segment will include demos to illustrate the full capabilities of FME in AI-driven processes.
Custom AI Models: Discover how to leverage FME to build personalized AI models using your data. Whether it’s populating a model with local data for added security or integrating public AI tools, find out how FME facilitates a versatile and secure approach to AI.
We’ll wrap up with a live Q&A session where you can engage with our experts on your specific use cases, and learn more about optimizing your data workflows with AI.
This webinar is ideal for professionals seeking to harness the power of AI within their data management systems while ensuring high levels of customization and security. Whether you're a novice or an expert, gain actionable insights and strategies to elevate your data processes. Join us to see how FME and AI can revolutionize how you work with data!
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
ABSTRACT: A prima vista, un mattoncino Lego e la backdoor XZ potrebbero avere in comune il fatto di essere entrambi blocchi di costruzione, o dipendenze di progetti creativi e software. La realtà è che un mattoncino Lego e il caso della backdoor XZ hanno molto di più di tutto ciò in comune.
Partecipate alla presentazione per immergervi in una storia di interoperabilità, standard e formati aperti, per poi discutere del ruolo importante che i contributori hanno in una comunità open source sostenibile.
BIO: Sostenitrice del software libero e dei formati standard e aperti. È stata un membro attivo dei progetti Fedora e openSUSE e ha co-fondato l'Associazione LibreItalia dove è stata coinvolta in diversi eventi, migrazioni e formazione relativi a LibreOffice. In precedenza ha lavorato a migrazioni e corsi di formazione su LibreOffice per diverse amministrazioni pubbliche e privati. Da gennaio 2020 lavora in SUSE come Software Release Engineer per Uyuni e SUSE Manager e quando non segue la sua passione per i computer e per Geeko coltiva la sua curiosità per l'astronomia (da cui deriva il suo nickname deneb_alpha).
Programming Foundation Models with DSPy - Meetup Slides
Prompting language models is hard, while programming language models is easy. In this talk, I will discuss the state-of-the-art framework DSPy for programming foundation models with its powerful optimizers and runtime constraint system.
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean Lotus cyber threat actors represent a sophisticated, persistent, and politically motivated group that poses a significant risk to organizations and individuals in the Southeast Asian region. Their continuous evolution and adaptability underscore the need for robust cybersecurity measures and international cooperation to identify and mitigate the threats posed by such advanced persistent threat groups.
Introduction of Cybersecurity with OSS at Code Europe 2024
I develop the Ruby programming language, RubyGems, and Bundler, which are package managers for Ruby. Today, I will introduce how to enhance the security of your application using open-source software (OSS) examples from Ruby and RubyGems.
The first topic is CVE (Common Vulnerabilities and Exposures). I have published CVEs many times. But what exactly is a CVE? I'll provide a basic understanding of CVEs and explain how to detect and handle vulnerabilities in OSS.
Next, let's discuss package managers. Package managers play a critical role in the OSS ecosystem. I'll explain how to manage library dependencies in your application.
I'll share insights into how the Ruby and RubyGems core team works to keep our ecosystem safe. By the end of this talk, you'll have a better understanding of how to safeguard your code.
Recently uploaded (20)
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
Socket Utilization in Node.js
- 1. SOCKET UTILIZATION IN NODE.JS Akhilesh Gupta @agupta03
- 2. Inefficient use of TCP sockets: Is HTTP keep-alive working?
- 3. Node’s HTTP module supports keep-alive
- 4. But there is a catch!
- 5. TCP Connection kept alive only if PENDING requests in agent queue
- 6. If requests go out one-by-one Connection closed each time
- 7. High QPS/Low Latency High time-wait sockets Eventual node CRASH Houston, we’ve had a problem here!
- 8. NPM Libraries to the rescue!
- 9. mikeal/request : forever module ceejbot/keep-alive-agent TBEDP/agentkeepalive
- 10. TUNING UP YOUR F-35! Monitor time_wait sockets ! “If you can’t measure it, you can’t fix it”
- 11. TUNING UP YOUR F-35! maxSockets ! Concurrent sockets agent can have open/host
- 12. TUNING UP YOUR F-35! idleTimeout ! Time for which connection is unused before it is discarded
- 14. Normal agent: Keep alive agent (30 seconds): Transactions: 60000 hits! Availability: 100.00 %! Elapsed time: 46.53 secs! Data transferred: 14.88 MB! Response time: 0.05 secs! Transaction rate: 1289.49 trans/sec! Throughput: 0.32 MB/sec! Concurrency: 59.81! Successful transactions:60000! Failed transactions: 0! Longest transaction: 0.45! Shortest transaction: 0.00 Transactions: 60000 hits! Availability: 100.00 %! Elapsed time: 29.70 secs! Data transferred: 14.88 MB! Response time: 0.03 secs! Transaction rate: 2020.20 trans/sec! Throughput: 0.50 MB/sec! Concurrency: 59.84! Successful transactions:60000! Failed transactions: 0! Longest transaction: 0.15! Shortest transaction: 0.01
- 15. TUNING UP YOUR F-35! Upgrade to Node 0.5.3+ ! Agent holds sockets for any number of hosts