Deezer - Consume topics in PHP from nightmare to performance
•
0 likes•17 views
This document discusses using Kafka to consume topics in PHP applications. It begins with some background on Kafka and key concepts. It then provides an example PHP code snippet using the librdkafka library to consume messages from Kafka topics. The document goes on to describe the author's experience optimizing a PHP Kafka consumer from an initial "naive implementation" that achieved 3.2 million messages processed per hour up to a final optimized "client-server" approach that achieved 1.6 billion messages processed per hour through techniques like using forks to process messages in parallel, adjusting librdkafka configuration, killing forks periodically, starting multiple consumers, and using strace to analyze performance.
Report
Share
Report
Share
Download to read offline
Recommended
Perl: Hate it for the Right Reasons
The document describes a project to build a website called PerkyProfiler that retrieves user profile information from different services like GitHub, Flickr, and Twitter by taking URLs as input. It will use Perl and several Perl modules. The project will be built using the Catalyst web framework and Moose/MooseX for object-oriented programming. It describes using Moose roles, custom types, declarative class definitions, and functional programming techniques in Perl. The goal is to generate a unified user profile by combining data from different services for a given URL.
Modern Perl
A brief introduction to modern Perl programming tools that I gave at the OpenTech conference in Spetember 2010.
Adding 1.21 Gigawatts to Applications with RabbitMQ (PHPNW Dec 2014 Meetup)
As your application grows, you soon realise you need to break up your application into smaller chunks that talk to each other. You could just use web services to interact, or you could take a more robust approach and use the message broker RabbitMQ. In this talk, we will take a look at the techniques you can use to vastly enhance inter-application communication, learn about the core concepts of RabbitMQ, cover how you can scale different parts of your application separately, and modernise your development using a message-oriented architecture
Follow the White Rabbit - Message Queues with PHP
An introduction to message queues with PHP. We'll focus on RabbitMQ and how to leverage queuing scenarios in your applications. The talk will cover the main concepts of RabbitMQ server and AMQP protocol and show how to use it in PHP. The RabbitMqBundle for Symfony2 will be presented and we'll see how easy you can start to use message queuing in minutes.
Presented at Symfony User Group Belgium: http://www.meetup.com/Symfony-User-Group-Belgium/events/169953362/
PHP and COM
A discussion of the OLE/COM bridge in PHP 5.
These slides are from 2004.
I\'m hoping that SlideShare preserves the speakers notes; there\'s a good deal of information in there to complement the slide content.
PSGI and Plack from first principles
Keep hearing about Plack and PSGI, and not really sure what they're for, and why they're popular? Maybe you're using Plack at work, and you're still copying-and-pasting `builder` lines in to your code without really knowing what's going on? What's the relationship between Plack, PSGI, and CGI? Plack from first principles works up from how CGI works, the evolution that PSGI represents, and how Plack provides a user-friendly layer on top of that.
Mojo as a_client
Mojo started as an alternative to the aging LWP library for HTTP requests in Perl. It was created by Sebastian Riedel to have a more modern, asynchronous API. Mojo provides an easy to use and full-featured HTTP client and server with support for features like websockets, parallel requests, and more. The library uses a test-driven development approach and strives to have a pragmatic design with reusable components.
Php Server Var
The $_SERVER variable is a superglobal array that contains information about headers, files, and script locations. It contains information about the client and server environment, including elements like the filename of the currently executing script, query strings, headers, and more. Some example elements include $_SERVER['PHP_SELF'] containing the filename of the currently executing script and $_SERVER['QUERY_STRING'] containing the query string used to access the page.
Recommended
Perl: Hate it for the Right Reasons
The document describes a project to build a website called PerkyProfiler that retrieves user profile information from different services like GitHub, Flickr, and Twitter by taking URLs as input. It will use Perl and several Perl modules. The project will be built using the Catalyst web framework and Moose/MooseX for object-oriented programming. It describes using Moose roles, custom types, declarative class definitions, and functional programming techniques in Perl. The goal is to generate a unified user profile by combining data from different services for a given URL.
Modern Perl
A brief introduction to modern Perl programming tools that I gave at the OpenTech conference in Spetember 2010.
Adding 1.21 Gigawatts to Applications with RabbitMQ (PHPNW Dec 2014 Meetup)
As your application grows, you soon realise you need to break up your application into smaller chunks that talk to each other. You could just use web services to interact, or you could take a more robust approach and use the message broker RabbitMQ. In this talk, we will take a look at the techniques you can use to vastly enhance inter-application communication, learn about the core concepts of RabbitMQ, cover how you can scale different parts of your application separately, and modernise your development using a message-oriented architecture
Follow the White Rabbit - Message Queues with PHP
An introduction to message queues with PHP. We'll focus on RabbitMQ and how to leverage queuing scenarios in your applications. The talk will cover the main concepts of RabbitMQ server and AMQP protocol and show how to use it in PHP. The RabbitMqBundle for Symfony2 will be presented and we'll see how easy you can start to use message queuing in minutes.
Presented at Symfony User Group Belgium: http://www.meetup.com/Symfony-User-Group-Belgium/events/169953362/
PHP and COM
A discussion of the OLE/COM bridge in PHP 5.
These slides are from 2004.
I\'m hoping that SlideShare preserves the speakers notes; there\'s a good deal of information in there to complement the slide content.
PSGI and Plack from first principles
Keep hearing about Plack and PSGI, and not really sure what they're for, and why they're popular? Maybe you're using Plack at work, and you're still copying-and-pasting `builder` lines in to your code without really knowing what's going on? What's the relationship between Plack, PSGI, and CGI? Plack from first principles works up from how CGI works, the evolution that PSGI represents, and how Plack provides a user-friendly layer on top of that.
Mojo as a_client
Mojo started as an alternative to the aging LWP library for HTTP requests in Perl. It was created by Sebastian Riedel to have a more modern, asynchronous API. Mojo provides an easy to use and full-featured HTTP client and server with support for features like websockets, parallel requests, and more. The library uses a test-driven development approach and strives to have a pragmatic design with reusable components.
Php Server Var
The $_SERVER variable is a superglobal array that contains information about headers, files, and script locations. It contains information about the client and server environment, including elements like the filename of the currently executing script, query strings, headers, and more. Some example elements include $_SERVER['PHP_SELF'] containing the filename of the currently executing script and $_SERVER['QUERY_STRING'] containing the query string used to access the page.
Scaling Symfony2 apps with RabbitMQ - Symfony UK Meetup
Slides from my talk at Symfony UK Meetup. London, 20 Aug 2014. http://twitter.com/cakper
Video: https://www.youtube.com/watch?v=cha92Og9M5A
More Domain-Driven Design related content at: https://domaincentric.net/
Web Apps in Perl - HTTP 101
An 15 minute introduction to web applications and writing them in Perl with CGI.pm and mod_perl v1 and v2
Intro to Perl
Larry Wall created the Perl programming language in 1987. Perl is a general purpose language that is practical, flexible, and supports both procedural and object-oriented programming. It has a large community of users and third-party modules. Perl can be used for tasks like web development, system administration, and more. It has the philosophies of "there's more than one way to do it" and to "share and enjoy."
AnyMQ, Hippie, and the real-time web
The document discusses various technologies for real-time web applications including PSGI, Plack, AnyEvent, AnyMQ, server-push technologies like Comet, WebSockets, and the Web::Hippie and Web::Hippie::Pipe modules. It provides code examples of using AnyEvent and POE for asynchronous programming, AnyMQ for publishing messages to different message queues, and Web::Hippie::Pipe for abstracting persistent bidirectional connections. The document advocates for relaxing the definition of "hippies" to support more connection types and demonstrates how Hippie::Pipe can provide a unified interface.
Json perl example
This document discusses encoding and decoding JSON objects in Perl. It provides an overview of the JSON module in Perl and describes functions for encoding Perl data structures to JSON strings (encode_json) and decoding JSON strings back to Perl data structures (decode_json). Examples are given showing how to encode a hash and object to JSON and decode a JSON string to a Perl hash.
Subroutines
Subroutines allow programmers to organize, reuse, and recall code. They are defined using the sub keyword followed by the subroutine name and block of code. Subroutines are called using an ampersand and the name, without parentheses. By default, the last operation in a subroutine is returned. Return values can be stored and used later in the main script. Well-structured subroutines improve code quality.
Advanced Perl Techniques
The document summarizes an advanced Perl training course covering new features in Perl 5.10 like defined-or operator, switch statement, smart matching and say(), as well as testing with modules like Test::MockObject, profiling with Devel::Cover, and benchmarking code with Benchmark.pm. The one-day course will quickly cover many Perl topics and point to additional online resources for further learning.
Nette framework (WebElement #28)
This document discusses Nette, a popular PHP framework for web development. It provides an overview of key Nette features like the RobotLoader, forms, templating with Latte, dependency injection, routing, AJAX, debugging and error handling, and the database layer. The document also mentions that components and controls allow for reusable code, signals, and flash messages.
Replacing "exec" with a type and provider: Return manifests to a declarative ...
Dominic Cleal's talk "Replacing 'exec' with a type and provider: Return manifests to a declarative configuration" from Puppet Camp Ghent 2013.
Puppet Camp Chicago 2014: Smoothing Troubles With Custom Types and Providers ...
"Smoothing Troubles With Custom Types and Providers" (Beginner) presented at Puppet Camp Chicago 2014 by Chad Thompson, Dice Holdings
Php hacku
The document introduces PHP as a server-side scripting language that is easy to learn and commonly used with the LAMP stack. It provides examples of basic PHP syntax for variables, arrays, functions, and interacting with URLs and external data sources. The goal is to teach enough PHP to handle simple requests and parse/generate XML and JSON through practical code examples.
A reviravolta do desenvolvimento web
This document discusses the evolution of web development in Perl, from CGI scripts to modern PSGI-based frameworks. It introduces PSGI as an interface between web applications and web servers, and Plack as a toolkit for building PSGI applications and middleware. The document outlines many PSGI web servers and frameworks that can be used to build and deploy Perl web applications according to the PSGI standard.
An Introduction to Symfony
The document provides an overview of the Symfony components, which are standalone PHP packages that can be used independently in any PHP project. It describes several key components, including the Console, YAML, Finder, and CSSSelector components. It also discusses how these components are used as the basis for the full-featured Symfony framework.
Webrtc mojo
This document discusses using WebRTC in Perl to enable real-time communication between browsers. It explains that WebRTC allows peer-to-peer connections without plugins by using signaling to exchange endpoint details and ICE servers. It then provides over 350 lines of Perl code to demonstrate setting up a WebRTC connection between an "offerer" and "answerer" browser to allow sending messages over a data channel. The code connects the browsers as peers, exchanges session descriptions and ICE candidates, creates audio/video constraints, and includes a chat interface to test the connection.
09 Oo Php Register
The document discusses object-oriented programming concepts in PHP, including classes and objects. It provides an example person class with properties like name and methods like get_name(). It then creates objects/instances of the person class and demonstrates accessing object properties and methods. It also provides information on registering with 000webhost for free web hosting and includes links for additional tutorials.
Perl web frameworks
The document discusses Perl web frameworks Catalyst and Mojolicious. It provides an overview of key MVC concepts like routers, controllers, models and views. It then demonstrates how to install and create a basic Catalyst application with a root controller and default action. It also covers additional Catalyst controller features like actions, routes, context object and chained actions.
Perl bhargav
This document provides an introduction to the Perl programming language, including:
- A brief history of Perl's development and origins drawing from other languages like C and shell scripting.
- An overview of the major Perl versions released since 1987.
- Descriptions of Perl's basic program structure, data types, control structures, input/output capabilities, functions, and object-oriented features like encapsulation and inheritance.
- Examples are provided to illustrate Perl's syntax and capabilities for variables, comments, arithmetic, strings, arrays, hashes, conditionals, loops, file handling and defining custom functions.
- The document concludes by providing a link to a demo Perl project online.
Building Web Services with Zend Framework (PHP Benelux meeting 20100713 Vliss...
The document discusses using the Zend Framework to build web services. It covers exposing classes as SOAP, XML-RPC, and JSON-RPC web services. It also discusses building RESTful web services using the Zend Framework by implementing actions in a Zend_Rest_Controller and adding a Zend_Rest_Route. Code examples are provided for each approach.
PHP 良好實踐 (Best Practice)
https://kylinyu.win/php_best_practice
For PHP Beginner.
在不過度依賴 Framework 或者 Library 工具的情況下，撰寫良好的 PHP 程式， PHP 良好實踐搭配 Clean Code 實戰範例分享
#clean_code #best_practice #PHP #軟體設計
php 2 Function creating, calling, PHP built-in function
The document discusses PHP functions, including how to create and call custom functions, and examples of useful built-in PHP functions. It explains that functions allow reusable blocks of code and built-in functions are pre-made and do not need to be created. Examples are provided for creating functions that take parameters and return values, as well as calling functions. Common built-in functions are also described, such as trim(), explode(), implode(), and print_r() which operate on strings and arrays.
Multi tenant laravel
This document discusses building multi-tenant SaaS applications with Laravel using separated databases. It begins by defining what multi-tenancy and SaaS are. It then covers database layouts for single, shared, and separated databases. The main sections cover setting up tenant connections, calling models from tenant and shared databases, handling inter-database relations, firing tenant events, and other considerations like caching and queues. Pros of the approach include backups and scalability per tenant, while cons include added complexity for built-in Laravel functions. Server layout and existing Laravel packages for multi-tenancy are also mentioned.
When symfony met promises
This document discusses making PHP applications more reactive and asynchronous using ReactPHP principles. It covers:
1. The benefits of using a reactive programming approach with ReactPHP including increased performance from non-blocking I/O.
2. How to build a reactive Symfony application using ReactPHP by splitting the application into asynchronous framework, server, and domain layers.
3. The Symfony Async Kernel and ReactPHP Symfony server packages that facilitate building reactive Symfony applications on ReactPHP.
4. Benchmarks showing the ReactPHP approach outperforming traditional PHP and PHP-PM implementations for concurrent requests.
More Related Content
What's hot
Scaling Symfony2 apps with RabbitMQ - Symfony UK Meetup
Slides from my talk at Symfony UK Meetup. London, 20 Aug 2014. http://twitter.com/cakper
Video: https://www.youtube.com/watch?v=cha92Og9M5A
More Domain-Driven Design related content at: https://domaincentric.net/
Web Apps in Perl - HTTP 101
An 15 minute introduction to web applications and writing them in Perl with CGI.pm and mod_perl v1 and v2
Intro to Perl
Larry Wall created the Perl programming language in 1987. Perl is a general purpose language that is practical, flexible, and supports both procedural and object-oriented programming. It has a large community of users and third-party modules. Perl can be used for tasks like web development, system administration, and more. It has the philosophies of "there's more than one way to do it" and to "share and enjoy."
AnyMQ, Hippie, and the real-time web
The document discusses various technologies for real-time web applications including PSGI, Plack, AnyEvent, AnyMQ, server-push technologies like Comet, WebSockets, and the Web::Hippie and Web::Hippie::Pipe modules. It provides code examples of using AnyEvent and POE for asynchronous programming, AnyMQ for publishing messages to different message queues, and Web::Hippie::Pipe for abstracting persistent bidirectional connections. The document advocates for relaxing the definition of "hippies" to support more connection types and demonstrates how Hippie::Pipe can provide a unified interface.
Json perl example
This document discusses encoding and decoding JSON objects in Perl. It provides an overview of the JSON module in Perl and describes functions for encoding Perl data structures to JSON strings (encode_json) and decoding JSON strings back to Perl data structures (decode_json). Examples are given showing how to encode a hash and object to JSON and decode a JSON string to a Perl hash.
Subroutines
Subroutines allow programmers to organize, reuse, and recall code. They are defined using the sub keyword followed by the subroutine name and block of code. Subroutines are called using an ampersand and the name, without parentheses. By default, the last operation in a subroutine is returned. Return values can be stored and used later in the main script. Well-structured subroutines improve code quality.
Advanced Perl Techniques
The document summarizes an advanced Perl training course covering new features in Perl 5.10 like defined-or operator, switch statement, smart matching and say(), as well as testing with modules like Test::MockObject, profiling with Devel::Cover, and benchmarking code with Benchmark.pm. The one-day course will quickly cover many Perl topics and point to additional online resources for further learning.
Nette framework (WebElement #28)
This document discusses Nette, a popular PHP framework for web development. It provides an overview of key Nette features like the RobotLoader, forms, templating with Latte, dependency injection, routing, AJAX, debugging and error handling, and the database layer. The document also mentions that components and controls allow for reusable code, signals, and flash messages.
Replacing "exec" with a type and provider: Return manifests to a declarative ...
Dominic Cleal's talk "Replacing 'exec' with a type and provider: Return manifests to a declarative configuration" from Puppet Camp Ghent 2013.
Puppet Camp Chicago 2014: Smoothing Troubles With Custom Types and Providers ...
"Smoothing Troubles With Custom Types and Providers" (Beginner) presented at Puppet Camp Chicago 2014 by Chad Thompson, Dice Holdings
Php hacku
The document introduces PHP as a server-side scripting language that is easy to learn and commonly used with the LAMP stack. It provides examples of basic PHP syntax for variables, arrays, functions, and interacting with URLs and external data sources. The goal is to teach enough PHP to handle simple requests and parse/generate XML and JSON through practical code examples.
A reviravolta do desenvolvimento web
This document discusses the evolution of web development in Perl, from CGI scripts to modern PSGI-based frameworks. It introduces PSGI as an interface between web applications and web servers, and Plack as a toolkit for building PSGI applications and middleware. The document outlines many PSGI web servers and frameworks that can be used to build and deploy Perl web applications according to the PSGI standard.
An Introduction to Symfony
The document provides an overview of the Symfony components, which are standalone PHP packages that can be used independently in any PHP project. It describes several key components, including the Console, YAML, Finder, and CSSSelector components. It also discusses how these components are used as the basis for the full-featured Symfony framework.
Webrtc mojo
This document discusses using WebRTC in Perl to enable real-time communication between browsers. It explains that WebRTC allows peer-to-peer connections without plugins by using signaling to exchange endpoint details and ICE servers. It then provides over 350 lines of Perl code to demonstrate setting up a WebRTC connection between an "offerer" and "answerer" browser to allow sending messages over a data channel. The code connects the browsers as peers, exchanges session descriptions and ICE candidates, creates audio/video constraints, and includes a chat interface to test the connection.
09 Oo Php Register
The document discusses object-oriented programming concepts in PHP, including classes and objects. It provides an example person class with properties like name and methods like get_name(). It then creates objects/instances of the person class and demonstrates accessing object properties and methods. It also provides information on registering with 000webhost for free web hosting and includes links for additional tutorials.
Perl web frameworks
The document discusses Perl web frameworks Catalyst and Mojolicious. It provides an overview of key MVC concepts like routers, controllers, models and views. It then demonstrates how to install and create a basic Catalyst application with a root controller and default action. It also covers additional Catalyst controller features like actions, routes, context object and chained actions.
Perl bhargav
This document provides an introduction to the Perl programming language, including:
- A brief history of Perl's development and origins drawing from other languages like C and shell scripting.
- An overview of the major Perl versions released since 1987.
- Descriptions of Perl's basic program structure, data types, control structures, input/output capabilities, functions, and object-oriented features like encapsulation and inheritance.
- Examples are provided to illustrate Perl's syntax and capabilities for variables, comments, arithmetic, strings, arrays, hashes, conditionals, loops, file handling and defining custom functions.
- The document concludes by providing a link to a demo Perl project online.
Building Web Services with Zend Framework (PHP Benelux meeting 20100713 Vliss...
The document discusses using the Zend Framework to build web services. It covers exposing classes as SOAP, XML-RPC, and JSON-RPC web services. It also discusses building RESTful web services using the Zend Framework by implementing actions in a Zend_Rest_Controller and adding a Zend_Rest_Route. Code examples are provided for each approach.
PHP 良好實踐 (Best Practice)
https://kylinyu.win/php_best_practice
For PHP Beginner.
在不過度依賴 Framework 或者 Library 工具的情況下，撰寫良好的 PHP 程式， PHP 良好實踐搭配 Clean Code 實戰範例分享
#clean_code #best_practice #PHP #軟體設計
php 2 Function creating, calling, PHP built-in function
The document discusses PHP functions, including how to create and call custom functions, and examples of useful built-in PHP functions. It explains that functions allow reusable blocks of code and built-in functions are pre-made and do not need to be created. Examples are provided for creating functions that take parameters and return values, as well as calling functions. Common built-in functions are also described, such as trim(), explode(), implode(), and print_r() which operate on strings and arrays.
What's hot (20)
Scaling Symfony2 apps with RabbitMQ - Symfony UK Meetup
Scaling Symfony2 apps with RabbitMQ - Symfony UK Meetup
Replacing "exec" with a type and provider: Return manifests to a declarative ...
Replacing "exec" with a type and provider: Return manifests to a declarative ...
Puppet Camp Chicago 2014: Smoothing Troubles With Custom Types and Providers ...
Puppet Camp Chicago 2014: Smoothing Troubles With Custom Types and Providers ...
Building Web Services with Zend Framework (PHP Benelux meeting 20100713 Vliss...
Building Web Services with Zend Framework (PHP Benelux meeting 20100713 Vliss...
php 2 Function creating, calling, PHP built-in function
php 2 Function creating, calling, PHP built-in function
Similar to Deezer - Consume topics in PHP from nightmare to performance
Multi tenant laravel
This document discusses building multi-tenant SaaS applications with Laravel using separated databases. It begins by defining what multi-tenancy and SaaS are. It then covers database layouts for single, shared, and separated databases. The main sections cover setting up tenant connections, calling models from tenant and shared databases, handling inter-database relations, firing tenant events, and other considerations like caching and queues. Pros of the approach include backups and scalability per tenant, while cons include added complexity for built-in Laravel functions. Server layout and existing Laravel packages for multi-tenancy are also mentioned.
When symfony met promises
This document discusses making PHP applications more reactive and asynchronous using ReactPHP principles. It covers:
1. The benefits of using a reactive programming approach with ReactPHP including increased performance from non-blocking I/O.
2. How to build a reactive Symfony application using ReactPHP by splitting the application into asynchronous framework, server, and domain layers.
3. The Symfony Async Kernel and ReactPHP Symfony server packages that facilitate building reactive Symfony applications on ReactPHP.
4. Benchmarks showing the ReactPHP approach outperforming traditional PHP and PHP-PM implementations for concurrent requests.
Tatsumaki
Tatsumaki is a non-blocking web framework for Perl built on Plack and AnyEvent. It allows building asynchronous applications that can handle thousands of concurrent connections. Tatsumaki uses psgi.streaming to enable asynchronous responses. It includes a non-blocking HTTP client and pure Perl message queue for building real-time applications like chat and comet. The framework is in a beta stage but plans include services for XMPP/IRC bots and a standard comet interface.
Tips
The document provides tips for optimizing PHP code, including using string functions instead of regular expressions where possible, passing references to reduce memory usage, using persistent database connections, and checking mysql_unbuffered_query() for faster queries. It also discusses HTTP requests and responses, cookie expiry, references in PHP, returning references from functions, and the debug_backtrace() function. The document concludes with tips for improving security such as checking for uninitialized variables, validating user input, and restricting access to included files.
Facebook的缓存系统
Facebook uses caching at multiple levels to improve performance and scalability. Caching is implemented globally, with APC, Memcached, and browser caches. Memcached is used to cache user profiles, photos, friends lists, and other frequently accessed data. Caching is optimized through techniques like caching serialization formats, priming APC, and caching parsed user agent strings. Dirty caching ensures cached data is invalidated when the source data changes.
The state of DI - DPC12
The document discusses dependency injection (DI) in PHP. It provides an overview of common DI containers and frameworks used in PHP projects, including Pimple, Bucket, Zend\Di, and Symfony. For each option, it demonstrates basic usage including constructor injection, setter injection, and retrieving services from the container. It also discusses concepts like shared services, configuration via XML, and injecting dependencies via interfaces or properties. The document serves as a high-level introduction to dependency injection in PHP.
Redis for the Everyday Developer
As presented at Confoo 2013.
More than some arcane NoSQL tool, Redis is a simple but powerful swiss army knife you can begin using today.
This talk introduces the audience to Redis and focuses on using it to cleanly solve common problems. Along the way, we'll see how Redis can be used as an alternative to several common PHP tools.
Redis for your boss
“Use the right tool for the right job” is one of the first thing they teach you when you start out in these waters. I would make “Get to really know your tools” a second.
In this talk we’re going to work on the architecture of an app that showcases some common features/scenarios we all probably already have in the apps we’re working on: counters, leaderboards, queuing, timelines, caching. But this time we’ll implement them with Redis, making the apps much faster, your hardware (and you) much cooler, your boss (and the clients) much happier and hopefully your salary a bit higher.
Event your life with Kafka
Quick review about Apache Kafka basics, its main features, and its use in applications or parts of applications designed under the event sourcing pattern.
4069180 Caching Performance Lessons From Facebook
This document discusses techniques for improving caching performance at Facebook. It begins by explaining the benefits of caching for large sites and applications. It then describes the various caching layers Facebook uses, including globals caching, APC caching, memcached, and browser caching. It provides examples of how Facebook leverages these caches, such as caching parsed user agent strings, opcode caching with APC, and caching profile data in memcached. It also discusses challenges like cache invalidation between data centers and techniques for addressing them like caching proxies.
Remedie: Building a desktop app with HTTP::Engine, SQLite and jQuery
Building a desktop app using HTTP::Engine as a micro web server, SQLite for data storage, and jQuery for the user interface. Comet and asynchronous workers are used to enable real-time features. JSON-RPC and routing are implemented to support AJAX actions. The combination provides a lightweight "desktop app" architecture that is cross-platform.
PHP, RabbitMQ, and You
PHP, RabbitMQ, and You talk given at MidwestPHP 2014
Video of the screens can be found here
http://www.youtube.com/watch?v=Nh5oFSXEg6k
This includes the videos of the sample code.
Practical PHP 5.3
PHP 5.3 has many new features that allow very different paradigms of software development, that may be unfamiliar to many PHP developers. If you want to learn more about functional or aspect-oriented programming, or how to organize your PHP libraries according to the new de facto PHP namespacing standard, don't miss this talk.
Symfony components in the wild, PHPNW12
Symfony is a set of reusable and decoupled PHP components designed to solve common web development problems. While as a framework it might not be the best for some of your projects, you can always build on top of its solid foundation of well written, tested and flexible components.
Original presentation: https://docs.google.com/presentation/pub?id=136blt1DWJ95yuEdpmjz9dIqgg38VwEXBQlY7bu0Op8w&start=false&loop=false&delayms=3000
The promise of asynchronous php
This document discusses asynchronous PHP processing and libraries. It begins with an overview of synchronous vs asynchronous processing and blocking vs non-blocking I/O. It then reviews several approaches for asynchronous PHP including Pthreads, pcntl_fork, popen, curl_multi, and event loops with libraries like ReactPHP. ReactPHP is discussed in depth as an event-driven non-blocking I/O library that uses promises and streams for asynchronous operations. Examples are provided for asynchronous HTTP requests, DNS lookups, and a pub/sub application using ZeroMQ. Key points emphasized are that asynchronous code does not necessarily run faster and execution order is not guaranteed.
The promise of asynchronous php
From ReactPHP to Facebook Hack's Async implementation and many more, asynchronous programming has been a 'hot' topic lately. But how well does async programming support work in PHP and what can you actually use it for in your projects ? Let's look at some real-world use cases and how they leverage the power of async to do things you didn't know PHP could do.
Symfony2, creare bundle e valore per il cliente
Un gioco in cui vincono tutti o due piccioni con una fava ;)
Lavorare rivolti alla creazione di valore per il cliente e da questo ottenere una libreria quasi pronta per essere pubblicata
Training
This document provides information about key concepts in Apache Kafka including producers, consumers, brokers, topics, partitions, replications, and Zookeeper. It also describes how to start the Kafka services, create and list topics, produce and consume messages, and configure producers and consumers. Finally, it briefly discusses Kafka Streams, Schema Registry, Kafka Connect, and KSQL.
Using ngx_lua in UPYUN
This document discusses using ngx_lua with UPYUN CDN. It provides examples of using Lua with Nginx for tasks like caching, health checking, and configuration as a service. Key points include using Lua for base64 encoding, Redis lookups, and upstream health checking. Lua provides a more flexible alternative to C modules for tasks like these by leveraging its embedding in Nginx via ngx_lua.
PHPSpec BDD Framework
This document introduces PHPSpec, a BDD framework for PHP inspired by RSpec. It discusses the principles of behavior-driven development (BDD) and test-driven development (TDD), and how PHPSpec implements a domain-specific language (DSL) that allows developers to write specifications in a natural language style. The document provides examples of how to write PHPSpec specifications using its matchers and contexts, run the specifications, and handle pending and failing tests. It also briefly discusses related tools like mocks, screen scraping with Goutte, and how BDD fits into the development cycle.
Similar to Deezer - Consume topics in PHP from nightmare to performance (20)
Remedie: Building a desktop app with HTTP::Engine, SQLite and jQuery
Remedie: Building a desktop app with HTTP::Engine, SQLite and jQuery
Recently uploaded
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on integration of Salesforce with Bonterra Impact Management.
Interested in deploying an integration with Salesforce for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
TrustArc Webinar - 2024 Global Privacy Survey
How does your privacy program stack up against your peers? What challenges are privacy teams tackling and prioritizing in 2024?
In the fifth annual Global Privacy Benchmarks Survey, we asked over 1,800 global privacy professionals and business executives to share their perspectives on the current state of privacy inside and outside of their organizations. This year’s report focused on emerging areas of importance for privacy and compliance professionals, including considerations and implications of Artificial Intelligence (AI) technologies, building brand trust, and different approaches for achieving higher privacy competence scores.
See how organizational priorities and strategic approaches to data security and privacy are evolving around the globe.
This webinar will review:
- The top 10 privacy insights from the fifth annual Global Privacy Benchmarks Survey
- The top challenges for privacy leaders, practitioners, and organizations in 2024
- Key themes to consider in developing and maintaining your privacy program
5th LF Energy Power Grid Model Meet-up Slides
5th Power Grid Model Meet-up
It is with great pleasure that we extend to you an invitation to the 5th Power Grid Model Meet-up, scheduled for 6th June 2024. This event will adopt a hybrid format, allowing participants to join us either through an online Mircosoft Teams session or in person at TU/e located at Den Dolech 2, Eindhoven, Netherlands. The meet-up will be hosted by Eindhoven University of Technology (TU/e), a research university specializing in engineering science & technology.
Power Grid Model
The global energy transition is placing new and unprecedented demands on Distribution System Operators (DSOs). Alongside upgrades to grid capacity, processes such as digitization, capacity optimization, and congestion management are becoming vital for delivering reliable services.
Power Grid Model is an open source project from Linux Foundation Energy and provides a calculation engine that is increasingly essential for DSOs. It offers a standards-based foundation enabling real-time power systems analysis, simulations of electrical power grids, and sophisticated what-if analysis. In addition, it enables in-depth studies and analysis of the electrical power grid’s behavior and performance. This comprehensive model incorporates essential factors such as power generation capacity, electrical losses, voltage levels, power flows, and system stability.
Power Grid Model is currently being applied in a wide variety of use cases, including grid planning, expansion, reliability, and congestion studies. It can also help in analyzing the impact of renewable energy integration, assessing the effects of disturbances or faults, and developing strategies for grid control and optimization.
What to expect
For the upcoming meetup we are organizing, we have an exciting lineup of activities planned:
-Insightful presentations covering two practical applications of the Power Grid Model.
-An update on the latest advancements in Power Grid -Model technology during the first and second quarters of 2024.
-An interactive brainstorming session to discuss and propose new feature requests.
-An opportunity to connect with fellow Power Grid Model enthusiasts and users.
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
ABSTRACT: A prima vista, un mattoncino Lego e la backdoor XZ potrebbero avere in comune il fatto di essere entrambi blocchi di costruzione, o dipendenze di progetti creativi e software. La realtà è che un mattoncino Lego e il caso della backdoor XZ hanno molto di più di tutto ciò in comune.
Partecipate alla presentazione per immergervi in una storia di interoperabilità, standard e formati aperti, per poi discutere del ruolo importante che i contributori hanno in una comunità open source sostenibile.
BIO: Sostenitrice del software libero e dei formati standard e aperti. È stata un membro attivo dei progetti Fedora e openSUSE e ha co-fondato l'Associazione LibreItalia dove è stata coinvolta in diversi eventi, migrazioni e formazione relativi a LibreOffice. In precedenza ha lavorato a migrazioni e corsi di formazione su LibreOffice per diverse amministrazioni pubbliche e privati. Da gennaio 2020 lavora in SUSE come Software Release Engineer per Uyuni e SUSE Manager e quando non segue la sua passione per i computer e per Geeko coltiva la sua curiosità per l'astronomia (da cui deriva il suo nickname deneb_alpha).
Artificial Intelligence for XMLDevelopment
In the rapidly evolving landscape of technologies, XML continues to play a vital role in structuring, storing, and transporting data across diverse systems. The recent advancements in artificial intelligence (AI) present new methodologies for enhancing XML development workflows, introducing efficiency, automation, and intelligent capabilities. This presentation will outline the scope and perspective of utilizing AI in XML development. The potential benefits and the possible pitfalls will be highlighted, providing a balanced view of the subject.
We will explore the capabilities of AI in understanding XML markup languages and autonomously creating structured XML content. Additionally, we will examine the capacity of AI to enrich plain text with appropriate XML markup. Practical examples and methodological guidelines will be provided to elucidate how AI can be effectively prompted to interpret and generate accurate XML markup.
Further emphasis will be placed on the role of AI in developing XSLT, or schemas such as XSD and Schematron. We will address the techniques and strategies adopted to create prompts for generating code, explaining code, or refactoring the code, and the results achieved.
The discussion will extend to how AI can be used to transform XML content. In particular, the focus will be on the use of AI XPath extension functions in XSLT, Schematron, Schematron Quick Fixes, or for XML content refactoring.
The presentation aims to deliver a comprehensive overview of AI usage in XML development, providing attendees with the necessary knowledge to make informed decisions. Whether you’re at the early stages of adopting AI or considering integrating it in advanced XML development, this presentation will cover all levels of expertise.
By highlighting the potential advantages and challenges of integrating AI with XML development tools and languages, the presentation seeks to inspire thoughtful conversation around the future of XML development. We’ll not only delve into the technical aspects of AI-powered XML development but also discuss practical implications and possible future directions.
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
A Mix Chart displays historical data of numbers in a graphical or tabular form. The Kalyan Rajdhani Mix Chart specifically shows the results of a sequence of numbers over different periods.
June Patch Tuesday
Ivanti’s Patch Tuesday breakdown goes beyond patching your applications and brings you the intelligence and guidance needed to prioritize where to focus your attention first. Catch early analysis on our Ivanti blog, then join industry expert Chris Goettl for the Patch Tuesday Webinar Event. There we’ll do a deep dive into each of the bulletins and give guidance on the risks associated with the newly-identified vulnerabilities.
Webinar: Designing a schema for a Data Warehouse
Are you new to data warehouses (DWH)? Do you need to check whether your data warehouse follows the best practices for a good design? In both cases, this webinar is for you.
A data warehouse is a central relational database that contains all measurements about a business or an organisation. This data comes from a variety of heterogeneous data sources, which includes databases of any type that back the applications used by the company, data files exported by some applications, or APIs provided by internal or external services.
But designing a data warehouse correctly is a hard task, which requires gathering information about the business processes that need to be analysed in the first place. These processes must be translated into so-called star schemas, which means, denormalised databases where each table represents a dimension or facts.
We will discuss these topics:
- How to gather information about a business;
- Understanding dictionaries and how to identify business entities;
- Dimensions and facts;
- Setting a table granularity;
- Types of facts;
- Types of dimensions;
- Snowflakes and how to avoid them;
- Expanding existing dimensions and facts.
Introduction of Cybersecurity with OSS at Code Europe 2024
I develop the Ruby programming language, RubyGems, and Bundler, which are package managers for Ruby. Today, I will introduce how to enhance the security of your application using open-source software (OSS) examples from Ruby and RubyGems.
The first topic is CVE (Common Vulnerabilities and Exposures). I have published CVEs many times. But what exactly is a CVE? I'll provide a basic understanding of CVEs and explain how to detect and handle vulnerabilities in OSS.
Next, let's discuss package managers. Package managers play a critical role in the OSS ecosystem. I'll explain how to manage library dependencies in your application.
I'll share insights into how the Ruby and RubyGems core team works to keep our ecosystem safe. By the end of this talk, you'll have a better understanding of how to safeguard your code.
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for life science domain, where you retriever information from biomedical knowledge graphs using LLMs to increase the accuracy and performance of generated answers
Skybuffer SAM4U tool for SAP license adoption
Manage and optimize your license adoption and consumption with SAM4U, an SAP free customer software asset management tool.
SAM4U, an SAP complimentary software asset management tool for customers, delivers a detailed and well-structured overview of license inventory and usage with a user-friendly interface. We offer a hosted, cost-effective, and performance-optimized SAM4U setup in the Skybuffer Cloud environment. You retain ownership of the system and data, while we manage the ABAP 7.58 infrastructure, ensuring fixed Total Cost of Ownership (TCO) and exceptional services through the SAP Fiori interface.
Programming Foundation Models with DSPy - Meetup Slides
Prompting language models is hard, while programming language models is easy. In this talk, I will discuss the state-of-the-art framework DSPy for programming foundation models with its powerful optimizers and runtime constraint system.
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean Lotus cyber threat actors represent a sophisticated, persistent, and politically motivated group that poses a significant risk to organizations and individuals in the Southeast Asian region. Their continuous evolution and adaptability underscore the need for robust cybersecurity measures and international cooperation to identify and mitigate the threats posed by such advanced persistent threat groups.
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
Imagine a world where machines not only perform tasks but also learn, adapt, and make decisions. This is the promise of Artificial Intelligence (AI), a technology that's not just enhancing our lives but revolutionizing entire industries.
Main news related to the CCS TSI 2023 (2023/1695)
An English 🇬🇧 translation of a presentation to the speech I gave about the main changes brought by CCS TSI 2023 at the biggest Czech conference on Communications and signalling systems on Railways, which was held in Clarion Hotel Olomouc from 7th to 9th November 2023 (konferenceszt.cz). Attended by around 500 participants and 200 on-line followers.
The original Czech 🇨🇿 version of the presentation can be found here: https://www.slideshare.net/slideshow/hlavni-novinky-souvisejici-s-ccs-tsi-2023-2023-1695/269688092 .
The videorecording (in Czech) from the presentation is available here: https://youtu.be/WzjJWm4IyPk?si=SImb06tuXGb30BEH .
OpenID AuthZEN Interop Read Out - Authorization
During Identiverse 2024 and EIC 2024, members of the OpenID AuthZEN WG got together and demoed their authorization endpoints conforming to the AuthZEN API
20240609 QFM020 Irresponsible AI Reading List May 2024
Everything I found interesting about the irresponsible use of machine intelligence in May 2024
HCL Notes and Domino License Cost Reduction in the World of DLAU
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-and-domino-license-cost-reduction-in-the-world-of-dlau/
The introduction of DLAU and the CCB & CCX licensing model caused quite a stir in the HCL community. As a Notes and Domino customer, you may have faced challenges with unexpected user counts and license costs. You probably have questions on how this new licensing approach works and how to benefit from it. Most importantly, you likely have budget constraints and want to save money where possible. Don’t worry, we can help with all of this!
We’ll show you how to fix common misconfigurations that cause higher-than-expected user counts, and how to identify accounts which you can deactivate to save money. There are also frequent patterns that can cause unnecessary cost, like using a person document instead of a mail-in for shared mailboxes. We’ll provide examples and solutions for those as well. And naturally we’ll explain the new licensing model.
Join HCL Ambassador Marc Thomas in this webinar with a special guest appearance from Franz Walder. It will give you the tools and know-how to stay on top of what is going on with Domino licensing. You will be able lower your cost through an optimized configuration and keep it low going forward.
These topics will be covered
- Reducing license cost by finding and fixing misconfigurations and superfluous accounts
- How do CCB and CCX licenses really work?
- Understanding the DLAU tool and how to best utilize it
- Tips for common problem areas, like team mailboxes, functional/test users, etc
- Practical examples and best practices to implement right away
Presentation of the OECD Artificial Intelligence Review of Germany
Consult the full report at https://www.oecd.org/digital/oecd-artificial-intelligence-review-of-germany-609808d6-en.htm
Recently uploaded (20)
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
Deezer - Consume topics in PHP from nightmare to performance
- 1. Kafka Consume topics in PHP from nightmare to performance
- 3. ~500 serveurs Paris / NY 1,5 To de logs par jour ~1B de requêtes / jour
- 4. KAFKA
- 5. What is Kafka ?
- 6. Key concepts Messages Topic Topic Partition Partition Messages ordered Partition Consumers One partition Consumer
- 7. How to use it in PHP
- 8. Kafka in php librdkafka $conf = new RdKafkaConf(); $conf->set('group.id', 'myConsumerGroup'); $conf->set('metadata.broker.list', '127.0.0.1'); $topicConf = new RdKafkaTopicConf(); $topicConf->set('auto.offset.reset', 'smallest'); $conf->setDefaultTopicConf($topicConf); $consumer = new RdKafkaKafkaConsumer($conf); $consumer->subscribe(['greatTopic']); while (true) { $message = $consumer->consume(120*1000); switch ($message->err) { case RD_KAFKA_RESP_ERR_NO_ERROR: var_dump($message); break; case RD_KAFKA_RESP_ERR__PARTITION_EOF: echo "No more messages; will wait for moren"; break; case RD_KAFKA_RESP_ERR__TIMED_OUT: echo "Timed outn"; break; default: throw new Exception($message->errstr(), $message->err); break; } } php-rdkafka
- 9. How we did it
- 10. Reference topic for tests ↑30 K/ ~60 K/ ~1.3 bn/ 80
- 11. What can we expect from kafka ? Kafka-cat 30 K/
- 12. Naïve implementation Topic we did we got ~3.2 m/ ~37 / ~1-2Gb /
- 13. Forks to process messages in parallel Topic we did we got 0 / 0 / ~1-2Gb /
- 15. Back to naïve implementation + fork consumer Topic we did we got fork Still ~3.2 m/ ~37 / ~1-2Gb /
- 16. Adjust librdkafka configuration ● ● we did we got still still still smaller memory footprint ~3.2 m/ ~37 / ~100mb /
- 17. Die them all we did we got consumption stop for ~30s each time a fork die ~1.6 m/ ~15 / ~100mb /
- 20. we got fork process messages then die, no memory leak, no trace ~865 m/ ~10 K/ ~100mb + 100mb/ Client-server
- 22. How to increase processing rate ? ~865 m/ ~100mb + 100mb /~865 m/ ~10 K/ ~100mb + 100mb/
- 23. Start more consumers/fork we did we got ~865 m/ ~100mb + 100mb /~865 m/ ~10 K/ ~100mb + 100mb/
- 25. How to increase processing rate ? ~865 m/ ~100mb + 100mb /~865 m/ ~10 K/ ~100mb + 100mb/
- 26. Strace consumer
- 27. What is stracing ?
- 29. Force communication protocol ● ● we did we got ~1.6 bn/ ~30 K/ ~100mb + 100mb/
- 31. Reference topic for tests ↑30 K/ ~60 K/ ~1.3 bn/ 80
- 33. Takeaway
- 35. THANK YOU 35