Hejfaktura
•Download as KEY, PDF•
0 likes•404 views
This document summarizes a painless invoicing solution for small businesses. It uses Django, MySQL, MongoDB, Memcached, RabbitMQ, Celery, Gunicorn, Nginx, and other technologies in a virtual environment deployed on a single 512MB VPS. Invoices are generated with Reportlab PDFLib and cached with johnny-cache. The frontend uses Compass, Blueprint grid, Coffeescript, jQuery and other libraries. Development is done in Vim on a Mac Air using IPython, Python debugger and Git.
Report
Share
Report
Share
Recommended
Build App with Nodejs - YWC Workshop
This document provides an introduction to Node.js, including:
- Node.js allows JavaScript to be run on the server-side using the V8 JavaScript engine.
- It uses an event-driven, non-blocking I/O model that makes it lightweight and efficient.
- Node.js supports module-driven development through NPM, which has over 250,000 packages available.
Fine tuning Hybrid Mobile App
Hybrid mobile apps combine native and web technologies. They have native shells and navigation with web content inside a webview. Perceived performance is important - users notice a 20% improvement in response times between 0.1 and 1 second. To improve button response, use fast click libraries or disable zooming. Network latency is a major factor in slow performance so reduce network requests and use compression. Offline support requires local caching and handling disconnected states. Testing, monitoring, and optimizing for performance is important for a good hybrid user experience.
Back to the 90s' - Revenge of the static website
Static websites are becoming a viable client application model once again. In this talk I provide a practical example
Faster on Rails
This document discusses ways to improve the speed of Rails applications. It covers topics like web servers, Rack web servers, the backend, and the frontend. It analyzes how small delays can negatively impact users and recommends measuring site speed, analyzing bottlenecks, and optimizing performance. Specific technologies mentioned include Nginx, Unicorn, SPDY, database queries, and client-side optimizations. The overall message is that scaling a Rails application is challenging but important for providing a good user experience.
Functional Programming in Serverless World
This document discusses functional programming in serverless environments. It begins by defining serverless computing and Function as a Service (FaaS). It then explores why serverless is useful from the perspectives of costs, architecture, and operations. The document examines using different programming languages like F# within serverless and the importance of tooling and context. It describes experiments running programs on AWS Lambda to measure predictability and constraints. Finally it provides references for further reading on serverless computing topics.
Apache Mesos Distributed Computing Talk
This document provides an agenda for a talk on Apache Mesos, a distributed systems kernel that provides resource management and helps to abstract cluster resources. The talk discusses why distributed computing is hard, how Mesos helps by turning servers into a single large computer and improving multi-tenancy. It also covers Mesos history, how it works, examples of Mesos in production use, and alternatives to writing custom frameworks like Marathon.
Power your website with Windows Azure
Slides of Microsoft Portugal "Developer Tech Refresh" event held in September 2013. Mostly a demo-based session.
MJ Berends talk - Women & Non-Binary Focused Intro to AWS
"how to develop for aws on your local machine using localstack / moto" - MJ Berends, Data Apps Team Lead at Jellyvision // @apprxlinear (https://twitter.com/apprxlinear)
Recommended
Build App with Nodejs - YWC Workshop
This document provides an introduction to Node.js, including:
- Node.js allows JavaScript to be run on the server-side using the V8 JavaScript engine.
- It uses an event-driven, non-blocking I/O model that makes it lightweight and efficient.
- Node.js supports module-driven development through NPM, which has over 250,000 packages available.
Fine tuning Hybrid Mobile App
Hybrid mobile apps combine native and web technologies. They have native shells and navigation with web content inside a webview. Perceived performance is important - users notice a 20% improvement in response times between 0.1 and 1 second. To improve button response, use fast click libraries or disable zooming. Network latency is a major factor in slow performance so reduce network requests and use compression. Offline support requires local caching and handling disconnected states. Testing, monitoring, and optimizing for performance is important for a good hybrid user experience.
Back to the 90s' - Revenge of the static website
Static websites are becoming a viable client application model once again. In this talk I provide a practical example
Faster on Rails
This document discusses ways to improve the speed of Rails applications. It covers topics like web servers, Rack web servers, the backend, and the frontend. It analyzes how small delays can negatively impact users and recommends measuring site speed, analyzing bottlenecks, and optimizing performance. Specific technologies mentioned include Nginx, Unicorn, SPDY, database queries, and client-side optimizations. The overall message is that scaling a Rails application is challenging but important for providing a good user experience.
Functional Programming in Serverless World
This document discusses functional programming in serverless environments. It begins by defining serverless computing and Function as a Service (FaaS). It then explores why serverless is useful from the perspectives of costs, architecture, and operations. The document examines using different programming languages like F# within serverless and the importance of tooling and context. It describes experiments running programs on AWS Lambda to measure predictability and constraints. Finally it provides references for further reading on serverless computing topics.
Apache Mesos Distributed Computing Talk
This document provides an agenda for a talk on Apache Mesos, a distributed systems kernel that provides resource management and helps to abstract cluster resources. The talk discusses why distributed computing is hard, how Mesos helps by turning servers into a single large computer and improving multi-tenancy. It also covers Mesos history, how it works, examples of Mesos in production use, and alternatives to writing custom frameworks like Marathon.
Power your website with Windows Azure
Slides of Microsoft Portugal "Developer Tech Refresh" event held in September 2013. Mostly a demo-based session.
MJ Berends talk - Women & Non-Binary Focused Intro to AWS
"how to develop for aws on your local machine using localstack / moto" - MJ Berends, Data Apps Team Lead at Jellyvision // @apprxlinear (https://twitter.com/apprxlinear)
Node.js for beginner
This document provides an introduction to Node.js for beginners. It defines Node.js as a server-side JavaScript platform that uses non-blocking I/O and an event-driven architecture. It discusses key Node.js concepts like callbacks, event loops, streams, and asynchronous programming. It also highlights how Node.js is well suited for building real-time applications and APIs due to its asynchronous and modular nature.
JavaScript innovaties: ECMAScript 6 & 7
[Dutch]
In juni is ECMAScript 6 definitief. Laten we alle vernieuwingen eens op een rij zetten middels sprekende voorbeelden en demos: Scope, const, destructuring, arrow functions, map, set, modules, classes, etc. Tevens behandelen we mogelijkheden om ECMAScript 6 code om te zetten naar versie 5, zodat de code ook uitvoerbaar is in oudere omgevingen. ES6 browser ondersteuning in bijvoorbeeld Windows 10’s Internet Explorer is er al gedeeltelijk, maar vereisen soms wat extra instellingen. We behandelen welke. Ook de Visual Studio ondersteuning wordt bekeken. Tot slot een vooruitblik op ECMAScript 7.
Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017
How to monitor unknown third party code? One of the hardest challenges we face running Clever Cloud, apart from the impressive scale we face with hundreds of new applications per week, is the monitoring of unknown tech stacks. The first goal of rebuilding the monitoring platform was to accommodate the immutable infrastructure pattern that generates lots of ephemeral hosts every minute. The traditional approach is to focus on VMs or hosts, not applications. We needed to shift this into an approach of auto-discovery of metrics to monitor, allowing third party code to publish new items. This talk explains our journey in building Clever Cloud Metrics stack, heavily based on Warp10 (Kafka/Hadoop/Storm based) to deliver developer efficiency and trustability to our clients applications.
Announcing StencilJS
Stencil is a compiler for web components that builds optimized custom elements using TypeScript and JSX. It is inspired by Angular, React, Vue, and other frameworks. Stencil focuses on fast startup times and small file sizes for progressive web apps. Sample apps show it has significantly faster startup and smaller bundles compared to other frameworks. Components are lazily loaded by default without needing Webpack.
Boulder JS meet up presentation for April 16
Boulder JS Meetup presentation for beginner track
Meetup was cancelled, but I would like to make this available to any who want to see it anyway.
The links to everything in the presentation and more reside at
https://github.com/m-schrepel/BoulderJS_Presentation_links/blob/master/Links.rtf
Anton Boyko, "The evolution of microservices platform or marketing gibberish"
This document discusses Azure Functions and serverless computing. It provides an overview of serverless benefits like manage less, micro-pricing, and ease of scale. It also compares common serverless offerings from Microsoft Azure, AWS, and Google Cloud. The document demonstrates consumption scale, durable functions, and addressing issues like capacity planning, durability, and performance for serverless applications.
Problems you’ll face in the Microservices World: Configuration, Authenticatio...
Okay, Microservices are cool. But, as all the new trendy buzzword, it’s not a silver bullet, and there are several problems to manage. One is the authentication, distributed authentication is hard, and there is many ways to achieve it. Configuration is the second issue to be managed when dealing with distributed micro application strategy. This talk is a concrete return of experience to build a strategy on microservice and problems we will have to deal on this occasion.
Scaling Django for X Factor - DJUGL Oct 2012
Malcolm Box presented on scaling Django web applications to handle over 10,000 requests per second. He discussed challenges in caching, counting, and using Cassandra to handle a write-heavy workload from user interactions on live TV shows. Key aspects of their architecture included caching using Pylibmc, implementing sharded counters to count things rapidly, and using Cassandra as the core database scaled through caching and virtual nodes.
Amazon S3 storage engine plugin for MySQL
This document describes a storage engine for Amazon S3 that allows storing large amounts of data in S3 without needing to purchase disks. It works by translating SQL queries to S3 operations and storing S3 items as rows in MySQL tables with the S3 item key as the primary key and item contents as the column value. This allows using inexpensive S3 storage through a traditional SQL interface.
Why Wordnik went non-relational
A presentation on the selection criteria, testing + evaluation and successful, zero-downtime migration to MongoDB. Additionally details on Wordnik's speed and stability are covered as well as how NoSQL technologies have changed the way Wordnik scales.
A faster web
Service workers can improve network resilience by caching content to reduce trips to the server. Workbox is a set of libraries and tools that help generate service workers using best practices. It can integrate with build tools like Webpack. Caching layers like Redis can also be used in front of databases to provide redundancy and faster requests while protecting databases. Redis is an open source in-memory data store that can be used as a cache. The demos showed how to implement these caching strategies to improve performance.
MONITORING THE UNKNOWN, 1000*100 SERIES A DAY - DEVOXX MOROCCO 2017
How to monitor unknown third party code? One of the hardest challenges we face running Clever Cloud, apart from the impressive scale we face with hundreds of new applications per week, is the monitoring of unknown tech stacks. The first goal of rebuilding the monitoring platform was to accommodate the immutable infrastructure pattern that generates lots of ephemeral hosts every minute. The traditional approach is to focus on VMs or hosts, not applications. We needed to shift this into an approach of auto-discovery of metrics to monitor, allowing third party code to publish new items. This talk explains our journey in building Clever Cloud Metrics stack, heavily based on Warp10 (Kafka/Hadoop/Storm based) to deliver developer efficiency and trustability to our clients applications.
Wongnai Engineering Story
แชร์ประสบกาณ์สิ่งที่ทีม Dev ของ Wongnai เคยผ่านมา ตั้งแต่เริ่มต้นเมื่อปี 2010 จนถึงปัจจุบัน และสิ่งที่จะทำในอนาคต
Build a reverse proxy for modern immutable infrastructure - Sozu - Devops D D...
This document summarizes a presentation about building a reverse proxy for modern immutable infrastructure using Sozu. Sozu is an open source, hot-reconfigurable reverse proxy written in Rust that allows changing configurations at runtime without packet loss or downtime. It uses a process-based architecture with zero-copy buffering for predictable high performance. Sozu supports multiple ways to manage configurations including via CLI, files, or integrating with configuration systems like Traefik.
LCA2013 : Implementing threaded accelerated compositing in WebKitGtk+
Implementing Threaded Accelerated Compositing in WebKit GTK+
Gwang Yoon Hwang · Slides
The main thread is where everything gets executed including layout and scripting. Thus, running compositing in the main thread severely limits responsiveness and rendering speed. By having a separate thread for compositing, we can bring a significant performance improvement in scrolling, zooming, and rendering, especially CSS3 animations.
Currently, several ports have already implemented offthemain thread compositing. Coordinated Graphics System, which is used by Qt and EFL, runs accelerated compositing in the UI Process. Compositor Thread used by Google Chrome runs the compositing thread off the main render thread in the Renderer Process.
Our Threaded Compositor is another accelerated compositing implementation, which is a threaded variant of Coordinated Graphics System. We are currently contributing Threaded Compositor to WebKit GTK+. Threaded Compositor makes WebKit GTK+ render CSS3 animations faster. Threaded Compositor brings a few benefits compared to the current Coordinated Graphics System. Firstly, by performing accelerated compositing in the Web Process, the UI process is isolated from the crashes caused by GPU driver bugs. Secondly, by not performing accelerated compositing in the main thread of the UI process, the UI process becomes more responsive to UI events.
In this talk, we will cover how we brought this feature to WebKit GTK+, and its current status. Additionally, optimized features for embedded systems such as memory management will be discussed.
Gwang Yoon is a software engineer at Company 100, working on GPU acceleration for WebKit in embedded systems. He is interested in the WebKit rendering system, especially accelerated compositing and accelerated 2D vector graphics on embedded GPUs.
下一代Web前端技术 陈子舜
- Web performance optimization techniques aim to improve load times and responsiveness, with the goal of enhancing the user experience. Common techniques include using browser caching, service workers, and HTTP/2 to reduce network requests and latency.
- Mobile web performance can be significantly impacted by network conditions like 2G, 3G, 4G, and WiFi. Factors like CPU, GPU, and app architecture also influence performance. Techniques like app shells, asynchronous resource loading, and responsive design help optimize the mobile web.
- Transitioning from HTTP to HTTPS, along with protocols like SPDY and HTTP/2, have helped reduce web page load times over the past decade through features that compress headers, prioritize requests, and multiple
Session dotNed Saturday 28 januari 2017
Slides from my session at dotNed Saturday in Veenendaal about using the MVVM pattern in real-life Xamarin.Forms apps
Node.js Introduction
The document introduces node.js and server-side JavaScript. It discusses the author's journey in web development, including static HTML, Perl/CGI, and PHP. It outlines some issues with PHP and needs for the next technology, which led the author to node.js due to its ease of use, scalability, engineering capabilities, and being a new technology with a great community. Node.js allows for real-time applications using a non-blocking and single-threaded model with JavaScript on both the front-end and back-end.
PuppetCamp Nj 2015- Puppet/packer presentation
This document discusses using Packer and Puppet together to create immutable "golden images" for infrastructure instances. It recommends using configuration management like Puppet to build golden images in order to make them consistent and compliant. The document outlines Packer's builders and provisioners, provides an example Packer template that uses Puppet provisioning, and discusses considerations like reusing certificates to authorize Puppet runs during image builds.
Node.js, for architects - OpenSlava 2013
These are the slides that were used for my presentation on Node.js in OpenSlava 2013 (October 11th, 2013, Bratislava) and provide an introduction to Node.js as well as analyze the potential effects of introducing Node.js in an enterprise and from an architectural perspective.
John adams talk cloudy
My presentation at Microsoft's Mountain View Conference Center during the "Talk Cloudy to me" day.
Thanks to Sebastian and Scalr for a great day.
Fixing Twitter Improving The Performance And Scalability Of The Worlds Most ...
Twitter's operations team manages software performance, availability, capacity planning, and configuration management for Twitter. They use metrics, logs, and analysis to find weak points and take corrective action. Some techniques include caching everything possible, moving operations to asynchronous daemons, and optimizing databases to reduce replication delay and locks. The team also created several open source projects like CacheMoney for caching and Kestrel for asynchronous messaging.
More Related Content
What's hot
Node.js for beginner
This document provides an introduction to Node.js for beginners. It defines Node.js as a server-side JavaScript platform that uses non-blocking I/O and an event-driven architecture. It discusses key Node.js concepts like callbacks, event loops, streams, and asynchronous programming. It also highlights how Node.js is well suited for building real-time applications and APIs due to its asynchronous and modular nature.
JavaScript innovaties: ECMAScript 6 & 7
[Dutch]
In juni is ECMAScript 6 definitief. Laten we alle vernieuwingen eens op een rij zetten middels sprekende voorbeelden en demos: Scope, const, destructuring, arrow functions, map, set, modules, classes, etc. Tevens behandelen we mogelijkheden om ECMAScript 6 code om te zetten naar versie 5, zodat de code ook uitvoerbaar is in oudere omgevingen. ES6 browser ondersteuning in bijvoorbeeld Windows 10’s Internet Explorer is er al gedeeltelijk, maar vereisen soms wat extra instellingen. We behandelen welke. Ook de Visual Studio ondersteuning wordt bekeken. Tot slot een vooruitblik op ECMAScript 7.
Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017
How to monitor unknown third party code? One of the hardest challenges we face running Clever Cloud, apart from the impressive scale we face with hundreds of new applications per week, is the monitoring of unknown tech stacks. The first goal of rebuilding the monitoring platform was to accommodate the immutable infrastructure pattern that generates lots of ephemeral hosts every minute. The traditional approach is to focus on VMs or hosts, not applications. We needed to shift this into an approach of auto-discovery of metrics to monitor, allowing third party code to publish new items. This talk explains our journey in building Clever Cloud Metrics stack, heavily based on Warp10 (Kafka/Hadoop/Storm based) to deliver developer efficiency and trustability to our clients applications.
Announcing StencilJS
Stencil is a compiler for web components that builds optimized custom elements using TypeScript and JSX. It is inspired by Angular, React, Vue, and other frameworks. Stencil focuses on fast startup times and small file sizes for progressive web apps. Sample apps show it has significantly faster startup and smaller bundles compared to other frameworks. Components are lazily loaded by default without needing Webpack.
Boulder JS meet up presentation for April 16
Boulder JS Meetup presentation for beginner track
Meetup was cancelled, but I would like to make this available to any who want to see it anyway.
The links to everything in the presentation and more reside at
https://github.com/m-schrepel/BoulderJS_Presentation_links/blob/master/Links.rtf
Anton Boyko, "The evolution of microservices platform or marketing gibberish"
This document discusses Azure Functions and serverless computing. It provides an overview of serverless benefits like manage less, micro-pricing, and ease of scale. It also compares common serverless offerings from Microsoft Azure, AWS, and Google Cloud. The document demonstrates consumption scale, durable functions, and addressing issues like capacity planning, durability, and performance for serverless applications.
Problems you’ll face in the Microservices World: Configuration, Authenticatio...
Okay, Microservices are cool. But, as all the new trendy buzzword, it’s not a silver bullet, and there are several problems to manage. One is the authentication, distributed authentication is hard, and there is many ways to achieve it. Configuration is the second issue to be managed when dealing with distributed micro application strategy. This talk is a concrete return of experience to build a strategy on microservice and problems we will have to deal on this occasion.
Scaling Django for X Factor - DJUGL Oct 2012
Malcolm Box presented on scaling Django web applications to handle over 10,000 requests per second. He discussed challenges in caching, counting, and using Cassandra to handle a write-heavy workload from user interactions on live TV shows. Key aspects of their architecture included caching using Pylibmc, implementing sharded counters to count things rapidly, and using Cassandra as the core database scaled through caching and virtual nodes.
Amazon S3 storage engine plugin for MySQL
This document describes a storage engine for Amazon S3 that allows storing large amounts of data in S3 without needing to purchase disks. It works by translating SQL queries to S3 operations and storing S3 items as rows in MySQL tables with the S3 item key as the primary key and item contents as the column value. This allows using inexpensive S3 storage through a traditional SQL interface.
Why Wordnik went non-relational
A presentation on the selection criteria, testing + evaluation and successful, zero-downtime migration to MongoDB. Additionally details on Wordnik's speed and stability are covered as well as how NoSQL technologies have changed the way Wordnik scales.
A faster web
Service workers can improve network resilience by caching content to reduce trips to the server. Workbox is a set of libraries and tools that help generate service workers using best practices. It can integrate with build tools like Webpack. Caching layers like Redis can also be used in front of databases to provide redundancy and faster requests while protecting databases. Redis is an open source in-memory data store that can be used as a cache. The demos showed how to implement these caching strategies to improve performance.
MONITORING THE UNKNOWN, 1000*100 SERIES A DAY - DEVOXX MOROCCO 2017
How to monitor unknown third party code? One of the hardest challenges we face running Clever Cloud, apart from the impressive scale we face with hundreds of new applications per week, is the monitoring of unknown tech stacks. The first goal of rebuilding the monitoring platform was to accommodate the immutable infrastructure pattern that generates lots of ephemeral hosts every minute. The traditional approach is to focus on VMs or hosts, not applications. We needed to shift this into an approach of auto-discovery of metrics to monitor, allowing third party code to publish new items. This talk explains our journey in building Clever Cloud Metrics stack, heavily based on Warp10 (Kafka/Hadoop/Storm based) to deliver developer efficiency and trustability to our clients applications.
Wongnai Engineering Story
แชร์ประสบกาณ์สิ่งที่ทีม Dev ของ Wongnai เคยผ่านมา ตั้งแต่เริ่มต้นเมื่อปี 2010 จนถึงปัจจุบัน และสิ่งที่จะทำในอนาคต
Build a reverse proxy for modern immutable infrastructure - Sozu - Devops D D...
This document summarizes a presentation about building a reverse proxy for modern immutable infrastructure using Sozu. Sozu is an open source, hot-reconfigurable reverse proxy written in Rust that allows changing configurations at runtime without packet loss or downtime. It uses a process-based architecture with zero-copy buffering for predictable high performance. Sozu supports multiple ways to manage configurations including via CLI, files, or integrating with configuration systems like Traefik.
LCA2013 : Implementing threaded accelerated compositing in WebKitGtk+
Implementing Threaded Accelerated Compositing in WebKit GTK+
Gwang Yoon Hwang · Slides
The main thread is where everything gets executed including layout and scripting. Thus, running compositing in the main thread severely limits responsiveness and rendering speed. By having a separate thread for compositing, we can bring a significant performance improvement in scrolling, zooming, and rendering, especially CSS3 animations.
Currently, several ports have already implemented offthemain thread compositing. Coordinated Graphics System, which is used by Qt and EFL, runs accelerated compositing in the UI Process. Compositor Thread used by Google Chrome runs the compositing thread off the main render thread in the Renderer Process.
Our Threaded Compositor is another accelerated compositing implementation, which is a threaded variant of Coordinated Graphics System. We are currently contributing Threaded Compositor to WebKit GTK+. Threaded Compositor makes WebKit GTK+ render CSS3 animations faster. Threaded Compositor brings a few benefits compared to the current Coordinated Graphics System. Firstly, by performing accelerated compositing in the Web Process, the UI process is isolated from the crashes caused by GPU driver bugs. Secondly, by not performing accelerated compositing in the main thread of the UI process, the UI process becomes more responsive to UI events.
In this talk, we will cover how we brought this feature to WebKit GTK+, and its current status. Additionally, optimized features for embedded systems such as memory management will be discussed.
Gwang Yoon is a software engineer at Company 100, working on GPU acceleration for WebKit in embedded systems. He is interested in the WebKit rendering system, especially accelerated compositing and accelerated 2D vector graphics on embedded GPUs.
下一代Web前端技术 陈子舜
- Web performance optimization techniques aim to improve load times and responsiveness, with the goal of enhancing the user experience. Common techniques include using browser caching, service workers, and HTTP/2 to reduce network requests and latency.
- Mobile web performance can be significantly impacted by network conditions like 2G, 3G, 4G, and WiFi. Factors like CPU, GPU, and app architecture also influence performance. Techniques like app shells, asynchronous resource loading, and responsive design help optimize the mobile web.
- Transitioning from HTTP to HTTPS, along with protocols like SPDY and HTTP/2, have helped reduce web page load times over the past decade through features that compress headers, prioritize requests, and multiple
Session dotNed Saturday 28 januari 2017
Slides from my session at dotNed Saturday in Veenendaal about using the MVVM pattern in real-life Xamarin.Forms apps
Node.js Introduction
The document introduces node.js and server-side JavaScript. It discusses the author's journey in web development, including static HTML, Perl/CGI, and PHP. It outlines some issues with PHP and needs for the next technology, which led the author to node.js due to its ease of use, scalability, engineering capabilities, and being a new technology with a great community. Node.js allows for real-time applications using a non-blocking and single-threaded model with JavaScript on both the front-end and back-end.
PuppetCamp Nj 2015- Puppet/packer presentation
This document discusses using Packer and Puppet together to create immutable "golden images" for infrastructure instances. It recommends using configuration management like Puppet to build golden images in order to make them consistent and compliant. The document outlines Packer's builders and provisioners, provides an example Packer template that uses Puppet provisioning, and discusses considerations like reusing certificates to authorize Puppet runs during image builds.
Node.js, for architects - OpenSlava 2013
These are the slides that were used for my presentation on Node.js in OpenSlava 2013 (October 11th, 2013, Bratislava) and provide an introduction to Node.js as well as analyze the potential effects of introducing Node.js in an enterprise and from an architectural perspective.
What's hot (20)
Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017
Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017
Anton Boyko, "The evolution of microservices platform or marketing gibberish"
Anton Boyko, "The evolution of microservices platform or marketing gibberish"
Problems you’ll face in the Microservices World: Configuration, Authenticatio...
Problems you’ll face in the Microservices World: Configuration, Authenticatio...
MONITORING THE UNKNOWN, 1000*100 SERIES A DAY - DEVOXX MOROCCO 2017
MONITORING THE UNKNOWN, 1000*100 SERIES A DAY - DEVOXX MOROCCO 2017
Build a reverse proxy for modern immutable infrastructure - Sozu - Devops D D...
Build a reverse proxy for modern immutable infrastructure - Sozu - Devops D D...
LCA2013 : Implementing threaded accelerated compositing in WebKitGtk+
LCA2013 : Implementing threaded accelerated compositing in WebKitGtk+
Similar to Hejfaktura
John adams talk cloudy
My presentation at Microsoft's Mountain View Conference Center during the "Talk Cloudy to me" day.
Thanks to Sebastian and Scalr for a great day.
Fixing Twitter Improving The Performance And Scalability Of The Worlds Most ...
Twitter's operations team manages software performance, availability, capacity planning, and configuration management for Twitter. They use metrics, logs, and analysis to find weak points and take corrective action. Some techniques include caching everything possible, moving operations to asynchronous daemons, and optimizing databases to reduce replication delay and locks. The team also created several open source projects like CacheMoney for caching and Kestrel for asynchronous messaging.
Fixing Twitter Improving The Performance And Scalability Of The Worlds Most ...
Fixing Twitter and Finding your own Fail Whale document discusses Twitter operations. The operations team manages software performance, availability, capacity planning, and configuration management using metrics, logs, and data-driven analysis to find weak points and take corrective action. They use managed services for infrastructure to focus on computer science problems. The document outlines Twitter's rapid growth and challenges in maintaining performance as traffic increases. It provides recommendations around caching, databases, asynchronous processing, and other techniques Twitter uses to optimize performance under heavy load.
Fixing twitter
Fixing Twitter and Finding your own Fail Whale document discusses Twitter operations. The Twitter operations team focuses on software performance, availability, capacity planning, and configuration management using metrics, logs, and science. They use a dedicated managed services team and run their own servers instead of cloud services. The document outlines Twitter's rapid growth and challenges in maintaining performance. It discusses strategies for monitoring, analyzing metrics to find weak points, deploying changes, and improving processes through configuration management and peer reviews.
Fixing_Twitter
Twitter's operations team manages software performance, availability, capacity planning, and configuration management. They use metrics, logs, and analysis to find weak points and take corrective action. Some techniques include caching everything possible, moving operations to asynchronous daemons, optimizing databases, and instrumenting all systems. Their goal is to process requests asynchronously when possible and avoid overloading relational databases.
A data layer in clojure
Clojure has always been good at manipulating data. With the release of spec and Onyx (“a masterless, cloud scale, fault tolerant, high performance distributed computation system”) good became best. In this talk you will learn about a streaming data layer architecture build around Kafka and Onyx that is self-describing, declarative, scalable and convenient to work with for the end user. The focus will be on the power and elegance of describing data and computation with data; the inferences and automations that can be built on top of that; and how and why Clojure is a natural choice for tasks that involve a lot of data manipulation, touching both on functional programming and lisp-specifics such as code-is-data.
We will look at how such an approach can be used to manage a data warehouse by automatically inferring materialized views from raw incoming data or other views based on a combination of heuristics, statistical analysis (seasonality, outlier removal, ...) and predefined ontologies. Doing so is a practical way to maintain a large number of views, increasing their availability and abstracting the complexity into declarative rules, rather than having an ETL pipeline with dozens or even hundreds of hand crafted tasks.
The system described requires relatively little effort upfront but can easily grow with one's needs both in terms of scale as well as scope. With its good introspection capabilities and strong decoupling it is for instance an excellent substrate for putting machine learning algorithms in production, which is the final use-case we will dive into.
Chirp 2010: Scaling Twitter
This document summarizes a keynote speech given by John Adams, an early Twitter engineer, about scaling Twitter operations from 2008-2009. Some key points:
1) Twitter saw exponential growth rates from 2008-2009, processing over 55 million tweets per day and 600 million searches per day.
2) Operations focused on improving performance, reducing errors and outages, and using metrics to identify weaknesses and bottlenecks like network latency and database delays.
3) Technologies like Unicorn, memcached, Flock, Cassandra, and daemons were implemented to improve scalability beyond a traditional RDBMS and handle Twitter's data volumes and real-time needs.
4) Caching,
Cooking a rabbit pie
This document discusses using AMQP and RabbitMQ for real-time system performance monitoring and job queueing. It describes key AMQP concepts like exchanges, queues, routing keys, and delivery modes. It then discusses how the speaker built a job queueing system called CatalystX::JobServer that uses these concepts and RabbitMQ. Demo examples are shown of using this system to queue and monitor the status of jobs. Potential next steps and other solutions like Gearman are also mentioned.
Diagnosing Problems in Production - Cassandra
1) The document discusses various tools for diagnosing problems in Cassandra production environments, including OpsCenter for monitoring, application metrics collection with Statsd/Graphite, and log aggregation with Splunk or Logstash.
2) Some common issues covered are incorrect server times causing data inconsistencies, tombstone overhead slowing queries, not using the proper snitch, and disk space not being reclaimed on new nodes.
3) Diagnostic tools described are htop, iostat, vmstat, dstat, strace, tcpdump, and nodetool for investigating process activity, disk usage, memory, networking, and Cassandra-specific statistics. GC profiling and query tracing are also recommended.
Webinar: Diagnosing Apache Cassandra Problems in Production
This document provides guidance on diagnosing problems in Cassandra production systems. It recommends first using OpsCenter to identify issues, then monitoring servers, applications, and logs. Common problems discussed include incorrect timestamps, tombstones slowing queries, not using a snitch, version mismatches, and disk space not being reclaimed. Diagnostic tools like htop, iostat, and nodetool are presented. The document also covers JVM garbage collection profiling to identify issues like early object promotion and long minor GCs slowing the system.
Webinar: Diagnosing Apache Cassandra Problems in Production
This session covers diagnosing and solving common problems encountered in production, using performance profiling tools. We’ll also give a crash course to basic JVM garbage collection tuning. Viewers will leave with a better understanding of what they should look for when they encounter problems with their in-production Cassandra cluster.
PyCon India 2012: Celery Talk
This document summarizes a presentation on using Celery for background task processing and deferred execution in Python applications. It discusses the basics of job queues and Celery, how to set up Celery with RabbitMQ, and integrating Celery with Django. The tutorial covers understanding Celery architecture, installing components, creating simple tasks, and next steps like adding workers, retrying tasks, routing to queues, and monitoring. Attendees are walked through hands-on examples of using Celery for asynchronous tasks like periodic jobs and integrating it with a web application.
2015 jcconf-h2s-devops-practice
Hochi Chuang presented on the DevOps practices at Here2Shop. Here2Shop uses Agile development methods like Scrum and focuses on continuous testing, deployment, and monitoring. They deploy Java applications to AWS using Jenkins, Selenium, and the AWS CLI. Their goals include improving the deployment process, integrating monitoring tools, and addressing security issues like content delivery and cross-site scripting. Chuang shared experiences transitioning to microservices and optimizing performance through caching.
Django production
This was a presentation given at San Diego Python's Django Day:
http://www.meetup.com/pythonsd/events/95751792/
https://github.com/pythonsd/learning-django
Memorial Sloan Kettering: Adventures in Drupal 8
Memorial Sloan Kettering is preparing to launch two websites in Drupal 8. As one of the first organizations to migrate its Drupal 6 content management system onto an enterprise Drupal 8 platform, Memorial Sloan Kettering has learned first hand the major challenges and advantages of building in Drupal 8.
In this session, project members from MSK, Phase2, and Digitas will explore the decision to take the leap to Drupal 8 and the reality of building in D8 while it is still a beta. Get details on the brute force migration process, front-end integrations and wiring up with twig in practice, and community contributions to accelerate Drupal 8 in the process of a flagship redesign for one of the leaders in the healthcare space.
We’ll elaborate on the challenges we faced and strategies we used to build on Drupal 8 and how you can learn from them!
Finally, we’ll answer some of your most burning questions:
How did you accomplish moving an existing Drupal 6 site with 25,000 plus pages of content to Drupal 8 while redesigning at the same time?
Should other organizations consider building in Drupal 8?
What tools and best practices were used by developers/sys admins?
What contrib modules are being used?
How difficult was it for the team to learn Drupal 8?
What is being used for layout and webforms?What external libraries and APIs are being used?
Dibi Conference 2012
This document discusses lessons learned from building and growing a software startup. It describes how the company quickly built their initial product but ran into scaling issues. It outlines the technical infrastructure changes they made to improve stability, such as moving to the cloud, adding Redis, Resque, and MongoDB. The document also provides recommendations on performance testing, libraries, tools, and localization. Overall it advocates for just starting to build the product now rather than overplanning.
Deep thoughts from the real world of azure
I presented this at a user group in Sweden, as a compilation discussion of practical customer experiences with WIndows Azure. The slides led the discussion. Enjoy.
Cassandra Day Atlanta 2015: Diagnosing Problems in Production
Diagnosing Problems in Production involves first preparing monitoring tools like OpsCenter, Server monitoring, Application metrics, and Log aggregation. Common issues include incorrect server times causing data inconsistencies, tombstone overhead slowing queries, not using the right snitch, version mismatches breaking functionality, and disk space not being reclaimed properly. Diagnostic tools like htop, iostat, vmstat, dstat, strace, jstack, tcpdump and nodetool can help narrow down issues like performance bottlenecks, garbage collection problems, and compaction issues.
Cassandra Day Chicago 2015: Diagnosing Problems in Production
Speaker(s): Jon Haddad, Apache Cassandra Evangelist at DataStax
This sessions covers diagnosing and solving common problems encountered in production, using performance profiling tools. We’ll also give a crash course to basic JVM garbage collection tuning. Attendees will leave with a better understanding of what they should look for when they encounter problems with their in-production Cassandra cluster. This talk is intended for people with a general understanding of Cassandra, but it not required to have experience running it in production.
Cassandra Day London 2015: Diagnosing Problems in Production
Speaker(s): Jon Haddad, Apache Cassandra Evangelist at DataStax
This sessions covers diagnosing and solving common problems encountered in production, using performance profiling tools. We’ll also give a crash course to basic JVM garbage collection tuning. Attendees will leave with a better understanding of what they should look for when they encounter problems with their in-production Cassandra cluster. This talk is intended for people with a general understanding of Cassandra, but it not required to have experience running it in production.
Similar to Hejfaktura (20)
Fixing Twitter Improving The Performance And Scalability Of The Worlds Most ...
Fixing Twitter Improving The Performance And Scalability Of The Worlds Most ...
Fixing Twitter Improving The Performance And Scalability Of The Worlds Most ...
Fixing Twitter Improving The Performance And Scalability Of The Worlds Most ...
Webinar: Diagnosing Apache Cassandra Problems in Production
Webinar: Diagnosing Apache Cassandra Problems in Production
Webinar: Diagnosing Apache Cassandra Problems in Production
Webinar: Diagnosing Apache Cassandra Problems in Production
Cassandra Day Atlanta 2015: Diagnosing Problems in Production
Cassandra Day Atlanta 2015: Diagnosing Problems in Production
Cassandra Day Chicago 2015: Diagnosing Problems in Production
Cassandra Day Chicago 2015: Diagnosing Problems in Production
Cassandra Day London 2015: Diagnosing Problems in Production
Cassandra Day London 2015: Diagnosing Problems in Production
Recently uploaded
QA or the Highway - Component Testing: Bridging the gap between frontend appl...
These are the slides for the presentation, "Component Testing: Bridging the gap between frontend applications" that was presented at QA or the Highway 2024 in Columbus, OH by Zachary Hamm.
ScyllaDB Tablets: Rethinking Replication
ScyllaDB is making a major architecture shift. We’re moving from vNode replication to tablets – fragments of tables that are distributed independently, enabling dynamic data distribution and extreme elasticity. In this keynote, ScyllaDB co-founder and CTO Avi Kivity explains the reason for this shift, provides a look at the implementation and roadmap, and shares how this shift benefits ScyllaDB users.
Leveraging the Graph for Clinical Trials and Standards
Katja Glaß
OpenStudyBuilder Community Manager - Katja Glaß Consulting
Marius Conjeaud
Principal Consultant - Neo4j
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
The typical problem in product engineering is not bad strategy, so much as “no strategy”. This leads to confusion, lack of motivation, and incoherent action. The next time you look for a strategy and find an empty space, instead of waiting for it to be filled, I will show you how to fill it in yourself. If you’re wrong, it forces a correction. If you’re right, it helps create focus. I’ll share how I’ve approached this in the past, both what works and lessons for what didn’t work so well.
Introduction of Cybersecurity with OSS at Code Europe 2024
I develop the Ruby programming language, RubyGems, and Bundler, which are package managers for Ruby. Today, I will introduce how to enhance the security of your application using open-source software (OSS) examples from Ruby and RubyGems.
The first topic is CVE (Common Vulnerabilities and Exposures). I have published CVEs many times. But what exactly is a CVE? I'll provide a basic understanding of CVEs and explain how to detect and handle vulnerabilities in OSS.
Next, let's discuss package managers. Package managers play a critical role in the OSS ecosystem. I'll explain how to manage library dependencies in your application.
I'll share insights into how the Ruby and RubyGems core team works to keep our ecosystem safe. By the end of this talk, you'll have a better understanding of how to safeguard your code.
"What does it really mean for your system to be available, or how to define w...
We will talk about system monitoring from a few different angles. We will start by covering the basics, then discuss SLOs, how to define them, and why understanding the business well is crucial for success in this exercise.
Dandelion Hashtable: beyond billion requests per second on a commodity server
This slide deck presents DLHT, a concurrent in-memory hashtable. Despite efforts to optimize hashtables, that go as far as sacrificing core functionality, state-of-the-art designs still incur multiple memory accesses per request and block request processing in three cases. First, most hashtables block while waiting for data to be retrieved from memory. Second, open-addressing designs, which represent the current state-of-the-art, either cannot free index slots on deletes or must block all requests to do so. Third, index resizes block every request until all objects are copied to the new index. Defying folklore wisdom, DLHT forgoes open-addressing and adopts a fully-featured and memory-aware closed-addressing design based on bounded cache-line-chaining. This design offers lock-free index operations and deletes that free slots instantly, (2) completes most requests with a single memory access, (3) utilizes software prefetching to hide memory latencies, and (4) employs a novel non-blocking and parallel resizing. In a commodity server and a memory-resident workload, DLHT surpasses 1.6B requests per second and provides 3.5x (12x) the throughput of the state-of-the-art closed-addressing (open-addressing) resizable hashtable on Gets (Deletes).
Day 2 - Intro to UiPath Studio Fundamentals
In our second session, we shall learn all about the main features and fundamentals of UiPath Studio that enable us to use the building blocks for any automation project.
📕 Detailed agenda:
Variables and Datatypes
Workflow Layouts
Arguments
Control Flows and Loops
Conditional Statements
💻 Extra training through UiPath Academy:
Variables, Constants, and Arguments in Studio
Control Flow in Studio
Astute Business Solutions | Oracle Cloud Partner |
Your goto partner for Oracle Cloud, PeopleSoft, E-Business Suite, and Ellucian Banner. We are a firm specialized in managed services and consulting.
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Join us to learn how UiPath Apps can directly and easily interact with prebuilt connectors via Integration Service--including Salesforce, ServiceNow, Open GenAI, and more.
The best part is you can achieve this without building a custom workflow! Say goodbye to the hassle of using separate automations to call APIs. By seamlessly integrating within App Studio, you can now easily streamline your workflow, while gaining direct access to our Connector Catalog of popular applications.
We’ll discuss and demo the benefits of UiPath Apps and connectors including:
Creating a compelling user experience for any software, without the limitations of APIs.
Accelerating the app creation process, saving time and effort
Enjoying high-performance CRUD (create, read, update, delete) operations, for
seamless data management.
Speakers:
Russell Alfeche, Technology Leader, RPA at qBotic and UiPath MVP
Charlie Greenberg, host
GNSS spoofing via SDR (Criptored Talks 2024)
In the realm of cybersecurity, offensive security practices act as a critical shield. By simulating real-world attacks in a controlled environment, these techniques expose vulnerabilities before malicious actors can exploit them. This proactive approach allows manufacturers to identify and fix weaknesses, significantly enhancing system security.
This presentation delves into the development of a system designed to mimic Galileo's Open Service signal using software-defined radio (SDR) technology. We'll begin with a foundational overview of both Global Navigation Satellite Systems (GNSS) and the intricacies of digital signal processing.
The presentation culminates in a live demonstration. We'll showcase the manipulation of Galileo's Open Service pilot signal, simulating an attack on various software and hardware systems. This practical demonstration serves to highlight the potential consequences of unaddressed vulnerabilities, emphasizing the importance of offensive security practices in safeguarding critical infrastructure.
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
Gursev Pirge, PhD
Senior Data Scientist - JohnSnowLabs
Demystifying Knowledge Management through Storytelling
The Department of Veteran Affairs (VA) invited Taylor Paschal, Knowledge & Information Management Consultant at Enterprise Knowledge, to speak at a Knowledge Management Lunch and Learn hosted on June 12, 2024. All Office of Administration staff were invited to attend and received professional development credit for participating in the voluntary event.
The objectives of the Lunch and Learn presentation were to:
- Review what KM ‘is’ and ‘isn’t’
- Understand the value of KM and the benefits of engaging
- Define and reflect on your “what’s in it for me?”
- Share actionable ways you can participate in Knowledge - - Capture & Transfer
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks creates AI-boosted business software that helps employees work more efficiently and effectively. Managing data across multiple RDBMS and NoSQL databases was already a challenge at their current scale. To prepare for 10X growth, they knew it was time to rethink their database strategy. Learn how they architected a solution that would simplify scaling while keeping costs under control.
Northern Engraving | Nameplate Manufacturing Process - 2024
Manufacturing custom quality metal nameplates and badges involves several standard operations. Processes include sheet prep, lithography, screening, coating, punch press and inspection. All decoration is completed in the flat sheet with adhesive and tooling operations following. The possibilities for creating unique durable nameplates are endless. How will you create your brand identity? We can help!
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Dmitrii Kamaev, PhD
Senior Product Owner - QIAGEN
Essentials of Automations: Exploring Attributes & Automation Parameters
Building automations in FME Flow can save time, money, and help businesses scale by eliminating data silos and providing data to stakeholders in real-time. One essential component to orchestrating complex automations is the use of attributes & automation parameters (both formerly known as “keys”). In fact, it’s unlikely you’ll ever build an Automation without using these components, but what exactly are they?
Attributes & automation parameters enable the automation author to pass data values from one automation component to the next. During this webinar, our FME Flow Specialists will cover leveraging the three types of these output attributes & parameters in FME Flow: Event, Custom, and Automation. As a bonus, they’ll also be making use of the Split-Merge Block functionality.
You’ll leave this webinar with a better understanding of how to maximize the potential of automations by making use of attributes & automation parameters, with the ultimate goal of setting your enterprise integration workflows up on autopilot.
Recently uploaded (20)
QA or the Highway - Component Testing: Bridging the gap between frontend appl...
QA or the Highway - Component Testing: Bridging the gap between frontend appl...
Leveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and Standards
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
"What does it really mean for your system to be available, or how to define w...
"What does it really mean for your system to be available, or how to define w...
Dandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity server
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
Demystifying Knowledge Management through Storytelling
Demystifying Knowledge Management through Storytelling
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Essentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation Parameters
Poznań ACE event - 19.06.2024 Team 24 Wrapup slidedeck
Poznań ACE event - 19.06.2024 Team 24 Wrapup slidedeck
Hejfaktura
- 1. Painless invoicing for small businesses
- 2. About me • Matti Kotsalainen matti@kotsalainen.org • My dayjob is Creuna, where I work on large CMS projekts • Previously Spray, Razofish, NetEnt, Grin, Soundcloud
- 3. Thanks Emil @ kundo.se!
- 4. DEMO
- 5. Technologies • Django 1.3 with default template engine • Mysql • MongoDB - Events, Loggar, Stats • Memcached • RabbitMQ + Celery • Gunicorn • Nginx
- 6. Deployment • Deploy via git / fabric over ssh • Today a single 512 MB VPS @ Linode.com • Virtuanlenv + requirements.txt • Sentry for exception handling • My own logsystem built in Mongo
- 7. Output • Posten eBREV • Postmark • Dropbox
- 8. Async workers • All contacts with external systems go through async workers. • RabbitMQ + Celeryon queue', email) log_info('Putting email tasks.send_email.delay(email.id) • Celery is also for cronjobs
- 9. Backend • Invoices are made with Reportlab PDFLib • django-reversion for everything displayed on invoices • johnny-cache caches ORM. I need to patch it / move to something else
- 10. Frontend • Compass. CSS on steroids. • I used blueprint grid but it got on my nerves. • Coffeescript. Javascript with better syntax • jQuery, jQuery UI, underscore.js, ICanHaz.js
- 11. How I work • Vim on Mac Air = super fast • IPython • Python CLI debugger • Git
- 12. THANKS!
Editor's Notes
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n