LSPE Meetup talk on Graphite
•Download as ODP, PDF•
2 likes•5,207 views
Slides from my LSPE Meetup talk from June 16, 2011 entitled Enterprise Realtime Graphing with Graphite.
Report
Share
Report
Share
![Graphite Overview ,[object Object]](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)
Recommended
Go Serverless with Cloud Functions and Python
A lightning talk showcasing how to build Serverless code on Google Cloud Platform using Cloud Functions.
Hybrid Application Development for Maemo N900 Device using Qt Webkit - Discov...
The document discusses hybrid application development using HTML and Qt web technology. It provides an overview of hybrid applications, which combine web technologies like HTML, CSS, and JavaScript with native device APIs. This allows developing applications with rapid web development while also accessing powerful device features. The document demonstrates a hybrid app that uses the accelerometer API and rotates images based on device orientation values passed from JavaScript to Qt. It shows how to create the HTML, integrate it into a Qt application using a webview widget, and call JavaScript functions to access native APIs.
2015 Stump the InduSoft Web Studio Expert!
Join InduSoft for a free webinar in which we challenge InduSoft Web Studio expert, Fabio Terezinho - V.P. of Consulting Services at InduSoft, with your toughest questions about InduSoft Web Studio! Ask how to create reports, trigger alarms, or get tips on developing applications more quickly.
Daniel Sikar: Hadoop MapReduce - 06/09/2010
This document discusses using Hadoop MapReduce on Amazon Web Services for parallel processing of large datasets in a distributed manner. It provides an example of counting word frequencies from log files using Hadoop Streaming to run MapReduce jobs with scripts. The steps shown include launching an Elastic MapReduce cluster, uploading data and scripts to S3, running a MapReduce job to count word frequencies from Wikipedia log files, and then terminating the cluster.
RxJS101 - What you need to know to get started with RxJS tomorrow
This document provides an overview of RxJS, a library for composing asynchronous and event-based programs using observable sequences. It discusses key RxJS concepts like Observables, Observers, Operators, and how to create and use Observables. It also provides learning resources and highlights improvements in RxJS 5 like compliance with the Observable specification and better performance.
OpenVisConf - WebGL for graphics and data visualization
WebGL is an API for accessing the GPU from JavaScript to perform graphics and data visualization. It can be used for exploratory visualizations, real-time data analysis, scientific visualization, and data art. WebGL works by using JavaScript to compile GLSL shaders that run on the GPU. Shaders are programs that run on the GPU and are written in GLSL, a C-like language made for graphics with built-in functions. An example application is the Hopf fibration, which maps points on a 3D sphere to circles on a 4D sphere using WebGL.
Programming the cloud with Skywriting
An introduction to cloud programming models and the Skywriting project. Talk originally given at the University of Cambridge, on 11th June 2010.
More information about the Skywriting project can be found here: http://www.cl.cam.ac.uk/netos/skywriting/
RxJS - The Reactive extensions for JavaScript
RxJS is a library for composing asynchronous and event-based programs using observable sequences and functional style operators. It provides developers with Observables to represent asynchronous data streams, operators to query those streams, and Schedulers to parameterize concurrency. Some key operators include map to project values, filter to select values, reduce to aggregate values, and flatMap to flatten nested observables. RxJS supports both hot and cold observables, and is used for tasks like DOM event handling, API communication, and state management in applications.
Recommended
Go Serverless with Cloud Functions and Python
A lightning talk showcasing how to build Serverless code on Google Cloud Platform using Cloud Functions.
Hybrid Application Development for Maemo N900 Device using Qt Webkit - Discov...
The document discusses hybrid application development using HTML and Qt web technology. It provides an overview of hybrid applications, which combine web technologies like HTML, CSS, and JavaScript with native device APIs. This allows developing applications with rapid web development while also accessing powerful device features. The document demonstrates a hybrid app that uses the accelerometer API and rotates images based on device orientation values passed from JavaScript to Qt. It shows how to create the HTML, integrate it into a Qt application using a webview widget, and call JavaScript functions to access native APIs.
2015 Stump the InduSoft Web Studio Expert!
Join InduSoft for a free webinar in which we challenge InduSoft Web Studio expert, Fabio Terezinho - V.P. of Consulting Services at InduSoft, with your toughest questions about InduSoft Web Studio! Ask how to create reports, trigger alarms, or get tips on developing applications more quickly.
Daniel Sikar: Hadoop MapReduce - 06/09/2010
This document discusses using Hadoop MapReduce on Amazon Web Services for parallel processing of large datasets in a distributed manner. It provides an example of counting word frequencies from log files using Hadoop Streaming to run MapReduce jobs with scripts. The steps shown include launching an Elastic MapReduce cluster, uploading data and scripts to S3, running a MapReduce job to count word frequencies from Wikipedia log files, and then terminating the cluster.
RxJS101 - What you need to know to get started with RxJS tomorrow
This document provides an overview of RxJS, a library for composing asynchronous and event-based programs using observable sequences. It discusses key RxJS concepts like Observables, Observers, Operators, and how to create and use Observables. It also provides learning resources and highlights improvements in RxJS 5 like compliance with the Observable specification and better performance.
OpenVisConf - WebGL for graphics and data visualization
WebGL is an API for accessing the GPU from JavaScript to perform graphics and data visualization. It can be used for exploratory visualizations, real-time data analysis, scientific visualization, and data art. WebGL works by using JavaScript to compile GLSL shaders that run on the GPU. Shaders are programs that run on the GPU and are written in GLSL, a C-like language made for graphics with built-in functions. An example application is the Hopf fibration, which maps points on a 3D sphere to circles on a 4D sphere using WebGL.
Programming the cloud with Skywriting
An introduction to cloud programming models and the Skywriting project. Talk originally given at the University of Cambridge, on 11th June 2010.
More information about the Skywriting project can be found here: http://www.cl.cam.ac.uk/netos/skywriting/
RxJS - The Reactive extensions for JavaScript
RxJS is a library for composing asynchronous and event-based programs using observable sequences and functional style operators. It provides developers with Observables to represent asynchronous data streams, operators to query those streams, and Schedulers to parameterize concurrency. Some key operators include map to project values, filter to select values, reduce to aggregate values, and flatMap to flatten nested observables. RxJS supports both hot and cold observables, and is used for tasks like DOM event handling, API communication, and state management in applications.
University of Bedford Knowledge Network 2.12.13
This document provides information on 100 different topics that could be learned in 50 minutes. It includes statistics on website visits, keywords, and common myths about search engine optimization. The document also features a quote from Google co-founder Sergey Brin about how Google users have the power to easily switch to other search engines if they want.
Introduction to PiCloud
A simple introduction to PiCloud presented to the PyAtl: Atlanta Python Programmers at their monthly Meetup on August 9, 2012
Viva 20.11.2013 google analytics
A simple guide to using Google Analytics with a sensible To Do list and minimal geekiness for the lovely folks at Viva Networking
Leaving Flatland: Getting Started with WebGL- SXSW 2012
This document discusses getting started with WebGL. It begins with an introduction to WebGL, explaining that it allows 3D graphics in browsers similarly to OpenGL. It then provides examples of what can be done with WebGL, such as data visualization, games, 3D modeling, and more. The document proceeds to explain the basic graphics pipeline and JavaScript API used in WebGL. It concludes by discussing how to set up a basic 3D scene and choose a WebGL library like Three.js or PhiloGL to get started creating WebGL applications.
R and Athena … there is another way!?
When setting up JDBC or ODBC drivers to AWS Athena proves to be too difficult, is there another way? Well yes! with the new RAthena and noctua packages, R users can now connect to AWS Athena by using AWS SDK's.
Kinect de-theremin
This document discusses using the Kinect sensor with Node.js. It describes connecting the Kinect to Node.js using the Audio Data API and Socket.IO for real-time data streaming. Code examples are provided for an Express server to handle requests and websockets, and using TCP/IP to receive Kinect sensor data and broadcast it over websockets.
Shiny r, live shared and explored
Shiny is a web application framework for R that allows users to build interactive web apps and dashboards. It makes R analyses more accessible by enabling live, shared, and interactive experiences. With Shiny, users write the user interface in ui.R and the server logic in server.R. Basic demos showed how to link inputs like text boxes and dropdowns to outputs like text and plots. Shiny supports all R graphics and its reactive programming allows automatic updates. This enables exploration of data and parameters. Integrations with JavaScript libraries like d3 allow highly interactive visualizations.
DevOps Do's and Don'ts, DevOpsDays SV 2013
Slides from my DevOps Do's and Don'ts Ignite talk from DevOpsDays 2013. Helpful tips and tricks I've learned when going through a devops transformation.
S4 xen hypervisor_20080622
The document provides an overview of the Open Source Xen Hypervisor, including introductions to virtualization concepts, the Xen architecture, installing and configuring Xen and guest virtual machines, and advanced topics like devices and network configurations. It includes hands-on demonstrations of installing Xen, creating paravirtualized and hardware virtualized guests, and interacting with guests using tools like VNC. The document is intended as training material for a full-day course on using the open source Xen hypervisor.
Data-Driven Operations - Practice realtime data analyse
Grab data from any of logs and operations in realtime. Enable the power to find problem instantly. And make all operations based on data.
The Importance of Data
The document discusses the growing importance and volume of data in today's world. It notes that 3.3 exabytes of new data will be created every day this year, fueled by factors like social media, e-commerce, and IoT devices. It also outlines how data technologies and solutions are advancing, creating new opportunities in fields like big data implementation. The document encourages the reader to enroll in the course to gain practical skills through projects in areas like databases, analytics, and emerging data technologies.
XPDS16: Consideration of Real Time GPU Scheduling of XenGT in Automotive Embe...
XPDS16: Consideration of Real Time GPU Scheduling of XenGT in Automotive Embe...The Linux Foundation
This presentation will introduce simple real-time GPU scheduler of XenGT running on automotive embedded system and explain why the real-time GPU scheduling and preemption should be needed for automotive system.
The reference target of automotive system consists of two VMs(Virtual Machine) which run on XenGT. One is digital instrument cluster VM and the other is In-Vehicle Infotainment VM. In case of digital instrument cluster system, it must guarantee the real-time GPU rendering of speedometer application at least 60 fps. To do this, GPU scheduler should support a priority-based scheduling and preemption function. The presentation will cover the current status of GPU virtulaization and what is needed to meet the requirement of real-time GPU rendering in automotive system.RealTime AdTech reporting & targeting with Apache Apex
AdTech companies need to address data increase at breakneck speed along with customer demands of insights &
analytical reports. At PubMatic we receive billions of events and several TBs of data per day from various geographic regions. This high volume data needs to be processed in realtime to derive actionable insights such as campaign decisions, audience targeting and also provide feedback loop to AdServer for making efficient ad serving decisions. In this talk we will share how we designed and implemented these scalable low latency realtime data processing solutions for our use cases using Apache Apex.
Reactive Stream Processing with Mantis
This document discusses Mantis, a reactive stream processing system for operational insights. Mantis allows querying data on-demand, reusing data and results between jobs for efficiency. It enables job chaining through discovery of job outputs and auto-scales jobs and clusters based on workload. Mantis provides high throughput and low latency stream processing while maintaining data guarantees.
Realtime interactive dashboard 2015
This document describes Sitar's data analytics tools and dashboards. It highlights that Sitar provides open data integration from any source, outputs data in the right format, and delivers it to the authorized people at the right time or in real-time. It also mentions that dynamic dashboards can be easily created using Google Charts and Maps and accessed from mobile devices. Finally, it notes that Sitar allows easy combination of different data types into one place and customizable dashboards in an interactive and time-saving manner.
Mobile webapplication development
The document discusses several HTML5 APIs including Geolocation, Web Storage, Web SQL, Web Workers, Web Sockets, and Canvas. It provides code examples and explanations for how each API works and can be used, including getting a user's location, storing data locally, running scripts in parallel threads, enabling real-time communications, and drawing graphics. It also mentions some use cases for these technologies like building games, performing intensive calculations, and syntax highlighting.
Monitoring Spark Applications
Monitoring Spark Applications
Tzach Zohar @ Kenshoo, March/2016
The document discusses monitoring Spark applications. It covers using the Spark UI to monitor jobs, stages and tasks; using the Spark REST API to programmatically access monitoring data; configuring Spark metric sinks like Graphite to export internal Spark metrics; and creating applicative metrics to monitor your own application metrics. The key points are monitoring is important for failures, performance, correctness and understanding data; Spark provides built-in tools but applicative metrics are also useful; and Graphite is well-suited to analyze metrics trends over time.
Realtime Analytics Using MongoDB, Python, Gevent, and ZeroMQ
Zarkov is a real-time analytics platform that uses MongoDB, Python, Gevent, and ZeroMQ to aggregate and analyze event data. It handles high volumes of event ingestion and uses a lightweight map/reduce framework to incrementally calculate statistics. The system was developed at SourceForge.net to monitor user and project activity in real-time and has proven capable of replacing other analytics solutions.
GWT Extreme!
In this session, see Google Web Toolkit used in exotic and creative ways to solve interesting engineering problems, from authoring OpenSocial apps that run as both Web gadgets and native Android applications, to developing Adobe AIR applications using GWT, compiling CSS selectors to Javascript at compile time, running multithreaded code with GWT and Gears workers, or exporting GWT libraries for JavaScript users. Learn the secrets of writing "faster than possible" GWT code, how to use Generators and Linkers in harmony, and make seamless procedure calls from GWT code to other environments like Flash, Gears, or Android.
Graphite, an introduction
Graphite is an open source tool that allows users to store and graph time-series data. It consists of three main parts - carbon for receiving metrics, whisper for storing metrics data files, and a web UI for graphing and dashboards. Graphite provides a simple way to collect and visualize many different types of application and system performance metrics over time which helps with monitoring, trend analysis, and capacity planning. Data can be fed into Graphite from various sources including scripts, programming languages, and collection agents like Collectd and StatsD. It is widely used for large scale real-time monitoring of hundreds of thousands of metrics per minute.
Play! Framework for JavaEE Developers
User.getUser(Long id) and User.getUsers(Long page, int cnt) methods retrieve data from the cache using different keys. So modifying and saving an object retrieved by getUser does not update the cached collection returned by getUsers, leading to inconsistencies. Play's caching at the model level does not consider relationships between entities.
Introduction To Groovy 2005
The document introduces dynamic languages and provides examples comparing Java and Groovy implementations of a filtering task. It discusses the benefits of Groovy, including its Java-like syntax, dynamic typing, built-in support for lists/maps/arrays, closures, and additional libraries that simplify APIs. Groovy aims to integrate well with Java while adding meta-programming capabilities. The document provides examples of common uses of Groovy and its features.
More Related Content
What's hot
University of Bedford Knowledge Network 2.12.13
This document provides information on 100 different topics that could be learned in 50 minutes. It includes statistics on website visits, keywords, and common myths about search engine optimization. The document also features a quote from Google co-founder Sergey Brin about how Google users have the power to easily switch to other search engines if they want.
Introduction to PiCloud
A simple introduction to PiCloud presented to the PyAtl: Atlanta Python Programmers at their monthly Meetup on August 9, 2012
Viva 20.11.2013 google analytics
A simple guide to using Google Analytics with a sensible To Do list and minimal geekiness for the lovely folks at Viva Networking
Leaving Flatland: Getting Started with WebGL- SXSW 2012
This document discusses getting started with WebGL. It begins with an introduction to WebGL, explaining that it allows 3D graphics in browsers similarly to OpenGL. It then provides examples of what can be done with WebGL, such as data visualization, games, 3D modeling, and more. The document proceeds to explain the basic graphics pipeline and JavaScript API used in WebGL. It concludes by discussing how to set up a basic 3D scene and choose a WebGL library like Three.js or PhiloGL to get started creating WebGL applications.
R and Athena … there is another way!?
When setting up JDBC or ODBC drivers to AWS Athena proves to be too difficult, is there another way? Well yes! with the new RAthena and noctua packages, R users can now connect to AWS Athena by using AWS SDK's.
Kinect de-theremin
This document discusses using the Kinect sensor with Node.js. It describes connecting the Kinect to Node.js using the Audio Data API and Socket.IO for real-time data streaming. Code examples are provided for an Express server to handle requests and websockets, and using TCP/IP to receive Kinect sensor data and broadcast it over websockets.
Shiny r, live shared and explored
Shiny is a web application framework for R that allows users to build interactive web apps and dashboards. It makes R analyses more accessible by enabling live, shared, and interactive experiences. With Shiny, users write the user interface in ui.R and the server logic in server.R. Basic demos showed how to link inputs like text boxes and dropdowns to outputs like text and plots. Shiny supports all R graphics and its reactive programming allows automatic updates. This enables exploration of data and parameters. Integrations with JavaScript libraries like d3 allow highly interactive visualizations.
What's hot (7)
Leaving Flatland: Getting Started with WebGL- SXSW 2012
Leaving Flatland: Getting Started with WebGL- SXSW 2012
Viewers also liked
DevOps Do's and Don'ts, DevOpsDays SV 2013
Slides from my DevOps Do's and Don'ts Ignite talk from DevOpsDays 2013. Helpful tips and tricks I've learned when going through a devops transformation.
S4 xen hypervisor_20080622
The document provides an overview of the Open Source Xen Hypervisor, including introductions to virtualization concepts, the Xen architecture, installing and configuring Xen and guest virtual machines, and advanced topics like devices and network configurations. It includes hands-on demonstrations of installing Xen, creating paravirtualized and hardware virtualized guests, and interacting with guests using tools like VNC. The document is intended as training material for a full-day course on using the open source Xen hypervisor.
Data-Driven Operations - Practice realtime data analyse
Grab data from any of logs and operations in realtime. Enable the power to find problem instantly. And make all operations based on data.
The Importance of Data
The document discusses the growing importance and volume of data in today's world. It notes that 3.3 exabytes of new data will be created every day this year, fueled by factors like social media, e-commerce, and IoT devices. It also outlines how data technologies and solutions are advancing, creating new opportunities in fields like big data implementation. The document encourages the reader to enroll in the course to gain practical skills through projects in areas like databases, analytics, and emerging data technologies.
XPDS16: Consideration of Real Time GPU Scheduling of XenGT in Automotive Embe...
XPDS16: Consideration of Real Time GPU Scheduling of XenGT in Automotive Embe...The Linux Foundation
This presentation will introduce simple real-time GPU scheduler of XenGT running on automotive embedded system and explain why the real-time GPU scheduling and preemption should be needed for automotive system.
The reference target of automotive system consists of two VMs(Virtual Machine) which run on XenGT. One is digital instrument cluster VM and the other is In-Vehicle Infotainment VM. In case of digital instrument cluster system, it must guarantee the real-time GPU rendering of speedometer application at least 60 fps. To do this, GPU scheduler should support a priority-based scheduling and preemption function. The presentation will cover the current status of GPU virtulaization and what is needed to meet the requirement of real-time GPU rendering in automotive system.RealTime AdTech reporting & targeting with Apache Apex
AdTech companies need to address data increase at breakneck speed along with customer demands of insights &
analytical reports. At PubMatic we receive billions of events and several TBs of data per day from various geographic regions. This high volume data needs to be processed in realtime to derive actionable insights such as campaign decisions, audience targeting and also provide feedback loop to AdServer for making efficient ad serving decisions. In this talk we will share how we designed and implemented these scalable low latency realtime data processing solutions for our use cases using Apache Apex.
Reactive Stream Processing with Mantis
This document discusses Mantis, a reactive stream processing system for operational insights. Mantis allows querying data on-demand, reusing data and results between jobs for efficiency. It enables job chaining through discovery of job outputs and auto-scales jobs and clusters based on workload. Mantis provides high throughput and low latency stream processing while maintaining data guarantees.
Realtime interactive dashboard 2015
This document describes Sitar's data analytics tools and dashboards. It highlights that Sitar provides open data integration from any source, outputs data in the right format, and delivers it to the authorized people at the right time or in real-time. It also mentions that dynamic dashboards can be easily created using Google Charts and Maps and accessed from mobile devices. Finally, it notes that Sitar allows easy combination of different data types into one place and customizable dashboards in an interactive and time-saving manner.
Viewers also liked (8)
Data-Driven Operations - Practice realtime data analyse
Data-Driven Operations - Practice realtime data analyse
XPDS16: Consideration of Real Time GPU Scheduling of XenGT in Automotive Embe...
XPDS16: Consideration of Real Time GPU Scheduling of XenGT in Automotive Embe...
RealTime AdTech reporting & targeting with Apache Apex
RealTime AdTech reporting & targeting with Apache Apex
Similar to LSPE Meetup talk on Graphite
Mobile webapplication development
The document discusses several HTML5 APIs including Geolocation, Web Storage, Web SQL, Web Workers, Web Sockets, and Canvas. It provides code examples and explanations for how each API works and can be used, including getting a user's location, storing data locally, running scripts in parallel threads, enabling real-time communications, and drawing graphics. It also mentions some use cases for these technologies like building games, performing intensive calculations, and syntax highlighting.
Monitoring Spark Applications
Monitoring Spark Applications
Tzach Zohar @ Kenshoo, March/2016
The document discusses monitoring Spark applications. It covers using the Spark UI to monitor jobs, stages and tasks; using the Spark REST API to programmatically access monitoring data; configuring Spark metric sinks like Graphite to export internal Spark metrics; and creating applicative metrics to monitor your own application metrics. The key points are monitoring is important for failures, performance, correctness and understanding data; Spark provides built-in tools but applicative metrics are also useful; and Graphite is well-suited to analyze metrics trends over time.
Realtime Analytics Using MongoDB, Python, Gevent, and ZeroMQ
Zarkov is a real-time analytics platform that uses MongoDB, Python, Gevent, and ZeroMQ to aggregate and analyze event data. It handles high volumes of event ingestion and uses a lightweight map/reduce framework to incrementally calculate statistics. The system was developed at SourceForge.net to monitor user and project activity in real-time and has proven capable of replacing other analytics solutions.
GWT Extreme!
In this session, see Google Web Toolkit used in exotic and creative ways to solve interesting engineering problems, from authoring OpenSocial apps that run as both Web gadgets and native Android applications, to developing Adobe AIR applications using GWT, compiling CSS selectors to Javascript at compile time, running multithreaded code with GWT and Gears workers, or exporting GWT libraries for JavaScript users. Learn the secrets of writing "faster than possible" GWT code, how to use Generators and Linkers in harmony, and make seamless procedure calls from GWT code to other environments like Flash, Gears, or Android.
Graphite, an introduction
Graphite is an open source tool that allows users to store and graph time-series data. It consists of three main parts - carbon for receiving metrics, whisper for storing metrics data files, and a web UI for graphing and dashboards. Graphite provides a simple way to collect and visualize many different types of application and system performance metrics over time which helps with monitoring, trend analysis, and capacity planning. Data can be fed into Graphite from various sources including scripts, programming languages, and collection agents like Collectd and StatsD. It is widely used for large scale real-time monitoring of hundreds of thousands of metrics per minute.
Play! Framework for JavaEE Developers
User.getUser(Long id) and User.getUsers(Long page, int cnt) methods retrieve data from the cache using different keys. So modifying and saving an object retrieved by getUser does not update the cached collection returned by getUsers, leading to inconsistencies. Play's caching at the model level does not consider relationships between entities.
Introduction To Groovy 2005
The document introduces dynamic languages and provides examples comparing Java and Groovy implementations of a filtering task. It discusses the benefits of Groovy, including its Java-like syntax, dynamic typing, built-in support for lists/maps/arrays, closures, and additional libraries that simplify APIs. Groovy aims to integrate well with Java while adding meta-programming capabilities. The document provides examples of common uses of Groovy and its features.
HTML5 and CartoDB
CartoDB provides tools for creating interactive maps using HTML5. This allows for removing proprietary software dependencies and creating an open platform for map innovation. Some of the key features demonstrated include rendering vector data and performing client-side raster operations in HTML5 canvases, as well as editing vector data directly in the browser. Challenges remain in browser compatibility, rendering performance, and data management, but the HTML5 approach has potential to improve maps and make mapping more accessible.
Monitoring Your ISP Using InfluxDB Cloud and Raspberry Pi
When a large group of people change their habits, it can be tricky for infrastructures! Working from home and spending time indoor today means attending video calls and streaming movies and tv shows. This leads to increased internet traffic that can create congestion on the network infrastructure. So how do you get real-time visibility into your ISP connection? In this meetup, Mirko presents his setup based on a time series database and Raspberry Pi to better understand his ISP connection quality and speed — including upload and download speeds. Join us to discover how he does it using Telegraf, InfluxDB Cloud, Astro Pi, Telegram and Grafana! Finally, proof that your ISP connection is (or is not) as fast as it promises.
node.js - Eventful JavaScript on the Server
Presentation made on January 2011 about node.js. This technology was used to be the main technology behind the API on "Guia VIVO TV" (codename TVSTAR) with MongoDB.
How data rules the world: Telemetry in Battlefield Heroes
By Kristoffer Benjaminsson, CTO, Easy.
This talk presents the telemetry system used in Battlefield Heroes and how it helps the team make technical decisions in order to provide the best service possible. We will show real life examples of how telemetry helped improve matchmaking, reduce latency for players and help find false alarms from the cheat detection system. We will also discuss how telemetry can be used in development for catching bugs and support game designers in their work.
A tech writer, a map, and an app
The document discusses the development of a web and mobile app called "Tech Comm on a Map" that maps events and resources related to technical communication. Key points:
- The app allows users to contribute tech comm events and resources through a web form or Android app, which are stored in a Google Sheet and displayed on an interactive map using the Google Maps API.
- The web app was created using HTML, CSS, JavaScript and jQuery. Data is retrieved from Google Sheets using Apps Script.
- An Android version was also developed using Java and the Google Maps Android API to make the map accessible on mobile.
- The project is open source on GitHub and the developer discusses lessons learned around community collaboration and
Python and trending_data_ops
This is a talk I gave to the late crew at the DevOps KC meetup outlining why/what/how of setting up a Graphite server using Python end-to-end for getting stats.
JQuery Flot
JQuery Flot is a charting library that allows creating line, bar, and pie charts. It works across many browsers from IE6+ and has plugins for additional chart types. The document discusses using Flot to display time-series data with tabs, radio buttons, and tooltips. Code examples are provided for building the charts, handling interactions, and blocking elements to indicate loading.
Google Maps API 101
This document provides an introduction to using the Google Maps API, including how to load the API, create a map container, add a map to the container with default styling, and add a marker to the map. It also briefly outlines some additional features that can be used like geocoding, custom styling, drawing tools, and more. The document encourages exploring the API further and provides resources for doing so.
GIS in the Rockies 2011: Building Distributed JavaScript Map Widgets with Ope...
Presented at the GIS in the Rockies conference by Allan Glen and Dan Hauser.
This presentation expands on the content the was presented in March at the ESRI Dev Meetup. At that time, we had just gone live with the first maps using this technique. Since then, we have rolled out many more maps and the widget approach has been very successful.
Open Source Ajax Solution @OSDC.tw 2009
This document provides an overview of various open source Ajax solutions including jQuery + DWR, GWT, and ZK. jQuery is a JavaScript library that simplifies DOM manipulation and AJAX requests. DWR allows making remote procedure calls from JavaScript to Java. GWT compiles Java code to JavaScript and supports component-based development. ZK is a server-centric framework that uses XML markup and allows building rich web applications in pure Java without writing JavaScript.
Writing robust Node.js applications
This document provides an introduction and overview of a Node.js tutorial presented by Tom Hughes-Croucher. The tutorial covers topics such as building scalable server-side code with JavaScript using Node.js, debugging Node.js applications, using frameworks like Express.js, and best practices for deploying Node.js applications in production environments. The tutorial includes exercises for hands-on learning and demonstrates tools and techniques like Socket.io, clustering, error handling and using Redis with Node.js applications.
State of the Art Web Mapping with Open Source
This document discusses the importance of open source tools and data for web mapping. It begins by providing background on TileMill and Mapbox, which provide open source tools for making maps. It then discusses key concepts in web mapping like geospatial data formats, tile rendering, and minimal code examples. Modern approaches to web mapping involve preprocessing data, using tile renderers and caches, and gradually rendering more client-side. Upcoming improvements may optimize tiled formats and storage. TileMill is demonstrated as an open source tool for making maps. The talk concludes by emphasizing other open mapping tools like CartoDB, Stamen, and CartoDB that build on these concepts.
Implementing Comet using PHP
This talk was given at the Dutch PHP Conference 2011 and details the use of Comet (aka reverse ajax or ajax push) technologies and the importance of websockets and server-sent events. More information is available at http://joind.in/3237.
Similar to LSPE Meetup talk on Graphite (20)
Realtime Analytics Using MongoDB, Python, Gevent, and ZeroMQ
Realtime Analytics Using MongoDB, Python, Gevent, and ZeroMQ
Monitoring Your ISP Using InfluxDB Cloud and Raspberry Pi
Monitoring Your ISP Using InfluxDB Cloud and Raspberry Pi
How data rules the world: Telemetry in Battlefield Heroes
How data rules the world: Telemetry in Battlefield Heroes
GIS in the Rockies 2011: Building Distributed JavaScript Map Widgets with Ope...
GIS in the Rockies 2011: Building Distributed JavaScript Map Widgets with Ope...
More from Dave Mangot
There's no such thing as DevSecOps
The document is a series of tweets discussing DevOps and related concepts. It mentions that there is no such thing as DevSecOps alone. It discusses Gene Kim's three ways framework which emphasizes performance of the entire system. It also lists out different variations of terms combining DevOps with other functions like security, sales, and HR. In the end, it simply states DevOps.
People management for distributed teams
The document outlines Dave Mangot's agenda for a presentation on managing distributed teams. The agenda includes discussing basics of working from home, scrum practices like sprint planning, standup meetings, demos and retrospectives, one-on-one meetings, and additional resources. The presentation aims to provide guidance on managing remote teams through virtual collaboration tools and establishing effective communication practices.
Familiar Smells I've Detected in Your Systems Engineering Organization - SREC...
This document summarizes a talk on systems engineering smells and fixes. It discusses common problems observed such as outsourced operations, lack of testing and automation, and suppressed volatility. It recommends adopting practices like infrastructure testing, automated deployments, and chaos engineering to improve reliability and prevent failures by learning from errors in a staged manner. Configuration should be coded and production readiness validated through gamedays to ensure systems can withstand failures.
Familiar Smells I've Detected in Your Systems Engineering Organization...And ...
This document summarizes Dave Mangot's presentation on smells he has detected in systems engineering organizations and how to fix them. It discusses problems like outsourced operations leading to never-ending projects, not solving problems but just fixing them, and conway's law creating misaligned engineering and operations teams. It then provides recommendations for improving practices such as testing infrastructure, automating deployments, using configuration management for stateful applications, implementing chaos engineering, and conducting production readiness gamedays. The overall message is that organizations should focus on reliability over preventing failures and adopt a crawl-walk-run approach to transformation.
Observability in DevOps with Modern Distributed Applications
The document discusses observability in DevOps and modern distributed applications. It covers topics like DevOps, the three ways of DevOps, uptime monitoring, latency, metrics, logging, tracing, and the four golden signals. SolarWinds is introduced as a company that provides tools to help with observability, monitoring, logging and tracing across distributed systems.
Distributed DevOps - Distance is Divine
The document discusses various topics related to distributed DevOps including stand-up meetings, architecture meetings, retrospectives, chatops, sync meetings, onsites, and hack events. It emphasizes that while distance can be challenging, tools like stand-ups and chatops can help turn remote out-groups into collaborative in-groups by making work more visible and transparent.
The Cynefin Model for Operational Transformation
Ignite talk from DevOpsDays Austin 2016. Mapping operational transformation into the Cynefin model.
The Cognitive Neuroscience of Empathy, DevOpsDays Austin 2016
Slide from The Cognitive Neuroscience of Empathy, You're A DevOps Natural, including speaker notes and bibliographies
The Cognitive Neuroscience of Empathy, DevOpsDays Vancouver 2016
This document is a slide deck for a talk on the cognitive neuroscience of empathy and how it relates to DevOps. It discusses how empathy involves sharing others' feelings, understanding their perspective, and being motivated to help without cost-benefit analysis. Empathy allows understanding different viewpoints and avoiding misattributions. Selected references on the neural basis of empathy and its role in prosocial behavior and reducing prejudice are provided.
DevOps Across the Enterprise
This document summarizes a talk on implementing DevOps across large enterprises. It discusses that DevOps is about continuous flow and improvement, not specific tools, and these principles can apply to large complex organizations as well as startups. It provides examples of systems thinking practices like continuous integration pipelines and transparency practices like shared code repositories. The talk suggests DevOps requires involvement from departments beyond just development and operations, including quality assurance, security, sales, product and others. It emphasizes thinking about improving the performance of the entire system rather than individual silos.
The Cognitve Neuroscience of Empathy: You're a DevOps Natural
This document summarizes research on the cognitive neuroscience of empathy. It discusses how mirror neurons in the brain allow people to naturally understand and share the feelings of others (emotional contagion). Experiments show that when people observe facial expressions of emotions, the same areas of their brain are activated as if experiencing that emotion firsthand. The document also notes that people more easily empathize with in-group members due to increased activation of brain regions involved in mentalizing. While empathy has long been recognized as important for human relationships, modern neuroscience now provides biological evidence for how and why humans connect with each other.
On the journey of an enterprise transformation, Quality is still Job 1
The document discusses the role of quality engineering (QE) in enabling an enterprise transformation to DevOps. It advocates for building quality into products from the start rather than relying on inspection. The QE team at Salesforce works across borders to ensure quality. For a DevOps transformation, QE expands to infrastructure and operations teams and helps automate infrastructure testing. Collaboration between QE, developers, operations, and security helps design systems to assume failure and continuously test and integrate improvements. Quality becomes everyone's responsibility in delivering high quality services to customers.
Agile.2013.effecting.a.dev ops.transformation.at.salesforce
Presentation by @davemangot and @kabbyr on the reasons behind, and mechanisms for a DevOps transformation at Salesforce.
More from Dave Mangot (13)
Familiar Smells I've Detected in Your Systems Engineering Organization - SREC...
Familiar Smells I've Detected in Your Systems Engineering Organization - SREC...
Familiar Smells I've Detected in Your Systems Engineering Organization...And ...
Familiar Smells I've Detected in Your Systems Engineering Organization...And ...
Observability in DevOps with Modern Distributed Applications
Observability in DevOps with Modern Distributed Applications
The Cognitive Neuroscience of Empathy, DevOpsDays Austin 2016
The Cognitive Neuroscience of Empathy, DevOpsDays Austin 2016
The Cognitive Neuroscience of Empathy, DevOpsDays Vancouver 2016
The Cognitive Neuroscience of Empathy, DevOpsDays Vancouver 2016
The Cognitve Neuroscience of Empathy: You're a DevOps Natural
The Cognitve Neuroscience of Empathy: You're a DevOps Natural
On the journey of an enterprise transformation, Quality is still Job 1
On the journey of an enterprise transformation, Quality is still Job 1
Agile.2013.effecting.a.dev ops.transformation.at.salesforce
Agile.2013.effecting.a.dev ops.transformation.at.salesforce
Recently uploaded
Full-RAG: A modern architecture for hyper-personalization
Mike Del Balso, CEO & Co-Founder at Tecton, presents "Full RAG," a novel approach to AI recommendation systems, aiming to push beyond the limitations of traditional models through a deep integration of contextual insights and real-time data, leveraging the Retrieval-Augmented Generation architecture. This talk will outline Full RAG's potential to significantly enhance personalization, address engineering challenges such as data management and model training, and introduce data enrichment with reranking as a key solution. Attendees will gain crucial insights into the importance of hyperpersonalization in AI, the capabilities of Full RAG for advanced personalization, and strategies for managing complex data integrations for deploying cutting-edge AI solutions.
Mind map of terminologies used in context of Generative AI
Mind map of common terms used in context of Generative AI.
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-und-domino-lizenzkostenreduzierung-in-der-welt-von-dlau/
DLAU und die Lizenzen nach dem CCB- und CCX-Modell sind für viele in der HCL-Community seit letztem Jahr ein heißes Thema. Als Notes- oder Domino-Kunde haben Sie vielleicht mit unerwartet hohen Benutzerzahlen und Lizenzgebühren zu kämpfen. Sie fragen sich vielleicht, wie diese neue Art der Lizenzierung funktioniert und welchen Nutzen sie Ihnen bringt. Vor allem wollen Sie sicherlich Ihr Budget einhalten und Kosten sparen, wo immer möglich. Das verstehen wir und wir möchten Ihnen dabei helfen!
Wir erklären Ihnen, wie Sie häufige Konfigurationsprobleme lösen können, die dazu führen können, dass mehr Benutzer gezählt werden als nötig, und wie Sie überflüssige oder ungenutzte Konten identifizieren und entfernen können, um Geld zu sparen. Es gibt auch einige Ansätze, die zu unnötigen Ausgaben führen können, z. B. wenn ein Personendokument anstelle eines Mail-Ins für geteilte Mailboxen verwendet wird. Wir zeigen Ihnen solche Fälle und deren Lösungen. Und natürlich erklären wir Ihnen das neue Lizenzmodell.
Nehmen Sie an diesem Webinar teil, bei dem HCL-Ambassador Marc Thomas und Gastredner Franz Walder Ihnen diese neue Welt näherbringen. Es vermittelt Ihnen die Tools und das Know-how, um den Überblick zu bewahren. Sie werden in der Lage sein, Ihre Kosten durch eine optimierte Domino-Konfiguration zu reduzieren und auch in Zukunft gering zu halten.
Diese Themen werden behandelt
- Reduzierung der Lizenzkosten durch Auffinden und Beheben von Fehlkonfigurationen und überflüssigen Konten
- Wie funktionieren CCB- und CCX-Lizenzen wirklich?
- Verstehen des DLAU-Tools und wie man es am besten nutzt
- Tipps für häufige Problembereiche, wie z. B. Team-Postfächer, Funktions-/Testbenutzer usw.
- Praxisbeispiele und Best Practices zum sofortigen Umsetzen
“I’m still / I’m still / Chaining from the Block”
“An Outlook of the Ongoing and Future Relationship between Blockchain Technologies and Process-aware Information Systems.” Invited talk at the joint workshop on Blockchain for Information Systems (BC4IS) and Blockchain for Trusted Data Sharing (B4TDS), co-located with with the 36th International Conference on Advanced Information Systems Engineering (CAiSE), 3 June 2024, Limassol, Cyprus.
Building Production Ready Search Pipelines with Spark and Milvus
Spark is the widely used ETL tool for processing, indexing and ingesting data to serving stack for search. Milvus is the production-ready open-source vector database. In this talk we will show how to use Spark to process unstructured data to extract vector representations, and push the vectors to Milvus vector database for search serving.
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
As the digital landscape continually evolves, operating systems play a critical role in shaping user experiences and productivity. The launch of Nitrux Linux 3.5.0 marks a significant milestone, offering a robust alternative to traditional systems such as Windows 11. This article delves into the essence of Nitrux Linux 3.5.0, exploring its unique features, advantages, and how it stands as a compelling choice for both casual users and tech enthusiasts.
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for life science domain, where you retriever information from biomedical knowledge graphs using LLMs to increase the accuracy and performance of generated answers
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Unlocking Productivity: Leveraging the Potential of Copilot in Microsoft 365, a presentation by Christoforos Vlachos, Senior Solutions Manager – Modern Workplace, Uni Systems
Infrastructure Challenges in Scaling RAG with Custom AI models
Building Retrieval-Augmented Generation (RAG) systems with open-source and custom AI models is a complex task. This talk explores the challenges in productionizing RAG systems, including retrieval performance, response synthesis, and evaluation. We’ll discuss how to leverage open-source models like text embeddings, language models, and custom fine-tuned models to enhance RAG performance. Additionally, we’ll cover how BentoML can help orchestrate and scale these AI components efficiently, ensuring seamless deployment and management of RAG systems in the cloud.
Microsoft - Power Platform_G.Aspiotis.pdf
Revolutionizing Application Development
with AI-powered low-code, presentation by George Aspiotis, Sr. Partner Development Manager, Microsoft
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
Imagine a world where machines not only perform tasks but also learn, adapt, and make decisions. This is the promise of Artificial Intelligence (AI), a technology that's not just enhancing our lives but revolutionizing entire industries.
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...Edge AI and Vision Alliance
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/06/building-and-scaling-ai-applications-with-the-nx-ai-manager-a-presentation-from-network-optix/
Robin van Emden, Senior Director of Data Science at Network Optix, presents the “Building and Scaling AI Applications with the Nx AI Manager,” tutorial at the May 2024 Embedded Vision Summit.
In this presentation, van Emden covers the basics of scaling edge AI solutions using the Nx tool kit. He emphasizes the process of developing AI models and deploying them globally. He also showcases the conversion of AI models and the creation of effective edge AI pipelines, with a focus on pre-processing, model conversion, selecting the appropriate inference engine for the target hardware and post-processing.
van Emden shows how Nx can simplify the developer’s life and facilitate a rapid transition from concept to production-ready applications.He provides valuable insights into developing scalable and efficient edge AI solutions, with a strong focus on practical implementation.Driving Business Innovation: Latest Generative AI Advancements & Success Story
Are you ready to revolutionize how you handle data? Join us for a webinar where we’ll bring you up to speed with the latest advancements in Generative AI technology and discover how leveraging FME with tools from giants like Google Gemini, Amazon, and Microsoft OpenAI can supercharge your workflow efficiency.
During the hour, we’ll take you through:
Guest Speaker Segment with Hannah Barrington: Dive into the world of dynamic real estate marketing with Hannah, the Marketing Manager at Workspace Group. Hear firsthand how their team generates engaging descriptions for thousands of office units by integrating diverse data sources—from PDF floorplans to web pages—using FME transformers, like OpenAIVisionConnector and AnthropicVisionConnector. This use case will show you how GenAI can streamline content creation for marketing across the board.
Ollama Use Case: Learn how Scenario Specialist Dmitri Bagh has utilized Ollama within FME to input data, create custom models, and enhance security protocols. This segment will include demos to illustrate the full capabilities of FME in AI-driven processes.
Custom AI Models: Discover how to leverage FME to build personalized AI models using your data. Whether it’s populating a model with local data for added security or integrating public AI tools, find out how FME facilitates a versatile and secure approach to AI.
We’ll wrap up with a live Q&A session where you can engage with our experts on your specific use cases, and learn more about optimizing your data workflows with AI.
This webinar is ideal for professionals seeking to harness the power of AI within their data management systems while ensuring high levels of customization and security. Whether you're a novice or an expert, gain actionable insights and strategies to elevate your data processes. Join us to see how FME and AI can revolutionize how you work with data!
Communications Mining Series - Zero to Hero - Session 1
This session provides introduction to UiPath Communication Mining, importance and platform overview. You will acquire a good understand of the phases in Communication Mining as we go over the platform with you. Topics covered:
• Communication Mining Overview
• Why is it important?
• How can it help today’s business and the benefits
• Phases in Communication Mining
• Demo on Platform overview
• Q/A
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
ABSTRACT: A prima vista, un mattoncino Lego e la backdoor XZ potrebbero avere in comune il fatto di essere entrambi blocchi di costruzione, o dipendenze di progetti creativi e software. La realtà è che un mattoncino Lego e il caso della backdoor XZ hanno molto di più di tutto ciò in comune.
Partecipate alla presentazione per immergervi in una storia di interoperabilità, standard e formati aperti, per poi discutere del ruolo importante che i contributori hanno in una comunità open source sostenibile.
BIO: Sostenitrice del software libero e dei formati standard e aperti. È stata un membro attivo dei progetti Fedora e openSUSE e ha co-fondato l'Associazione LibreItalia dove è stata coinvolta in diversi eventi, migrazioni e formazione relativi a LibreOffice. In precedenza ha lavorato a migrazioni e corsi di formazione su LibreOffice per diverse amministrazioni pubbliche e privati. Da gennaio 2020 lavora in SUSE come Software Release Engineer per Uyuni e SUSE Manager e quando non segue la sua passione per i computer e per Geeko coltiva la sua curiosità per l'astronomia (da cui deriva il suo nickname deneb_alpha).
20240607 QFM018 Elixir Reading List May 2024
Everything I found interesting about the Elixir programming ecosystem in May 2024
Recently uploaded (20)
Full-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalization
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
Infrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI models
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
LSPE Meetup talk on Graphite
- 1. Realtime Enterprise Graphing and Visualization with Graphite Dave Mangot tech.mangot.com www.tagged.com
- 3. Complex graph creation Web / Dashboard, “CLI” and API interfaces
- 7. Oooh...
- 8. Ahhh...
- 10. Zooming on arbitrary time periods
- 11. Ability to create ad-hoc graphs from ANY metric
- 12. Metric Storage
- 15. Rapid graph prototyping (CLI)
- 16. Graph disparate data points
- 17. Numerous formulas available (derive, transform, average, sum, etc... )
- 18. Share graphs with other users
- 19. Supports existing RRD databases
- 20. Empower any user to create their own graphs, no advance configuration required
- 22. No hover details
- 23. No collector
- 24. Unfortunate name
- 26. Demo Time!
- 30. Dashboard – give targeted view of the data
- 32. API improvements
- 33. Multiple Y axes
- 35. Takes data from EsxSNMP and NetAlmanac
- 37. writers for Graphite (recommended), cacti/rrdtool and stdout
- 39. Inspired by Flickr project
- 40. “A network daemon for aggregating statistics, rolling them up, then sending them to graphite.”
- 42. Can do counting, timing, sampling
- 43. Flushes to Graphite on interval
- 45. Graphite can consume AMQP
- 46. Integrates with Esper (http://esper.codehaus.org/)
- 47. Special Thanks Chris Davis Jason Dixon Corey Hickey Yaakov Nemoy Gary Larsen
Editor's Notes
- Not Nagios, other monitoring, fooled ya
- Who has heard of or knows what a key value pair is? How about epoch time or unix time? Then you can use graphite.
- Ceres does not use space for time periods which contain no datapoints, uses 33% less disk space, able to store the datapoints for a single metric across multiple servers. Dashboard trunk: Save graphs drag'n'drop reordering & merging graphs, all the composer features are there (graph options, functions, etc) plus a few more (breakout a graph with wildcards into separate graphs,