Self-supervised learning uses unlabeled data to learn visual representations through pretext tasks like predicting relative patch location, solving jigsaw puzzles, or image rotation. These tasks require semantic understanding to solve but only use unlabeled data. The features learned through pretraining on pretext tasks can then be transferred to downstream tasks like image classification and object detection, often outperforming supervised pretraining. Several papers introduce different pretext tasks and evaluate feature transfer on datasets like ImageNet and PASCAL VOC. Recent work combines multiple pretext tasks and shows improved generalization across tasks and datasets.
Functional Tests Automation with Robot Frameworklaurent bristiel
The document discusses Robot Framework, an open source test automation framework written in Python. It can be used to write functional, end-to-end, component, and unit tests. Robot Framework uses a keyword-driven, data-driven, or behavior-driven approach. It provides built-in keywords and libraries that allow tests to be written in a simple, lightweight manner and executed across multiple platforms and applications. Case studies are presented on large companies using Robot Framework to automate testing of their products. Both advantages and limitations of the framework are covered.
AWS networking fundamentals - SVC303 - Santa Clara AWS SummitAmazon Web Services
In this session, we first cover build-out and design fundamentals for VPCs, including selecting your IP space, subnetting, routing, security, and more. We then discuss different approaches and scenarios for connecting your VPC to your data center with AWS VPN or AWS Direct Connect. Throughout this presentation, we discuss our latest networking services and updates, including AWS Transit Gateway and AWS PrivateLink. This mid-level architecture discussion is for architects, network administrators, and technology decision makers interested in understanding the building blocks that AWS makes available with Amazon VPC. Learn how to connect VPCs with your offices and data center footprint.
Logic programming in Python allows for productive, readable programs using logic rules rather than loops or conditionals. The pyDatalog library adds logic programming capabilities to Python. Programs are defined with facts and clauses like Prolog, and can query SQL databases. PyDatalog memoizes results to avoid recomputation and supports features like aggregate functions. It allows applications like spreadsheet programming, expert systems, and cross-database queries. The presenter outlines roadmaps for adding an equation solver, transactions, and improving performance.
This document describes Dynatrace's full-stack application monitoring solution. It can automatically monitor entire application stacks from the user experience down to code level. Dynatrace provides a unified real-time model called Smartscape that maps out the entire environment and all transaction dependencies. It also uses artificial intelligence for anomaly detection since environmental complexity is too much for humans to fully analyze. Deployments can be either SaaS or on-premises to provide flexibility. Dynatrace can monitor dynamic container environments across all major platforms.
This document provides instructions for installing and setting up the Robot Framework for acceptance testing and acceptance-test driven development. It discusses installing Python, pip, Robot Framework, and Selenium libraries. It also covers test structure, standard and external Robot Framework libraries, Selenium keywords, creating simple tests, running tests, and handling proxies. The document aims to help users create test cases with Robot Framework to test websites like Google, login pages, and todo applications.
Keynote: Elastic Observability evolution and visionElasticsearch
Elastic Observability is helping organisations drive their mean time to resolution toward zero with end-to-end visibility in a single platform. Hear about the latest features and capabilities at all layers — from ingest to insight — and get a glimpse into the future straight from the product leaders who are building it.
Self-supervised learning uses unlabeled data to learn visual representations through pretext tasks like predicting relative patch location, solving jigsaw puzzles, or image rotation. These tasks require semantic understanding to solve but only use unlabeled data. The features learned through pretraining on pretext tasks can then be transferred to downstream tasks like image classification and object detection, often outperforming supervised pretraining. Several papers introduce different pretext tasks and evaluate feature transfer on datasets like ImageNet and PASCAL VOC. Recent work combines multiple pretext tasks and shows improved generalization across tasks and datasets.
Functional Tests Automation with Robot Frameworklaurent bristiel
The document discusses Robot Framework, an open source test automation framework written in Python. It can be used to write functional, end-to-end, component, and unit tests. Robot Framework uses a keyword-driven, data-driven, or behavior-driven approach. It provides built-in keywords and libraries that allow tests to be written in a simple, lightweight manner and executed across multiple platforms and applications. Case studies are presented on large companies using Robot Framework to automate testing of their products. Both advantages and limitations of the framework are covered.
AWS networking fundamentals - SVC303 - Santa Clara AWS SummitAmazon Web Services
In this session, we first cover build-out and design fundamentals for VPCs, including selecting your IP space, subnetting, routing, security, and more. We then discuss different approaches and scenarios for connecting your VPC to your data center with AWS VPN or AWS Direct Connect. Throughout this presentation, we discuss our latest networking services and updates, including AWS Transit Gateway and AWS PrivateLink. This mid-level architecture discussion is for architects, network administrators, and technology decision makers interested in understanding the building blocks that AWS makes available with Amazon VPC. Learn how to connect VPCs with your offices and data center footprint.
Logic programming in Python allows for productive, readable programs using logic rules rather than loops or conditionals. The pyDatalog library adds logic programming capabilities to Python. Programs are defined with facts and clauses like Prolog, and can query SQL databases. PyDatalog memoizes results to avoid recomputation and supports features like aggregate functions. It allows applications like spreadsheet programming, expert systems, and cross-database queries. The presenter outlines roadmaps for adding an equation solver, transactions, and improving performance.
This document describes Dynatrace's full-stack application monitoring solution. It can automatically monitor entire application stacks from the user experience down to code level. Dynatrace provides a unified real-time model called Smartscape that maps out the entire environment and all transaction dependencies. It also uses artificial intelligence for anomaly detection since environmental complexity is too much for humans to fully analyze. Deployments can be either SaaS or on-premises to provide flexibility. Dynatrace can monitor dynamic container environments across all major platforms.
This document provides instructions for installing and setting up the Robot Framework for acceptance testing and acceptance-test driven development. It discusses installing Python, pip, Robot Framework, and Selenium libraries. It also covers test structure, standard and external Robot Framework libraries, Selenium keywords, creating simple tests, running tests, and handling proxies. The document aims to help users create test cases with Robot Framework to test websites like Google, login pages, and todo applications.
Keynote: Elastic Observability evolution and visionElasticsearch
Elastic Observability is helping organisations drive their mean time to resolution toward zero with end-to-end visibility in a single platform. Hear about the latest features and capabilities at all layers — from ingest to insight — and get a glimpse into the future straight from the product leaders who are building it.
Google Cloud Platform is a cloud computing platform by Google that offers hosting on the same supporting infrastructure that Google uses internally for end-user products like Google Search and YouTube. Cloud Platform provides developer products to build a range of programs from simple websites to complex applications.
Google Cloud Platform is a part of a suite of enterprise solutions from Google for Work and provides a set of modular cloud-based services with a host of development tools. For example, hosting and computing, cloud storage, data storage, translations APIs and prediction APIs.
Topic Covered
Why Google Cloud Platform ?
Google Cloud Platform Services: First Insight !!!
This document provides an overview of Open edX, an open-source online learning platform. It discusses key components of Open edX including the learning management system (LMS), Studio for content authoring, discussions, mobile apps, analytics, and other backend systems. It also covers creating and editing courses in Studio, adding course components, testing practices, and guidelines for writing accessible and secure code to prevent vulnerabilities like cross-site scripting attacks.
Introduction to AWS VPC, Guidelines, and Best PracticesGary Silverman
I crafted this presentation for the AWS Chicago Meetup. This deck covers the rationale, building blocks, guidelines, and several best practices for Amazon Web Services Virtual Private Cloud. I classify it as a somewhere between a 101 and 201 level presentation.
If you like the presentation, I would appreciate you clicking the Like button.
Machine Learning for Dummies (without mathematics)ActiveEon
It presents an introduction and the basic concepts of machine learning without mathematics. This is a short presentation for beginners in machine learning.
Robot Framework is a generic test automation framework for acceptance and regression testing. It has easy-to-use tabular test data syntax and supports test automation using the keyword-driven testing approach. Tests are created using test cases composed of test data and keywords. Keywords are provided by test libraries that extend the functionality of the framework. Robot Framework can be installed on Windows using pip and supports creating and running tests from the command line or using the RIDE test data editor.
Serverless Architecture - Design Patterns and Best PracticesAmazon Web Services
As serverless architectures become more popular, customers are looking for a framework of patterns to help them identify how they can leverage AWS to deploy their workloads without managing servers or operating systems.
This webinar session describes reusable serverless patterns. For each pattern, operational and security best practices with potential pitfalls and nuances will be described. The patterns involve services including but not limited to AWS Lambda, Amazon API Gateway, Amazon Kinesis Data Streams and Data Firehose, Amazon DynamoDB, Amazon S3, AWS Step Functions, AWS Config, AWS X-Ray, and Amazon Athena.
This session can help audience recognise candidates for various serverless architectures in an organisation and understand areas of potential savings and increased agility. For example, using X-Ray in Lambda for tracing and operational insight; a pattern on high performance computing (HPC) using Lambda at scale; Step Functions as a way to handle orchestration for both the Automation and Batch patterns; a pattern for Security Automation using AWS Config rules to detect and automatically remediate violations of security standards; CI/CD development pipelines for serverless, which includes testing, deploying, and versioning (SAM tools); working with services from AI/ML area; plus tips to optimise Lambda functions for performance and cost-effectiveness.
Robot Framework is an open source test automation framework that can be used to test web, desktop, and mobile applications. It uses a keyword-driven design and has a modular architecture that makes it easy to extend with custom test libraries. Some benefits include being highly reusable, accessible for beginners, and having powerful logging capabilities. However, it does not support while loops or nested for loops, and working with non-string data types can be complicated. The framework operates independently of the system under test and uses test suites made up of test cases that can each be in their own namespace. Custom keywords, variables, and extensions are usually stored separately.
Join the “AWS Services Overview” webinar to take a fast-paced 45-minute tour through our broad range of services. During the webinar, you will have the opportunity to propose questions for the live Q&A session following the presentation.
Learning Objectives:
• Overview of AWS Services
• Advice for Getting Started
"Wild Rydes (www.wildrydes.com) needs your help! With fresh funding from its seed investors, Wild Rydes is seeking to build the world’s greatest mobile/VR/AR unicorn transportation system. The scrappy startup needs a first-class webpage to begin marketing to new users and to begin its plans for global domination. Join us to help Wild Rydes build a website using a serverless architecture. You’ll build a scalable website using services like AWS Lambda, Amazon API Gateway, Amazon DynamoDB, and Amazon S3. Join this workshop to hop on the rocket ship!
To complete this workshop, you'll need:
Your laptop
AWS Account
AWS Command Line Interface
Google Chrome
git
Text Editor"
AWS Webinar 201: Designing scalable, available & resilient cloud applicationsAmazon Web Services
Applications have become a vital aspect of everyday life in nearly every part of the world. No matter where we are, we interact with applications–whether that is by using our mobile phone, withdrawing money from an automated bank machine, or even by just shopping online. Because applications have become such an integral part of our daily lives, a great deal of work has to be done to ensure that these applications remain scalable, operational and available. Cloud-native applications are designed for failure, automation, horizontal scalability, anti-fragility, security, cost-optimization and resilience. Join this session to learn best practices on how to design and implement cloud-ready, or cloud-native applications and workloads.
Reasons to attend:
• Learn practical design patterns and anti-patterns, do's and don'ts.
• Techniques to improve your operational efficiency, cost-control, security posture, availability and scalability.
Who should attend
• Architects
• Developers
• System administrators
• DevOps practitioners
• CTOs
Prometheus is an open-source monitoring system that collects metrics from instrumented systems and applications and allows for querying and alerting on metrics over time. It is designed to be simple to operate, scalable, and provides a powerful query language and multidimensional data model. Key features include no external dependencies, metrics collection by scraping endpoints, time-series storage, and alerting handled by the AlertManager with support for various integrations.
This presentation demonstrates general guidelines how to create good test cases using Robot Framework. Both good practices and anti-patterns are presented.
The presentation is hosted on GitHub where you can find the original in ODP format: https://github.com/robotframework/DosDontsSlides
This document provides an introduction to machine learning and its applications in genomics and biology. It discusses how biology and genomics data have become "big data" due to technological advances in sequencing and data generation. Machine learning is well-suited for analyzing these large, multidimensional datasets and addressing complex biological questions. The document outlines different machine learning approaches like supervised and unsupervised learning, and provides examples of real-world applications. R and Python are introduced as popular programming languages for machine learning.
Cloud computing is the delivery of computing resources like servers, storage, databases, and software over the Internet. There are different types of cloud including public, private, and hybrid clouds. Google Cloud Platform (GCP) provides various computing, storage, networking, security, and other services to users. GCP offers products and services for compute, storage, networking, security, big data, machine learning, and management tools to build solutions in the cloud. Some advantages of GCP include flexible billing, fast scaling, global datacenter network, and petabyte data processing capabilities.
This document discusses serverless computing and AWS Lambda. It provides an overview of virtual machines, containers, and serverless/functions as a service. It describes how AWS Lambda works, including how to author functions using various programming languages. It also discusses how to integrate Lambda with other AWS services like API Gateway, Step Functions, S3, DynamoDB and more. It introduces the AWS Serverless Application Repository and AWS SAM for defining serverless applications.
The document outlines the agenda for a workshop on threat detection and remediation using AWS security services. The workshop includes modules on environment setup, an attack simulation, detecting and investigating the attack, and a review. Services discussed that can help with detection include GuardDuty, Macie, and Inspector, while services like Systems Manager, Lambda, and Inspector can assist with automation of remediation. The document provides information on the specific steps and activities involved in each module of the workshop.
This document discusses testing strategies for microservices. It defines microservices as small, focused services that together create applications. Key challenges in testing microservices include timely availability of services, complicated log extraction, and isolating the scope of each service. The document recommends a bottom-up testing strategy starting with unit tests, then contract, integration, and end-to-end tests. It also provides examples of tools that can help test microservices at each level, from API testing to monitoring and performance testing. The conclusion emphasizes applying best practices like the test pyramid and reducing common tests across services.
The document discusses machine learning classification using the MNIST dataset of handwritten digits. It begins by defining classification and providing examples. It then describes the MNIST dataset and how it is fetched in scikit-learn. The document outlines the steps of classification which include dividing the data into training and test sets, training a classifier on the training set, testing it on the test set, and evaluating performance. It specifically trains a stochastic gradient descent (SGD) classifier on the MNIST data. The performance is evaluated using cross validation accuracy, confusion matrix, and metrics like precision and recall.
The document provides an overview of serverless computing using AWS Lambda and related AWS services. It introduces Chris Munns and his background in serverless computing. Serverless applications are built by connecting event sources to AWS Lambda functions. Common uses of serverless include web applications, data processing, chatbots, backends, and IT automation. AWS Lambda, API Gateway, DynamoDB, S3, and other services were demonstrated.
Prometheus and Docker (Docker Galway, November 2015)Brian Brazil
Brian Brazil is an engineer passionate about reliable systems who has worked at Google SRE and Boxever. He discusses Prometheus, an open source monitoring system he helped create. Prometheus offers inclusive monitoring of services, is manageable and reliable, integrates easily with other tools, and provides powerful querying and dashboards. It is efficient, scalable, and helps provide visibility into systems through its data model and labeling.
Camunda BPM is the leading open-source platform for workflow and decision automation. For developer friendly organisations, it is becoming the de facto standard for process automation. Yet, there is always room for improvement. Can we allow users to monitor and improve their processes end-to-end - even if parts of the process are not automated with Camunda? Can we expand support for more programming languages? Can we make BPMN execution and standards support even more powerful? Yes, we can. And we have. Continuous improvement is at the heart of what we do.
Join this webinar with Camunda’s VP of Product Management, Rick Weinberg, as he discusses the workflow enhancements and operational efficiencies coming in the 7.13 release and the value they deliver to Camunda customers and the Camunda community. In this webinar, you’ll learn about:
- How Camunda Run lets teams automate and orchestrate processes…no JAVA or app server knowledge required
- Our Open API support will let any developer use Camunda in their preferred programming languages
- Seamlessly generating a Camunda Rest client in your language of choice
- Standards continue to drive Camunda as we expand Open API support of the REST standard, in addition to support for DMN1.3 and FEEL expressions
- Process Events Monitoring: End-To-End Process Monitoring and Reporting for your Camunda (or non-Camunda) process fragments
Presenters
Rick Weinberg, Camunda VP Product Management
Thorben Lindhauer, Engineering Manager Camunda BPM
Nico Rehwaldt, Principal Software Engineer Camunda Modeler
Niall Deehan, Camunda Developer Advocate
Google Cloud Platform is a cloud computing platform by Google that offers hosting on the same supporting infrastructure that Google uses internally for end-user products like Google Search and YouTube. Cloud Platform provides developer products to build a range of programs from simple websites to complex applications.
Google Cloud Platform is a part of a suite of enterprise solutions from Google for Work and provides a set of modular cloud-based services with a host of development tools. For example, hosting and computing, cloud storage, data storage, translations APIs and prediction APIs.
Topic Covered
Why Google Cloud Platform ?
Google Cloud Platform Services: First Insight !!!
This document provides an overview of Open edX, an open-source online learning platform. It discusses key components of Open edX including the learning management system (LMS), Studio for content authoring, discussions, mobile apps, analytics, and other backend systems. It also covers creating and editing courses in Studio, adding course components, testing practices, and guidelines for writing accessible and secure code to prevent vulnerabilities like cross-site scripting attacks.
Introduction to AWS VPC, Guidelines, and Best PracticesGary Silverman
I crafted this presentation for the AWS Chicago Meetup. This deck covers the rationale, building blocks, guidelines, and several best practices for Amazon Web Services Virtual Private Cloud. I classify it as a somewhere between a 101 and 201 level presentation.
If you like the presentation, I would appreciate you clicking the Like button.
Machine Learning for Dummies (without mathematics)ActiveEon
It presents an introduction and the basic concepts of machine learning without mathematics. This is a short presentation for beginners in machine learning.
Robot Framework is a generic test automation framework for acceptance and regression testing. It has easy-to-use tabular test data syntax and supports test automation using the keyword-driven testing approach. Tests are created using test cases composed of test data and keywords. Keywords are provided by test libraries that extend the functionality of the framework. Robot Framework can be installed on Windows using pip and supports creating and running tests from the command line or using the RIDE test data editor.
Serverless Architecture - Design Patterns and Best PracticesAmazon Web Services
As serverless architectures become more popular, customers are looking for a framework of patterns to help them identify how they can leverage AWS to deploy their workloads without managing servers or operating systems.
This webinar session describes reusable serverless patterns. For each pattern, operational and security best practices with potential pitfalls and nuances will be described. The patterns involve services including but not limited to AWS Lambda, Amazon API Gateway, Amazon Kinesis Data Streams and Data Firehose, Amazon DynamoDB, Amazon S3, AWS Step Functions, AWS Config, AWS X-Ray, and Amazon Athena.
This session can help audience recognise candidates for various serverless architectures in an organisation and understand areas of potential savings and increased agility. For example, using X-Ray in Lambda for tracing and operational insight; a pattern on high performance computing (HPC) using Lambda at scale; Step Functions as a way to handle orchestration for both the Automation and Batch patterns; a pattern for Security Automation using AWS Config rules to detect and automatically remediate violations of security standards; CI/CD development pipelines for serverless, which includes testing, deploying, and versioning (SAM tools); working with services from AI/ML area; plus tips to optimise Lambda functions for performance and cost-effectiveness.
Robot Framework is an open source test automation framework that can be used to test web, desktop, and mobile applications. It uses a keyword-driven design and has a modular architecture that makes it easy to extend with custom test libraries. Some benefits include being highly reusable, accessible for beginners, and having powerful logging capabilities. However, it does not support while loops or nested for loops, and working with non-string data types can be complicated. The framework operates independently of the system under test and uses test suites made up of test cases that can each be in their own namespace. Custom keywords, variables, and extensions are usually stored separately.
Join the “AWS Services Overview” webinar to take a fast-paced 45-minute tour through our broad range of services. During the webinar, you will have the opportunity to propose questions for the live Q&A session following the presentation.
Learning Objectives:
• Overview of AWS Services
• Advice for Getting Started
"Wild Rydes (www.wildrydes.com) needs your help! With fresh funding from its seed investors, Wild Rydes is seeking to build the world’s greatest mobile/VR/AR unicorn transportation system. The scrappy startup needs a first-class webpage to begin marketing to new users and to begin its plans for global domination. Join us to help Wild Rydes build a website using a serverless architecture. You’ll build a scalable website using services like AWS Lambda, Amazon API Gateway, Amazon DynamoDB, and Amazon S3. Join this workshop to hop on the rocket ship!
To complete this workshop, you'll need:
Your laptop
AWS Account
AWS Command Line Interface
Google Chrome
git
Text Editor"
AWS Webinar 201: Designing scalable, available & resilient cloud applicationsAmazon Web Services
Applications have become a vital aspect of everyday life in nearly every part of the world. No matter where we are, we interact with applications–whether that is by using our mobile phone, withdrawing money from an automated bank machine, or even by just shopping online. Because applications have become such an integral part of our daily lives, a great deal of work has to be done to ensure that these applications remain scalable, operational and available. Cloud-native applications are designed for failure, automation, horizontal scalability, anti-fragility, security, cost-optimization and resilience. Join this session to learn best practices on how to design and implement cloud-ready, or cloud-native applications and workloads.
Reasons to attend:
• Learn practical design patterns and anti-patterns, do's and don'ts.
• Techniques to improve your operational efficiency, cost-control, security posture, availability and scalability.
Who should attend
• Architects
• Developers
• System administrators
• DevOps practitioners
• CTOs
Prometheus is an open-source monitoring system that collects metrics from instrumented systems and applications and allows for querying and alerting on metrics over time. It is designed to be simple to operate, scalable, and provides a powerful query language and multidimensional data model. Key features include no external dependencies, metrics collection by scraping endpoints, time-series storage, and alerting handled by the AlertManager with support for various integrations.
This presentation demonstrates general guidelines how to create good test cases using Robot Framework. Both good practices and anti-patterns are presented.
The presentation is hosted on GitHub where you can find the original in ODP format: https://github.com/robotframework/DosDontsSlides
This document provides an introduction to machine learning and its applications in genomics and biology. It discusses how biology and genomics data have become "big data" due to technological advances in sequencing and data generation. Machine learning is well-suited for analyzing these large, multidimensional datasets and addressing complex biological questions. The document outlines different machine learning approaches like supervised and unsupervised learning, and provides examples of real-world applications. R and Python are introduced as popular programming languages for machine learning.
Cloud computing is the delivery of computing resources like servers, storage, databases, and software over the Internet. There are different types of cloud including public, private, and hybrid clouds. Google Cloud Platform (GCP) provides various computing, storage, networking, security, and other services to users. GCP offers products and services for compute, storage, networking, security, big data, machine learning, and management tools to build solutions in the cloud. Some advantages of GCP include flexible billing, fast scaling, global datacenter network, and petabyte data processing capabilities.
This document discusses serverless computing and AWS Lambda. It provides an overview of virtual machines, containers, and serverless/functions as a service. It describes how AWS Lambda works, including how to author functions using various programming languages. It also discusses how to integrate Lambda with other AWS services like API Gateway, Step Functions, S3, DynamoDB and more. It introduces the AWS Serverless Application Repository and AWS SAM for defining serverless applications.
The document outlines the agenda for a workshop on threat detection and remediation using AWS security services. The workshop includes modules on environment setup, an attack simulation, detecting and investigating the attack, and a review. Services discussed that can help with detection include GuardDuty, Macie, and Inspector, while services like Systems Manager, Lambda, and Inspector can assist with automation of remediation. The document provides information on the specific steps and activities involved in each module of the workshop.
This document discusses testing strategies for microservices. It defines microservices as small, focused services that together create applications. Key challenges in testing microservices include timely availability of services, complicated log extraction, and isolating the scope of each service. The document recommends a bottom-up testing strategy starting with unit tests, then contract, integration, and end-to-end tests. It also provides examples of tools that can help test microservices at each level, from API testing to monitoring and performance testing. The conclusion emphasizes applying best practices like the test pyramid and reducing common tests across services.
The document discusses machine learning classification using the MNIST dataset of handwritten digits. It begins by defining classification and providing examples. It then describes the MNIST dataset and how it is fetched in scikit-learn. The document outlines the steps of classification which include dividing the data into training and test sets, training a classifier on the training set, testing it on the test set, and evaluating performance. It specifically trains a stochastic gradient descent (SGD) classifier on the MNIST data. The performance is evaluated using cross validation accuracy, confusion matrix, and metrics like precision and recall.
The document provides an overview of serverless computing using AWS Lambda and related AWS services. It introduces Chris Munns and his background in serverless computing. Serverless applications are built by connecting event sources to AWS Lambda functions. Common uses of serverless include web applications, data processing, chatbots, backends, and IT automation. AWS Lambda, API Gateway, DynamoDB, S3, and other services were demonstrated.
Prometheus and Docker (Docker Galway, November 2015)Brian Brazil
Brian Brazil is an engineer passionate about reliable systems who has worked at Google SRE and Boxever. He discusses Prometheus, an open source monitoring system he helped create. Prometheus offers inclusive monitoring of services, is manageable and reliable, integrates easily with other tools, and provides powerful querying and dashboards. It is efficient, scalable, and helps provide visibility into systems through its data model and labeling.
Camunda BPM is the leading open-source platform for workflow and decision automation. For developer friendly organisations, it is becoming the de facto standard for process automation. Yet, there is always room for improvement. Can we allow users to monitor and improve their processes end-to-end - even if parts of the process are not automated with Camunda? Can we expand support for more programming languages? Can we make BPMN execution and standards support even more powerful? Yes, we can. And we have. Continuous improvement is at the heart of what we do.
Join this webinar with Camunda’s VP of Product Management, Rick Weinberg, as he discusses the workflow enhancements and operational efficiencies coming in the 7.13 release and the value they deliver to Camunda customers and the Camunda community. In this webinar, you’ll learn about:
- How Camunda Run lets teams automate and orchestrate processes…no JAVA or app server knowledge required
- Our Open API support will let any developer use Camunda in their preferred programming languages
- Seamlessly generating a Camunda Rest client in your language of choice
- Standards continue to drive Camunda as we expand Open API support of the REST standard, in addition to support for DMN1.3 and FEEL expressions
- Process Events Monitoring: End-To-End Process Monitoring and Reporting for your Camunda (or non-Camunda) process fragments
Presenters
Rick Weinberg, Camunda VP Product Management
Thorben Lindhauer, Engineering Manager Camunda BPM
Nico Rehwaldt, Principal Software Engineer Camunda Modeler
Niall Deehan, Camunda Developer Advocate
This is a talk on how you can monitor your microservices architecture using Prometheus and Grafana. This has easy to execute steps to get a local monitoring stack running on your local machine using docker.
How to monitor your Java micro-service with Prometheus? How to design metrics, what is USE and RED? Metrics for a REST service with Prometheus, AlertManager, and Grafana.
Slides and live-coding demo from Warsaw Java User Group Meetup in Warsaw #238.
OSMC 2012 | PMp - another approach to configure Nagios by Pierre WaellemacqNETWAYS
PMp ist ein proaktives Konfigurations-Software-Paket, das entwickelt wurde, um das Einrichten eines Monitoring Setups zu erleichtern. Es kann Netzwerk IPs scannen und erstellt automatisch angemessene Monitoring Konfigurationen. PMP überlässt dem Endverbraucher die Wahl was im Monitoring UI sichtbar ist und wie es über ein intuitives Web Interface überwacht wird. Derzeit wird PMp am besten in Kombination mit OMD verwendet um Icinga oder Nagios Software zu konfigurieren. Des Weiteren kann es ebenfalls problemlos mit anderer Software erweitert werden.
Chicago Docker Meetup Presentation - MediaflyMediafly
This document discusses how Bryan Murphy uses Docker at his company Mediafly. It begins by introducing Bryan and his background. It then describes what Mediafly does, including content management systems, secure content delivery, document and video processing, and customizable user interfaces. The document highlights aspects of Mediafly that make it interesting, such as being multi-device, multi-tenant, service oriented, and distributed. It provides examples of technologies used at Mediafly and some key metrics. The document then discusses why Docker is used at Mediafly, covering benefits like being developer friendly, enabling faster iteration and testing, managing dependencies, sharing environments, standardization, isolation, and infrastructure freedom.
This document discusses various tools and strategies for tuning Linux performance on Red Hat Enterprise Linux. It begins by describing Red Hat's tuned tool, which provides performance profiles that are installed and activated by default. It then covers obtaining diagnostic information using tools like sar and collecting additional metrics. The document provides strategies for tuning storage, CPU, memory, and virtual machine performance. It emphasizes the importance of clearly identifying performance issues before making tuning changes.
Free radius billing server with practical vpn exmapleChanaka Lasantha
This document provides instructions for setting up a total site-to-site Linux-based OpenVPN solution with dynamic DNS (DDNS) in 3 pages. It includes steps to install and configure a DDNS client, FreeRADIUS server, MySQL database, OpenVPN server, firewall rules, and a web interface for managing the FreeRADIUS server. The full document contains technical details for installing packages, editing configuration files, testing the setup, and securing the system.
How to Configure the CA Workload Automation System Agent agentparm.txt FileCA Technologies
Unlock the mystery and power of CA Workload Automation System Agent by understanding how to configure its agentparm.txt file.
For more information on Mainframe solutions from CA Technologies, please visit: http://bit.ly/1wbiPkl
Read to learn what Mule Runtime Fabric (RTF) and Anypoint RTF are, how you can leverage these integration engines, the best adoption strategies, and the right way to conduct the risk-cost-benefit analysis for your business.
The document provides an overview of setting up an Akamai development environment in 5 minutes using Docker. It includes an agenda for the document which covers Akamai development environment best practices, demos of common development tasks, an interactive quiz, and Q&A. The document then demonstrates how to set up the environment, optimize Docker image size, and implement continuous deployment workflows. It also includes demos of tasks like content purging, asset protection, and implementing security configurations. Finally, it discusses implementing infrastructure as code practices with Akamai and provides additional useful links.
IDNOG 4 Lightning Talks - Documenting your Network in 3 Simple StepsAffan Basalamah
This document provides a 3-step process for documenting a network in a sane and healthy way:
1. Draw network diagrams using tools like Visio or OmniGraffle to depict the physical, logical, and application layers. Store the diagrams online or in a wiki for easy access.
2. Backup network configurations regularly using tools like RANCID or Oxidize, which can save configurations to a repository and detect changes between backups.
3. Use IP address management (IPAM) tools like Netbox to document IP assignments, devices, rack locations, and network connections. This provides a single source of truth for the physical and logical network resources.
Following these steps provides visibility into
This document provides a 3-step process for documenting a network in a sane and healthy way:
1. Draw network diagrams using tools like Visio or OmniGraffle to depict the physical, logical, and application layers. Store the diagrams online or with network monitoring tools.
2. Backup network configurations regularly using tools like RANCID or Oxidize, which can save configurations to repositories and alert administrators of changes via email or messaging.
3. Use IP address management (IPAM) tools like Netbox to document IP prefixes, devices, rack locations, and network links. This provides a single source of truth for the physical and logical network resources.
Properly documenting the network
Automate Oracle database patches and upgrades using Fleet Provisioning and Pa...Nelson Calero
Each new version of the Oracle database includes improvements in the upgrade and patching utilities, forcing us to update our procedures to incorporate these changes.
The Fleet Provisioning & Patching (FPP, formerly RHP) utility, together with the change in its licensing announced at OOW 2019 that makes it free in RAC, now makes it possible to centrally manage the software life cycle.
This presentation shows examples of how to use FPP and different configuration options.
Raw Iron to Enterprise Server: Installing Domino on LinuxDevin Olson
This document appears to be notes from a presentation or session on installing and configuring IBM Domino on CentOS Linux. It includes steps for:
1) Installing VirtualBox and CentOS in a virtual machine, configuring networking and basic CentOS configuration.
2) Installing additional packages, disabling SELinux, configuring firewall rules, and creating a Linux user and group for Domino.
3) Configuring SSH, removing conflicting services, increasing file handles, setting Domino-specific variables, and creating directories for Domino data and installation files.
4) Copying the Domino installation files, verifying, extracting, and running the installer to complete the Domino installation on
This document discusses new features in Red Hat Enterprise Virtualization 3.1, including an HTML5 GWT web admin, improved network management, NIC hot plug, direct LUN support, live snapshots, storage live migration, a POSIX file system storage domain, and Gluster integration. Red Hat Enterprise Virtualization provides a KVM hypervisor and management tools for deploying and managing virtual machines on cloud infrastructure.
Les containers docker vu par un chef cuisinier et un mécanicienRachid Zarouali
Les containers docker sont partout aujourd'hui, nos boites mails google/office365, nos applications web, notre accès pour les rendez-vous médicaux, les avions, ...
Ils sont partout mais pourtant pas toujours facile a appréhender, et pourtant, ils ont beaucoup plus de similitude avec des métiers de notre quotidien qu'il n'y parait.
Lors de ce webinar, je vous presenter ces fameux containers Docker, vu par un chef cuisiner et un mécanicien automobile et vous ferez qu'il a beaucoup de points communs.
Containers explained as for cook and a mecanics Rachid Zarouali
Containers are everywhere, google/office365 mailboxes, web applications, healthcare booking, aeroplanes, and many more.
Docker containers are everywhere today, our google/office365 mailboxes, our web applications, our access for medical appointments, airplanes, ...
They are everywhere but not always easy to apprehend, and yet, they have much more similarities with our daily jobs than it seems.
During this webinar, I will present you these famous Docker containers, seen by a chef and a car mechanic and you will see that they have a lot in common.
Container security is a vast ecosystem, there’s a lot of tools, project and methods.
In this talk, we’ll see how to use basic out of the box features and best practices to make your container more secure without adding too much complexity into your container platform.
This talk will be a mix of live demos and best practices.
We’ll close the talk by giving an overview of some more advanced security features available either out of the box or by using some third-party tools.
Les conteneurs sont partout, laptop, serveurs, cloud hosting, embarqué, edge computing, ils prennent littéralement le monde d'assaut ! Cette tempête s'accompagne d'un certain nombre de préoccupations cruciales, et l'une est la gestion de la sécurité.
Dans cette présentation, nous découvrir ensemble quelques bonnes pratiques en matière de sécurité, et une mise en œuvre avancée.
Nous découvrirons l'analyse comportementale ou comment détecter les activités indésirables / malveillantes, l'intégration d'un scanner de sécurité directement dans votre pipeline de CI/CD et le verrouillage des images Docker via un admission controller dans Kubernetes.
Que vous soyez un développeur, un responsable opérationnel ou technique, ce talk vous donnera des clés que vous pourrez appliquer directement dans vos projets de mise en place / migration d'infrastructure cloud.
Talk donné à la soirée DockerLyon du 30Mai autour de la sécurité de container.
les do's and don'ts accompagné d'exemples d'utilisation de fonctionnalités avancées (Capabilities, AppAmor, SecComp ...)
Slides from my DockerCon EU 2017 Talk.
Find the abstract below:
"In this talk, we'll discover how Docker comes to the rescue of the Ops Team, while rebuilding from scratch our monitoring infrastructure. We'll start by quickly describing the challenges, to focus on why and how using docker saved the project. From fixing dependencies and isolation issues, implementing rolling upgrades and new features hot addition, to building a completely modular, scalable and resilient infrastructure, we'll talk about why CI/CD workflows, docker tooling and Docker Swarm were the key to success."
This document discusses deploying a resilient e-commerce platform using containers. It covers how containers can help solve issues with traditional monolithic e-commerce applications like varying OSes/middleware stacks and lack of scalability. Specific topics covered include using Docker Swarm for scalability, tools like Traefik and ProxySQL for load balancing, Portworx for distributed storage, applying security best practices to containers/orchestration, and implementing continuous integration/delivery workflows using tools like Drone.
The Ipsos - AI - Monitor 2024 Report.pdfSocial Samosa
According to Ipsos AI Monitor's 2024 report, 65% Indians said that products and services using AI have profoundly changed their daily life in the past 3-5 years.
Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...Kaxil Naik
Navigating today's data landscape isn't just about managing workflows; it's about strategically propelling your business forward. Apache Airflow has stood out as the benchmark in this arena, driving data orchestration forward since its early days. As we dive into the complexities of our current data-rich environment, where the sheer volume of information and its timely, accurate processing are crucial for AI and ML applications, the role of Airflow has never been more critical.
In my journey as the Senior Engineering Director and a pivotal member of Apache Airflow's Project Management Committee (PMC), I've witnessed Airflow transform data handling, making agility and insight the norm in an ever-evolving digital space. At Astronomer, our collaboration with leading AI & ML teams worldwide has not only tested but also proven Airflow's mettle in delivering data reliably and efficiently—data that now powers not just insights but core business functions.
This session is a deep dive into the essence of Airflow's success. We'll trace its evolution from a budding project to the backbone of data orchestration it is today, constantly adapting to meet the next wave of data challenges, including those brought on by Generative AI. It's this forward-thinking adaptability that keeps Airflow at the forefront of innovation, ready for whatever comes next.
The ever-growing demands of AI and ML applications have ushered in an era where sophisticated data management isn't a luxury—it's a necessity. Airflow's innate flexibility and scalability are what makes it indispensable in managing the intricate workflows of today, especially those involving Large Language Models (LLMs).
This talk isn't just a rundown of Airflow's features; it's about harnessing these capabilities to turn your data workflows into a strategic asset. Together, we'll explore how Airflow remains at the cutting edge of data orchestration, ensuring your organization is not just keeping pace but setting the pace in a data-driven future.
Session in https://budapestdata.hu/2024/04/kaxil-naik-astronomer-io/ | https://dataml24.sessionize.com/session/667627
Beyond the Basics of A/B Tests: Highly Innovative Experimentation Tactics You...Aggregage
This webinar will explore cutting-edge, less familiar but powerful experimentation methodologies which address well-known limitations of standard A/B Testing. Designed for data and product leaders, this session aims to inspire the embrace of innovative approaches and provide insights into the frontiers of experimentation!
10. PROS CONS
Duplicated features
Significant overhead
Noisy and untested system
pull metrics (security issue)
Fastest deployment ever
great dashboards
immediate benefits
percona supported since GA
UGLY: WHY
10
13. PROS CONS
Cut from the upstream
Rewrite all dashboards
How about QAN ?
Lowest overhead
No more duplicated system
Unified and simple platform
BAD: WHY
13
16. Production server overhead
"locked-in" in prometheus world
New system to use/manage
Pull mecanism for metrics
no docker container for pmm-client
BUT NOT THE BEST: WHY
16
17. ONE MORE THING!
DON'T PUT PMM IN PRODUCTION
UNLESS YOU KNOW WHAT YOU'RE DOING
BUT .....
I'LL SHOW YOU HOW ANYWAY :)
17
18. HOW TO ANYWAY ?!
Extending Monitoring capabilities
Staying as close as possible to PMM Upstream
Removing most of duplicate features
18
19. HOW ?!
Remove everything but the specific (i.e: Apache,Php)
Inject in Pmm's Grafana :
dashboards
datasources
19
20. HOW ?! HOW ?! HOW ?!
FROM percona/pmm-server:latest
MAINTAINER Rachid Zarouali <rzarouali@gmail.com>
RUN apt-get install wget -qqy
# ############################# #
# Add several custom dashboards #
# ############################# #
WORKDIR /var/lib/grafana/dashboards
RUN wget https://raw.githubusercontent.com/infinityworksltd/graf-db/master/dashboards/Rancher_Stats.json
RUN wget https://raw.githubusercontent.com/xinity/graf-db/master/dashboards/Container_Stats.json
# ############################## #
# Add specific scrapping options #
# ############################## #
COPY conf/tweak-prom.yml /tmp
RUN cat /tmp/tweak-prom.yml >> /opt/prometheus/prometheus.yml
# ######################## #
# Activate dashboards.json #
# ######################## #
COPY conf/grafana-dashs.yml /tmp
RUN cat /tmp/grafana-dashs.yml >> /etc/grafana/grafana.ini
DOCKER INSIDE !
20
21. HOW ?! HOW ?! HOW ?!
[dashboards.json]
enabled = true
path = /var/lib/grafana/dashboards
GRAFANA-DASHS.YML
TWEAK-PROM.YML
- job_name: 'HostsMetrics'
dns_sd_configs:
- names:
- node-exporter
refresh_interval: 15s
type: A
port: 9100
- job_name: 'ContainerMetrics'
dns_sd_configs:
- names:
- ranch-eye
refresh_interval: 15s
type: A
port: 9104
- job_name: 'rancher-api'
dns_sd_configs:
- names:
- 'prometheus-rancher-exporter'
refresh_interval: 15s
type: A
port: 9010
21
23. NEXT STEPS
wait for / contribute to prometheus
backup/restore
Seperate TSDB from apps
other TSDB interfaces
replace collectd by prometheus exporter
maybe !
maybe not !
23