We will have a deep view of the Elastic Stack - which is the next evolution of ELK Stack, learn how to build the powerful log analysis system with Elastic Stack and have an overview of specifications and comparison details between the self-managed cluster vs Elastic stack provided as SaaS from cloud providers.
Prometheus is a popular open source metric monitoring solution and Azure Monitor provides a seamless onboarding experience to collect Prometheus metrics. Learn how to configure scraping of Prometheus metrics with Azure Monitor for containers running in AKS cluster.
Live Application and Infrastructure Monitoring and Root Cause Log Analysis wi...Lucas Jellema
The importance of a good end user experience with our applications and the responsibility for that experience is getting more attention in our move towards a DevOps culture. The challenge at the same time is growing with multitier architectures and IT landscapes distributed across technology stacks, locations and clouds. Oracle Management Cloud offers a number of products that collect runtime metrics from applications and IT platform and infrastructure components whatever what and where they are. These products provide near-real time insight (Application Performance and Infrastructure Monitoring) and analytical capabilities to find root causes, identify trends and otherwise make sense of the pile of runtime metrics (Log and Infrastructure Analytics). The objective is to quickly spot problems – ideally before they occur – find the cause and a solution and apply the latter. This session introduces Oracle Management Cloud and demonstrates what it can do for Oracle Fusion Middleware and Database, both on premises and in the public cloud.
WSO2Con USA 2017: Building an Effective API ArchitectureWSO2
WSO2 API Manager is a solution that effectively reuses most of the WSO2 platform components to build an elegant, scalable software that performs the whole API management cycle. Understanding the various components of the solution and their interactions helps you to build an effective solution architecture that best suits your organizational needs. Knowing the available deployment options and best practises can benefit you in the long run when managing APIs and the applications that consume them. In this session we will look at
WSO2 API Manager components and their interactions
Advanced API security: Key management
Rate limiting API requests: Traffic management
Analytics: Batch, real-time and logs
Deployment patterns: HA and multi-datacenter deployment
50 Shades of Data - how, when and why Big,Relational,NoSQL,Elastic,Event,CQRS...Lucas Jellema
Data has been and will be the key ingredient to enterprise IT. What is changing is the nature, scope and volume of data and the place of data in the IT architecture. BigData, unstructured data and non-relational data stored on Hadoop, in NoSQL databases and held in Elastic Search Indexes, Caches and Message Queues complements data in the enterprise RDBMS. Emerging patterns such as microservices that contain their own data, BASE, CQRS and Event Sourcing have changed the way we store, share and govern data. This session introduces patterns, technologies, trends and hypes around storing, processing and retrieving data using products such as MongoDB, MySQL, Kafka, Redis, Elastic Search and Hadoop/Spark -locally,in containers and on the cloud
Key take away: what an application architect and a developer should know about the various types of data in enterprise IT and how to store/manage/query/manipulate them. What products and technologies are at your disposal. How can you make these work together - for a consistent (enough) overall data presentation.
These are the slides for the presentation as well as all the demos I prepared for the Devoxx Morocco event in November 2017. The deck includes 150+ slides showing the setup of the demo environment (Oracle Public Cloud DBaaS, Event Hub, Application Container, Application Cache, Kubernetes and Kafka) and the detailed demo steps that show Microservices with Data Bounded Context, Event based choreography and CQRS in action.
This is a presentation from Serverless Summit.
In this session you will learn about how to build your IoT solution with the various components of AWS Serverless backend. We will visit the AWS IoT stack, Kinesis, DynamoDB and AWS Lambda to build an IoT solution.
The Workshop: Alcanzando una observabilidad unificada con Elastic APMElasticsearch
Aprende cómo Elastic APM permite a The Workshop recolectar información de Real User Monitoring (RUM) a través de múltiples CPDs, analizarlas de una forma centralizada para detectar y resolver cuellos de botella y solucionarlos.
Effective AIOps with Open Source Software in a WeekDatabricks
Classic event, incident, problem and change management are ITSM practices that are getting integrated with DevOps/SRE and ML through a competency known as AIOps. Large streams of data generated through logs, metrics and traces are organized and computed using machine learning algorithms to extract insights on the anomalies of system behavior that could be impacting end-users and business transactions. Businesses cannot afford to see their end-users impacted by those anomalies and therefore would want to proactively predict the likelihood of systems regressing and take corrective action long before any material impact.
In this talk, we show the use of simple linear regression and multivariate linear regression techniques to predict the likelihood of system behavior resulting in one or two sigma of standard deviation. We show how to use FOSS tools to predict them using various decision trees that are integrated to high performing streaming platforms like Apache Flink, Apache Beam, Prometheus and Grafana which makes it a lot easier to visualize the various alerts and triage their way back to performing root cause analysis. These high performing systems are also backed by KAFKA for its streaming and distributed computing capabilities by partitioning the data for various staged analysis some of which can be done in parallel and concurrently based on the use cases. We present a fully integrated architecture that helps you realize a commercial AIOps capability without having to license expensive software products. The above open architecture allows you to implement various ML algorithms as needed and its agnostic to programming languages and tools.
The talk will combine various techniques with demos and is focused to practicing engineers and developers who are familiar with ML.
Prometheus is a popular open source metric monitoring solution and Azure Monitor provides a seamless onboarding experience to collect Prometheus metrics. Learn how to configure scraping of Prometheus metrics with Azure Monitor for containers running in AKS cluster.
Live Application and Infrastructure Monitoring and Root Cause Log Analysis wi...Lucas Jellema
The importance of a good end user experience with our applications and the responsibility for that experience is getting more attention in our move towards a DevOps culture. The challenge at the same time is growing with multitier architectures and IT landscapes distributed across technology stacks, locations and clouds. Oracle Management Cloud offers a number of products that collect runtime metrics from applications and IT platform and infrastructure components whatever what and where they are. These products provide near-real time insight (Application Performance and Infrastructure Monitoring) and analytical capabilities to find root causes, identify trends and otherwise make sense of the pile of runtime metrics (Log and Infrastructure Analytics). The objective is to quickly spot problems – ideally before they occur – find the cause and a solution and apply the latter. This session introduces Oracle Management Cloud and demonstrates what it can do for Oracle Fusion Middleware and Database, both on premises and in the public cloud.
WSO2Con USA 2017: Building an Effective API ArchitectureWSO2
WSO2 API Manager is a solution that effectively reuses most of the WSO2 platform components to build an elegant, scalable software that performs the whole API management cycle. Understanding the various components of the solution and their interactions helps you to build an effective solution architecture that best suits your organizational needs. Knowing the available deployment options and best practises can benefit you in the long run when managing APIs and the applications that consume them. In this session we will look at
WSO2 API Manager components and their interactions
Advanced API security: Key management
Rate limiting API requests: Traffic management
Analytics: Batch, real-time and logs
Deployment patterns: HA and multi-datacenter deployment
50 Shades of Data - how, when and why Big,Relational,NoSQL,Elastic,Event,CQRS...Lucas Jellema
Data has been and will be the key ingredient to enterprise IT. What is changing is the nature, scope and volume of data and the place of data in the IT architecture. BigData, unstructured data and non-relational data stored on Hadoop, in NoSQL databases and held in Elastic Search Indexes, Caches and Message Queues complements data in the enterprise RDBMS. Emerging patterns such as microservices that contain their own data, BASE, CQRS and Event Sourcing have changed the way we store, share and govern data. This session introduces patterns, technologies, trends and hypes around storing, processing and retrieving data using products such as MongoDB, MySQL, Kafka, Redis, Elastic Search and Hadoop/Spark -locally,in containers and on the cloud
Key take away: what an application architect and a developer should know about the various types of data in enterprise IT and how to store/manage/query/manipulate them. What products and technologies are at your disposal. How can you make these work together - for a consistent (enough) overall data presentation.
These are the slides for the presentation as well as all the demos I prepared for the Devoxx Morocco event in November 2017. The deck includes 150+ slides showing the setup of the demo environment (Oracle Public Cloud DBaaS, Event Hub, Application Container, Application Cache, Kubernetes and Kafka) and the detailed demo steps that show Microservices with Data Bounded Context, Event based choreography and CQRS in action.
This is a presentation from Serverless Summit.
In this session you will learn about how to build your IoT solution with the various components of AWS Serverless backend. We will visit the AWS IoT stack, Kinesis, DynamoDB and AWS Lambda to build an IoT solution.
The Workshop: Alcanzando una observabilidad unificada con Elastic APMElasticsearch
Aprende cómo Elastic APM permite a The Workshop recolectar información de Real User Monitoring (RUM) a través de múltiples CPDs, analizarlas de una forma centralizada para detectar y resolver cuellos de botella y solucionarlos.
Effective AIOps with Open Source Software in a WeekDatabricks
Classic event, incident, problem and change management are ITSM practices that are getting integrated with DevOps/SRE and ML through a competency known as AIOps. Large streams of data generated through logs, metrics and traces are organized and computed using machine learning algorithms to extract insights on the anomalies of system behavior that could be impacting end-users and business transactions. Businesses cannot afford to see their end-users impacted by those anomalies and therefore would want to proactively predict the likelihood of systems regressing and take corrective action long before any material impact.
In this talk, we show the use of simple linear regression and multivariate linear regression techniques to predict the likelihood of system behavior resulting in one or two sigma of standard deviation. We show how to use FOSS tools to predict them using various decision trees that are integrated to high performing streaming platforms like Apache Flink, Apache Beam, Prometheus and Grafana which makes it a lot easier to visualize the various alerts and triage their way back to performing root cause analysis. These high performing systems are also backed by KAFKA for its streaming and distributed computing capabilities by partitioning the data for various staged analysis some of which can be done in parallel and concurrently based on the use cases. We present a fully integrated architecture that helps you realize a commercial AIOps capability without having to license expensive software products. The above open architecture allows you to implement various ML algorithms as needed and its agnostic to programming languages and tools.
The talk will combine various techniques with demos and is focused to practicing engineers and developers who are familiar with ML.
Project Sherpa: How RightScale Went All in on DockerRightScale
We just finished a 7 week project at RightScale to migrate 48 services and 650+ cloud instances to Docker. As a result we’ve been able to accelerate our development processes and cut our cloud costs (a lot). Here we share lessons learned about our experience migrating to Docker and introduce our new Container Manager we added to the RightScale platform to help manage containerized environments.
Reducing MTTR and False Escalations: Event Correlation at LinkedInMichael Kehoe
LinkedIn’s production stack is made up of over 900 applications and over 2200 internal API’s. With any given application having many interconnected pieces, it is difficult to escalate to the right person in a timely manner.
In order to combat this, LinkedIn built an Event Correlation Engine that monitors service health and maps dependencies between services to correctly escalate to the SRE’s who own the unhealthy service.
We’ll discuss the approach we used in building a correlation engine and how it has been used at LinkedIn to reduce incident impact and provide better quality of life to LinkedIn’s oncall engineers.
Opening the Outage Door: Integrating OMS into CISSSP Innovations
Tri-County Electric Co-Op breaks the OMS data barrier by integrating their existing ATS OpenOne CIS system with Schneider Electric’s Responder OMS. CSR’s now have the ability to: retrieve past outage information for the customer account; input new outage calls on behalf of the customer; and retrieve real-time outage information for existing outages. Customers are now able to enter outages from web and mobile technologies. SSP Innovations bridged the gap with a Multispeak-based web service.
Monitor availability and performance of applications hosted in the Amazon cloud. Monitor your Amazon EC2 and RDS instances and gain insight into the performance of your cloud computing environment, troubleshoot and resolve problems before end users are affected.
Forums: https://forums.site24x7.com/
Facebook: http://www.facebook.com/Site24x7
Twitter: http://twitter.com/site24x7
Google+: https://plus.google.com/+Site24x7
LinkedIn: https://www.linkedin.com/company/site24x7
View Blogs: http://blogs.site24x7.com/
Learning Objectives:
- Securing network access to Amazon EC2 Instances with Security Groups
- Launch and configure a Windows virtual machine
- Bootstrapping using Powershell
- Creating Key Pairs for authentication
Couchbase Connect 2016: Monitoring Production Deployments The Tools – LinkedInMichael Kehoe
Good monitoring can be the difference between a great night's sleep or hearing your phone go off at 2:37 a.m. because of a production outage. Couchbase Server provides a large number of metrics which can be overwhelming if you do not know the critical things to focus on or how to expose that information to your monitoring system. In this talk we will look at example production incidents, going in depth around specific things to monitor, and how this information can be used to find issues, work out root cause, and discover trends.
LinkedIn serves traffic for its 467 million members from four data centers and multiple PoPs spread geographically around the world. Serving live traffic from from many places at the same time has taken us from a disaster recovery model to a disaster avoidance model where we can take an unhealthy data center or PoP out of rotation and redistribute its traffic to a healthy one within minutes, with virtually no visible impact to users. The geographical distribution of our infrastructure also allows us to optimize the end-user's experience by geo routing users to the best possible PoP and datacenter.
This talk provide details on how LinkedIn shifts traffic between its PoPs and data centers to provide the best possible performance and availability for its members. We will also touch on the complexities of performance in APAC, how IPv6 is helping our members and how LinkedIn stress tests data centers verify its disaster recovery capabilities.
RightScale Webinar: Provide a Self-Service Portal for vSphere, AWS and Other ...RightScale
In this webinar you’ll learn how to enable your organization with fast, self-service access to your VMware vSphere resources as well as public clouds such as AWS, Google and Azure. We’ll cover the following topics:
1. Create a Self-Service Portal for vSphere and Public Clouds
Are virtualization and cloud the same thing?
How does vSphere fit with cloud self-service?
2. Create and Manage Portable Workloads
Can I move from vSphere to AWS? and back?
Choosing between in-place management, migration and portability.
3. Provide Visibility and Control for Self-Service
Ensure workloads meet corporate standards.
Manage capacity and costs.
This topic covers SignalR on a general level. The demo used for this talk was a modification of the default chat application to make it more descriptive and realistic in enterprise setting.
Monitoring Containerized Application in Alibaba Cloudgavaskar s
In this presentation we are going to learn following Alibaba Cloud Services/tools used to monitoring the Containerized application.
-CAdvisor
-Heapster/InflexDB
-Grafana
-Prometheus
Orchestrating Cloud Workloads with RightScale Self-Service RightScale
Organizations are seeking to drive agility by offering developers a self-service portal to access cloud resources. In order to provide push-button access to the cloud, IT DevOps teams need to orchestrate the deployment, configuration and integration of entire technology stacks or applications.
David Max SATURN 2018 - Migrating from Oracle to EspressoDavid Max
This talk is about our experience at LinkedIn migrating our content ingestion system from using Oracle to using our internal database system Espresso. I explain some of the reasons for doing the migration as well as how we met the challenges of swapping database technologies with no down time and in a way that was transparent to our clients.
This talk was delivered at the SATURN 2018 conference in Plano, TX on May 9, 2018.
Using SaltStack to Auto Triage and Remediate Production SystemsMichael Kehoe
LinkedIn created an auto-remediation system named Nurse which leverages SaltStack and the CherryPy API to auto-triage and remediate issues with production systems. See how LinkedIn uses SaltStack with Nurse in its production environment and learn how to architect your own auto-triage and remediation system.
Get a glimpse of the main features supported in Nuxeo Platform LTS 2015.
With this LTS version of the Nuxeo Platform, we’re changing how we assign product version names and numbers. The name for each LTS version is now based on the release year. Nuxeo Platform LTS 2015 is the result of the four Fast Track releases throughout the past year.
Highlights of Nuxeo Platform LTS 2015 include:
- Nuxeo Live Connect: Native Integration with Google Drive & Dropbox
- Content Analytics & Data Visualisation
- Elasticsearch: API Passthrough, Hints for NXQL, Security
- Massive Scalability with MongoDB Integration
- New Document Viewer
- Automation Scripting
- Nuxeo Drive 2
- Automated Media Conversions
Project Sherpa: How RightScale Went All in on DockerRightScale
We just finished a 7 week project at RightScale to migrate 48 services and 650+ cloud instances to Docker. As a result we’ve been able to accelerate our development processes and cut our cloud costs (a lot). Here we share lessons learned about our experience migrating to Docker and introduce our new Container Manager we added to the RightScale platform to help manage containerized environments.
Reducing MTTR and False Escalations: Event Correlation at LinkedInMichael Kehoe
LinkedIn’s production stack is made up of over 900 applications and over 2200 internal API’s. With any given application having many interconnected pieces, it is difficult to escalate to the right person in a timely manner.
In order to combat this, LinkedIn built an Event Correlation Engine that monitors service health and maps dependencies between services to correctly escalate to the SRE’s who own the unhealthy service.
We’ll discuss the approach we used in building a correlation engine and how it has been used at LinkedIn to reduce incident impact and provide better quality of life to LinkedIn’s oncall engineers.
Opening the Outage Door: Integrating OMS into CISSSP Innovations
Tri-County Electric Co-Op breaks the OMS data barrier by integrating their existing ATS OpenOne CIS system with Schneider Electric’s Responder OMS. CSR’s now have the ability to: retrieve past outage information for the customer account; input new outage calls on behalf of the customer; and retrieve real-time outage information for existing outages. Customers are now able to enter outages from web and mobile technologies. SSP Innovations bridged the gap with a Multispeak-based web service.
Monitor availability and performance of applications hosted in the Amazon cloud. Monitor your Amazon EC2 and RDS instances and gain insight into the performance of your cloud computing environment, troubleshoot and resolve problems before end users are affected.
Forums: https://forums.site24x7.com/
Facebook: http://www.facebook.com/Site24x7
Twitter: http://twitter.com/site24x7
Google+: https://plus.google.com/+Site24x7
LinkedIn: https://www.linkedin.com/company/site24x7
View Blogs: http://blogs.site24x7.com/
Learning Objectives:
- Securing network access to Amazon EC2 Instances with Security Groups
- Launch and configure a Windows virtual machine
- Bootstrapping using Powershell
- Creating Key Pairs for authentication
Couchbase Connect 2016: Monitoring Production Deployments The Tools – LinkedInMichael Kehoe
Good monitoring can be the difference between a great night's sleep or hearing your phone go off at 2:37 a.m. because of a production outage. Couchbase Server provides a large number of metrics which can be overwhelming if you do not know the critical things to focus on or how to expose that information to your monitoring system. In this talk we will look at example production incidents, going in depth around specific things to monitor, and how this information can be used to find issues, work out root cause, and discover trends.
LinkedIn serves traffic for its 467 million members from four data centers and multiple PoPs spread geographically around the world. Serving live traffic from from many places at the same time has taken us from a disaster recovery model to a disaster avoidance model where we can take an unhealthy data center or PoP out of rotation and redistribute its traffic to a healthy one within minutes, with virtually no visible impact to users. The geographical distribution of our infrastructure also allows us to optimize the end-user's experience by geo routing users to the best possible PoP and datacenter.
This talk provide details on how LinkedIn shifts traffic between its PoPs and data centers to provide the best possible performance and availability for its members. We will also touch on the complexities of performance in APAC, how IPv6 is helping our members and how LinkedIn stress tests data centers verify its disaster recovery capabilities.
RightScale Webinar: Provide a Self-Service Portal for vSphere, AWS and Other ...RightScale
In this webinar you’ll learn how to enable your organization with fast, self-service access to your VMware vSphere resources as well as public clouds such as AWS, Google and Azure. We’ll cover the following topics:
1. Create a Self-Service Portal for vSphere and Public Clouds
Are virtualization and cloud the same thing?
How does vSphere fit with cloud self-service?
2. Create and Manage Portable Workloads
Can I move from vSphere to AWS? and back?
Choosing between in-place management, migration and portability.
3. Provide Visibility and Control for Self-Service
Ensure workloads meet corporate standards.
Manage capacity and costs.
This topic covers SignalR on a general level. The demo used for this talk was a modification of the default chat application to make it more descriptive and realistic in enterprise setting.
Monitoring Containerized Application in Alibaba Cloudgavaskar s
In this presentation we are going to learn following Alibaba Cloud Services/tools used to monitoring the Containerized application.
-CAdvisor
-Heapster/InflexDB
-Grafana
-Prometheus
Orchestrating Cloud Workloads with RightScale Self-Service RightScale
Organizations are seeking to drive agility by offering developers a self-service portal to access cloud resources. In order to provide push-button access to the cloud, IT DevOps teams need to orchestrate the deployment, configuration and integration of entire technology stacks or applications.
David Max SATURN 2018 - Migrating from Oracle to EspressoDavid Max
This talk is about our experience at LinkedIn migrating our content ingestion system from using Oracle to using our internal database system Espresso. I explain some of the reasons for doing the migration as well as how we met the challenges of swapping database technologies with no down time and in a way that was transparent to our clients.
This talk was delivered at the SATURN 2018 conference in Plano, TX on May 9, 2018.
Using SaltStack to Auto Triage and Remediate Production SystemsMichael Kehoe
LinkedIn created an auto-remediation system named Nurse which leverages SaltStack and the CherryPy API to auto-triage and remediate issues with production systems. See how LinkedIn uses SaltStack with Nurse in its production environment and learn how to architect your own auto-triage and remediation system.
Get a glimpse of the main features supported in Nuxeo Platform LTS 2015.
With this LTS version of the Nuxeo Platform, we’re changing how we assign product version names and numbers. The name for each LTS version is now based on the release year. Nuxeo Platform LTS 2015 is the result of the four Fast Track releases throughout the past year.
Highlights of Nuxeo Platform LTS 2015 include:
- Nuxeo Live Connect: Native Integration with Google Drive & Dropbox
- Content Analytics & Data Visualisation
- Elasticsearch: API Passthrough, Hints for NXQL, Security
- Massive Scalability with MongoDB Integration
- New Document Viewer
- Automation Scripting
- Nuxeo Drive 2
- Automated Media Conversions
Kafka: Journey from Just Another Software to Being a Critical Part of PayPal ...confluent
PayPal currently processes tens of billions of signals per day from different sources in batch and streaming mode. The data processing platform is the one powering these different analytical needs and use cases, not just at PayPal but our adjacencies like Venmo, Hyperwallet and iZettle. End users of this platform demand access to data insights with as much flexibility as possible to explore it with low processing latency.
One such use case is where our Switchboard(data de-multiplexer) platform where we process approximately 20 billion events daily and provide data to different teams and platforms with-in PayPal and also to platform outside PayPal for more insights. When we started building this platform Kafka was just another asynchronous message processing platform for us but we have seen it evolving to a place where its adds value not just in terms of event processing but also for platform resiliency and scalability.
Takeaway for the audience: Most people work with and have knowledge about data. With this talk I want to present information which is relevant and meaningful to the audience. Information and examples which will make it easier for attendees to understand our complex system and hopefully have some practical takeaways to use Kafka for similar problems on their hand.
During this brief walkthrough of the setup, configuration and use of the toolset we will show you how to find the trees from the forest in today's modern cloud environments and beyond.
Accenture Cloud Platform helps customers manage public and private enterprise cloud resources effectively and securely. In this session, learn how we designed and built new core platform capabilities using a serverless, microservices-based architecture that is based on AWS services such as AWS Lambda and Amazon API Gateway. During our journey, we discovered a number of key benefits, including a dramatic increase in developer velocity, a reduction (to almost zero) of reliance on other teams, reduced costs, greater resilience, and scalability. We describe the (wild) successes we’ve had and the challenges we’ve overcome to create an AWS serverless architecture at scale. Session sponsored by Accenture.
AWS Competency Partner
Mike Spicer is the lead architect for the IBM Streams team. In his presentation, Mike provides an overview of the many key new features available in IBM Streams V4.1. Simpler development, simpler management, and Spark integration are a few of the capabilities included in IBM Streams V4.1.
AWS re:Invent 2016: The State of Serverless Computing (SVR311)Amazon Web Services
Join us to learn about the state of serverless computing from Dr. Tim Wagner, General Manager of AWS Lambda. Dr. Wagner discusses the latest developments from AWS Lambda and the serverless computing ecosystem. He talks about how serverless computing is becoming a core component in how companies build and run their applications and services, and he also discusses how serverless computing will continue to evolve.
A presentation given to the Brisbane Azure User Group. Several slides taken from Stephen Siciliano's Ignite 2015 presentation (http://channel9.msdn.com/Events/Ignite/2015/BRK1450)
The latest distributed system utilizing the cloud is a very complicated configuration in which the components span a plurality of components. Applications for customers are part of products, and service quality targets directly linked to business indicators are needed. Legacy monitoring system based on traditional system management is not linked not only to business indicators but also to measure service quality. Google advocates the idea of site reliability engineering (SRE) and introduces efforts to measure quality of service. Based on the concept of SRE, the service quality monitoring system collects and analyzes logs from various components not only application codes but also whole infrastructure components. Since very large amounts of data must be processed in real time, it is necessary to design carefully with reference to the big data architecture. To utilize this system, you can measure the quality of service, and make it possible to continuously improve the service quality.
A presentation on the Netflix Cloud Architecture and NetflixOSS open source. For the All Things Open 2015 conference in Raleigh 2015/10/19. #ATO2015 #NetflixOSS
AWS re:Invent 2016 was AWS’ largest event yet with over 32,000 attendees, 400 breakout sessions, and two keynotes of new product announcements. In this talk, we’ll explore the core themes of AWS re:Invent 2016 such as serverless and artificial intelligence. We will also drill down into several of the services and features unveiled including AWS Batch, AWS Shield, Aurora for Postgres, X-Ray, Polly, Lex, Rekognition, AWS Step Functions. Light appetizers and refreshments will be provided.
Awareness presentation on the integration of Network Operations into DevOps and using tools like Ansible and UCS director to automate network operations.
(ENT211) Migrating the US Government to the Cloud | AWS re:Invent 2014Amazon Web Services
The US government has built hundreds of applications that must be refactored to task advantage of modern distributed systems. This session discusses EzBake, an open-source, secure big data platform deployed on top of Amazon EC2 and using Amazon S3 and Amazon RDS. This solution has helped speed the US government to the cloud and make big data easy. Furthermore this session discusses critical architecture design decisions through the creation of the platform in order to add additional security, leverage future AWS offerings, and cut total operations and maintenance costs.
Sponsored by CSC
Geek Sync | Deployment and Management of Complex Azure EnvironmentsIDERA Software
You can watch the replay of this Geek Sync webinar in the IDERA Resource Center: http://ow.ly/pg7N50A4svf.
Today's data management professional is finding their landscape changing. They have multiple database platforms to manage, multi-OS environments and everyone wants it now.
Join IDERA and Kellyn Pot’Vin-Gorman as she discusses the power of auto deployment in Azure when faced with complex environments and tips to increase the knowledge you need at the speed of light. Kellyn will cover scripting basics, advanced Portal features, opportunities to lessen the learning curve and how multi-platform and tier doesn't have to mean multi-cloud.
Attendees can expect to learn how to build automation scripts efficiently, even if you have little scripting experience, and how to work with Azure automation deployments. This session will allow you to begin building a repository of multi-platform development scripts to use as needed.
About Kellyn: Kellyn Pot’Vin-Gorman is a member of the Oak Table Network and an IDERA ACE and Oracle ACE Director alumnus. She is the newest Technical Solution Professional in Power BI with AI in the EdTech group at Microsoft. Kellyn is known for her extensive work with multi-database platforms, DevOps, cloud migrations, virtualization, visualizations, scripting, environment optimization tuning, automation, and architecture design. She has spoken at numerous technical conferences for Oracle, Big Data, DevOps, Testing and SQL Server. Her blog, http://dbakevlar.com and social media activity under her handle, DBAKevlar is well respected for her insight and content.
We're talking about serious log crunching and intelligence gathering with Elastic, Logstash, and Kibana.
ELK is an end-to-end stack for gathering structured and unstructured data from servers. It delivers insights in real time using the Kibana dashboard giving unprecedented horizontal visibility. The visualization and search tools will make your day-to-day hunting a breeze.
During this brief walkthrough of the setup, configuration, and use of the toolset, we will show you how to find the trees from the forest in today's modern cloud environments and beyond.
Dutch Oracle Architects Platform - Reviewing Oracle OpenWorld 2017 and New Tr...Lucas Jellema
Not since the rise of Service Oriented Architecture (and the supporting Fusion Middleware technology) over a decade ago have we seen so much rapid change in terms of application and infrastructure architecture. Cloud, Microservices and DevOps are perhaps the most explicit examples – but many other developments in technology, architecture and even the industry at large have an impact on how enterprises consider and employ IT – such as machine learning, IoT, blockchain.
In this session for (infrastructure, solution, application, enterprise, security, data) architects – we will present the main stories, roadmaps and technologies from Oracle OpenWorld 2017 (and JavaOne) that influence, shape and enable architecture. We will brainstorm together on the consequences of the new directions outlined by Oracle – and coming our way from other quarters. We are seeing a a lot of change. New opportunities arise – that may become challenges or threats if we fail to recognize and embrace the change in time. This session will help us all to get a better handle on the winds in enterprise IT in general and in Oracle land in particular.
Among the topics we will present and discuss are:
- The Only Way is Up – the inevitable and imminent move from on premises to the cloud, and upwards in the stack – from IaaS to SaaS
- Security and Ops in a hybrid landscape (multiple clouds & on premises, multiple technologies & interaction channels)
- Autonomous Database – what, when, how
- Oracle’s cloud strategy, High PaaS and Low PaaS, Open [source] technology (star of the show: Apache Kafka) and the commodization of the traditional Oracle platform
- Container and Cloud Native at Oracle Cloud (Docker, Kubernetes Container Platform, Wercker, Istio Service Mesh, CNCF)
- Serverless
- Java Reborn – for microservices and cloud, modularized (highlights from the JavaOne conference)
- Disruptive: Blockchain, IoT, Machine Learning
My talk from Red Hat Summit 2015 about apache camel
Similar to Deep Dive Into Elasticsearch: Establish A Powerful Log Analysis System With Elastic Stack | On Premises vs SaaS Elastic Stack Comparisons. (20)
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
Key Trends Shaping the Future of Infrastructure.pdf
Deep Dive Into Elasticsearch: Establish A Powerful Log Analysis System With Elastic Stack | On Premises vs SaaS Elastic Stack Comparisons.
1. DEEP DIVE INTO ELASTICSEARCH
Establish A Powerful Log Analysis System
With Elastic Stack.
On Premises vs SaaS Elastic Stack
Comparisons.
Tyler
DevOps Engineer
NFQ Asia Company
2. Agenda
• Intro.
• Overview: Elastic Stack.
• Establish a powerful log analysis system with Elastic Stack.
• Elastic stack options from cloud providers.
• Which one would be fit for us?
• Cost Reflections.
• In conclusion.
3. About Me
• In tech for 7+ years.
• Technical Project Coordinator @ AVASO Technology Solutions.
• Infrastructure Technical Lead @ Betfair Group PLC.
• DevOps Engineer @ NFQ Asia.
• Member of Vietnam Elasticsearch Community.
• Bash/PowerShell languages.
• A dog parent :D
4. About NFQ Asia
• Member of NFQ Company.
• 15+ years’ experience in e-business
strategy and software development
• 300+ professionals.
• 4 countries: offices in Lithuania,
Germany, Vietnam, Singapore.
• Founded in Vietnam since 2015.
• Having organized 5 community
events/hackathons in Vietnam.
7. What is Elastic Stack?
• Formerly known as ELK Stack.
• ELK - The acronym for three open source
projects: elasticsearch, logstash, and kibana.
• Distributed, scalable, and highly available
(both on premises or SaaS).
• The Elastic Stack is the next evolution of ELK.
• Supports the lightweight Beats data shippers
from ES v2.1.1.
8. Elasticsearch
• “You know, for Search”
• Free, Open Source.
• Search engine based on Lucene.
• Near real-time searching, analytics and
visualization capabilities.
• Sophisticated Restful API.
9. Logstash
• Open source data collection engine that unifies
data from disparate sources, normalizes it and
distributes it.
• The ingestion workhorse for elasticsearch and
more.
• Real-time capabilities and pluggable pipeline
architecture.
• Community-extensible and developer-friendly
plugin ecosystem.
10. Kibana
• Open source analytics and visualization
platform designed to work with elasticsearch.
• Specialized for large volumes of streaming and
real-time data.
• No code, no additional infrastructure required.
• Easily and quickly understandable through
graphic representation.
11. Beats Platform
• “Data shippers” that are installed on servers
as agents.
• Either elasticsearch directly or through
logstash.
• Library written based on Golang.
• Supports create your own beat for specific
use cases.
13. Rationale
• What is log?
• How do we solve the production issue as usual?
• How much time do you spend investigating the
production issue?
• Where are the archived log?
• Visualization and dashboards?
14. The Challenge
How do you satisfy the search needs of the application system’s over 2,000 docs
per second while simultaneously providing tactical operational insights that help
both Development Team and Operation Team iteratively improve the customer
experience?
17. Scalability Rationale
• High availability.
• Petabyte-scale data is written and/or read frequently.
• High scalability.
• Sufficient data allocation.
• Costs.
21. WHAT IS AWS ELASTICSEARCH
SERVICE?
• Managed service in AWS Cloud.
• Introduced in Oct 2015.
• Fully managed; Zero admin.
• Highly available and reliable.
• Built-in Kibana support.
• Integrated with other services in AWS ecosystem.
23. What is Elastic Cloud?
• Launched in Oct 2015.
• Provided by Elastic.
• High provisioning and scaling.
• Hosted in the Cloud Providers.
• Service-oriented architecture.
• Containerization using Docker.
• Fully supports custom plugins and API.
26. Specifications comparison sheet
Self-managed Elastic Stack AWS Elasticsearch Service Elastic Cloud Enterprise
Pros
More options and features.
Complete control settings and
capacity.
Access to other APIs
Comprehensive ES monitoring
solutions.
Lowest costs.
SaaS.
Simplify the operations via APIs.
Security by IAM.
Automated snapshots*.
Encryption at rest.
Monitoring included*.
Technical supported.
SaaS.
Fully control through APIs.
Technical Supported.
Uptime SLA.
Feature-rich and complete
monitoring product.
Available on Marketplace.
Cons
Self maintenance.
Infrastructure matters.
No technical supported.
X-Pack limit features.
Limited control.
Less capacity and scalability.
Backup once time per day.
No plugins, no logs.
Medium expensive.
Only support I2 series EC2
instances.
Most expensive.
Imperfect for AWS-hosted
solutions.
27.
28. Costs Comparison Chart
8,400.38 10,678.56 11,512.51
75,303.17
81,375.17
11,316.98 14,500.26
25,201.1525,201.15
32,035.68 34,537.54
203,318.55
219,712.95
28,319.95
38,295.63
50,402.30
0
50,000
100,000
150,000
200,000
250,000
Elastic Stack (AWS) Elastic Stack (GCP) AWS Elasticsearch Services Elastic Cloud (GCP) Elastic Cloud (AWS)
Cost($)
Service Models
One Year One Year (All Upfront) Three Years Three Years (All Upfront)
*Costs calculated based on 3TB-data cluster in multi-AZ in
Frankfurt region
29. In Conclusion
• Elasticsearch leverage the power of analysis ability for both Dev/Ops teams.
• Easily operate/maintain the huge cluster of servers and microservices.
• Choose the proper architecture depend on application/system.
• Estimate the budget to meet the requirements.
• Optimize the aggregation to adopt the resources.
• High availability oriented system.
30. We are hiring…
• Java Senior/Lead Developer
• PHP Senior Developer
• PHP Technical Lead
• Front-end Senior Developer
• Front-end Technical Lead
• Technical Project Manager
Simply send us an email with your enclosed
updated CV to: career@nfq.asia