Propel to the cloud with open source
•Download as PPTX, PDF•
1 like•386 views
Trusted Opinion CTO shares the experience in re-engineering of a social network. Major parts of the presentation: - lessons learned during the re-engirding process - open source frameworks used to implement a highly scalable web applications - system architecture solutions used 5 years ago and today
Report
Share
Report
Share
Recommended
Cleaning The Part: Reclaim your Logging
Monitoring is great. So are logs. But when all your dashboards are red and your inbox is full of alerts, how do you separate the noise from an actual emergency? With a dirty park, it becomes easier for teams to add more garbage to the pile compounding the problem.
In this talk I will walk you through the approach I'm using to help my company move toward 0 error logs. Lack of visibility and lack of ownership have left us with millions and millions of error logs monthly most of which are useless noise. I'll take you through some of the technology choices we made to make error logs easier to consume and harder to avoid. I'll also share my learning on how to drive motivation for a project that feels never-ending.
Building Bridges: A DevOps Story
Join me as I recount my journey in helping introduce DevOps at D2L. Like many enterprise companies we had strong divides between Ops and Dev. Over the years the walls had been built up and the animosity grew. It wasn't until we decided to fully embrace AWS that we had to start building bridges instead of walls.
In this talk I will take you through our journey and the tools, tips, and techniques that helped us heal the divide and begin working together instead of against each other. I will also talk about common pitfalls and mistakes that people make as they start out on the road to DevOps. This talk will help anyone working at a company where the developers and operations are not working together optimally.
Non-profit Cloud Resources - Presentation for Baltimore Techies for Good
This document discusses how non-profits can leverage cloud technologies like startups to operate efficiently with limited budgets. It provides examples of how a startup used cloud services to launch with under $50 per month in recurring costs. The document also lists key cloud resources available for non-profits, including free or discounted offerings from Microsoft, Google, Salesforce and others for applications, platforms, and other services like backups, phone systems and web meetings.
Copy data management
This document discusses copy data management and provides an overview of copy data. It defines copy data as copies of production databases used for disaster recovery, development/testing, business intelligence, and archiving. The document then discusses the challenges of "copy data sprawl" and compares various methods for obtaining copy data like replication, log shipping, mirroring, snapshots, and copy data virtualization. Key advantages and disadvantages of each method are provided. The document concludes with a bibliography and invitation for questions.
Lies Enterprise Architects Tell - Data Day Texas 2018 Keynote
The document discusses lies that architects sometimes tell and truths they avoid. It provides examples of six common lies: 1) saying a system is real-time or has big data when it really has specific requirements, 2) claiming a microservices architecture exists when the goal is still to migrate, 3) saying hybrid/multi-cloud architectures don't exist when the architecture is just copy-pasted, 4) using "best of breed" when really using only one of everything, 5) claiming something can't be done at an organization due to its nature when other similar organizations succeeded, and 6) avoiding risk or change by safely interpreting things in a non-threatening way. The document advocates defining responsibilities clearly, embracing change, taking measured
Your app works slowly. Now what?
You did great job finishing this web app on time and budget. Design patterns, good code coverage, cutting edge frameworks and best CI ever. It goes to production and boom, clients complain it's too slow. They don't really care, if it's best engineering ever, if each view loads 4 seconds. My presentation will give you hints on how to look for bottlenecks. I will also share simple tricks to make the app work faster, or at least seem to work faster.
Cloud Foundry Summit 2014 - IBM Bluemix DevOps Services lightning talk
This is the lightning talk that I gave on the main stage of the Cloud Foundry Summit 2014 describing IBM Bluemix DevOps Services.
Hadoop at Meebo: Lessons in the Real World
Vikram Oberoi presented lessons learned from using Hadoop in production at Meebo. He discussed how Meebo transitioned to using Hadoop for ETL and analytics due to the large volume of log data they process daily. He emphasized the importance of using a workflow manager like Azkaban to automate jobs and dependencies rather than scripts, and of using a backwards-compatible data serialization format like Protocol Buffers to avoid issues when data schemas change over time.
Recommended
Cleaning The Part: Reclaim your Logging
Monitoring is great. So are logs. But when all your dashboards are red and your inbox is full of alerts, how do you separate the noise from an actual emergency? With a dirty park, it becomes easier for teams to add more garbage to the pile compounding the problem.
In this talk I will walk you through the approach I'm using to help my company move toward 0 error logs. Lack of visibility and lack of ownership have left us with millions and millions of error logs monthly most of which are useless noise. I'll take you through some of the technology choices we made to make error logs easier to consume and harder to avoid. I'll also share my learning on how to drive motivation for a project that feels never-ending.
Building Bridges: A DevOps Story
Join me as I recount my journey in helping introduce DevOps at D2L. Like many enterprise companies we had strong divides between Ops and Dev. Over the years the walls had been built up and the animosity grew. It wasn't until we decided to fully embrace AWS that we had to start building bridges instead of walls.
In this talk I will take you through our journey and the tools, tips, and techniques that helped us heal the divide and begin working together instead of against each other. I will also talk about common pitfalls and mistakes that people make as they start out on the road to DevOps. This talk will help anyone working at a company where the developers and operations are not working together optimally.
Non-profit Cloud Resources - Presentation for Baltimore Techies for Good
This document discusses how non-profits can leverage cloud technologies like startups to operate efficiently with limited budgets. It provides examples of how a startup used cloud services to launch with under $50 per month in recurring costs. The document also lists key cloud resources available for non-profits, including free or discounted offerings from Microsoft, Google, Salesforce and others for applications, platforms, and other services like backups, phone systems and web meetings.
Copy data management
This document discusses copy data management and provides an overview of copy data. It defines copy data as copies of production databases used for disaster recovery, development/testing, business intelligence, and archiving. The document then discusses the challenges of "copy data sprawl" and compares various methods for obtaining copy data like replication, log shipping, mirroring, snapshots, and copy data virtualization. Key advantages and disadvantages of each method are provided. The document concludes with a bibliography and invitation for questions.
Lies Enterprise Architects Tell - Data Day Texas 2018 Keynote
The document discusses lies that architects sometimes tell and truths they avoid. It provides examples of six common lies: 1) saying a system is real-time or has big data when it really has specific requirements, 2) claiming a microservices architecture exists when the goal is still to migrate, 3) saying hybrid/multi-cloud architectures don't exist when the architecture is just copy-pasted, 4) using "best of breed" when really using only one of everything, 5) claiming something can't be done at an organization due to its nature when other similar organizations succeeded, and 6) avoiding risk or change by safely interpreting things in a non-threatening way. The document advocates defining responsibilities clearly, embracing change, taking measured
Your app works slowly. Now what?
You did great job finishing this web app on time and budget. Design patterns, good code coverage, cutting edge frameworks and best CI ever. It goes to production and boom, clients complain it's too slow. They don't really care, if it's best engineering ever, if each view loads 4 seconds. My presentation will give you hints on how to look for bottlenecks. I will also share simple tricks to make the app work faster, or at least seem to work faster.
Cloud Foundry Summit 2014 - IBM Bluemix DevOps Services lightning talk
This is the lightning talk that I gave on the main stage of the Cloud Foundry Summit 2014 describing IBM Bluemix DevOps Services.
Hadoop at Meebo: Lessons in the Real World
Vikram Oberoi presented lessons learned from using Hadoop in production at Meebo. He discussed how Meebo transitioned to using Hadoop for ETL and analytics due to the large volume of log data they process daily. He emphasized the importance of using a workflow manager like Azkaban to automate jobs and dependencies rather than scripts, and of using a backwards-compatible data serialization format like Protocol Buffers to avoid issues when data schemas change over time.
IBM Codename: BlueMix DevOps Services for Rapid Software Delivery (Cloud Foun...
Cloud Foundry Summit: IBM Codename: BlueMix DevOps Services for Rapid Software Delivery
Lightning talk by Daniel Berg, IBM Distinguished Engineer and the CTO for DevOps Tools and Strategy at IBM.
Sam Guckenheimer - Moving to One Engineering System
This is the story of transforming Microsoft to One Engineering System with a globally distributed 24x7x365 service on the public cloud. We’ll show you round the system that handles the load of some of the most demanding engineering teams in the world and share some stories about how they got there.
The guardian and app engine
A quick overview of some of the ways that we use Google's AppEngine at the guardian, and why we do so.
Unintended consequences
In this presentation Chris Crosby explains why some data center "enhancements" have some unpleasant side effects
Sparklint @ Spark Meetup Chicago
Spark makes it easy to build and deploy complex data processing applications onto shared compute platforms, but tuning them is a skill in itself and can get overlooked. Uncontrolled, this leads to over specified resource requirements, unnecessary platform load and increases the chances of resource contention, degrading overall performance. By identifying inefficient jobs, development teams and platform administrators can wrestle back control of system resources, improve efficiency and lessen the effect of contention across the cluster.
Sparklint uses the Spark metrics steam and a custom event listener to analyze individual Spark jobs for over specified or unbalanced resources, incorrect partitioning and sub optimal worker locality. It is easily attached to any Spark job and can also run standalone against historical event logs, presenting data for analysis through a web UI and providing a unique resource focused view of the application runtime.
London web perfug_performancefocused_devops_feb2014
The document discusses best practices for performance-focused DevOps including metrics for measuring performance throughout the development and deployment process. It provides examples of companies that deploy software frequently and with few errors and outlines the importance of testing, monitoring and addressing performance issues. The document advocates taking a data-driven approach to identifying and resolving problems in order to improve development efficiency and software quality.
Responsive images
This document discusses responsive images and several solutions for providing optimized images for different devices and bandwidth situations. It summarizes Picturefill, Adaptive Images, HiSRC and SVG as potential solutions. Picturefill allows for image breakpoints and art direction but requires extra markup. Adaptive Images has no markup changes but is limited to PHP. HiSRC uses bandwidth testing and light markup with jQuery. SVG provides a scalable solution using one file but is limited to vector images.
Benefits of Grid Computing in the Cloud
This document discusses using grid computing in the cloud. It introduces RightGrid, a cloud-based grid computing platform from RightScale. The presentation covers how grid applications can leverage cloud infrastructure for back-end processing jobs. It demonstrates RightGrid's architecture using Amazon Web Services and shows how standard design patterns allow jobs to be submitted, processed by worker nodes, and retrieved. Examples of industries using grid computing in the cloud are provided. Benefits discussed include elastic scaling, on-demand access to resources, and a simple cost model.
The 7 Habits of Effective Data Driven Companies
1. Start searching use cases with value & impact: without use cases, nobody will want to draft a data strategy​
Where do you want to go? Draft a clear Customer Experience that you want to create and think about the organization & data strategy to get there!​
2. Get Tech (data scientists and engineers) and Business (Product Management & Commercial) on the same table: create a solid foundation.​
3. Start with communities of practice to learn & experiment together and build the capability.​
4. Stop talking about data. Start experimenting and doing. ​
5. Product Management needs to get real about data. (start training these capabilities)
Virtualization and Containers
This document discusses using virtualization and containers to improve database deployments in development environments. It notes that traditional database deployments are slow, taking 85% of project time for creation and refreshes. Virtualization allows for more frequent releases by speeding up refresh times. The document discusses how virtualization engines can track database changes and provision new virtual databases in seconds from a source database. This allows developers and testers to self-service provision databases without involving DBAs. It also discusses how virtualization and containers can optimize database deployments in cloud environments by reducing storage usage and data transfers.
GoldenGate Case Study - Enterprise IT
This document discusses how Oracle GoldenGate was used to enable a zero downtime migration and upgrade project for a client. GoldenGate captured changes in the source database and kept the new database synchronized during the migration process. This allowed the application to switch over to the new database with no disruption to availability within the limited maintenance window. By implementing a generic procedure, GoldenGate provided a solution that could be reused for other migration projects, improving high availability and disaster recovery capabilities overall.
DevOps@Scale- IBM Cloud and NetAp-Insight-Berlin
DevOps@scale. IBM and NetApp recently joined forces to dramatically accelerate developer workspace creation and build times (by more than 30x!) for the developers leveraging IBM Cloud Container Service powered by Kubernetes. Agile and Lean methods drove the entire project lifecycle from early design thinking workshops to pair programming with weekly playbacks. By starting with a design thinking focus and practicing agile methods, the team repeatedly demonstrated the ability to pivot, accelerate development, and ultimately highlight the flexibility and high-value capabilities of both the NetApp Data Fabric and the IBM Cloud Platform. This session will take an in-depth look at the practices used by the joint development team, and the high-level results they were able to achieve in a very short period of time.
Apcera Case Study: The selection of the Go language
Derek Collison, founder of Apcera, discusses why the company selected Go as its primary programming language over other options like Ruby and Node.js. Some key reasons included Go's built-in support for concurrency, its static typing and compilation which aids dependency management, and its suitability for building distributed systems. While Go had some immature areas like its garbage collection and standard library, its focus on stacks, statically linked executables, and ease of learning made it the best choice for Apcera's cloud platform needs. Collison believes more companies will make the same choice as Go continues to evolve and address open issues.
Apply, rinse and repeat: avoid the fidelity gap
OpenStack Tokyo Presentation about best practices for scale deployment using Digital Rebar & Open Contrail.
Rob Hirschfeld and Parantap Lahiri
Kubo (Cloud Foundry Container Platform): Your Gateway Drug to Cloud-native
The document discusses how Kubo can be used as a gateway to running cloud-native workloads. It outlines different types of workloads like code developed internally which may change frequently or code from third parties. For internally developed code, Kubo allows maintaining existing processes while deploying container images instead of infrastructure. For external code and data-centric workloads, Kubo provides benefits like health management, multi-cloud support, and operating system/Kubernetes upgrades without affecting applications. The document calls developers to run workloads on Cloud Foundry Container Runtime and share experiences.
Kubo (Cloud Foundry Container Platform): Your Gateway Drug to Cloud-native
You’re at the Cloud Foundry Summit, which means you are by definition a cloud-native enthusiast. There’s no question that building apps in this architectural style will produce resilient, scalable software in an agile manner, and allow you to operate it far more efficiently than you’ve been able to in the past. But you’ve also got a whole lot of software in your company’s portfolio that isn’t there yet. Do you have to resign yourself to the pains of managing those applications the old way until you can finally refactor them to be cloud-native? Kubo to the rescue.
You can run legacy applications on Kubo without significant refactoring – pure and simple. As an added bonus, it allows you to satisfy the CIO mandate of running containers (check). But it’s far more than that – running those workloads on Kubo offers advantages over running them on traditional virtualized infrastructure. This session covers those advantages –resource consolidation, health management, multi-cloud and more. It will also present the abstractions in Kubernetes, things like pods and stateful sets, that support running legacy workloads in the cloud environments that are far more distributed and changing than they have been in the past. It’s a first step to cloud-native.
Pratyusa_Resume
This document provides a summary of Pratyusa Choudhury's work experience as an Oracle DBA. It details 6 years of experience working on various Oracle EBS, Database, and Fusion Middleware projects involving upgrades, migrations, and ongoing support. Responsibilities included patching, cloning, and troubleshooting Oracle EBS, Database, and middleware issues. Technologies worked on include Oracle EBS 11i, R12, Database 10g, 11g, 12c, Fusion Middleware, and tools like OEM and Hudson. Various projects are summarized involving upgrades, platform migrations, data center migrations, and ongoing support projects.
SRE vs DevOps vs Cloud Native Preso
DevOpsDays Austin Presentation from 5/4/17 at 4:05 pm
Discussing the alignment and differences between these key infrastructure automation concepts.
Adobe Advertising Cloud: The Reality of Cloud Bursting with OpenStack
After successfully moving a large workload from a Public Cloud to an OpenStack Private Cloud, the former TubeMogul Operations Engineering team tackled its next important step toward Cloud Bursting.
While experiencing hyper-growth on the Adobe Advertising Cloud, the team had to figure out a simple way to quickly provision new compute resources. Our latency critical workload need our core private resources while some workload can safely leverage public cloud. Cloud Bursting helped to ensure rapid support of the business and provide a more flexible capacity planning strategy. Being able to burst some workload back to the Public Cloud allowed the team to leverage the best of public and private cloud.
In this presentation, we will detail how the team dealt with the network complexity between clouds infrastructure, the cost effectiveness of cloud bursting, the impact on performance, and the hard reality of multi-cloud environments.
Multi-Cloud Lightweight Platform as a Service
Lightweight PaaS as a vitally-needed solution for efficient applications hosting, that helps to overcome such road blockers as:
- complexity of managing infrastructure
- lock-in and overpaying
- wasting time on server configuration
- lacking compatibility with legacy applications
- GDPR compliance
OpenStack Preso: DevOps on Hybrid Infrastructure
Discusses the approach for making hybrid DevOps workable including what obstacles must be overcome. Includes demo of multiple OpenStack clouds & Kubernetes deploy on AWS, Google and OpenStack
2016 - Open Mic - IGNITE - Open Infrastructure = ANY Infrastructure
The document discusses the need for hybrid infrastructure and hybrid DevOps to manage different cloud platforms and physical infrastructure in a consistent way. It notes that while no single API or platform can meet all needs, AWS dominance means its operational patterns have become the benchmark. The key is developing composable infrastructure modules that can be orchestrated together to provide portability across environments using a common operational process.
More Related Content
What's hot
IBM Codename: BlueMix DevOps Services for Rapid Software Delivery (Cloud Foun...
Cloud Foundry Summit: IBM Codename: BlueMix DevOps Services for Rapid Software Delivery
Lightning talk by Daniel Berg, IBM Distinguished Engineer and the CTO for DevOps Tools and Strategy at IBM.
Sam Guckenheimer - Moving to One Engineering System
This is the story of transforming Microsoft to One Engineering System with a globally distributed 24x7x365 service on the public cloud. We’ll show you round the system that handles the load of some of the most demanding engineering teams in the world and share some stories about how they got there.
The guardian and app engine
A quick overview of some of the ways that we use Google's AppEngine at the guardian, and why we do so.
Unintended consequences
In this presentation Chris Crosby explains why some data center "enhancements" have some unpleasant side effects
Sparklint @ Spark Meetup Chicago
Spark makes it easy to build and deploy complex data processing applications onto shared compute platforms, but tuning them is a skill in itself and can get overlooked. Uncontrolled, this leads to over specified resource requirements, unnecessary platform load and increases the chances of resource contention, degrading overall performance. By identifying inefficient jobs, development teams and platform administrators can wrestle back control of system resources, improve efficiency and lessen the effect of contention across the cluster.
Sparklint uses the Spark metrics steam and a custom event listener to analyze individual Spark jobs for over specified or unbalanced resources, incorrect partitioning and sub optimal worker locality. It is easily attached to any Spark job and can also run standalone against historical event logs, presenting data for analysis through a web UI and providing a unique resource focused view of the application runtime.
London web perfug_performancefocused_devops_feb2014
The document discusses best practices for performance-focused DevOps including metrics for measuring performance throughout the development and deployment process. It provides examples of companies that deploy software frequently and with few errors and outlines the importance of testing, monitoring and addressing performance issues. The document advocates taking a data-driven approach to identifying and resolving problems in order to improve development efficiency and software quality.
Responsive images
This document discusses responsive images and several solutions for providing optimized images for different devices and bandwidth situations. It summarizes Picturefill, Adaptive Images, HiSRC and SVG as potential solutions. Picturefill allows for image breakpoints and art direction but requires extra markup. Adaptive Images has no markup changes but is limited to PHP. HiSRC uses bandwidth testing and light markup with jQuery. SVG provides a scalable solution using one file but is limited to vector images.
Benefits of Grid Computing in the Cloud
This document discusses using grid computing in the cloud. It introduces RightGrid, a cloud-based grid computing platform from RightScale. The presentation covers how grid applications can leverage cloud infrastructure for back-end processing jobs. It demonstrates RightGrid's architecture using Amazon Web Services and shows how standard design patterns allow jobs to be submitted, processed by worker nodes, and retrieved. Examples of industries using grid computing in the cloud are provided. Benefits discussed include elastic scaling, on-demand access to resources, and a simple cost model.
The 7 Habits of Effective Data Driven Companies
1. Start searching use cases with value & impact: without use cases, nobody will want to draft a data strategy​
Where do you want to go? Draft a clear Customer Experience that you want to create and think about the organization & data strategy to get there!​
2. Get Tech (data scientists and engineers) and Business (Product Management & Commercial) on the same table: create a solid foundation.​
3. Start with communities of practice to learn & experiment together and build the capability.​
4. Stop talking about data. Start experimenting and doing. ​
5. Product Management needs to get real about data. (start training these capabilities)
What's hot (9)
IBM Codename: BlueMix DevOps Services for Rapid Software Delivery (Cloud Foun...
IBM Codename: BlueMix DevOps Services for Rapid Software Delivery (Cloud Foun...
Â
Sam Guckenheimer - Moving to One Engineering System
Sam Guckenheimer - Moving to One Engineering System
Â
London web perfug_performancefocused_devops_feb2014
London web perfug_performancefocused_devops_feb2014
Â
Similar to Propel to the cloud with open source
Virtualization and Containers
This document discusses using virtualization and containers to improve database deployments in development environments. It notes that traditional database deployments are slow, taking 85% of project time for creation and refreshes. Virtualization allows for more frequent releases by speeding up refresh times. The document discusses how virtualization engines can track database changes and provision new virtual databases in seconds from a source database. This allows developers and testers to self-service provision databases without involving DBAs. It also discusses how virtualization and containers can optimize database deployments in cloud environments by reducing storage usage and data transfers.
GoldenGate Case Study - Enterprise IT
This document discusses how Oracle GoldenGate was used to enable a zero downtime migration and upgrade project for a client. GoldenGate captured changes in the source database and kept the new database synchronized during the migration process. This allowed the application to switch over to the new database with no disruption to availability within the limited maintenance window. By implementing a generic procedure, GoldenGate provided a solution that could be reused for other migration projects, improving high availability and disaster recovery capabilities overall.
DevOps@Scale- IBM Cloud and NetAp-Insight-Berlin
DevOps@scale. IBM and NetApp recently joined forces to dramatically accelerate developer workspace creation and build times (by more than 30x!) for the developers leveraging IBM Cloud Container Service powered by Kubernetes. Agile and Lean methods drove the entire project lifecycle from early design thinking workshops to pair programming with weekly playbacks. By starting with a design thinking focus and practicing agile methods, the team repeatedly demonstrated the ability to pivot, accelerate development, and ultimately highlight the flexibility and high-value capabilities of both the NetApp Data Fabric and the IBM Cloud Platform. This session will take an in-depth look at the practices used by the joint development team, and the high-level results they were able to achieve in a very short period of time.
Apcera Case Study: The selection of the Go language
Derek Collison, founder of Apcera, discusses why the company selected Go as its primary programming language over other options like Ruby and Node.js. Some key reasons included Go's built-in support for concurrency, its static typing and compilation which aids dependency management, and its suitability for building distributed systems. While Go had some immature areas like its garbage collection and standard library, its focus on stacks, statically linked executables, and ease of learning made it the best choice for Apcera's cloud platform needs. Collison believes more companies will make the same choice as Go continues to evolve and address open issues.
Apply, rinse and repeat: avoid the fidelity gap
OpenStack Tokyo Presentation about best practices for scale deployment using Digital Rebar & Open Contrail.
Rob Hirschfeld and Parantap Lahiri
Kubo (Cloud Foundry Container Platform): Your Gateway Drug to Cloud-native
The document discusses how Kubo can be used as a gateway to running cloud-native workloads. It outlines different types of workloads like code developed internally which may change frequently or code from third parties. For internally developed code, Kubo allows maintaining existing processes while deploying container images instead of infrastructure. For external code and data-centric workloads, Kubo provides benefits like health management, multi-cloud support, and operating system/Kubernetes upgrades without affecting applications. The document calls developers to run workloads on Cloud Foundry Container Runtime and share experiences.
Kubo (Cloud Foundry Container Platform): Your Gateway Drug to Cloud-native
You’re at the Cloud Foundry Summit, which means you are by definition a cloud-native enthusiast. There’s no question that building apps in this architectural style will produce resilient, scalable software in an agile manner, and allow you to operate it far more efficiently than you’ve been able to in the past. But you’ve also got a whole lot of software in your company’s portfolio that isn’t there yet. Do you have to resign yourself to the pains of managing those applications the old way until you can finally refactor them to be cloud-native? Kubo to the rescue.
You can run legacy applications on Kubo without significant refactoring – pure and simple. As an added bonus, it allows you to satisfy the CIO mandate of running containers (check). But it’s far more than that – running those workloads on Kubo offers advantages over running them on traditional virtualized infrastructure. This session covers those advantages –resource consolidation, health management, multi-cloud and more. It will also present the abstractions in Kubernetes, things like pods and stateful sets, that support running legacy workloads in the cloud environments that are far more distributed and changing than they have been in the past. It’s a first step to cloud-native.
Pratyusa_Resume
This document provides a summary of Pratyusa Choudhury's work experience as an Oracle DBA. It details 6 years of experience working on various Oracle EBS, Database, and Fusion Middleware projects involving upgrades, migrations, and ongoing support. Responsibilities included patching, cloning, and troubleshooting Oracle EBS, Database, and middleware issues. Technologies worked on include Oracle EBS 11i, R12, Database 10g, 11g, 12c, Fusion Middleware, and tools like OEM and Hudson. Various projects are summarized involving upgrades, platform migrations, data center migrations, and ongoing support projects.
SRE vs DevOps vs Cloud Native Preso
DevOpsDays Austin Presentation from 5/4/17 at 4:05 pm
Discussing the alignment and differences between these key infrastructure automation concepts.
Adobe Advertising Cloud: The Reality of Cloud Bursting with OpenStack
After successfully moving a large workload from a Public Cloud to an OpenStack Private Cloud, the former TubeMogul Operations Engineering team tackled its next important step toward Cloud Bursting.
While experiencing hyper-growth on the Adobe Advertising Cloud, the team had to figure out a simple way to quickly provision new compute resources. Our latency critical workload need our core private resources while some workload can safely leverage public cloud. Cloud Bursting helped to ensure rapid support of the business and provide a more flexible capacity planning strategy. Being able to burst some workload back to the Public Cloud allowed the team to leverage the best of public and private cloud.
In this presentation, we will detail how the team dealt with the network complexity between clouds infrastructure, the cost effectiveness of cloud bursting, the impact on performance, and the hard reality of multi-cloud environments.
Multi-Cloud Lightweight Platform as a Service
Lightweight PaaS as a vitally-needed solution for efficient applications hosting, that helps to overcome such road blockers as:
- complexity of managing infrastructure
- lock-in and overpaying
- wasting time on server configuration
- lacking compatibility with legacy applications
- GDPR compliance
OpenStack Preso: DevOps on Hybrid Infrastructure
Discusses the approach for making hybrid DevOps workable including what obstacles must be overcome. Includes demo of multiple OpenStack clouds & Kubernetes deploy on AWS, Google and OpenStack
2016 - Open Mic - IGNITE - Open Infrastructure = ANY Infrastructure
The document discusses the need for hybrid infrastructure and hybrid DevOps to manage different cloud platforms and physical infrastructure in a consistent way. It notes that while no single API or platform can meet all needs, AWS dominance means its operational patterns have become the benchmark. The key is developing composable infrastructure modules that can be orchestrated together to provide portability across environments using a common operational process.
Comparison of control plane deployment architectures in the scope of hypercon...
The OpenStack control plane can be implemented using one of the three infrastructure types: Bare Metal, Virtual Machines, and Containers. Comprehensive comparisons of these approaches are not available. In the first section of our talk, we present a reference architecture for building a virtualized control plane, which supports OpenStack controller HA, file system HA, networking HA, and enhanced performance through CPU-pinning, and SR-IOV. All the building blocks are based on established open source tools and their corresponding products, Red Hat Enterprise Virtualization, Red Hat Gluster Storage and Red Hat OpenStack. Any OpenStack deployment tool which can be used on bare metal work to build this virtualized control plane. We will focus on comparisons of different OpenStack control plane infrastructures. We compare the deployment and operational aspects of different control plane implementation on the same hardware environment. We also evaluate the different control plane deployments through benchmarking tools (such as Rally), and provide a quantitative comparison.
OpenStack clusters are most often built with servers for Nova compute VMs and servers for storage, with Ceph storage requiring 3 or more nodes. It can be more cost-effective to "hyperconverge" Nova and Ceph on to the same servers, and rising processor core counts and RAM density have made this feasible. But it is important to understand the resource demand patterns of each and protect against corner cases where one starves the other. In the second section of our talk we will present our empirical approach to:
Generating realistic system & storage loads using open source test suites
Collecting and analyzing results quantitatively
Optimizing hardware configuration and resource partitioning
We will present data, analysis, and lessons learned from our hyperconverged infrastructure work.
Berlioz Introduction
Whether you’re starting a new cloud development or migrating to the cloud, Berlioz would automate infrastructure setup, service deployment, monitoring and security - all in just one step.
Learn how you can achieve:
a) Cloud and environment portability
Seamlessly migrate across cloud vendors (GCP and AWS) and deployment environments (dev to test, test to prod).
b) Monitoring and overall observability.
Achieve observability across all your services, in all your environments. Including Prometheus, Grafana, Zipkin and Jaeger
c) Secure deployments out-of-the-box.
Our solution automatically configures security aspects of your application, configuring: Firewall rules, Cloud IAM policies, Kubernetes network policies and Istio mutual TLS
d) Improved cross-functional team interactions.
Our tools would enable Dev, QA and SRE teams to collaborate efficiently and deliver high quality software!
Cloudify 6 Webinar
1) Cloudify Version 6 aims to turn "glue code" into certified environments and simplify DevOps workflows by providing environment automation as a service.
2) Traditional CI/CD approaches have led to a proliferation of automation silos and tools, overloading DevOps teams. Cloudify Version 6 integrates with various tools to provide a unified approach.
3) The presentation demonstrated Cloudify's environment as a service capabilities through a live demo, showing how it can optimize infrastructure costs and improve development efficiency through standardized, certified environments.
Gluecon Preso: Hybrid Container Infrastructure
My Gluecon presentation about hybrid infrastructure and container orchestration deployment. I talk about why composability matters and how AWS sets the standard.
How to Architect AWS for Mission-Critical Applications
A presentation delivered by Logicworks, a cloud consulting and engineering services company, on June 27, 2017.
AWS and Dynatrace: Moving your Cloud Strategy to the Next Level
AWS and Dynatrace: Moving your Cloud Strategy to the Next Level
On-Demand Webcast
AWS re:Invent was an exciting time for Dynatrace and we received a lot of “Wows” on our capabilities. We got to demonstrate the only AI-based, full-stack monitoring solution to thousands of AWS prospects and users. We announced our AWS Certified DevOps Competency partnership, and we introduced DAVIS, our natural-language voice interface, to thousands of attendees.
We know that many of you couldn’t attend the event in Las Vegas, so we wanted to share some of the key highlights from the show. And for those of you who were there, you may not have seen all of the benefits Dynatrace provides in the AWS ecosystem due to time constraints of sessions and the large tradeshow floor.
Listen to this 30 Minute webcast where Alois Reitbauer and Franz Karlsberger recap some of the highlights of the event, including:
How Dynatrace, as an AWS certified Migration Competency partner, uniquely supports enterprise migrations to AWS
How to achieve faster feedback and improved lead times with AWS CodePipeline and Dynatrace
An overview of the first ever VoiceOps and ChatOps interface via DAVIS, based on our AI approach to full-stack monitoring
Use GitLab with Chaos Engineering to Harden your Applications + OpenEBS 1.3 ...
The document provides an overview of new features in OpenEBS 1.3 including support for Kubernetes 1.16 APIs, enhancements like auto scaling of cStor pools and initial support for NDM prometheus metrics exporter, and bug fixes. It discusses using GitLab with OpenEBS for running GitLab and storing application data and using Litmus for injecting chaos in GitLab pipelines. The presentation covers use cases like using OpenEBS as persistent storage for GitLab, keeping CI data closer to reality with immediate access to failed environments, and practicing chaos engineering to increase resiliency from CI pipelines to production.
Similar to Propel to the cloud with open source (20)
Apcera Case Study: The selection of the Go language
Apcera Case Study: The selection of the Go language
Â
Kubo (Cloud Foundry Container Platform): Your Gateway Drug to Cloud-native
Kubo (Cloud Foundry Container Platform): Your Gateway Drug to Cloud-native
Â
Kubo (Cloud Foundry Container Platform): Your Gateway Drug to Cloud-native
Kubo (Cloud Foundry Container Platform): Your Gateway Drug to Cloud-native
Â
Adobe Advertising Cloud: The Reality of Cloud Bursting with OpenStack
Adobe Advertising Cloud: The Reality of Cloud Bursting with OpenStack
Â
2016 - Open Mic - IGNITE - Open Infrastructure = ANY Infrastructure
2016 - Open Mic - IGNITE - Open Infrastructure = ANY Infrastructure
Â
Comparison of control plane deployment architectures in the scope of hypercon...
Comparison of control plane deployment architectures in the scope of hypercon...
Â
How to Architect AWS for Mission-Critical Applications
How to Architect AWS for Mission-Critical Applications
Â
AWS and Dynatrace: Moving your Cloud Strategy to the Next Level
AWS and Dynatrace: Moving your Cloud Strategy to the Next Level
Â
Use GitLab with Chaos Engineering to Harden your Applications + OpenEBS 1.3 ...
Use GitLab with Chaos Engineering to Harden your Applications + OpenEBS 1.3 ...
Â
More from Gene Leybzon
Generative AI Application Development using LangChain and LangFlow
LangChain and LangFlow are tools for developing applications using large language models (LLMs). LangChain provides libraries, templates, and tools to facilitate building context-aware systems using LLMs from prototype to production. It includes components, chains to process data, and LangSmith for debugging models. LangFlow is a GUI for LangChain. The presentation demonstrates LangChain's chat capabilities and use of tools/agents. It discusses building applications with LangChain and deploying them via LangServe APIs. LangChain aims to enhance LLM utility by making them more reasoning and context-aware.
Chat GPTs
🚀 What Are GPTs?
GPTs are tailor-made ChatGPT versions that you can craft to suit your specific needs. Whether it's for learning new skills, aiding in education, or assisting in unique work tasks, these custom GPTs are designed to be versatile and incredibly user-friendly.
✨ Create Your Own AI Assistant - No Coding Required! The best part? You don't need to be a tech wizard to create your GPT. The process is as simple as starting a conversation - guiding the AI, feeding it extra knowledge, and choosing its capabilities, like web searching, crafting images, or data analysis.
Generative AI Use cases for Enterprise - Second Session
This document provides an overview of generative AI use cases for enterprises. It begins with addressing concerns that generative AI will replace jobs. The presentation then defines generative AI as AI that generates new content like text, images or code based on patterns learned from training data.
Several examples of generative AI outputs are shown including code, text, images and advice. Potential use cases for enterprises are then outlined, including synthetic data generation, code generation, code quality checks, customer service, and data analysis. The presentation concludes by emphasizing that people will be "replaced by someone who knows how to use AI", not AI itself.
Generative AI Use-cases for Enterprise - First Session
In this presentation, we will delve into the exciting applications of Generative AI across various business domains. Leveraging the capabilities of artificial intelligence and machine learning, Generative AI allows for dynamic, context-aware user interfaces that adapt in real-time to provide personalized user experiences. We will explore how this transformative technology can streamline design processes, facilitate user engagement, and open the doors to new forms of interactivity.
Non-fungible tokens (nfts)
Non-fungible tokens (NFTs) are unique digital assets that are verified on a blockchain network, allowing for the creation and ownership of one-of-a-kind digital items, such as artwork, music, videos, and other types of digital content. They are important because they provide a way for digital creators to monetize their work and establish ownership, scarcity, and authenticity of their creations. NFTs have also gained popularity as a form of investment and collectible item, with some NFTs selling for millions of dollars.
This slide deck includes the following sections:
Introduction: Provide a brief overview of what NFTs are and their significance in the digital world.
How NFTs work: Explain the process of creating and verifying NFTs on a blockchain network, including the use of smart contracts and cryptographic hashing.
Types of NFTs: Describe the various types of NFTs that can be created, such as digital artwork, music, videos, and other types of digital content.
Benefits of NFTs: Highlight the benefits of NFTs, including the ability to establish ownership, scarcity, and authenticity of digital assets, as well as their potential as a new source of revenue for creators.
Market trends: Provide an overview of the current state of the NFT market, including recent sales and trends in various industries, such as art, sports, and gaming.
Potential use cases: Discuss potential use cases for NFTs beyond the current market, such as in the areas of identity verification, supply chain management, and digital voting.
Challenges and risks: Acknowledge the challenges and risks associated with NFTs, such as environmental concerns related to blockchain networks and the potential for fraudulent activity.
Conclusion: Summarize the key takeaways of the presentation and emphasize the growing importance of NFTs in the digital world.
Introduction to Solidity and Smart Contract Development (9).pptx
Here is a suggested learning path for getting started with blockchain and smart contracts development:
1. Learn the fundamentals of blockchain technology - how it works, key components, types of blockchains.
2. Understand cryptography basics - hashes, digital signatures, public/private key encryption.
3. Learn the Solidity programming language for writing Ethereum smart contracts.
4. Build simple smart contracts and deploy them to testnets.
5. Learn how to develop decentralized applications (dApps) using smart contracts.
6. Explore blockchain development platforms like Ethereum, Hyperledger, etc.
7. Learn frontend libraries like Web3.js for interacting with blockchains.
8.
Ethereum in Enterprise.pptx
Ethereum and other blockchains are finding their way into the enterprise world. We look into common use cases, blockchains, and standard approaches to deploy and access enterprise blockchains
ERC-4907 Rentable NFT Standard.pptx
This document discusses rentable non-fungible tokens (NFTs) and the ERC-4907 standard. It begins with an overview of NFTs and common standards like ERC-721. It then introduces the concept of renting NFTs and outlines the rental experience. The ERC-4907 standard is presented as enabling risk-free NFT rentals by allowing contracts to set users and expiration dates for rented NFTs. Code examples and next steps are provided to implement rentable NFTs using this standard.
Onchain Decentralized Governance 2.pptx
The document discusses decentralized governance and smart contracts, providing examples of DAO governance models and OpenZeppelin governor contract functionality. It defines DAOs as organizations represented by rules encoded as a computer program and controlled by members, not a central authority. Notable DAOs like Dash, The DAO, Augur, and Uniswap are examined. Yearn Finance's multi-DAO governance structure using YFI tokens is explained in detail. Finally, examples are provided for deploying a MeetupToken contract, MeetupGovernor contract, and creating a DAO using these contracts and on-chain voting functionality.
Onchain Decentralized Governance.pptx
Looks into different DAO governance frameworks and tools. Deep dive into Solidity example of proposal voting contract
Web3 File Storage Options
Smart contracts and NFTs call for a revised approach to store data. In these slides, 3 options for distributed and fault-tolerant data storage are presented:
IPFS
Filecoin
Arweave
Web3 Full Stack Development
Demonstrating how to create an end-to-end Web-based application that uses blockchain for user authentication, read, and write access to the data stored on the blockchain
Instantly tradeable NFT contracts based on ERC-1155 standard
The document discusses the ERC-1155 token standard which allows for both fungible and non-fungible tokens to be transferred together in a single transaction, providing benefits over existing standards like ERC-20 and ERC-721. It provides an overview of the standard's functions and events as well as examples of how it can be implemented using OpenZeppelin's ERC-1155 contract. The presentation also covers how to publish an ERC-1155 based NFT collection on the OpenSea marketplace.
Non-fungible tokens. From smart contract code to marketplace
This document provides an overview of non-fungible tokens (NFTs), including their history from colored coins in 2012 to recent growth in 2021. Key concepts covered include the differences between fungible and non-fungible assets, common NFT use cases like art and collectibles, and technical standards like ERC-721 and ERC-1155. The document demonstrates how to create, mint, and list an NFT for sale using OpenSea and the Ethereum blockchain.
The Art of non-fungible tokens
This document provides an overview of non-fungible tokens (NFTs). It defines NFTs and discusses their history from colored coins in 2012 to recent growth in 2021. Common use cases for NFTs like art, games, and collectibles are described. The ERC-721 and ERC-1155 token standards are explained. Hands-on examples are provided for creating an ERC-721 contract from scratch and minting/selling an NFT on OpenSea.
Graph protocol for accessing information about blockchains and d apps
Overview of TheGraph and hands-on tutorial on accessing data from blockchains using GraphQL language
Substrate Framework
Substrate framework as a foundation for enterprise blockchains:
- Use cases
- Out-of-the box features
- Available customization options
Chainlink
Chainlink is a decentralized oracle network that allows smart contracts to securely access external data and APIs. It provides smart contracts with data from outside sources through oracle nodes that query, verify, and authenticate external data feeds. Chainlink has built-in price feeds and adapters that allow smart contracts to request data from nodes paid in LINK tokens. The document demonstrates a smart contract using Chainlink to request ETH price data from an API and receive the response once fulfilled.
OpenZeppelin + Remix + BNB smart chain
The document discusses creating an ERC-20 token on the Binance Smart Chain using OpenZeppelin and Remix IDE. It provides an overview of ERC-20 standards, describes how to create an ERC-20 token contract using OpenZeppelin, edit the code in Remix, deploy it to BSC testnet, and check that the token was successfully created and transferred between accounts.
Chainlink, Cosmos, Kusama, Polkadot: Approaches to the Internet of Blockchains
Approaches to connectivity between blockchains with examples of Chainlink, Cosmos, Kusama, and Polkadot
More from Gene Leybzon (20)
Generative AI Application Development using LangChain and LangFlow
Generative AI Application Development using LangChain and LangFlow
Â
Generative AI Use cases for Enterprise - Second Session
Generative AI Use cases for Enterprise - Second Session
Â
Generative AI Use-cases for Enterprise - First Session
Generative AI Use-cases for Enterprise - First Session
Â
Introduction to Solidity and Smart Contract Development (9).pptx
Introduction to Solidity and Smart Contract Development (9).pptx
Â
Instantly tradeable NFT contracts based on ERC-1155 standard
Instantly tradeable NFT contracts based on ERC-1155 standard
Â
Non-fungible tokens. From smart contract code to marketplace
Non-fungible tokens. From smart contract code to marketplace
Â
Graph protocol for accessing information about blockchains and d apps
Graph protocol for accessing information about blockchains and d apps
Â
Chainlink, Cosmos, Kusama, Polkadot: Approaches to the Internet of Blockchains
Chainlink, Cosmos, Kusama, Polkadot: Approaches to the Internet of Blockchains
Â
Recently uploaded
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Dmitrii Kamaev, PhD
Senior Product Owner - QIAGEN
June Patch Tuesday
Ivanti’s Patch Tuesday breakdown goes beyond patching your applications and brings you the intelligence and guidance needed to prioritize where to focus your attention first. Catch early analysis on our Ivanti blog, then join industry expert Chris Goettl for the Patch Tuesday Webinar Event. There we’ll do a deep dive into each of the bulletins and give guidance on the risks associated with the newly-identified vulnerabilities.
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Are you ready to revolutionize how you handle data? Join us for a webinar where we’ll bring you up to speed with the latest advancements in Generative AI technology and discover how leveraging FME with tools from giants like Google Gemini, Amazon, and Microsoft OpenAI can supercharge your workflow efficiency.
During the hour, we’ll take you through:
Guest Speaker Segment with Hannah Barrington: Dive into the world of dynamic real estate marketing with Hannah, the Marketing Manager at Workspace Group. Hear firsthand how their team generates engaging descriptions for thousands of office units by integrating diverse data sources—from PDF floorplans to web pages—using FME transformers, like OpenAIVisionConnector and AnthropicVisionConnector. This use case will show you how GenAI can streamline content creation for marketing across the board.
Ollama Use Case: Learn how Scenario Specialist Dmitri Bagh has utilized Ollama within FME to input data, create custom models, and enhance security protocols. This segment will include demos to illustrate the full capabilities of FME in AI-driven processes.
Custom AI Models: Discover how to leverage FME to build personalized AI models using your data. Whether it’s populating a model with local data for added security or integrating public AI tools, find out how FME facilitates a versatile and secure approach to AI.
We’ll wrap up with a live Q&A session where you can engage with our experts on your specific use cases, and learn more about optimizing your data workflows with AI.
This webinar is ideal for professionals seeking to harness the power of AI within their data management systems while ensuring high levels of customization and security. Whether you're a novice or an expert, gain actionable insights and strategies to elevate your data processes. Join us to see how FME and AI can revolutionize how you work with data!
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
At this talk we will discuss DDoS protection tools and best practices, discuss network architectures and what AWS has to offer. Also, we will look into one of the largest DDoS attacks on Ukrainian infrastructure that happened in February 2022. We'll see, what techniques helped to keep the web resources available for Ukrainians and how AWS improved DDoS protection for all customers based on Ukraine experience
Apps Break Data
How information systems are built or acquired puts information, which is what they should be about, in a secondary place. Our language adapted accordingly, and we no longer talk about information systems but applications. Applications evolved in a way to break data into diverse fragments, tightly coupled with applications and expensive to integrate. The result is technical debt, which is re-paid by taking even bigger "loans", resulting in an ever-increasing technical debt. Software engineering and procurement practices work in sync with market forces to maintain this trend. This talk demonstrates how natural this situation is. The question is: can something be done to reverse the trend?
Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Inconsistent user experience and siloed data, high costs, and changing customer expectations – Citizens Bank was experiencing these challenges while it was attempting to deliver a superior digital banking experience for its clients. Its core banking applications run on the mainframe and Citizens was using legacy utilities to get the critical mainframe data to feed customer-facing channels, like call centers, web, and mobile. Ultimately, this led to higher operating costs (MIPS), delayed response times, and longer time to market.
Ever-changing customer expectations demand more modern digital experiences, and the bank needed to find a solution that could provide real-time data to its customer channels with low latency and operating costs. Join this session to learn how Citizens is leveraging Precisely to replicate mainframe data to its customer channels and deliver on their “modern digital bank” experiences.
Introduction of Cybersecurity with OSS at Code Europe 2024
I develop the Ruby programming language, RubyGems, and Bundler, which are package managers for Ruby. Today, I will introduce how to enhance the security of your application using open-source software (OSS) examples from Ruby and RubyGems.
The first topic is CVE (Common Vulnerabilities and Exposures). I have published CVEs many times. But what exactly is a CVE? I'll provide a basic understanding of CVEs and explain how to detect and handle vulnerabilities in OSS.
Next, let's discuss package managers. Package managers play a critical role in the OSS ecosystem. I'll explain how to manage library dependencies in your application.
I'll share insights into how the Ruby and RubyGems core team works to keep our ecosystem safe. By the end of this talk, you'll have a better understanding of how to safeguard your code.
What is an RPA CoE? Session 1 – CoE Vision
In the first session, we will review the organization's vision and how this has an impact on the COE Structure.
Topics covered:
• The role of a steering committee
• How do the organization’s priorities determine CoE Structure?
Speaker:
Chris Bolin, Senior Intelligent Automation Architect Anika Systems
"Choosing proper type of scaling", Olena Syrota
Imagine an IoT processing system that is already quite mature and production-ready and for which client coverage is growing and scaling and performance aspects are life and death questions. The system has Redis, MongoDB, and stream processing based on ksqldb. In this talk, firstly, we will analyze scaling approaches and then select the proper ones for our system.
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
Gursev Pirge, PhD
Senior Data Scientist - JohnSnowLabs
Main news related to the CCS TSI 2023 (2023/1695)
An English 🇬🇧 translation of a presentation to the speech I gave about the main changes brought by CCS TSI 2023 at the biggest Czech conference on Communications and signalling systems on Railways, which was held in Clarion Hotel Olomouc from 7th to 9th November 2023 (konferenceszt.cz). Attended by around 500 participants and 200 on-line followers.
The original Czech 🇨🇿 version of the presentation can be found here: https://www.slideshare.net/slideshow/hlavni-novinky-souvisejici-s-ccs-tsi-2023-2023-1695/269688092 .
The videorecording (in Czech) from the presentation is available here: https://youtu.be/WzjJWm4IyPk?si=SImb06tuXGb30BEH .
Choosing The Best AWS Service For Your Website + API.pptx
Have you ever been confused by the myriad of choices offered by AWS for hosting a website or an API?
Lambda, Elastic Beanstalk, Lightsail, Amplify, S3 (and more!) can each host websites + APIs. But which one should we choose?
Which one is cheapest? Which one is fastest? Which one will scale to meet our needs?
Join me in this session as we dive into each AWS hosting service to determine which one is best for your scenario and explain why!
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Join us to learn how UiPath Apps can directly and easily interact with prebuilt connectors via Integration Service--including Salesforce, ServiceNow, Open GenAI, and more.
The best part is you can achieve this without building a custom workflow! Say goodbye to the hassle of using separate automations to call APIs. By seamlessly integrating within App Studio, you can now easily streamline your workflow, while gaining direct access to our Connector Catalog of popular applications.
We’ll discuss and demo the benefits of UiPath Apps and connectors including:
Creating a compelling user experience for any software, without the limitations of APIs.
Accelerating the app creation process, saving time and effort
Enjoying high-performance CRUD (create, read, update, delete) operations, for
seamless data management.
Speakers:
Russell Alfeche, Technology Leader, RPA at qBotic and UiPath MVP
Charlie Greenberg, host
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks creates AI-boosted business software that helps employees work more efficiently and effectively. Managing data across multiple RDBMS and NoSQL databases was already a challenge at their current scale. To prepare for 10X growth, they knew it was time to rethink their database strategy. Learn how they architected a solution that would simplify scaling while keeping costs under control.
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift
Overview
Dive into the world of anomaly detection on edge devices with our comprehensive hands-on tutorial. This SlideShare presentation will guide you through the entire process, from data collection and model training to edge deployment and real-time monitoring. Perfect for those looking to implement robust anomaly detection systems on resource-constrained IoT/edge devices.
Key Topics Covered
1. Introduction to Anomaly Detection
- Understand the fundamentals of anomaly detection and its importance in identifying unusual behavior or failures in systems.
2. Understanding Edge (IoT)
- Learn about edge computing and IoT, and how they enable real-time data processing and decision-making at the source.
3. What is ArgoCD?
- Discover ArgoCD, a declarative, GitOps continuous delivery tool for Kubernetes, and its role in deploying applications on edge devices.
4. Deployment Using ArgoCD for Edge Devices
- Step-by-step guide on deploying anomaly detection models on edge devices using ArgoCD.
5. Introduction to Apache Kafka and S3
- Explore Apache Kafka for real-time data streaming and Amazon S3 for scalable storage solutions.
6. Viewing Kafka Messages in the Data Lake
- Learn how to view and analyze Kafka messages stored in a data lake for better insights.
7. What is Prometheus?
- Get to know Prometheus, an open-source monitoring and alerting toolkit, and its application in monitoring edge devices.
8. Monitoring Application Metrics with Prometheus
- Detailed instructions on setting up Prometheus to monitor the performance and health of your anomaly detection system.
9. What is Camel K?
- Introduction to Camel K, a lightweight integration framework built on Apache Camel, designed for Kubernetes.
10. Configuring Camel K Integrations for Data Pipelines
- Learn how to configure Camel K for seamless data pipeline integrations in your anomaly detection workflow.
11. What is a Jupyter Notebook?
- Overview of Jupyter Notebooks, an open-source web application for creating and sharing documents with live code, equations, visualizations, and narrative text.
12. Jupyter Notebooks with Code Examples
- Hands-on examples and code snippets in Jupyter Notebooks to help you implement and test anomaly detection models.
Fueling AI with Great Data with Airbyte Webinar
This talk will focus on how to collect data from a variety of sources, leveraging this data for RAG and other GenAI use cases, and finally charting your course to productionalization.
Astute Business Solutions | Oracle Cloud Partner |
Your goto partner for Oracle Cloud, PeopleSoft, E-Business Suite, and Ellucian Banner. We are a firm specialized in managed services and consulting.
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...Edge AI and Vision Alliance
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/06/how-axelera-ai-uses-digital-compute-in-memory-to-deliver-fast-and-energy-efficient-computer-vision-a-presentation-from-axelera-ai/
Bram Verhoef, Head of Machine Learning at Axelera AI, presents the “How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-efficient Computer Vision” tutorial at the May 2024 Embedded Vision Summit.
As artificial intelligence inference transitions from cloud environments to edge locations, computer vision applications achieve heightened responsiveness, reliability and privacy. This migration, however, introduces the challenge of operating within the stringent confines of resource constraints typical at the edge, including small form factors, low energy budgets and diminished memory and computational capacities. Axelera AI addresses these challenges through an innovative approach of performing digital computations within memory itself. This technique facilitates the realization of high-performance, energy-efficient and cost-effective computer vision capabilities at the thin and thick edge, extending the frontier of what is achievable with current technologies.
In this presentation, Verhoef unveils his company’s pioneering chip technology and demonstrates its capacity to deliver exceptional frames-per-second performance across a range of standard computer vision networks typical of applications in security, surveillance and the industrial sector. This shows that advanced computer vision can be accessible and efficient, even at the very edge of our technological ecosystem.Â
Recently uploaded (20)
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Â
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Â
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
Â
Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Â
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
Â
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
Â
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
Â
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Â
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Â
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Â
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
Â
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
Â
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Â
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
Â
Propel to the cloud with open source
- 1. Propel to the Cloud with Open Source or “How we re-engineered a social network” by Gene Leybzon, CTO, Trusted Opinion, Inc
- 2. Trusted Opinion Social Recommendation Network 2 Propel to the cloud by Gene Leybzon
- 3. Trusted Opinion in Numbers Over Million users Over 100 Countries Over 1.5 Million Bars and Restaurants with reviews Over 100,000 emails sent daily 3 Propel to the cloud by Gene Leybzon
- 4. “Legacy” architecture 4 Propel to the cloud by Gene Leybzon
- 5. How J2EE architecture became a liability instead of an asset Business needs: Almost “on-the fly” code changes with immediate deployments (daily releases) Extreme scalability Constant tuning based on A/B testing Can not afford expensive DB licensing fee Parallelism in code development with no bottlenecks in the develop-test-release cycles 5 Propel to the cloud by Gene Leybzon
- 6. “Legacy” hosting 6 Propel to the cloud by Gene Leybzon
- 7. Scalability and Performance Problems Too much work performed in Database (store procedures did a lot of math on the data) Way too expensive to go to database cluster while a single server (even 16 core) has it’s limits too Overhead of J2EE+templates (slow performance) 7 Propel to the cloud by Gene Leybzon
- 8. Other Pain Points Managing offshore development team Significantof effort in system/database administration Too slow to implementchanges Hard to implement detail user behavior analytics Time to be multilingual and integrate with CDN to support international customers 8 Propel to the cloud by Gene Leybzon
- 9. Solution Complete re-architecture from the top-to-bottom and from the bottom-up Update to current Snapshot of the best technologies 9 Propel to the cloud by Gene Leybzon
- 10. Wish list that became the Plan Use latest and greatest technologies Open source, and open source only! Scalability on demand Local team for core software development Best analytics with customized A/B testing framework Good performance and with even better performance perception 10 Propel to the cloud by Gene Leybzon
- 11. Why Cloud? Scalability on demand Dynamic load Ease deployment/keeping configuration Simplify IT Cool factor 11 Propel to the cloud by Gene Leybzon
- 12. Why Amazon? EC2 Cloud Front MapReduce Load balancer Performance monitoring 12 Propel to the cloud by Gene Leybzon
- 13. Job Ahead #lines of Java code Migrating to the new database and with completely different database schema Add language support (20 core languages) Add on-demand image uploading to CDN and serving all static content from the CDN 13 Propel to the cloud by Gene Leybzon
- 14. Challenges Where to find right and motivated developers? Where to rent the office How to create a quality code development culture How to have fun along the way 14 Propel to the cloud by Gene Leybzon
- 15. Lessons People first Happy developers write good code In-house recruiting Focus on the core, borrow the rest 15 Propel to the cloud by Gene Leybzon
- 16. New Architecture 16 Propel to the cloud presentation by Gene Leybzon
- 17. New Database Architecture 17 Propel to the cloud by Gene Leybzon
- 18. Analyzing log data 18 Propel to the cloud by Gene Leybzon
- 19. Semantic Web and RDF Used at Trusted Opinion to store information about Movies and Restaurants Data stored across all items as “triplets” Allows structured and semi-structured data to be mixed, exposed, and shared across different applications Took a lot of load from relational DB Easy to add new item categories 19 Propel to the cloud by Gene Leybzon
- 20. You can do it too! “Just do itRight” “Right” developers (treat them with respect!) “Right” technology (keep an eye on technology trends, use it fresh but ready) “Right” design (NO new frameworks, focus on the product, not a framework) “Right” management team 20 Propel to the cloud by Gene Leybzon