Microsoft Technologies for Data Science 201612Mark Tabladillo
Delivered to SQL Saturday BI Edition -- Atlanta, GA
Microsoft provides several technologies in and around Azure which can be used for casual to serious data science. This presentation provides an overview of the major Microsoft options for both on-premise and cloud-based data science (and hybrid). These technologies have been used by the presenter in various companies and industries, both as a Microsoft consultant and previously independent consultant. As well, the speaker provides insights into data science careers, information which helps imply where the business will likely be for consultants and partners.
Modern big data and machine learning in the era of cloud, docker and kubernetesSlim Baltagi
There is a major shift in web and mobile application architecture from the ‘old-school’ one to a modern ‘micro-services’ architecture based on containers. Kubernetes has been quite successful in managing those containers and running them in distributed computing environments.
Now enabling Big Data and Machine Learning on Kubernetes will allow IT organizations to standardize on the same Kubernetes infrastructure. This will propel adoption and reduce costs.
Kubeflow is an open source framework dedicated to making it easy to use the machine learning tool of your choice and deploy your ML applications at scale on Kubernetes. Kubeflow is becoming an industry standard as well!
Both Kubernetes and Kubeflow will enable IT organizations to focus more effort on applications rather than infrastructure.
Exploring microservices in a Microsoft landscapeAlex Thissen
Presentation for Dutch Microsoft TechDays 2015 with Marcel de Vries:
During this session we will take a look at how to realize a Microservices architecture (MSA) using the latest Microsoft technologies available. We will discuss some fundamental theories behind MSA and show you how this can actually be realized with Microsoft technologies such as Azure Service Fabric. This session is a real must-see for any developer that wants to stay ahead of the curve in modern architectures.
The Future of Data Warehousing, Data Science and Machine LearningModusOptimum
Watch the on-demand recording here:
https://event.on24.com/wcc/r/1632072/803744C924E8BFD688BD117C6B4B949B
Evolution of Big Data and the Role of Analytics | Hybrid Data Management
IBM, Driving the future Hybrid Data Warehouse with IBM Integrated Analytics System.
Microsoft Technologies for Data Science 201612Mark Tabladillo
Delivered to SQL Saturday BI Edition -- Atlanta, GA
Microsoft provides several technologies in and around Azure which can be used for casual to serious data science. This presentation provides an overview of the major Microsoft options for both on-premise and cloud-based data science (and hybrid). These technologies have been used by the presenter in various companies and industries, both as a Microsoft consultant and previously independent consultant. As well, the speaker provides insights into data science careers, information which helps imply where the business will likely be for consultants and partners.
Modern big data and machine learning in the era of cloud, docker and kubernetesSlim Baltagi
There is a major shift in web and mobile application architecture from the ‘old-school’ one to a modern ‘micro-services’ architecture based on containers. Kubernetes has been quite successful in managing those containers and running them in distributed computing environments.
Now enabling Big Data and Machine Learning on Kubernetes will allow IT organizations to standardize on the same Kubernetes infrastructure. This will propel adoption and reduce costs.
Kubeflow is an open source framework dedicated to making it easy to use the machine learning tool of your choice and deploy your ML applications at scale on Kubernetes. Kubeflow is becoming an industry standard as well!
Both Kubernetes and Kubeflow will enable IT organizations to focus more effort on applications rather than infrastructure.
Exploring microservices in a Microsoft landscapeAlex Thissen
Presentation for Dutch Microsoft TechDays 2015 with Marcel de Vries:
During this session we will take a look at how to realize a Microservices architecture (MSA) using the latest Microsoft technologies available. We will discuss some fundamental theories behind MSA and show you how this can actually be realized with Microsoft technologies such as Azure Service Fabric. This session is a real must-see for any developer that wants to stay ahead of the curve in modern architectures.
The Future of Data Warehousing, Data Science and Machine LearningModusOptimum
Watch the on-demand recording here:
https://event.on24.com/wcc/r/1632072/803744C924E8BFD688BD117C6B4B949B
Evolution of Big Data and the Role of Analytics | Hybrid Data Management
IBM, Driving the future Hybrid Data Warehouse with IBM Integrated Analytics System.
GeoWave: Open Source Geospatial/Temporal/N-dimensional Indexing for Accumulo,...DataWorks Summit
GeoWave is an open-source library that connects geospatial software with distributed computing frameworks. GeoWave leverages the scalability of a distributed key-value store for effective storage, retrieval, and analysis of massive geospatial datasets. It uses a space filling curve to preserve locality between multi-dimensional objects and the single dimensional sort order imposed by key-value stores. What this means to a user is that distributed spatial and spatial-temporal retrieval and analysis can be effectively accomplished at a massive scale.
At its core, GeoWave solves the problem of multi-dimensional indexing, and particularly extends this capability to spatial/temporal use cases. GeoWave supports raster, vector, and point cloud data, and provides common spatial algorithms that can be extended to create deep analytic capabilities. It also performs fast subsampling via distributed rendering that integrates with GeoServer, so that a user can interactively visualize data at map scale regardless of density.
Our goal in presenting GeoWave to the Hadoop Summit is to introduce it to the big data community. We will present GeoWave at a moderate level of detail, to include a short demonstration, and hopefully answer any questions regarding maturity, suitability and implementation details.
Liberate Your Files with a Private Cloud Storage Solution powered by Open SourceIsaac Christoffersen
Many of today's enterprises are working under a false assumption that there is a trade-off between consumer-centric file sharing and corporate IT policy compliance. This is because most market-leading SaaS solutions for file sync and share are not designed around enterprise IT's needs. They represent growing risks with vendor lock-in, data security, compliance and data ownership.
With a track record in delivering innovative Open Source solutions, Vizuri has an answer to help enterprises overcome these hurdles. By leveraging innovative Red Hat and ownCloud open source solutions, this solution help corporate IT provide a simple to use file sync and share solution for employees. As a result, organizations are able to retain a greater control over valuable intellectual property.
Accelerating Business Intelligence Solutions with Microsoft Azure passJason Strate
Business Intelligence (BI) solutions need to move at the speed of business. Unfortunately, roadblocks related to availability of resources and deployment often present an issue. What if you could accelerate the deployment of an entire BI infrastructure to just a couple hours and start loading data into it by the end of the day. In this session, we'll demonstrate how to leverage Microsoft tools and the Azure cloud environment to build out a BI solution and begin providing analytics to your team with tools such as Power BI. By end of the session, you'll gain an understanding of the capabilities of Azure and how you can start building an end to end BI proof-of-concept today.
Continus sql with sql stream builder
Eventador Cloudera
Flink SQL Kafka Apache NiFi SMM Schema Registry
Avro Json Apache Calcite. Meetup Future of Data New York
Kenny Gorman Tim Spann John Kuchmek
This presentation describes how hortonworks is delivering Hadoop on Docker for a cloud-agnostic deployment approach which presented in Cisco Live 2015.
This presentation on Open Source and Cloud Technologies was given by Vizuri SVP Joe Dickman at the 2012 Destination Marketing Technology Forum in Raleigh, NC. For more information please visit our website at www.vizuri.com or email solutions@vizuri.com.
Better performance and cost effectiveness empower better results in the cognitive era. For more information, visit: http://www.ibm.com/systems/power/hardware/linux-lc.html
An Introduction to Apache Ignite - Mandhir Gidda - Codemotion Rome 2017Codemotion
Apache Ignite is a high-performance, integrated and distributed in-memory platform for computing and transacting on large-scale data sets in real-time, orders of magnitude faster than possible with traditional disk-based or flash technologies.
GeoWave: Open Source Geospatial/Temporal/N-dimensional Indexing for Accumulo,...DataWorks Summit
GeoWave is an open-source library that connects geospatial software with distributed computing frameworks. GeoWave leverages the scalability of a distributed key-value store for effective storage, retrieval, and analysis of massive geospatial datasets. It uses a space filling curve to preserve locality between multi-dimensional objects and the single dimensional sort order imposed by key-value stores. What this means to a user is that distributed spatial and spatial-temporal retrieval and analysis can be effectively accomplished at a massive scale.
At its core, GeoWave solves the problem of multi-dimensional indexing, and particularly extends this capability to spatial/temporal use cases. GeoWave supports raster, vector, and point cloud data, and provides common spatial algorithms that can be extended to create deep analytic capabilities. It also performs fast subsampling via distributed rendering that integrates with GeoServer, so that a user can interactively visualize data at map scale regardless of density.
Our goal in presenting GeoWave to the Hadoop Summit is to introduce it to the big data community. We will present GeoWave at a moderate level of detail, to include a short demonstration, and hopefully answer any questions regarding maturity, suitability and implementation details.
Liberate Your Files with a Private Cloud Storage Solution powered by Open SourceIsaac Christoffersen
Many of today's enterprises are working under a false assumption that there is a trade-off between consumer-centric file sharing and corporate IT policy compliance. This is because most market-leading SaaS solutions for file sync and share are not designed around enterprise IT's needs. They represent growing risks with vendor lock-in, data security, compliance and data ownership.
With a track record in delivering innovative Open Source solutions, Vizuri has an answer to help enterprises overcome these hurdles. By leveraging innovative Red Hat and ownCloud open source solutions, this solution help corporate IT provide a simple to use file sync and share solution for employees. As a result, organizations are able to retain a greater control over valuable intellectual property.
Accelerating Business Intelligence Solutions with Microsoft Azure passJason Strate
Business Intelligence (BI) solutions need to move at the speed of business. Unfortunately, roadblocks related to availability of resources and deployment often present an issue. What if you could accelerate the deployment of an entire BI infrastructure to just a couple hours and start loading data into it by the end of the day. In this session, we'll demonstrate how to leverage Microsoft tools and the Azure cloud environment to build out a BI solution and begin providing analytics to your team with tools such as Power BI. By end of the session, you'll gain an understanding of the capabilities of Azure and how you can start building an end to end BI proof-of-concept today.
Continus sql with sql stream builder
Eventador Cloudera
Flink SQL Kafka Apache NiFi SMM Schema Registry
Avro Json Apache Calcite. Meetup Future of Data New York
Kenny Gorman Tim Spann John Kuchmek
This presentation describes how hortonworks is delivering Hadoop on Docker for a cloud-agnostic deployment approach which presented in Cisco Live 2015.
This presentation on Open Source and Cloud Technologies was given by Vizuri SVP Joe Dickman at the 2012 Destination Marketing Technology Forum in Raleigh, NC. For more information please visit our website at www.vizuri.com or email solutions@vizuri.com.
Better performance and cost effectiveness empower better results in the cognitive era. For more information, visit: http://www.ibm.com/systems/power/hardware/linux-lc.html
An Introduction to Apache Ignite - Mandhir Gidda - Codemotion Rome 2017Codemotion
Apache Ignite is a high-performance, integrated and distributed in-memory platform for computing and transacting on large-scale data sets in real-time, orders of magnitude faster than possible with traditional disk-based or flash technologies.
OpenShift is Red Hat's Platform-as-a-Service (PaaS) that lets developers quickly develop, host, and scale Docker container-based applications. OpenShift enables a uniform and standardised approach to container management across all hosting options including AWS/EC2 and other private/public cloud and on/off-premise variants. At this session, you will learn how Red Hat's enterprise clients are using OpenShift to enable their digital transformation initiatives. Examples will cover how realising a hybrid cloud strategy can simplify and reduce the risk of migrating and transitioning application workloads to containers in the cloud.
Alex Smith, Solutions Architect, Amazon Web Services, ASEAN
Stephen Bylo, Senior Solution Architect, Red Hat Asia Pacific Pte Ltd
Red Hat multi-cluster management & what's new in OpenShiftKangaroot
More and more organisations are not only using container platforms but starting to run multiple clusters of containers. And with that comes new headaches of maintaining, securing, and updating those multiple clusters. In this session we'll look into how Red Hat has solved multi-cluster management, covering cluster lifecycle, app lifecycle, and governance/risk/compliance.
In occasione del Containers & Cloud-Native Roadshow 2019 il Cloud Engineer Domenico Pastore ha fornito una panoramica sui concetti chiave, sui benefici e sulle opportunità offerte dall’adozione dei container Linux e di tecnologie open source come Red Hat OpenShift e Gluster.
I punti trattati durante la presentazione sono:
- I container Linux
- Differenze tra virtual machine e container
- Architettura di Red Hat OpenShift
- Container native storage
Per saperne di più, scaricate le slide e guardate il video della presentazione su https://www.par-tec.it/containers-landscape-review
KubeCon CloudNativeCon Seattle 2019 Recap - General overview and also summary of some of the application deployment track (App sig, Operator Framework, Helm, Kustomize, CNAB).
Radisys' CTO, Andrew Alleman, was one of the featured speakers at the OCP Telco Engineering Workshop during the 2017 Big Communications Event. Andrew discussed carrier-grade open rack architecture (CG-OpenRack-19), the future of open hardware standards and commercial products in the OCP pipeline during his presentation.
OSDC 2018 | Three years running containers with Kubernetes in Production by T...NETWAYS
The talk gives a state of the art update of experiences with deploying applications in Kubernetes on scale. If in clouds or on premises, Kubernetes took over the leading role as a container operating system. The central paradigm of stateless containers connected to storage and services is the core of Kubernetes. However, it can be extended to distributed databases, Machine Learning, Windows VMs in Kubernetes. All these applications have been considered as edge cases a few years ago, however, are going more and more mainstream today.
The presentation will provide a brief overview of Tungsten Fabric, and the new features in the recent 5.0 release. A demo of Tungsten Fabric will follow, with an overview of core functionality, and newly released features.
Speaker: Nick Davey, Cloud - SDN Product Manager
Kubernetes is awesome! But what does it takes for a Java developer to design, implement and run Cloud Native applications? In this session, we will look at Kubernetes from a user point of view and demonstrate how to consume it effectively. We will discover which concerns Kubernetes addresses and how it helps to develop highly scalable and resilient Java applications.
FOSDEM TALK: https://fosdem.org/2017/schedule/event/cnjavadev/
Similar to Openshift 3.10 & Container solutions for Blockchain, IoT and Data Science (20)
Enabling Enterprise-wide OT Data access with Matrikon Data Broker.pdfJohn Archer
Highlights on new partnership between Red Hat and Matrikon for supporting OPC-UA on Red Hat edge infrastructure including bare metal, VMs and containers deployments for Matrikon Data Broker
Extending open source and hybrid cloud to drive OT transformation - Future Oi...John Archer
A look at ESG concerns and agility needed to address pressures to transform energy organizations with decarbonization. Presented to Future Oil and Gas conference November 2021
Leveraging IoT as part of your digital transformationJohn Archer
Review of approaches for Edge computing architecture with emphasis on improved security for container workloads collecting telemetry from Industrial IoT environments
Delivering Agile Data Science on Openshift - Red Hat Summit 2019John Archer
Audrey Reznik, Data Scientist from ExxonMobil and John Archer, Red Hat Solution Architect present on how to use Openshift to enable and create value to data science teams and improve their agility and improve collaboration for larger organizations.
Single View of Well, Production and AssetsJohn Archer
SINGLE VIEW OF WELL, PRODUCTION AND ASSETS
Deliver a complete view of G&G, Well Header, Volumes, transactional data
Reduce Data Movement
Reduce Load on Data sources with intelligent caching
Aggregated single view of complex and legacy data sources
Field development and operational optimization for unconventionalsJohn Archer
How to address high operational demands for drilling and fracking wells.
How can improved planning address inefficiencies in unconventional fields.
Agile end-to-end service value chains are needed from Edge Computing scenarios to newly formed Data Science teams.
Making the Data Science teams efforts operational is an industry challenge.
Real-time operations of all assets are needed for improved margins in the industry.
Improve margins in shale oil fields with sand frac logistics improvements.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Let's dive deeper into the world of ODC! Ricardo Alves (OutSystems) will join us to tell all about the new Data Fabric. After that, Sezen de Bruijn (OutSystems) will get into the details on how to best design a sturdy architecture within ODC.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
"Impact of front-end architecture on development cost", Viktor TurskyiFwdays
I have heard many times that architecture is not important for the front-end. Also, many times I have seen how developers implement features on the front-end just following the standard rules for a framework and think that this is enough to successfully launch the project, and then the project fails. How to prevent this and what approach to choose? I have launched dozens of complex projects and during the talk we will analyze which approaches have worked for me and which have not.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Openshift 3.10 & Container solutions for Blockchain, IoT and Data Science
1. John Archer
Senior Openshift Solution Architect
joarcher@redhat.com
What’s New in Red Hat
OpenShift Container Platform 3.10
&
Emerging Container Solutions:
Blockchain, IoT, Data Science
2. Aug 2nd - RHUG Agenda
● Get a Beer - Try the Ranga - Excellent Red!
● Who’s new
● Looking for a gig?
● Meet the F5 and Red Hat Teams
● Automating F5 BIG-IP with Ansible
● Why yes I’ll have a beer - maybe the Box Kick IPA
● Openshift 3.10 - Update Highlights
○ Blockchain
○ IoT
○ Data Science
● Questions
3. ● 700+ attendees (100% YoY growth)
● 385+ OpenShift Commons Members (40%
YoY growth)
● BP Joined
● 21+ OpenShift Customer presentations and
Panel discussions:
● Amadeus, Barclays, Bank of Montreal
● Daimler, Paychex, Cisco
● Florida Blue, UPS, DHL
● Banking on OpenShift Panel
● What’s Next Panel
● Roadmap AMA Panel
OPENSHIFT COMMONS 2018 AT-A-GLANCE
OpenShift Commons Gathering (Videos) - https://www.youtube.com/playlist?list=PLaR6Rq6Z4IqcTSloODnFwdIn2XjNa72JJ
Join OpenShift Commons here - https://commons.openshift.org#join
4. OPENSHIFT + CoreOS UNIFIED PLATFORM
Developer Productivity
Build Automation, Image
Streams, CI/CD
Kubernetes
Red Hat Enterprise Linux or Red Hat CoreOS
Automated
Operations
Hybrid Cloud
App
Monitoring
Infra
Monitoring
Service Cat/Operators
etcd, Prometheus, Red
Hat Middleware, ISVs
Cluster Services
Metering/Chargeback,
Metrics, Logging, Registry
CaaS PaaSBest Operator Experience Best Developer Experience
Operator Lifecycle Manager
Ops & Dev Consoles
Install / Upgrade
Security / Auth
Network / CNI
Storage / CSI
5. ENHANCING OPENSHIFT WITH COREOS TECTONIC
& QUAY CONTAINER REGISTRY
CoreOS Tectonic
● Fully integrated and merged with OpenShift
● Adds automated operations and day 2 management
(install, upgrades, monitoring, metering and chargeback)
● Best-in-class support for CaaS/KaaS/PaaS use cases
CoreOS Container Linux
● Red Hat CoreOS inspired by Container Linux &
RHEL/Atomic
● Fully immutable, container optimized, automatically
updated Linux host foundation for OpenShift
CoreOS Quay Registry
● Enterprise container registry; self managed & as-a-service
● Premium offering usable standalone or with OpenShift
● Geo-replication, vulnerability scanning, build automation
ETCD PROMETHEUS
METERING &
CHARGEBACK
RED HAT QUAY REGISTRY
RED HAT COREOS
PLATFORM OPERATOR - AUTOMATED OPS
APPLICATION OPERATORS - SELF-DRIVING APPS
6. 6
- Minimal Linux distribution
- Optimized for running containers
- Decreased attack surface
- Over-the-air automated updates
- Ignition-based Metal and Cloud
host configuration
- Deployment option for OpenShift
DELIVERING IMMUTABLE INFRASTRUCTURE
WITH RED HAT CoreOS
Red Hat Summit Video
Red Hat CoreOS FAQ
7. 7
INTRODUCING THE OPERATOR FRAMEWORK
● Kubernetes-native Day1 and Day2
deployment and operations of Apps
● Simplify Kubernetes upgrades
● Deploy Apps as “Self-Driving”
● Consistent App Deploy/Ops on
Kubernetes on Any Cloud
● Fully Open Source
Operator Framework Deep Dive - OpenShift Commons Briefing - https://youtu.be/oLAfCKM7RbA
8. 8
AUTOMATING DAY 2 OPERATIONS
OF CONTAINER APPLICATIONS
CONTAINER OPERATORS
Encapsulate and automate operational
knowledge and actions with application
services.
OPERATOR FRAMEWORK
An open source toolkit to manage
application instances on Kubernetes in an
effective, automated and scalable way.
https://github.com/operator-framework
Operator SDK
Operator
Lifecycle
Management
Operator
Metering
9. 9
● ISTIO available on OpenShift Container Platform
● RHOAR Launcher will provision ISTIO code samples
○ Spring Boot, WildFly Swarm @Summit; Node.js, Eclipse Vert.x to follow
● Simplifies microservices development for enterprise developers
○ Infrastructure services embedded into container platform
○ More focus on business logic, less infrastructure code
○ Improved security, robustness, and observability with little to no coding
RELEASING AS DEVELOPER PREVIEW AT SUMMIT - GA EOY or early next year
INTRODUCING SERVICE MESH:
ISTIO in OpenShift
10. 10
INTRODUCING SERVERLESS:
OPENSHIFT CLOUD FUNCTIONS
● Industry’s first enterprise grade, Hybrid Serverless offering
● Runs on OpenShift - based on Apache OpenWhisk
● Mature, battle-tested technology - IBM and Adobe already running OpenWhisk at
scale
● Initial RHOAR supported runtimes:
○ Java, Python and Node.js
● Event Sources:
○ In-memory Data Grid, Storage (Gluster), Messaging (AMQ), HTTP, GitHub, etc.
● Dev tool support with Che / OpenShift.io
RELEASING AS DEVELOPER PREVIEW AT SUMMIT - WATCH THE VIDEO
11. 11
INTRODUCING
CONTAINER-NATIVE VIRTUALIZATION
Technology enabling OpenShift Container Platform as a unified platform for building,
modifying, and deploying applications residing in both containers and virtual machines in a
common, shared environment.
Use Kubernetes to orchestrate both application containers and VM containers on the same
container platform (OpenShift). CNV is based on RHEL (KVM) virtualization capabilities.
Keynote Demo: https://youtu.be/r8e4bT0-zhU?t=45m30s
Based on the KubeVirt project: http://www.kubevirt.io/
12. Feature: Podman is now available as a
technology preview.
Description: A daemon-less CLI/API for
running, managing, and debugging OCI
containers and pods
● Fast and lightweight
● Leverages runC
● Provides a “docker-like” syntax for
working with containers
● Remote management API via Varlink
● Provides systemd integration and
advanced namespace isolation
Podman Tech Preview
kernel
13. RED HAT SUMMIT 2018 - RESOURCES
Red Hat Summit Videos: Keynotes and Breakouts
Red Hat Summit Keynote Demos: Container-Native Virt, OpenShift on Azure, Serverless (OpenWhisk),
OpenShift Commons Gathering: All Videos
Must See Videos
● RHEL and Red Hat CoreOS (Roadmap) - https://www.youtube.com/watch?v=LJOm4JbF4eQ
● OpenShift Roadmap - https://www.youtube.com/watch?v=1AelNjx6BB4
● Kubernetes & the future platform - https://www.youtube.com/watch?v=YAFKlOB8vBw
● OpenShift & Service Mesh (Istio) - https://www.youtube.com/watch?v=iGLPk-Rm62E
● OpenShift & Serverless (OpenWhisk) - https://www.youtube.com/watch?v=C2u6wVRI-N0
● OpenShift for Operations - https://www.youtube.com/watch?v=nBXALsqs1RA
● Building Production-ready Containers - https://www.youtube.com/watch?v=nizud-1IK9c
● OpenShift & Tensorflow (Machine Learning) - https://www.youtube.com/watch?v=YJzp4iOqLEo
● Red Hat’s AI Strategy - https://www.youtube.com/watch?v=1hUA31uzUzg
14. OCP 3.10 - The Efficient Cluster
● Resource Management
● Descheduler (tech preview), CPU Manager, Ephemeral Storage,
HugePages
● Resilience
● Node Problem Detector, HA egress pods with DNS
● Workload Diversity
● Device Manager, Windows Containers (dev preview)
● Installation Automation
● TLS node bootstrapping, static pods
● Security
● Etcd cipher coverage, Shared PID namespace options, more secured
router
18. 18
● HyperLedger Fabric
● JPMC Quorum
● Ripple
● R3 Corda
● Lightning Network
● BlockApps Strato
● Red Hat Middleware
○ Fuse - Ethereum SDK adapter
○ Process Activity Management (PAM) - BPM Activity
○ Openshift Runtime - Vert.X
RHT Activity in the Blockchain Marketplace
19. 19
BLOCKCHAIN HELPFUL CONCEPTS
“ISN’T IT JUST A DATABASE?”
One can follow the following conceptual path:
1. Centralized database
2. Replicated database
3. Distributed database
(Up to now, all under the control of one entity.)
4. Distributed ledger / blockchains
(Under the control of multiple entities)
https://medium.com/@sbmeunier/blockchain-technology-a-very-special-kind-of-distributed-database-e63d00781118
20. 20
● A node application: code that runs on the nodes
● A client-facing application: GUI, CLI, RPC
● A peer-to-peer networking system: to connect the nodes into one network
● A data structure: to organise the data on the ledger/chain
● A messaging (gossiping) system: to send the updates to the network
● A storage system: to store transactions and/or blocks on the nodes
● A consensus system: to choose the node in the network in charge of creating the next block
● A virtual machine: to execute “smart” “contracts”
● A way to define the blockchain’s governance (built-in? external?)
WHAT’S IN A BLOCKCHAIN
Necessary bits
21. INSERT DESIGNATOR, IF NEEDED
THE ENTERPRISE IT STACK IN 2025?
21
HYBRID CLOUD
DATABASES
MIDDLEWARE
APPLICATIONS
SMART CONTRACTS
DISTRIBUTED LEDGER(S)
AI/ML
IT OPERATIONS
IDENTITY
ACCOUNTING
BLOCKCHAINS AND DLTs AS A DEFAULT COMPONENT
22. BlockApps – Confidential
Enterprise Blockchain Platform Key Differentiators
Data Containers
& Storage
(esp. cloud)
Blockchain
Application
Platform
Enterprise
Applications
Use Case /
Verticals
STRATO Blockchain Platform
Enterprise Resource
Planning (ERP)
Supply Chain
Management
Workflow
Management
Enterprise
Performance
Management
Banking Logistics Energy Government
Financial Services Transportation Insurance Agriculture
STRATO
VM
STRATO
Sync
STRATO
DB
STRATO
Transaction
API
STRATO
Query API
STRATO Key
and Smart
Contract API
REST API approach simplifies
enterprise application development
and hides complexity from
developers
Cloud agnostic for enterprise
flexibility, enabling our clients to
remain with their favorite cloud
provider
Enterprise-friendly licensing geared
to allow worry free use and
extensibility needed for enterprises
1
2
3
BlockApps Stack - STRATO
22
Red Hat OpenShift Container Platform
24. The cost of
Non-Productive Time pe
asset during drill to
completion is $500K -
$1M per day, and post
completion is
$40K-$300K per day on
average
Prioritizing Upstream Use Cases
25. Addressing End-to-End Enterprise IoT needs
Data Management & Analytics
● Enterprise Data Mgmt.
● Persistent Data Storage
● Big Data Processing & Analytics
● Real-Time Analytics
● Machine Learning
● Data Security & Compliance
Operational Technology (OT)
● Device Management
● Industrial protocols
● OT Middleware
● Intelligent gateways
● MQTT co-inventors
● OT security
Information Technology (IT)
● Messaging & Integration
● Business Rules & CEP
● Open Hybrid
Platform-as-a-Service
● Enterprise Linux Platform
● IT security
Enterprise IoT open source community
Operational Technology (OT) Information Technology (IT)
26. 26
Red Hat and Open Source for IoT
Our open source solutions
• Free you from proprietary lock-in and cost
escalation
• Capture community innovation
• Provide the enterprise-level security,
reliability, scalability and support required by
the IoT
• Bring the internet of things to life quickly,
cost-effectively, and with lower risk.
27. An End-to-End Open Source Architecture for IoT
• Application lifecycle
management
• Integration services
• Self-service provisioning
• Hybrid cloud portability via
containers
Sensors,
Actuators,
Data Sources
Edge Processing
& Analytics
Data Integration, Routing,
Device Command/Control
Telemetry
Data
Telemetry
Data
Application
Data
Advanced Analytics
& Machine Learning
Application Development,
Deployment, Integration
• Device management,
security, and access control
• Data aggregation
• Event processing
• Integration services
• Device connectivity
• Data transformation
• Intelligent routing
• Business logic
• Edge analytics & real-time
decisions
• Data ingest
• Stream / batch processing
• Persistent data storage
• Machine learning and
real-time analytics
CDH
IoT
GATEWAYS
IoT
INTEGRATION HUB
CONNECTED
“THINGS”
ENTERPRISE
APPLICATIONS
28. Wells
Remote Monitoring and Alerting
Dashboard
“Things” IoT Gateways
Refineries
Pipelines
Assets
OneStream Data Science
Asset Predictive Maintenance
Production Optimization
Safety Assurance
Reliability Monitoring
On Premise and/or Public Cloud
Human Aided AI
Storage
MQTT
Partners
Multiple
Protocols
EdgeML
30. ● Real time bead size analysis
● Maximize production line utilization
● EdgeML with precision imagery
● Correlate environmental factors
○ Ambient and material humidity
○ Ambient and material temperature
○ Manufacturing settings
Polyethylene Bead Manufacturing
31. Artificial Lift ESP (Electrical Submersible Pumps)
● Motor Temperature
● Vibration
● Voltage
● Frequency
● Intake and Discharge pressures
● Downhole Pressure
● Monitor Flow Rates
● Cavitation
● % of Water, Oil, Sand, Mud
Predictive Maintenance and Monitoring
32. ● GeoSteering/Borehole Planned/Actual
● HSE Gas Detection
● Unconventional Field Planning
○ Asset Management
○ Long Term Planning
○ NPT Solver
Unconventional Field Optimization Use Cases
33. Business Optimizer33
Business Value
-15% Driving Time (Fuel and Driver savings)
-3% Reduction in Non Productive Time
Determine optimal sand density lbs/ft
Rules:
Direct to pad when needed
Storage availability 40/70/100
Redirect due to well site issue, weather or traffic
Increase sand while production volumes increase
Sand Delivery and Proppant Optimization
Execute deliveries and changes with more efficiency and NPV maximized
42. Benefits of using OpenShift for Jupyter
● More accessible to developers and non technical users
● Easier to create custom solutions for deploying Jupyter
● Can use JupyterHub for collaborators or education
● Run workloads other than just Jupyter notebooks
● Users controlled through quotas and limits on resources
● Share infrastructure with other users in your organization
● Open Source platform, with option for support from Red Hat
43. Data Science/ML/AI Resources
● GitHub - Openshift Notebooks
○ Jupyter Notebook on OCP https://github.com/jupyter-on-openshift
○ JupyterHub and JupyterLab on OCP
https://github.com/jupyter-on-openshift/jupyterhub-quickstart
○ Jupyter on Openshift https://www.jupyteronopenshift.org
● Articles - Jupyter-related on OpenShift
○ https://blog.openshift.com/tag/jupyter/
● Briefings - Machine Learning-related on OpenShift
○ https://blog.openshift.com/tag/machine-learning/
● Check out Red Hat’s Radanalytics.io Developers Portal
○ Empowering intelligent application development on the OpenShift platform
○ https://radanalytics.io/
● Join the OpenShift Commons Machine Learning Special Interest Group!
○ http://commons.openshift.org/sig/OpenshiftMachineLearning.html