This document summarizes a presentation by two engineers from DENSO Corporation about their development of a Kubernetes-based connected vehicle platform prototype called Misaki. They introduce Misaki's orchestrator for deploying and managing applications across edge and cloud, as well as its service mesh for handling network issues. While Misaki addresses many challenges of developing vehicle applications, the engineers note there is still work needed to support additional protocols, improve flexibility, and minimize resource usage on edge devices. They invite the audience to follow their continued work on Misaki.
Kubernetes based connected vehicle platform #k8sjp_t1 #k8sjp Kenta Suzuki
KubeFest Tokyo 2020
https://k8sjp.github.io/kubefest-2020/
https://www.youtube.com/watch?v=2x7jQTBUT5w&feature=youtu.be&list=PLm3Ufa7bsgpyN_UGH7TnOfg-XynZHRlqL&fbclid=IwAR2dkSFwBKkGr97-2IqKyjZ3i7yQdD1CoQvh6s1zbbI7fr-V86seqwaQMzI
Kubernetes based connected vehicle platform #k8sjp_t1 #k8sjp Kenta Suzuki
KubeFest Tokyo 2020
https://k8sjp.github.io/kubefest-2020/
https://www.youtube.com/watch?v=2x7jQTBUT5w&feature=youtu.be&list=PLm3Ufa7bsgpyN_UGH7TnOfg-XynZHRlqL&fbclid=IwAR2dkSFwBKkGr97-2IqKyjZ3i7yQdD1CoQvh6s1zbbI7fr-V86seqwaQMzI
talked by CI/CD Conference 2021 by CloudNative Days https://event.cloudnativedays.jp/cicd2021
re-upload: https://speakerdeck.com/whywaita/cyberagent-oss-cicd-myshoes-cicd2021
talked by CI/CD Conference 2021 by CloudNative Days https://event.cloudnativedays.jp/cicd2021
re-upload: https://speakerdeck.com/whywaita/cyberagent-oss-cicd-myshoes-cicd2021
A completely subjective look at the direction the role of the architect might take in years to come, as we endeavour to keep up with the ever accelerating pace of change.
1. What does Predix bring to the table?
2. How is it different to Cloud Foundry and IBM Bluemix?
3. Predix service catalog. Which services can set Predix apart?
4. Top use cases and apps
5. Likely scenarios of Predix evolution
What is IoT and how Modulus and Pacific can Help - Featuring Node.js and Roll...Eduardo Pelegri-Llopart
Presentation at Progress Exchange 2014.
The Internet of Things is everywhere, from the connected home to the connected car, from smart watches to smart glasses, from beacons to smart thermostats. In this session we will provide an updated view of the IOT space and we will show you how Pacific technology like Node.js and Rollbase can be used to build IOT applications.
The presentation included a demo showing how Node.js and MongoDB can be used to process a GPS feed (from vehicles like snow plows), using MongoDB to store the data. The data is then presented to Rollbase as an external source where it can be combined with other sources in model-driven productivity applications. The content is also exposed via REST through a SPA using AngularJS and through an Apache Cordova (Phonegap)-based mobile app.
apidays Paris 2022 - Blurred Lines, Denis Jannot, Solo.ioapidays
apidays Paris 2022 - APIs the next 10 years: Software, Society, Sovereignty, Sustainability
December 14, 15 & 16, 2022
Blurred Lines - When North/South meets East/West
Denis Jannot, Director of Field Engineering at EMEA, Solo.io
------
Check out our conferences at https://www.apidays.global/
Do you want to sponsor or talk at one of our conferences?
https://apidays.typeform.com/to/ILJeAaV8
Learn more on APIscene, the global media made by the community for the community:
https://www.apiscene.io
Explore the API ecosystem with the API Landscape:
https://apilandscape.apiscene.io/
Deep dive into the API industry with our reports:
https://www.apidays.global/industry-reports/
Subscribe to our global newsletter:
https://apidays.typeform.com/to/i1MPEW
I've been working on IOvent.com platform since 2012. If you are interested on any of our ideas or you think our platform can help your business, just let us know.
We are young but quite knowledgeable on IoT technologies and business models and we are eager to share, learn and put everything on practice !!
RAILWAY SAFETY PROTECTION WITH ANDROID MOBILE APPLICATION FOR 5G NEW RADIO NE...ijcsit
In every night of non-traffic hours, different jobs are conducting maintenance works in “Railway” trackside area. This project will explain a specific section of track under the sole control an Engineer’s Person-in-Charge as procedures. And how to provide protection methods by which a person or persons
on or near a track are safeguarded from potential train movements or a train is safeguarded from other train movements or obstructions, or persons or equipment are safeguarded from traction power.Consolidated past several investigation reports and according to related is rules, workflow or procedures etc. to summarize. There are protection tools left on trackside area incident caused by the workers are forgetting and poor management. Proposed are different project themes in the light of their expertise, experience and observation in their daily works. The proposed themes are compared, assessed
and prioritized under the criteria - “Manageable”, “Measurable”, “Result of Benefit”, “Standardization” and “Priority” in the Decision Matrix. Establish some solve problem methods for
comparing to find out which that lower-cost plan accordingly. I came up with a conclusion and the ideas as develop a mobile application and create a unique QR code label with equipment naming to facilitate each worker management of protection tools. This is also fulfilled in popular terms of Creativity and
Innovations. Used the MIT App Inventor (Massachusetts Institute of technology) an intuitive and visual programming preform for mobile application are development. Stage 1: program for individual mobile user application. Stage 2: build-up Network centralized storage with supervising console operation.
Stage 3: testing system under with 5G network compatibility, bandwidth and network speed is applicable people will be able to use more of the network dedicated to each mobile phone.Finally, successful to apply trial works a fruitful outcome after implementation of the project solution. There was no missing of protection tools on trackside area within the trial period. With the safety-first culture boosted by us, I believe we can achieve a common goal: Everyone Going Home Safe and Well Every day.
In every night of non-traffic hours, different jobs are conducting maintenance works in “Railway” trackside area. This project will explain a specific section of track under the sole control an Engineer’s Person-in-Charge as procedures. And how to provide protection methods by which a person or persons on or near a track are safeguarded from potential train movements or a train is safeguarded from other train movements or obstructions, or persons or equipment are safeguarded from traction power.Consolidated past several investigation reports and according to related is rules, workflow or procedures etc. to summarize. There are protection tools left on trackside area incident caused by the workers are forgetting and poor management. Proposed are different project themes in the light of their expertise, experience and observation in their daily works. The proposed themes are compared, assessed and prioritized under the criteria - “Manageable”, “Measurable”, “Result of Benefit”, “Standardization” and “Priority” in the Decision Matrix. Establish some solve problem methods for comparing to find out which that lower-cost plan accordingly. I came up with a conclusion and the ideas as develop a mobile application and create a unique QR code label with equipment naming to facilitate each worker management of protection tools. This is also fulfilled in popular terms of Creativity and Innovations. Used the MIT App Inventor (Massachusetts Institute of technology) an intuitive and visual programming preform for mobile application are development. Stage 1: program for individual mobile user application. Stage 2: build-up Network centralized storage with supervising console operation. Stage 3: testing system under with 5G network compatibility, bandwidth and network speed is applicable people will be able to use more of the network dedicated to each mobile phone.Finally, successful to apply trial works a fruitful outcome after implementation of the project solution. There was no missing of protection tools on trackside area within the trial period. With the safety-first culture boosted by us, I believe we can achieve a common goal: Everyone Going Home Safe and Well Every day.
The Entando Platform, an open source Application Composition Platform (ACP), is transforming cloud-native application development. With a component-based approach, organizations harness the power of Entando to effortlessly create and consume reusable components, fostering collaboration and driving productivity.
At the heart of this transformation lies the Entando Marketplace. Entando Marketplace and the Entando Platform provides FOOS communities with a platform to collaborate, showcase their projects, access resources, and streamline development processes.
We delve into the principles and benefits of composable practices, which enable developers to build modular, scalable, and adaptable applications.
Furthermore, we highlight the essential role of the Entando Marketplace as a catalyst for the capability economy. FOSS contributors are empowered to share their expertise and contribute to the growing collection of reusable components, unlocking new possibilities for innovation and collaboration.
Join us to discover how the Entando Community fosters collaboration and embraces composable practices, paving the way for a vibrant FOSS ecosystem. Together, we can cultivate a community-driven capability economy that thrives on shared knowledge and collective innovation.
From Embedded to IoT and From Cloud to Edge & AIoT -- A computer technology t...William Liang
In this talk, we will review the evolution of the computer technologies after the PC Era, including embedded systems, smart devices and smartphones, cloud computing, IoT, AI, and then AIoT & Edge Computing that are happening today, and discuss how the trends were developed.
Meetup #7 Voiture Connectée et Autonome à ParisLaurent Dunys
Le 20 avril 2017 chez INGIMA à Paris.
Le Meetup Voiture Connectée et Autonome est un événement réunissant la communauté des professionnels du secteur.
Pour cette 7ème édition, nous avons le plaisir de vous présenter 4 projets qui ont pour mission de transformer l'usage de l'automobile, de la mobilité et des transports à travers des solutions technologiques et des business models innovants.
1) GPSGate: Your Next GPS Tracking and IoT Platform
2) YoGoKo conçoit et met en œuvre des solutions de communication pour le véhicule connecté & coopératif dans la ville intelligente. Conformes aux standards des ITS Coopératifs, ces solutions permettent l’échange de données entre les véhicules et avec l’infrastructure routière ou urbaine, tout en fournissant une connectivité Internet sécurisée. Les solutions YoGoKo sont notamment déployés dans les véhicules de gestionnaires d’infrastructure routière (déploiement pilote SCOOP@F) et chez plusieurs acteurs du véhicule autonome et connecté, en particulier VEDECOM, pour ses expérimentations sur route ouverte.
3) Cabine connectée COVED by SMILE: Smile, leader européen de l’intégration, de l’infogérance et de l'IoT à partir de solutions open source, accompagne le groupe Coved dans son projet à la fois ambitieux et structurant de cabines connectées. Ce projet a reçu l'IoT Awards 2017 dans la catégorie "Hi-Tech".
4) Munic.Box by Mobile Devices: Proven independent aftermarket and OEM connected car platform, hardware & tools.
De plus, Ross Douglas est venu nous présenter le nouveau format de l'événement Autonomy, prévu à Paris du 19 au 21 Octobre, dédié à la mobilité urbaine.
Les Meetups Voiture Connectée et Autonome vous sont proposés par Laurent Dunys, https://www.linkedin.com/in/laurentdunys, depuis 2016.
Rejoignez notre groupe en ligne: https://www.meetup.com/fr-FR/MeetupVoitureConnecteeAutonome
Introduce a connected vehicle blueprint; a Linux Akraino Project. The presentation consists of general background introduction, application use cases, network/technical/deployment architecture and the future plan.
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...Amil Baba Dawood bangali
Contact with Dawood Bhai Just call on +92322-6382012 and we'll help you. We'll solve all your problems within 12 to 24 hours and with 101% guarantee and with astrology systematic. If you want to take any personal or professional advice then also you can call us on +92322-6382012 , ONLINE LOVE PROBLEM & Other all types of Daily Life Problem's.Then CALL or WHATSAPP us on +92322-6382012 and Get all these problems solutions here by Amil Baba DAWOOD BANGALI
#vashikaranspecialist #astrologer #palmistry #amliyaat #taweez #manpasandshadi #horoscope #spiritual #lovelife #lovespell #marriagespell#aamilbabainpakistan #amilbabainkarachi #powerfullblackmagicspell #kalajadumantarspecialist #realamilbaba #AmilbabainPakistan #astrologerincanada #astrologerindubai #lovespellsmaster #kalajaduspecialist #lovespellsthatwork #aamilbabainlahore#blackmagicformarriage #aamilbaba #kalajadu #kalailam #taweez #wazifaexpert #jadumantar #vashikaranspecialist #astrologer #palmistry #amliyaat #taweez #manpasandshadi #horoscope #spiritual #lovelife #lovespell #marriagespell#aamilbabainpakistan #amilbabainkarachi #powerfullblackmagicspell #kalajadumantarspecialist #realamilbaba #AmilbabainPakistan #astrologerincanada #astrologerindubai #lovespellsmaster #kalajaduspecialist #lovespellsthatwork #aamilbabainlahore #blackmagicforlove #blackmagicformarriage #aamilbaba #kalajadu #kalailam #taweez #wazifaexpert #jadumantar #vashikaranspecialist #astrologer #palmistry #amliyaat #taweez #manpasandshadi #horoscope #spiritual #lovelife #lovespell #marriagespell#aamilbabainpakistan #amilbabainkarachi #powerfullblackmagicspell #kalajadumantarspecialist #realamilbaba #AmilbabainPakistan #astrologerincanada #astrologerindubai #lovespellsmaster #kalajaduspecialist #lovespellsthatwork #aamilbabainlahore #Amilbabainuk #amilbabainspain #amilbabaindubai #Amilbabainnorway #amilbabainkrachi #amilbabainlahore #amilbabaingujranwalan #amilbabainislamabad
Welcome to WIPAC Monthly the magazine brought to you by the LinkedIn Group Water Industry Process Automation & Control.
In this month's edition, along with this month's industry news to celebrate the 13 years since the group was created we have articles including
A case study of the used of Advanced Process Control at the Wastewater Treatment works at Lleida in Spain
A look back on an article on smart wastewater networks in order to see how the industry has measured up in the interim around the adoption of Digital Transformation in the Water Industry.
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Dr.Costas Sachpazis
Terzaghi's soil bearing capacity theory, developed by Karl Terzaghi, is a fundamental principle in geotechnical engineering used to determine the bearing capacity of shallow foundations. This theory provides a method to calculate the ultimate bearing capacity of soil, which is the maximum load per unit area that the soil can support without undergoing shear failure. The Calculation HTML Code included.
Cosmetic shop management system project report.pdfKamal Acharya
Buying new cosmetic products is difficult. It can even be scary for those who have sensitive skin and are prone to skin trouble. The information needed to alleviate this problem is on the back of each product, but it's thought to interpret those ingredient lists unless you have a background in chemistry.
Instead of buying and hoping for the best, we can use data science to help us predict which products may be good fits for us. It includes various function programs to do the above mentioned tasks.
Data file handling has been effectively used in the program.
The automated cosmetic shop management system should deal with the automation of general workflow and administration process of the shop. The main processes of the system focus on customer's request where the system is able to search the most appropriate products and deliver it to the customers. It should help the employees to quickly identify the list of cosmetic product that have reached the minimum quantity and also keep a track of expired date for each cosmetic product. It should help the employees to find the rack number in which the product is placed.It is also Faster and more efficient way.
Student information management system project report ii.pdfKamal Acharya
Our project explains about the student management. This project mainly explains the various actions related to student details. This project shows some ease in adding, editing and deleting the student details. It also provides a less time consuming process for viewing, adding, editing and deleting the marks of the students.
Explore the innovative world of trenchless pipe repair with our comprehensive guide, "The Benefits and Techniques of Trenchless Pipe Repair." This document delves into the modern methods of repairing underground pipes without the need for extensive excavation, highlighting the numerous advantages and the latest techniques used in the industry.
Learn about the cost savings, reduced environmental impact, and minimal disruption associated with trenchless technology. Discover detailed explanations of popular techniques such as pipe bursting, cured-in-place pipe (CIPP) lining, and directional drilling. Understand how these methods can be applied to various types of infrastructure, from residential plumbing to large-scale municipal systems.
Ideal for homeowners, contractors, engineers, and anyone interested in modern plumbing solutions, this guide provides valuable insights into why trenchless pipe repair is becoming the preferred choice for pipe rehabilitation. Stay informed about the latest advancements and best practices in the field.
Immunizing Image Classifiers Against Localized Adversary Attacksgerogepatton
This paper addresses the vulnerability of deep learning models, particularly convolutional neural networks
(CNN)s, to adversarial attacks and presents a proactive training technique designed to counter them. We
introduce a novel volumization algorithm, which transforms 2D images into 3D volumetric representations.
When combined with 3D convolution and deep curriculum learning optimization (CLO), itsignificantly improves
the immunity of models against localized universal attacks by up to 40%. We evaluate our proposed approach
using contemporary CNN architectures and the modified Canadian Institute for Advanced Research (CIFAR-10
and CIFAR-100) and ImageNet Large Scale Visual Recognition Challenge (ILSVRC12) datasets, showcasing
accuracy improvements over previous techniques. The results indicate that the combination of the volumetric
input and curriculum learning holds significant promise for mitigating adversarial attacks without necessitating
adversary training.
Integrating Service Mesh with Kubernetes-based connected vehicle platform
1. June 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Integrating Service Mesh
with Kubernetes-based
connected vehicle platform
DENSO CORPORATION Digital Innovation Div
JunKai Yong / Tomoya Amachi
2. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Agenda
2
Introduction of DENSO and our team
What we are building
Technical details and demonstration
3. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Introduction
JunKai Yong/@yjk_miloaddict
3
Software Engineer@DENSO CORPORATION
Digital Innovation Div.
Graduated from Nanyang Technological University
(NTU) in May 2018
Joined DENSO in Oct 2018.
Working on IoT and Service-Mesh related
topics
4. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Introduction
Tomoya Amachi/@tomoyamachi
4
Software Engineer
Joined misaki project as part of CREATIONLINE team
5. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
About DENSO
5
https://www.denso.com/global/en/
6. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
6
As a global manufacturer of automotive parts, DENSO is expanding its
business operations around the world.
DENSO supplies a wide range of products and systems
as a Tier 1* supplier trusted by the world’s automobile manufacturers.
World’s No.2
Consolidated net sales of 5.2 trillion yen.
About DENSO
7. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Our team
DENSO + Creationline = Our team!
7
8. June 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Abstracts of the Misaki
9. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
9
Why it is difficult to develop vehicle applications?
Applications on vehicle is becoming more and more important!
Develop application on
vehicles
10. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Develop application on
vehicles
10
There are many ECU(Electric control unit)s in a
car.
rader
accessmete
r
rain
sensor
camer
a
battery sensor
EC
U
Difficult to Develop - Need to learn about embedded systems.
11. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Difficult to Develop - Need to learn about embedded systems.
11
There are many ECU(Electric control unit)s in a
car.
Not using linux in most
cases.
CPU/Memory resources are limited and distributed.
Develop application on
vehicles
12. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
No easy way to update applications on many cars
simultaneously.
12
It's not always possible to run the application on your
PC as it is.
Develop application on
vehicles
Difficult to Develop - Need to learn about embedded systems.
13. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Network connection can be unstable
Because cars are moving around!
13
If connection
breaks..
Cars are like highly distributed system.
Developers have to deal with network
disconnection for their apps.
(retries/store data locally…)
Develop application on
vehicles
Difficult to Develop - Unstable Network.
14. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
But application on vehicle is becoming more and more important!
14
It’s important to handle data on edge and and keep updating the application
to minimize communications expenses.
e.g: Picture / Video / Traffic Data / Metadata
The Global Connected Car Market size is projected to reach USD 212.7 billion by
2027, from an estimated value of USD 42.6 billion in 2019, at a CAGR of 22.3%.
Current vehicles are like feature phone at 2000s. Smart "vehicle" era is coming soon.
"Applications" will be a selling point of smart vehicles same as smart phone.
Develop application on
vehicles
https://www.marketsandmarkets.com/Market-Reports/connected-car-market-102580117.html
15. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
What we are building?
Kubernetes based connected vehicle platform!
15
Minimize the need to learn about embedded
systems.
Easy to deploy/update application to vehicles.
Remove the need for application developers to
handle network issues.
It's still a prototype.
16. June 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Architecture Overview
17. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Architecture Overview
17
App
Edge Cloud
App
K8s
Agent
VP
N
VP
N
Applying
Manifest
Choos
e
HELM
Chart
Generat
e
K8s
Manifest
List
Share
Ideal
Manifest
b/w Edge and
Cloud
DigitalTwin API UI
K8s
Agent
18. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Why Kubernetes?
Flexibility of resources
18
radar
accessmete
r
rain
sensor
battery sensor
EC
U
ECUs will unified into several High Performance ECU in the future. We can use it
as k8s worker node.
19. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Flexibility of resources
19
radar
accessmete
r
rain
sensor
battery sensor
High Performance
ECU
Easy to orchestrate and manage ECU resources.
These ECUs will be separated from the basic operation of the car (running, stopping,
turning)
Why Kubernetes?
20. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
High performance ECU:
NVIDIA Jetson AGX Xavier Developer Kit
20
https://www.nvidia.com/en-us/autonomous-machines/embedded-systems/jetson-xavier-nx/
Why Kubernetes?
21. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
21
Edge
A
Cloud
High Spec Car
We can use resources on
cloud.
We can run same applications
even if edge resources are not enough
We can run container image
in different vehicles and cloud.
Flexibility of resources
B C
VP
N
A
Low Spec Car
B C
VP
N
Why Kubernetes?
22. June 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Technical Details
23. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Components of Misaki
Misaki
23
Misaki Orchestrator
Misaki Service mesh
24. June 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Misaki Orchestrator
For more information:
https://youtu.be/2x7jQTBUT5w
25. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Technical details about
Misaki orchestrator
25
App
Edge Cloud
App
K8s
Agent
VP
N
Apply
Manifest
To
Cluster
Choos
e
HELM
Chart
Generat
e
K8s
Manifest
List
Share
Ideal
Manifest
b/w Edge and
Cloud
DigitalTwin API UI
4 3 2 1
4 components
26. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
26
Misaki orchestrator
Applications
Repository
Data
Processcor
Data
Uploader
Sensory data
APP1
APP2
APP3
APP4
APP1
APP2
APP3
APP4
https://www.flaticon.com/authors/vitaly-gorbachev
https://www.flaticon.com/authors/xnimrodx
https://www.flaticon.com/authors/good-ware
How it works:
27. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
27
Demo: Misaki orchestrator Video scenario
GPS managerCan manager
Deleted Service:
CAN-uploader-for-prius-phv
Pod 3 Pod 4
Pod 1 Pod 2
Local Broker Redis to Ambass
GPS managerCan manager
New service deployed:
via-containers-for-prius
Pod 3
Pod 4
Pod 1 Pod 2
Local Broker
Redis to Ambass
Pod 5
File uploader
Pod 6
Ring Buffer
Pod 7
Steady video
Pod 8
Video
segment
28. June 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
DEMO VIDEO (orchestrator)
https://www.youtube.com/watch?v=2x7jQTBUT5w&t=1145s
29. June 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Misaki Service-Mesh
30. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
What is Service
Mesh?
30
Traffic control (load balancing, routing rules, failovers etc...)
Policy control
Secure communications
Service monitoring (metrics, logs, traces)
https://www.abhishek-tiwari.com/a-sidecar-for-your-service-mesh/
A dedicated infrastructure layer mainly for microservices
31. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Service Mesh
Architecture
31
https://servicemesh.es/
32. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Why Service Mesh?
32
App Proxy
Service-mesh decouples network concerns
from applications.
https://philcalcado.com/img/service-mesh/mesh1.png
https://qiita.com/Ladicle/items/4ba57078128d6affadd5
Application developers can focus on their
business values/logics
Applications no longer needs to implement
distributed system practices (i.e timeouts, service
discoveries etc.)
33. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Technical Detail about
Misaki Service Mesh
Overview
33
Misaki Control Plane
Misaki Data Plane
34. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Technical Detail about
Misaki Service Mesh
Architecture
34
• Provides policies
and configurations
to each Envoy
• Connects individual
envoys into a
distributed system.
Routing the application
to appropriate service(s)
Envoy:
Cloud node
Edge node
Queue
Filter
Queue
Filter
Misaki Control
Plane
App A App B
App C
Proxy
35. June 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Misaki Control Plane
36. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Technical Detail about
Misaki Control Plane
What is needed to deploy an app?
36
K8s deployment manifest
Envoy Custom Resource Definitions (CRD)
37. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Technical Detail about
Misaki Control Plane
Deployment Manifest
37
Create, modify or delete K8s resources
(i.e pods, deployment)
Commonly written in .yaml
- App
- Envoy side-car
- Control plane configmap
- Initialization settings
38. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Technical Detail about
Misaki Control Plane
Custom Resource Definition
(CRD)
38
Custom k8s API endpoint that stores a collection of API objects
I.E route CRD contains route CRD contains all the route information values
39. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Technical Detail about
Misaki Control Plane
Misaki Control Plane
39
Custom k8s controller
Assign appropriate settings to envoy side-car of newly deployed application, or
when changes are made to an existing application
40. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Technical Detail about
Misaki Control Plane
Misaki Control Plane
40
App C
Prox
y
New k8s
deployment
Misaki Control
Plane
App C
CRD
Obtain Pod.Spec
information1
Retrieve App C’s CRD
Generates envoy setting
snapshot and sets it to the
envoy side-car of the new app
3
2
App B
Prox
y
App A
Prox
y
41. June 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Misaki Data Plane
42. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
What’s going on
normal service-mesh Data Plane?
42
https://www.slideshare.net/ThomasGraf5/accelerating-envoy-and-istio-with-cilium-and-the-linux-kernel
43. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
What’s going on
Misaki Data Plane?
43
Buffering HTTP Request from application when network disconnect or not
applicable network interface(3g, 4g, wifi etc).
Re-sends the HTTP Request/streaming-data to server when network available
again.
Store HTTP Request from application if network did not recover during buffering
duration.
44. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Prototype Outbounds
on Misaki Data Plane
44
volume
App
Prox
y
Prox
y
Server
Online1 Offline2
volume
App
Prox
y
Prox
y
Server
Name resolve
in /etc/hosts
Recover3
volume
App
Prox
y
Prox
y
Server
45. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Problems
45
Server footprint is not small
Not supported Dynamic DNS resolve
Network security problems
46. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Current Outbounds
on Misaki Data Plane
46
volume
App Proxy
volume
App Proxy
Local
DNS
Local
DNS
Online1 Offline2 Recover during buffering time3
App Proxy
Local
DNS
47. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Current Outbounds
on Misaki Data Plane
47
Recover after buffering time4
volume
App Proxy
Local
DNS
Replay
Async
response
volume
App Proxy
Local
DNS
Replay
Next request5
48. June 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
DEMO VIDEO (service mesh)
https://www.youtube.com/watch?v=2x7jQTBUT5w&t=1630s
49. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Troubles
49
Envoy does not suppose offline communications.
We need to customize Envoy code (written by C++11).
Network security problems
Create an original DNS Resolver (based on tomoyamachi/go-dnsmasq)
All component images need to build for cross platforms(ARM, AMD etc).
50. June 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Summary
51. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Summary
51
We developed a k8s-based connected vehicle platform prototype
Misaki service-mesh removes the need for developers to
handle network problems
But there is still many challenges to be solved.
52. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Challenges
52
Misaki service-mesh currently only support simple HTTP/1.1 and HTTP/2.0.
We want it to support more protocols (WebSocket, gRPC etc)
Misaki control plane needs to be more flexible
Our journey is just beginning!
Minimizing cpu/memory usage on edge devices.
53. May 2020 / Digital Innovation, Engineering Research & Development
ゥ DENSO CORPORATION All Rights Reserved.
Visit us
53
misaki-io
currently empty, but
we have a plan to
make it open source
this year
Thank You
Editor's Notes
こんにちは、デンソーのヨンと申します。
今日は「Kubernetesを用いた車両用クラスタ管理とvehicle service mesh」で発表いたします。
よろしくお願いいたします
Before I present on the technical details of Misaki, I would like to briefly talk about the architecture overview.
Our vehicle cluster consists of an Edge side and Cloud side.
The Edge side, would be your devices on board the vehicle. This is where we have the worker nodes.
On the cloud side, we have the master node and the k8s agent
On the right we have the orchestration components.
I will provide more details later.
So why have we chose to use K8s?
The main reason for using k8s, is so that we can better manage the resources we have in the vehicle
such as the high performance ECUs that will be made more available in the future.
We can do so by treating the ECU as k8s worker nodes
Of course, these ECUs will not be able to influence the basic operations such as driving and braking.
One such possible high-spec ECU would be the nvida jetson AGX Xavier.
We will be using this in our demonstration today.
K8s provides us with more flexibility in resource management.
In a scenario where you have a high-spec car with very power on-vehicle devices, you would be able to run all 3 application, A B C on the vehicle, or edge side.
But what if we want to bring this experience down to a low-spec car that would not have a powerful on-vehicle device?
With k8s, we can harness the resource on the cloud.
For the low-spec car, we can deploy only application A which could be the minimum requirement.
Apps B and C could be deployed to the cloud server instead.
We can run the same applications for both the high-spec and low-spec cars, even if the edge resources are not enough
Using this idea, we can also change the type of vehicle that we are deploying the applications to, and even the cloud servers that we would want to run on, such as AWS, Azure, Google, etc.
Now, I would like to present about the technical details of Misaki.
Misaki comprises two major components
Misaki Orchestrator
And the Misaki Service Mesh
Misaki Orchestrator
The orchestrator comprises 4 components
UI, API, Digital Twin and K8s agent
Misaki UI is user interface where users can deploy, modify and remove applications in the vehicle by choosing a helm chart.
The API will then generate a k8s manifest list based on the helm chart chosen.
We then have a digital twin that will synchronize the changes made on the UI and the vehicle.
This ensures that both Edge and Cloud sides will have the exact same state, hence the name Digital Twin.
Lastly, the k8s agent will apply the manifest to the cluster based on what is reflected on the digital twin.
Through this implementation, we will be able to do an intuitive application deployment without directly accessing the devices in the vehicle.
Now, I would like to show a demonstration on Misaki Ochestrator
Before that, allow me to briefly explain to you the operations of the UI.
In this scenario,
We currently have a service called CAN-uploader for prius HV deployed
We will be deleting this service from the UI and deploying a new service
The new service will be uploading video files to a S3 bucket
すでにデプロイされてるセットがあって、まずそれを削除します
削除すると、Terminatingになりました。
画面にも何も表示されません
video upload用のセットをdeployします。
misakiではhelmというツールをつかってdeployを管理しています。いまはバージョンの指定や、設定値の変更をしてます
workingになったので確認すると、kubernetes cluster上にコンテナが増えて、事前に設定したセットがWebの画面上に表示されます
リロードすると、動画が正常にアップロードされました
ダウンロードしたファイルを確認すると車載器からの動画データが確認できます
Before jumping in to the technical details, allow me to give you a brief introduction to service mesh.
So what is a service mesh?
It is a dedicated infrastructure layer mainly for microservices that has the following purpose
Traffic control, such as load balancing, routing, failover etc
Policy control
Service monitoring such as metric logging
And most importantly, providing secure communication
Before jumping in to the technical details, allow me to give you a brief introduction to service mesh.
So what is a service mesh?
It is a dedicated infrastructure layer mainly for microservices that has the following purpose
Traffic control, such as load balancing, routing, failover etc
Policy control
Service monitoring such as metric logging
And most importantly, providing secure communication
I will now present about the Misaki Service Mesh
The Misaki service mesh comprises two components
Misaki Control plane
And Misaki Proxy
The following is our architecture overview for Misaki-service mesh
We have a control plane, which will provide policies and configuration to the each envoy
The envoy is deployed together with the application as a side-car
This envoy sidecar will handle all the routing.
In addition, we have a queue filter that handles request in event of disconnection.
In our implementation, we require a few components before an app can be deployed successfully
Firstly, a k8s deployment manifest
As well as the envoy custom resource definition yaml
The deployment manifest is used to create, modify or delete k8s resources such as pods and deployment
It is usually written in .yaml
For our implementation, the manifest should contain the application you wish to deploy, the envoy side-car, a configmap for Misaki control plane and the container initialization settings
The custom resource definition or CRD is a custom k8s api endpoint that stores a collection of API objects
For example, the route CRD contains all the route information value such as route name, and virtual hosts names.
I will now present about the Misaki Control plane.
Misaki control plane is a custom k8s controller that uses the Envoy CRD
Its main purpose is to automatically assign the appropriate envoy settings to a newly deployed application, or when a new envoy CRD is applied for an existing app
As such, users no longer need to manually assign the envoy settings such as Pod IP every time an app is deployed or changes are made
I will now hand over the time to my colleague, Amachi-san, who will be explaining about Queue Filter.