Building A Cloud-Native Advanced Logistics Ecosystem

1. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T BuildingACloud-NativeAdvanced Logistics Ecosystem Christian Deger Chief Architect RIO The Logistics Flow | TRATON Group

4. RIO'S VISION RIO's vision is to make the complete transport and logistics ecosystem more transparent – across all manufacturers, and open to all. The centralizing platform creates the foundations for a wide range of new business and service models.

5. Digitization of trucks with the RIO Box RIO DIGITIZES THE LOGISTICS SUPPLY CHAIN. Integration of producer platforms System connection of the receivers TMS connection of logistics service providers

6. Fleet customers registered at RIO Platform MORE THAN 4,500Vehicles equipped with RIO Box MORE THAN 80,00027Participating countries OUR CUSTOMERS ON THE RIO PLATFORM.

12. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Vehicleconnectivity AWS Account Connectivity Private APN MQTT Broker HiveMQ Kafka Event Bus AWS Account Services Peering

13. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Vehicleconnectivity AWS Account Connectivity Private APN MQTT Broker HiveMQ Kafka Event Bus AWS Account Services Peering MQTT Gateway

14. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Vehicleconnectivity AWS Account Connectivity Private APN MQTT Gateway MQTT Broker HiveMQ Kafka Event Bus AWS Account Services Peering

15. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Vehicleconnectivity AWS Account Connectivity Private APN MQTT Gateway MQTT Broker HiveMQ Kafka Event Bus Receiver: Decodes Enriches Routes AWS Account Services Peering

16. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Vehicleconnectivity AWS Account Connectivity Private APN MQTT Gateway MQTT Broker HiveMQ Kafka Event Bus Receiver: Decodes Enriches Routes Microservices AWS Account Services Peering

17. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Vehicleconnectivity AWS Account Connectivity Private APN MQTT Gateway MQTT Broker HiveMQ Kafka Event Bus Receiver: Decodes Enriches Routes Sender: Routes Microservices AWS Account Services Peering

18. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Vehicleconnectivity AWS Account Connectivity Private APN MQTT Gateway MQTT Broker HiveMQ Proxy NGINX Kafka Event Bus Proxy NGINX Mobile Device Management Receiver: Decodes Enriches Routes Sender: Routes Microservices AWS Account Services Peering

20. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Telematicshardware – RIO box AWS CloudCloud Connect Gateway • Over the air update of base software • Over the air updates of individual apps • End-to-end responsibility for teams • Middleware includes MQTT broker • App config changes via MQTT

23. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Dataarchitecture Event Bus Connectivity Gateway Connectivity Gateway Microservice Microservice Microservice Other sources Kafka Data or event flow

24. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Dataarchitecture Event Bus Connectivity Gateway Connectivity Gateway Microservice Microservice Microservice Other sources Kafka Connect S3 Kafka Raw Data Data or event flow

25. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Dataarchitecture Event Bus Connectivity Gateway Connectivity Gateway Microservice Microservice Microservice Other sources Data Lake Kafka Connect S3 Kafka Raw Data Data Hub Data or event flow

26. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Dataarchitecture Event Bus Connectivity Gateway Connectivity Gateway Microservice Microservice Microservice Other sources Data Lake Kafka Connect S3 Kafka Raw Data Data Hub Data or event flow Analytics

27. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Dataarchitecture Event Bus Connectivity Gateway Connectivity Gateway Microservice Microservice Microservice Other sources Data Lake Kafka Connect S3 Kafka Raw Data Data Hub Data or event flow Analytics Use case data

28. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Bounded contexts Event Bus Microservices Microservices Microservice Storage API Gateway Microservices Microservices Microservice Storage Bounded Context Bounded Context A bounded context delimits the applicability of a particular model so that team members have a clear and shared understanding of what has to be consistent and how it relates to other contexts. API Gateway

29. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Bounded contexts – Interfaces Event Bus Microservices Microservices Microservice Storage API Gateway Microservices Microservices Microservice Storage Bounded Context Bounded Context Bounded contexts interact only via their interfaces API Gateway

30. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Bounded contexts –AWSAccounts Event Bus Microservices Microservices Microservice Storage API Gateway Microservices Microservices Microservice Storage AWS Account AWS Account Strengthen the architecture with AWS account as explicit boundary API Gateway

37. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Stereotypicalcontext account AWS Account Parameter Store or or Delivery Bounded Context MongoDB Atlas Hosted zone

38. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Stereotypicalcontext account AWS Account Hosted zone Parameter Store or or Delivery Bounded Context Kafka MongoDB Atlas

41. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Stereotypicalcontext account AWS Account Hosted zone Parameter Store or or Delivery Bounded Context Kafka MongoDB Atlas React App

42. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Stereotypicalcontext account AWS Account Hosted zone Parameter Store or or Delivery Bounded Context Kafka MongoDB Atlas React App

43. https://blog.crisp.se/wp-content/uploads/2013/09/culture-over-process.pdf

44. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Foster autonomy You build it, You run it teams… • own one or more bounded contexts • decide on micro architecture • deploy and operate services in their context accounts • have end-to-end responsibility for their services • are cross-functional Autonomy and alignment

45. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T You build it, You run it teams… • own one or more bounded contexts • decide on micro architecture • deploy and operate services in their context accounts • have end-to-end responsibility for their services • are cross-functional • Objectives and key results (OKR) • Technology Radar • Transparent decisions via Macro Architecture Guild Autonomy and alignment Enable alignment Foster autonomy

47. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Usecases Fleet Monitor End-to-end responsibility and device configuration Performance Analysis Stream processing with higher data volume Tachograph Services Polyglot microservices and personal data

50. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Fleetmonitor – architecture Location MongoDB Atlas Async events via Kafka Vehicle connectivity HTTP calls Location reports

51. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Fleetmonitor – architecture Location MongoDB Atlas Async events via Kafka Vehicle connectivity HTTP calls Location reports

52. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Fleetmonitor – architecture Location MongoDB Atlas React App Fleet monitor Async events via Kafka Vehicle connectivity HTTP calls Location reports

53. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Fleetmonitor – architecture Location MongoDB Atlas Here Maps API Map Service React App Fleet monitor Async events via Kafka Vehicle connectivity HTTP calls Location reports

54. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Fleetmonitor – architecture Location MongoDB Atlas Here Maps API Map Service React App Fleet monitor Async events via Kafka Vehicle connectivity HTTP calls Location reports

55. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Fleetmonitor – architecture Location RIO Marketplace MongoDB Atlas Here Maps API Map Service React App Fleet monitor Async events via Kafka Vehicle connectivity HTTP calls Location reports

56. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Fleetmonitor – architecture Location RIO Marketplace MongoDB Atlas Here Maps API Map Service React App Fleet monitor MongoDB Atlas Async events via Kafka Vehicle connectivity HTTP calls Product activated Map Activation Location reports

57. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Fleetmonitor – architecture Location RIO Marketplace MongoDB Atlas Here Maps API Map Service React App Fleet monitor MongoDB Atlas Async events via Kafka Vehicle connectivity HTTP calls Product activated Map Activation Change configuration Location reports

60. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Performance analysis– architecture Async events via Kafka Vehicle connectivity HTTP calls Performance data Kafka Streaming Performance Kafka Streams

61. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Performance analysis– architecture Async events via Kafka Vehicle connectivity HTTP calls Performance data Kafka Streaming Performance Kafka Streams Driver changed

62. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Performance analysis– architecture Async events via Kafka Vehicle connectivity HTTP calls Performance data Kafka Streaming Performance Kafka Streams Driver changed • Deserialization, Deduplication, Filtering, Repartitioning • Group by fleet and vehicle • Create 15 minute windows of snapshots • Join vehicle snapshots with drivers • Combine aggregates within windows

63. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Performance analysis– architecture MongoDB Atlas Async events via Kafka Vehicle connectivity HTTP calls Performance data Kafka Streaming Performance Kafka Streams Driver changed 15 min aggregates

64. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Performance analysis– architecture Performance History MongoDB Atlas Async events via Kafka Vehicle connectivity HTTP calls Performance data Kafka Streaming Performance Kafka Streams Driver changed 15 min aggregates

65. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Performance analysis– architecture Performance History MongoDB Atlas React App Performance Async events via Kafka Vehicle connectivity HTTP calls Performance data Kafka Streaming Performance Kafka Streams Driver changed 15 min aggregates

66. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Performance analysis– architecture Performance History RIO Marketplace MongoDB Atlas React App Performance Async events via Kafka Vehicle connectivity HTTP calls Product activated Product Config Change configuration, including data reduction Performance data Kafka Streaming Performance Kafka Streams Driver changed 15 min aggregates

67. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Performance analysis– architecture Performance History RIO Marketplace MongoDB Atlas React App Performance Async events via Kafka Vehicle connectivity HTTP calls Product activated Product Config Change configuration, including data reduction Performance data Kafka Streaming Performance Kafka Streams Driver changed 15 min aggregates IoT throughput: ~4KB per truck per minute

68. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Performance analysis– architecture Performance History RIO Marketplace MongoDB Atlas React App Performance Async events via Kafka Vehicle connectivity HTTP calls Product activated Product Config Change configuration, including data reduction Performance data Kafka Streaming Performance Kafka Streams Driver changed 15 min aggregates IoT throughput: ~4KB per truck per minute Retention: 60 days

69. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Performance analysis– architecture Performance History RIO Marketplace MongoDB Atlas React App Performance Async events via Kafka Vehicle connectivity HTTP calls Product activated Product Config Change configuration, including data reduction Performance data Kafka Streaming Performance Kafka Streams Driver changed 15 min aggregates Write amplification factor 12 IoT throughput: ~4KB per truck per minute Retention: 60 days

70. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Performance analysis– architecture Performance History RIO Marketplace MongoDB Atlas React App Performance Async events via Kafka Vehicle connectivity HTTP calls Product activated Product Config Change configuration, including data reduction Performance data Kafka Streaming Performance Kafka Streams Driver changed 15 min aggregates Write amplification factor 12 IoT throughput: ~4KB per truck per minute Retention: 60 days Reprocessing of ~45 million truck messages in ~14 hours, with 7 instances, each 4 GB RAM, 1 vCPU

71. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T KafkaStreamsalternatives Kafka and Apache Flink • Apache Flink is not so deeply integrated with Kafka • Apache Flink is deployed as cluster, Kafka Streams is included as library • Kafka Stream applications can be deployed to ECS Amazon Kinesis and Apache Flink • Deployment managed by AWS • Amazon Kinesis Data Analytics for Java was not available yet

72. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Performance analysis– Keypoints End-to-end responsibility from device to application allows fast iteration and control • Payload definition • Various trigger for data collection • Remote configurable aggregation on device Stream processing • Near real-time access to results • Reprocessing of truck events possible Elastic adjustment of capacity between reprocessing and normal operation

74. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Tachographservices – keypoints • Multiple .NET Core services instead of Java/Kotlin Spring Boot • Windows application with card reader • Automated download and archival of digital tachograph and driver card to Amazon S3 • Enabled compliant processing and storage of personal data on AWS to fulfill legal obligation of customers

76. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Fleet monitor Organization and architectural End-to-end responsibility • From embedded app to service • Fast, local decisions • Fit for initial purpose Performance Analysis Remaining driving time

77. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Organization and architectural Align local optimizations with overall strategy • Abstractions at the right level • Connector abstraction required to address mixed fleets Fleet monitor Performance Analysis Remaining driving time Connector Connector

78. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Domain-driven design Improve collaboration with domain experts by • Explicitly defining bounded contexts • Building a context map of the domain • Exploring and designing with event storming • Using ubiquitous language

80. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Multi-AccountStrategy AWS Account AWS Account AWS Account AWS Account Instances Instances Instances Instances Instances Instances

84. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Undifferentiated heavylifting Value for RIO customers Undifferentiated heavy lifting On premise Value for RIO customers Undifferentiated heavy lifting AWS as infrastructure provider

85. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Undifferentiated heavylifting Value for RIO customers Undifferentiated heavy lifting On premise Value for RIO customers Undifferentiated heavy lifting AWS as infrastructure provider Value for RIO customers Undifferentiated heavy lifting Embrace higher level AWS services

86. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T AWS Firstprinciple Favor AWS platform service over managed service, over self-hosted OSS, over self-built solutions Self-hosted OSS Self-built solution Managed service AWS service Higher level AWS service

88. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T AWS First– Examples Self-hosted OSS Self-built solution Managed service AWS service Higher level AWS service OSS IAM and API Gateway Amazon Cognito and Amazon API Gateway

89. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T AWS First– Examples Self-hosted OSS Self-built solution Managed service AWS service Higher level AWS service OSS IAM and API Gateway Amazon Cognito and Amazon API Gateway Monitoring and logging DataDog

90. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T AWS First– Examples Self-hosted OSS Self-built solution Managed service AWS service Higher level AWS service OSS IAM and API Gateway Amazon Cognito and Amazon API Gateway Monitoring and logging DataDog ECS launch type EC2 ECS launch type Fargate

91. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T AWS First– Re-evaluatedecisions Self-hosted OSS Self-built solution Managed service AWS service Higher level AWS service

92. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T AWS First– Re-evaluatedecisions Self-hosted OSS Self-built solution Managed service AWS service Higher level AWS service IoT and MQTT stack AWS IoT Core

93. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T AWS First– Re-evaluatedecisions Self-hosted OSS Self-built solution Managed service AWS service Higher level AWS service IoT and MQTT stack AWS IoT Core Managed Kafka Kafka

94. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T AWS First– Re-evaluatedecisions Self-hosted OSS Self-built solution Managed service AWS service Higher level AWS service IoT and MQTT stack AWS IoT Core Managed Kafka Kafka Amazon Managed Streaming for Kafka

95. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T AWS First– Re-evaluatedecisions Self-hosted OSS Self-built solution Managed service AWS service Higher level AWS service IoT and MQTT stack AWS IoT Core Kafka Kinesis and Lambda Amazon Managed Streaming for Kafka Managed Kafka

97. That's why we need you! https://rio.cloud/en/careers.html SOFTWARE CAN NEVER BE FINISHED

98. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Thank you! S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Christian Deger @cdeger

Building A Cloud-Native Advanced Logistics Ecosystem

You are reading a preview.

Check these out next

Building A Cloud-Native Advanced Logistics Ecosystem

More Related Content

Slideshows for you (20)

Similar to Building A Cloud-Native Advanced Logistics Ecosystem (20)

More from Christian Deger (17)

Recently uploaded (20)