Successfully reported this slideshow.
Your SlideShare is downloading. ×

Tobias Braun [Herrenknecht AG] | Going Underground with InfluxDB | InfluxDays NA 2021

Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad

Check these out next

1 of 27 Ad

Tobias Braun [Herrenknecht AG] | Going Underground with InfluxDB | InfluxDays NA 2021

Download to read offline

Tobias Braun [Herrenknecht AG] | Going Underground with InfluxDB | InfluxDays NA 2021

Going Underground with InfluxDB
Herrenknecht AG is the world’s leading manufacturer of tunnel boring machines. This talk shows how the company is using InfluxDB for capturing IIoT data on hundreds of tunneling construction projects, how they’re transferring this data into the cloud over unreliable network connections and what kind of insights they’re getting out of it.

Tobias Braun [Herrenknecht AG] | Going Underground with InfluxDB | InfluxDays NA 2021

Going Underground with InfluxDB
Herrenknecht AG is the world’s leading manufacturer of tunnel boring machines. This talk shows how the company is using InfluxDB for capturing IIoT data on hundreds of tunneling construction projects, how they’re transferring this data into the cloud over unreliable network connections and what kind of insights they’re getting out of it.

Advertisement
Advertisement

More Related Content

Slideshows for you (20)

Similar to Tobias Braun [Herrenknecht AG] | Going Underground with InfluxDB | InfluxDays NA 2021 (20)

Advertisement

More from InfluxData (20)

Recently uploaded (20)

Advertisement

Tobias Braun [Herrenknecht AG] | Going Underground with InfluxDB | InfluxDays NA 2021

  1. 1. Going Underground with InfluxDB Tobias Braun – Software Architect Herrenknecht AG, Germany
  2. 2. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Overview - Herrenknecht AG and the presenter - Building an IIoT platform for Herrenknecht AG - Focus on handling of sensor data - InfluxDB as central time series storage - Migration to InfluxDB Enterprise - Current status of the product
  3. 3. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Herrenknecht AG - Founded 1977 in Germany - World market leader for tunnel boring machines - For tunnels from 0.1m to 19m - Traffic, utility and mining - Vertical and horizontal - All geologies, even under water - Major share of global market - ~ 5,300 employees - Revenue 2020: 1,007 mio. €
  4. 4. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved.
  5. 5. © 2021 InfluxData Inc. All Rights Reserved. Tobias Braun Software Architect, Herrenknecht AG Build an IIoT platform with insight into live and historic data for all tunnel boring machines delivered by Herrenknecht AG. Small agile team of 4 developers. Frontend development is supported by an external partner. We have to compromise and gradually improve what we build. E-Mail: braun.tob@herrenknecht.com Software Architect at Herrenknecht for 2 ½ years - More than 20 years of experience in highly available, distributed systems - Worked for: 1&1 IONOS – Web Hosting Core Burda GmbH – E-Commerce Trumpf Werkzeugmaschinen GmbH – IIoT platform for a machine tool manufacturer
  6. 6. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Building an IIoT platform for Herrenknecht AG
  7. 7. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Tunnel diameter and amount of data correlate 1985 HERA 5.95 m 1996 Sydney 10.70 m 1997 Hamburg 14.20 m 2006 Madrid 15.20 m 2006 Shanghai 15.43 m 2010 Sparvo 15.62 m 2016 Santa Lucia 15.87 m 2013 Hongkong 17.6 m Concept St. Petersburg 19.25 m
  8. 8. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Current, correct data is vital for TBM operator
  9. 9. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Building an IIoT platform for Herrenknecht AG • Has to support >2000 TBM, several hundred are working simultaneously • Up to 5000 sensors on a single machine • Some sensors with sample rates <= 100ms • Limited bandwidth to the job-site • Machines can be offline for days, weeks, even months • Historic data from 40 years and in different formats (SQL, DBase, even CSV) has to be made available
  10. 10. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Building an IIoT platform for Herrenknecht AG • Can be developed and maintained by a small team • Start with the basics: Make sure data is recorded consistently • Development first for TBM, cloud as a second step • Data storage for the next 10-15 years • Robust, flexible architecture
  11. 11. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. InfluxDB as central time series storage
  12. 12. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Why we chose InfluxDB • Open Source with commercial „Enterprise Edition“ • Windows-Service available (was relevant „back-then“) • Very space efficient storage • Query language similar to SQL with powerful aggregations • Stored in simple, flat files
  13. 13. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Where is sensor data stored? • On-site • Control room of the TBM is equipped with ruggedized industrial PCs • Windows operating system with limited computing power and SSD • Data cleansing and storage in InfluxDB OSS • Cloud • InfluxDB Enterprise running on Microsoft Azure
  14. 14. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. How is data stored? • Basically one big measurement • Every sensor is a „float“ field • Only few tags are used • Low tag cardinality • Only write values when there was a significant change -> 1-5 GB / month & machine
  15. 15. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Simple architecture for InfluxDB in the cloud • When entering the cloud, we used a quick and pragmatic approach based on Kubernetes • One InfluxDB OSS container per TBM • No clustering of InfluxDB itself • Azure File Storage (equivalent to Windows share)
  16. 16. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Advantages of this approach • Architecture almost identical to the environment on the TBM, therefore minimal development effort • Isolated impact zones • Cheap pay-per-use storage • File-based backup is included with Azure File Storage • InfluxDB OSS – no licensing cost
  17. 17. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. How is data transferred to the cloud? • Historic data is converted to InfluxDB format in batches • Live Data: • Data cleansing is already done on the machine • So we simply mirror all the data from the machine to the cloud • We built a custom synchronization, based on a REST API • Result: Data is identical on the TBM and in the cloud
  18. 18. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Migration to InfluxDB Enterprise
  19. 19. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. First issues with the pragmatic approach • Scaled well to ~100 InfluxDB containers, • But with >> 100 containers, • the overall system became unreliable • … and response times for even simple queries exploded • … and the infrastructure became prohibitively expensive • Azure File Storage „forgot“ to unlock files in rare cases • with hundreds of containers, even rare cases tend to happen regularly
  20. 20. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Decision to migrate to InfluxDB Enterprise • 750 GB of data in 200 databases • At most a couple of minutes of downtime for each TBM • Small team with limited capacity, migration had to be automated • Executed successfully in Q1/2020, took less than two weeks • No read-downtime, write-downtime of less than 60 minutes per TBM
  21. 21. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Results after the migration • Reduced TCO of Influx databases by 1/3 • Extensive monitoring and stable operation • Very reliable and reproducable response times for all queries
  22. 22. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Status of the product
  23. 23. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Successful rollout to first customers
  24. 24. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Successful rollout to first customers
  25. 25. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Status of the product • Very positive feedback from customers and internal users • Team can concentrate on feature development, little DevOps efforts • InfluxDB OSS on every TBM • InfluxDB Enterprise in the cloud just works, unnoticable in the background
  26. 26. © 2021 InfluxData Inc. All Rights Reserved. Questions? braun.tob@herrenknecht.com
  27. 27. © 2021 InfluxData Inc. All Rights Reserved. Thank You

×