Containers for sensor web services, applications and research @ Sensor Web Conference, Münster
•Download as PPTX, PDF•
1 like•413 views
Using Docker for research and production in the Sensor Web / OGC SWE domain with examples from 52°North Sensor Observation Service and Helgoland.
More Related Content
What's hot
What's hot (20)
Viewers also liked
Viewers also liked (20)
Similar to Containers for sensor web services, applications and research @ Sensor Web Conference, Münster
Similar to Containers for sensor web services, applications and research @ Sensor Web Conference, Münster (20)
More from Daniel Nüst
More from Daniel Nüst (17)
Recently uploaded
Recently uploaded (20)
Containers for sensor web services, applications and research @ Sensor Web Conference, Münster
- 1. Containers for Sensor Web Services, Applications and Research Aug 30, 2016 @ Geospatial Sensor Webs Conference, Münster, Germany Daniel Nüst, University of Münster, daniel.nuest@uni-muenster.de
- 2. Agenda Motivation Containerization (Docker) Reproducible Research ❤ Containers Docker for Geospatial Sensor Webs
- 4. Docker
- 5. Slide by Docker inventor & Docker, Inc. CTO Solomon Hykes, DockerCon 2014
- 7. Open access Open access to data Open access to data and procedures Reproducibility platforms (identification/citation/credit, viewing, and downloading) Meta-publications (Nature, Nature Geosciences, Science, …) Motivation: Open Science https://openaccessbutton.org/ Missing for reproducibility of computational research: access to and archival of runtime environments
- 8. To cut to the chase... Who of you can reproduce a scientific analysis conducted 5 years ago today? Who of you is sure she can start a multi-service demonstrator of a research project that was finished today in 5 years?
- 10. https://www.docker.com/what-docker https://en.wikipedia.org/wiki/Operating-system-level_virtualization https://youtu.be/ki8CZkutoxQ Containerization using kernel features: namespaces libcontainer, LXC cgroups Houses vs. Appartments Docker @ ARM / RaspberryPI !
- 11. Docker basics Dockerfile … … Docker Image Docker Container build run pause stop/kill start logs cp exec rm stats docker-compose configuration … … use n Docker Container Docker Container Docker Container up down Docker CLI Docker Engine Docker Registry run
- 12. Docker for Reproducible Research
- 13. Executable Research Compendium Docker logo courtesy of Docker Inc.; Trafic lights Bluemix via Wikimedia Commons; crowbar by Delapouite via game-icons.net; zipper by RRZEIcons, cursor by Subhashish Panigrahi, via Wikimedia Commons;
- 15. Docker for Geospatial Sensor Webs
- 16. 52°North Helgoland $ docker run -p 80:8080 52north/helgoland http://172.17.0.2:8080/#/ $ docker run -p 80:80 geocontainers/52n-helgoland http://localhost/#/ Differences: BRANCH env var, nginx vs. node, git clone during build (Hub)
- 17. 52°North SOS Whole (!) Dockerfile based on Debian (unsimplified) FROM tomcat:9 WORKDIR /tmp RUN curl -L -o sos-bundle.zip http://../491-52n-sensorweb-sos-bundle-4-3-7 RUN unzip -d sos-bundle sos-bundle.zip RUN cp sos-bundle/*.war $CATALINA_HOME/webapps/52n-sos-webapp.war RUN rm -r * Command to run image based on Alpine $ docker run --rm -p 80:8080 geocontainers/52n-sos-alpine # http://localhost/52n-sos-webapp/ docker-compose configuration (SOS + PostGIS DB)
- 18. 52°North SOS on Docker Cloud with AWS EC2 ”1 Minute Deployment”
- 19. Docker for Geospatial Projects https://wiki.osgeo.org/wiki/DockerImages http://geocontainers.org
- 20. Docker for Geospatial Sensor Webs We need to catch up with mainstream IT Collaborate more effectively (prod/dev/research) Spread software more easily and more DevOps friendly by bringing down requirements to 1 software and installation to 1 command Quickly (re) create dev, demo, test, production (customer!) environments Effective deployment of the latest software thin your own infrastructure or in the cloud http://simpleicon.com/money-7.html
- 21. Docker for Geospatial Sensor Webs - How? 1. Use it! You admins won’t mind. Your work will be easier. 2. Provide and share (!) images and docker-compose files for popular services on Docker Hub (52°North is getting started) https://github.com/Geonovum/smartemission/tree/master/docker/sos52n 3. Keep in mind during implementation (e.g. configurability) 4. Add getting services cloud ready + scalable prominently to all funding efforts 5. Experiment with desktop apps https://wiki.52north.org/Documentation/Docker https://hub.docker.com/u/52north/
- 22. Thanks for your attention! What are your questions? http://o2r.info/almost http://o2r.info @o2r_project daniel.nuest@wwu.de @nordholmen
Editor's Notes
- The pets and cattle metaphor has come up in a few conversations lately and we mention it because it seems a useful way to think about IT operations. We'll even have a go at extending it by saying cattle get to live in a far-off bit barn. The presentation is also worth a look as it details that CERN is a KVM and Hyper-V shop, with OpenStack employed to manage its pets and a herd of about 15,000 virtual machines. That it has chosen OpenStack for that server-wrangling job, on top of IBM's recent declaration of large-scale affection for the project, is surely not happy news for outfits like VMware that consider themselves ideal carers for large numbers of pets. http://www.theregister.co.uk/2013/03/18/servers_pets_or_cattle_cern/
- via http://www.tigertech.de/ein-docker-container-und-deine-anwendung-laeuft-ueberall/ Die Macher von Docker haben sich gedacht, daß es ja wohl nicht sein kann, daß die Menschheit mittlerweile Waren in jeglicher Form an jeglichen Ort der Welt verschiffen kann, aber die IT-Welt es immer noch nicht hinkriegt, problemlos eine Anwendung von einem Kontext in den nächsten zu portieren. In Anlehnung an diese Allegorie wurde 2013 der Docker-Container erfunden. Ebenso wie ein großer Schiffscontainer ein einheitliches (seit 1956 nach ISO-Norm standardisiertes) Format hat, das gleichermaßen von Schiffen und LKWs transportiert und gestapelt werden kann und mit beliebigem Inhalt zu befüllen ist, ist der Docker-Container dafür zuständig, eine Anwendung beliebiger Art so in sich zu kapseln, daß der Container alle Kontextinformationen übernimmt und sich problemlos in verschiedene Umgebungen verschieben lässt.
- STATE OF THE ART We think that the major technical building block exist
- https://www.docker.com/what-docker
- Where are we on the reproducibility spectrum? Standards Software Research workflow & analysis software journal software, archival software, … Interactive execution of ERC Infrastructure DFG-funded 2.75 researcher positions for 24 months (with goal to extend +36 months) http://o2r.info @o2r_project Team (a-z): Jim Jones, Stephanie Klötgen, Markus Konkol, Christian Kray, Dirk Kussmann, Jörg Lorenz, Daniel Nüst, Edzer Pebesma, Holger Przibytzin, Marc Schutzeichel
- https://www.docker.com/sites/all/themes/docker/assets/images/footer_moby_icon.png
- Login + > service Use dynamic IP! issues with map...
- QGIS GeoServer Mapserver PostGIS
- Collaborate: integrate using standards and using the same tools