Central Iowa Linux Users group July 2019--Jupyter Notebook on a Raspberry Pi

•

0 likes•86 views

This document summarizes a presentation given at the Central Iowa Linux Users Group meeting on July 17, 2019 about using Jupyter Notebook on a Raspberry Pi. The presentation covered installing Docker on a Raspberry Pi 3B+, building a Docker image with Jupyter Notebook and related Python packages, and briefly demonstrating Jupyter Notebook within the Docker container. The speaker was Andrew Denner, a senior software developer and president of the user group.

Technology

WELCOME TO LUG
• We meet third Wednesday of the
month
• Connect with us at www.cialug.org
• Mailing list
• Slack/IRC
• Call a shotgun event?

JUPYTER NOTEBOOK FOR PI
AND PROFIT
ANDREW DENNER
JULY 17, 2019
CENTRAL IOWA LINUX USERS GROUP

A LITTLE ABOUT ME
• Senior Software Developer by
day, Tinker by night with linux
• Not just a member, but also the
president!
• Twitter: @adenner
• Slides will be posted to
https://denner.co later tonight

TECH STACK FOR TODAY
• Raspberry Pi 3+ Running Rasberian pi
• Docker
• Jupyter Notebook
• Python

CONSIDERATIONS
Remember this is not production code, but just a
demo
We have limited resources on the pi (disk
memory etc) this is not for “big data”
Since this is in docker it is easy to blow it away
and start over again
Pi is an arm so not all packages will work

A BRIEF HISTORY OF JUPYTER
Guido Van Rossum… (maybe a bit
too early)
Late 1980s
Iron Python started by Fernando
Pérez
2001
Robert Kern and Fernando Pérez
working on a notebook system
(didn’t really work) but work on
Iron Python continued
2005
tried again was far more successful
won bunch of awards
2007
Spun off as project Jupyter
2014

WHAT IS A NOTEBOOK
Pérez and Kern were
inspired by Sage
Notebook (based on
layout google’s notebook)
Avid users of Mathmatica
notebooks that date back
to 1988 designed by
Theodore Gray
Notebooks were a ui that
contained text and
calculations and could be
shared
Revolution was the use of
“AJAX” and web

FIRST LET’S INSTALL DOCKER
• curl -fsSL https://get.docker.com -o get-docker.sh
• sh get-docker.sh
• Watch install https://asciinema.org/a/vhCu8XKgeq3fMjuqnzWVaeeWl
• Start Docker and add user to docker groups
https://asciinema.org/a/LH6kK9mfeFNPH8WXTXiPeigXe

DOCKER
• Normally just use the prebuilt images
• Doesn’t exist for pi / ARM
• This will take a bit to install
•
https://asciinema.org/a/aplhAVYTf42w9
iVOkdWN9pymH
FROM debian:latest
RUN apt-get update; apt-get install -y
python3-dev python3-pip ttf-bitstream-
vera python-seaborn python-pandas;
pip3 install --upgrade pip; pip3 install
jupyter
RUN ipython3 kernelspec install-self
CMD jupyter notebook --ip=0.0.0.0 --
port=8080 --allow-root

Git is the new gold standard when it comes to versioning in the Web age. Git is an open source, distributed version control system designed to handle everything from small to very large projects with speed and efficiency. Version control should always be used when doing software development and most open source projects use version control and there is no exception for Wakanda applications. In this session we give an introduction to Git, we explain how to use it with Wakanda, the process of creating and cloning repositories, as well as working with branches in a distributed team environment, and finally dealing with merging source code with your team members.

Introduction to Version Control with GIT

ismet özöztürk

This document provides an overview of a Git workshop. It introduces version control systems and Git, explains the typical Git workflow including cloning a repository, making changes, staging and committing work, and pushing changes to a remote repository. It also covers configuring Git, branching to work on experimental changes, and merging branches. The workshop is intended to teach participants the basics of using Git and collaborating through a remote Git repository hosted on GitHub.

Workshop For pycon13

Steven Pousty

This document provides an agenda and overview for an OpenShift workshop on Python development. The workshop will introduce OpenShift and demonstrate how to create Python applications using the OpenShift platform-as-a-service. Attendees will learn to create applications from the command line and web console, add databases like MongoDB, and use tools like Git for version control. The document outlines assumptions about attendees' experience and what will be covered, including supported technologies, available resources, and terminology for the workshop.

AGES Presentation on Web, Python, Django and GeoServer

Ng'eno Victor

Ubuntu 17.10

Maki Turki

Openshift GeoSpatial Capabilities

Steven Pousty

This document discusses using the OpenShift Platform as a Service (PaaS) for geospatial applications. It provides an overview of OpenShift and demonstrates how to deploy PostGIS and MongoDB for geospatial data storage and GeoServer for serving maps on OpenShift. The presentation assumes basic command line and geospatial knowledge and shows how OpenShift allows developers to write code and apps without managing servers.

Script for the geomeetup presentation

Steven Pousty

1. The document provides instructions for setting up applications on OpenShift including creating domains, applications, adding cartridges for databases like Postgresql and MongoDB, and loading spatial data. 2. Steps are outlined for setting up a Java application called GeoServer with Postgresql and spatial data, and a Python application called Parks using MongoDB to store spatial JSON data. 3. Finally it describes deploying a modified GeoServer WAR file on OpenShift to serve spatial layers from the Postgresql data.

Docker on the Raspberry Pi by Dieter Reuter (Hypriot)

Docker, Inc.

Docker can run on resource-constrained devices like the Raspberry Pi, allowing lightweight virtualization for IoT applications. During a live demo, over 250 Docker containers were launched on a Raspberry Pi in under 7 minutes, showing Docker's ability to scale down to minimal hardware resources. The presentation concluded with information on how to learn more about Docker on IoT devices from the speaker's blog and Twitter account.

This document summarizes Kazuki Morita's blog which he writes in both Japanese and English. It details his blog topics from September 2018 to March 2019 which include software engineering and programming. It also outlines the technologies used to build and deploy the blog such as Hugo, Markdown, Git, VPS and Jenkins. The blog aims to improve SEO and implement additional features such as PWA and MathJax equations.

How Openstack is Built

Anton Weiss

Openstack is one of the largest OSS projects today with hundreds of commits flowing in daily. This high rate of change requires an advanced CI infrastructure. The purpose of the talk is to provide an overview of this infrastructure, explaining the role of each tool and the pipelines along which changes have to travel before they find their way into the approved Openstack codebase. Talk delivered at Openstack Day Israel 2016 : http://www.openstack-israel.org/#!agenda/cjg9

OpenShift with Eclipse Tooling - EclipseCon 2012

Steven Pousty

This document provides an overview of the Eclipse tooling for OpenShift. It begins with an agenda and assumptions. It then defines Infrastructure as a Service, Platform as a Service, and Software as a Service. It highlights benefits of using a PaaS like OpenShift. Supported technologies are listed, including Java, JBoss Tools, Maven, and Jenkins. Steps are provided to get started, including signing up, installing plugins, creating a domain and applications. Demo steps are outlined. Command line tools are discussed. Creating an application in Eclipse is demonstrated.

Docker worshop @Twitter - How to use your own private registry

dotCloud

Mongo sf spatialmongo

Steven Pousty

RootedCON 2017 - Docker might not be your friend. Trojanizing Docker images

Daniel Garcia (a.k.a cr0hn)

The document discusses a talk titled "Docker might not be your friend - Trojanizing Docker like a Sir" given by Daniel García and Roberto Muñoz. The talk covers what Docker is, the Docker environment including components like Docker hosts, registries, and orchestrators. It also discusses continuous integration/continuous deployment cycles and how Docker fits into those processes. The slides provide definitions and diagrams to explain these concepts.

Spatial mongo for PHP and Zend

Steven Pousty

This document provides an overview of building geospatial applications with Zend, MongoDB, and OpenShift. It includes an agenda that covers loading spatial data into MongoDB, performing queries, and showing PHP code to access spatial data. The document also discusses assumptions, what OpenShift is, supported technologies, and concludes by stating spatial is easy and fun with MongoDB and PHP, and applications can now be built and deployed quickly on OpenShift without infrastructure management.

CIALUG May 2019 Meeting: An intro to docker and using rootless docker

Andrew Denner

The document summarizes a presentation given by Andrew Denner to the Central Iowa Linux Users Group about Docker and rootless Docker. It begins with welcome information about the meeting and introduces the presenter. Andrew Denner then gives a brief introduction to Docker, comparing it to shipping containers, and discusses the benefits of using Docker. He notes some limitations of running Docker as root and introduces the concept of rootless Docker as a more secure alternative, explaining how it works using user namespaces to simulate root access within containers run by non-root users.

Python + STIX = Awesome

stixproject

This document introduces python-stix, an open-source Python library for working with STIX (Structured Threat Information Expression) documents. It allows users to easily generate and parse STIX XML by mapping STIX objects to Python objects. The document provides examples of using python-stix to create a STIX package, add indicators and related objects, load and access data from an existing STIX file, and dereference relationships between objects.

Free Mongo on OpenShift

Steven Pousty

Mastering Docker on a Raspberry Pi

Team Hypriot

The document discusses running Docker containers on Raspberry Pi devices. It describes how the Hypriot team iteratively developed HypriotOS to make it easy to run Docker on ARM devices like Raspberry Pi through pre-built images. It aims to bring Docker and containers to Internet of Things applications by supporting low-powered boards. The talk covers the goals, approaches, concepts and current status of HypriotOS for enabling Docker containers on ARM and Raspberry Pi.

Embedr.eu & Omeka

IIIF_io

Why Open Cloud Platforms are important - OSCON 2013

Andy Piper

Dockerizing IoT Services

msyukor

Talk be secret like a ninja with Vault

Devoteam Revolve

This document summarizes a talk about using Vault for secrets management. The talk discusses how Vault works from both an operations and developer perspective. It outlines four steps to become a "ninja" with Vault: find secrets, put secrets in Vault, make secrets dynamic, and encrypt sensitive data. The talk demonstrates using Vault as a secret store and for encryption as a service. It encourages exploring additional integrations with Vault like using the Vault agent or integrating with Consul.

Build A Private Developer's Cloud Using TripleO

K Rain Leander

リバースプロキシでwebサーバを集約ついでにdocker化しよう

Yasunori Kuji

This document discusses using Docker and HAProxy to set up a load balanced web server infrastructure. It demonstrates configuring two Apache web servers behind a HAProxy load balancer on a single CentOS host. The Apache containers are placed on a Docker network and configured for round-robin load balancing through the HAProxy container's ports 80 and 8001/8002 redirecting to the Apache containers.

LUG - Install Fest 2008

Alessandro Manfredi

The document summarizes Install Fest 2008 hosted by LUG Roma Tre. It provides an overview of GNU/Linux and its history from the GNU project starting in 1984 to develop an open source operating system. It discusses the later addition of the Linux kernel in 1991 and growth in lines of code and users over the 1990s. The document also provides tips on installing Linux distributions like Ubuntu and drivers for hardware like Nvidia and ATI graphics cards.

Ditch Sandboxes for Docker

Travis Thieman

Jupyter Kernel: How to Speak in Another Language

Wey-Han Liaw

The document discusses how to create a Jupyter kernel. It explains that kernels use ZeroMQ sockets to communicate with clients via the Jupyter messaging protocol. Native kernels are implemented from scratch while wrapper kernels are built from an existing interpreter using Python. The document provides examples of existing kernels like IJulia and the Python ipykernel. It also outlines the steps to build a wrapper kernel and mentions several other kernel types.

Central Iowa Linux Users Group: August 2020 Jupyter Lab

Andrew Denner

Introduction to new technologies in drupal 8

naxoc

Symfony, Twig, Backbone, Guzzle. What are these things? A lot of new libraries and technologies have been added to Drupal 8. This session will go through the new libraries and provide a brief introduction to them by looking at some history, and the effects of including them in Drupal. This will be a high-level introduction - not a deep technical walkthrough. It is suitable for everyone, regardless of skill level, who is interested in the building blocks of Drupal 8.

What's hot

ブログ執筆を支える技術

kazuki morita

How Openstack is Built

Anton Weiss

OpenShift with Eclipse Tooling - EclipseCon 2012

Steven Pousty

Docker worshop @Twitter - How to use your own private registry

dotCloud

Mongo sf spatialmongo

Steven Pousty

RootedCON 2017 - Docker might not be your friend. Trojanizing Docker images

Daniel Garcia (a.k.a cr0hn)

Spatial mongo for PHP and Zend

Steven Pousty

CIALUG May 2019 Meeting: An intro to docker and using rootless docker

Andrew Denner

Python + STIX = Awesome

stixproject

Free Mongo on OpenShift

Steven Pousty

Mastering Docker on a Raspberry Pi

Team Hypriot

Embedr.eu & Omeka

IIIF_io

Why Open Cloud Platforms are important - OSCON 2013

Andy Piper

Dockerizing IoT Services

msyukor

Talk be secret like a ninja with Vault

Devoteam Revolve

Build A Private Developer's Cloud Using TripleO

K Rain Leander

リバースプロキシでwebサーバを集約ついでにdocker化しよう

Yasunori Kuji

LUG - Install Fest 2008

Alessandro Manfredi

Ditch Sandboxes for Docker

Travis Thieman

Jupyter Kernel: How to Speak in Another Language

Wey-Han Liaw

What's hot (20)

ブログ執筆を支える技術

How Openstack is Built

OpenShift with Eclipse Tooling - EclipseCon 2012

Docker worshop @Twitter - How to use your own private registry

Mongo sf spatialmongo

RootedCON 2017 - Docker might not be your friend. Trojanizing Docker images

Spatial mongo for PHP and Zend

CIALUG May 2019 Meeting: An intro to docker and using rootless docker

Python + STIX = Awesome

Free Mongo on OpenShift

Mastering Docker on a Raspberry Pi

Embedr.eu & Omeka

Why Open Cloud Platforms are important - OSCON 2013

Dockerizing IoT Services

Talk be secret like a ninja with Vault

Build A Private Developer's Cloud Using TripleO

リバースプロキシでwebサーバを集約ついでにdocker化しよう

LUG - Install Fest 2008

Ditch Sandboxes for Docker

Jupyter Kernel: How to Speak in Another Language

Similar to Central Iowa Linux Users group July 2019--Jupyter Notebook on a Raspberry Pi

Central Iowa Linux Users Group: August 2020 Jupyter Lab

Andrew Denner

Introduction to new technologies in drupal 8

naxoc

A Jupyter kernel for Scala and Apache Spark.pdf

Luciano Resende

Many data scientists are already making heavy usage of the Jupyter ecosystem for analyzing data using interactive notebooks. Apache Toree (incubating) is a Jupyter kernel designed that enables data scientists and data engineers to easily connect and leverage Apache Spark and its powerful APIs from a standard Jupyter notebook to execute their analytics workloads. In this talk, we will go over what's new with the most recent Apache Toree release. We will cover available magics and visualizations extensions that can be integrated with Toree to enable better data exploration and data visualizations. We will also describe some high-level designs of Toree and how users can extend the functionality of Apache Toree powerful plugin system. And all of these with multiple live demos that demonstrate how Toree can help with your analytics workloads in an Apache Spark environment.

Unikernel User Summit 2015: Getting started in unikernels using the rump kernel

The Linux Foundation

IoT: LoRa and Java on the PI

JWORKS powered by Ordina

Docker 2014

Open Networking Perú (Opennetsoft)

This document introduces Docker containers and provides examples of using Docker for networking containers across virtual machines. It discusses setting up a GRE tunnel between two VMs to connect their Docker interfaces and allow containers running on different VMs to communicate. Specific commands are provided to configure the Docker and overlay networks on each VM, establish the GRE tunnel, and run a sample container to test the connectivity.

Creating basic workflows as Jupyter Notebooks to use Cytoscape programmatically.

Hakky St

This document discusses creating reusable workflows in Jupyter Notebooks to programmatically use the Cytoscape network analysis software. The goals are to provide a stable environment for network analysis using cyREST (Python and R wrappers for Cytoscape) and Docker, and to create reusable workflows in Jupyter Notebooks. Key points include quickly setting up an analysis environment using Docker, automating typical tasks with cyREST rather than doing them manually, and sharing reusable code in Jupyter Notebooks.

Making the big data ecosystem work together with Python & Apache Arrow, Apach...

Holden Karau

Making the big data ecosystem work together with python apache arrow, spark,...

Holden Karau

The document discusses the current state of the big data ecosystem and how tools interact across different programming languages and environments. It focuses on Python tools like Dask, Spark, Beam, and Kafka and how they can communicate with systems built on the Java Virtual Machine like Spark. It notes that there is often unnecessary data copying between systems due to differences in languages and environments. Emerging technologies like Apache Arrow aim to allow more direct data sharing to improve performance. The document advocates for continued work to better integrate Python tools into the larger big data ecosystem.

GNOME 3.4 accessible: Status, news, future (FOSDEM 2012)

Igalia

By Alejandro Piñeiro Iglesias. In GNOME, accessibility is a core value that touches all aspects of the system. [1] From the infrastructure, to the graphical toolkit, to the applications, to the assistive technologies, accessibility has been a central consideration from the very early days. On April 2011 GNOME 3.0 was released, and although GNOME and the accessibility made a huge effort, the accessibility support was not ideal. But not are bad news. Finally the accessibility technologies are starting to be used from the two main free desktops. AT-SPI is starting to be used on KDE distros, and Orca is starting to be functional with Qt apps. Since GNOME 3.0 a big effort was done in order to improve the situation. At the moment of this proposal writing an ATK/AT-SPI2 hackfest is being organized, in order to fix the issues from the framework itself. The purpose of this presentation is explaining: * Introduce accessibility on GNOME. * Briefly explain the status towards GNOME 3.4 * Summarize the output of the ATK/AT-SPI2 hackfest * Compare GNOME 3.0 vs GNOME 3.4 * KDE status and cooperation * Future [1] http://library.gnome.org/devel/accessibility-devel-guide/nightly/gad-how-it-works.html.en

Docker - 15 great Tutorials

Julien Barbier

This document lists 15 tutorials about Docker, an open-source containerization platform. The tutorials cover topics such as installing Docker on various platforms like Ubuntu, Linux, Rackspace, and Digital Ocean; deploying applications like Java, Django, Drupal, and Redis using Docker containers; and using Docker to build services and applications. The tutorials are from 2013 and provide links to blog posts and resources about getting started with Docker.

What is octohost?

Darron Froese

This document discusses Octohost, a micro-Heroku inspired platform as a service (PaaS) that allows users to easily deploy web applications using Docker containers. It aims to provide a more efficient and flexible alternative to Heroku for hosting small sites. The key aspects are that Octohost uses Docker images and containers to deploy applications without dependency or version issues. Users can deploy their code by pushing to Git and configuring a Dockerfile to specify the build process.

Consuming Cinder from Docker

Tesora

This document provides a summary of a presentation about using Docker volume plugins with OpenStack Cinder block storage. The presentation discusses: 1. The speaker introducing themselves and their background with OpenStack Cinder. 2. An overview of the Docker volume plugin API and how the speaker created a Cinder volume plugin in Golang to provide block storage to Docker containers. 3. A demonstration of deploying a sample web application on a Docker Swarm cluster using the Cinder volume plugin to persist Redis data, showing how storage can be provided to containers across nodes.

From Docker Swarm to OCCS and Wercker: Live-hacking at Oracle CODE Mexico 2017

Frank Munz

Introduction to Docker (and a bit more) at LSPE meetup Sunnyvale

Jérôme Petazzoni

Everyone wants (someone else) to do it: writing documentation for open source...

Jody Garnett

Raspberry pi overview

Matthew Karas

This document provides an overview and introduction to the Raspberry Pi. It discusses the origins of the Raspberry Pi in aiming to provide affordable computers to help stimulate interest in computer science education. It outlines key events in the development of the Raspberry Pi and describes its low cost and performance compared to earlier computers. The document then provides basic getting started information for setting up and using a Raspberry Pi including updating software, setting passwords, and connecting to hardware. It also discusses some popular project examples and suggests when to use a Raspberry Pi versus an Arduino.

An Incomplete Data Tools Landscape for Hackers in 2015

Wes McKinney

Wes McKinney gives an overview of the current data analysis tools landscape in Python and R. He discusses essential Python packages like NumPy, pandas, and scikit-learn. For R, he covers packages in the "Hadley stack" like dplyr and ggplot2. IPython/Jupyter notebooks are also mentioned as a platform for interactive data analysis across languages. The talk aims to highlight trends, opportunities, and challenges in the open source data science tool ecosystem.

Arduino for developers by Steve Robinson

SPRITLE SOFTWARE PRIVATE LIMIT ED

The document introduces Arduino, an open-source electronics prototyping platform. It discusses that Arduino allows simple interfacing and programming of a microcontroller board. The agenda includes an introduction, history, sample demos, and a question period. It describes how Arduino can be used for physical computing by sensing the physical world and building mechanical systems. Key features that make Arduino stand out are its low cost, cross-platform capability, simple programming environment, and open-source software and hardware. Sample demos are provided to get hands-on experience using Arduino's IDE to write and upload code to make an LED blink or create music. Controlling Arduino with Node.js is also demonstrated.

APACHE TOREE: A JUPYTER KERNEL FOR SPARK by Marius van Niekerk

Spark Summit

Many data scientists are already making heavy usage of the Jupyter ecosystem for analyzing data using interactive notebooks. Apache Toree (incubating) is a Jupyter kernel designed to act as a gateway to Spark by enabling users Spark from standard Jupyter notebooks. This allows users to easily integrate Spark into their existing Jupyter deployments, This allows users to easily move between languages and contexts without needing to switch to a different set of tools. Apache Toree is designed expressly for interactive work. It supports interpreters in Scala, Python, and R. In this talk, I will cover the design of Toree, how it interacts with the Jupyter ecosystem and various ways in which users can extend the functionality of Apache Toree via a powerful plugin system.

Similar to Central Iowa Linux Users group July 2019--Jupyter Notebook on a Raspberry Pi (20)

Central Iowa Linux Users Group: August 2020 Jupyter Lab

Introduction to new technologies in drupal 8

A Jupyter kernel for Scala and Apache Spark.pdf

Unikernel User Summit 2015: Getting started in unikernels using the rump kernel

IoT: LoRa and Java on the PI

Docker 2014

Creating basic workflows as Jupyter Notebooks to use Cytoscape programmatically.

Making the big data ecosystem work together with Python & Apache Arrow, Apach...

Making the big data ecosystem work together with python apache arrow, spark,...

GNOME 3.4 accessible: Status, news, future (FOSDEM 2012)

Docker - 15 great Tutorials

What is octohost?

Consuming Cinder from Docker

From Docker Swarm to OCCS and Wercker: Live-hacking at Oracle CODE Mexico 2017

Introduction to Docker (and a bit more) at LSPE meetup Sunnyvale

Everyone wants (someone else) to do it: writing documentation for open source...

Raspberry pi overview

An Incomplete Data Tools Landscape for Hackers in 2015

Arduino for developers by Steve Robinson

APACHE TOREE: A JUPYTER KERNEL FOR SPARK by Marius van Niekerk

More from Andrew Denner

All about Time, or how to stop from going back to the future

Andrew Denner

This document discusses network time protocol (NTP) and how to synchronize computer clocks over a network. It explains that NTP was developed in 1985 to keep clocks accurate on networked devices. NTP works by synchronizing client clocks to server clocks via the network. Servers get their time from stratum 0 sources like atomic clocks and GPS. The document recommends configuring clients to sync to public NTP pool servers or a local server by editing /etc/ntp.conf to list the server addresses. More information on NTP and setting it up is provided.

CIALUG October 2022 linux news

Andrew Denner

This document provides information about an upcoming Linux Users Group meeting and various recent Linux news items. It announces that the LUG meeting will be held in a hybrid format on the third Wednesday of the month. It also lists several recent Linux-related news stories, including the release of CBL Mariner 2.0, Rust being added to the Linux kernel, PyTorch becoming a Linux Foundation project, and systemd being added to WSL.

January 2022: Central Iowa Linux Users Group: Git

Andrew Denner

This document provides an overview of the history and features of Git version control software. It discusses earlier version control systems like SCCS and CVS, and how Git was created in 2005 by Linus Torvalds with goals of speed, data integrity, and supporting distributed non-linear workflows. The document outlines some key features of Git like distributed versioning and atomic commits, as well as potential downsides like dealing with large binary files. It also briefly introduces Git LFS as an extension for managing large files outside of the main Git repository.

Cialug August 2021

Andrew Denner

This document summarizes Andrew Denner's presentation about migrating his blog from a WordPress/LAMP stack hosted on a VM to a static site generated with Jekyll and hosted on GitLab Pages. It discusses the pros and cons of each approach, including how the new static site will have a smaller attack surface and be easier to version control but lose dynamic features. It also provides demonstrations of using Markdown, Liquid templates, and Podman to build and serve the static site locally before deployment.

Local Kubernetes for Dummies: STLLUG March 2021

Andrew Denner

Andrew Denner gives an introduction to moving from Docker to Kubernetes. He discusses drawbacks of Docker like lack of orchestration and networking headaches. Kubernetes provides orchestration, service discovery, storage orchestration, self-healing and more. It is not a drop-in replacement for Docker and does not include deployment or middleware. Key Kubernetes concepts include clusters, controllers, manifests, pods, volumes and workloads. Easier options for learning Kubernetes include Minikube, K3s and Helm.

December 2020 CIALUG: Local Kubernetes for Dummies-So you want to move on fro...

Andrew Denner

St Louis Linux Users Group Wireguard (for Fun and Networking)

Andrew Denner

This document discusses different VPN protocols and presents Wireguard as a new option. It provides an overview of older protocols like PPTP and OpenVPN, noting their security weaknesses. The document then introduces Wireguard as very fast with low overhead, using standardized encryption algorithms and having no known major vulnerabilities. It demonstrates how to install and set up Wireguard on different platforms like the Raspberry Pi, Ubuntu, MacOS, and Android to securely connect networks.

Central Iowa Linux Users Group June 2020 Meeting Apache Guacamole

Andrew Denner

The document welcomes attendees to the Central Iowa Linux Users Group (CIALUG) meeting for June 2020. It provides information on the group's monthly meetings on the third Wednesday, website, mailing list, and Slack/IRC channels. The document also lists topics for the meeting including news about Apache and Guacamole remote desktop software, with links provided for Guacamole configuration and Docker setups. Speakers for the meeting are listed as Kyle Hamilton and Andrew Denner.

A brief intro to Ansible-CIALUG March 2020

Andrew Denner

- The document introduces Ansible, an automation tool for server provisioning, configuration, and management that allows organizing servers into groups and describing how those groups should be configured from a central location. - Key Ansible concepts are introduced including control nodes, managed nodes, inventory files, modules, tasks, and playbooks which are like todo lists that use modules to achieve tasks. - A brief demo is shown of using Ansible with a control node, two managed nodes, and a Docker Compose host for sharing files.

Central Iowa Linux Users Group May 2020 Meeting: WireGuard

Andrew Denner

This document summarizes a presentation about the Wireguard VPN protocol given to the Central Iowa Linux Users Group. It begins with introductions and background about the presenter and organization. The bulk of the document discusses and compares existing VPN protocols like PPTP, OpenVPN, and IPSec and their security issues. It focuses on introducing Wireguard as a newer, more lightweight VPN protocol that uses standardized encryption and has no known vulnerabilities. It concludes with demos of installing Wireguard on Ubuntu, MacOS, and Android.

Central Iowa Linux Users Group-December 2019: Windows Managers

Andrew Denner

This document provides information about a Linux users group meeting, including summaries of several desktop environments that were discussed. The meeting covered setting up a Raspberry Pi 4 with Manjaro Linux, and then discussed popular desktop environments like KDE Plasma, GNOME, Budgie, Cinnamon, MATE, Enlightenment, LXDE, LXQt, Xfce, Sugar, and Deepin. Unfortunately Window Maker was not able to be demonstrated as it does not build for ARM. The document also mentions a user submitted section on desktops.

Central Iowa Linux Users Group: November Meeting -- Container showdown

Andrew Denner

This document summarizes an upcoming meeting of the Central Iowa Linux Users Group (CIALUG) that will feature a presentation on Linux containers. The presentation will provide a brief history of containers from early chroot-based implementations to modern Docker and Kubernetes containers. It will also demo and compare various container technologies like Docker, LXC, Podman, Buildah, and Kubernetes.

Central Iowa Linux Users Group October Meeting: Centos 8

Andrew Denner

This document summarizes a presentation about CentOS 8 and alternatives to Docker like Podman and Buildah. It discusses what CentOS is, key changes in CentOS 8 like using DNF and Python 3.6 by default. It also covers how long support lasts for CentOS 6, 7, and 8. Alternatives to Docker like Podman and Buildah are presented as being more secure since they don't require running a daemon process as root. Demo videos are linked showing how to install Podman and pull a Docker image. Risks of upgrading from CentOS 7 to 8 are discussed.

Intro to networking

Andrew Denner

This document provides a brief introduction to networking and the Internet. It discusses the history of networks from early packet networks in the 1950s to the development of the ARPANET and the birth of the Internet in the 1980s and 1990s. The presentation also introduces some key networking concepts like MAC addresses, IP addresses, DNS, network devices like hubs, switches and routers, and firewalls. It provides an overview of private IP addressing and mentions some common troubleshooting tools like Wireshark.

A Brief overview of Linux, or How I learned to stop worrying and love the pen...

Andrew Denner

August CIALUG meeting: Debian buster

Andrew Denner

Debian Buster was released on July 6, 2019 as the latest stable version, codenamed Debian 10. It replaces Debian Stretch and includes updates to major components like Gnome 3.30, Linux kernel 4.19, OpenJDK 11, and Python 3 as the default version. Some changes include switching to NFtables for firewall rules, improved ARM and SBC support, and Wayland as the default display server. The /usr directory merger and Bash 5.0 update are also covered.

CIALUG June 2019: Raspberry Pi Facial Recognition

Andrew Denner

July 18, 2018 Central Iowa Linux User's Group: Tor onion services

Andrew Denner

CIALUG: Encrypt all the things

Andrew Denner

Apache nifi

Andrew Denner

The document summarizes Apache NiFi, a software tool for automating the flow of data between systems. It was originally developed by the NSA in 2014 to address shortcomings in security, interactivity, scalability, and data lineage/provenance of existing solutions. NiFi uses a flow-based programming model where data flows between processing components via predefined connections. It has a web-based user interface and is designed to be highly configurable, loss tolerant, low latency, dynamically prioritized, and able to modify flows at runtime. Key features include data provenance tracking, extension capabilities, and security. Resources listed at the end provide more information on NiFi and flow-based programming.

More from Andrew Denner (20)

All about Time, or how to stop from going back to the future

CIALUG October 2022 linux news

January 2022: Central Iowa Linux Users Group: Git

Cialug August 2021

Local Kubernetes for Dummies: STLLUG March 2021

December 2020 CIALUG: Local Kubernetes for Dummies-So you want to move on fro...

St Louis Linux Users Group Wireguard (for Fun and Networking)

Central Iowa Linux Users Group June 2020 Meeting Apache Guacamole

A brief intro to Ansible-CIALUG March 2020

Central Iowa Linux Users Group May 2020 Meeting: WireGuard

Central Iowa Linux Users Group-December 2019: Windows Managers

Central Iowa Linux Users Group: November Meeting -- Container showdown

Central Iowa Linux Users Group October Meeting: Centos 8

Intro to networking

A Brief overview of Linux, or How I learned to stop worrying and love the pen...

August CIALUG meeting: Debian buster

CIALUG June 2019: Raspberry Pi Facial Recognition

July 18, 2018 Central Iowa Linux User's Group: Tor onion services

CIALUG: Encrypt all the things

Apache nifi

Recently uploaded

20240605 QFM017 Machine Intelligence Reading List May 2024

Matthew Sinclair

Essentials of Automations: The Art of Triggers and Actions in FME

Safe Software

In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation. We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios. Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!

Data structures and Algorithms in Python.pdf

TIPNGVN2

How to Get CNIC Information System with Paksim Ga.pptx

danishmna97

GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024

Neo4j

Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...

Zilliz

Full-RAG: A modern architecture for hyper-personalization

Zilliz

Mike Del Balso, CEO & Co-Founder at Tecton, presents "Full RAG," a novel approach to AI recommendation systems, aiming to push beyond the limitations of traditional models through a deep integration of contextual insights and real-time data, leveraging the Retrieval-Augmented Generation architecture. This talk will outline Full RAG's potential to significantly enhance personalization, address engineering challenges such as data management and model training, and introduce data enrichment with reranking as a key solution. Attendees will gain crucial insights into the importance of hyperpersonalization in AI, the capabilities of Full RAG for advanced personalization, and strategies for managing complex data integrations for deploying cutting-edge AI solutions.

Communications Mining Series - Zero to Hero - Session 1

DianaGray10

This session provides introduction to UiPath Communication Mining, importance and platform overview. You will acquire a good understand of the phases in Communication Mining as we go over the platform with you. Topics covered: • Communication Mining Overview • Why is it important? • How can it help today’s business and the benefits • Phases in Communication Mining • Demo on Platform overview • Q/A

Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!

SOFTTECHHUB

As the digital landscape continually evolves, operating systems play a critical role in shaping user experiences and productivity. The launch of Nitrux Linux 3.5.0 marks a significant milestone, offering a robust alternative to traditional systems such as Windows 11. This article delves into the essence of Nitrux Linux 3.5.0, exploring its unique features, advantages, and how it stands as a compelling choice for both casual users and tech enthusiasts.

Microsoft - Power Platform_G.Aspiotis.pdf

Uni Systems S.M.S.A.

Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf

Malak Abu Hammad

Discover how MongoDB Atlas and vector search technology can revolutionize your application's search capabilities. This comprehensive presentation covers: * What is Vector Search? * Importance and benefits of vector search * Practical use cases across various industries * Step-by-step implementation guide * Live demos with code snippets * Enhancing LLM capabilities with vector search * Best practices and optimization strategies Perfect for developers, AI enthusiasts, and tech leaders. Learn how to leverage MongoDB Atlas to deliver highly relevant, context-aware search results, transforming your data retrieval process. Stay ahead in tech innovation and maximize the potential of your applications. #MongoDB #VectorSearch #AI #SemanticSearch #TechInnovation #DataScience #LLM #MachineLearning #SearchTechnology

Building RAG with self-deployed Milvus vector database and Snowpark Container...

Zilliz

Introduction to CHERI technology - Cybersecurity

mikeeftimakis1

みなさんこんにちはこれ何文字まで入るの？40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの？えこ...

名前です男

20240609 QFM020 Irresponsible AI Reading List May 2024

Matthew Sinclair

GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...

Neo4j

Dr. Sean Tan, Head of Data Science, Changi Airport Group Discover how Changi Airport Group (CAG) leverages graph technologies and generative AI to revolutionize their search capabilities. This session delves into the unique search needs of CAG’s diverse passengers and customers, showcasing how graph data structures enhance the accuracy and relevance of AI-generated search results, mitigating the risk of “hallucinations” and improving the overall customer journey.

Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack

shyamraj55

Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI

Vladimir Iglovikov, Ph.D.

Presented by Vladimir Iglovikov: - https://www.linkedin.com/in/iglovikov/ - https://x.com/viglovikov - https://www.instagram.com/ternaus/ This presentation delves into the journey of Albumentations.ai, a highly successful open-source library for data augmentation. Created out of a necessity for superior performance in Kaggle competitions, Albumentations has grown to become a widely used tool among data scientists and machine learning practitioners. This case study covers various aspects, including: People: The contributors and community that have supported Albumentations. Metrics: The success indicators such as downloads, daily active users, GitHub stars, and financial contributions. Challenges: The hurdles in monetizing open-source projects and measuring user engagement. Development Practices: Best practices for creating, maintaining, and scaling open-source libraries, including code hygiene, CI/CD, and fast iteration. Community Building: Strategies for making adoption easy, iterating quickly, and fostering a vibrant, engaged community. Marketing: Both online and offline marketing tactics, focusing on real, impactful interactions and collaborations. Mental Health: Maintaining balance and not feeling pressured by user demands. Key insights include the importance of automation, making the adoption process seamless, and leveraging offline interactions for marketing. The presentation also emphasizes the need for continuous small improvements and building a friendly, inclusive community that contributes to the project's growth. Vladimir Iglovikov brings his extensive experience as a Kaggle Grandmaster, ex-Staff ML Engineer at Lyft, sharing valuable lessons and practical advice for anyone looking to enhance the adoption of their open-source projects. Explore more about Albumentations and join the community at: GitHub: https://github.com/albumentations-team/albumentations Website: https://albumentations.ai/ LinkedIn: https://www.linkedin.com/company/100504475 Twitter: https://x.com/albumentations

Pushing the limits of ePRTC: 100ns holdover for 100 days

Adtran

Removing Uninteresting Bytes in Software Fuzzing

Aftab Hussain

Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process. In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds. - These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.

Recently uploaded (20)

20240605 QFM017 Machine Intelligence Reading List May 2024

Essentials of Automations: The Art of Triggers and Actions in FME

Data structures and Algorithms in Python.pdf

How to Get CNIC Information System with Paksim Ga.pptx

GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024

Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...

Full-RAG: A modern architecture for hyper-personalization

Communications Mining Series - Zero to Hero - Session 1

Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!

Microsoft - Power Platform_G.Aspiotis.pdf

Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf

Building RAG with self-deployed Milvus vector database and Snowpark Container...

Introduction to CHERI technology - Cybersecurity

20240609 QFM020 Irresponsible AI Reading List May 2024

GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...

Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack

Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI

Pushing the limits of ePRTC: 100ns holdover for 100 days

Removing Uninteresting Bytes in Software Fuzzing

Central Iowa Linux Users group July 2019--Jupyter Notebook on a Raspberry Pi

1. WELCOME TO LUG

2. WELCOME TO LUG • We meet third Wednesday of the month • Connect with us at www.cialug.org • Mailing list • Slack/IRC • Call a shotgun event?

3. (to give a presentation)

4. LINUX NEWS

5. NOW FOR OUR FEATURED PRESENTATION…

6. JUPYTER NOTEBOOK FOR PI AND PROFIT ANDREW DENNER JULY 17, 2019 CENTRAL IOWA LINUX USERS GROUP

7. A LITTLE ABOUT ME • Senior Software Developer by day, Tinker by night with linux • Not just a member, but also the president! • Twitter: @adenner • Slides will be posted to https://denner.co later tonight

8. TECH STACK FOR TODAY • Raspberry Pi 3+ Running Rasberian pi • Docker • Jupyter Notebook • Python

9. CONSIDERATIONS Remember this is not production code, but just a demo We have limited resources on the pi (disk memory etc) this is not for “big data” Since this is in docker it is easy to blow it away and start over again Pi is an arm so not all packages will work

10. A BRIEF HISTORY OF JUPYTER Guido Van Rossum… (maybe a bit too early) Late 1980s Iron Python started by Fernando Pérez 2001 Robert Kern and Fernando Pérez working on a notebook system (didn’t really work) but work on Iron Python continued 2005 tried again was far more successful won bunch of awards 2007 Spun off as project Jupyter 2014

11. WHAT IS A NOTEBOOK Pérez and Kern were inspired by Sage Notebook (based on layout google’s notebook) Avid users of Mathmatica notebooks that date back to 1988 designed by Theodore Gray Notebooks were a ui that contained text and calculations and could be shared Revolution was the use of “AJAX” and web

12. FIRST LET’S INSTALL DOCKER • curl -fsSL https://get.docker.com -o get-docker.sh • sh get-docker.sh • Watch install https://asciinema.org/a/vhCu8XKgeq3fMjuqnzWVaeeWl • Start Docker and add user to docker groups https://asciinema.org/a/LH6kK9mfeFNPH8WXTXiPeigXe

13. DOCKER • Normally just use the prebuilt images • Doesn’t exist for pi / ARM • This will take a bit to install • https://asciinema.org/a/aplhAVYTf42w9 iVOkdWN9pymH FROM debian:latest RUN apt-get update; apt-get install -y python3-dev python3-pip ttf-bitstream- vera python-seaborn python-pandas; pip3 install --upgrade pip; pip3 install jupyter RUN ipython3 kernelspec install-self CMD jupyter notebook --ip=0.0.0.0 -- port=8080 --allow-root

14.

15. DEMO TIME!

Central Iowa Linux Users group July 2019--Jupyter Notebook on a Raspberry Pi

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Central Iowa Linux Users group July 2019--Jupyter Notebook on a Raspberry Pi

Similar to Central Iowa Linux Users group July 2019--Jupyter Notebook on a Raspberry Pi (20)

More from Andrew Denner

More from Andrew Denner (20)

Recently uploaded

Recently uploaded (20)

Central Iowa Linux Users group July 2019--Jupyter Notebook on a Raspberry Pi