Ground Control to Nomad Job Dispatch

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

⁄
Ground Control to
Nomad Job Dispatch
Michael Lange
@DingoEatingFuzz

https://github.com/ashleymcnamara/gophers/blob/master/Kubernetes_Gophers.png

“What is Nomad?”
–like, a lot of people

Yes No I don’t know

What is a parameterized job?
Welcome to the talk.

What is a job?
Welcome to the preface.

Standard Job Flow

Periodic Job Flow

Parameterized Job Flow
Meta Params: Small configuration strings/ids
Payload: Larger configuration blob.

Parameterized Job Flow
Meta Params: Query Params/GET
Payload: Request Body/POST

The Simplest Imaginable
Parameterized Job
DEMO

Our job file
Batch Job
Parameterized options
Simple bash command
CODE EDITOR
job "hi" {
datacenters = ["dc1"]
type = "batc...

Our job file
Batch Job
Parameterized options
Simple bash command
CODE EDITOR
job "hi" {
datacenters = ["dc1"]
type = "batc...

Our job file
Batch Job
Parameterized options
Simple bash command
CODE EDITOR
job "hi" {
datacenters = ["dc1"]
type = "batc...

Our job file
Batch Job
Parameterized options
Simple bash command
CODE EDITOR
job "hi" {
datacenters = ["dc1"]
type = "batc...

“Cool story, bro”
–you, probably

What if…
1. I have various datasets about the world
2. I want to make a choropleth*
3. I don’t know what map projection I ...

The tools we have available
▪ Meta params
▪ Payload

The tools we have available
▪ Meta params Good for specifying a projection
▪ Payload Good for attaching the dataset

16KiB
The maximum payload size for
a dispatched job.

Artifact
Stanza
A way of telling Nomad to
download files before
starting a task.
CODE EDITOR
task "map" {
# ...
artifact {...

Combine
Concepts
Parameterized meta
params can be
interpolated and will also
exist in the task env.
CODE EDITOR
parameteri...

Let’s Make Some Maps!
DEMO

A final note about
that demo…

¯_(ツ)_/¯

“Workflows, not technologies”
–Tao of HashiCorp

Exec Task
Driver
Get an isolated context for
your task. Run whatever
you want.
CODE EDITOR
task "map" {
driver = "exec"
ar...

Recap!
1. Nomad! It’s HashiCorp’s workload orchestrator
2. Parameterized jobs! A way of modeling batch jobs as a template
...

LEARN FORUMS
learn.hashicorp.com/nomad discuss.hashicorp.com/c/nomad

Thank you!
Source Code: https://github.com/DingoEatingFuzz/hashitalks-2020-map-dispatch

Share Slideshare

LinkedIn
Facebook
Twitter

Embed

Size (px)

Show related Slideshows at end

WordPress Shortcode

Link

Share
Email

2024 Trend Updates: What Really Wor... by Search Engine Jou... 1052471 views
Storytelling For The Web: Integrate... by Chiara Aliotta 967761 views
Artificial Intelligence, Data and C... by OECD Directorate ... 900577 views
How to Leverage AI to Boost Employe... by SocialHRCamp 380598 views
2024 State of Marketing Report – by... by Marius Sescu 215763 views
Everything You Need To Know About C... by Expeed Software 233752 views

View on Slideshare

1 of 37 Ad

View on Slideshare

1 of 37 Ad