Modern Software Development

©2016 IKERLAN. All rights reserved©2016 IKERLAN. All rights reserved
Ikerlan – Modern Software
Development
Ángel Conde– [DevOps & Data Engineer]
2016/4/4

©2016 IKERLAN. All rights reserved 2
Outline
1. Environment – Software tools
2. Architecture – Cloud based software
3. Ops – Coded Infrastructure
4. Deployment – Into the Continuous I/D wheel

Git
Why another Version Control System?
1. Fast
2. Decentralized
3. Branch management made easy.
4. Everyone is using it!

Git – Branch flow
A branch for each different feature.
Use tags for identification.
Merge / Rebase concepts.

Git – Basic Example
git clone git@github.com:foo/bar.git
cd bar
touch something
git add something
git commit -a -m "foo"
git push
User A:
User B:
git pull
echo “blah blah” | tee --append something
git commit –a –m “added something”
git push

GitHub – Social VCS
Issues / Releases / Milestones.
Promotes collaboration between developers.
Pull request concept for Open Source projects.
Open Source alternative, .

Slack – Team communication
Write less emails.
Integration with 3rd party tools (GitHub, Trello).
Useful search functions.
Snippets, share your code.
Works everywhere.
Private channels.

Slack – Team communication

Trello – Project Management
Kanban system from Toyota.
Three main elements:
1. Boards: used to house a project.
2. Lists: organize your tasks into lists.
3. Cards: to-do items.
Cards can be moved between lists.

Trello – Project Management

Jenkins – CI Server
Automate your tests on each Push.
Hundreds of plugins.
Provides Continuous Delivery support.
Multiple languages support.
Distributed model  Master / Slaves.

Jenkins – Example

Jenkins – GitHub Integration

IDEs

Debugging and Profiling

Outline

Cloud based software
On Premise
On Cloud
Hybrid
PROVIDERS TYPES
IaaS
PaaS
SaaS
SERVICES

Cloud based software
Reduce infrastructure costs.
SaaS for further cost reduction.
Scalability  Elasticity.
High Availability.
Blue-Green deployments.
Microservices

Microservices
Very simple, focus on doing one thing well.
Each service can be built using the best tool.
Systems inherently loosely coupled.
Multiple teams can deliver independently.

Microservices

Microservices – Scaling

Microservices – High Availability
Design “stateless” apps.
Use different availability zones.
Load balancers serve to healthy instances.
Store sessions outside the apps (Redis).

Microservices – High Availability

Microservices – Service Discovery
Dynamically distributed architecture.
Is there at least one DB instance running?
At which IP?
On which port?

Microservices – Service Discovery

Microservices – Message Brokers
Kafka: LinkedIn’s message Broker
Influenced by transaction logs from the DB world.
High-throughput, low-latency.
Used by: Cisco, Netflix, Uber, PayPal, Spotify..
Topics & Partitions.

LOGS EVERYWHERE
1. DB storage engines.
2. DB replication
3. Distributed consensus, aka Zookeeper .
4. Kafka.

Byte Stream
In-memory
Blocking/backpressure
One-to-one (tee)
KAFKA UNIX PIPES
Messages
Durable
Buffering
Multi-subscriber

Beyond the VM´s – Docker
•Multiple isolated user space instances.
•On par with bare metal performance of servers.
• Solves  “Works on my machine” syndrome.
Docker: a container based virtualization system
App A App B
Libs
Guest OS
Libs
Guest OS
Hypervisor
Host OS
Server
App B
Docker Engine
Host OS
Server
App A
Libs LibsVMs Docker

Orchestration
Kubernetes: Google´s approach to container
orchestration.
Apache Mesos: Mesosphere approach´s,
promoted to Apache top level project.
Docker Swarm: Docker native clustering
orchestration system.

Outline

Infrastructure as a Code (IaC)
Automatize your infrastructure.
Keep your developers happy.
Launch VMs, configure OS and configure applications.
Software Defined Networks -- Microsoft platform.

©2016 IKERLAN. All rights reserved
Consul: service discovery and configuration.
Vagrant: portable work environments.
Terraform: build, change and version infrastructure.
Vault: centralized secret management.
38
Hashicorp Stack

Hashicorp Stack – Vagrant

Hashicorp Stack – Consul

Provisioning
Automatize your applications environment.
Install/configure platforms/software.

Ansible – Example

Outline

The Continuous wheel

Continuous Integration
Adopted first on Extreme Programming.
Remove the problem of finding later issues in the build
lifecycle.
Enforces disciple of frequent automated testing.
Immediate feedback on system-wide impact of local
changes.
Metrics reports focus developers on improve the code.

Continuous Delivery
Ensure that the software can be reliable released any
time.
Build, test and release software faster and frequently.
Accelerated time to market.
Building the right product (user feedback).
Productivity and efficiency.

Continuous Delivery

References
https://git-scm.com/book/es/v1
http://codeinthehole.com/writing/pull-requests-and-other-good-practices-for-
teams-using-github/
http://wpcurve.com/trello-for-project-management/
http://techblog.netflix.com/2016/03/how-we-build-code-at-netflix.html
http://developers.redhat.com/blog/2014/08/14/find-fix-memory-leaks-java-
application/
https://www.youtube.com/watch?v=YCC-CpTE2LU
http://www.tutorialspoint.com/jenkins/index.htm

References (II)
http://progrium.com/blog/2014/07/29/understanding-modern-service-
discovery-with-docker/
http://progrium.com/blog/2014/08/20/consul-service-discovery-with-docker/
https://github.com/ansible/ansible-examples
https://martin.kleppmann.com/2015/01/24/stream-processing-at-dev-
winter.html
https://www.digitalocean.com/community/tutorials/how-to-configure-consul-
in-a-production-environment-on-ubuntu-14-04

©2016 IKERLAN. All rights reserved
IKERLAN Polo Garaia
C/ Goiru , 9
20500 Arrasate-Mondragón
Tel.: 943 71 02 12
Fax: 943 79 69 44
IKERLAN Unidad de energía
Parque Tecnológico de Álava,
C/ Juan de la Cierva, 1
01510 Miñano
Tel.: 945 29 70 32
Fax: 943 79 69 44
www.ikerlan.es
ORONA IDeO - Innovation city
Pol. Industrial Galarreta,
Parcela 10.5, Edificio A3
20120 Hernani
Tel.: 945 29 70 32
Fax: 943 79 69 44
IKERLAN
Pº. J. Mª. Arizmendiarrieta, 2
20500 Arrasate-Mondragón
Tel.: 943 71 24 00
Fax: 943 79 69 44
Questions?
Email: aconde@ikerlan.es
Thanks for your attention:

Modern Software Development

More Related Content

What's hot

Similar to Modern Software Development

More from Angel Conde Manjon

Recently uploaded

Modern Software Development

Editor's Notes