All My Tests Are Passing, Now What?

All My Tests Are Passing Now What? Chris.Read@ThoughtWorks.com

Software has no value outside of production... • No matter how clean the code • No matter how clean the server room

...but most software is built to pass QA • Developers sometimes don’t even understand what production will look like • Conﬁguration reﬂects development environment

Where does our software need to run? • So where does code go after all your tests pass?

Developer Workstations • Often the sweet spot • High rate of change in all directions • Need to get up and running quickly

Continuous Integration • Unit testing • Functional testing • Integration testing • Stubbed • Mocked

Integration • Lots of endpoints (hopefully all of them) • Does my app play nice with others?

Performance • Scaling • Responsiveness • Does my app meet performance criteria?

Formal Acceptance • Sign off the stories...

Staging • Let’s practice deployment

Production • Yay! We’re live at last! All done...

Disaster Recovery • ... not done yet! • DR often has a few subtle differences

All these places need Conﬁguration

Different types of conﬁguration • Environments are different • Different owners • Different rates of change

Developer Centric • Spring Wiring • ORM Models • It’s actually code!

Environment Speciﬁc • Hostnames • Passwords • Connection Strings

Application Centric • Pool sizes • Memory sizes • Timeouts

Operator Centric • Logging • Alerting • Monitoring • Housekeeping

Conﬁg Management Maturity Model • How do people manage it now?

CMMM 0 • Don’t understand the distinction between conﬁguration and code • “Just edit stuff in production until it works”

CMMM I • Manual Installation • Manual Conﬁguration • Massive Release Notes • Slow • Error Prone

CMMM II • Hard Coded Conﬁguration • Build per environment • Conﬁguration in SCM with code • What’s tested is not what gets to production

CMMM III • Configuration in separate SCM • Automated configuration at deploy time • One package for all environments • Forked configuration - missing and/or deprecated entries

CMMM IV • LDAP/DNS/JNDI • Puppet/Chef/SMS • Focussed on machine level conﬁg, not app • Hard to administer • Hard for developers to view and use

CMMM V ? • Conﬁguration Repository • Cross Platform • Language Independent • Encrypt Sensitive Values

Summary • Conﬁguration is hard • Poor conﬁguration management impacts software quality • There’s a lot of room here to make things better...

Escape • http://code.google.com/ p/escservesconﬁg • Open Source • Apache2 Licensed • Let’s try make things better...

All My Tests Are Passing, Now What?

by Christopher Read on Oct 26, 2009

Accessibility

Categories

Tags

Upload Details

Usage Rights

1 Embed 3

Statistics

All My Tests Are Passing, Now What? — Presentation Transcript