Selenium in the enterprise what went right and what went wrong so far - selenium conf 2012 london

Selenium in the EnterpriseWhat went right, what went wrong (so far) Noah Sussman Selenium Conf 2012, London #SEConf • @noahsussman

Our mission is to empower people to change the waythe global economy works. We see a world in whichvery-very small businesses have much-much moresway in shaping the economy, local living economiesare thriving everywhere, and people value authorshipand provenance as much as price and convenience.We are bringing heart to commerce and making theworld more fair, more sustainable, and more fun.

Chad Dickerson Describes the History of Etsy

The story of how I became a Web hackerbegins with Willoughby Sharp. Pamela Seymour Smith

Clicking all these links is a waste of my time and it hurtsmy wrist. There has got to be some way to tell thecomputer to click everything, without my having tomove the mouse.

In 2006, Ben Strawbridge introduced me to Selenium.

Selenium Core was nothing but JavaScript and Markup

If you have to choose between perfecting it and shipping it... Kellan Elliott-McCrea

And then the Web exploded. Randall Munroe

In 2007, I led my ﬁrst large enterprise Web project.UI team geographically separated from services team.UI development began months in advance of services.

INTEGRATION HELL

We decoupled the UI from the services layer.We ensured all the HTML was valid.We treated the DOM structure as a contract.

UI AS CONTRACT

A frameset wrapped in a proxy server wrapped in an enigma.Hacking Selenium requires some serious programming chops.

In 2008 I worked on a green field project.The UI was constantly in flux. I couldn’t keep up.So I wrote a Perl script that sniffed for invalid response codes.To my surprise, the script caught a lot of bugs.It was the simplest thing that could possibly work.

Detectable errors tend not to be subtle.

In 2009 I worked on several large enterprise projects.

Hundreds of tests in HTML ﬁlesTook all day to run by handEnormous maintenance costNo automationNo visibility

Various attempts were made to convert manual QAsteps into automated tests.Attempts were made to test deep and subtle aspects ofthe application.

In the end, I wrote a few small tests for the critical path.It was the simplest thing that could possibly work.

“What did it just do?”“Why does it say Element Not Found?”“Isn’t this going to fail next time we update the UI?”

iOS Functional Testing in 2009.Automation frameworks barely existed.All I could provide were crash tests.The crash tests were very helpful to the QA team.It was the simplest thing that could possibly work.

A Brief History of the Etsy CI SystemLots of functional tests, some unit tests.Expensive, slow ﬁxtures.Written in Python but the stack is PHP.

The Etsy CI System TodayFunctional tests mostly replaced with Nagios + StatsD.Remaining functional tests rewritten in Behat + Mink.We made it really easy to write unit tests.

We can rapidly detect and ﬁx problems in production.

Every Etsy admin gets to help with testing and debugging.

Maintaining a large functional test suite is hard.Interpreting the results of functional tests is an art.Often a simple solution is all you need.

Being able to move fast is more important thanbeing able to prove you are safe from failure.Failure is inevitable. Recovery is what matters.

First, do the simplest thing that can possibly work.That’s probably all you need.

etsy.com/careers @noahsussman Mashable Cubicle Spy

http://elearning.tadelformacion.com	3
http://www.linkedin.com	3
http://bitly.com	2
http://coderwall.com	1

Selenium in the enterprise what went right and what went wrong so far - selenium conf 2012 london

by Noah Sussman

Accessibility

Categories

Upload Details

Usage Rights

4 Embeds 9

Statistics