Acceptance testing
in the land of the startup


                       @josephwilk
Context   Songkick   Questions
Startup:
“an organisation dedicated to creating
something new under conditions
of extreme uncertainty
Acceptance tests:
  Customer facing tests with each
  acceptance test representing some
  expected result from the system.
Acceptance tests
  for startups?
Acceptance tests
in extreme uncertainty?
Cynefin model
 Complex           Complicated
         Complicated
Complex
   Probe              Sense
    Sense                  Analyze
   Respond                 Respond
  Emergent              Good practice

             Disorder
     Chaotic
 Chaotic            Simple
                         Simple
     Act                    Sense
    Sense                 Categorise
   Respond                 Respond
   Novel                Best Practice
Cynefin model
 Complex           Complicated
         Complicated
Complex
   Probe              Sense
    Sense                  Analyze
   Respond                 Respond
  Emergent              Good practice

             Disorder
     Chaotic
 Chaotic            Simple
                         Simple
     Act                    Sense
    Sense                 Categorise
   Respond                 Respond
   Novel                Best Practice
Build              Measure           Build             Measure



                                               Learn
         Learn


                             Build
                                                        Measure

 Build           Measure



         Learn
                                             Learn
Complexity   Team size




Uncertainty
Team
Principles
Embrace    UX obsessed   Testing
 change
Principles
Embrace    UX obsessed   Testing
 change
Songkick @ work
We have no idea what
   we are doing
Really.
Kanban
Feature
MMF

Facebook signup

In order to increase signups
I want visitors to signup
through their facebook
accounts
10% increase in signups        Measurable
Successful signup through Facebook



Successful signup through Facebook
In order to sign up with as little
effort as possible
As a non-member
I want to signup through my facebook
account




Failed signup up through Facebook

Failed signup up through Facebook
In order to sign with as little
effort as possible
As a non-member
I want to know what I can do to
correct errors preventing signup
Where acceptance
               tests are born


      Product                Developer
      Owner




   User
interaction                       QA
Where acceptance
               tests are born

                   Just In Time
      Product
                      Talking     Developer
      Owner




   User
interaction                            QA
Pairing
Pairing
Feature: Visitor Signs up through facebook
  In order to reduce friction in signin up
  As a non-member
                                                  Value
  I want to signup through my facebook account

Allow users to signup through logging into
there facebook account. A large percentage of
people browse the web with their facebook
                                                 Specification
accounts login.So this should mean most users
have to make 1 click to signup.

See mockups: http://of1-dev-songkick.net/
facebook/mocks

Scenario: Successful signup through facebook
                                                 Examples
  Given ...
  When ...
  Then ...
Hacking
Hacking
Hacking
Anyone can
  deploy
Two way
mirrors
Lessons
Bring on the pain
Urm...

Easy                  Hard
Full stack            Unit test
Feature Rot
Duplicating effort
           We
      already have
      tests for that
@A                  @B
Scenario: example   Scenario: example




         A/B/C/D Testing

@C                  @D
Scenario: example   Scenario: example
Work In Progress
    Limits
         I’m a
      tester too
Slipping under the UI
Done. Done. Done
“A story isn't done until it is being
used by real users
in production and has been validated to be a
useful part of a product.”
                                Joshua Kerievsky
Love Metrics
Questions
Q. Situation with no
acceptance testing
Joe steals your
    lessons
Thanks!



   Joseph Wilk
   @josephwilk
     @josephwilk

Acceptance testing in the land of the startup