Your SlideShare is downloading. ×
Pushing The Boundaries Of Continuous Integration
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Saving this for later?

Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime - even offline.

Text the download link to your phone

Standard text messaging rates apply

Pushing The Boundaries Of Continuous Integration

3,855
views

Published on

Presentation from Agile2008.org of the session 'Pushing the Boundaries of Continuous Integration.

Presentation from Agile2008.org of the session 'Pushing the Boundaries of Continuous Integration.

Published in: Technology, Sports

0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
3,855
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
49
Comments
0
Likes
2
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Pushing the Boundaries of Testing and Continuous Integration Fabrizio Cannizzo Raghav Ramesh Robbie Clutton
  • 2. http://flickr.com/photos/zoonabar/159442457/ Who are we? http://flickr.com/photos/kerrybuckley/ 1356791754/in/pool-web21c
  • 3.  
  • 4. Agile to the Core!
      • XP/Scrum
        • - TDD
        • - Pair programming
        • - Continuous Build/Integration
          • Unit/Acceptance Test
          • Reporting
    •  
  • 5. Feature completeness != completed product http://flickr.com/photos/mattimattila/2188826561/
  • 6. What's Missing?
    • Robustness
    •  
    • Performance
    • Scalability  
    • Failover
  • 7. We needed to know the thing would stand up http://flickr.com/photos/alan-light/2435511982/
  • 8. But we didn't want to wait for formal QA testing
  • 9. We had to last three spooky nights http://flickr.com/photos/luchilu/677786684/
  • 10. After four weekends, we were done http://flickr.com/photos/22243977@N06/2457787000/ Bugs Memory Leaks Poor Environment Log Extractors
  • 11. What next?
    • Create scenarios
    •  
    • Define expectations
    • Automate 
    • Continuously test
  • 12. So... how does it really work?
  • 13.
    • Technologies
      • Cruise Control
      • Java Spring Framework
      • Hand crafted Java code
      • JMX Console
      • UltraMonkey
      • SIPp
      • JainSIP
      • Mockphones
  • 14. Cruise control is the engine that continuously runs typical usage scenarios. http://flickr.com/photos/_fxr/2142296214/ Ensure the entire scenario played out as expected http://flickr.com/photos/mike-burns/35534789/ connect connect join
  • 15. Why are scenarios relevant?
    • Robustness
    • Performance
    • Scalability
    • Failover
  • 16. We automated phone behaviour using SIPp... Different  configurations are implemented using different spring application contexts and network setups Scenario runners are java applications Scenarios are POJOs loaded from spring application context
  • 17.  
  • 18.  
  • 19.  
  • 20.  
  • 21. TestRR
      • Generic Framework
        • Robustness
        • Performance
    •  
      • http://code.google.com/p/testrr/
  • 22. Who else is talking about this?
    • James Bull - Pragmatic Performance Testing - http://is.gd/SUv
    •  
    • Dr. Dobbs - Continuous Integration and Performance Testing - http://is.gd/12Ds
    • Manfred Lange - Introducing Automated Performance Testing - http://is.gd/SUj
    • Paul King & Dalton Cranston – Open Source Performance Testing Tools For The Web
  • 23. What we have learned that you could take away...
    • Automate early and often unit and acceptance tests are an essential first step maintaining these builds can have severe impact on velocity the customer must buy in: formulate user stories to drive the creation of tests
  • 24. ... and also...
    • This drives creation of robust code earlier Leverage existing frameworks for performance testing Build up testing strategies incrementally These tests are resource hungry, use an appropriate environment
  • 25. Q & A   Fabrizio Cannizzo:  - http://smartrics.blogspot.com Raghav Ramesh: - http://ragstorooks.wordpress.com Robbie Clutton: - http://blog.iclutton.com Aloha SIP A/S: https://trac.osmosoft.com/Aloha Web21C SDK: http://web21c.bt.com