WHY I DONT LOADTEST…Peter FarkasAssociate Director, Enterprise Scholarly SystemsGeorgetown University
GETTING VISIBILITYINTOBLACKBOARDS"BLACK BOX" ANDLEARNING TO TESTIN PRODUCTION
About Georgetown• Located in Washington, DC• Founded in 1789• Comprised of 8 schools• 3 campuses and several additional lo...
Evolution of testing @ Georgetown              Bb 5.0     Bb 6.x      Bb 8.x   Bb 9.1   Current• Bb 5.0 • Insufficient QA ...
Evolution of testing @ Georgetown              Bb 5.0     Bb 6.x    Bb 8.x   Bb 9.1   Current• Bb 6.x • Comprehensive manu...
Evolution of testing @ Georgetown               Bb 5.0      Bb 6.x     Bb 8.x   Bb 9.1     Current• Bb 8.x • Continued JMe...
Evolution of testing @ Georgetown               Bb 5.0     Bb 6.x     Bb 8.x   Bb 9.1    Current• Bb 9.1 • Load testing an...
Evolution of testing @ Georgetown               Bb 5.0    Bb 6.x     Bb 8.x     Bb 9.1   Current• Limitations of testing  ...
Evolution of testing @ Georgetown             Bb 5.0   Bb 6.x   Bb 8.x   Bb 9.1   Current• Due Diligence Testing!• Closely...
Demo       10
Blackboard via AppDynamics Then…
Blackboard via AppDynamics now… live?              AppDynamics
Slow Assignment Upload Example
Slow Assignment Uploads
Slow DB Instance
Xythos DB Tuning
Next Steps              Bb 5.0   Bb 6.x    Bb 8.x   Bb 9.1   Current• Upgrade to take advantage of End User Experience  Mo...
Questions?
We value your feedback!Please fill out a session evaluation.                                        41
BbWorld 2012 AppDynamics Presentation
BbWorld 2012 AppDynamics Presentation
BbWorld 2012 AppDynamics Presentation
BbWorld 2012 AppDynamics Presentation
BbWorld 2012 AppDynamics Presentation
BbWorld 2012 AppDynamics Presentation
BbWorld 2012 AppDynamics Presentation
BbWorld 2012 AppDynamics Presentation
BbWorld 2012 AppDynamics Presentation
BbWorld 2012 AppDynamics Presentation
BbWorld 2012 AppDynamics Presentation
BbWorld 2012 AppDynamics Presentation
BbWorld 2012 AppDynamics Presentation
BbWorld 2012 AppDynamics Presentation
BbWorld 2012 AppDynamics Presentation
BbWorld 2012 AppDynamics Presentation
BbWorld 2012 AppDynamics Presentation
BbWorld 2012 AppDynamics Presentation
BbWorld 2012 AppDynamics Presentation
BbWorld 2012 AppDynamics Presentation
BbWorld 2012 AppDynamics Presentation
BbWorld 2012 AppDynamics Presentation
Upcoming SlideShare
Loading in …5
×

BbWorld 2012 AppDynamics Presentation

1,886 views

Published on

Published in: Technology
  • Be the first to comment

BbWorld 2012 AppDynamics Presentation

  1. 1. WHY I DONT LOADTEST…Peter FarkasAssociate Director, Enterprise Scholarly SystemsGeorgetown University
  2. 2. GETTING VISIBILITYINTOBLACKBOARDS"BLACK BOX" ANDLEARNING TO TESTIN PRODUCTION
  3. 3. About Georgetown• Located in Washington, DC• Founded in 1789• Comprised of 8 schools• 3 campuses and several additional locations• 2,100 full-time and part-time faculty• 15,000+ undergraduate and post-graduate students 3
  4. 4. Evolution of testing @ Georgetown Bb 5.0 Bb 6.x Bb 8.x Bb 9.1 Current• Bb 5.0 • Insufficient QA • Insufficient Functional Testing • MAJOR NIGHTMARE 4
  5. 5. Evolution of testing @ Georgetown Bb 5.0 Bb 6.x Bb 8.x Bb 9.1 Current• Bb 6.x • Comprehensive manual functional testing process implemented • JMeter load testing • CRITICAL bottlenecks found! 5
  6. 6. Evolution of testing @ Georgetown Bb 5.0 Bb 6.x Bb 8.x Bb 9.1 Current• Bb 8.x • Continued JMeter testing • Bb ICM engaged for Oracle RAC • Brought Grinder test framework • Attempts to license Grinder from Bb were not successful • Attempts to automate functional testing • Lots of work, limited reward • Misunderstanding of some important use cases 6
  7. 7. Evolution of testing @ Georgetown Bb 5.0 Bb 6.x Bb 8.x Bb 9.1 Current• Bb 9.1 • Load testing and automated functional testing even harder • Heavy use of client-side technologies • Faculty reports of slowness were difficult to verify (but correct!) 7
  8. 8. Evolution of testing @ Georgetown Bb 5.0 Bb 6.x Bb 8.x Bb 9.1 Current• Limitations of testing • Requires significant investment in time and expertise • It is easy to draw the wrong conclusions • Based on our (mis)understanding of user behavior • Valid for conditions at time test is conducted • End user experience depends on client-side technologies 8
  9. 9. Evolution of testing @ Georgetown Bb 5.0 Bb 6.x Bb 8.x Bb 9.1 Current• Due Diligence Testing!• Closely monitor production use! This is what really matters!• APM allows us to do this! 9
  10. 10. Demo 10
  11. 11. Blackboard via AppDynamics Then…
  12. 12. Blackboard via AppDynamics now… live? AppDynamics
  13. 13. Slow Assignment Upload Example
  14. 14. Slow Assignment Uploads
  15. 15. Slow DB Instance
  16. 16. Xythos DB Tuning
  17. 17. Next Steps Bb 5.0 Bb 6.x Bb 8.x Bb 9.1 Current• Upgrade to take advantage of End User Experience Monitoring• Move to a relative method of categorizing requests • Some requests are slow and always will be…• Pass persistent user reference to AppDynamics • Search for requests from Prof. X. 39
  18. 18. Questions?
  19. 19. We value your feedback!Please fill out a session evaluation. 41

×