Scaling
                      Confluence
            From performance to people


      Tim Colson, SW Architect, Cisco*
*T...
Who is Tim?




     2
Who is Tim?
Geek!

•   Microbiology

•   Internet Developer

•   Systems Architect @ Cisco




                         2
Who is Tim?
Geek!

•   Microbiology

•   Internet Developer

•   Systems Architect @ Cisco

Collaborator




             ...
Who is Tim?
Geek!

•   Microbiology

•   Internet Developer

•   Systems Architect @ Cisco

Collaborator

Confluence User s...
Why am I here?
                             500K+
                             pages?




          2004 2005 2006 2007 20...
Why am I here?
Experience with rapid growth                      500K+
and large scale wiki                              p...
Why am I here?
Experience with rapid growth                      500K+
and large scale wiki                              p...
Why am I here?
Experience with rapid growth                      500K+
and large scale wiki                              p...
Why am I here?
Experience with rapid growth                       500K+
and large scale wiki                              ...
Why am I here?
Experience with rapid growth                        500K+
and large scale wiki                             ...
Why am I here?
Experience with rapid growth                        500K+
and large scale wiki                             ...
Scalable Collaboration




          4
Scalable Collaboration

SW   HW




           4
Scalable Collaboration

 SW        HW
(User   Activity)3




                     4
Scalable Collaboration

 SW        HW            Configuration

(User   Activity)3




                     4
Scalable Collaboration

 SW        HW            Configuration

(User   Activity)3
                         Innovation



 ...
Scalable Collaboration

SW       HW             Configuration

(User Activity) 3        Innovation




                    5
SW + HW


          Cluster?




             6
SW + HW


                  Cluster?
     Confluence rocks on a single node!




                           6
SW + HW


                   Cluster?
     Confluence rocks on a single node!

     Cluster adds complexity and width




 ...
SW + HW


                      Cluster?
     Confluence rocks on a single node!

     Cluster adds complexity and width

 ...
SW + HW


                      Cluster?
     Confluence rocks on a single node!

     Cluster adds complexity and width

 ...
SW


All ur UX belong to us!




           7
SW


All ur UX belong to us!




           7
SW


     User Experience




            8
SW


          User Experience
     Drop down for 3,500 spaces = FAIL!




                              8
SW


          User Experience
     Drop down for 3,500 spaces = FAIL!

     Paging 50,000 users = FAIL!




             ...
SW


          User Experience
     Drop down for 3,500 spaces = FAIL!

     Paging 50,000 users = FAIL!

     People sear...
SW


          User Experience
     Drop down for 3,500 spaces = FAIL!

     Paging 50,000 users = FAIL!

     People sear...
SW


          User Experience
     Drop down for 3,500 spaces = FAIL!

     Paging 50,000 users = FAIL!

     People sear...
SW


          User Experience
     Drop down for 3,500 spaces = FAIL!

     Paging 50,000 users = FAIL!

     People sear...
SW


     Web 2.0 Integration




              9
SW


     Web 2.0 Integration

                  Must be bullet proof




              9
SW


     Web 2.0 Integration

                  Must be bullet proof

                  Instability leads to Instability
...
SW


     Web 2.0 Integration

                  Must be bullet proof

                  Instability leads to Instability
...
SW


     Web 2.0 Integration

                  Must be bullet proof

                  Instability leads to Instability
...
Scalable Collaboration

 SW        HW             Configuration

(User   Activity)3         Innovation




                ...
User Activity


                Complex Markup
          {style}{section}{column:width=70%}
          {panel:borderStyle=s...
User Activity


                Complex Markup
          {style}{section}{column:width=70%}
          {panel:borderStyle=s...
User Activity


                Complex Markup
          {style}{section}{column:width=70%}
          {panel:borderStyle=s...
User Activity


           Macros & Plugins
                           1-4 macros
                              43%
      ...
User Activity


           Macros & Plugins
                           1-4 macros              I get coffee
              ...
User Activity


         Access Restrictions




                  13
User Activity


         Access Restrictions
     Perceived need and fear




                               13
User Activity


         Access Restrictions
     Perceived need and fear

     Web site vs. Collaborative space




     ...
User Activity


         Access Restrictions
     Perceived need and fear

     Web site vs. Collaborative space

     Sca...
User Activity


         Access Restrictions
     Perceived need and fear

     Web site vs. Collaborative space

     Sca...
User Activity


         Access Restrictions
     Perceived need and fear

     Web site vs. Collaborative space

     Sca...
User Activity


                     Support
 ? ? ?? ? ?               ? ? ?? ? ?
User Support                  IT
 ? ? ??...
Scalable Collaboration

SW         HW            Configuration

(User Activity) 3          Innovation




                 ...
Configuration


     Policy affects Usage


               ... or ...




                            16
Configuration


               Space!




                 17
Configuration


               Space!




                 17
Scalable Collaboration

SW         HW             Configuration

(User Activity) 3
                         Innovation


  ...
Innovation


             Good vs. Evil

      “...technologies are
             morally neutral
      until we apply them...
Enterprise Theme



250 authors

35 spaces

2,500 pages



              20
Enterprise Theme



250 authors        25,000 authors

35 spaces          3,500 spaces

2,500 pages        250,000 pages

...
Innovation


       Theme & Spacemap




              21
Innovation


       Theme & Spacemap




              21
Innovation


       Theme & Spacemap




              21
Innovation


          Metrics & Analytics
    100
                                              Content
     75
         ...
Innovation


             Rogue Servers




                   23
Innovation


             Rogue Servers
                        What are they?




                   23
Innovation


             Rogue Servers
                        What are they?

                        Why care?




    ...
Innovation


             Rogue Servers
                        What are they?

                        Why care?

       ...
Summary
Large scale collaboration is
more than just SW + HW.

       Tim Colson
@ gmail/yahoo/me dot com




             ...
Scaling
    Confluence

From Performance to People
Charles Miller
Confluence Architect
Numbers
Average response time (in ms) for various Confluence operations
5,000



3,750



2,500



1,250



   0
                 ...
Average response time (in ms) for various Confluence operations (Clustered)
3,000



2,250



1,500



 750



   0
      ...
Throughput
 2.10.3




3.0-beta2
Throughput
 2.10.3




3.0-beta2
Throughput
 2.10.3




3.0-beta2
CPU Idle (8 cores)

                      2.10.3           ~30%


                    3.0-beta2           ~5%


http://con...
On the Roadmap
• Improved page moving and reordering for
  large spaces
• Improvements for instances with large
  numbers ...
Mind the Gap
You Are Going to Need It

•   Change Control

•   System Monitoring

•   Load Testing

•   Staged Upgrades

•   Tuning
Tuning
 •   Database

 •   Application Server

 •   Operating System

 •   JVM

 •   Confluence

Don’t be afraid to ask
   ...
Clustering
User Management

•   Number of users and
    groups

•   Number of groups per
    user

•   Response time for
    external...
Log Monitoring
http://confluence.atlassian.com/display/DOC/How+to+audit+Confluence+-+enabling+user+access+logging
{cache}

{future}
Plugin Management
Customi[sz]ation
confluence.atlassian.com


•   Operating Large or
    Mission Critical
    Confluence Installations

•   Performance Tuning...
Talk to us
Talk to us
Talk to us
Talk to us
Scaling Confluence: From Performance to People
Upcoming SlideShare
Loading in …5
×

Scaling Confluence: From Performance to People

2,611 views

Published on

A good wiki grows — more people and content, uses and demands. What begins as a simple experiment in collaboration, explodes into a new Intranet or a mission critical web application. This session focuses on how to architect Confluence for scale and configure it for growing user needs.

Atlassian Speaker: Charles Miller

Customer Speaker: Tim Colson of Cisco

Key Takeaways:

* Best practices in tuning and performance
* Administrative tips-and-tricks for improved performance and management
* Lessons from customers

Published in: Technology, Business
0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
2,611
On SlideShare
0
From Embeds
0
Number of Embeds
146
Actions
Shares
0
Downloads
44
Comments
0
Likes
3
Embeds 0
No embeds

No notes for slide

Scaling Confluence: From Performance to People

  1. 1. Scaling Confluence From performance to people Tim Colson, SW Architect, Cisco* *The views expressed in this presentation are mine and do not necessarily reflect the views of Cisco. 1
  2. 2. Who is Tim? 2
  3. 3. Who is Tim? Geek! • Microbiology • Internet Developer • Systems Architect @ Cisco 2
  4. 4. Who is Tim? Geek! • Microbiology • Internet Developer • Systems Architect @ Cisco Collaborator 2
  5. 5. Who is Tim? Geek! • Microbiology • Internet Developer • Systems Architect @ Cisco Collaborator Confluence User since v1.0 2
  6. 6. Why am I here? 500K+ pages? 2004 2005 2006 2007 2008 2009 3
  7. 7. Why am I here? Experience with rapid growth 500K+ and large scale wiki pages? 2004 2005 2006 2007 2008 2009 3
  8. 8. Why am I here? Experience with rapid growth 500K+ and large scale wiki pages? Over 70,000 users 2004 2005 2006 2007 2008 2009 3
  9. 9. Why am I here? Experience with rapid growth 500K+ and large scale wiki pages? Over 70,000 users 250,000 pages / 4,000 spaces 2004 2005 2006 2007 2008 2009 3
  10. 10. Why am I here? Experience with rapid growth 500K+ and large scale wiki pages? Over 70,000 users 250,000 pages / 4,000 spaces ~6K active contributors (30d) 2004 2005 2006 2007 2008 2009 3
  11. 11. Why am I here? Experience with rapid growth 500K+ and large scale wiki pages? Over 70,000 users 250,000 pages / 4,000 spaces ~6K active contributors (30d) ~25K total contributors (4yrs) 2004 2005 2006 2007 2008 2009 3
  12. 12. Why am I here? Experience with rapid growth 500K+ and large scale wiki pages? Over 70,000 users 250,000 pages / 4,000 spaces ~6K active contributors (30d) ~25K total contributors (4yrs) ~300-400K views daily 2004 2005 2006 2007 2008 2009 3
  13. 13. Scalable Collaboration 4
  14. 14. Scalable Collaboration SW HW 4
  15. 15. Scalable Collaboration SW HW (User Activity)3 4
  16. 16. Scalable Collaboration SW HW Configuration (User Activity)3 4
  17. 17. Scalable Collaboration SW HW Configuration (User Activity)3 Innovation 4
  18. 18. Scalable Collaboration SW HW Configuration (User Activity) 3 Innovation 5
  19. 19. SW + HW Cluster? 6
  20. 20. SW + HW Cluster? Confluence rocks on a single node! 6
  21. 21. SW + HW Cluster? Confluence rocks on a single node! Cluster adds complexity and width 6
  22. 22. SW + HW Cluster? Confluence rocks on a single node! Cluster adds complexity and width Recommendations • Version 2.x - Tim says “Meh” • Version 3.x - Tim says, “Yay!” 6
  23. 23. SW + HW Cluster? Confluence rocks on a single node! Cluster adds complexity and width Recommendations • Version 2.x - Tim says “Meh” • Version 3.x - Tim says, “Yay!” Approach • big honkinʼ servers • separate instances 6
  24. 24. SW All ur UX belong to us! 7
  25. 25. SW All ur UX belong to us! 7
  26. 26. SW User Experience 8
  27. 27. SW User Experience Drop down for 3,500 spaces = FAIL! 8
  28. 28. SW User Experience Drop down for 3,500 spaces = FAIL! Paging 50,000 users = FAIL! 8
  29. 29. SW User Experience Drop down for 3,500 spaces = FAIL! Paging 50,000 users = FAIL! People search returns 6 of 500 “Tims” = FAIL! 8
  30. 30. SW User Experience Drop down for 3,500 spaces = FAIL! Paging 50,000 users = FAIL! People search returns 6 of 500 “Tims” = FAIL! Approach 8
  31. 31. SW User Experience Drop down for 3,500 spaces = FAIL! Paging 50,000 users = FAIL! People search returns 6 of 500 “Tims” = FAIL! Approach • customi[sz]ation (more later), training, policy, configuration 8
  32. 32. SW User Experience Drop down for 3,500 spaces = FAIL! Paging 50,000 users = FAIL! People search returns 6 of 500 “Tims” = FAIL! Approach • customi[sz]ation (more later), training, policy, configuration • feedback to Atlassian 8
  33. 33. SW Web 2.0 Integration 9
  34. 34. SW Web 2.0 Integration Must be bullet proof 9
  35. 35. SW Web 2.0 Integration Must be bullet proof Instability leads to Instability 9
  36. 36. SW Web 2.0 Integration Must be bullet proof Instability leads to Instability 9
  37. 37. SW Web 2.0 Integration Must be bullet proof Instability leads to Instability Approach: limit exposure 9
  38. 38. Scalable Collaboration SW HW Configuration (User Activity)3 Innovation 10
  39. 39. User Activity Complex Markup {style}{section}{column:width=70%} {panel:borderStyle=solid|borderColor=#e6e6e6| bgColor=#FFFFFF|}{center}h1. *Milestone* {align:center}{table-plus}| !img7.jpg!| milestones |{table-plus}{align} h6. {color:black}Click the +*buttons*+ below {align:center}{section}{section} [!roadmapspic3.bmp!|http://zed.cisco.com/ confluence/display/CPDA/Milestones]{align} {include:Team}{toc:minLevel=4}{column} 11
  40. 40. User Activity Complex Markup {style}{section}{column:width=70%} {panel:borderStyle=solid|borderColor=#e6e6e6| bgColor=#FFFFFF|}{center}h1. *Milestone* {align:center}{table-plus}| !img7.jpg!| milestones |{table-plus}{align} h6. {color:black}Click the +*buttons*+ below {align:center}{section}{section} [!roadmapspic3.bmp!|http://zed.cisco.com/ confluence/display/CPDA/Milestones]{align} {include:Team}{toc:minLevel=4}{column} At risk: UX, Adoption, Collaboration, Support 11
  41. 41. User Activity Complex Markup {style}{section}{column:width=70%} {panel:borderStyle=solid|borderColor=#e6e6e6| bgColor=#FFFFFF|}{center}h1. *Milestone* {align:center}{table-plus}| !img7.jpg!| milestones |{table-plus}{align} h6. {color:black}Click the +*buttons*+ below {align:center}{section}{section} [!roadmapspic3.bmp!|http://zed.cisco.com/ confluence/display/CPDA/Milestones]{align} {include:Team}{toc:minLevel=4}{column} At risk: UX, Adoption, Collaboration, Support Approach: forums, blogs, screen casts 11
  42. 42. User Activity Macros & Plugins 1-4 macros 43% 0 macros 50% >5 7% 12
  43. 43. User Activity Macros & Plugins 1-4 macros I get coffee 43% 0 macros while it loads... 50% then it’s FAST! >5 7% Approach: governance / separate instances 12
  44. 44. User Activity Access Restrictions 13
  45. 45. User Activity Access Restrictions Perceived need and fear 13
  46. 46. User Activity Access Restrictions Perceived need and fear Web site vs. Collaborative space 13
  47. 47. User Activity Access Restrictions Perceived need and fear Web site vs. Collaborative space Scalability issue 13
  48. 48. User Activity Access Restrictions Perceived need and fear Web site vs. Collaborative space Scalability issue 13
  49. 49. User Activity Access Restrictions Perceived need and fear Web site vs. Collaborative space Scalability issue Approach: training, policy, tricks 13
  50. 50. User Activity Support ? ? ?? ? ? ? ? ?? ? ? User Support IT ? ? ?? ? ? ? ? ? ?? ? ? Approach • Consolidate requests inside the enterprise • Feedback to Atlassian 14
  51. 51. Scalable Collaboration SW HW Configuration (User Activity) 3 Innovation 15
  52. 52. Configuration Policy affects Usage ... or ... 16
  53. 53. Configuration Space! 17
  54. 54. Configuration Space! 17
  55. 55. Scalable Collaboration SW HW Configuration (User Activity) 3 Innovation 18
  56. 56. Innovation Good vs. Evil “...technologies are morally neutral until we apply them.” - William Gibson 19
  57. 57. Enterprise Theme 250 authors 35 spaces 2,500 pages 20
  58. 58. Enterprise Theme 250 authors 25,000 authors 35 spaces 3,500 spaces 2,500 pages 250,000 pages 20
  59. 59. Innovation Theme & Spacemap 21
  60. 60. Innovation Theme & Spacemap 21
  61. 61. Innovation Theme & Spacemap 21
  62. 62. Innovation Metrics & Analytics 100 Content 75 Collaboration ? 50 25 0 2007 2008 2009 2010 Approach: SQL on Confluence DB 22
  63. 63. Innovation Rogue Servers 23
  64. 64. Innovation Rogue Servers What are they? 23
  65. 65. Innovation Rogue Servers What are they? Why care? 23
  66. 66. Innovation Rogue Servers What are they? Why care? Approach • Embrace them! • Engage them! 23
  67. 67. Summary Large scale collaboration is more than just SW + HW. Tim Colson @ gmail/yahoo/me dot com 24
  68. 68. Scaling Confluence From Performance to People
  69. 69. Charles Miller Confluence Architect
  70. 70. Numbers
  71. 71. Average response time (in ms) for various Confluence operations 5,000 3,750 2,500 1,250 0 2.10.3 3.0-beta2
  72. 72. Average response time (in ms) for various Confluence operations (Clustered) 3,000 2,250 1,500 750 0 2.10.3 3.0-beta2
  73. 73. Throughput 2.10.3 3.0-beta2
  74. 74. Throughput 2.10.3 3.0-beta2
  75. 75. Throughput 2.10.3 3.0-beta2
  76. 76. CPU Idle (8 cores) 2.10.3 ~30% 3.0-beta2 ~5% http://confluence.atlassian.com/display/DOC/Performance+Testing+Scripts
  77. 77. On the Roadmap • Improved page moving and reordering for large spaces • Improvements for instances with large numbers of spaces • Improve user management • Continue to work on performance, clustering, stability, documentation
  78. 78. Mind the Gap
  79. 79. You Are Going to Need It • Change Control • System Monitoring • Load Testing • Staged Upgrades • Tuning
  80. 80. Tuning • Database • Application Server • Operating System • JVM • Confluence Don’t be afraid to ask for help.
  81. 81. Clustering
  82. 82. User Management • Number of users and groups • Number of groups per user • Response time for external user management
  83. 83. Log Monitoring http://confluence.atlassian.com/display/DOC/How+to+audit+Confluence+-+enabling+user+access+logging
  84. 84. {cache} {future}
  85. 85. Plugin Management
  86. 86. Customi[sz]ation
  87. 87. confluence.atlassian.com • Operating Large or Mission Critical Confluence Installations • Performance Tuning • Configuring a Large Confluence Installation (These links will be available from the summit wiki)
  88. 88. Talk to us
  89. 89. Talk to us
  90. 90. Talk to us
  91. 91. Talk to us

×