This document summarizes TopCoder, a company that develops custom software through online programming competitions. It discusses TopCoder's history and business model, including how CEO Jack Hughes refined the model over time based on his prior experiences. By 2009, TopCoder had grown to a global community of over 225,000 programmers and routinely produced software solutions for over 45 major clients. However, Hughes aimed to increase annual revenues from $18 million to $200 million and considered how to scale the competition-based model to achieve that goal.
Redington Value Distribution's ‘Value Journal’, a monthly news journal whose purpose is to update the channel on the latest vendor news and Redington Value’s Channel Initiatives.
Key stories from the November Edition:
• Redington Value Drives Transformation
• DellEMC launches new partner program
• Red Hat's mobile vision to support containerized mobile app development
• Fortiner delivers on open security fabric
• FGB expands analytics capabilities in partnership with Oracle
• CloudHost unveils UAE's first user-based cloud solution
• Cisco Announces new education platform
Value Journal, a monthly news journal from Redington Value Distribution, intends to update the channel on the latest vendor news and Redington Value’s Channel Initiatives.
Key stories from the April Edition:
•Coronet Security Signs Distribution Deal With Redington Value
•HPE announces innovation center to accelerate UAE’s innovation ecosystem
•Carving a niche : By Zahid Sumar, Regional Sales Head, East and South Africa, Redington Value
•Dell EMC reveals results of third Global Data Protection Index
•Avaya targets huddle rooms with latest product enhancements
•Fortinet Highlights Convergence Of Cybersecurity And Physical Spaces
•Kaspersky Lab unveils new program to empower partners
•Micro Focus completes SUSE sale
•Nutanix .Next on Tour emphasizes onchannel partner programs
•Veritas acquires APTARE to enhance enterprise data analytics
•Pivot3 achieves common criteria certification to drive hybrid cloud adoption
The document discusses Capgemini's TechnoVision 2012 report, which identifies seven technology clusters that will be important for businesses. The clusters are designed to help map business needs to relevant technology solutions. TechnoVision asserts that technology can both open opportunities for businesses and free them from constraints. It analyzed 17 key technology trends and organized them into the seven clusters. The clusters can then be mapped to actual products and solutions to help businesses address drivers, issues, opportunities, and compliance needs through technology.
In prior research, we showcased how digital leaders are using investments in digital technologies to transform key capabilities across customer experience and operations. However, in today’s volatile and disrupted world, capability leadership is not enough. As well as having the capabilities in place, organizations need to be nimble and flexible – dexterous – if they are to respond to ever-changing technology advances, emerging competitive disruptions, and changing customer needs. Enterprises that excel in both qualities – capability and dexterity – are digital organizations. This ‘digital elite’ reported that they outperformed their competitors on multiple key performance indicators including profitability, customer satisfaction, innovativeness and growth.
Organizing for digital why digital dexterity matters - capgemini consultingRick Bouter
- The document discusses how organizations that underwent major redesigns to take advantage of new technologies, like electrification and digitalization, saw large increases in productivity and performance.
- It provides examples of companies like Starbucks, GE, and HSBC that redesigned their organizational structures and processes to harness digital technologies and become "digital organizations", improving metrics like customer satisfaction and innovation.
- Digital organizations report better performance on key indicators compared to all firms, showing the competitive edge of undergoing digital transformation and redesign.
(1) IBM is promoting the concept of social business, where social media and networking tools are integrated into core business processes.
(2) When implemented properly through aligning goals, gaining trust, engaging users, networking processes, managing reputation and risk, and analyzing data, social business can lead to benefits like increased sales, customer satisfaction, innovation, and knowledge sharing.
(3) IBM provides its own social networking platform called IBM Connections to help companies implement social business practices.
The main goal of this study is to understand how companies use the concept of Digital Analytics and how to leverage their results from Digital Analytics implementation.
Based on, and including, interviews with a global panel of experts from world-leading institutions, Capitalising on the Digital Age outlines future revenue models and strategies that media and telecoms firms should consider adopting in order to prosper in a world where the value of traditional business models is slowly being eroded.
Redington Value Distribution's ‘Value Journal’, a monthly news journal whose purpose is to update the channel on the latest vendor news and Redington Value’s Channel Initiatives.
Key stories from the November Edition:
• Redington Value Drives Transformation
• DellEMC launches new partner program
• Red Hat's mobile vision to support containerized mobile app development
• Fortiner delivers on open security fabric
• FGB expands analytics capabilities in partnership with Oracle
• CloudHost unveils UAE's first user-based cloud solution
• Cisco Announces new education platform
Value Journal, a monthly news journal from Redington Value Distribution, intends to update the channel on the latest vendor news and Redington Value’s Channel Initiatives.
Key stories from the April Edition:
•Coronet Security Signs Distribution Deal With Redington Value
•HPE announces innovation center to accelerate UAE’s innovation ecosystem
•Carving a niche : By Zahid Sumar, Regional Sales Head, East and South Africa, Redington Value
•Dell EMC reveals results of third Global Data Protection Index
•Avaya targets huddle rooms with latest product enhancements
•Fortinet Highlights Convergence Of Cybersecurity And Physical Spaces
•Kaspersky Lab unveils new program to empower partners
•Micro Focus completes SUSE sale
•Nutanix .Next on Tour emphasizes onchannel partner programs
•Veritas acquires APTARE to enhance enterprise data analytics
•Pivot3 achieves common criteria certification to drive hybrid cloud adoption
The document discusses Capgemini's TechnoVision 2012 report, which identifies seven technology clusters that will be important for businesses. The clusters are designed to help map business needs to relevant technology solutions. TechnoVision asserts that technology can both open opportunities for businesses and free them from constraints. It analyzed 17 key technology trends and organized them into the seven clusters. The clusters can then be mapped to actual products and solutions to help businesses address drivers, issues, opportunities, and compliance needs through technology.
In prior research, we showcased how digital leaders are using investments in digital technologies to transform key capabilities across customer experience and operations. However, in today’s volatile and disrupted world, capability leadership is not enough. As well as having the capabilities in place, organizations need to be nimble and flexible – dexterous – if they are to respond to ever-changing technology advances, emerging competitive disruptions, and changing customer needs. Enterprises that excel in both qualities – capability and dexterity – are digital organizations. This ‘digital elite’ reported that they outperformed their competitors on multiple key performance indicators including profitability, customer satisfaction, innovativeness and growth.
Organizing for digital why digital dexterity matters - capgemini consultingRick Bouter
- The document discusses how organizations that underwent major redesigns to take advantage of new technologies, like electrification and digitalization, saw large increases in productivity and performance.
- It provides examples of companies like Starbucks, GE, and HSBC that redesigned their organizational structures and processes to harness digital technologies and become "digital organizations", improving metrics like customer satisfaction and innovation.
- Digital organizations report better performance on key indicators compared to all firms, showing the competitive edge of undergoing digital transformation and redesign.
(1) IBM is promoting the concept of social business, where social media and networking tools are integrated into core business processes.
(2) When implemented properly through aligning goals, gaining trust, engaging users, networking processes, managing reputation and risk, and analyzing data, social business can lead to benefits like increased sales, customer satisfaction, innovation, and knowledge sharing.
(3) IBM provides its own social networking platform called IBM Connections to help companies implement social business practices.
The main goal of this study is to understand how companies use the concept of Digital Analytics and how to leverage their results from Digital Analytics implementation.
Based on, and including, interviews with a global panel of experts from world-leading institutions, Capitalising on the Digital Age outlines future revenue models and strategies that media and telecoms firms should consider adopting in order to prosper in a world where the value of traditional business models is slowly being eroded.
WhiteSource and FINOS: Empowering Financial Institutions to use Open Source W...DevOps.com
The days when financial institutions relied solemnly on proprietary code are over. Today, even the largest financial services firms have realized the benefits of using open source technology to build powerful, innovative applications at a reduced time-to-market. However, the financial services industry faces strict regulatory requirements that present it with a unique set of challenges, especially when it comes to open source usage (both consumption and contribution).
FINOS is a non-profit organization whose purpose is to accelerate collaboration and innovation in financial services through the adoption of open source software, standards and best practices. Together with WhiteSource, they are able to provide a safe environment for developers to use open source components freely and fearlessly.
Join FINOS and WhiteSource as they discuss:
The challenges of open source usage
The state of open source vulnerabilities management
How FINOS uses WhiteSource to ensure the security and IP compliance of FINOS-produced open source software
Lotus Connections is used by various organizations to address different challenges:
- A global manufacturer used it to reduce costs by leveraging a packaged employee directory solution instead of custom coding, and to improve cross-functional communication.
- A global telecommunications firm used it to increase innovation by involving customers and partners in developing new services through an online portal.
- A small non-profit used it to collaborate across disconnected teams on education projects through an activities component.
Our team analyzed competitors addressing screenshot management and identified alternative solutions. An ideal solution would use AI to automatically sort screenshots but required coding beyond our skills. Instead, we proposed an app allowing users to: 1) upload multiple screenshots to pre-defined categories, eliminating manual tagging; 2) search screenshots by text tags added during upload. This streamlined organization while being accessible across platforms with our limited technical abilities. User testing provided feedback to improve the solution's intuitiveness.
The document discusses generational differences in attitudes towards the importance of software as a competitive advantage between Microsoft, Google, and Facebook.
Microsoft historically viewed software as its primary competitive advantage and developed software for many markets. Google chose open source software and focuses on infrastructure efficiency rather than proprietary software. Facebook believes infrastructure software is non-differentiating and runs primarily on open source and publicly available software. Perceptions are evolving to recognize that software is less of a means to differentiate as it becomes more standardized and commoditized.
Social Business and Yammer | #onlinefuturetodayArjen Jelsma
1. Enterprise social networking can help organizations transform into social businesses needed to add value for customers, employees, stakeholders, and themselves.
2. A social business focuses on human factors over techniques and connects people to achieve more value. Social media facilitates this social business transformation.
3. A social business thinks about what employees, stakeholders, and customers need and adds value to their lives to benefit the business.
GovLoop Guide: Government Technology Year in ReviewGovLoop
This document provides a summary of key technology trends and developments in the US government in 2012. It begins with an overview of the results of a GovLoop survey of 250 government professionals on the most important technology trends of 2012 and those they are watching for 2013. It then details five major trends: the expansion of mobility in government; unlocking big data; cloud computing; bringing agile methodology to government projects; and increased use of social media. Each trend section identifies challenges, highlights successful case studies from 2012, and looks ahead to 2013. The document aims to serve as a roadmap for agencies to address challenges and provide a review of the past year in government technology.
Maitland Waters Social Media @ SOHO house_london_june_6_2011Symbio Agency Ltd
The document provides an overview of a presentation on digital strategy and social media. It discusses relationship networks and how social media can benefit businesses. It emphasizes the importance of an omnichannel digital strategy and highlights examples of how to measure return on investment from social media initiatives.
Make the leap, take the lead Slideshare | Accentureaccenture
The document discusses how companies can become "Leapfroggers" and close the performance gap between Leaders and Laggards in technology adoption. It finds that Leaders have significantly increased their growth rate compared to Laggards during the COVID-19 pandemic. To become Leapfroggers, companies need to replatform by moving to the cloud, reframe their mindset to focus on innovation and collaboration, and reach by expanding access to technology across their organization and addressing employee and social issues. Case studies are provided of companies like Santander, Carrefour, and Deutsche Telekom that exemplify these approaches and were able to adapt successfully during the pandemic.
Hatch Connect, an engineering consulting firm, implemented Open Text's Livelink ECM software to enhance collaboration among its 8,700 global employees. The key goals were to leverage communications, increase competitiveness to retain technologically-savvy employees, and appeal to younger generations' demand for social networking. Employees formed 73 communities on topics like bulk materials handling and sustainability. This allowed sharing of specialized knowledge globally and met younger employees' expectations for collaboration beyond email. The communities have enhanced expertise availability and information sharing.
Kronos is consistently identified as the global market leader for workforce management solutions. Multiple analyst reports and case studies cite Kronos' breadth of offerings, global capabilities, leadership in key industries like retail and healthcare, and ability to deliver strong ROI for customers. Kronos is particularly strong in North America and Western Europe and continues to drive innovation in areas like talent acquisition, mobile applications, and new user experiences.
Innovation in the Age of Global Collaboration - CrowdsourcingSaadick Dhansay
The rapid development of new technologies has given rise to new forms of collaboration. Organisations are able to collaborate on a global scale with individuals around the world, in order to conduct R&D activities as a result of Web 2.0 tools and technologies. This study focuses on three areas relating to global collaboration (crowdsourcing); people, processes and technology.
The purpose of this study is to understand the motivational factors of people that partake in global collaboration (crowdsourcing), the change of process with regard to bringing to new products and services to the market and how technology has changed the way organisations collaborate to achieve this. The research was conducted in the form of case studies to analyse how products were brought to the market through the use of global collaboration.
NASA is exploring various methods of open collaboration and innovation to advance its human health and performance initiatives. It has piloted several programs including challenges on InnoCentive, Yet2.com, and TopCoder to source novel solutions from external experts. NASA has also established the NASA Human Health and Performance Center and the Center of Excellence for Collaborative Innovation to institutionalize these open innovation efforts. The results have included new technologies and algorithms as well as potential partnerships. NASA plans to continue expanding these collaboration methods going forward.
Tony Zhang is promoting Fortune Data, an advertising platform that provides a one-stop solution for Western businesses to cost-effectively engage local Chinese consumers. It uses big data, business knowledge, and algorithms to allow programmatic and real-time bidding on web and mobile ads in North America and Europe targeting the growing overseas Chinese market. Fortune Data makes money by taking a 20% cut of ad costs. The $400 billion overseas Chinese consumer market is largely untapped and represents a major opportunity for growth.
This document provides an overview of opportunities for international partnerships between Chinese and Finnish companies. It discusses how both Chinese and Finnish companies need to pursue international expansion to drive growth. For China, internationalization is important as rising wages erode its low-cost advantage, and it needs to transition to a high-value economy. For Finland, emerging markets provide disproportionate demand that small Finnish companies need to commercialize innovation. The document introduces a market opportunity matrix that identifies four types of partnership opportunities depending on whether the target market/sector is developed/emerging or in a "sunrise" industry. These include opportunities in good enough, latent demand, breakthrough, and leapfrog markets.
CWKCommerce provides e-commerce services for North American SMB brands to enter the Chinese market in a quick and cost-effective manner. It targets fashion, luxury, and consumer goods companies and helps them establish online stores on Taobao. CWKCommerce handles all aspects of operations including website development, marketing, logistics, and customer service. It has proven success with clients such as Moni Moni, RAILS Clothing, and SASSY Baby.
TopCoder is a community of over 225,000 software developer and graphic designers. Our clients include large companies (Fortune 50) to start-ups who tap into the TopCoder Platform by holding online contests. This presentation gives an overview of the platform and describes how it can work for you.
TopCoder was founded by Jack Hughes as a crowdsourcing platform for software development after seeing issues with high costs and employee turnover at his previous company Tallan. It started as a competition-based model (v1.0) where clients would host competitions and the winner would be hired. It evolved to have different models where more tasks were broken out to the crowd (v2.0, v2.1). While revenue increased, costs associated with project managers decreased profitability. TopCoder addressed this through new pricing models and increasing prize money to motivate more of the latent crowd to be active.
Nicholas Hoffmeyer - Adobe Systems - BL_S2_2016Nick Hoffmeyer
Adobe Systems successfully transformed its business model from desktop software licenses to cloud-based subscriptions under CEO Shantanu Narayen. Facing challenges like slowing growth and high piracy rates, Narayen shifted Adobe's focus to the entire creative content value chain and cloud subscriptions. This transition was difficult but enabled faster innovation, recurring revenues, and access to new customers. Through acquisitions, restructuring, and convincing employees of the vision, Narayen completed the transformation in just three years, propelling Adobe's growth and market position.
Digital Engineering: Top 5 Imperatives for Communications, Media and Technolo...Cognizant
Many communications, media and technology companies share similar digital objectives. Here are our recommendations for realizing five common digital goals, and a look at a few companies that have succeeded with meeting them.
WhiteSource and FINOS: Empowering Financial Institutions to use Open Source W...DevOps.com
The days when financial institutions relied solemnly on proprietary code are over. Today, even the largest financial services firms have realized the benefits of using open source technology to build powerful, innovative applications at a reduced time-to-market. However, the financial services industry faces strict regulatory requirements that present it with a unique set of challenges, especially when it comes to open source usage (both consumption and contribution).
FINOS is a non-profit organization whose purpose is to accelerate collaboration and innovation in financial services through the adoption of open source software, standards and best practices. Together with WhiteSource, they are able to provide a safe environment for developers to use open source components freely and fearlessly.
Join FINOS and WhiteSource as they discuss:
The challenges of open source usage
The state of open source vulnerabilities management
How FINOS uses WhiteSource to ensure the security and IP compliance of FINOS-produced open source software
Lotus Connections is used by various organizations to address different challenges:
- A global manufacturer used it to reduce costs by leveraging a packaged employee directory solution instead of custom coding, and to improve cross-functional communication.
- A global telecommunications firm used it to increase innovation by involving customers and partners in developing new services through an online portal.
- A small non-profit used it to collaborate across disconnected teams on education projects through an activities component.
Our team analyzed competitors addressing screenshot management and identified alternative solutions. An ideal solution would use AI to automatically sort screenshots but required coding beyond our skills. Instead, we proposed an app allowing users to: 1) upload multiple screenshots to pre-defined categories, eliminating manual tagging; 2) search screenshots by text tags added during upload. This streamlined organization while being accessible across platforms with our limited technical abilities. User testing provided feedback to improve the solution's intuitiveness.
The document discusses generational differences in attitudes towards the importance of software as a competitive advantage between Microsoft, Google, and Facebook.
Microsoft historically viewed software as its primary competitive advantage and developed software for many markets. Google chose open source software and focuses on infrastructure efficiency rather than proprietary software. Facebook believes infrastructure software is non-differentiating and runs primarily on open source and publicly available software. Perceptions are evolving to recognize that software is less of a means to differentiate as it becomes more standardized and commoditized.
Social Business and Yammer | #onlinefuturetodayArjen Jelsma
1. Enterprise social networking can help organizations transform into social businesses needed to add value for customers, employees, stakeholders, and themselves.
2. A social business focuses on human factors over techniques and connects people to achieve more value. Social media facilitates this social business transformation.
3. A social business thinks about what employees, stakeholders, and customers need and adds value to their lives to benefit the business.
GovLoop Guide: Government Technology Year in ReviewGovLoop
This document provides a summary of key technology trends and developments in the US government in 2012. It begins with an overview of the results of a GovLoop survey of 250 government professionals on the most important technology trends of 2012 and those they are watching for 2013. It then details five major trends: the expansion of mobility in government; unlocking big data; cloud computing; bringing agile methodology to government projects; and increased use of social media. Each trend section identifies challenges, highlights successful case studies from 2012, and looks ahead to 2013. The document aims to serve as a roadmap for agencies to address challenges and provide a review of the past year in government technology.
Maitland Waters Social Media @ SOHO house_london_june_6_2011Symbio Agency Ltd
The document provides an overview of a presentation on digital strategy and social media. It discusses relationship networks and how social media can benefit businesses. It emphasizes the importance of an omnichannel digital strategy and highlights examples of how to measure return on investment from social media initiatives.
Make the leap, take the lead Slideshare | Accentureaccenture
The document discusses how companies can become "Leapfroggers" and close the performance gap between Leaders and Laggards in technology adoption. It finds that Leaders have significantly increased their growth rate compared to Laggards during the COVID-19 pandemic. To become Leapfroggers, companies need to replatform by moving to the cloud, reframe their mindset to focus on innovation and collaboration, and reach by expanding access to technology across their organization and addressing employee and social issues. Case studies are provided of companies like Santander, Carrefour, and Deutsche Telekom that exemplify these approaches and were able to adapt successfully during the pandemic.
Hatch Connect, an engineering consulting firm, implemented Open Text's Livelink ECM software to enhance collaboration among its 8,700 global employees. The key goals were to leverage communications, increase competitiveness to retain technologically-savvy employees, and appeal to younger generations' demand for social networking. Employees formed 73 communities on topics like bulk materials handling and sustainability. This allowed sharing of specialized knowledge globally and met younger employees' expectations for collaboration beyond email. The communities have enhanced expertise availability and information sharing.
Kronos is consistently identified as the global market leader for workforce management solutions. Multiple analyst reports and case studies cite Kronos' breadth of offerings, global capabilities, leadership in key industries like retail and healthcare, and ability to deliver strong ROI for customers. Kronos is particularly strong in North America and Western Europe and continues to drive innovation in areas like talent acquisition, mobile applications, and new user experiences.
Innovation in the Age of Global Collaboration - CrowdsourcingSaadick Dhansay
The rapid development of new technologies has given rise to new forms of collaboration. Organisations are able to collaborate on a global scale with individuals around the world, in order to conduct R&D activities as a result of Web 2.0 tools and technologies. This study focuses on three areas relating to global collaboration (crowdsourcing); people, processes and technology.
The purpose of this study is to understand the motivational factors of people that partake in global collaboration (crowdsourcing), the change of process with regard to bringing to new products and services to the market and how technology has changed the way organisations collaborate to achieve this. The research was conducted in the form of case studies to analyse how products were brought to the market through the use of global collaboration.
NASA is exploring various methods of open collaboration and innovation to advance its human health and performance initiatives. It has piloted several programs including challenges on InnoCentive, Yet2.com, and TopCoder to source novel solutions from external experts. NASA has also established the NASA Human Health and Performance Center and the Center of Excellence for Collaborative Innovation to institutionalize these open innovation efforts. The results have included new technologies and algorithms as well as potential partnerships. NASA plans to continue expanding these collaboration methods going forward.
Tony Zhang is promoting Fortune Data, an advertising platform that provides a one-stop solution for Western businesses to cost-effectively engage local Chinese consumers. It uses big data, business knowledge, and algorithms to allow programmatic and real-time bidding on web and mobile ads in North America and Europe targeting the growing overseas Chinese market. Fortune Data makes money by taking a 20% cut of ad costs. The $400 billion overseas Chinese consumer market is largely untapped and represents a major opportunity for growth.
This document provides an overview of opportunities for international partnerships between Chinese and Finnish companies. It discusses how both Chinese and Finnish companies need to pursue international expansion to drive growth. For China, internationalization is important as rising wages erode its low-cost advantage, and it needs to transition to a high-value economy. For Finland, emerging markets provide disproportionate demand that small Finnish companies need to commercialize innovation. The document introduces a market opportunity matrix that identifies four types of partnership opportunities depending on whether the target market/sector is developed/emerging or in a "sunrise" industry. These include opportunities in good enough, latent demand, breakthrough, and leapfrog markets.
CWKCommerce provides e-commerce services for North American SMB brands to enter the Chinese market in a quick and cost-effective manner. It targets fashion, luxury, and consumer goods companies and helps them establish online stores on Taobao. CWKCommerce handles all aspects of operations including website development, marketing, logistics, and customer service. It has proven success with clients such as Moni Moni, RAILS Clothing, and SASSY Baby.
TopCoder is a community of over 225,000 software developer and graphic designers. Our clients include large companies (Fortune 50) to start-ups who tap into the TopCoder Platform by holding online contests. This presentation gives an overview of the platform and describes how it can work for you.
TopCoder was founded by Jack Hughes as a crowdsourcing platform for software development after seeing issues with high costs and employee turnover at his previous company Tallan. It started as a competition-based model (v1.0) where clients would host competitions and the winner would be hired. It evolved to have different models where more tasks were broken out to the crowd (v2.0, v2.1). While revenue increased, costs associated with project managers decreased profitability. TopCoder addressed this through new pricing models and increasing prize money to motivate more of the latent crowd to be active.
Nicholas Hoffmeyer - Adobe Systems - BL_S2_2016Nick Hoffmeyer
Adobe Systems successfully transformed its business model from desktop software licenses to cloud-based subscriptions under CEO Shantanu Narayen. Facing challenges like slowing growth and high piracy rates, Narayen shifted Adobe's focus to the entire creative content value chain and cloud subscriptions. This transition was difficult but enabled faster innovation, recurring revenues, and access to new customers. Through acquisitions, restructuring, and convincing employees of the vision, Narayen completed the transformation in just three years, propelling Adobe's growth and market position.
Digital Engineering: Top 5 Imperatives for Communications, Media and Technolo...Cognizant
Many communications, media and technology companies share similar digital objectives. Here are our recommendations for realizing five common digital goals, and a look at a few companies that have succeeded with meeting them.
Buddy, partnered with industry leaders such as Amazon, Docker, Github, Microsoft, and Google, is a winning development automation platform that serves a rapidly growing market valued to become $345 billion by 2022. Over 7,000 developers use Buddy every day across 120+ countries. Featured customers: INC. Magazine, CGI.com & ING Bank. Our vision is to become the backbone on which talented people can build world-altering apps & services. Our goal is to take the load off millions of developers by offloading everything that can be automated – giving them back the time for being creative.
Organizing for digital why digital dexterity mattersRoel Palmaers
Digital organizations outperform competitors on key metrics like customer satisfaction and innovation by redesigning their organizations around digital technologies. The document discusses how companies like Starbucks, GE, and HSBC redesigned organization structures and processes to better harness digital opportunities. It also describes the four stages - stalling, initiating, engaging, and self-reinforcing - that companies progress through to become fully digital organizations. Finally, it identifies four dimensions critical for organizations to transform digitally: adopting a digital-first mindset, digitizing practices, empowering digital talent, and providing data and collaboration tools.
Organizing for Digital: Why Digital Dexterity MattersRick Bouter
- The document discusses how organizations that underwent major redesigns to take advantage of new technologies, like electrification and digitalization, saw large increases in productivity and performance.
- It provides examples of companies like Starbucks, GE, and HSBC that redesigned their organizational structures and processes to fully harness digital technologies, bringing together fragmented teams and standardizing systems.
- Research shows that "digital organizations" that have significantly invested in technology while redesigning themselves outperform peers on metrics like customer satisfaction and innovation.
This document brings together a set
of latest data points and publicly
available information relevant for
Digital Customer Experience
Industry. We are very excited to share
this content and believe that readers
will benefit from this periodic
publication immensely.
DAN Brand Accelerator: Client Pitch KeynoteJason Newport
Here is the Brand Accelerator pitch deck I began using to pitch current clients more than two years ago. I refined as we advanced through each phase once clients had signed on and we adjusted as necessary. I pitched this to more than twenty clients, all household brand names -- an converted each of them. Not a single brand declined to move forward.
Chordiant is a software company that provides customer experience solutions to help companies better understand customer behavior across multiple channels in real-time. It developed an online community called Chordiant Mesh powered by Jive's Clearspace to facilitate more transparent and collaborative software development. Over 1,000 individuals from over 30 companies across more than 20 countries now participate in Mesh. This approach has delivered software features customers want faster while improving productivity, differentiation, and customer loyalty.
The document discusses Arkadin, a leading provider of unified communications services for the digital workplace. Arkadin has experienced strong growth of 21% annually through its global yet local service strategy of delivering solutions tailored to each customer's needs through local teams. Arkadin's CEO Didier Jaubert is championing a strategy to become a digital workplace leader by capturing market share in unified communications. Arkadin offers solutions like Microsoft Skype for Business and Cisco Jabber to enable enjoyable collaboration experiences that drive teamwork.
Insights Success is a platform that focuses distinctively on emerging as well as leading IT companies, their confrontational style of doing business and way of delivering effective and collaborative solutions to strengthen market share.Our magazine talks about leaders and orators from the world of technology, which includes CEO’s, CIO’s, VP’s, Managers and other professionals who had set a benchmark in the revolution of IT industry.
In this edition of our business magazine, "Top 10 Low-Code/No Code Development Platforms" that are helping Code Development Platforms.
Read More: https://www.insightssuccess.com/top-10-low-code-no-code-development-platforms-february2022/
On the Road to Digital: Practical EncountersCognizant
Even with digital initiatives entering the mainstream, many business and IT leaders are still encountering headwinds. Here are the five most common challenges organizations face and potential workarounds that can help captains of industry more quickly and effectively digitally enhance their businesses.
This power point gives a birds view of Our vision,product,case studies and operatives. You can contact us at www.synthagile.com for further information.
This document provides information about a presentation by the members of a group on Adobe Inc. It includes:
1. The names of the group members and the presenter, M.Zain Rafaqat.
2. An executive summary of Adobe Inc., which was founded in 1982 and focuses on multimedia and creativity software, including Photoshop and Creative Cloud. It has over 21,000 employees worldwide.
3. Sections on Adobe's strategy formulation, analysis of its internal/external environment, business model transition to subscriptions, marketing strategy, and growth strategy to power digital businesses.
4. Presentations by other group members on Porter's Five Forces analysis of Adobe and the industry,
This document brings together a set
of latest data points and publicly
available information relevant for
Telecommunication & Media
Industry. We are very excited to share
this content and believe that readers
will benefit from this periodic
publication immensely.
Software Engineering: Designing a Better Experience for Communications, Media...Cognizant
Software makes the world go ‘round, from hyperefficient business operations to users wowed by the newest app interface and digital products. For CMT companies, software development innovation is the key not only to enhancing business agility but to rapidly designing and offering extraordinary experiences and cutting-edge products that will continually satisfy and delight customers.
CHAPTER 3
PROJECT MANAGEMENT
THE ESSENCE OF PROJECT MANAGEMENT
“First, have a definite, clear practical ideal; a goal, an objective. Second, have the necessary means to achieve your ends; wisdom, money, materials, and methods. Third, adjust all your means to that end.”
—Aristotle, ancient Greek philosopher and scientist
THE BBC DIGITAL MEDIA INITIATIVE
In 2007, the British Broadcasting Corporation (BBC) launched the Digital Media Initiative, an IT project meant to digitize media production and media asset management across the organization. Originally estimated at a cost of £80 million ($128 million), DMI was intended to introduce a tape- less workflow—from raw footage to finished programs—and give BBC staff immediate desktop access to the entire BBC archive. It was predicted that the DMI would save the company 2.5 percent in media production costs per hour, bringing a return of £100 million ($160 million) by 2015. In 2008, the BBC awarded the contract to Siemens, its long-time technology partner; however, that partnership broke down in 2009, with neither company taking direct responsibility for the failure. Rather, the two companies issued a statement saying, “The media environment has changed a great deal since the DMI project began, and both organizations have been in discussions about the way forward. The BBC and Siemens have reached an agreement that allows the BBC to complete the
Chapter 3
project in-house.” DMI was dubbed the “Don’t Mention It” project and delegated to the BBC’s chief
62
technical architect and executive producer.
Once in-house, however, DMI ran into a series of obstacles. Behind schedule, the IT team struggled to get end users to commit to firm project requirements and priorities. “Throughout the project, the team informed me that the biggest single challenge facing the project was the changes to requirements requested by the business,” said the former chief technology officer John Linwood. The result was a constantly fluctuating project scope.
In addition, the technology team sought to adopt an agile development approach, so that the software would be produced bit-by-bit, with the business units exploring each incremental release as it was developed. Linwood claims, however, that the business units did not want to take the time to test the releases. Eventually, the IT team simply developed major system components with minimal business unit testing. Meanwhile, the project was falling further and further behind sched- ule. In addition, the BBC did not assign anyone the responsibility or the authority to oversee the adoption of the program by the business units, depriving the DMI of effective project integration management. Because the transition from tape-based production and asset management to digital production and asset management necessitated a significant shift in work processes, management of the adoption and integration of the DMI into business units was essential.
In May 2013, the B.
This is a discussion of how firms that build strong skills in software development and data analytics, especially intelligent analytics, will dominate their industries in the next few years.
Pervasive, intelligent cloud ecosystems, spectacular firms and frontier firms...
1
1. (Êîììåíòàðèé "Âûäåëåíèå" Gunchenko
15.02.2013 17:28:44
ïóñòî)
9-610--032
JANUARY 1 55, 2010
KARI MM R. LAKHANI
DAVID A. GARVIN
ERIC L ONSTEIN
ToppCoderr (A): DDevelopping Sooftwaree througgh
Croowdsouurcing
In December 22009, Jack Huughes, CEO and founderr of TopCodeer Inc., enterred
his comppany’s
headqquarters in Glastonbury,, Connecticuut, eager to review a pparticularly
ccomplex sofftware
development projeect for an eneergy firm’s dyynamic poweer pricing systtem.
Eight yeears after founnding
TopCoder, Hughees still enjoyyed detailed project reviews. He waas particularlly
proud thaat his
company could prroduce high-qquality softwaare solutions for which hiis own
emplooyees did nott have
to wrrite a single liine of code. IInstead, the ffirm nurturedd a global
commmunity of mmore than 2225,000
progrrammers whoo competed too design and create softwaare modules for TopCoder
clients, a prrocess
that thhe popular prress called croowdsourcing.1
Huughes smiledd at the projecct’s success. TThe resulting software codde was
bug-freee and opera tional
on itss first day, a rrarity in the ssoftware induustry. Especiially impressive
to Hughees was that inn four
monthhs, 65 particippants from 1 1 countries inn 6 continents had competed in 57
conntests to creatte this
criticaal pricing syystem for thee client (see Exhibit 1). AAs of 2009, TopCoder
rooutinely prodduced
softwware solutionss for over 45 clients, incluuding AOL, Best Buy, Elii Lilly,
ESPNN, GEICO, annd the
Royall Bank of Scottland.
In the past eighht years, Hughes had refinned TopCoderr’s business mmodel to
accoommodate onngoing
changges in the sooftware induustry, while also pursuinng its uniquue
competitioon-based sofftware
development apprroach. He haad transitioneed his busine ss from a moodel that
helpped other sofftware
firms identify ’topp coders’ to aa company thhat developedd custom softtware
throughh a combinatiion of
tradittional IT conssulting servicces and comppetitions, pitting developeers
world-widde to solve cllients'
probleems.
Thhe shift to a greater emmphasis on competitionns, encompasssing all asppects
of software
development, howwever, meant that project volume was a "growing" issue--for
ToopCoder. Huughes
had too think throuugh how a commpetition-bassed business model, whichh
increasinglyy stressed conntests
as ann organizing,, as well as money-makking approacch, could hanndle increasees
in numbeers of
3. TopCoder (A): Developing Software through Crowdsourcing
solutions. But, was $200 million in revenue a reasonable goal? Did his
assumptions make sense? If
so, what would it take to increase revenues by over an order of magnitude?
Background and Current Operations
Before he founded TopCoder in 2001, Hughes had built a custom software
development2
company, Business Data Services, in 1985; renamed Tallan in 1991. Tallan
employed some 600 people
before being sold to CMGI in 2000.3 As he was completing the transaction, Hughes
reflected on what
he had learned from his experiences at Tallan--these experiences would inspire
the core tenets of the
TopCoder business model. Although Hughes enjoyed his time at Tallan, there were
areas in which
the company struggled. For example, recruitment was an expensive and frustrating
process because
finding qualified programmers was time consuming and talent was difficult to
assess. Due to
constantly evolving technologies, programmers’ skill sets often became obsolete
after only a few
years of productive service, leading to high levels of employee turnover.
Furthermore, despite
Tallan’s goal of maximizing billable hours, Hughes believed there were
opportunities to save clients
time and money by, for example, reusing computer programs’ basic components
instead of building
each application from scratch.
Drawing upon these and other insights, Hughes set about creating a new kind of
organization that
would build a "community" of programmers to help address the issues he had
identified. These
programmers would compete--as well as affiliate’by building and using components
that had
already been tested and found workable. The idea of reusing software components
for new projects
would become the core of the solutions the new company, called TopCoder,
provided. Hughes
envisioned the company as a ’two-sided platform’ for software development. One
side of the
platform would be clients, firms that needed software developed, who would work
with his staff to
specify programming challenges. The other side would be community members who
would compete
in contests to create solutions to the challenges for money and skill ratings.
TopCoder would be in
the middle as the platform host, designing and enforcing the rules of engagement
between clients
and the community members. Pete Bourdon, TopCoder’s CFO, explained the company
needed to
excel at five core tasks: breaking down large client software projects into
components, taking in and
processing client project specifications, determining appropriate contest
prizes, having a consistent
and unbiased way of picking contest winners, and fixing bugs at the back end of
development.
Setting out to amass an initial collection of highly skilled programmers, from
2001 to 2003
4. TopCoder asked established software development companies to sponsor world-wide
web-based
programming competitions. The sponsorships increased the popularity and
legitimacy of TopCoder’s
competition platform and provided the company with access to talented
programmers from around
the world. In return, the sponsors, including Sun Microsystems and Google, used
the contests to
advertise and recruit new talent. Tanya Horgan, TopCoder’s V.P. of Finance,
explained that during
the sponsorship phase, TopCoder offered unusually large prizes’as much as $5,000
to $10,000 per
match for tournament winners’to attract competitors and expand the community. In
addition, every
contestant that participated was given an objective numerical rating for their
performance against the
global talent pool, providing a clear signal to TopCoder and others about the
talent in the
community.
2 Custom software development done by specialist firms in the global IT
consulting and services sector (for example,
Accenture and IBM) was an over $500 billion segment in 2008. (Source: ’Global IT
Consulting & Other Services: Industry
Profile,’ Data Monitor, March 2009.)
3 Clint Boulton, ’CMGI Acquires Tallan for $920 million,’ February 14, 2000,
http://www.internetnews.com/ecnews/
article.php/303771 8/1/2009.
5. TopCoder (A): Developing Software through Crowdsourcing
By the end of 2004, the TopCoder community was 50,000 members strong. In its
early efforts to
use the community to generate revenue, TopCoder acted as a placement firm,
matching top rated
community members with firms seeking new talent. Hughes, however, was
dissatisfied: ’I cringed at
the idea of TopCoder becoming a placement firm. That was not my end-vision for
the company.’
As of 2005, TopCoder began to use its community to develop software components
and
applications. Hughes first tested this model by having highly rated community
members compete to
redesign and rewrite the firm’s own software platform. The resulting code was
higher quality and
much less expensive than TopCoder’s own internally developed solution. Hughes
now had positive
proof that complex software systems could be built through competitions.
Initially, TopCoder adopted a model to create solutions for clients by
contracting with community
members, running competitions, and providing consulting services. The company
broke down the
software development process into seven distinct but interrelated tasks; 1)
Conceptualization, 2)
Specification, 3) Architecture, 4) Component Production, 5) Application
Assembly, 6) Certification,
and 7) Deployment. Most revenue came from consulting services: TopCoder billed
clients for the time
the company’s platform managers spent conceptualizing and specifying client
problems, setting up
component design and development competitions, assembling components, and
delivering finished
solutions.
Shortly after TopCoder started developing software for clients, the company
identified reusable
components from the software it was creating and collected the components in a
catalog. These
software components became an important part of TopCoder’s value proposition to
its clients. Many
of the custom applications could be produced by combining existing catalog
components with new
components built through competition.
TopCoder’s hybrid consulting model led to large increases in revenues. However,
Hughes was
still dissatisfied: ’I viewed the hours-based services approach to be a broken,
inefficient model.’ In
2007 and 2008, TopCoder produced nearly $20 million in revenue but platform
manager costs
remained high (see Exhibit 2 for information on revenue and platform manager
costs). Attempting to
alleviate costs, in 2007 TopCoder introduced competition tracks for component
architecture and
assembly. With these new competition tracks in place, the work traditionally
done by platform
managers would now be done by the community. In 2008, the company also added
competitions in
software development tasks such as conceptualization and specification, as well
as deployment and
6. bug fixing.
By early 2009, TopCoder had moved increasingly away from the hybrid consulting
model. It now
focused on completing all tasks in software development through competitions.
Instead of paying for
time and materials for TopCoder platform managers, clients paid a monthly
platform fee, based on
the complexity of their software requirements and the estimated number of
competitions they would
run through the TopCoder platform each month. The platform fee also provided
clients with
unlimited access to the over 1400 components in TopCoder’s catalog. Roughly 60%
of most clients’
projects could be accomplished through reusing components from the catalog. The
move from the
hybrid consultancy model to a competition model was coupled with the reduction
of many platform
manager positions, leaving the company with 16 project managers servicing 35
clients by the end of
2009.
As of late 2009, TopCoder ran two different types of competitions on its
platform: algorithm and
client software development. Algorithm competitions served as the primary means
for attracting new
members and retaining existing members. These competitions required members to
develop creative
software solutions to relatively difficult programming challenges. All members
were assessed against
7. TopCoder (A): Developing Software through Crowdsourcing
each other through an automated computer scoring system; they then received a
TopCoder rating for
their performance. Some algorithm competitions also had cash prizes for winners.
The second type of competition was targeted at developing software applications
for specific
client needs. A TopCoder platform manager initially worked with the client staff
to develop a ’Game
Plan’ (see Exhibit 3 for a representative Game Plan) or a project road map for
building the software.
The first step typically involved a contest where the general client problem was
presented to the
TopCoder community in a conceptualization contest. Here contestants publicly
cross-examined the
client staff as to their actual needs and then submitted a business requirements
document and highlevel
use cases. The client picked the submission(s) that best represented their needs
as the basis for
further development. Then a series of specification contests were held to create
the applications
requirements documents, application wireframes (i.e. the logical flow of
application) and storyboards
(detailed cases of the user experience). Next, the output of the specification
contests were fed into
several architecture contests where the overall system and component level
designs would be
created. At this point the TopCoder platform manager would work with the client
to either select
components from the catalog or commission the creation of new components through
design and
development competitions. After the component production phase, all the relevant
components were
put together through an assembly competition with the objective of creating a
working system.
Assembly was then followed by certification and testing contests and then
eventually deployment.
Throughout the execution of the Game Plan, TopCoder retained flexibility in
development by
running ’Bug Races’ to accommodate changing client specification or unforeseen
errors. TopCoder
also had been issued eight U.S. patents on various aspects of running online
programming contests in
a distributed community setting and had other patents pending domestically and
internationally.
To determine winners and assess quality in client software development, TopCoder
used a
community-based peer review system. In particular, expert and experienced
TopCoder community
members were paid to grade and comment on all contest submissions using detailed
scorecards,
ultimately picking the contest winners. The winning competitors for each contest
were then awarded
monetary prizes and all participants were given updated ratings for their
performance. TopCoder
also ran Studio contests if an application required logos or graphics; in those
cases, clients chose the
winners.
Evolution of the TopCoder Community
8. Growth and Composition
From 2001 to 2009, TopCoder added an average of 25,000 new computer programmers
to its
community each year. After filling out a short online registration form, anybody
in the world could
participate in a software development competition; by spring 2009, the TopCoder
community had
over 200,000 members (see Exhibit 4 for community growth). Although the size of
the overall
community was large, the number of people within that community who actively
participated in
contests and posted in forums was much smaller. The majority of community
members at TopCoder
registered as members of the community but never competed in any contests. In
fact, by 2009, only
35,000 unique individuals had competed in contests. To Mike Lydon, TopCoder’s
Chief Technology
Officer, the remaining 82.5% of the community was the ’latent pool’: people who
were interested
enough in the TopCoder platform to register and had the potential to provide
TopCoder with
increased development under the right conditions.
A second group within the TopCoder community comprised those members who at one
time
participated in TopCoder contests but then stopped participating. Lydon noted
that, after TopCoder
decreased prize values in 2008, many competitors from the United States and
Canada left the
9. TopCoder (A): Developing Software through Crowdsourcing
TopCoder community. Yet another group included people who participated in
TopCoder contests
but did not win. TopCoder saw those competitors as the ’long tail’’people who
primarily
competed for the sake of learning. One of TopCoder’s main goals was to cultivate
the long tail so that
lesser skilled competitors could improve over time and increase their levels of
contribution. Lastly,
TopCoder’s most valuable group of competitors included the everyday winners. The
talent of
TopCoder’s elite programmers was equal to the best in the world, but such
members only accounted
for 0.5% of the total TopCoder population.
The core of TopCoder’s community was made up of single, highly competitive males
in their 20s.
According to Michael Paweska, a six-year veteran at TopCoder: ’To be successful
at TopCoder, you
must ask yourself, ’Are you a competitor?’ You need to be able to thrive on
competition; you can’t be
scared of it. You also need the flexibility to work long hours. TopCoder is a
bachelor’s sport: the
moment you become involved with someone else, it becomes a point of friction.’
TopCoder attracted
competitors from developed nations such as the United States, Canada, South
Korea, and Japan, as
well as from emerging economies such as China, Russia, Poland, India, and
Ukraine. Wu Yanbo, a
Chinese TopCoder community member studying abroad in Australia, explained that
most
competitors in the lower-paid contests were from developing countries. According
to Wu, the prizes
were not large enough for many individuals from developed countries to compete,
since they could
spend their time better elsewhere.
Justin Gasper, a member since 2001, began experimenting with the TopCoder
platform while
working for a traditional software engineering company. After winning
significant money with
TopCoder, Gasper decided to quit his job in 2005 and devote forty to fifty hours
a week to TopCoder.
Gasper explained: ’TopCoder is my full time job; I don’t have a day job.’ Gasper
was one of
TopCoder’s regular winners, a member of the ’global elite’ of programmers. In
architecture
competitions, Gasper came in at least 2nd place 95% of the time and had a win
percentage of 69.23%.
Competitors at TopCoder could choose which contests and what type of contests to
join (see Exhibit
5 for participation and prize data by contest type).
Profiles and Ratings
Each programmer in the TopCoder community maintained a public profile that
displayed his or
her user name, contest history, and basic personal information. Another part of
the member profile
displayed a competitor’s numeric rating for each type of contest. The rating
system was modeled on
the one used to rank grandmaster chess players engaged in worldwide competition.
10. A ’red color
rating,’ or a rating of over 2,200, represented elite status within the
community and a high skill level.
Yellow, blue, and green color ratings represented descending skill levels. Each
competitor’s country
rank, total community rank, success rates for contests, and reliability’or
percentage of times the
contestant joined a competition and submitted a passing solution’were featured
in their profiles.
TopCoder members could also choose whether or not they wanted to display their
total earnings on
their profiles (see Exhibit 6 for an example member profile).
Motivating Members
Between 2001 and 2009, TopCoder paid out over $20 million dollars in prizes and
peer review
money to its community of developers. However, prize money was not evenly
distributed
throughout the TopCoder community. The top 5% of prize earners received
approximately 80% of
the total prize pool, while the majority of TopCoder community members earned
little or no money
from competitions. Some competitors were extremely successful. For example, from
2006 to 2008,
Paweska earned $200,000 to $300,000 per year, while Gasper averaged over
$100,000 annually. Wu
commented: ’I have to say money is the most attractive thing. The prize is very
good compared to the
11. TopCoder (A): Developing Software through Crowdsourcing
income of my friends who are working in some local companies in China. Even
though the economy
is not very good and TopCoder reduced its prizes, I can still earn around $1000
per month in my
spare time.’ TopCoder typically awarded prizes to the top two submissions in
each contest, with the
lion’s share of the prize money going to the top performer.
Besides prizes awarded on a contest-by-contest basis, another main source of
income for members
was the Digital Run. In the Digital Run system, the top five ranked competitors
for each contest were
awarded points based on contest rank and performance. At the end of each month,
TopCoder tallied
competitors’ total points and awarded the top point earners thousands of dollars
in bonus prizes.
Paweska explained that success in the Digital Run was not all about who was the
best programmer
but more about who could handle the most all-nighters. Other competitors, such
as Gasper, also
made money through contracted projects that TopCoder assigned.
In addition to their cash earnings, many community members reported that their
TopCoder rating
was very important because it provided an objective assessment of ability. Wu
commented that it was
not easy to maintain a very high rating as it required familiarity with many
kinds of technologies,
quick thinking, the ability to learn independently, a strong work ethic, and
attention to detail.
According to Wu, a TopCoder rating could be important for a programmer’s future
career. For
example, a high TopCoder rating helped one of Wu’s friends earn a job at Google.
Gasper noted that
TopCoder ratings were also symbols of status and prestige for many programmers:
’If you have red
ratings, people look up to you.’ Indeed, many prestigious software firms asked
potential recruits to
get a TopCoder rating before applying for a job. To others, however, the rating
system was less
important. Gasper, for example, explained that winning and making money meant
more to him than
ratings.
Although there were differences of opinion regarding the importance of ratings,
almost all
community members agreed that competing at TopCoder provided numerous
opportunities to learn
and improve. In fact, for many programmers, a TopCoder career often began with
failure, but postcontest
evaluation and peer review of each submission helped them grow and improve.
Gasper
noted: ’I totally failed in my first competition. But the reviewers were really
good at pointing me in
the right direction, saying ’here’s where you went wrong’’. You can’t fake it
because you’re getting
peer reviewed by people who are better at programming than you are. The
reviewers don’t care if
they hurt your feelings; they are direct. If they see a bad design, they rip it
apart.’ Paweska agreed
that getting feedback from reviewers was crucial and added that community
12. members could also
learn from acting as a reviewer for contests. For scientists and developers, Wu
believed that
algorithm contests were particularly helpful at sharpening research skills and
improving critical
thinking abilities. In all cases, continual learning opportunities from peers
were an important reason
for participation.
Gasper described the appeal of working at home on a web-based platform instead
of in a
traditional ’cubicle farm’ setting: ’I like the flexibility that TopCoder gives
me. I don’t need to drive
a half an hour to work each day and can do the same work at home. If I want to
take off a day to play
golf, I just do it. I also don’t have to work from 2 to 6 pm, my most
unproductive hours.’ Sharing
similar sentiments, Paweska liked that while working at TopCoder he did not have
a supervisor
looking over his shoulder.
Setting one’s hours was convenient but also challenging, as competitors had to
actively manage
their individual levels of participation. Gasper constantly balanced effort and
reward to maximize
income while still living a sustainable lifestyle. ’If there’s something that is
way too much work for
the payment, I won’t do it’ that’s a super power I’ve developed. I know when the
spec is clean and
worthwhile to solve. It’s a skill that comes from doing tons and tons of
contests.’
13. TopCoder (A): Developing Software through Crowdsourcing
A ’Community’ of Competitors
Wu noted that, although the firm was competitive in sprit, competition at
TopCoder was never
disrespectful or nasty and that people liked to help each other, even when they
competed in the same
arena. TopCoder forums were the main source for collaboration. In the forums,
less experienced
community members asked for assistance on certain problems and received instant
feedback from
more experienced competitors.
At TopCoder, conversations and relationships extended beyond the scope of
software
development. Hughes reflected on a particularly remarkable exhibit of communal
strength and
caring for fellow community members outside of software development. ’When one
of the
community members died,’ he said, ’the outpouring of support was such that a
number of the
community members took all of their winnings for a few weeks and gave it to the
deceased’s wife. It
ended up being tens of thousands of dollars.’
Once a year, TopCoder paid for all of the best talent from the community to
travel to Las Vegas,
Nevada, to compete in the TopCoder Open (TCO). In additional to serving as a
proving ground for
the best programmers in the world, the TCO provided community members with the
opportunity to
network professionally and socially.
The TopCoder community had a distinctive culture, with identifiable
personalities. Wu explained:
’I believe this community, like all others, has its own culture. Clearly, the
members built it up
continuously. When I joined the community, there were already some leading
members who were
active in competitions and forums, brought out good suggestions, and started up
interesting and
important discussions.’ In some cases, the fame of community leaders extended
well beyond
TopCoder. For example, Tomasz Czajka, from Poland, achieved ’rock star’ status
and had his picture
plastered on billboards throughout Warsaw after he won the TopCoder Open in
2006.
The Client’s Perspective
Clients came to TopCoder to have high quality software developed in a cost
effective and time
efficient manner. TopCoder positioned itself to serve both large firms and
medium to small-sized
business that wanted to see systems developed. Keith Moore, a TopCoder client
and former Senior
Vice President at LendingTree.com, believed that, regardless of size, any
company could take
advantage of TopCoder, whether it was a five man operation or large outsourcing
vendor. For many
CIOs, the process of software development and talent recruitment was a major
headache, and missed
14. deadlines and large cost overruns were common worries. According to Stephen
Laster, the CIO at
Harvard Business School and a TopCoder client, ’A typical IT shop will turn over
48% of its
employees every three years. This process is very costly. The same problem
exists with our
outsourcing consultants. When selecting consultant teams, we tried out 60
programmers before
finding our team of 20. With TopCoder, I pay for performance and the CIO sees
Nirvana.’
As of 2009, TopCoder had developed a strong relationship with existing clients
for delivering high
quality software solutions and superior customer service. After completing their
first project with
TopCoder, 82% of clients signed up for a second round of contests. They cited
several advantages.
Benefits
Better Ideas Before sinking thousands of dollars into a project, a client could
run a
conceptualization contest through which TopCoder members helped identify bad
ideas and generate
better approaches early in the development cycle. When the client introduced a
business problem to
15. TopCoder (A): Developing Software through Crowdsourcing
the community, members asked hundreds of questions. Nic Perez, a former
Technical Director at
AOL, explained that the community’s questions ’gave us insights into problems I
didn’t even really
know I had’ and ’saved us money by doing all of those questions upfront.’ Using
online forums,
clients answered questions for all competitors only once, avoiding repeated
efforts. In some cases,
clients scrapped product ideas entirely after the community raised concerns
about the product’s
likely success or usability in the marketplace.
TopCoder’s contest-based development system consistently produced highly
creative ideas and
solutions. According to Darren Smith, a Solution Architect for the e-commerce
division at Ferguson
Enterprises, North America’s largest plumbing supplies wholesaler and
distributor: ’The community
comes back with many options. It really has surprised us. You never know what
you are you going to
get. The creative side allows us to go to the marketing management team and say,
’We could do x, y,
and z that we may not have previously considered.’ They’re adding value to our
business because
they bring us solutions that quite frankly we may not have considered or were
not resourced to
deliver.’
(Êîììåíòàðèé "Âûäåëåíèå" Gunchenko
15.02.2013 17:33:01
ïóñòî)
Superior Quality, Cost, Speed and Flexibility Clients praised TopCoder’s
rigorous
evaluation and documentation process for being well above industry standards.
Reflecting on his
experience working on the Google Talk interface to AOL Instant Messenger, Perez
stated that
TopCoder and its community had a strong desire to deliver bug-free code and that
even the most
complex systems always had fewer than 100 identified bugs. According to Perez,
the same sized
projects, developed internally, at AOL would have had 5-8 times that number of
bugs.
Another TopCoder client, a web-based startup business, noted that it would have
had to pay
$350,000 to a large IT consulting firm, $200,000 to a small IT consulting firm,
or $80,000 to individual
contractors to build the company’s website. Using TopCoder, the client only
spent $35,000. This same
client proclaimed: ’At $35,000, it’s priceless. There is no other game out
there.’ A different client
noted that based on its experience working with almost every type of software
development
company, TopCoder charged approximately half of the fee of a large, tier one IT
consulting firm.
Using the community for parallel problem solving, TopCoder marketed itself as
faster than
other software development shops. This was true for back end bug races and
16. system checks, as
TopCoder took 72 hours to complete the same bug testing that a traditional
development firm
finished in 10 business days. However, for other steps in the software
development process, reports
on speed were mixed as some clients said that TopCoder worked at about the same
speed as a large
IT consulting firm while others lauded TopCoder for speed of completion.
Especially appealing to clients was TopCoder’s ability to supply flexible
software development
capacity. In particular, a TopCoder client could expand or reduce its business
requirements and
development capabilities without having to hire or fire programmers. According
to one client, a basic
in-house computer programmer cost $120,000 a year, after accounting for
benefits, sick time, and
vacation. Working with TopCoder, clients did not have to spend as much on
employees’ benefits and
downtime.
Concerns
Although CIOs were impressed by TopCoder’s technical capabilities and cost
saving potential,
many often had initial reservations about working with TopCoder’s unusual
software development
model.
Intellectual Property and Security According to Ira Heffan, TopCoder’s Chief
Legal
Counsel, ’For new clients unfamiliar with TopCoder’s model, IP and security
concerns can be an
17. TopCoder (A): Developing Software through Crowdsourcing
initial point of resistance. Until they understand the documentation and
processes we have in place
with the community members, they see IP and security as potential barriers to
working with a
community.’ For example, some clients were apprehensive that a TopCoder
community member
might divulge proprietary ideas, business plans, or operations to their
competitors. In addition, some
clients worried that once a component became an integral part of their IT
systems, the community
member who built the component might attempt to prohibit its use or ask the
client to pay
considerable royalties. Lastly, some clients were concerned that a solution
submitted by a community
member could be stolen, copyrighted, or taken from open source software
projects, thus potentially
opening the door for intellectual property disputes.
TopCoder had in place a number of initiatives targeted at addressing these
concerns and reducing
the risk level for clients, and also took steps to communicate its processes. To
ease client’s intellectual
property and security concerns, TopCoder produced a white paper that detailed
confidentiality
policies, intellectual property assignment rules, and TopCoder’s modular
approach to software
development. In addition, TopCoder allowed clients to keep their company names
anonymous
during competitions and helped clients generate test data sets to avoid the
exposure of sensitive
information. At the client’s request, before a community member was allowed
entry into a
competition, all competitors could be required to sign a standard Competition
Confidentiality
Agreement.
The peer review process was another means to ensure code security and quality.
Peer reviewers
were selected and vetted by TopCoder employees based on their superior
performance on prior
competitions. TopCoder clients also had the option of running testing
competitions at the back end of
software production, serving as an additional means of checking code security
and quality.
TopCoder’s compartmentalized software development process also made it difficult
for a single
competitor to insert harmful code into a program, since individual contests only
addressed one small
piece of the overall program.
Cultural Change Many clients realized that working with TopCoder would be
difficult
culturally for their company. In particular, CIOs believed that internal
employees would view
TopCoder as a threat to their job security. One new client observed: ’TopCoder
is a CIO’s dream but
a programmer’s worst nightmare. I fully expect that if this goes well and if my
programmers see
good quality work coming out of TopCoder, fear will quickly explode throughout
the building.’
Although using TopCoder could help a company scale and reduce the programming
18. staff costs,
companies still had to retain the ’big thinking’ people’the employees who could
guide the
TopCoder development process. The managers at TopCoder clients also had to
adjust to a perceived
loss of control over the software development process. Smith commented: ’We set
the competitions,
but they manage the whole process. Our project management group works with the
TopCoder
manager to ensure delivery according to pre-determined SLAs (Service Level
Agreement).’ Some
clients even found a few community members to be pushy and rude during pre-
competition question
and answer sessions.
Coding Challenges Even if TopCoder did all of a company’s internal development
work, the
company still needed to have an internal staff to integrate the deliverable into
the client’s existing
systems, review the code for security issues, and adjust and fix code as systems
changed over time.
For example, Smith’s team at Ferguson spent a significant amount of time
inspecting, testing, and
processing TopCoder’s work to make sure that there were no security threats or
bugs. In some
contests, TopCoder clients also spent time evaluating ideas and approaches from
multiple winning
solutions.
Another ongoing issue for clients was finding the right types of problems and
providing the
appropriate amount of problem detail for the TopCoder community. As Moore
described it, ’You
19. TopCoder (A): Developing Software through Crowdsourcing
want neither too much nor too little detail. You do not want to quell innovation
but also want a
solution that makes sense in your system.’ Clients discovered that contest
participation decreased if
they were unclear about what problems they wanted to solve or presented problems
that were too
complex or vast in scope; in those cases, the TopCoder community struggled to
produce an
acceptable solution. Clients also found that community members worked best when
contests lasted
less than two weeks. If projects took too long to complete, contestants would
lose interest and not
make submissions.
Managing TopCoder
The Supply Side
A management job at TopCoder was unique. Along with supervising internal
TopCoder
employees, managers at the firm had to oversee a community of over 200,000
members and direct the
process of competition-based software development. According to Senior Vice
President George
Tsipolitis, the key to success was effective process management: ’When you’re
managing a
community, you are no longer managing individuals, you’re managing a whole. We
can’t control
individuals. We can only control the process of their participation.’ Clients
and employees alike
believed that the sustainable value of the company was dependent on TopCoder’s
ability to facilitate
community participation and foster community growth. Lydon described the risks:
’From the
beginning, we focused on the community. We knew they could be unforgiving. If
you did the wrong
thing, you got crucified.’
Attraction To run many competitions simultaneously and produce solutions for
many clients
at the same time, TopCoder needed to have access to a critical mass of talent
and coding capacity.
TopCoder’s primary means of attracting new members into the community was the
appeal and
challenge of the algorithm challenges. In addition, TopCoder occasionally
advertised its online
competition platform by paying for Google keyword searches using terms such as
’design contests.’
A third mechanism for attracting talent was ’member development days.’ Organized
by a small
team of TopCoder employees, member development days were held at Chinese and
other
international universities. At a member development day, a student
representative would post signs
around the school and explain the TopCoder system. A primary goal of these
member development
days was to encourage participation in the higher revenue producing development
and design
contests. During one member development day in China, TopCoder registered over
one thousand
new community members. Bourdon noted that TopCoder had achieved critical mass
20. once it crossed
the 200,000 member threshold as there were now many members with deep and narrow
skills over a
range of software development challenges (See Exhibit 7 for the number of
participants by contest
type).
Norms As the community grew, TopCoder paid close attention to establishing
community
norms. As contest administrator, the company had to maintain the highest
standards of contest
integrity, fairness, transparency, and quality. For example, TopCoder personnel
strictly monitored
competitions and tolerated no form of cheating. Community members who peeked at
other
competitors’ solutions, shared ideas during competition, or used unauthorized
code were
immediately eliminated from the contest. Often they were kicked out of the
community entirely.
If any uncertainty or disagreement arose about which competitor won a particular
contest,
TopCoder would spend the extra money to re-run the competition. Another part of
contest integrity,
Tsipolitis explained, was TopCoder’s emphasis on maintaining consistency of
rules and procedures:
’The second that participants can’t figure out how to win, they’ll stop
participating. So we can’t
change the rules of a competition mid-stream.’ TopCoder also guaranteed complete
contest
21. TopCoder (A): Developing Software through Crowdsourcing
transparency by storing all contest and competitor statistics, peer reviews, and
solutions in a data
warehouse. The data were publicly available to registered community members,
accessed via the
TopCoder website.
Integrity and fairness also extended to TopCoder’s corporate motivations and
community
compensation philosophy. In particular, TopCoder was upfront with the community
over its
intention to make money. When TopCoder made a decision to change corporate
direction or
competition procedures, Hughes posted the information in the forums and
explained the business
reasons behind his decisions. Hughes also believed that, since the company
benefited from the
community’s hard work, adequately compensating community members was essential.
Governance Although TopCoder executives were responsible for final decisions,
they
frequently incorporated community members’ views into the process. Lydon
explained: ’We treat the
community as the driver for everything we do. If we have enough dissent from
members, we always
take that into account. The problem is that when we don’t know what to do, our
members will also be
split.’ Community member Gasper, shared a similar perspective: ’TopCoder tends
to push out ideas
into the forums to get feedback. Seventy-five percent of the time, they listen
to the community. But
TopCoder also has its own business interests to consider. Sometimes the
community and business
interests don’t line-up.’
Similarly, if competitors were unhappy with a peer review scoring outcome,
TopCoder allowed
them to appeal the decision. Over 90% of contests featured at least one appeal.
If a member appealed,
peer reviewers had to provide specific reasons why the appeal was accepted or
rejected. If
disagreement remained between contestant and reviewer, TopCoder employees often
investigated.
Contestants could also appeal directly and privately to TopCoder personnel or
post complaints
publicly on the TopCoder forums.
TopCoder managers inevitably made decisions that sometimes disturbed and upset
the TopCoder
community. For example, facing a very difficult economic environment in the
summer and fall of
2008, TopCoder reduced the contest prize amounts, cut payments to peer
reviewers, and reduced the
number of algorithm competitions. During this period, some TopCoder competitors
left the
community entirely and others dramatically reduced their participation levels.
Gasper argued that
the payment cuts also led to many superficial reviews because the best reviewers
were no longer
doing the work, which then required additional cycles to achieve acceptable
quality.
22. Resource Allocation Another part of the TopCoder managerial role was allocating
community resources and controlling contest participation. Lydon explained, ’We
have to figure out
how to distribute the number of people who want to participate across the number
of contests that
have to be solved.’ Unlike a typical software development firm, TopCoder could
not assign specific
people to a task or project. As participation manager, TopCoder’s goal was to
minimize the costs of
evaluation, stimulate effort through competition, and get at least one solution
that was acceptable to
the client. To achieve the ideal number of submissions and participants,
TopCoder adjusted the prize
amount, the duration and timing of the contest, the number of other contests
running concurrently,
and the problem’s complexity and scope. When deciding on the ideal number of
competitors,
TopCoder also considered contestants’ reliability. As a last resort, TopCoder
employees reached out
directly to individual community members if other methods did not lead to the
desired participation
levels.
Although TopCoder managers could pull many levers to influence contest
participation, they
believed it was important not to act like the community’s boss. Hughes explained
his community
management philosophy: ’We don’t own this community. We want people to be here
when they
23. TopCoder (A): Developing Software through Crowdsourcing
want to be here. You are just going to get much better results when you let
people do what they
really want to do.’
Retention At the same time, TopCoder executives worked to retain community
members and
encourage future contest participation. At least one client raised concerns in
this area: ’I think that
communities are fickle. Community members could start to ask, why do I need
them? For example,
what happens if an imitator comes along and offers 2x the prize amount?’ To
avoid such problems,
TopCoder tried to supply community members with consistent work streams and
prize money.
TopCoder also encouraged community members to engage in the community as much as
possible by
dedicating significant resources to facilitating forum discussions and inviting
contestants to
participate in peer reviews, write problems for contests, and develop TopCoder’s
internal systems.
TopCoder community members differed on their level of loyalty to the TopCoder
community.
Paweska, appreciative of all the opportunities TopCoder had provided, reflected,
’I have some
loyalty. I think it would take a lot for me to leave. Only if there were no
projects would I leave.’
Gasper viewed his position in the community in a different light. ’I’m not super
loyal to TopCoder or
anything,’ he said. ’To defect, the payment and work would have to outweigh the
payment and
flexibility I have at TopCoder.’
The Demand Side
Platform Managers The other side of management at TopCoder was guiding clients
through
the contest-based software development process. This was the responsibility of
the company’s
platform managers, whose job was to induce the appropriate amount of community
participation,
make suggestions for contest prize amounts, gather feedback between contests,
and provide project
status updates to clients. Before starting the next step in the Game Plan,
platform managers also
adjusted contest requirements based on the work already completed. Once the
product was delivered
to the client, TopCoder platform managers were required to act in a support and
service role. If there
was a technical problem with a solution, the platform manager often contacted
the community
members who developed the component and worked with the community members to fix
the issue.
Most enterprise-level clients believed the platform manager was pivotal to a
project’s success. At a
large client like LendingTree, the platform manager was onsite three to four
days a week, conducting
daily meetings with the internal teams. A large part of the platform manager’s
role was managing
client expectations and serving as a sounding board for client concerns. At the
24. backend of projects,
although the community often assembled a project’s components through
competition, the platform
manager was also an expert at combining the small software pieces. The component
integration role
saved the client hours of work trying to figure out how all the pieces fit
together. At Ferguson, Smith
considered the TopCoder personnel working onsite to be an integral part of his
team.
TopCoder Direct However, each platform manager added to TopCoder’s overhead
costs and
narrowed profit margins. As of 2009, a typical platform manager at TopCoder cost
$100,000 a year
including benefits. To Tsipolitis, the platform manager’s time was not always
well spent. ’Our project
managers spend a lot of time babysitting,’ he said.
To avoid a potentially large increase in expenses as TopCoder added clients and
projects, Hughes
came up with the concept of ’TopCoder Direct,’ in which the client used the
company’s platform
with little to no intervention from its employees. Under this self-service
model, platform managers
would educate clients on how to use the TopCoder platform to manage the contest-
based software
development process themselves. Hughes envisioned shifting the platform
manager’s responsibilities
to an experienced community member or an external consultant familiar with
TopCoder’s platform’
someone who would serve as a ’co-pilot’ to assist the client staff. With co-
pilots taking the role of
25. TopCoder (A): Developing Software through Crowdsourcing
platform managers, Hughes estimated that the platform manager’s weekly time on a
project would
shrink from forty hours to two, thus saving the client and TopCoder considerable
time and money.
The Future
As of December 2009, no competitors had elected to copy TopCoder’s business
model by offering
full service software development through a competition-based approach. Instead,
companies such as
RentACoder, Elance, and oDesk served as online liaisons between clients and
freelance software
developers. Unlike TopCoder, whose clients only paid for solutions, clients at
these firms used a ’buy
talent’ approach: they selected one or more programmers to solve their problem.
More similar to
TopCoder, uTest used crowdsourcing to find bugs and check the functional
usability of web, mobile,
desktop, and gaming applications, but did not engage in software development.
According to
Hughes, this lack of direct competition reflected the technical difficulties and
costs associated with
building a full-fledged community and platform.
After a significant downturn in the global economy in 2008 and 2009, Hughes
believed that
TopCoder was primed for growth. Sales staff were forecasting aggressive targets
for the volume of
competitions and revenues and there were several strategic partnerships under
consideration.
However, significant challenges and uncertainty remained. In particular, Hughes
wondered whether
the community, as well as the company, could grow to meet increasing demand.
Stakeholders had divergent views. Mike Morris, Vice-President of Sales, saw
unlimited potential:
’If sales grow at a linear rate, membership grows at an exponential rate. The
supply of community
members is not going to limit growth. If you throw enough money out there, you
will get enough
programmers.’ Community members Paweska and Wu agreed that offering more money
per contest
would increase participation among existing members. Paweska also believed,
however, that holding
many more contests than usual in a given week would result in inexperienced
competitors competing
actively for the prizes, possibly reducing code quality. Furthermore, Lydon
noted that that during
TopCoder’s last large scale up in 2007, review quality suffered during a
transitional period of a few
months. As more contests became available, the usual reviewers wanted to compete
in the contests,
rather than review them, leaving TopCoder scrambling to find replacements. In
addition, a few
clients worried that as the number of avenues of competition at TopCoder grew,
attracting the same
group of competitors would prove much more difficult, reducing contest
consistency and continuity,
which were especially critical for addressing legacy systems.
26. Hughes also worried about client service. If the number of TopCoder clients
expanded
significantly, TopCoder’s staff might face increasing difficulties responding to
all those clients’
questions and concerns. For large clients, expansion might require adding more
platform managers,
but Rob Hughes, TopCoder’s COO, was concerned that too many platform managers
might make the
firm appear to be like any other large IT consulting company, with the risk of
losing its unique
business model.
Even if Hughes succeeded at growing TopCoder, he was unsure about the company’s
competitive
position. In particular, Hughes wondered if community members would stick with
TopCoder if a
new competition-based software development company emerged. What would happen if
a company
like Accenture started to develop software in the same way as TopCoder? Would
the TopCoder
community remain intact?
27. 610-
032
-
14
Exhibit 1
TopCoder Members Involved
in Making
a Power
Pricing System
for an
Energy
Company
Source:
Company documents;
Developed
via
a
TopCoder
Studio competition.
28. 610-
032
-
15
Exhibit 2
Number of Clients, Revenue,
Number of
Platform
Managers
and
Platform
Manager
Costs by Quarter
2007
2008
2009
Q1
Q2
Q3
Q4
Q1
Q2
Q3
Q4
Q1
Q2
Q3
Q4
Number of Clients
3232
34
25
24
38
37
47
46
47
38
35
Total Revenue
($MM)
4.66
4.50
3.80
5.35
5.80
5.50
4.85
2.60
2.25
1.92
1.82
2.45
Number of Platform Managers
51
51
44
29. 52
52
46
44
36
20
19
18
16
Cost of Platform Managers ($MM)
a
1.23
1.24
1.12
1.30
1.36
1.19
1.13
0.91
0.53
0.49
0.46
0.40
Source: Company statistics.
aIncludes
Platform
Managers salaries, benefits
and other expenses.
30. 610-
032
-
16
Exhibit 3
Sample Game
Plan
Phase
# of
Contests
Estimated
Costs
M
T
W
TF M
T
W
TF M
T
W
TF M
T
W
TF M
T
W
TF M
T
W
TF M
T
W
TF M
T
W
TF M
T
W
TF M
T
W
TF M
T
W
TF M
T
W
TF M
T
W
TF M
T
W
TF M
T
W
TF M
T
W
37. TopCoder (A): Developing Software through Crowdsourcing
610-032
Exhibit 4 Community Growth
250,000
0
50,000
100,000
150,000
200,000
Total
Community
Members
Source: Company statistics.
Exhibit 5 Average Contest Registration, Submission and Prize Amount for Client
Contests in 2008
and 2009
2008 2009
Contest Type # of Submissions Prize $ per # of Submissions Prize $ per
Registrants per Contest Contesta Registrants per Contest Contesta
per Contest per Contest
Conceptualization n/abn/ab n/ab 17.57 3.60 $1,314
Specification n/abn/ab n/ab 14.20 1.94 $1,017
Architecture 16.3 1.64 $1,590 19.34 1.75 $1,095
Component
Design 9.83 2.85 $899 16.26 1.94 $559
Component
Development 15.4 2.69 $733 25.59 2.56 $465
Assembly 16.09 1.12 $1,628 18.38 1.18 $913
Studio 27.55 14.57 $795 27.57 20.04 $1,015
Source: Company statistics.
aPrize per contest= Prize for 1st & 2nd places and reserve for Digital Run.
bn/a- Data not available for most of 2008.
17
38. TopCoder (A): Developing Software through Crowdsourcing
Exhibit 6 Example Community Profile
Source: http://www.topcoder.com/tc?module=MemberProfile&cr=287614 - 12/23/2009.
39. 610-
032
-
19
Exhibit 7
Number of
unique participants by contest type per
year
and month/
Total number of official contests per year
2005
2006
2007
2008
2009
Contest Type
Average Submitters
per Month
per Year
Contests per Year
Average Submitters
per Month
per Year
Contests per Year
Average Submitters
per Month
per Year
Contests per Year
Average Submitters
per Month
per Year
Contests per Year
Average Submitters
per Month
per Year
Contests per Year
Algorithm Contests
Single Rounda Marathon Matchb
Client
Software Development Contests Conceptualization
Specification Architecture Component Design Component Dev. Assembly Design
Contests Studio
Totald
1,319
5,287
500c
500c
33
157
58
316
1,370
5,565
81 1c 362 287 730
1,930
7,525
273
1,532
45
41. 429
2,911
11,122
5135 7071145300337416 456 1,881
Source: Company statistics.
a
75
minute
programming contest.
b
Programming
contest
that
run
from
3-
30
days.
c
Partial
year
data
’
contest track
officially
did not
officially
start
until the
middle or
end of the year.
d
Represents
the unique number
of
participants
during a
given
time period. Columns
are not additive.