SlideShare a Scribd company logo
Topcoder Reflections
MICHAEL CONTRERAS | CROWDSOURCING WEEK GLOBAL | 10 / 25/ 2018
A Decade of Public Sector Crowdsourcing
Topcoder was founded with a simple goal: identify the best
developers in the world through competition.
Over the past decade, Topcoder has been a catalyst for
public sector crowdsourcing, reframing the way the US
Federal Government develops software and conducts
R&D.
Topcoder
Community
Topcoder is home to the
world’s largest network of
Designers, Developers, and
Data Scientists.
The Topcoder Community
includes more than 1.3
million members from every
country around the world.
Community members in
over 190 countries
More engineers than
Microsoft, Facebook,
and Twitter combined
Challenges
per quarter
New members
per week
Paid to the
community
Logins every
90 days
1M+ 5x 1400
1800 $80m 35k
Where we have been . . .
2001
Topcoder launches gamified
platform for computer
scientists to demonstrate
skills and gain notoriety.
First Topcoder Community
member ratings are published.
2010
The NASA Tournament Lab is
formed. Topcoder begins to
work on app dev and
algorithm projects for many
Federal agencies through
Harvard.
2005
NSA begins to sponsor the
Topcoder Open for recruiting
purposes.
Full application development
stack capabilities added in
2006.
2004
Harvard publishes its first
academic study on Topcoder.
First commercial offering for
software components.
2011
Topcoder is onboarded to the
GSA Schedule for Challenges
and Competition Services.
DARPA taps Topcoder to
launch STEM education
community for teens.
2015
Topcoder is awarded a spot
on the NASA Open Innovation
Services contract vehicle
through 2020.
Topcoder and Apple partner to
launch the iOS Community.
2007
First commercial Marathon
Match conducted to develop
an enterprise data science
solution.
Topcoder Community expands
to include UX design.
2017
Topcoder has run challenges
for CMS, I-ARPA, EPA, Air
Force, DOE, VA, PTO, OPM,
USAID
Topcoder and IBM partner to
launch the Cognitive
Community.
2016
Topcoder surpasses 1 million-
member mark.
Topcoder and GE partner to
launch the IoT Community.
Wipro acquires Topcoder to
transform its business and the
IT services industry.
2009
The NSA “Enigma” Marathon
Match is hosted on Topcoder
based on the famous WWII era
decoding of the Enigma
machine, a cryptographic
security system.
01 04 05 07 09 10 11 15 16 17
6
It started with recruiting…
7
8
9
10
11
12
13
14
Algorithms and R&D
16
17
DATA SCIENTISTS
450K
AVERAGE # COMPETITORS
PER CHALLENGE
78
AVERAGE #SUBMISSIONS
PER CHALLENGE
578
Topcoder’s Data Science Community
18 Algorithms and Analytics Sales Enablement
Algorithms and Analytics Overview
Products
● Algorithm Optimization
● Predictive Analytics
● Image and Pattern Recognition
● Objective Optimization
Crowdsourcing Contests
● Marathon Match
● Banner Match
● Mini Marathon Match
● Data Science First-to-
Finish (F2F)
● Data Science Sprint
● Data Visualization
● Data Science Ideation
Objectively scores with an automated scoring function that feeds the Topcoder live leaderboard.
Restricted to the following languages: Java, C++, C#.NET, VB.NET, or Python.
Objectively scores with an automated scoring function that feeds the Topcoder live leaderboard.
Competitors are allowed to use any language and libraries to write their solution.
A shorter duration, more straight-forward version of the Marathon Match. Has the same structure
and rules of a regular Marathon Match but a smaller prize purse for competitors.
Objectively scores with an automated scoring function that feeds the Topcoder live leaderboard.
Restricted to the following languages: Java, C++, C#.NET, VB.NET, or Python. A predetermined
threshold is selected for the match, and once a competitor reaches the desired threshold score
the match ends and the first place winner receives the one prize available.
A series of smaller, more rapid data science challenges with a manual scoring function and no
leaderboard. Competitors are allowed to use any language and libraries to write their solution.
A hybrid project completed by a series of data science tasks to find the unique qualities or
“highlights” in the data, followed by design challenges to visualize the data. The output of this
kind of project is static screens.
Looks to discover or learn new approaches, data, and ideas from the community.
Predictive Toxicology -
Environmental Safety
Predictive Analytics
Every day we come into contact with common pesticides. Which chemicals,
in what dosage, can cause us harm? See how the EPA used crowdsourcing
to deliver more accurate predictive analysis.
Learn More
338 49
a Brand New Approach
discovered, tested, and shared with their scientific community
REGISTRANTS COMPETITORS
804
SUBMISSIONS
3
CHALLENGE DURATION
WEEKS
21
Offering Design and
Development
Outcomes?
22
Topcoder Studio circa 2009
24
Application
Wireframe
25
Translate your mobile or web app idea into a structured design brief
that includes a description of the design concept, use case scenarios,
design guidelines, and a low-fidelity mockup of basic UI/UX elements.
What’s Included
Application design brief crowdsourced in the Topcoder Marketplace.
A Topcoder copilot manages all logistics.
What You Receive
Written visual design brief for up to five screens of a single application.
You pay only for the winning brief, not hours, and you own the final
deliverables.
Design Brief
Plan the UI/UX design of your application
Application Wireframe
26
Code
Development
Code
Development
27
Code Development packages make it easy to add the people and skills
you need to round out your team, free valuable time, and accelerate
development.
Crowdsource specific phases of your development process or end-to-
end application builds.
What’s Included
Code or task crowdsourced in the Topcoder Marketplace.
A Topcoder copilot manages all logistics.
What You Receive
Ready-to-deploy code, interface, or service built to your specs. You pay
only for the winning code, not hours, and you own the final deliverables.
Code Development
Enterprise-grade code for every stage of the dev life
cycle
Code Development
POWERED BY
Eight month
challenge
Multiple concurrent
development work streams
Third round
of human
testing
29
New HorizonsVA WORKFORCE DEVELOPMENT
This is footer and you can change the content or delete if you wanted to
30
What is the TCVC?
The TCVC is Topcoder’s Veterans Community
● The VA has 3 projects in motion at Topcoder via NASA - web, analytics & mobile
● Each VA project includes funding for the TCVC
● Topcoder teams with OperationCode, a veterans 503(c) to source members
The TCVC is a place for US Veterans and Active Duty to learn and compete
The TCVC is hosted as a private community within Topcoder’s platform
● Challenges run inside the TCVC are open only to US Veterans and Active Duty
● Challenges types run from “Hello World” style to complex multi-challenge series
● Challenges also come to the TCVC via the VA’s projects as well
● Topcoder challenges can be cross-posted to TCVC with different prizes On veterans.topcoder.com, Vets compete
against each other, mentor each other, code
solutions for paying customers, earn
prizes and payments, and build their
resumes by working on actual customer
solutions.
31
What are the goals of the TCVC?
VA Goals
Cultivate and Prepare veterans for entry into the tech world
● Give veterans the opportunity to PROSUMERS
● Provide opportunity for veterans to demonstrate current, marketable tech skills
Topcoder Goals
Use the TCVC as an incubator for new community members
● Cultivate new members
● Train and grow new copilots who will eventually lead projects in our regular
community
● Create a compelling story for Topcoder
32
Our moment . . .
Army Air Forces
ARPA
BBN
Telenet Inc.
Harvard Topcoder | Wipro
?
37
Special thanks to . . .
Andy LaMora
Clinton Bonner Rashid SialJessie Ford
Mike Morris Brendan Wright

More Related Content

Similar to Topcoder Reflections: Observations from a Decade of Crowdsourcing with the Public Sector

What is CloudSpokes?
What is CloudSpokes?What is CloudSpokes?
What is CloudSpokes?
Raymond Gao
 
Open source presentation
Open source presentationOpen source presentation
Open source presentation
Rona Segev Gal
 
Open Source Software Development by TLV Partners
Open Source Software Development by TLV PartnersOpen Source Software Development by TLV Partners
Open Source Software Development by TLV Partners
Roy Leiser
 
Workshop - Architecting Innovative Graph Applications- GraphSummit Milan
Workshop -  Architecting Innovative Graph Applications- GraphSummit MilanWorkshop -  Architecting Innovative Graph Applications- GraphSummit Milan
Workshop - Architecting Innovative Graph Applications- GraphSummit Milan
Neo4j
 
International developers and building for the next billion users
International developers and building for the next billion usersInternational developers and building for the next billion users
International developers and building for the next billion users
Ugonna William Imoh
 
Open Source
Open Source Open Source
Open Source
Liron Zighelnic
 
Quicklook technology assessment topmod software_ccchittim
Quicklook technology assessment topmod software_ccchittimQuicklook technology assessment topmod software_ccchittim
Quicklook technology assessment topmod software_ccchittimClaudia Chittim
 
Developing internationally building stuff that works across the world - adobe
Developing internationally   building stuff that works across the world - adobeDeveloping internationally   building stuff that works across the world - adobe
Developing internationally building stuff that works across the world - adobe
Ugonna William Imoh
 
IronHacks Live: Info session #3 - COVID-19 Data Science Challenge
IronHacks Live: Info session #3 - COVID-19 Data Science ChallengeIronHacks Live: Info session #3 - COVID-19 Data Science Challenge
IronHacks Live: Info session #3 - COVID-19 Data Science Challenge
Purdue RCODI
 
ANIn Pune July 2023 |Prompt Engineering and AI first SDLC by Abhijit Shah
ANIn Pune July 2023 |Prompt Engineering and AI first SDLC by Abhijit ShahANIn Pune July 2023 |Prompt Engineering and AI first SDLC by Abhijit Shah
ANIn Pune July 2023 |Prompt Engineering and AI first SDLC by Abhijit Shah
AgileNetwork
 
Platform Dynamics - The rise and dominance of Platforms
Platform Dynamics - The rise and dominance of PlatformsPlatform Dynamics - The rise and dominance of Platforms
Platform Dynamics - The rise and dominance of Platforms
Jason Dojc
 
Continuous Integration
Continuous IntegrationContinuous Integration
Continuous Integration
Meni Lubetkin
 
SFScon 2020 - Cedric Thomas - Open Source ecosystem sustainability bring the ...
SFScon 2020 - Cedric Thomas - Open Source ecosystem sustainability bring the ...SFScon 2020 - Cedric Thomas - Open Source ecosystem sustainability bring the ...
SFScon 2020 - Cedric Thomas - Open Source ecosystem sustainability bring the ...
South Tyrol Free Software Conference
 
How to Maximize the Role of Insights Throughout the Product Lifecycle
How to Maximize the Role of Insights Throughout the Product LifecycleHow to Maximize the Role of Insights Throughout the Product Lifecycle
How to Maximize the Role of Insights Throughout the Product Lifecycle
IntelCollab.com
 
Crypton Studio Presentation
Crypton Studio PresentationCrypton Studio Presentation
Crypton Studio Presentation
AlexMainov
 
Introduction to OpenDaylight
Introduction to OpenDaylightIntroduction to OpenDaylight
Introduction to OpenDaylight
Open Networking Summits
 
GEETHAhshansbbsbsbhshnsnsn_INTERNSHIP.pptx
GEETHAhshansbbsbsbhshnsnsn_INTERNSHIP.pptxGEETHAhshansbbsbsbhshnsnsn_INTERNSHIP.pptx
GEETHAhshansbbsbsbhshnsnsn_INTERNSHIP.pptx
Geetha982072
 
42DM Credentials: Blockchain & Crypto
42DM Credentials: Blockchain & Crypto42DM Credentials: Blockchain & Crypto
42DM Credentials: Blockchain & Crypto
42DM
 
TRIK robotics
TRIK robotics TRIK robotics
TRIK robotics
Iakov Kirilenko
 
Commit to the Cause, Push for Change: Contributing to Call for Code Open Sour...
Commit to the Cause, Push for Change: Contributing to Call for Code Open Sour...Commit to the Cause, Push for Change: Contributing to Call for Code Open Sour...
Commit to the Cause, Push for Change: Contributing to Call for Code Open Sour...
Daniel Krook
 

Similar to Topcoder Reflections: Observations from a Decade of Crowdsourcing with the Public Sector (20)

What is CloudSpokes?
What is CloudSpokes?What is CloudSpokes?
What is CloudSpokes?
 
Open source presentation
Open source presentationOpen source presentation
Open source presentation
 
Open Source Software Development by TLV Partners
Open Source Software Development by TLV PartnersOpen Source Software Development by TLV Partners
Open Source Software Development by TLV Partners
 
Workshop - Architecting Innovative Graph Applications- GraphSummit Milan
Workshop -  Architecting Innovative Graph Applications- GraphSummit MilanWorkshop -  Architecting Innovative Graph Applications- GraphSummit Milan
Workshop - Architecting Innovative Graph Applications- GraphSummit Milan
 
International developers and building for the next billion users
International developers and building for the next billion usersInternational developers and building for the next billion users
International developers and building for the next billion users
 
Open Source
Open Source Open Source
Open Source
 
Quicklook technology assessment topmod software_ccchittim
Quicklook technology assessment topmod software_ccchittimQuicklook technology assessment topmod software_ccchittim
Quicklook technology assessment topmod software_ccchittim
 
Developing internationally building stuff that works across the world - adobe
Developing internationally   building stuff that works across the world - adobeDeveloping internationally   building stuff that works across the world - adobe
Developing internationally building stuff that works across the world - adobe
 
IronHacks Live: Info session #3 - COVID-19 Data Science Challenge
IronHacks Live: Info session #3 - COVID-19 Data Science ChallengeIronHacks Live: Info session #3 - COVID-19 Data Science Challenge
IronHacks Live: Info session #3 - COVID-19 Data Science Challenge
 
ANIn Pune July 2023 |Prompt Engineering and AI first SDLC by Abhijit Shah
ANIn Pune July 2023 |Prompt Engineering and AI first SDLC by Abhijit ShahANIn Pune July 2023 |Prompt Engineering and AI first SDLC by Abhijit Shah
ANIn Pune July 2023 |Prompt Engineering and AI first SDLC by Abhijit Shah
 
Platform Dynamics - The rise and dominance of Platforms
Platform Dynamics - The rise and dominance of PlatformsPlatform Dynamics - The rise and dominance of Platforms
Platform Dynamics - The rise and dominance of Platforms
 
Continuous Integration
Continuous IntegrationContinuous Integration
Continuous Integration
 
SFScon 2020 - Cedric Thomas - Open Source ecosystem sustainability bring the ...
SFScon 2020 - Cedric Thomas - Open Source ecosystem sustainability bring the ...SFScon 2020 - Cedric Thomas - Open Source ecosystem sustainability bring the ...
SFScon 2020 - Cedric Thomas - Open Source ecosystem sustainability bring the ...
 
How to Maximize the Role of Insights Throughout the Product Lifecycle
How to Maximize the Role of Insights Throughout the Product LifecycleHow to Maximize the Role of Insights Throughout the Product Lifecycle
How to Maximize the Role of Insights Throughout the Product Lifecycle
 
Crypton Studio Presentation
Crypton Studio PresentationCrypton Studio Presentation
Crypton Studio Presentation
 
Introduction to OpenDaylight
Introduction to OpenDaylightIntroduction to OpenDaylight
Introduction to OpenDaylight
 
GEETHAhshansbbsbsbhshnsnsn_INTERNSHIP.pptx
GEETHAhshansbbsbsbhshnsnsn_INTERNSHIP.pptxGEETHAhshansbbsbsbhshnsnsn_INTERNSHIP.pptx
GEETHAhshansbbsbsbhshnsnsn_INTERNSHIP.pptx
 
42DM Credentials: Blockchain & Crypto
42DM Credentials: Blockchain & Crypto42DM Credentials: Blockchain & Crypto
42DM Credentials: Blockchain & Crypto
 
TRIK robotics
TRIK robotics TRIK robotics
TRIK robotics
 
Commit to the Cause, Push for Change: Contributing to Call for Code Open Sour...
Commit to the Cause, Push for Change: Contributing to Call for Code Open Sour...Commit to the Cause, Push for Change: Contributing to Call for Code Open Sour...
Commit to the Cause, Push for Change: Contributing to Call for Code Open Sour...
 

More from Crowdsourcing Week

Crowdsourcing à la sbv IMPROVER: the challenge of being your own client
Crowdsourcing à la sbv IMPROVER: the challenge of being your own clientCrowdsourcing à la sbv IMPROVER: the challenge of being your own client
Crowdsourcing à la sbv IMPROVER: the challenge of being your own client
Crowdsourcing Week
 
Transforming the Global Payments Operation
Transforming the Global Payments OperationTransforming the Global Payments Operation
Transforming the Global Payments Operation
Crowdsourcing Week
 
Crowdsourced to Outsourced: How online platforms are shaping the future of work
Crowdsourced to Outsourced: How online platforms are shaping the future of workCrowdsourced to Outsourced: How online platforms are shaping the future of work
Crowdsourced to Outsourced: How online platforms are shaping the future of work
Crowdsourcing Week
 
Malasya's Experience in Crowd Labour and Sharing Economy
Malasya's Experience in Crowd Labour and Sharing EconomyMalasya's Experience in Crowd Labour and Sharing Economy
Malasya's Experience in Crowd Labour and Sharing Economy
Crowdsourcing Week
 
LM Industries: Harnessing The Power of Crowdsourced Innovation to Build the F...
LM Industries: Harnessing The Power of Crowdsourced Innovation to Build the F...LM Industries: Harnessing The Power of Crowdsourced Innovation to Build the F...
LM Industries: Harnessing The Power of Crowdsourced Innovation to Build the F...
Crowdsourcing Week
 
Human Collective Intelligence: the future of corporate innovation
Human Collective Intelligence: the future of corporate innovationHuman Collective Intelligence: the future of corporate innovation
Human Collective Intelligence: the future of corporate innovation
Crowdsourcing Week
 
9 Ways to Ruin Your Open Innovation Challenge
9 Ways to Ruin Your Open Innovation Challenge9 Ways to Ruin Your Open Innovation Challenge
9 Ways to Ruin Your Open Innovation Challenge
Crowdsourcing Week
 
Disruptive Crowdsourcing
Disruptive CrowdsourcingDisruptive Crowdsourcing
Disruptive Crowdsourcing
Crowdsourcing Week
 
Accelerating Hardware Development: Ideation and Engineering
Accelerating Hardware Development: Ideation and EngineeringAccelerating Hardware Development: Ideation and Engineering
Accelerating Hardware Development: Ideation and Engineering
Crowdsourcing Week
 
Attracting and Retaining Top Partners with a Best-in-Class Payments Experience
Attracting and Retaining Top Partners with a Best-in-Class Payments ExperienceAttracting and Retaining Top Partners with a Best-in-Class Payments Experience
Attracting and Retaining Top Partners with a Best-in-Class Payments Experience
Crowdsourcing Week
 
Crowdsourcing Disaster Relief
Crowdsourcing Disaster ReliefCrowdsourcing Disaster Relief
Crowdsourcing Disaster Relief
Crowdsourcing Week
 
Core + Crowd: Why (and how) crowdsourcing is about to become mainstream
Core + Crowd: Why (and how) crowdsourcing is about to become mainstreamCore + Crowd: Why (and how) crowdsourcing is about to become mainstream
Core + Crowd: Why (and how) crowdsourcing is about to become mainstream
Crowdsourcing Week
 
Smart and Secure Cities and Communities
Smart and Secure Cities and Communities Smart and Secure Cities and Communities
Smart and Secure Cities and Communities
Crowdsourcing Week
 
How Successful Crowdsourcing Depends on asking 'Interesting Questions'
How Successful Crowdsourcing Depends on asking 'Interesting Questions'How Successful Crowdsourcing Depends on asking 'Interesting Questions'
How Successful Crowdsourcing Depends on asking 'Interesting Questions'
Crowdsourcing Week
 
Contestant Centered Design: creative approaches to designing competitions
Contestant Centered Design: creative approaches to designing competitionsContestant Centered Design: creative approaches to designing competitions
Contestant Centered Design: creative approaches to designing competitions
Crowdsourcing Week
 
How Crypto can Monetize Crowdsourcing
How Crypto can Monetize CrowdsourcingHow Crypto can Monetize Crowdsourcing
How Crypto can Monetize Crowdsourcing
Crowdsourcing Week
 
A New Report on the State of Open Innovation and What it Means For you
A New Report on the State of Open Innovation and What it Means For youA New Report on the State of Open Innovation and What it Means For you
A New Report on the State of Open Innovation and What it Means For you
Crowdsourcing Week
 
Expert Operating System: Business On-Demand
Expert Operating System: Business On-DemandExpert Operating System: Business On-Demand
Expert Operating System: Business On-Demand
Crowdsourcing Week
 
Crowdsourcing: Changing the Faces of Innovation at NASA
Crowdsourcing: Changing the Faces of Innovation at NASACrowdsourcing: Changing the Faces of Innovation at NASA
Crowdsourcing: Changing the Faces of Innovation at NASA
Crowdsourcing Week
 
Crowdfunding an ICO Without Getting In Trouble
Crowdfunding an ICO Without Getting In TroubleCrowdfunding an ICO Without Getting In Trouble
Crowdfunding an ICO Without Getting In Trouble
Crowdsourcing Week
 

More from Crowdsourcing Week (20)

Crowdsourcing à la sbv IMPROVER: the challenge of being your own client
Crowdsourcing à la sbv IMPROVER: the challenge of being your own clientCrowdsourcing à la sbv IMPROVER: the challenge of being your own client
Crowdsourcing à la sbv IMPROVER: the challenge of being your own client
 
Transforming the Global Payments Operation
Transforming the Global Payments OperationTransforming the Global Payments Operation
Transforming the Global Payments Operation
 
Crowdsourced to Outsourced: How online platforms are shaping the future of work
Crowdsourced to Outsourced: How online platforms are shaping the future of workCrowdsourced to Outsourced: How online platforms are shaping the future of work
Crowdsourced to Outsourced: How online platforms are shaping the future of work
 
Malasya's Experience in Crowd Labour and Sharing Economy
Malasya's Experience in Crowd Labour and Sharing EconomyMalasya's Experience in Crowd Labour and Sharing Economy
Malasya's Experience in Crowd Labour and Sharing Economy
 
LM Industries: Harnessing The Power of Crowdsourced Innovation to Build the F...
LM Industries: Harnessing The Power of Crowdsourced Innovation to Build the F...LM Industries: Harnessing The Power of Crowdsourced Innovation to Build the F...
LM Industries: Harnessing The Power of Crowdsourced Innovation to Build the F...
 
Human Collective Intelligence: the future of corporate innovation
Human Collective Intelligence: the future of corporate innovationHuman Collective Intelligence: the future of corporate innovation
Human Collective Intelligence: the future of corporate innovation
 
9 Ways to Ruin Your Open Innovation Challenge
9 Ways to Ruin Your Open Innovation Challenge9 Ways to Ruin Your Open Innovation Challenge
9 Ways to Ruin Your Open Innovation Challenge
 
Disruptive Crowdsourcing
Disruptive CrowdsourcingDisruptive Crowdsourcing
Disruptive Crowdsourcing
 
Accelerating Hardware Development: Ideation and Engineering
Accelerating Hardware Development: Ideation and EngineeringAccelerating Hardware Development: Ideation and Engineering
Accelerating Hardware Development: Ideation and Engineering
 
Attracting and Retaining Top Partners with a Best-in-Class Payments Experience
Attracting and Retaining Top Partners with a Best-in-Class Payments ExperienceAttracting and Retaining Top Partners with a Best-in-Class Payments Experience
Attracting and Retaining Top Partners with a Best-in-Class Payments Experience
 
Crowdsourcing Disaster Relief
Crowdsourcing Disaster ReliefCrowdsourcing Disaster Relief
Crowdsourcing Disaster Relief
 
Core + Crowd: Why (and how) crowdsourcing is about to become mainstream
Core + Crowd: Why (and how) crowdsourcing is about to become mainstreamCore + Crowd: Why (and how) crowdsourcing is about to become mainstream
Core + Crowd: Why (and how) crowdsourcing is about to become mainstream
 
Smart and Secure Cities and Communities
Smart and Secure Cities and Communities Smart and Secure Cities and Communities
Smart and Secure Cities and Communities
 
How Successful Crowdsourcing Depends on asking 'Interesting Questions'
How Successful Crowdsourcing Depends on asking 'Interesting Questions'How Successful Crowdsourcing Depends on asking 'Interesting Questions'
How Successful Crowdsourcing Depends on asking 'Interesting Questions'
 
Contestant Centered Design: creative approaches to designing competitions
Contestant Centered Design: creative approaches to designing competitionsContestant Centered Design: creative approaches to designing competitions
Contestant Centered Design: creative approaches to designing competitions
 
How Crypto can Monetize Crowdsourcing
How Crypto can Monetize CrowdsourcingHow Crypto can Monetize Crowdsourcing
How Crypto can Monetize Crowdsourcing
 
A New Report on the State of Open Innovation and What it Means For you
A New Report on the State of Open Innovation and What it Means For youA New Report on the State of Open Innovation and What it Means For you
A New Report on the State of Open Innovation and What it Means For you
 
Expert Operating System: Business On-Demand
Expert Operating System: Business On-DemandExpert Operating System: Business On-Demand
Expert Operating System: Business On-Demand
 
Crowdsourcing: Changing the Faces of Innovation at NASA
Crowdsourcing: Changing the Faces of Innovation at NASACrowdsourcing: Changing the Faces of Innovation at NASA
Crowdsourcing: Changing the Faces of Innovation at NASA
 
Crowdfunding an ICO Without Getting In Trouble
Crowdfunding an ICO Without Getting In TroubleCrowdfunding an ICO Without Getting In Trouble
Crowdfunding an ICO Without Getting In Trouble
 

Recently uploaded

Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
mikeeftimakis1
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
Adtran
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Nexer Digital
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Paige Cruz
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
ControlCase
 
Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
Dorra BARTAGUIZ
 
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptxSecstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
nkrafacyberclub
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
Sri Ambati
 
By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024
Pierluigi Pugliese
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
Ralf Eggert
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Kari Kakkonen
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
Jemma Hussein Allen
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Ana-Maria Mihalceanu
 
Free Complete Python - A step towards Data Science
Free Complete Python - A step towards Data ScienceFree Complete Python - A step towards Data Science
Free Complete Python - A step towards Data Science
RinaMondal9
 
Assure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyesAssure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
Laura Byrne
 

Recently uploaded (20)

Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
 
Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
 
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptxSecstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
 
Free Complete Python - A step towards Data Science
Free Complete Python - A step towards Data ScienceFree Complete Python - A step towards Data Science
Free Complete Python - A step towards Data Science
 
Assure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyesAssure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyes
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
 

Topcoder Reflections: Observations from a Decade of Crowdsourcing with the Public Sector

  • 1. Topcoder Reflections MICHAEL CONTRERAS | CROWDSOURCING WEEK GLOBAL | 10 / 25/ 2018 A Decade of Public Sector Crowdsourcing
  • 2. Topcoder was founded with a simple goal: identify the best developers in the world through competition. Over the past decade, Topcoder has been a catalyst for public sector crowdsourcing, reframing the way the US Federal Government develops software and conducts R&D.
  • 3. Topcoder Community Topcoder is home to the world’s largest network of Designers, Developers, and Data Scientists. The Topcoder Community includes more than 1.3 million members from every country around the world.
  • 4. Community members in over 190 countries More engineers than Microsoft, Facebook, and Twitter combined Challenges per quarter New members per week Paid to the community Logins every 90 days 1M+ 5x 1400 1800 $80m 35k
  • 5. Where we have been . . . 2001 Topcoder launches gamified platform for computer scientists to demonstrate skills and gain notoriety. First Topcoder Community member ratings are published. 2010 The NASA Tournament Lab is formed. Topcoder begins to work on app dev and algorithm projects for many Federal agencies through Harvard. 2005 NSA begins to sponsor the Topcoder Open for recruiting purposes. Full application development stack capabilities added in 2006. 2004 Harvard publishes its first academic study on Topcoder. First commercial offering for software components. 2011 Topcoder is onboarded to the GSA Schedule for Challenges and Competition Services. DARPA taps Topcoder to launch STEM education community for teens. 2015 Topcoder is awarded a spot on the NASA Open Innovation Services contract vehicle through 2020. Topcoder and Apple partner to launch the iOS Community. 2007 First commercial Marathon Match conducted to develop an enterprise data science solution. Topcoder Community expands to include UX design. 2017 Topcoder has run challenges for CMS, I-ARPA, EPA, Air Force, DOE, VA, PTO, OPM, USAID Topcoder and IBM partner to launch the Cognitive Community. 2016 Topcoder surpasses 1 million- member mark. Topcoder and GE partner to launch the IoT Community. Wipro acquires Topcoder to transform its business and the IT services industry. 2009 The NSA “Enigma” Marathon Match is hosted on Topcoder based on the famous WWII era decoding of the Enigma machine, a cryptographic security system. 01 04 05 07 09 10 11 15 16 17
  • 6. 6 It started with recruiting…
  • 7. 7
  • 8. 8
  • 9. 9
  • 10. 10
  • 11. 11
  • 12. 12
  • 13. 13
  • 14. 14
  • 16. 16
  • 17. 17 DATA SCIENTISTS 450K AVERAGE # COMPETITORS PER CHALLENGE 78 AVERAGE #SUBMISSIONS PER CHALLENGE 578 Topcoder’s Data Science Community
  • 18. 18 Algorithms and Analytics Sales Enablement Algorithms and Analytics Overview Products ● Algorithm Optimization ● Predictive Analytics ● Image and Pattern Recognition ● Objective Optimization Crowdsourcing Contests ● Marathon Match ● Banner Match ● Mini Marathon Match ● Data Science First-to- Finish (F2F) ● Data Science Sprint ● Data Visualization ● Data Science Ideation Objectively scores with an automated scoring function that feeds the Topcoder live leaderboard. Restricted to the following languages: Java, C++, C#.NET, VB.NET, or Python. Objectively scores with an automated scoring function that feeds the Topcoder live leaderboard. Competitors are allowed to use any language and libraries to write their solution. A shorter duration, more straight-forward version of the Marathon Match. Has the same structure and rules of a regular Marathon Match but a smaller prize purse for competitors. Objectively scores with an automated scoring function that feeds the Topcoder live leaderboard. Restricted to the following languages: Java, C++, C#.NET, VB.NET, or Python. A predetermined threshold is selected for the match, and once a competitor reaches the desired threshold score the match ends and the first place winner receives the one prize available. A series of smaller, more rapid data science challenges with a manual scoring function and no leaderboard. Competitors are allowed to use any language and libraries to write their solution. A hybrid project completed by a series of data science tasks to find the unique qualities or “highlights” in the data, followed by design challenges to visualize the data. The output of this kind of project is static screens. Looks to discover or learn new approaches, data, and ideas from the community.
  • 19. Predictive Toxicology - Environmental Safety Predictive Analytics Every day we come into contact with common pesticides. Which chemicals, in what dosage, can cause us harm? See how the EPA used crowdsourcing to deliver more accurate predictive analysis. Learn More
  • 20. 338 49 a Brand New Approach discovered, tested, and shared with their scientific community REGISTRANTS COMPETITORS 804 SUBMISSIONS 3 CHALLENGE DURATION WEEKS
  • 23.
  • 25. 25 Translate your mobile or web app idea into a structured design brief that includes a description of the design concept, use case scenarios, design guidelines, and a low-fidelity mockup of basic UI/UX elements. What’s Included Application design brief crowdsourced in the Topcoder Marketplace. A Topcoder copilot manages all logistics. What You Receive Written visual design brief for up to five screens of a single application. You pay only for the winning brief, not hours, and you own the final deliverables. Design Brief Plan the UI/UX design of your application Application Wireframe
  • 27. 27 Code Development packages make it easy to add the people and skills you need to round out your team, free valuable time, and accelerate development. Crowdsource specific phases of your development process or end-to- end application builds. What’s Included Code or task crowdsourced in the Topcoder Marketplace. A Topcoder copilot manages all logistics. What You Receive Ready-to-deploy code, interface, or service built to your specs. You pay only for the winning code, not hours, and you own the final deliverables. Code Development Enterprise-grade code for every stage of the dev life cycle Code Development
  • 28. POWERED BY Eight month challenge Multiple concurrent development work streams Third round of human testing
  • 29. 29 New HorizonsVA WORKFORCE DEVELOPMENT This is footer and you can change the content or delete if you wanted to
  • 30. 30 What is the TCVC? The TCVC is Topcoder’s Veterans Community ● The VA has 3 projects in motion at Topcoder via NASA - web, analytics & mobile ● Each VA project includes funding for the TCVC ● Topcoder teams with OperationCode, a veterans 503(c) to source members The TCVC is a place for US Veterans and Active Duty to learn and compete The TCVC is hosted as a private community within Topcoder’s platform ● Challenges run inside the TCVC are open only to US Veterans and Active Duty ● Challenges types run from “Hello World” style to complex multi-challenge series ● Challenges also come to the TCVC via the VA’s projects as well ● Topcoder challenges can be cross-posted to TCVC with different prizes On veterans.topcoder.com, Vets compete against each other, mentor each other, code solutions for paying customers, earn prizes and payments, and build their resumes by working on actual customer solutions.
  • 31. 31 What are the goals of the TCVC? VA Goals Cultivate and Prepare veterans for entry into the tech world ● Give veterans the opportunity to PROSUMERS ● Provide opportunity for veterans to demonstrate current, marketable tech skills Topcoder Goals Use the TCVC as an incubator for new community members ● Cultivate new members ● Train and grow new copilots who will eventually lead projects in our regular community ● Create a compelling story for Topcoder
  • 32. 32
  • 37. 37 Special thanks to . . . Andy LaMora Clinton Bonner Rashid SialJessie Ford Mike Morris Brendan Wright