Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
ARCHITECTING
A MODERN BIG DATA ENTERPRISE
API ECOSYSTEM
+OLEG DULIN
CHIEF ARCHITECT, ADP INNOVATION LAB
Copyright © 2017 A...
Copyright © 2017 ADP, LLC.
APPLICATION SERVER
PLATFORMS
DISTRIBUTED
SYSTEMS
WALL STREET
WHOLESALE AND
DISTRIBUTION
HUMAN C...
OVER 630,000
CLIENTS
MORE THAN
35 MILLION USERS
5 MILLION
LOGINS A DAY
2015 RANK: #13
2016 RANK IN
FINANCIAL
SERVICES DATA...
Copyright © 2017 ADP, LLC. Proprietary and Confidential. 4
I N N O V A T I O N L A B
A D P
DESIGN-DRIVEN CULTURE
LEAN UX A...
Copyright © 2017 ADP, LLC.
H C M I N D U S T R Y T R E N D S
5
GIG
ECONOMY
CONSUMERIZATIONGOING
GLOBAL
BIG
DATA
OPEN
ECOSY...
Taking your API
ecosystem to the
next level
OPEN-SOURCE
The benefit to the
modern enterprise
API ECOSYSTEM
S
Harnessing th...
…I SUGGEST THAT A
COMPANY BE VIEWED NOT AS
A MEMBER OF A SINGLE
INDUSTRY
BUT AS PART OF A BUSINESS
ECOSYSTEM THAT CROSSES
...
API
ECO-SYSTEMS
# A D P i n n o v a t i o n | # h e l l o w o r k
The Benefit to Modern Enterprise
STARTUPS ARE BORN ONLINE
TAKE A FRESH LOOK AT AN EXISTING
COMMODITY OR SERVICE ECOSYSTEM
DELIVER IT IN NEW WAYS VIA NEW
CH...
T O E C O S Y S T E M B U I L D I N G
P U B L I C A P I S A R E C R U C I A L
PUBLIC
APIS
APPS ARE SHORT-LIVED
ENTERPRISE ...
APPLE
App Store, iOS, MacOS,
iTunes, Xcode toolchain,
Apple Pay
AMAZON Retail API, AWS, Prime
MICROSOFT
Office 365, Window...
PRODUCT CATALOG
TAXONOMY
SEARCH
ANALYTICS AND TRENDS
WALMART OPEN API DEVELOPER PORTAL
O P E N A P I
W A L M A R T
12Copyr...
EXISTING SERVICE OR PRODUCT
DELIVERED IN INNOVATIVE NEW WAYS
MILLENNIAL FRIENDLY BANKING
IFTTT IS AN ECOSYSTEM LEADER
QAPI...
CENTER OF THE ADP ECOSYSTEM
LEADERSHIP
API ACCESS TO ALL ASPECTS OF
HCM AND PAYROLL
APP STORE
INTEGRATED WITH ADP DATA CLO...
GROUND WORK
Tenancy
Redundancy and replication
Software lifecycle
SECURITY
Authentication and microservice security
User p...
MULTI-TENANT
Shared logical instance
Managed data security
API and data limits
Examples: ADP, Google Maps
VIRTUALIZED
Each...
DURABILITY Ensure data and transactions are not lost
AVAILABILITY Provide non-stop API access
REDUNDANCY Keep all of your ...
SUPPORT SDLC API
CONSUMERS EXPECT
DON’T REINVENT THE WHEEL
OR OVER-ENGINEER
STAY CONSISTENT WITH
INDUSTRY BEST PRACTICES
D...
LOST PASSWORDS ARE THE MOST
COMMON TECH SUPPORT COMPLAINT
LET USERS USE THEIR SOCIAL
NETWORK CREDENTIALS
TAKE CARE TO ENSU...
OAUTH 2.0 IS AN INDUSTRY
STANDARD
JWT TOKENS FOR
MICRO-SERVICE SECURITY
L I N K : “OAUTH 2.0: THE PROTOCOL
AT THE CENTER O...
21Copyright © 2017 ADP, LLC.
A N D A C C E S S C O N T R O L
A U T H O R I Z A T I O N
TAKE ADVANTAGE
OF OAUTH SCOPES
THIN...
GENERIC DATA STORES
PERFORM CRUD
Tables get updated
Documents get uploaded
No semantic meaning
Can’t learn
UPDATE Inventor...
MEANINGFUL QUERIES GET /payroll/v2/workers/abc123ef/pay-distributions
OVER-GENERALIZED
POST /v2/Query
{
“type”: “PayDistri...
ODATA
Strongly typed with EDM metadata
Supports basic CRUD and
integration endpoints
Supports business events (actions)
Be...
API FRIENDLY TO
ESB TOOLS
Mule ESB
BizTalk
OData
BULK DATA LOADS
OData batch
Streaming
INITIAL INTEGRATION
AND MAINTENANCE...
WHEN BUSINESS EVENTS HAPPEN,
PARTNERS WANT TO KNOW
“UPDATES” API
OUTBOUND WEBHOOK
NOTIFICATIONS
26Copyright © 2017 ADP, LL...
# A D P i n n o v a t i o n | # h e l l o w o r k
OPEN-SOURCETaking your API Ecosystem to the Next Level
OFFER DEVELOPERS OPEN-SOURCE
LIBRARIES FOR YOUR APIS
CONTRIBUTE CODE THAT IS NOT
CRITICAL TO YOUR CORE BUSINESS
BUILD DEVE...
29Copyright © 2017 ADP, LLC.
“ C I T I Z E N D E V E L O P E R S ”
N U R T U R E
CREATE NEW BUSINESS APPS
WITHIN THE ECOSY...
BIG DATA
# A D P i n n o v a t i o n | # h e l l o w o r k
Harnessing the Collected Data
31Copyright © 2017 ADP, LLC.
A P I U S A G E
A N A L Y Z E
API CALLS CAN BE ANALYZED
TRACK AND ENFORCE RESOURCE
UTILIZATIO...
BUSINESS EVENTS
CAN BE ANALYZED
Orders get placed
People get paid
Vacations get booked
BUSINESS EVENTS
CAN BE PREDICTED
Pa...
LEARN FROM BUSINESS EVENTS
WITHIN THE ECOSYSTEM
TRY TO PREDICT EVENTS
PROACTIVELY NOTIFY USERS
VIA CHANNELS THEY USE
33Cop...
ENCOURAGE
INNOVATION
NEW WAYS TO SECURE SYSTEMS
WITHOUT GETTING IN THE WAY
ENCOURAGE “CITIZEN DEVELOPERS”
34Copyright © 20...
35Copyright © 2017 ADP, LLC.
A D P M A R K E T P L A C E
R E S U L T S
200+ APPS AVAILABLE
1250+ PARTNERS IN PIPELINE
500%...
DON’T MISS AN OPPORTUNITY
TO BECOME AN ECOSYSTEM LEADER
LEVERAGE EXISTING
ECOSYSTEMS
THINK ABOUT CREATIVE NEW WAYS TO
DELI...
THANK YOU
# A D P i n n o v a t i o n | # h e l l o w o r k
WEB: ADP.com
ADP Innovation Lab: https://www.adp.com/why-adp/i...
Upcoming SlideShare
Loading in …5
×

Architecting a modern Big Data Enterprise API Ecosystem

904 views

Published on

In May, 2017, I had an opportunity to give a talk at TDWI Leadership Summit on API ecosystems and their benefit to the modern enterprise.

Published in: Technology
  • How to improve brain memory power naturally? Boost your brainpower with brain pill now...  https://bit.ly/2GEWG9T
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • DOWNLOAD FULL BOOKS, INTO AVAILABLE FORMAT ......................................................................................................................... ......................................................................................................................... ,DOWNLOAD FULL. PDF EBOOK here { https://tinyurl.com/yyxo9sk7 } ......................................................................................................................... ,DOWNLOAD FULL. EPUB Ebook here { https://tinyurl.com/yyxo9sk7 } ......................................................................................................................... ,DOWNLOAD FULL. doc Ebook here { https://tinyurl.com/yyxo9sk7 } ......................................................................................................................... ,DOWNLOAD FULL. PDF EBOOK here { https://tinyurl.com/yyxo9sk7 } ......................................................................................................................... ,DOWNLOAD FULL. EPUB Ebook here { https://tinyurl.com/yyxo9sk7 } ......................................................................................................................... ,DOWNLOAD FULL. doc Ebook here { https://tinyurl.com/yyxo9sk7 } ......................................................................................................................... ......................................................................................................................... ......................................................................................................................... .............. Browse by Genre Available eBooks ......................................................................................................................... Art, Biography, Business, Chick Lit, Children's, Christian, Classics, Comics, Contemporary, Cookbooks, Crime, Ebooks, Fantasy, Fiction, Graphic Novels, Historical Fiction, History, Horror, Humor And Comedy, Manga, Memoir, Music, Mystery, Non Fiction, Paranormal, Philosophy, Poetry, Psychology, Religion, Romance, Science, Science Fiction, Self Help, Suspense, Spirituality, Sports, Thriller, Travel, Young Adult,
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • ===>>>I basically make about $6,000-$8,000 a month online. It’s enough to comfortably replace my old jobs income, especially considering I only work about 10-13 hours a week from home. I was amazed how easy it was after I tried it… ↡↡↡↡●▬▬▬▬ஜHERE► www.jobsthings.com
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • ===>>>I basically make about $6,000-$8,000 a month online. It’s enough to comfortably replace my old jobs income, especially considering I only work about 10-13 hours a week from home. I was amazed how easy it was after I tried it… ↡↡↡↡●▬▬▬▬ஜHERE► www.jobsthings.com
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Earn $90/day Working Online. You won't get rich, but it is going to make you some money! ★★★ http://ishbv.com/ezpayjobs/pdf
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

Architecting a modern Big Data Enterprise API Ecosystem

  1. 1. ARCHITECTING A MODERN BIG DATA ENTERPRISE API ECOSYSTEM +OLEG DULIN CHIEF ARCHITECT, ADP INNOVATION LAB Copyright © 2017 ADP, LLC. 1
  2. 2. Copyright © 2017 ADP, LLC. APPLICATION SERVER PLATFORMS DISTRIBUTED SYSTEMS WALL STREET WHOLESALE AND DISTRIBUTION HUMAN CAPITAL MANAGEMENT & PAYROLL BLOGGING CLOUD COMPUTING LINUX AND OPEN- SOURCE ADVOCACY A B O U T M E 2
  3. 3. OVER 630,000 CLIENTS MORE THAN 35 MILLION USERS 5 MILLION LOGINS A DAY 2015 RANK: #13 2016 RANK IN FINANCIAL SERVICES DATA: #1 2016 RANK: #43 2016 SCORE: 100% 2014 RANK: #20 2014 RANK: #19 100+ COUNTRIES WIDE BREADTH OF HCM SOLUTIONS BEST HCM SERVICE AND BPO OFFERINGS T H E L A R G E S T G L O B A L P R O V I D E R O F C L O U D - B A S E D H C M S O L U T I O N S A B O U T A D P 3Copyright © 2017 ADP, LLC.
  4. 4. Copyright © 2017 ADP, LLC. Proprietary and Confidential. 4 I N N O V A T I O N L A B A D P DESIGN-DRIVEN CULTURE LEAN UX AND USER-CENTRIC METHODOLOGY IN-HOUSE RESEARCH CENTER OPEN INNOVATION AND COLLABORATION
  5. 5. Copyright © 2017 ADP, LLC. H C M I N D U S T R Y T R E N D S 5 GIG ECONOMY CONSUMERIZATIONGOING GLOBAL BIG DATA OPEN ECOSYSTEM
  6. 6. Taking your API ecosystem to the next level OPEN-SOURCE The benefit to the modern enterprise API ECOSYSTEM S Harnessing the collected data BIG DATA A G E N D A 6Copyright © 2017 ADP, LLC.
  7. 7. …I SUGGEST THAT A COMPANY BE VIEWED NOT AS A MEMBER OF A SINGLE INDUSTRY BUT AS PART OF A BUSINESS ECOSYSTEM THAT CROSSES A VARIETY OF INDUSTRIES. J A M E S M O O R E , “ P R E D A T O R S A N D P R E Y ” , H A R V A R D B U S I N E S S R E V I E W 1 9 9 3 7Copyright © 2017 ADP, LLC. “
  8. 8. API ECO-SYSTEMS # A D P i n n o v a t i o n | # h e l l o w o r k The Benefit to Modern Enterprise
  9. 9. STARTUPS ARE BORN ONLINE TAKE A FRESH LOOK AT AN EXISTING COMMODITY OR SERVICE ECOSYSTEM DELIVER IT IN NEW WAYS VIA NEW CHANNELS SMART ECOSYSTEM LEADERS BENEFIT IN NEW AND MORE PROFITABLE WAYS INCUMBENTS WITH NO ECOSYSTEM LEADERSHIP WILL FEEL IT “VERTICAL COMMERCE AND HOW THE NEXT GENERATION OF RETAIL WILL BE BUILT”S T E P H A N A N G O , 8 / 2 1 / 1 6 B E G E T V E R T I C A L C O M M E R C E E C O S Y S T E M S 9Copyright © 2017 ADP, LLC.
  10. 10. T O E C O S Y S T E M B U I L D I N G P U B L I C A P I S A R E C R U C I A L PUBLIC APIS APPS ARE SHORT-LIVED ENTERPRISE SYSTEMS ARE COMPLEX AND COSTLY ONCE A SUPPLIER OR PARTNER PLUGS INTO AN ECOSYSTEM, THEY STAY THERE ECOSYSTEMS ARE LONG-LIVED Copyright © 2017 ADP, LLC. CONSUMER APPS INTERNAL ENTERPRIS E APPS SUPPLIERS PARTNERS 10
  11. 11. APPLE App Store, iOS, MacOS, iTunes, Xcode toolchain, Apple Pay AMAZON Retail API, AWS, Prime MICROSOFT Office 365, Windows, Azure, Active Directory, Visual Studio WALMART Open API, retail API, product catalog IFTTT Sprawling partner ecosystem ADP API, Marketplace, developer outreach, partner program SALESFORCE Force.com, database.com, sales cloud, marketing cloud, etc. PAYPAL Online shopping, payments A P I E C O - S Y S T E M E X A M P L E S W E L L K N O W N 11Copyright © 2017 ADP, LLC.
  12. 12. PRODUCT CATALOG TAXONOMY SEARCH ANALYTICS AND TRENDS WALMART OPEN API DEVELOPER PORTAL O P E N A P I W A L M A R T 12Copyright © 2017 ADP, LLC.
  13. 13. EXISTING SERVICE OR PRODUCT DELIVERED IN INNOVATIVE NEW WAYS MILLENNIAL FRIENDLY BANKING IFTTT IS AN ECOSYSTEM LEADER QAPITAL PARTICIPATES IN THE IFTTT ECO-SYSTEM “WHAT IS IFTTT? QAPITAL LETS YOU SAVE WITH YOUR FAVORITE APPS” Q A P I T A L B L O G , 9 / 1 1 / 2 0 1 5 I F T T T A N D Q A P I T A L 13Copyright © 2017 ADP, LLC.
  14. 14. CENTER OF THE ADP ECOSYSTEM LEADERSHIP API ACCESS TO ALL ASPECTS OF HCM AND PAYROLL APP STORE INTEGRATED WITH ADP DATA CLOUD PARTNER PROGRAM DEVELOPER OUTREACH PROGRAM A D P M A R K E T P L A C E L I N K : ADP MARKETPLACE 14Copyright © 2017 ADP, LLC.
  15. 15. GROUND WORK Tenancy Redundancy and replication Software lifecycle SECURITY Authentication and microservice security User profiles and account management Authorization and access control API ARCHITECTURE Business events Queries Integration ANALYTICS Machine learning Predictive notifications Chat bots P L A N N I N G C H E C K L I S T A P I E C O S Y S T E M S 15Copyright © 2017 ADP, LLC.
  16. 16. MULTI-TENANT Shared logical instance Managed data security API and data limits Examples: ADP, Google Maps VIRTUALIZED Each customer gets their own virtual instance Data is segregated Network and computing infrastructure limits Examples: AWS, SAP O N T E N A N C Y V S . V I R T U A L I Z A T I O N D E C I D E 16Copyright © 2017 ADP, LLC.
  17. 17. DURABILITY Ensure data and transactions are not lost AVAILABILITY Provide non-stop API access REDUNDANCY Keep all of your data centers always “hot” REPLICATION Keep or replicate data where it makes sense 17Copyright © 2017 ADP, LLC. R E D U N D A N C Y A N D R E P L I C A T I O N P L A N
  18. 18. SUPPORT SDLC API CONSUMERS EXPECT DON’T REINVENT THE WHEEL OR OVER-ENGINEER STAY CONSISTENT WITH INDUSTRY BEST PRACTICES D E V E L O P M E N T L I F E C Y C L E A C C O M O D A T E 18Copyright © 2017 ADP, LLC. DEVELOPMENT PRODUCTION SCALABILITY TESTING QUALITY ASSURANCE
  19. 19. LOST PASSWORDS ARE THE MOST COMMON TECH SUPPORT COMPLAINT LET USERS USE THEIR SOCIAL NETWORK CREDENTIALS TAKE CARE TO ENSURE THAT SOCIAL NETWORKS OUTLAST YOUR OWN PLATFORM CONSIDER OFFERING PASSWORD MANAGEMENT A N D A C C O U N T M A N A G E M E N T U S E R P R O F I L E S 19Copyright © 2017 ADP, LLC.
  20. 20. OAUTH 2.0 IS AN INDUSTRY STANDARD JWT TOKENS FOR MICRO-SERVICE SECURITY L I N K : “OAUTH 2.0: THE PROTOCOL AT THE CENTER OF THE UNIVERSE” 20Copyright © 2017 ADP, LLC. A N D M I C R O - S E R V I C E S E C U R I T Y A U T H E N T I C A T I O N RESOURCE OWNE R (YOU) CLIENT (THIRD-PARTY APP ) AUTHORIZATION SERVER RESOURCE SERVER CONNECT TO SERVICE REQUEST AUTHORIZATION CODE REQUEST CREDENTIALS AND CONSENT ENTER CREDENTIALS AND GRANT CONSEN T AUTHORIZATION CODE RESPONSE OBTAIN ACCESS TOKEN ACCESS THE RESOURC E REFRESH EXPIRED ACCESS TOKEN USE THE APP
  21. 21. 21Copyright © 2017 ADP, LLC. A N D A C C E S S C O N T R O L A U T H O R I Z A T I O N TAKE ADVANTAGE OF OAUTH SCOPES THINK THROUGH DATA SECURITY
  22. 22. GENERIC DATA STORES PERFORM CRUD Tables get updated Documents get uploaded No semantic meaning Can’t learn UPDATE Inventory SET count=coun WHERE productId=422; BUSINESS PLATFORMS OPERATE ON EVENTS Products get ordered Employees get hired Semantically meaningful Can learn and predict POST /Order { “customerId”:4, ”productId”: 422, “quantity”: 1 } 22Copyright © 2017 ADP, LLC. B U S I N E S S E V E N T S A P I D E S I G N
  23. 23. MEANINGFUL QUERIES GET /payroll/v2/workers/abc123ef/pay-distributions OVER-GENERALIZED POST /v2/Query { “type”: “PayDistributions”, ”filter”: { “associateId”:”abc123ef” } } 23Copyright © 2017 ADP, LLC. F O R Q U E R I E S A D D S U P P O R T
  24. 24. ODATA Strongly typed with EDM metadata Supports basic CRUD and integration endpoints Supports business events (actions) Best in Microsoft environments GRAPHQL Strongly typed Query language for APIs Less chatty than OData and REST Get all required data in one call Perfect for mobile and single page apps F O R Q U E R I E S O D A T A V S G R A P H Q L 24Copyright © 2017 ADP, LLC.
  25. 25. API FRIENDLY TO ESB TOOLS Mule ESB BizTalk OData BULK DATA LOADS OData batch Streaming INITIAL INTEGRATION AND MAINTENANCE Ability to suspend event analytics during maintenance I N T E G R A T I O N 25Copyright © 2017 ADP, LLC.
  26. 26. WHEN BUSINESS EVENTS HAPPEN, PARTNERS WANT TO KNOW “UPDATES” API OUTBOUND WEBHOOK NOTIFICATIONS 26Copyright © 2017 ADP, LLC. AND OUTBOUND NOTIFICATIONS W E B H O O K S
  27. 27. # A D P i n n o v a t i o n | # h e l l o w o r k OPEN-SOURCETaking your API Ecosystem to the Next Level
  28. 28. OFFER DEVELOPERS OPEN-SOURCE LIBRARIES FOR YOUR APIS CONTRIBUTE CODE THAT IS NOT CRITICAL TO YOUR CORE BUSINESS BUILD DEVELOPER COMMUNITY L I N K : ADP LABS GITHUB 28Copyright © 2017 ADP, LLC. O P E N - S O U R C E H A R N E S S I N G
  29. 29. 29Copyright © 2017 ADP, LLC. “ C I T I Z E N D E V E L O P E R S ” N U R T U R E CREATE NEW BUSINESS APPS WITHIN THE ECOSYSTEM ORGANIZE HACKATHONS TRAINING AND EDUCATION
  30. 30. BIG DATA # A D P i n n o v a t i o n | # h e l l o w o r k Harnessing the Collected Data
  31. 31. 31Copyright © 2017 ADP, LLC. A P I U S A G E A N A L Y Z E API CALLS CAN BE ANALYZED TRACK AND ENFORCE RESOURCE UTILIZATION BY API CONSUMERS PREVENT DOS PRIORITIZE DEVELOPMENT AUTO-SCALE
  32. 32. BUSINESS EVENTS CAN BE ANALYZED Orders get placed People get paid Vacations get booked BUSINESS EVENTS CAN BE PREDICTED Past history can offer insights Anticipate sales Proactive notifications 32Copyright © 2017 ADP, LLC. I N T E L L I G E N C E A P P L Y
  33. 33. LEARN FROM BUSINESS EVENTS WITHIN THE ECOSYSTEM TRY TO PREDICT EVENTS PROACTIVELY NOTIFY USERS VIA CHANNELS THEY USE 33Copyright © 2017 ADP, LLC. P R E D I C T I V E A N A L Y T I C S H A R N E S S
  34. 34. ENCOURAGE INNOVATION NEW WAYS TO SECURE SYSTEMS WITHOUT GETTING IN THE WAY ENCOURAGE “CITIZEN DEVELOPERS” 34Copyright © 2017 ADP, LLC. I T D E P A R T M E N T S R E L E V A N T K E E P
  35. 35. 35Copyright © 2017 ADP, LLC. A D P M A R K E T P L A C E R E S U L T S 200+ APPS AVAILABLE 1250+ PARTNERS IN PIPELINE 500% GROWTH IN SITE VISITS 2851 CLIENT SUBSCRIPTIONS Insights VIA ADP DATA CLOUD
  36. 36. DON’T MISS AN OPPORTUNITY TO BECOME AN ECOSYSTEM LEADER LEVERAGE EXISTING ECOSYSTEMS THINK ABOUT CREATIVE NEW WAYS TO DELIVER EXISTING PRODUCTS AND SERVICES 36Copyright © 2017 ADP, LLC. C O N C L U S I O N S
  37. 37. THANK YOU # A D P i n n o v a t i o n | # h e l l o w o r k WEB: ADP.com ADP Innovation Lab: https://www.adp.com/why-adp/innovation.aspx Oleg Dulin on Twitter: @olegdulin The information provided in this document is for informational purposes only and not for the purpose of providing legal, accounting, or tax advice. The information and services ADP provides should not be deemed a substitute for the advice of any such professional. Such information is by nature subject to revision and may not be the most current information available. ADP and the ADP logo are registered trademarks of ADP, LLC. ADP A more human resource. is a service mark of ADP, LLC. All other marks are the property of their respective owners. Copyright (c) 2017 ADP, LLC.

×