Recommended
Recommended
More Related Content
What's hot
What's hot (19)
Similar to Ret301 Nike AWS ReInvent Real-Time monitoring
Similar to Ret301 Nike AWS ReInvent Real-Time monitoring (20)
Recently uploaded
Recently uploaded (20)
Ret301 Nike AWS ReInvent Real-Time monitoring
- 1. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Just Do It: Nike’s Journey to Real-Time Monitoring of its Digital Business Adam Nutt Engineering Manager Nike, Web Engineering • R E T 3 0 1 Demond Jackson Site Reliability Engineer Nike, Site Reliability
- 2. Nike Digital Engineering Nike Digital Engineering ADAM NUTT ✦ Engineering Manager, Nike Digital ✦ 15+ years experience, including government, video games, and startups ✦ 3 years with Nike, all with AWS infrastructure DEMOND JACKSON ✦ Lead SRE, Nike Digital ✦ 18+ years experience, mostly large enterprise w/ some consulting ✦ 3 years with Nike, primarily AWS infrastructure
- 3. Nike Digital Engineering FROM TO CONSUMER-FACING WEBSITE, APPS, RETAIL EPHEMERAL INFRASTRUCTURE DEVOPS CHANGE IN HOURS ENTERPRISE-FACING WHOLESALE, B2B, PRODUCT CREATION CLASSIC IT INFRASTRUCTURE TRADITIONAL IT CHANGE IN WEEKS/MONTHS
- 5. Nike Digital Engineering Nike Digital Engineering LATENCY ERRORS TRAFFIC SATURATION THE FOUR GOLDEN SIGNALS OPERATIONAL READINESS
- 6. Nike Digital Engineering KEY PERFORMANCE INDICATORS ALERTS AND RUNBOOKS AVAILABILITY REPORTING DASHBOARDS NOC INTEGRATION CANARY DEPLOYMENTS AUTOMATED DOMAIN TESTS OPERATIONAL READINESS
- 7. Nike Digital Engineering HOW DO YOU KEEP TRACK OF ALL THIS?
- 8. Nike Digital Engineering CHALLENGES HIGH HEAT PRODUCT LAUNCHES SHOCK DROPS GLOBAL HOLIDAYS MEMBER NOTIFICATIONS BOTS (Millions of users) (Surprise sales)
- 9. Nike Digital Engineering OUR NEEDS We need to know there is an error quickly. Seconds matter during brand events SPEED RESOLUTION Our volume means minute issues only become discoverable when we have all the data SCALE We have a large, ephemeral infrastructure. We need to monitor all of it, easily ANALYTICS Metrics become significantly more powerful when the same metric can be used in different ways by applying live transformations
- 11. Nike Digital Engineering USING CRAWL-WALK-RUN TO ENABLE ENTERPRISE MONITORING
- 12. Nike Digital Engineering Nike Digital Engineering WHAT WILL I GET PAGED FOR? WHAT IS IMPORTANT? CPU UTILIZATION MEMORY USAGE 80%90% ERROR RATE 40% CRAWL-WALK-RUN CRAWL
- 13. Nike Digital Engineering WHAT DO THESE NUMBERS MEAN? ARE THEY GOOD OR BAD? DO WE HAVE A PROBLEM? AVERAGES CAN SMOOTH OUT ERRORS. THEY CAN ALSO MAKE AN INSTANT EVENT SEEM LONG LASTING KNOWING IS BETTER THAN NOT KNOWING METRICS = WINNING GAVE CONFIDENCE DIFFICULT TO PARSE CRAWL-WALK-RUN CRAWL
- 14. Nike Digital Engineering Nike Digital Engineering WHAT IMPACTS MY CUSTOMERS? OPEN CIRCUITSLATENCY BAD ACTORS CRAWL-WALK-RUN WALK
- 15. Nike Digital Engineering LEARN WHAT MATTERS. THEN MEASURE THAT HAVING THE PERTINENT PARTS OF THE USER REQUEST BROKEN DOWN IN SENSIBLE WAYS ALLOWS US TO TRIAGE IN REAL TIME OBSERVABILITY MEANS FINDING ANSWERS TO QUESTIONS YOU DIDN’T KNOW TO ASK NEW QUESTIONS CAN BE ASKED EASILY UNDERSTOOD KEY QUESTIONS CAN BE ANSWERED CRAWL-WALK-RUN WALK
- 16. Nike Digital Engineering Nike Digital Engineering “LOOK AT WHAT YOU VALUE AND MEASURE THOSE THINGS INSTEAD” CRAWL-WALK-RUN RUN - MICHELLE BRANCH HTTPS://WWW.SAFARIBOOKSONLINE.COM/VIDEOS/OREILLY-SOFTWARE-ARCHITECTURE/9781492028116/9781492028116-
- 17. Nike Digital Engineering INSPIRATION FROM AN UNLIKELY SOURCE RUN 250,000/60 MINUTES/60 SECONDS=70 SHOES* PER SECOND
- 18. Nike Digital Engineering INSPIRED BY MICHELLE AND TWITTER INFORMS OUR FUTURE BUSINESS DECISIONS. ALSO FUN TO WATCH IN REAL TIME SHOES* PER SECOND IS A NIKE LAUNCH METRIC MEASURES WHAT MATTERS CUSTOM KPIS IMPORTANT FOR OUR LINE OF BUSINESS CRAWL-WALK-RUN RUN
- 22. Nike Digital Engineering EASY TO IMPLEMENT. BIG WIN FOR THE DEV TEAM NIKE WORKED CLOSELY WITH SIGNALFX DURING BOTH THE ALPHA AND THE BETA SIMPLIFY YOUR DEVOPS ALIGNMENT ACROSS MULTIPLE TEAMS SMART GATEWAY WITH TAIL-BASED SAMPLING MAP OUT YOUR GEOMETRY, INCLUDING SERVERLESS QUICKLY INVESTIGATE ERRORS AND DETERMINE THEIR TRUE SOURCE MICROSERVICES APPLICATION PERFORMANCE MANAGEMENT FLY
- 23. Nike Digital Engineering BE CAREFUL NOT TO OVER INSTRUMENT 1 One service reported a single success or failure metric and used tags to qualify the success or failure ✦ Only report what you care about ✦ Use metric buckets HAVING CUSTOM METRICS LEADS TO BETTER METRICS Our initial efforts concentrated on reporting numbers we thought were important. After observing the initial metrics we were able to derive a better set of metrics ✦ Start with what you think you know ✦ Use that knowledge to build better metrics THE RIGHT METRICS ARE EASY TO IMPLEMENT Most of our metrics are single lines of code that expose values that already exist. Writing many lines of code for a single metric can signal trouble ✦ Metrics should be easy to expose ✦ Use SignalFx’s domain knowledge to build better metrics 2 3 LESSONS LEARNED
- 25. Nike Digital Engineering MONDAY WEDNESDAY TUESDAY RET202-L Leadership Session: AWS Retail with Nike, River Island, and Infosys Wednesday, Nov 28, 11:30 AM - 12:30 PM – MGM, Level 3, Premier Ballroom 316 NIKE & SFX @ REINVENT ANT203 Introduction to Amazon ElasticSearch Service Tuesday, Nov 27, 4:00 PM - 5:00 PM – Aria West, Level 3, Ironwood 5 DAT315 Building a Social Graph at Nike with Amazon Neptune Wednesday, Nov 28, 12:15 PM - 1:15 PM – Venetian, Level 2, Venetian Theatre RET301 Running Nike’s Digital Transformation Monday, Nov 26, 1:00 PM - 2:00 PM– Aria East, Level 1, Joshua 9 DAT320 Becoming a Nimble Giant: How Amazon DynamoDB Serves Nike at Scale Tuesday, Nov 27, 2:30 PM - 3:30 PM – Aria East, Level 2, Mariposa 5 DEV312 Fully Realizing the Microservices Vision with Service Mesh Tuesday, Nov 27, 1:00 PM - 2:00 PM– Aria West, Level 3, Juniper 1