Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Machine learning with Google machine learning APIs - Puppy or Muffin?

5,160 views

Published on

A brief overview of what machine learning is and how it's used at Google and in other projects.

Then find out how to take advantage of machine learning without building and training your own models. The Google Cloud Vision and Speech APIs expose the machine learning functionality behind Google Photos, Google Images, and the speech recognition in “Ok, Google.” Developers can now build these features into their apps with a simple REST API call.

This deck gives an overview of Google Cloud Vision API, Cloud Speech API, and the Cloud Natural Language API.

Published in: Technology
  • A professional Paper writing services can alleviate your stress in writing a successful paper and take the pressure off you to hand it in on time. Check out, please ⇒ www.HelpWriting.net ⇐
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • To get professional research papers you must go for experts like ⇒ www.WritePaper.info ⇐
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Sie können Hilfe bekommen bei ⇒ www.WritersHilfe.com ⇐. Erfolg und Grüße!
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • boost your bust. increase your breast size by 2 cups, naturally and without surgery. ✱✱✱ https://t.cn/A6Li7BTH
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • DOWNLOAD THE BOOK INTO AVAILABLE FORMAT (New Update) ......................................................................................................................... ......................................................................................................................... Download Full PDF EBOOK here { https://urlzs.com/UABbn } ......................................................................................................................... Download Full EPUB Ebook here { https://urlzs.com/UABbn } ......................................................................................................................... Download Full doc Ebook here { https://urlzs.com/UABbn } ......................................................................................................................... Download PDF EBOOK here { https://urlzs.com/UABbn } ......................................................................................................................... Download EPUB Ebook here { https://urlzs.com/UABbn } ......................................................................................................................... Download doc Ebook here { https://urlzs.com/UABbn } ......................................................................................................................... ......................................................................................................................... ................................................................................................................................... eBook is an electronic version of a traditional print book THE can be read by using a personal computer or by using an eBook reader. (An eBook reader can be a software application for use on a computer such as Microsoft's free Reader application, or a book-sized computer THE is used solely as a reading device such as Nuvomedia's Rocket eBook.) Users can purchase an eBook on diskette or CD, but the most popular method of getting an eBook is to purchase a downloadable file of the eBook (or other reading material) from a Web site (such as Barnes and Noble) to be read from the user's computer or reading device. Generally, an eBook can be downloaded in five minutes or less ......................................................................................................................... .............. Browse by Genre Available eBOOK .............................................................................................................................. Art, Biography, Business, Chick Lit, Children's, Christian, Classics, Comics, Contemporary, CookBOOK, Manga, Memoir, Music, Mystery, Non Fiction, Paranormal, Philosophy, Poetry, Psychology, Religion, Romance, Science, Science Fiction, Self Help, Suspense, Spirituality, Sports, Thriller, Travel, Young Adult, Crime, EBOOK, Fantasy, Fiction, Graphic Novels, Historical Fiction, History, Horror, Humor And Comedy, ......................................................................................................................... ......................................................................................................................... .....BEST SELLER FOR EBOOK RECOMMEND............................................................. ......................................................................................................................... Blowout: Corrupted Democracy, Rogue State Russia, and the Richest, Most Destructive Industry on Earth,-- The Ride of a Lifetime: Lessons Learned from 15 Years as CEO of the Walt Disney Company,-- Call Sign Chaos: Learning to Lead,-- StrengthsFinder 2.0,-- Stillness Is the Key,-- She Said: Breaking the Sexual Harassment Story THE Helped Ignite a Movement,-- Atomic Habits: An Easy & Proven Way to Build Good Habits & Break Bad Ones,-- Everything Is Figureoutable,-- What It Takes: Lessons in the Pursuit of Excellence,-- Rich Dad Poor Dad: What the Rich Teach Their Kids About Money THE the Poor and Middle Class Do Not!,-- The Total Money Makeover: Classic Edition: A Proven Plan for Financial Fitness,-- Shut Up and Listen!: Hard Business Truths THE Will Help You Succeed, ......................................................................................................................... .........................................................................................................................
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

Machine learning with Google machine learning APIs - Puppy or Muffin?

  1. 1. a.k.a. “Puppy or muffin?” Machine learning with Google APIs Easily leverage machine learning in your apps Bret McGowen @bretmcg
  2. 2. 2@bretmcg Who am I? Developer Advocate, Google Cloud Platform Bret McGowen / @bretmcg ● New York, NY ● Aspiring Node.js developer ● College football fan (Gig 'em, Aggies!) ● Lord of the Rings aficionado
  3. 3. What we’ll cover 01 02 03 04 05 A (very) brief overview of machine learning Machine learning at Google and elsewhere Vision API Speech API Natural Language API
  4. 4. 01 A (very) brief overview of machine learning
  5. 5. 5@bretmcg 5 Machine learning is learning from examples and experience.
  6. 6. 6@bretmcg Machine learningArtificial intelligence Making machines intelligent. Making machines that learn. "Programming a computer to learn to be clever is easier than programming a computer to be clever directly."
  7. 7. 7@bretmcg
  8. 8. Google Cloud Platform 8 Why the sudden explosion in machine learning?
  9. 9. 9@bretmcg
  10. 10. The bigger, the better From: Andrew Ng
  11. 11. 12@bretmcg
  12. 12. 13@bretmcg
  13. 13. DNN requires large training datasets Large models don't fit into a GPU Requires try-and-errors to find the best design, configs and params ↓ Need to spend a few days or weeks to finish a training The challenge: computing power
  14. 14. GPUs run at nanoseconds GPU cluster needs microsec network
  15. 15. 02 Machine Learning at Google (and elsewhere)
  16. 16. 17@bretmcg Enterprise Google Cloud is The Datacenter as a Computer
  17. 17. 18@bretmcg Jupiter Network • 10 GbE x 100 K = 1 Pbps • Consolidates servers with microsec latency
  18. 18. 19@bretmcg Tensor Processing Unit ASIC for TensorFlow Designed by Google 10x better perf / watt latency and efficiency bit quantization
  19. 19. 20@bretmcg TPUs in Production RankBrain AlphaGo Google Photos Speech and more
  20. 20. 21@bretmcg
  21. 21. 22@bretmcg signal for Search ranking, out of hundreds improvement to ranking quality in 2+ years #3 #1 Search machine learning for search engines RankBrain: a deep neural network for search ranking
  22. 22. WaveNet by Google DeepMind
  23. 23. Combined vision and translation
  24. 24. Smart reply in Inbox by Gmail 10% of all responses sent on mobile
  25. 25. 30@bretmcg Google Photos
  26. 26. Open source Machine Learning library Especially useful for Deep Learning For research and production Apache 2.0 license
  27. 27. TensorFlow powered Fried Chicken Nugget Server From: http://www.rt-net.jp/karaage1/
  28. 28. TensorFlow powered Cucumber Sorter
  29. 29. TensorFlow powered Cucumber Sorter
  30. 30. TensorFlow+ RasPi for sorting garbages From: https://techcrunch.com/2016/09/13/auto-trash-sorts- garbage-automatically-at-the-techcrunch-disrupt-hacka thon/
  31. 31. Google Cloud Platform 36 Let's try some human-powered image detection
  32. 32. Puppy or muffin? source: boredpanda.com
  33. 33. source: boredpanda.com
  34. 34. Google Cloud Platform 40 What if I'm not a machine learning expert?
  35. 35. 41@bretmcg The Machine Learning Spectrum TensorFlow Cloud Machine Learning Machine Learning APIs BYOML skills (Developers, Data Scientists) (Friendly Machine Learning) Pre-packaged ML
  36. 36. 03 The Cloud Vision API Complex image detection with a simple REST request
  37. 37. Google Cloud Platform 44 Making an API request
  38. 38. Making a request { "requests":[ { "image": { "content": "base64ImageString" // Alternatively, you can pass a Google Cloud Storage url here }, "features": [ { "type": "LABEL_DETECTION", "maxResults": 10 }, { "type": "FACE_DETECTION", "maxResults": 10 }, // More feature detection types... ] } ]
  39. 39. Google Cloud Platform 46 Let’s see some JSON responses
  40. 40. 47 { "labelAnnotations" : [ { "mid" : "/m/01wydv", "score" : 0.92442685, "description" : "beignet" }, { "mid" : "/m/0270h", "score" : 0.90845567, "description" : "dessert" }, { "mid" : "/m/033nb2", "score" : 0.74553984, "description" : "profiterole" }, { "mid" : "/m/01dk8s", "score" : 0.71415579, "description" : "powdered sugar" } ] } Label Detection 47
  41. 41. "landmarkAnnotations": [ { "mid": "/m/0c7ln", "description": "Navy Pier", "score": 36, "boundingPoly": { "vertices": [ { "x": 275, "y": 102 }, //... ] }, "locations": [ { "latLng": { "latitude": 41.888685, "longitude": -87.601311 } } ], //... }, { "mid": "/m/01_d4", "description": "Chicago", "score": 31, Landmark Detection 48
  42. 42. 49 ... "itemListElement": [ { "@type": "EntitySearchResult", "result": { "@id": "kg:/m/0c7ln", "name": "Navy Pier", "@type": [ "Thing", "Place", "LandmarksOrHistoricalBuildings", "TouristAttraction" ], ... "detailedDescription": { "articleBody": "Navy Pier is a 3,300-foot-long pier on the Chicago shoreline of Lake Michigan. It is located in the Streeterville neighborhood of the Near North Side community area.", "url": "http://en.wikipedia.org/wiki/Navy_Pier" ... Knowledge Graph sidebar GET https://kgsearch.googleapis.com/v1/entities:search?ids=%2Fm%2F0b__kbm&key={API_KEY}
  43. 43. 50 "textAnnotations": [ { "locale": "en", "description": "U.S. COAST GUARD AUXILIARYn242039n", "boundingPoly": { "vertices": [ { "x": 429, "y": 307 }, { "x": 1178, "y": 307 }, { "x": 1178, "y": 770 }, { "x": 429, "y": 770 } ] } }, // ... ] Text Detection
  44. 44. 51 "faceAnnotations" : [ { "headwearLikelihood" : "VERY_LIKELY", "surpriseLikelihood" : "VERY_UNLIKELY", "rollAngle" : 2.8030474, "angerLikelihood" : "VERY_UNLIKELY", "landmarks" : [ { "type" : "LEFT_EYE", "position" : { "x" : 221.60617, "y" : 638.263, "z" : 0.0017568493 } }, ... ], "boundingPoly" : { "vertices" : [ { "x" : 89, "y" : 436 }, ... Face Detection "detectionConfidence" : 0.98838496, "joyLikelihood" : "VERY_LIKELY", "panAngle" : -1.0822374, "sorrowLikelihood" : "VERY_UNLIKELY", "tiltAngle" : -2.5003448, "underExposedLikelihood" : "VERY_UNLIKELY", "blurredLikelihood" : "VERY_UNLIKELY"
  45. 45. 52 "faceAnnotations" : [ { "headwearLikelihood" : "VERY_UNLIKELY", "surpriseLikelihood" : "VERY_UNLIKELY", rollAngle" : -4.6490049, "angerLikelihood" : "VERY_UNLIKELY", "landmarks" : [ { "type" : "LEFT_EYE", "position" : { "x" : 691.97974, "y" : 373.11096, "z" : 0.000037421443 } }, ... ], "boundingPoly" : { "vertices" : [ { "x" : 743, "y" : 449 }, ... Face Detection "detectionConfidence" : 0.93568963, "joyLikelihood" : "VERY_LIKELY", "panAngle" : 4.150538, "sorrowLikelihood" : "VERY_UNLIKELY", "tiltAngle" : -19.377356, "underExposedLikelihood" : "VERY_UNLIKELY", "blurredLikelihood" : "VERY_UNLIKELY"
  46. 46. 53 "labelAnnotations" : [ { "mid" : "/m/01fklc", "score" : 0.9337945, "description" : "pink" }, { "mid" : "/m/09g5pq", "score" : 0.83878618, "description" : "people" }, { "mid" : "/m/017ftj", "score" : 0.71847415, "description" : "sunglasses" }, { "mid" : "/m/019nj4", "score" : 0.69381392, "description" : "smile" } ] Putting it all together: face + label + landmark "landmarkAnnotations" : [ { "boundingPoly" : { "vertices" : [ { "x" : 153, "y" : 64 }, ... ] }, "mid" : "/m/0c7zy", "score" : 0.56636304, "description" : "Petra", "locations" : [ { "latLng" : { "longitude" : 35.449361, "latitude" : 30.323975 } } ] } ]
  47. 47. 54 "safeSearchAnnotation" : { "spoof" : "VERY_UNLIKELY", "medical" : "VERY_UNLIKELY", "adult" : "VERY_UNLIKELY", "violence" : "VERY_UNLIKELY" } But wait...is it appropriate?
  48. 48. Live Demo
  49. 49. 04 The Speech API Speech to text transcription in over 80 languages
  50. 50. 57@bretmcg What can I do with the Speech API? ● Speech to text transcription in over 80 languages ● Supports streaming and non-streaming recognition ● Filters inappropriate content
  51. 51. 58@bretmcg Translation Response "responses": [{ "results": [{ "alternatives": [ { "transcript": "how old is the Brooklyn Bridge", "confidence": 0.987629 }], "isFinal": true } ] }]
  52. 52. 59@bretmcg Let’s make a recording! 1. Make a recording using SoX, a command line utility for audio files 2. Base64 encode the recording 3. Build our API request in a JSON file 4. Send the JSON request to the Speech API Bash script at https://goo.gl/zgvbWY
  53. 53. 05 Cloud Natural Language API Perform sentiment analysis and entity recognition on text
  54. 54. 61@bretmcg What can I do with the Natural Language API? Three methods: 1. Analyze entities - The Washington Nationals are an MLB team from Washington, D.C. 2. Analyze sentiment - The DC metro area is a great place to live and work. 3. Analyze syntax - Michelle Obama is married to Barack Obama
  55. 55. 62@bretmcg Analyze Entities There is plenty to do in Washington, D.C. without having to spend a single dollar. The Smithsonian is totally free, as is the U.S. Capitol building, along with the White House tour, the U.S. Supreme Court Building, and many other monuments. Bring your Android camera and take photos! -- Bret McGowen's Made-Up Guide to Washington, D.C.
  56. 56. 63@bretmcg Analyze Entities There is plenty to do in Washington, D.C. without having to spend a single dollar. The Smithsonian is totally free, as is the U.S. Capitol building, along with the White House tour, the U.S. Supreme Court Building, and many other monuments. Bring your Android camera and take photos! -- Bret McGowen's Made-Up Guide to Washington, D.C.
  57. 57. 64@bretmcg Analyze Entities "name": "Bret McGowen", "type": "PERSON", "metadata": {}, "salience": 0.0164788, "mentions": [ { "text": { "content": "Bret McGowen", "beginOffset": -1 } } ] There is plenty to do in Washington, D.C. without having to spend a single dollar. The Smithsonian is totally free, as is the U.S. Capitol building, along with the White House tour, the U.S. Supreme Court Building, and many other monuments. Bring your Android camera and take photos! -- Bret McGowen's Made-Up Guide to Washington, D.C. "name": "Washington, D.C.", "type": "LOCATION", "metadata": { "wikipedia_url": "http://en.wikipedia.org/wiki/Washington,_D.C ." }, "salience": 0.29157177, "mentions": [ { "text": { "content": "Washington, D.C.", "beginOffset": -1 } } "name": "Android", "type": "CONSUMER_GOOD", "metadata": { "wikipedia_url": "http://en.wikipedia.org/wiki/Android_(operating_ system)" }
  58. 58. 65@bretmcg Analyze Sentiment Texas is the best state in the Union. { “documentSentiment”: { “polarity”: 1, “magnitude”: 0.8 } }
  59. 59. 66@bretmcg Analyze Syntax “My dog Fluffy has been missing ever since Bret brought in that basket of muffins.”
  60. 60. 67@bretmcg Analyze Syntax
  61. 61. 68@bretmcg Let’s see a demo! Twitter Streaming NL API BigQuery bit.ly/nl-olympics
  62. 62. 69@bretmcg APIs we covered ● Vision: cloud.google.com/vision ● Speech: cloud.google.com/speech ● Natural Language: cloud.google.com/natural-language Related APIs: ● Translate: cloud.google.com/translate ● Prediction: cloud.google.com/prediction ● Knowledge Graph API: developers.google.com/knowledge-graph
  63. 63. 70@bretmcg 70 Oh, in case you were wondering...
  64. 64. source: boredpanda.com "labelAnnotations": [ { "mid": "/m/02wbm", "description": "Food", "score": 96 }, { "mid": "/m/02q08p0", "description": "Dish", "score": 87 }, { "mid": "/m/0270h", "description": "Dessert", "score": 86 }, { "mid": "/m/0dxb5", "description": "Berry", "score": 83 }, { "mid": "/m/052lwg6", "description": "Baked Goods", "score": 78 }, { "mid": "/m/0hz4q", "description": "Breakfast", "score": 76 }, { "mid": "/m/01tcjp", "description": "Muffin", "score": 76 },
  65. 65. source: boredpanda.com
  66. 66. source: boredpanda.com ? "Baked goods" "Mammal" Looking for: ● Dog (or breed) ● Muffin
  67. 67. 74@bretmcg 74 Bret McGowen @bretmcg Thank You!

×