An overview of the different Cloud technologies available from Google including App Engine, Google Storage, Google Prediction API, and BigQuery.
This presentation was given to the San Diego GTUG on Aug 26th, 2011.
These slides are made for the 2013 DevFest talks. It covers the main blocks of Google cloud platform: App engine, Compute Engine, storage options and more.
Google Cloud - Scale With A Smile (Dec 2014)Ido Green
Β
"Google's ability to build, organize, and operate a huge network of servers and fiber-optic cables with an efficiency and speed that rocks physics on its heels. This is what makes Google Google: its physical network, its thousands of fiber miles, and those many thousands of servers that, in aggregate, add up to the mother of all clouds.β - Wired
---
Well, Wired hit the nail on the head with this quote about our platform. In this presentation we cover most of the new interesting features that will give you the ability to scale with (a big) smile!
Overview of Google Cloud products for Developers, to build, sell and monetize web apps: Google Apps Marketplace, App Engine, App Engine for Business, Google Storage, Prediction and BigQuery APIs.
These slides are made for the 2013 DevFest talks. It covers the main blocks of Google cloud platform: App engine, Compute Engine, storage options and more.
Google Cloud - Scale With A Smile (Dec 2014)Ido Green
Β
"Google's ability to build, organize, and operate a huge network of servers and fiber-optic cables with an efficiency and speed that rocks physics on its heels. This is what makes Google Google: its physical network, its thousands of fiber miles, and those many thousands of servers that, in aggregate, add up to the mother of all clouds.β - Wired
---
Well, Wired hit the nail on the head with this quote about our platform. In this presentation we cover most of the new interesting features that will give you the ability to scale with (a big) smile!
Overview of Google Cloud products for Developers, to build, sell and monetize web apps: Google Apps Marketplace, App Engine, App Engine for Business, Google Storage, Prediction and BigQuery APIs.
Getting Started on Google Cloud PlatformAaron Taylor
Β
This slide deck accompanied a talk I gave at Boston's Google Cloud Meetup group in June of 2016. It chronicles our story of building out the Meta Search product using Google Cloud Platform, particularly App Engine, and finishes with a short walkthrough of a demo application.
Google Cloud Platform is a cloud computing platform by Google that offers hosting on the same supporting infrastructure that Google uses internally for end-user products like Google Search and YouTube. Cloud Platform provides developer products to build a range of programs from simple websites to complex applications.
Google Cloud Platform is a part of a suite of enterprise solutions from Google for Work and provides a set of modular cloud-based services with a host of development tools. For example, hosting and computing, cloud storage, data storage, translations APIs and prediction APIs.
Topic Covered
Why Google Cloud Platform ?
Google Cloud Platform Services: First Insight !!!
Introduction to Google Cloud Services / PlatformsNilanchal
Β
The presentation provides a brief Introduction to Google Cloud Services and Platforms. In the course of this slide, we will introduce you the different Google cloud computing options, Compute Engine, App Engine, Cloud function, Databases, file storage and security features of Google cloud platform.
This is a 1-hr tech talk designed for developers to give a comprehensive, vendor-agnostic overview of cloud computing, primarily targeting educators in the higher education market but is open to any developer. This is followed by an introduction to products in Google Cloud, focusing on the serverless products. The talk ends with several inspirational examples of what can be built with Google Cloud
Scale with a smile with Google Cloud Platform At DevConTLV (June 2014)Ido Green
Β
What is new and hot on Google Cloud?
How can you work like a pro with some (or all) the new APIs and services... Here are some good starting points to follow.
Here's an intro to the 30 Days of Google Cloud program to kickstart your career in the cloud as well as earn exciting prizes & digital badges. To start with, your facilitator, Mohini Gupta, will be taking you on board this journey, explaining you these :
1.) Introduction to the program
2.) About GCP Crash Course
3.) A Tour of Qwiklabs and the Google Cloud Platform Lab
4.) Hands-on lab experience
GDG DevFest Romania - Architecting for the Google Cloud PlatformMΓ‘rton Kodok
Β
Learn about FaaS, PaaS architectural patterns that make use of Cloud Functions, Pub/Sub, Dataflow, Kubernetes and platforms that hides the management of servers from the user and have changed how we develop and deploy future software.
We discuss the difference between an event-driven approach - this means that you can trigger a function whenever something interesting happens within the cloud environment - and the simpler HTTP approach. Quota and pricing of per invocation, and the advantages and disadvantages of the serverless systems.
Building Enterprise Applications on Google Cloud Platform Cloud Computing Exp...Chris Schalk
Β
This is a presentation given by Google Developer Advocate Chris Schalk at Cloud Expo in NYC on June 8th 2011 on building enterprise applications with Google's Cloud Platform.
Getting Started on Google Cloud PlatformAaron Taylor
Β
This slide deck accompanied a talk I gave at Boston's Google Cloud Meetup group in June of 2016. It chronicles our story of building out the Meta Search product using Google Cloud Platform, particularly App Engine, and finishes with a short walkthrough of a demo application.
Google Cloud Platform is a cloud computing platform by Google that offers hosting on the same supporting infrastructure that Google uses internally for end-user products like Google Search and YouTube. Cloud Platform provides developer products to build a range of programs from simple websites to complex applications.
Google Cloud Platform is a part of a suite of enterprise solutions from Google for Work and provides a set of modular cloud-based services with a host of development tools. For example, hosting and computing, cloud storage, data storage, translations APIs and prediction APIs.
Topic Covered
Why Google Cloud Platform ?
Google Cloud Platform Services: First Insight !!!
Introduction to Google Cloud Services / PlatformsNilanchal
Β
The presentation provides a brief Introduction to Google Cloud Services and Platforms. In the course of this slide, we will introduce you the different Google cloud computing options, Compute Engine, App Engine, Cloud function, Databases, file storage and security features of Google cloud platform.
This is a 1-hr tech talk designed for developers to give a comprehensive, vendor-agnostic overview of cloud computing, primarily targeting educators in the higher education market but is open to any developer. This is followed by an introduction to products in Google Cloud, focusing on the serverless products. The talk ends with several inspirational examples of what can be built with Google Cloud
Scale with a smile with Google Cloud Platform At DevConTLV (June 2014)Ido Green
Β
What is new and hot on Google Cloud?
How can you work like a pro with some (or all) the new APIs and services... Here are some good starting points to follow.
Here's an intro to the 30 Days of Google Cloud program to kickstart your career in the cloud as well as earn exciting prizes & digital badges. To start with, your facilitator, Mohini Gupta, will be taking you on board this journey, explaining you these :
1.) Introduction to the program
2.) About GCP Crash Course
3.) A Tour of Qwiklabs and the Google Cloud Platform Lab
4.) Hands-on lab experience
GDG DevFest Romania - Architecting for the Google Cloud PlatformMΓ‘rton Kodok
Β
Learn about FaaS, PaaS architectural patterns that make use of Cloud Functions, Pub/Sub, Dataflow, Kubernetes and platforms that hides the management of servers from the user and have changed how we develop and deploy future software.
We discuss the difference between an event-driven approach - this means that you can trigger a function whenever something interesting happens within the cloud environment - and the simpler HTTP approach. Quota and pricing of per invocation, and the advantages and disadvantages of the serverless systems.
Building Enterprise Applications on Google Cloud Platform Cloud Computing Exp...Chris Schalk
Β
This is a presentation given by Google Developer Advocate Chris Schalk at Cloud Expo in NYC on June 8th 2011 on building enterprise applications with Google's Cloud Platform.
The System Administrator Role in the Cloud Era: Better Than Ever (ENT212) | A...Amazon Web Services
Β
With developers and business leaders driving the charge into cloud computing, where does this leave the IT department and, to put it bluntly, me, the sysadmin? Fear not, IT operation skills are highly relevant and in demand in the cloud era, but it might take a little repositioning on your part to get the opportunity. In this session, Forrester analyst James Staten shares how the leading sysadmins are engaging the business on their cloud journey and what they have done to evolve their role, advance their skills, and position themselves as IT change agents and leaders for the next generation.
DoubleClick for Publishers (DFP) Basic GuideBidGear Inc.
Β
DoubleClick for Publishers (DFP) is a comprehensive hosted ad serving platform that streamlines your ad management, whether you deliver ads to websites, mobile pages, mobile apps. It helps publishers to organize ad stack and sell their advertising inventory more efficiently.
A Beginnerβs Guide to DFP
DoubleClick for Publishers (DFP) is a must-have for every publisher that is aiming for money from his website. In this presentation you will find the basics terms and concepts to get you started.
What You Need To Know For A Successful Start on DoubleClick Bid ManagerHanapin Marketing
Β
Are you wanting to jump into the world of programmatic advertising? DoubleClick Bid Manager is an easy way to start programmatic if you are already advertising on Google and Bing. It offers more access to spend and reporting, however, unlike Google AdWords, you canβt just start a campaign right away. There are multiple steps along way, numerous settings, and targeting options you need to be aware of before you even start your campaign.
In this presentation, Hanapin expert Kelsey Hadaller, discusses what you need to know for a successful start and smooth transition on DoubleClick Bid Manager.
Getting Started with the Hybrid Cloud: Enterprise Backup and RecoveryAmazon Web Services
Β
This session is for architects and storage admins seeking simple and non-disruptive ways to adopt cloud platforms in their organizations. You will learn how to deliver lower costs and greater scale with nearly seamless integration into your existing B&R processes. Services mentioned: S3, Glacier, Snowball, 3rd party partners, storage gateway, and ingestion services.
DoubleClick for Advertisers is an Ad Management and Ad Serving solution that helps Agency and Advertisers manage the entire scope of digital advertising.
Follow me to get more updates regularly.
Introduction to WWW, History of Web
Protocols governing web
Cyber Crime
Cyber Laws
IT Act 2000
Web Development Strategies, Planning and Development
Web Applications
Web Development Process
Web Team
Quick Intro to Google Cloud TechnologiesChris Schalk
Β
This is the "Lightning Presentation" given at DreamForce 2011 on Google's Cloud Technologies. It covers, App Engine, Google Storage and BigQuery. #df11
Building Integrated Applications on Google's Cloud TechnologiesChris Schalk
Β
This is the presentation "Building Integrated Applications on Google's Cloud Technologies" that was given at GDD 2011 #gdd11 in Sao Paulo and Buenos Aires by Google Developer Advocate Chris Schalk @cschalk.
Introduction to Google Cloud platform technologiesChris Schalk
Β
This is a presentation given by Google Developer Advocate Chris Schalk at Spring One 2GX on Oct 21st, 2010. It introduces Google Storage for Developers, Prediction API, and BigQuery.
Intro to new Google cloud technologies: Google Storage, Prediction API, BigQueryChris Schalk
Β
This is an introductory presentation given at DevFest Madrid 2010 by Google Developer Advocate Chris Schalk. It introduces new Google cloud technologies: Google Storage, Google Prediction API and BigQuery.
The 'macro view' on Big Query:
We started with an overview, some typical uses and moved to project hierarchy, access control and security.
In the end we touch about tools and demos.
Building Kick Ass Video Games for the CloudChris Schalk
Β
This is a presentation that covers how to use PlayN to build kick ass games for the cloud. It was delivered at GDC Online 2011, by Google Developer Advocate, Chris Schalk
Half-hour tech talk given at user groups or technical conferences to introducing developers to integrating with Google (Cloud) APIs from Python .
ABSTRACT
Want to integrate Google technologies into the web+mobile apps that you build? Google has various open source libraries & developer tools that help you do exactly that. Users who have run into roadblocks like authentication or found our APIs confusing/challenging, are welcome to come and make these non-issues moving forward. Learn how to leverage the power of Google technologies in the next apps you build!!
Google Cloud for Data Crunchers - Strata Conf 2011Patrick Chanezon
Β
http://strataconf.com/strata2011/public/schedule/detail/16242
Talk at Strata 2011 with Ryan Boyd and Kirrily Roberts
Google is a Data business: over the past few years, many of the tools Google created to store, query, analyze, visualize its data, have been exposed to developers as services.
This talk will give you an overview of Google services for Data Crunchers:
Google Storage for developers
BigQuery, fast interactive queries on Terabytes of data
Machine Learning API: Machine Learning made easy
Google App Engine, exposing Data APIs is a very common use case for App Engine
Visualization API: many cool visualization components
GDD Brazil 2010 - Google Storage, Bigquery and Prediction APIsPatrick Chanezon
Β
Google is expanding our storage products by introducing Google Storage for Developers. It offers a RESTful API for storing and accessing data at Google. Developers can take advantage of the performance and reliability of Google's storage infrastructure, as well as the advanced security and sharing capabilities. We will demonstrate key functionality of the product as well as customer use cases. Google relies heavily on data analysis and has developed many tools to understand large datasets. Two of these tools are now available on a limited sign-up basis to developers: (1) BigQuery: interactive analysis of very large data sets and (2) Prediction API: make informed predictions from your data. We will demonstrate their use and give instructions on how to get access.
Image archive, analysis & report generation with Google Cloudwesley chun
Β
Google Cloud provides a diverse array of services to realize the ambition of solving real business problems, like constrained resources. An image archive & analysis plus report generation use-case can be realized with just Google Workspace & GCP APIs. The principle of mixing-and-matching Google technologies is applicable to many other challenges faced by you, your organization, or your customers. These slides are from a half- to 1-hour presentation about this case study.
Entrepreneurship Tips With HTML5 & App Engine Startup Weekend (June 2012)Ido Green
Β
My talk in Startup Weekend 2012 during Google I/O. It cover, startup life tips, modern web apps and how to leverage Google cloud (specific App Engine).
Powerful Google developer tools for immediate impact! (2023-24 A)wesley chun
Β
This is one of two 45-60-min presentations to students or working professionals. You may know Google for search, YouTube, Android, Chrome, and Gmail, but did you know Google has many other cloud services? In this comprehensive yet still high-level overview of Google Cloud tools & APIs with the purpose of inspiring you as to what's possible. The session introduces Google's machine learning & other APIs, tools that have an immediate impact on projects, alleviating the need to think about computing infrastructure as well as dispensing with the need to have machine learning expertise. We'll wrap up w/online resources like videos & hands-on tutorials to get you started! The main takeaways are where to run your code, store your data, and analyze your data, all in the cloud!
The other version of this talk ("B") focuses more on serverless platforms.
30-45-min tech talk given at user groups or technical conferences to introducing developers to integrating with Google APIs from Python .
ABSTRACT
Want to integrate Google technologies into the web+mobile apps that you build? Google has various open source libraries & developer tools that help you do exactly that. Users who have run into roadblocks like authentication or found our APIs confusing/challenging, are welcome to come and make these non-issues moving forward. Learn how to leverage the power of Google technologies in the next apps you build!!
You may know Google for search, YouTube, Android, Chrome, and Gmail, but that's only as an end-user of OUR apps. Did you know you can also integrate Google technologies into YOUR apps? We have many APIs and open source libraries that help you do that! If you have tried and found it challenging, didn't find not enough examples, run into roadblocks, got confused, or just curious about what Google APIs can offer, join us to resolve any blockers. Code samples will be in Python and/or Node.js/JavaScript. This session focuses on showing you how to access Google Cloud APIs from one of Google Cloud's compute platforms, whether serverless or otherwise.
An overview and update presentation on Google App Engine given by Google Developer Advocate Christian Schalk at the 2011 DevFest Singapore and Jakarta events. Developer Advocate Wesley Chun also participated in the Q&A.
How to build Kick Ass Games in the CloudChris Schalk
Β
This is a presentation given by Googlers Chris Schalk and Johan Euphrosine (Proppy) at GDD Sydney 2011 on how to build multi-platform video games using PlayN.
GDD 2011 - How to build kick ass video games for the cloudChris Schalk
Β
This is the Google Developer Day 2011 "How to build kick ass games in the cloud" presentation that was given in Sao Paulo and Buenos Aires. (The title is in Spanish since it was last given in Argentina - the content is the same as Sao Paulo though)
It was given by Google Developer Advocate, Chris Schalk in Sept 2011. @cschalk
An overview of the different Google Cloud Technologies. Includes coverage of Google App Engine, Google Storage, Google Prediction Api, and BigQuery.
This presentation was given to the San Diego GTUG on Aug 26th, 2011.
A review and update presentation on Google App Engine's latest features up through version 1.5.3 and including new experimental features. This presentation was given to the San Diego GTUG on Aug 26, 2011.
Building Apps on Google Cloud TechnologiesChris Schalk
Β
This is a presentation on how to use the different Google Cloud technologies to build applications.
It was delivered in Mexico City at the "EstoEsGoogle" aka Devfest Mexico event on Aug 9th, 2011 in Mexico City by Google Developer Advocate Chris Schalk.
This is a presentation on Google App Engine's Latest Features.
It was delivered in Mexico City at the "EstoEsGoogle" aka Devfest Mexico event on Aug 9th, 2011 in Mexico City by Google Developer Advocate Chris Schalk.
Building Multi-platform Video Games for the CloudChris Schalk
Β
This is a presentation on how to build multi-platform (HTML5, Flash, Java/Android) video games using an open source technology known as Forplay (PlayN).
This presentation was delivered in Mexico City on Aug 9th, 2011 at the "EstoEsGoogle" aka Devfest Mexico event on Aug 9th in Mexico City by Google Developer Advocate Chris Schalk
This is an introduction presentation on App Engine for Business given by Chris Schalk, Google Developer Advocate on Oct 26, 2010 at the PayPal Innovate conference.
What's new in App Engine and intro to App Engine for BusinessChris Schalk
Β
This is a presentation given by Devfest Madrid 2010 by Google Developer Advocate Chris Schalk on "What's new in Google App Engine and Intro to App Engine for Business"
App Engine Overview @ Google Hackathon SXSW 2010Chris Schalk
Β
This is an overview presentation on Google App Engine. This was given at the Google hackathon @ SXSW Interactive, 2010.
bit.ly/googlehackathonsxsw
bit.ly/gcodelabs
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
Β
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Β
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
DevOps and Testing slides at DASA ConnectKari Kakkonen
Β
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
Β
As AI technology is pushing into IT I was wondering myself, as an βinfrastructure container kubernetes guyβ, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefitβs both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Β
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Β
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
Β
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Β
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
5. Cloud Development in a Box
β Downloadable SDK
β Application runtimes
β Java, Python
β Local development tools
β Eclipse plugin,
AppEngine Launcher
β Specialized application
services
β Cloud based dashboard
β Ready to scale
β Built in fault tolerance, load
balancing
6. Specialized Services
Memcache Datastore URL Fetch
Mail XMPP Task Queue
Images Blobstore User Service
But, is that it?
9. New Google Cloud Technologies
β Google Storage
β Store your data in Google's cloud
β Prediction API
β Google's machine learning tech in an API
β BigQuery
β Hi-speed data analysis on massive scale
β SQL Service*
β Relational Database in the cloud
11. What Is Google Storage?
β Store your data in Google's cloud
β any format, any amount, any time
β You control access to your data
β private, shared, or public
β Access via Google APIs or 3rd party tools/libraries
12. Sample Use Cases
Static content hosting
e.g. static html, images, music, video
Backup and recovery
e.g. personal data, business records
Sharing
e.g. share data with your customers
Data storage for applications
e.g. used as storage backend for Android, AppEngine, Cloud
based apps
Storage for Computation
e.g. BigQuery, Prediction API
13. Google Storage Benefits
High Performance and Scalability
Backed by Google infrastructure
Strong Security and Privacy
Control access to your data
Easy to Use
Get started fast with Google & 3rd party tools
14. Google Storage Technical Details
β RESTful API
β Verbs: GET, PUT, POST, HEAD, DELETE
β Resources: identified by URI
β Compatible with S3
β Buckets
β Flat containers
β Objects
β Any type
β Size: 100 GB / object
β Access Control for Google Accounts
β For individuals and groups
β Two Ways to Authenticate Requests
β Sign request using access keys
β Web browser login
15. Security and Privacy Features
β Key-based authentication
β Authenticated downloads from a web browser
β Sharing with individuals
β Group sharing via Google Groups
β Access control for buckets and objects
β Set Read/Write/List permissions
19. Google Storage - Pricing
β Free trial quota until Dec 31, 2011
β For first project
β 5 GB of storage
β 25 GB download/upload data
β 20 GB to Americas/EMEA, 5GB APAC
β 25K GET, HEAD requests
β 2,5K PUT, POST, LIST* requests
β Production Storage
β $0.17/GB/Month (Location US, EU)
β Upload - $0.10/GB
β Download
β $0.15/GB Americas / EMEA
β $0.30/GB APAC
β Requests
β PUT, POST, LIST - $0.01 / 1000 Requests
β GET, HEAD - $0.01 / 10,000 Requests
β Up to 99.9% SLA
20. Google Storage Summary
β Store any kind of data using Google's cloud infrastructure
β Easy to Use APIs
β Many available tools and libraries
β gsutil, GS Manager
β 3rd party:
β Boto, CloudBerry, CyberDuck, JetS3t, and more
22. Google Prediction API as a simple example
Predicts outcomes based on 'learned' patterns
23. How does it work?
"english" The quick brown fox jumped over the
The Prediction API lazy dog.
finds relevant
"english" To err is human, but to really foul things
features in the up you need a computer.
sample data during "spanish" No hay mal que por bien no venga.
training.
"spanish" La tercera es la vencida.
The Prediction API
later searches for ? To be or not to be, that is the
question.
those features
? La fe mueve montaΓ±as.
during prediction.
24. A virtually endless number of applications...
Customer Transaction Species Message Diagnostics
Sentiment Risk Identification Routing
Churn Legal Docket Suspicious Work Roster Inappropriate
Prediction Classification Activity Assignment Content
Recommend Political Uplift Email Career
Products Bias Marketing Filtering Counselling
... and many more ...
25. Using the Prediction API
A simple three step process...
Upload your training data to
1. Upload Google Storage
Build a model from your data
2. Train
3. Predict Make new predictions
26. Step 1: Upload
Upload your training data to Google Storage
β Training data: outputs and input features
β Data format: comma separated value format (CSV)
"english","To err is human, but to really ..."
"spanish","No hay mal que por bien no venga."
...
Upload to Google Storage
gsutil cp ${data} gs://yourbucket/${data}
27. Step 2: Train
Create a new model by training on data
To train a model:
POST prediction/v1.3/training
{"id":"mybucket/mydata"}
Training runs asynchronously. To see if it has finished:
GET prediction/v1.3/training/mybucket%2Fmydata
{"kind": "prediction#training",...
,"training status": "DONE"}
28. Step 3: Predict
Apply the trained model to make predictions on new data
POST
prediction/v1.3/training/mybucket%2Fmydata/predict
{ "data":{
"input": { "text" : [
"J'aime X! C'est le meilleur" ]}}}
29. Step 3: Predict
Apply the trained model to make predictions on new data
POST prediction/v1.3/training/bucket%2Fdata/predict
{ "data":{
"input": { "text" : [
"J'aime X! C'est le meilleur" ]}}}
{ data : {
"kind" : "prediction#output",
"outputLabel":"French",
"outputMulti" :[
{"label":"French", "score": x.xx}
{"label":"English", "score": x.xx}
{"label":"Spanish", "score": x.xx}]}}
30. Step 3: Predict
Apply the trained model to make predictions on new data
import httplib
header = {"Content-Type" : "application/json"}#...put new data in JSON
format in params variable
conn = httplib.HTTPConnection("www.googleapis.com")conn.request
("POST",
"/prediction/v1.3/query/bucket%2Fdata/predict", params, header)print
conn.getresponse()
31. Demo
β Command line Demos
β Training a model
β Checking training status
β Making predictions
β A complete Web application using the JavaScript
API for Prediction
32. Prediction API Capabilities
Data
β Input Features: numeric or unstructured text
β Output: up to hundreds of discrete categories
Training
β Many machine learning techniques
β Automatically selected
β Performed asynchronously
Access from many platforms:
β Web app from Google App Engine
β Apps Script (e.g. from Google Spreadsheet)
β Desktop app
33. Prediction API - key features
β Multi-category prediction
β Tag entry with multiple labels
β Continuous Output
β Finer grained prediction rankings based on multiple labels
β Mixed Inputs
β Both numeric and text inputs are now supported
Can combine continuous output with mixed inputs
35. Introducing Google BigQuery
β Google's large data adhoc analysis technology
β Analyze massive amounts of data in seconds
β Simple SQL-like query language
β Flexible access
β REST APIs, JSON-RPC, Google Apps Script
37. Many Use Cases ...
Interactive Trends
Spam
Tools Detection
Web Network
Dashboards Optimization
38. Key Capabilities of BigQuery
β Scalable: Billions of rows
β Fast: Response in seconds
β Simple: Queries in SQL
β Web Service
β REST
β JSON-RPC
β Google App Scripts
39. Using BigQuery
Another simple three step process...
Upload your raw data to
1. Upload Google Storage
Import raw data into
2. Import
BigQuery table
3. Query Perform SQL queries on
table
40. Writing Queries
Compact subset of SQL
β SELECT ... FROM ...
WHERE ...
GROUP BY ... ORDER BY ...
LIMIT ...;
Common functions
β Math, String, Time, ...
Statistical approximations
β TOP
β COUNT DISTINCT
41. BigQuery via REST
GET /bigquery/v1/tables/{table name}
GET /bigquery/v1/query?q={query}
Sample JSON Reply:
{
"results": {
"fields": { [
{"id":"COUNT(*)","type":"uint64"}, ... ]
},
"rows": [
{"f":[{"v":"2949"}, ...]},
{"f":[{"v":"5387"}, ...]}, ... ]
}
}
Also supports JSON-RPC
42. Security and Privacy
Standard Google Authentication
β Client Login
β OAuth
β AuthSub
HTTPS support
β protects your credentials
β protects your data
Relies on Google Storage to manage access
43. Large Data Analysis Example
Wikimedia Revision History
Wikimedia Revision history data from: http://download.wikimedia.
org/enwiki/latest/enwiki-latest-pages-meta-history.xml.7z
47. Recap
β Google App Engine
β Application development platform for the
cloud
β Google Storage
β High speed cloud data storage on Google's
infrastructure
β Prediction API
β Google's machine learning technology able to
predict outcomes based on sample data
β BigQuery
β Interactive analysis of very large data sets
β Simple SQL query language access
48. Further info available at:
β Google App Engine
β http://code.google.com/apis/storage
β Google Storage for Developers
β http://code.google.com/apis/storage
β Prediction API
β http://code.google.com/apis/predict
β BigQuery
β http://code.google.com/apis/bigquery