Building Integrated Applications on Google's Cloud Technologies
Upcoming SlideShare
Loading in...5
×
 

Building Integrated Applications on Google's Cloud Technologies

on

  • 2,328 views

Presentation given by Google Developer Advocate Chris Schalk on building integrated applications with Google's Cloud Technologies.

Presentation given by Google Developer Advocate Chris Schalk on building integrated applications with Google's Cloud Technologies.

Statistics

Views

Total Views
2,328
Views on SlideShare
2,326
Embed Views
2

Actions

Likes
3
Downloads
61
Comments
0

1 Embed 2

http://a0.twimg.com 2

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Building Integrated Applications on Google's Cloud Technologies Building Integrated Applications on Google's Cloud Technologies Presentation Transcript

    • Christian SchalkGoogle Developer Advocateprofiles.google.com/cschalk@cschalkBuilding Integrated Applications onGoogles Cloud TechnologiesDevFest 2011Jakarta
    • Agenda● Introduction● App Engine Recap● Googles new Cloud Technologies ○ Google Cloud Storage ○ Prediction API ○ BigQuery ○ Google Cloud SQL● Summary Q&A
    • Introduction Google App Engine
    • Introduction Google App Engine Google BigQuery Google Google Cloud SQL Prediction API Google Cloud Storage
    • New Google Cloud Technologies ● Google Cloud Storage ○ Store your data in Googles cloud ● Prediction API ○ Googles machine learning tech in an API ● BigQuery ○ Hi-speed data analysis on a massive scale ● Cloud SQL ○ A relational database in the cloud
    • Google Cloud StorageStore your data in Googles cloud
    • What Is Google Cloud Storage? ● Store your data in Googles cloud ○ any format, any amount, any time ● You control access to your data ○ private, shared, or public ● Access via Google APIs or 3rd party tools/libraries
    • Sample Use Cases Static content hosting e.g. static html, images, music, video Backup and recovery e.g. personal data, business records Sharing e.g. share data with your customers Data storage for applications e.g. used as storage backend for Android, AppEngine, Cloud based apps Storage for Computation e.g. BigQuery, Prediction API
    • Google Cloud Storage Benefits High Performance and Scalability Backed by Google infrastructure Strong Security and Privacy Control access to your data Easy to Use Get started fast with Google & 3rd party tools
    • Google Cloud Storage Technical Details ● RESTful API ○ Verbs: GET, PUT, POST, HEAD, DELETE ○ Resources: identified by URI ○ Compatible with S3 ● Buckets ○ Flat containers ● Objects ○ Any type ○ Size: 100 GB / object ● Access Control for Google Accounts ○ For individuals and groups ● Two Ways to Authenticate Requests ○ Sign request using access keys ○ Web browser login
    • Early Google Cloud Storage Adopters and more...
    • Simple Google Cloud Storage Demos GS (Web) Manager GSutil
    • Google Prediction APIGoogles prediction engine in the cloud
    • Google Prediction API as a simple example Predicts outcomes based on learned patterns
    • Potentially endless number of applications... Customer Transaction Species Message Diagnostics Sentiment Risk Identification Routing Churn Legal Docket Suspicious Work Roster InappropriatePrediction Classification Activity Assignment ContentRecommend Political Uplift Email Career Products Bias Marketing Filtering Counselling ... and more ...
    • Prediction API CapabilitiesData ● Input Features: numeric or unstructured text ● Output: up to hundreds of discrete categoriesTraining ● Many machine learning techniques ● Automatically selected ● Performed asynchronouslyAccess from many platforms: ● Web app from Google App Engine ● Apps Script (e.g. from Google Spreadsheet) ● Desktop app
    • How does it work? "english" The quick brown fox jumped over theThe Prediction API lazy dog.finds relevant "english" To err is human, but to really foul thingsfeatures in the up you need a computer.sample data during "spanish" No hay mal que por bien no venga.training. "spanish" La tercera es la vencida.The Prediction APIlater searches for ? To be or not to be, that is the question.those features ? La fe mueve montañas.during prediction.
    • Using the Prediction APIA simple three step process... (REST Calls) Upload your training data to 1. Upload Google Storage Build a model from your data 2. Train 3. Predict Make new predictions
    • Prediction API - key features ● Multi-category prediction ○ Tag entry with multiple labels ● Multiple Prediction Output ○ Finer grained prediction rankings based on multiple labels ● Mixed Inputs ○ Both numeric and text inputs are now supportedCan combine continuous output with mixed inputs
    • Prediction Demos ● Command line Demos ○ Training a model ○ Checking training status ○ Making predictions ● A complete Web application using the JavaScript API for Prediction
    • Google BigQueryInteractive analysis of large datasets in Googles cloud
    • Introducing Google BigQuery ● Googles large data adhoc analysis technology ○ Analyze massive amounts of data in seconds ● Simple SQL-like query language ● Flexible access ○ REST APIs, JSON-RPC, Google Apps Script
    • Many Use Cases ... Interactive Trends Spam Tools Detection Web Network Dashboards Optimization
    • Key Capabilities of BigQuery ● Scalable: Billions of rows ● Fast: Response in seconds ● Simple: Queries in SQL ● Web Service ○ REST ○ JSON-RPC ○ Google App Scripts
    • Using BigQueryAnother simple three step process... (REST Calls) Upload your raw data to 1. Upload Google Storage Import raw data into 2. Import BigQuery table 3. Query Perform SQL queries on table
    • Writing QueriesCompact subset of SQL ○ SELECT ... FROM ... WHERE ... GROUP BY ... ORDER BY ... LIMIT ...;Common functions ○ Math, String, Time, ...Statistical approximations ○ TOP ○ COUNT DISTINCT
    • BigQuery via RESTGET /bigquery/v1/tables/{table name}GET /bigquery/v1/query?q={query}Sample JSON Reply:{ "results": { "fields": { [ {"id":"COUNT(*)","type":"uint64"}, ... ] }, "rows": [ {"f":[{"v":"2949"}, ...]}, {"f":[{"v":"5387"}, ...]}, ... ] }}Also supports JSON-RPC
    • BigQuery Security and PrivacyStandard Google Authentication ● Client Login ● AuthSub ● OAuthHTTPS support ● protects your credentials ● protects your dataRelies on Google Storage to manage access
    • New!Whats New in BigQuery V2? ● A new REST API ● A new web user interface ● Support for JOIN statements ● Export table or query result to a CSV file in Google Cloud Storage ● Support for ACLs on collections of tables ● A new object architecture describing tables, groups of tables, and queries. This new architecture is described under Main Concepts below.
    • BigQuery Demo BigQuery Web Browser
    • Google Cloud SQLA relational database in the cloud
    • Google Cloud SQL ● Developer console ○ Easy to use ● Fully managed ● High availability ○ Synchronous replication to multiple data centers ● Integrated with Google App Engine ○ Java: JDBC, Python: DB-API ○ Use with High Replication Datastore ● MySQL Compatible ○ Import / export
    • Cloud SQL Demos! ● Cloud SQL Console ● SQL via JDBC Access ● SQL from PHP!
    • Recap ● Google App Engine ○ General purpose application development platform for the cloud ● Google Cloud Storage ○ High speed cloud data storage on Googles infrastructure ● Prediction API ○ Googles machine learning technology ● BigQuery ○ Interactive analysis of very large data sets ● Google SQL ○ A relational SQL database in the cloud
    • Further info available at: ● Google App Engine ○ http://code.google.com/appengine ● Google Cloud Storage ○ http://code.google.com/apis/storage ● Prediction API ○ http://code.google.com/apis/predict ● BigQuery ○ http://code.google.com/apis/bigquery ● Cloud SQL ○ http://code.google.com/apis/sql
    • Thank You! Christian Schalk Google Developer Advocate profiles.google.com/cschalk @cschalk (Follow me on G+ to get the slides!)