These slides are made for the 2013 DevFest talks. It covers the main blocks of Google cloud platform: App engine, Compute Engine, storage options and more.
Google Cloud - Scale With A Smile (Dec 2014)Ido Green
"Google's ability to build, organize, and operate a huge network of servers and fiber-optic cables with an efficiency and speed that rocks physics on its heels. This is what makes Google Google: its physical network, its thousands of fiber miles, and those many thousands of servers that, in aggregate, add up to the mother of all clouds.” - Wired
---
Well, Wired hit the nail on the head with this quote about our platform. In this presentation we cover most of the new interesting features that will give you the ability to scale with (a big) smile!
Introduction to Google's Cloud TechnologiesChris Schalk
An overview of the different Cloud technologies available from Google including App Engine, Google Storage, Google Prediction API, and BigQuery.
This presentation was given to the San Diego GTUG on Aug 26th, 2011.
Google Cloud Platform is a cloud computing platform by Google that offers hosting on the same supporting infrastructure that Google uses internally for end-user products like Google Search and YouTube. Cloud Platform provides developer products to build a range of programs from simple websites to complex applications.
Google Cloud Platform is a part of a suite of enterprise solutions from Google for Work and provides a set of modular cloud-based services with a host of development tools. For example, hosting and computing, cloud storage, data storage, translations APIs and prediction APIs.
Topic Covered
Why Google Cloud Platform ?
Google Cloud Platform Services: First Insight !!!
Building Enterprise Applications on Google Cloud Platform Cloud Computing Exp...Chris Schalk
This is a presentation given by Google Developer Advocate Chris Schalk at Cloud Expo in NYC on June 8th 2011 on building enterprise applications with Google's Cloud Platform.
These slides are made for the 2013 DevFest talks. It covers the main blocks of Google cloud platform: App engine, Compute Engine, storage options and more.
Google Cloud - Scale With A Smile (Dec 2014)Ido Green
"Google's ability to build, organize, and operate a huge network of servers and fiber-optic cables with an efficiency and speed that rocks physics on its heels. This is what makes Google Google: its physical network, its thousands of fiber miles, and those many thousands of servers that, in aggregate, add up to the mother of all clouds.” - Wired
---
Well, Wired hit the nail on the head with this quote about our platform. In this presentation we cover most of the new interesting features that will give you the ability to scale with (a big) smile!
Introduction to Google's Cloud TechnologiesChris Schalk
An overview of the different Cloud technologies available from Google including App Engine, Google Storage, Google Prediction API, and BigQuery.
This presentation was given to the San Diego GTUG on Aug 26th, 2011.
Google Cloud Platform is a cloud computing platform by Google that offers hosting on the same supporting infrastructure that Google uses internally for end-user products like Google Search and YouTube. Cloud Platform provides developer products to build a range of programs from simple websites to complex applications.
Google Cloud Platform is a part of a suite of enterprise solutions from Google for Work and provides a set of modular cloud-based services with a host of development tools. For example, hosting and computing, cloud storage, data storage, translations APIs and prediction APIs.
Topic Covered
Why Google Cloud Platform ?
Google Cloud Platform Services: First Insight !!!
Building Enterprise Applications on Google Cloud Platform Cloud Computing Exp...Chris Schalk
This is a presentation given by Google Developer Advocate Chris Schalk at Cloud Expo in NYC on June 8th 2011 on building enterprise applications with Google's Cloud Platform.
This is a 1-hr tech talk designed for developers to give a comprehensive, vendor-agnostic overview of cloud computing, primarily targeting educators in the higher education market but is open to any developer. This is followed by an introduction to products in Google Cloud, focusing on the serverless products. The talk ends with several inspirational examples of what can be built with Google Cloud
Introduction to Google Cloud Services / PlatformsNilanchal
The presentation provides a brief Introduction to Google Cloud Services and Platforms. In the course of this slide, we will introduce you the different Google cloud computing options, Compute Engine, App Engine, Cloud function, Databases, file storage and security features of Google cloud platform.
Overview of Google Cloud products for Developers, to build, sell and monetize web apps: Google Apps Marketplace, App Engine, App Engine for Business, Google Storage, Prediction and BigQuery APIs.
Scale with a smile with Google Cloud Platform At DevConTLV (June 2014)Ido Green
What is new and hot on Google Cloud?
How can you work like a pro with some (or all) the new APIs and services... Here are some good starting points to follow.
Getting Started on Google Cloud PlatformAaron Taylor
This slide deck accompanied a talk I gave at Boston's Google Cloud Meetup group in June of 2016. It chronicles our story of building out the Meta Search product using Google Cloud Platform, particularly App Engine, and finishes with a short walkthrough of a demo application.
Google Cloud Connect @ Korea
- Google Cloud Vision
- G Suite Product Roadmap
- Google Cloud Security
- Google Cloud Machine Learning
- G suite Customer Stories
Google Cloud Platform itself has been on a very rapid rise over the past few years. It has a lot of advantages over AWS or Microsoft Azure. In this slideshow, you can learn more about these top advantages. For more details, you can also read this post https://kinsta.com/blog/google-cloud-hosting/
This is a 1-hr tech talk designed for developers to give a comprehensive, vendor-agnostic overview of cloud computing, primarily targeting educators in the higher education market but is open to any developer. This is followed by an introduction to products in Google Cloud, focusing on the serverless products. The talk ends with several inspirational examples of what can be built with Google Cloud
Introduction to Google Cloud Services / PlatformsNilanchal
The presentation provides a brief Introduction to Google Cloud Services and Platforms. In the course of this slide, we will introduce you the different Google cloud computing options, Compute Engine, App Engine, Cloud function, Databases, file storage and security features of Google cloud platform.
Overview of Google Cloud products for Developers, to build, sell and monetize web apps: Google Apps Marketplace, App Engine, App Engine for Business, Google Storage, Prediction and BigQuery APIs.
Scale with a smile with Google Cloud Platform At DevConTLV (June 2014)Ido Green
What is new and hot on Google Cloud?
How can you work like a pro with some (or all) the new APIs and services... Here are some good starting points to follow.
Getting Started on Google Cloud PlatformAaron Taylor
This slide deck accompanied a talk I gave at Boston's Google Cloud Meetup group in June of 2016. It chronicles our story of building out the Meta Search product using Google Cloud Platform, particularly App Engine, and finishes with a short walkthrough of a demo application.
Google Cloud Connect @ Korea
- Google Cloud Vision
- G Suite Product Roadmap
- Google Cloud Security
- Google Cloud Machine Learning
- G suite Customer Stories
Google Cloud Platform itself has been on a very rapid rise over the past few years. It has a lot of advantages over AWS or Microsoft Azure. In this slideshow, you can learn more about these top advantages. For more details, you can also read this post https://kinsta.com/blog/google-cloud-hosting/
Google Cloud Platform: Prototype ->Production-> Planet scaleIdan Tohami
As one of Big Data’s Founding Fathers, Google explored the technological changes we faced over the past 10 years and present their solutions to the new data challenges within the Google Cloud ecosystem
Half-hour talk introducing Google APIs. Primarily covers the Google Cloud Platform, it's products & services, focused on Google App Engine, and to some extent, Google Compute Engine, and all Google services as a whole.
30-minute talk front-loading a hack session teaching people how to use Google APIs with Python. Similar to the "Exploring Google APIs with Python" talk, this one is much shorter because the code samples are only discussed during the coding session.
Stop Hackers with Integrated CASB & IDaaS SecurityCloudLock
Watch this on-demand webinar with CloudLock and OneLogin to: Identify the top five cyber threats to your cloud environment; Protect against cloud security risks using advanced user and entity behavior analysis; Streamline identity and access management; Easily automate your cloud access management process.
Be A Hero: Combat Cloud Security Threats with Google Apps Unlimited & CloudLockCloudLock
According to the latest IBM X-Force Research report, the average consolidated total cost of a single data breach is $3.8 million. And with data breaches up 22% so far in 2016, across every vertical imaginable, the threat must be addressed. Watch Google and CloudLock's discussion in this hands-on exploration of how your organization can combat these ever changing security threats.
Talk about Andromeda at Botconf 2015. Abstract:
Andromeda, also known as Gamarue by some Antivirus vendors, is a popular and modular bot active since 2011. It is normally used to spread additional malware, but sometimes, depending on the criminals, the main objective could be just stealing user credentials. After almost five years of life its development has not stopped. The people behind it keep maintaining it and adding functionalities, like new anti-analysis routines, changes in the communication encryption, new request formats, etc.
This talk will not give just details about the latest changes in the Andromeda binary and control panel, but it will also respond some interesting questions about this botnet. Which are the most popular versions used nowadays? Are most of the botnets spreading malware or just using its plugins? What are the most popular plugins? How and where is Andromeda sold? Who is selling it? What criminal groups are using Andromeda? It is not just a talk about malware reversing but about the whole Andromeda ecosystem.
Modern Machine Learning Infrastructure and PracticesWill Gardella
Slides from Curtis Huang's talk at the Couchbase Meetup in Mountain View on August 18th. Curtis is a Senior Software Engineer at Facebook working on Machine Learning, with experience in both ad tech and search.
"AI and machine learning have transformed the technology industry for the last decade, creating a foundation for web search, ranking/recommendation, and object/speech recognition. In this talk, I will discuss a collection of machine learning approaches to effectively analyzing and modeling large-scale data. From a hands-on practitioner's perspective, I will talk about the process of building a ML pipeline from idea to production, the challenges, and lessons learned. As an example, I will describe the infrastructure and components of a modern ML ranking system."
Power Comparison Power Comparison of Cloud Data of Cloud Data Center Architec...Paolo Giaccone
Power consumption is a primary concern for cloud computing data centers. Being the network one of the non- negligible contributors to energy consumption in data centers, several architectures have been designed with the goal of im- proving network performance and being energy-efficient. In this paper we provide a comparison study of data center architectures, covering both classical two- and three-tier design and state-of- art ones as Jupiter, recently disclosed by Google. Specifically, we analyze the combined effect on the overall system performance of different power consumption profiles for the IT equipment and of different resource allocation policies. Our experiments, performed in small and large scale scenarios, unveil the ability of network-aware allocation policies in loading the the data center in a energy-proportional manner and the robustness of classical two- and three-tier design under network-oblivious allocation strategies.
What's new in App Engine and intro to App Engine for BusinessChris Schalk
This is a presentation given by Devfest Madrid 2010 by Google Developer Advocate Chris Schalk on "What's new in Google App Engine and Intro to App Engine for Business"
Google Cloud for Data Crunchers - Strata Conf 2011Patrick Chanezon
http://strataconf.com/strata2011/public/schedule/detail/16242
Talk at Strata 2011 with Ryan Boyd and Kirrily Roberts
Google is a Data business: over the past few years, many of the tools Google created to store, query, analyze, visualize its data, have been exposed to developers as services.
This talk will give you an overview of Google services for Data Crunchers:
Google Storage for developers
BigQuery, fast interactive queries on Terabytes of data
Machine Learning API: Machine Learning made easy
Google App Engine, exposing Data APIs is a very common use case for App Engine
Visualization API: many cool visualization components
App Engine Overview @ Google Hackathon SXSW 2010Chris Schalk
This is an overview presentation on Google App Engine. This was given at the Google hackathon @ SXSW Interactive, 2010.
bit.ly/googlehackathonsxsw
bit.ly/gcodelabs
Entrepreneurship Tips With HTML5 & App Engine Startup Weekend (June 2012)Ido Green
My talk in Startup Weekend 2012 during Google I/O. It cover, startup life tips, modern web apps and how to leverage Google cloud (specific App Engine).
How Google Cloud Platform can help in the classroom/labwesley chun
This is a 90-min tech talk along with hands-on exercises gives a comprehensive, vendor-agnostic overview of cloud computing, primarily targeting educators in the higher education market but is open to any developer. This is followed by an introduction to products in Google Cloud Platform, focusing on its serverless and machine learning products. .
Half-hour tech talk given at user groups or technical conferences to introducing developers to integrating with Google (Cloud) APIs from Python .
ABSTRACT
Want to integrate Google technologies into the web+mobile apps that you build? Google has various open source libraries & developer tools that help you do exactly that. Users who have run into roadblocks like authentication or found our APIs confusing/challenging, are welcome to come and make these non-issues moving forward. Learn how to leverage the power of Google technologies in the next apps you build!!
This is an introduction presentation on App Engine for Business given by Chris Schalk, Google Developer Advocate on Oct 26, 2010 at the PayPal Innovate conference.
Powerful Google developer tools for immediate impact! (2023-24 A)wesley chun
This is one of two 45-60-min presentations to students or working professionals. You may know Google for search, YouTube, Android, Chrome, and Gmail, but did you know Google has many other cloud services? In this comprehensive yet still high-level overview of Google Cloud tools & APIs with the purpose of inspiring you as to what's possible. The session introduces Google's machine learning & other APIs, tools that have an immediate impact on projects, alleviating the need to think about computing infrastructure as well as dispensing with the need to have machine learning expertise. We'll wrap up w/online resources like videos & hands-on tutorials to get you started! The main takeaways are where to run your code, store your data, and analyze your data, all in the cloud!
The other version of this talk ("B") focuses more on serverless platforms.
Introduction to Google App Engine talk delivered 2010 Jul 16 at EuroPython in Birmingham, UK and 2010 Jul 22 at the GTUG in London by Wesley Chun, Developer Advocate for Google.
This is a presentation on Google App Engine for Java given at Devfest 2009 in Buenos Aires Argentina on Nov 17, 2009 by Google Developer Advocate, Chris Schalk and Google Software Engineer, Ignacio Blanco.
Similar to Introduction to Google Cloud Platform Technologies (20)
An overview and update presentation on Google App Engine given by Google Developer Advocate Christian Schalk at the 2011 DevFest Singapore and Jakarta events. Developer Advocate Wesley Chun also participated in the Q&A.
How to build Kick Ass Games in the CloudChris Schalk
This is a presentation given by Googlers Chris Schalk and Johan Euphrosine (Proppy) at GDD Sydney 2011 on how to build multi-platform video games using PlayN.
Building Kick Ass Video Games for the CloudChris Schalk
This is a presentation that covers how to use PlayN to build kick ass games for the cloud. It was delivered at GDC Online 2011, by Google Developer Advocate, Chris Schalk
Building Integrated Applications on Google's Cloud TechnologiesChris Schalk
This is the presentation "Building Integrated Applications on Google's Cloud Technologies" that was given at GDD 2011 #gdd11 in Sao Paulo and Buenos Aires by Google Developer Advocate Chris Schalk @cschalk.
GDD 2011 - How to build kick ass video games for the cloudChris Schalk
This is the Google Developer Day 2011 "How to build kick ass games in the cloud" presentation that was given in Sao Paulo and Buenos Aires. (The title is in Spanish since it was last given in Argentina - the content is the same as Sao Paulo though)
It was given by Google Developer Advocate, Chris Schalk in Sept 2011. @cschalk
Quick Intro to Google Cloud TechnologiesChris Schalk
This is the "Lightning Presentation" given at DreamForce 2011 on Google's Cloud Technologies. It covers, App Engine, Google Storage and BigQuery. #df11
An overview of the different Google Cloud Technologies. Includes coverage of Google App Engine, Google Storage, Google Prediction Api, and BigQuery.
This presentation was given to the San Diego GTUG on Aug 26th, 2011.
A review and update presentation on Google App Engine's latest features up through version 1.5.3 and including new experimental features. This presentation was given to the San Diego GTUG on Aug 26, 2011.
Building Apps on Google Cloud TechnologiesChris Schalk
This is a presentation on how to use the different Google Cloud technologies to build applications.
It was delivered in Mexico City at the "EstoEsGoogle" aka Devfest Mexico event on Aug 9th, 2011 in Mexico City by Google Developer Advocate Chris Schalk.
This is a presentation on Google App Engine's Latest Features.
It was delivered in Mexico City at the "EstoEsGoogle" aka Devfest Mexico event on Aug 9th, 2011 in Mexico City by Google Developer Advocate Chris Schalk.
Building Multi-platform Video Games for the CloudChris Schalk
This is a presentation on how to build multi-platform (HTML5, Flash, Java/Android) video games using an open source technology known as Forplay (PlayN).
This presentation was delivered in Mexico City on Aug 9th, 2011 at the "EstoEsGoogle" aka Devfest Mexico event on Aug 9th in Mexico City by Google Developer Advocate Chris Schalk
Introduction to Google Cloud platform technologiesChris Schalk
This is a presentation given by Google Developer Advocate Chris Schalk at Spring One 2GX on Oct 21st, 2010. It introduces Google Storage for Developers, Prediction API, and BigQuery.
Intro to new Google cloud technologies: Google Storage, Prediction API, BigQueryChris Schalk
This is an introductory presentation given at DevFest Madrid 2010 by Google Developer Advocate Chris Schalk. It introduces new Google cloud technologies: Google Storage, Google Prediction API and BigQuery.
This is a presentation on OpenSocial in the Enterprise given at Devfest 2009 in Buenos Aires Argentina on Nov 17, 2009 by Google Developer Advocate, Chris Schalk, eXo Platform CEO Benjamin Mestrallet, and Globant's Bruno Rovagnati
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
"Impact of front-end architecture on development cost", Viktor TurskyiFwdays
I have heard many times that architecture is not important for the front-end. Also, many times I have seen how developers implement features on the front-end just following the standard rules for a framework and think that this is enough to successfully launch the project, and then the project fails. How to prevent this and what approach to choose? I have launched dozens of complex projects and during the talk we will analyze which approaches have worked for me and which have not.
Let's dive deeper into the world of ODC! Ricardo Alves (OutSystems) will join us to tell all about the new Data Fabric. After that, Sezen de Bruijn (OutSystems) will get into the details on how to best design a sturdy architecture within ODC.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
4. Google Cloud Platform Technologies at Glance
ExisFng Google App Engine
Google App Engine for Business (new)
New! Google
Google BigQuery
Predic/on API
Google Storage
5. Agenda
• Part I - Intro to App Engine
• App Engine Details
• Development Tools
• App Engine for Business
• Part II – Google’s new cloud technologies
• Google Storage
• Prediction API
• BigQuery
6. Part I – Intro to App Engine
Topics covered
• App Engine a PaaS
• App Engine usage/customers
• App Engine Technical Details
13. Cloud Development in a Box
• Downloadable SDK
• Application runtimes
• Java, Python
• Local development tools
• Eclipse plugin, AppEngine Launcher
• Specialized application services
• Cloud based dashboard
• Ready to scale
• Built in fault tolerance, load balancing
13
14. Specialized Services
Memcache Datastore URL Fetch
Mail XMPP Task Queue
Images Blobstore User Service
14
26. Two+ years in review
Apr 2008
Python launch
May 2008
Memcache, Images API
Jul 2008
Logs export
Aug 2008
Batch write/delete
Oct 2008
HTTPS support
Dec 2008
Status dashboard, quota details
Feb 2009
Billing, larger files
Apr 2009
Java launch, DB import, cron support, SDC
May 2009
Key-only queries
Jun 2009
Task queues
Aug 2009
Kindless queries
Sep 2009
XMPP
Oct 2009
Incoming email
Dec 2009
Blobstore
Feb 2010
Datastore cursors, Appstats
Mar 2010
Read policies, IPv6
May 2010
App Engine for Business
Jun 2010
Task queue increases, Python pre-compilation…
Jul 2010
Mapper API
Aug 2010
Multi-tenancy, hi perf img serving, custom err pages
Oct 2010
Instances Console, Delete Kind/App Data
26
27. Introducing App Engine for Business
App Engine for Business
Same scalable cloud platform, but designed for the Enterprise
27
28. Google App Engine for Business Details
• Enterprise application management
– Centralized domain console (preview available)
• Enterprise reliability and support Google App Engine
– 99.9% Service Level Agreement for Business
– Direct support
• Hosted SQL
– Relational SQL database in the cloud (preview available)
• SSL on your domain
• Extremely Secure by default
– Integrated Single Sign On (SSO)
• Pricing that makes sense
– Apps cost $8 per user, up to $1000 max per month
28
29. Enterprise App Development with Google
Buy from others Buy from Google Build your own
Google Apps Google Apps Google App Engine
Marketplace for Business for Business
Enterprise Application Platform
Enterprise Firewall
Enterprise Data AuthenFcaFon Enterprise Services User Management
29
30. App Engine for Business
Roadmap
Enterprise Administration
Preview (signups available)
Console
Direct Support Preview (signups available)
Hosted SQL Preview (signups available)
Service Level Agreement Available Q4 2010 (Draft published)
Enterprise billing Available Q4 2010
Custom Domain SSL Limited Release EOY 2010
30
31. App Engine Resources
Get started with App Engine
• http://code.google.com/appengine
Read up on App Engine for Business and become a trusted tester
• http://code.google.com/appengine/business
• bit.ly/gae4btt <- sign up!
32. Part II - Google’s new Cloud Technologies
Topics covered
• Google Storage for Developers
• Prediction API (machine learning)
• BigQuery
34. What Is Google Storage?
• Store your data in Google's cloud
o any format, any amount, any Fme
• You control access to your data
o private, shared, or public
• Access via Google APIs or 3rd party tools/libraries
35. Sample Use Cases
Static content hosting
e.g. static html, images, music, video
Backup and recovery
e.g. personal data, business records
Sharing
e.g. share data with your customers
Data storage for applications
e.g. used as storage backend for Android, AppEngine, Cloud based apps
Storage for Computation
e.g. BigQuery, Prediction API
36. Google Storage Benefits
High Performance and Scalability
Backed by Google infrastructure
Strong Security and Privacy
Control access to your data
Easy to Use
Get started fast with Google & 3rd party tools
37. Google Storage Technical Details
• RESTful API
o Verbs: GET, PUT, POST, HEAD, DELETE
o Resources: identified by URI
o Compatible with S3
• Buckets
o Flat containers
• Objects
o Any type
o Size: 100 GB / object
• Access Control for Google Accounts
o For individuals and groups
• Two Ways to Authenticate Requests
o Sign request using access keys
o Web browser login
38. Performance and Scalability
• Objects of any type and 100 GB / Object
• Unlimited numbers of objects, 1000s of buckets
• All data replicated to multiple US data centers
• Utilizes Google's worldwide network for data delivery
• Only you can use bucket names with your domain names
• Read-your-writes data consistency
• Range Get
39. Demo
• Tools:
o GS Manager
o GSUtil
• Upload / Download
40. Google Storage usage within Google
Google BigQuery Google
Predic/on API
HaiF Relief Imagery USPTO data
Partner ReporFng Partner ReporFng
42. Google Storage - Pricing
o Storage
$0.17/GB/Month
o Network
Upload - $0.10/GB
Download
$0.15/GB Americas / EMEA
$0.30/GB APAC
o Requests
PUT, POST, LIST - $0.01 / 1000 Requests
GET, HEAD - $0.01 / 10000 Requests
43. Google Storage - Availability
• Limited preview in US currently
o 100GB free storage and network from Google per
account
o Sign up for waitlist at http://code.google.com/apis/
storage/
• Note: Non US preview available on case-by-case basis
45. Introducing the Google Prediction API
• Google's sophisticated machine learning technology
• Available as an on-demand RESTful HTTP web service
46. How does it work?
"english" The quick brown fox jumped over the lazy
The Prediction API dog.
finds relevant
features in the "english" To err is human, but to really foul things up
sample data during you need a computer.
training. "spanish" No hay mal que por bien no venga.
"spanish" La tercera es la vencida.
The PredicFon API
? To be or not to be, that is the quesFon.
later searches for
those features ? La fe mueve montañas.
during predicFon.
47. A virtually endless number of applicaFons...
Customer TransacFon Species Message DiagnosFcs
Sentiment Risk IdenFficaFon RouFng
Churn Legal Docket Suspicious Work Roster Inappropriate
PredicFon ClassificaFon AcFvity Assignment Content
Recommend PoliFcal Uplij Email Career
Products Bias MarkeFng Filtering Counselling
... and many more ...
49. Using the Prediction API
A simple three step process...
Upload your training data to
1. Upload Google Storage
Build a model from your data
2. Train
3. Predict Make new predicFons
50. Step 1: Upload
Upload your training data to Google Storage
• Training data: outputs and input features
• Data format: comma separated value format
(CSV)
"english","To err is human, but to really ..."
"spanish","No hay mal que por bien no venga."
...
Upload to Google Storage
gsutil cp ${data} gs://yourbucket/${data}
51. Step 2: Train
Create a new model by training on data
To train a model:
POST prediction/v1.1/training?data=mybucket%2Fmydata
Training runs asynchronously. To see if it has finished:
GET prediction/v1.1/training/mybucket%2Fmydata
{"data":{
"data":"mybucket/mydata",
"modelinfo":"estimated accuracy: 0.xx"}}}
55. Prediction API Capabilities
Data
• Input Features: numeric or unstructured text
• Output: up to hundreds of discrete categories
Training
• Many machine learning techniques
• Automatically selected
• Performed asynchronously
Access from many platforms:
• Web app from Google App Engine
• Apps Script (e.g. from Google Spreadsheet)
• Desktop app
56. Prediction API v1.1 - new features
• Updated Syntax
• Multi-category prediction
o Tag entry with multiple labels
• Continuous Output
o Finer grained prediction rankings based on multiple labels
• Mixed Inputs
o Both numeric and text inputs are now supported
Can combine continuous output with mixed inputs
58. Introducing Google BigQuery
• Google's large data adhoc analysis technology
o Analyze massive amounts of data in seconds
• Simple SQL-like query language
• Flexible access
o REST APIs, JSON-RPC, Google Apps Script
60. Many Use Cases ...
InteracFve Tools Trends
Spam DetecFon
Web Dashboards Network
OpFmizaFon
61. Key CapabiliFes of BigQuery
• Scalable: Billions of rows
• Fast: Response in seconds
• Simple: Queries in SQL
• Web Service
o REST
o JSON-RPC
o Google App Scripts
63. Writing Queries
Compact subset of SQL
o SELECT ... FROM ...
WHERE ...
GROUP BY ... ORDER BY ...
LIMIT ...;
Common functions
o Math, String, Time, ...
Statistical approximations
o TOP
o COUNT DISTINCT
64. BigQuery via REST
GET /bigquery/v1/tables/{table name}
GET /bigquery/v1/query?q={query}
Sample JSON Reply:
{
"results": {
"fields": { [
{"id":"COUNT(*)","type":"uint64"}, ... ]
},
"rows": [
{"f":[{"v":"2949"}, ...]},
{"f":[{"v":"5387"}, ...]}, ... ]
}
}
Also supports JSON-RPC
65. Security and Privacy
Standard Google Authentication
• Client Login
• OAuth
• AuthSub
HTTPS support
• protects your credentials
• protects your data
Relies on Google Storage to manage access
66. Large Data Analysis Example
Wikimedia Revision History
Wikimedia Revision history data from: hmp://download.wikimedia.org/enwiki/latest/enwiki‐
latest‐pages‐meta‐history.xml.7z
70. Further info available at:
• Google Storage for Developers
o http://code.google.com/apis/storage
• Prediction API
o http://code.google.com/apis/predict
• BigQuery
o http://code.google.com/apis/bigquery
71. Recap
• Google App Engine
o Google’s PaaS cloud development platform
• Google App Engine for Business
o New enterprise version of App Engine
• Google Storage
o New high speed data storage on Google Cloud
• Prediction API
o New machine learning technology able to predict
outcomes based on sample data
• BigQuery
o New service for Interactive analysis of very large data
sets using SQL