This document summarizes the life of a request on Google App Engine. It describes how requests for static content are routed to specialized static content servers. Requests for dynamic content are routed to App Servers where the code runs. App Servers can also make API requests to services like Memcache and the Datastore. The document then recaps the design motivations behind App Engine like building on Google infrastructure, encouraging fast requests and statelessness, and requiring a partitioned data model.
Consuming External Content and Enriching Content with Apache Cameltherealgaston
While AEM Solr Search provides a framework for indexing and searching content within AEM, it does not address other real-world use cases such as indexing and searching content external to AEM (i.e. products). Secondly, it assumes that the final indexable AEM document will be produced entirely by AEM. This is often not the case, as advanced search applications typically need to enrich the document prior to indexing using external data sources.
In this talk we will extend the AEM Solr Search reference architecture to include document processing capabilities using Apache Camel. As an example, two real-world use cases will be provided: 1) ingesting an external product data set via Apache Camel into a shared Solr instance and delivering the results via AEM, and 2) enriching AEM content with analytics and ratings data for the purpose of applying popularity boosting.
Implementing SharePoint on Azure, Lessons Learnt from a Real World ProjectK.Mohamed Faizal
Infrastructure as a Service (IaaS) and its features that can be leveraged for hosting a SharePoint 2013 farm. Learn how to setup, thinks to consider when you setup VPN, Storage, Cloud Services, setting up load balance endpoints. The speaker will share his real world experience and trips and tricks
There are many systems where Database plays central role for business operations. More often than not performance and maintainability of your “Main” database is key factor of success of your business. In order to deploy DevOps culture in your organization you need to Trust your developers and give them access to Production Database. Developers could find great insights in database metrics so you would have opportunity to improve both performance and maintainability dramatically for moderate costs.
I am going to talk about catching and solving problems in Production Databases – how to increase performance and decrease costs in long time perspective. The talk is based on experience we’ve received in Production.
adaptTo() 2014 - Integrating Open Source Search with CQ/AEMtherealgaston
A presentation by Gaston Gonzalez at adaptTo() 2014 describing several approaches for integrating Apache Solr with AEM. It starts with an introduction to various pull and push indexing strategies (e.g., Sling Eventing, content publishing and web crawling). The topic of content ingestion is followed by an approach for delivering rapid search front-end experiences using AEM Solr Search.
<p>You've built a great site and spent a countless hours creating compelling content, but important questions remain. Can your visitors quickly find what they need on your site? Is your current search strategy helping visitors find information, or is it slowing them down?</p>
<p>Join Robert Douglass, Senior Drupal Advisor at Acquia and maintainer of the Apache Solr Search integration module, and Bryan House, senior director of marketing, for a one-hour webinar presentation. Acquia Search is a cloud-based service within the Acquia Network that delivers powerful Apache Solr search capabilities to Drupal 6 websites as a plug-and-play option. Using Acquia Search, your visitors will find information faster and spend more time on your site, resulting in higher conversions on your site.</p>
<p>Key takeaways will include:</p>
<ul>
<li>Overview of the latest Acquia Search features - including multisite search, attachment search, and more</li>
<li>Learn how easy it is to deploy and configure Acquia Search on any Drupal 6 site</li>
<li>An introduction to the pricing options available for Acquia Search, starting at under $30 / month</li>
</ul>
Consuming External Content and Enriching Content with Apache Cameltherealgaston
While AEM Solr Search provides a framework for indexing and searching content within AEM, it does not address other real-world use cases such as indexing and searching content external to AEM (i.e. products). Secondly, it assumes that the final indexable AEM document will be produced entirely by AEM. This is often not the case, as advanced search applications typically need to enrich the document prior to indexing using external data sources.
In this talk we will extend the AEM Solr Search reference architecture to include document processing capabilities using Apache Camel. As an example, two real-world use cases will be provided: 1) ingesting an external product data set via Apache Camel into a shared Solr instance and delivering the results via AEM, and 2) enriching AEM content with analytics and ratings data for the purpose of applying popularity boosting.
Implementing SharePoint on Azure, Lessons Learnt from a Real World ProjectK.Mohamed Faizal
Infrastructure as a Service (IaaS) and its features that can be leveraged for hosting a SharePoint 2013 farm. Learn how to setup, thinks to consider when you setup VPN, Storage, Cloud Services, setting up load balance endpoints. The speaker will share his real world experience and trips and tricks
There are many systems where Database plays central role for business operations. More often than not performance and maintainability of your “Main” database is key factor of success of your business. In order to deploy DevOps culture in your organization you need to Trust your developers and give them access to Production Database. Developers could find great insights in database metrics so you would have opportunity to improve both performance and maintainability dramatically for moderate costs.
I am going to talk about catching and solving problems in Production Databases – how to increase performance and decrease costs in long time perspective. The talk is based on experience we’ve received in Production.
adaptTo() 2014 - Integrating Open Source Search with CQ/AEMtherealgaston
A presentation by Gaston Gonzalez at adaptTo() 2014 describing several approaches for integrating Apache Solr with AEM. It starts with an introduction to various pull and push indexing strategies (e.g., Sling Eventing, content publishing and web crawling). The topic of content ingestion is followed by an approach for delivering rapid search front-end experiences using AEM Solr Search.
<p>You've built a great site and spent a countless hours creating compelling content, but important questions remain. Can your visitors quickly find what they need on your site? Is your current search strategy helping visitors find information, or is it slowing them down?</p>
<p>Join Robert Douglass, Senior Drupal Advisor at Acquia and maintainer of the Apache Solr Search integration module, and Bryan House, senior director of marketing, for a one-hour webinar presentation. Acquia Search is a cloud-based service within the Acquia Network that delivers powerful Apache Solr search capabilities to Drupal 6 websites as a plug-and-play option. Using Acquia Search, your visitors will find information faster and spend more time on your site, resulting in higher conversions on your site.</p>
<p>Key takeaways will include:</p>
<ul>
<li>Overview of the latest Acquia Search features - including multisite search, attachment search, and more</li>
<li>Learn how easy it is to deploy and configure Acquia Search on any Drupal 6 site</li>
<li>An introduction to the pricing options available for Acquia Search, starting at under $30 / month</li>
</ul>
Do you need an external search platform for Adobe Experience Manager?therealgaston
Experience Manager provides some basic search capabilities out of the box. In this talk, we'll explore an external search platform for implementing an Experience Manager powered, search-driven site. As an example, we will use Apache Solr as a reference implementation and describe best practices for indexing content, exposing non-Experience Manager content via search, delivering search-driven experiences, and deploying the solution in a production setting.
Data Replication Options in AWS (ARC302) | AWS re:Invent 2013Amazon Web Services
One of the most critical roles of an IT department is to protect and serve its corporate data. As a result, IT departments spend tremendous amounts of resources developing, designing, testing, and optimizing data recovery and replication options in order to improve data availability and service response time. This session outlines replication challenges, key design patterns, and methods commonly used in today’s IT environment. Furthermore, the session provides different data replication solutions available in the AWS cloud. Finally, the session outlines several key factors to be considered when implementing data replication architectures in the AWS cloud.
The Hop project entered Apache Software Foundation as an Incubator project in 2020, and Julian Hyde, one of their mentors, gave this presentation to educate the initial committers on the Apache Way and what to expect during the Incubation process.
The talk was given by Julian Hyde on October 1st, 2020, with the original title "Apache Incubation - What's it all about?"
AWS Webcast - Optimize your database for the cloud with DynamoDB – A Deep Div...Amazon Web Services
Amazon DynamoDB is a fully managed, highly scalable distributed database service. Global Secondary Indexes (GSI) give you the flexibility to query your DynamoDB tables in new and powerful ways.
In this session, we will:
• Describe how GSI's work under the covers to ensure consistent low latency at any scale.
• Walk through various access patterns so that you will learn how to take full advantage of GSI's and implement best practice designs that will scale efficiently and cost-effectively.
This session is designed for developers and architects seeking to build rich applications that require performance and availability with absolute data durability.
Faceted search is a powerful technique to let users easily navigate the search results. It can also be used to develop rich user interfaces, which give an analyst quick insights about the documents space. In this session I will introduce the Facets module, how to use it, under-the-hood details as well as optimizations and best practices. I will also describe advanced faceted search capabilities with Lucene Facets.
An overview of ORDS for building RESTful Web Services and your Oracle Database with BEER examples!
Thanks and credit to the POUG organization for making this possible.
Solr Recipes provides quick and easy steps for common use cases with Apache Solr. Bite-sized recipes will be presented for data ingestion, textual analysis, client integration, and each of Solr’s features including faceting, more-like-this, spell checking/suggest, and others.
Distributed-ness: Distributed computing & the cloudsRobert Coup
Discussion on distributed apps and the cloud resources available to support them. Some discussion on the XMPP/Jabber based messaging system we use at Koordinates. Part of the seminar series for the Wellington Summer of Code programme.
This is a presentation which describe the big picture of the Rest API. In this presentation I simply describe the theories with practical examples. Hope this presentation will cover the overall Rest API domain.
Presented by Shai Erera, Researcher, IBM
Lucene's arsenal has recently expanded to include two new modules: Index Sorting and Replication. Index sorting lets you keep an index consistently sorted based on some criteria (e.g. modification date). This allows for efficient search early-termination as well as achieve better index compression. Index replication lets you replicate a search index to achieve high-availability, fault tolerance as well as take hot index backups. In this talk we will introduce these modules, discuss implementation and design details as well as best practices.
Boosting Documents in Solr by Recency, Popularity and Personal Preferences - ...lucenerevolution
See conference video - http://www.lucidimagination.com/devzone/events/conferences/revolution/2011
Attendees with come away from this presentation with a good understanding and access to source
code for boosting and/or filtering documents by recency, popularity, and personal preferences. My
solution improves upon the common “recipe” based solution for boosting by document age. The
framework also supports boosting documents by a popularity score, which is calculated and
managed outside the index. I will present a few different ways to calculate popularity in a scalable
manner. Lastly, my solution supports the concept of a personal document collection, where each
user is only interested in a subset of the total number of documents in the index.
Forritun veflausna, hvort sem er fyrir neytendur (B2C) eða fyrirtækni (B2B) eru í sívaxandi mæli að nota API til að bjóða upp á þjónustur. Þetta opnar örðum hugbúnaðarhúsum leið til að bjóða upp á lausnir sem nota viðkomandi APi. Sem dæmi má nefna að margir nota Google Maps API til að birta kort t.d. hvar eitthvað er.
Notkun API er einnig architecture style og þar kemur REST inn. Með því að aðskila viðmót og backvinnslu með API má ná fram skörpum skilum þarna á milli. Í þessum fyrirlestri er REST skoða sem leið til að búa til lausnir.
You can watch the replay for this Geek Sync webcast, Successfully Migrating Existing Databases to Azure SQL Database, on the IDERA Resource Center, http://ow.ly/k4p050A4rBA.
First impressions have long-lasting effects. When dealing with an architecture change like migrating to Azure SQL Database the last thing you want to do is leave a bad first impression by having an unsuccessful migration. In this session, you will learn the difference between Azure SQL Database, SQL Managed Instances, and Elastic Pools. How to use tools to test migrations for compatibility issues before you start the migration process. You will learn how to successfully migrate your database schema and data to the cloud. Finally, you will learn how to determine which performance tier is a good starting point for your existing workload(s) and how to monitor your workload over time to make sure your users have a great experience while you save as much money as possible.
Speaker: John Sterrett is an MCSE: Data Platform, Principal Consultant and the Founder of Procure SQL LLC. John has presented at many community events, including Microsoft Ignite, PASS Member Summit, SQLRally, 24 Hours of PASS, SQLSaturdays, PASS Chapters, and Virtual Chapter meetings. John is a leader of the Austin SQL Server User Group and the founder of the HADR Virtual Chapter.
Search is everywhere, and therefore so is Apache Lucene. While providing amazing out-of-the-box defaults, there’s enough projects weird enough to require custom search scoring and ranking. In this talk, I’ll walk through how to use Lucene to implement your custom scoring and search ranking. We’ll see how you can achieve both amazing power (and responsibility) over your search results. We’ll see the flexibility of Lucene’s data structures and explore the pros/cons of custom Lucene scoring vs other methods of improving search relevancy.
Voldemort & Hadoop @ Linkedin, Hadoop User Group Jan 2010Bhupesh Bansal
Jan 22nd, 2010 Hadoop meetup presentation on project voldemort and how it plays well with Hadoop at linkedin. The talk focus on Linkedin Hadoop ecosystem. How linkedin manage complex workflows, data ETL , data storage and online serving of 100GB to TB of data.
Do you need an external search platform for Adobe Experience Manager?therealgaston
Experience Manager provides some basic search capabilities out of the box. In this talk, we'll explore an external search platform for implementing an Experience Manager powered, search-driven site. As an example, we will use Apache Solr as a reference implementation and describe best practices for indexing content, exposing non-Experience Manager content via search, delivering search-driven experiences, and deploying the solution in a production setting.
Data Replication Options in AWS (ARC302) | AWS re:Invent 2013Amazon Web Services
One of the most critical roles of an IT department is to protect and serve its corporate data. As a result, IT departments spend tremendous amounts of resources developing, designing, testing, and optimizing data recovery and replication options in order to improve data availability and service response time. This session outlines replication challenges, key design patterns, and methods commonly used in today’s IT environment. Furthermore, the session provides different data replication solutions available in the AWS cloud. Finally, the session outlines several key factors to be considered when implementing data replication architectures in the AWS cloud.
The Hop project entered Apache Software Foundation as an Incubator project in 2020, and Julian Hyde, one of their mentors, gave this presentation to educate the initial committers on the Apache Way and what to expect during the Incubation process.
The talk was given by Julian Hyde on October 1st, 2020, with the original title "Apache Incubation - What's it all about?"
AWS Webcast - Optimize your database for the cloud with DynamoDB – A Deep Div...Amazon Web Services
Amazon DynamoDB is a fully managed, highly scalable distributed database service. Global Secondary Indexes (GSI) give you the flexibility to query your DynamoDB tables in new and powerful ways.
In this session, we will:
• Describe how GSI's work under the covers to ensure consistent low latency at any scale.
• Walk through various access patterns so that you will learn how to take full advantage of GSI's and implement best practice designs that will scale efficiently and cost-effectively.
This session is designed for developers and architects seeking to build rich applications that require performance and availability with absolute data durability.
Faceted search is a powerful technique to let users easily navigate the search results. It can also be used to develop rich user interfaces, which give an analyst quick insights about the documents space. In this session I will introduce the Facets module, how to use it, under-the-hood details as well as optimizations and best practices. I will also describe advanced faceted search capabilities with Lucene Facets.
An overview of ORDS for building RESTful Web Services and your Oracle Database with BEER examples!
Thanks and credit to the POUG organization for making this possible.
Solr Recipes provides quick and easy steps for common use cases with Apache Solr. Bite-sized recipes will be presented for data ingestion, textual analysis, client integration, and each of Solr’s features including faceting, more-like-this, spell checking/suggest, and others.
Distributed-ness: Distributed computing & the cloudsRobert Coup
Discussion on distributed apps and the cloud resources available to support them. Some discussion on the XMPP/Jabber based messaging system we use at Koordinates. Part of the seminar series for the Wellington Summer of Code programme.
This is a presentation which describe the big picture of the Rest API. In this presentation I simply describe the theories with practical examples. Hope this presentation will cover the overall Rest API domain.
Presented by Shai Erera, Researcher, IBM
Lucene's arsenal has recently expanded to include two new modules: Index Sorting and Replication. Index sorting lets you keep an index consistently sorted based on some criteria (e.g. modification date). This allows for efficient search early-termination as well as achieve better index compression. Index replication lets you replicate a search index to achieve high-availability, fault tolerance as well as take hot index backups. In this talk we will introduce these modules, discuss implementation and design details as well as best practices.
Boosting Documents in Solr by Recency, Popularity and Personal Preferences - ...lucenerevolution
See conference video - http://www.lucidimagination.com/devzone/events/conferences/revolution/2011
Attendees with come away from this presentation with a good understanding and access to source
code for boosting and/or filtering documents by recency, popularity, and personal preferences. My
solution improves upon the common “recipe” based solution for boosting by document age. The
framework also supports boosting documents by a popularity score, which is calculated and
managed outside the index. I will present a few different ways to calculate popularity in a scalable
manner. Lastly, my solution supports the concept of a personal document collection, where each
user is only interested in a subset of the total number of documents in the index.
Forritun veflausna, hvort sem er fyrir neytendur (B2C) eða fyrirtækni (B2B) eru í sívaxandi mæli að nota API til að bjóða upp á þjónustur. Þetta opnar örðum hugbúnaðarhúsum leið til að bjóða upp á lausnir sem nota viðkomandi APi. Sem dæmi má nefna að margir nota Google Maps API til að birta kort t.d. hvar eitthvað er.
Notkun API er einnig architecture style og þar kemur REST inn. Með því að aðskila viðmót og backvinnslu með API má ná fram skörpum skilum þarna á milli. Í þessum fyrirlestri er REST skoða sem leið til að búa til lausnir.
You can watch the replay for this Geek Sync webcast, Successfully Migrating Existing Databases to Azure SQL Database, on the IDERA Resource Center, http://ow.ly/k4p050A4rBA.
First impressions have long-lasting effects. When dealing with an architecture change like migrating to Azure SQL Database the last thing you want to do is leave a bad first impression by having an unsuccessful migration. In this session, you will learn the difference between Azure SQL Database, SQL Managed Instances, and Elastic Pools. How to use tools to test migrations for compatibility issues before you start the migration process. You will learn how to successfully migrate your database schema and data to the cloud. Finally, you will learn how to determine which performance tier is a good starting point for your existing workload(s) and how to monitor your workload over time to make sure your users have a great experience while you save as much money as possible.
Speaker: John Sterrett is an MCSE: Data Platform, Principal Consultant and the Founder of Procure SQL LLC. John has presented at many community events, including Microsoft Ignite, PASS Member Summit, SQLRally, 24 Hours of PASS, SQLSaturdays, PASS Chapters, and Virtual Chapter meetings. John is a leader of the Austin SQL Server User Group and the founder of the HADR Virtual Chapter.
Search is everywhere, and therefore so is Apache Lucene. While providing amazing out-of-the-box defaults, there’s enough projects weird enough to require custom search scoring and ranking. In this talk, I’ll walk through how to use Lucene to implement your custom scoring and search ranking. We’ll see how you can achieve both amazing power (and responsibility) over your search results. We’ll see the flexibility of Lucene’s data structures and explore the pros/cons of custom Lucene scoring vs other methods of improving search relevancy.
Voldemort & Hadoop @ Linkedin, Hadoop User Group Jan 2010Bhupesh Bansal
Jan 22nd, 2010 Hadoop meetup presentation on project voldemort and how it plays well with Hadoop at linkedin. The talk focus on Linkedin Hadoop ecosystem. How linkedin manage complex workflows, data ETL , data storage and online serving of 100GB to TB of data.
The millions of people that use Spotify each day generate a lot of data, roughly a few terabytes per day. What does it take to handle datasets of that scale, and what can be done with it? I will briefly cover how Spotify uses data to provide a better music listening experience, and to strengthen their busineess. Most of the talk will be spent on our data processing architecture, and how we leverage state of the art data processing and storage tools, such as Hadoop, Cassandra, Kafka, Storm, Hive, and Crunch. Last, I'll present observations and thoughts on innovation in the data processing aka Big Data field.
This is a presentation I delivered at CodeMash 2.0.1.0 dealing with lessons learned while building an application for handling the post-processing of scientific data using the Windows Azure platform.
AWS Webcast - Build Mobile Apps with a Secure, Scalable Back End on DynamoDBAmazon Web Services
Mobile apps and connected devices require a secure and scalable back end to deliver an excellent user experience. DynamoDB makes it easy to securely store and serve data, with remarkably low latency. Join us to learn how to easily build scalable mobile apps with a powerful back end.
The eBay Architecture: Striking a Balance between Site Stability, Feature Ve...Randy Shoup
eBay architects Randy Shoup and Dan Pritchett give a guided tour of the eBay architecture. They cover the evolution of the technology stack from Perl to C++ to Java. And they discuss scaling strategies for the data tier, application tier, search, and operations.
SharePoint 2010 Boost your farm performance!Brian Culver
Is your farm struggling to server your organization? How long is it taking between page requests? Where is your bottleneck in your farm? Is your SQL Server tuned properly? Worried about upgrading due to poor performance? We will look at various tools for analyzing and measuring performance of your farm. We will look at simple SharePoint and IIS configuration options to instantly improve performance.
Similar to Google Devfest 2009 Argentina - Intro to Appengine (20)
Kubernetes has many ways to scale your workloads, most of what we hear about is scaling our cluster up with either with vm sets or autoscaling groups. There is another way, in this talk we will look at virtual kubelet. Virual Kubelet will allow us to talk to a cloud providers container as a service platform like ACI, fargate or ECI. We will deep dive into how you can scale your applications across virtual kubelet. One issue is the kubernetes service type has is scaling to zero due to the way routing to the pod happens if there is no pod for the service to route too. Scaling our applications to zero is just as important and scaling up. We will look at projects that integrate with the horizontal pod autoscaler that fix this issue. Allowing us to not only scale our applications up but as easily down to make our cluster truly elastic.
KubeCon China 2019 - Building Apps with Containers, Functions and Managed Ser...Patrick Chanezon
Cloud native applications are composed of many technologies and components, but three canonical abstraction emerged in the past few years that help developers structure their architecture: container, functions responding to events, and managed services.
This talk will explain how to develop (Docker, local Kubernetes, virtual Kubelet, OpenFaaS), deploy (managed Kubernetes, functions and services) and package (CNAB specification and tooling) applications using these three components and look at not only deployment workflows but also at day 2 concerns that a developer would need to consider in the cloud native landscape.
We will demo every topic and a Github repository will be available for developers to reproduce the demos and learn at their own pace.
Patrick Chanezon and Scott Coulton
Dockercon 2019 Developing Apps with Containers, Functions and Cloud ServicesPatrick Chanezon
Cloud native applications are composed of containers, serverless functions and managed cloud services.
What is the best set of tools on your desktop to provide a rapid, iterative development experience and package applications using these three components?
This hand-on talk will explain how you can complement Docker Desktop, with it’s local Docker engine and Kubernetes cluster, with open source tools such as the Virtual Kubelet, Open Service Broker, the Gloo hybrid app gateway, Draft, and others, to build the most productive development inner-loop for these type of applications.
It will also cover how you can use the Cloud Native Application Bundle (CNAB) format and it’s implementation in the Docker app experimental tool to package your application and manage it with container supply chain tooling such as Docker Hub.
GIDS 2019: Developing Apps with Containers, Functions and Cloud ServicesPatrick Chanezon
Cloud native applications are increasingly composed of containers, serverless functions responding to events and managed cloud services. What is the best workflow and set of tools to provide a rapid, iterative development experience and to package applications using these three components?
This hand-on talk will compare and contrast several sets of tools and their associated workflows:
Using Docker Desktop, with its local Docker engine and Kubernetes cluster, with open source tools such as the Virtual Kubelet, or the Gloo hybrid app gateway, to build the most productive development inner-loop for these type of applications
OpenFaaS, Fn, or Nuclio open source serverless framework to run functions in containers locally
Telepresence to run a container locally, connected to a remote cluster
Helm and Draft
Knative
The talk will also cover how you can use the Cloud Native Application Bundle (CNAB) format and tools to package your applications and share them using a container registry.
Patrick Chanezon, un des pionniers du Cloud chez Google, VMware, Microsoft et Docker, vous raconte la révolution des conteneurs logiciels et comment certains concepts du taoïsme, wei-wu-wei, "agir sans agir", et ziran, naturel, ou spontanéïté, permettent d'en mieux cerner les enjeux.
Les conteneurs accélèrent l'adoption du Cloud en entreprise, avec des architectures hybride et multi cloud, la mise en place de démarches agiles et DevOps pour moderniser les applications existantes et réduire les coûts d'infrastructure, et permettent de nouveaux cas d'utilisation dans l'internet des objets et l'intelligence artificielle.
Moby is an open source project providing a "LEGO set" of dozens of components, the framework to assemble them into specialized container-based systems, and a place for all container enthusiasts to experiment and exchange ideas.
One of these assemblies is Docker CE, an open source product that lets you build, ship, and run containers.
This talk will explain how you can leverage the Moby project to assemble your own specialized container-based system, whether for IoT, cloud or bare metal scenarios.
We will cover Moby itself, the framework, and tooling around the project, as well as many of it’s components: LinuxKit, InfraKit, containerd, SwarmKit, Notary.
Then we will present a few use cases and demos of how different companies have leveraged Moby and some of the Moby components to create their own container-based systems.
Video at https://www.youtube.com/watch?v=kDp22YkD6WY
Microsoft Techsummit Zurich Docker and MicrosoftPatrick Chanezon
Docker and Microsoft have been collaborating both in open source and through their commercial partnership to bring the benefits of Docker Windows and Linux containers to Azure Enterprise customers. Docker’s container platform, Docker Enterprise Edition, is used to modernize traditioal applications, and move them to Azure, as well as to develop new cloud native applications using microservices architecture, bringing agility to developers and control to IT Pros. This talk will cover the latest developments in Docker’s container platform with planned support for Kubernetes in Docker for Windows, and Docker Enterprise Edition for Azure, Docker for Azure Stack to enable hybrid cloud deployments, Windows containers, Linux containers on Windows.
Develop and deploy Kubernetes applications with Docker - IBM Index 2018Patrick Chanezon
Docker Desktop and Enterprise Edition now both include Kubernetes as an optional orchestration component. This talk will explain how to use Docker Desktop (Mac or Windows) to develop and debug a cloud native application, then how Docker Enterprise Edition helps you deploy it to Kubernetes in production.
The Docker Way: modernize traditional applications without action (wu-wei) and create new cloud native microservices applications with naturalness (ziran).
This talk also provides a summary of all the DockerCon EU 2017 announcements: Kubernetes now supported in Docker, MTA, IBM partnership.
Building specialized container-based systems with Moby: a few use cases
This talk will explain how you can leverage the Moby project to assemble your own specialized container-based system, whether for IoT, cloud or bare metal scenarios. We will cover Moby itself, the framework, and tooling around the project, as well as many of it’s components: LinuxKit, InfraKit, containerd, SwarmKit, Notary. Then we will present a few use cases and demos of how different companies have leveraged Moby and some of the Moby components to create their own container-based systems.
Docker Cap Gemini CloudXperience 2017 - la revolution des conteneurs logicielsPatrick Chanezon
Si vous avez raté le début : Patrick Chanezon, un des pionniers du Cloud chez Google, VMware, Microsoft et Docker, vous raconte la révolution des conteneurs logiciels en quelques films ; comment ils accélèrent l'adoption du Cloud en entreprise, avec des architectures hybride et multi, la mise en place de démarches agiles et DevOps pour moderniser les applications existantes et réduire les coûts d'infrastructure, et permettent de nouveaux cas d'utilisation dans l'internet des objets et l'intelligence artificielle.
En bref, comment expliquer la stratégie des opérateurs du Cloud avec des films de science- fiction ? C’est le défi que va relever Patrick Chanezon, évangéliste chez Docker.
Docker moves very fast, with an edge channel released every month and a stable release every 3 months. Patrick will talk about how Docker introduced Docker EE and a certification program for containers and plugins with Docker CE and EE 17.03 (from March), the announcements from DockerCon (April), and the many new features planned for Docker CE 17.05 in May.
This talk will be about what's new in Docker and what's next on the roadmap
Oscon 2017: Build your own container-based system with the Moby projectPatrick Chanezon
Build your own container-based system
with the Moby project
Docker Community Edition—an open source product that lets you build, ship, and run containers—is an assembly of modular components built from an upstream open source project called Moby. Moby provides a “Lego set” of dozens of components, the framework for assembling them into specialized container-based systems, and a place for all container enthusiasts to experiment and exchange ideas.
Patrick Chanezon and Mindy Preston explain how you can leverage the Moby project to assemble your own specialized container-based system, whether for IoT, cloud, or bare-metal scenarios. Patrick and Mindy explore Moby’s framework, components, and tooling, focusing on two components: LinuxKit, a toolkit to build container-based Linux subsystems that are secure, lean, and portable, and InfraKit, a toolkit for creating and managing declarative, self-healing infrastructure. Along the way, they demo how to use Moby, LinuxKit, InfraKit, and other components to quickly assemble full-blown container-based systems for several use cases and deploy them on various infrastructures.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
Google Devfest 2009 Argentina - Intro to Appengine
1.
2. From Spark Plug to Drive Train:
Life of an App Engine Request
Patrick Chanezon @chanezon
Ignacio Blanco @blanconet
11/16/09
Post your questions for this talk on Twitter #devfest09 #appengine
4. Agenda
Designing for Scale and Reliability
App Engine: Design Motivations
Life of a Request
Request for static content
Request for dynamic content
Requests that use APIs
App Engine: Design Motivations, Recap
App Engine: The Numbers
7. LiveJournal circa 2007
From Brad Fitzpatrick's USENIX '07 talk:
"LiveJournal: Behind the Scenes" Memcache
Application
Frontends Servers Storage
Static File Servers
8. Basic LAMP
Linux, Apache, MySQL,
Programming Language
Scalable?
Shared machine for database
and webserver
Reliable?
Single point of failure (SPOF)
9. Dedicated Database
Database running on a
separate server
Requirements
Another machine plus
additional management
Scalable?
Up to one web server
Reliable?
Two single points of failure
11. Multiple Web Servers
Load Balancing: DNS Round Robin
Register list of IPs with DNS
Statistical load balancing
DNS record is cached with Time To Live (TTL)
TTL may not be respected
12. Multiple Web Servers
Load Balancing: DNS Round Robin
Register list of IPs with DNS
Statistical load balancing
DNS record is cached with Time To Live (TTL)
TTL may not be respected
Now wait for DNS changes to propagate :-(
13. Multiple Web Servers
Load Balancing: DNS Round Robin
Scalable?
Add more webservers as necessary
Still I/O bound on one database
Reliable?
Cannot redirect traffic quickly
Database still SPOF
14. Reverse Proxy
Benefits:
Custom Routing
Specialization
Application-level load balancing
Requirements:
More machines
Configuration and code for reverse proxies
15. Reverse Proxy
Scalable?
Add more web servers
Specialization
Bound by
Routing capacity of reverse proxy
One database server
Reliable?
Agile application-level routing
Specialized components are more robust
Multiple reverse proxies requires network-level routing
DNS Round Robin (again)
Fancy network routing hardware
Database is still SPOF
16. Master-Slave Database
Benefits:
Better read throughput
Invisible to application
Requirements:
Even more machines
Changes to MySQL
17. Master-Slave Database
Scalable?
Scales read rate with # of servers
But not writes
What happens eventually?
18. Master-Slave Database
Reliable?
Master is SPOF for writes
Master may die before replication
19. Partitioned Database
Benefits: Requirements:
Increase in both read Even more machines
and write throughput Lots of management
Re-architect data model
Rewrite queries
22. Design Motivations
Build on Existing Google Technology
Provide an Integrated Environment
Encourage Small Per-Request Footprints
Encourage Fast Requests
Maintain Isolation Between Applications
Encourage Statelessness and Specialization
Require Partitioned Data Model
24. Request for Static Content on Google Network
Routed to the nearest Google datacenter
Travels over Google's network
Same infrastructure other Google products use
Lots of advantages for free
25. Request for Static Content
Routing at the Front End
Google App Engine Front Ends
Load balancing
Routing
Frontends route static requests to specialized serving
infrastructure
26. Request for Static Content
Static Content Servers
Google Static Content Serving
Built on shared Google Infrastructure
Static files are physically separate from code files
How are static files defined?
27. Request for Static Content
What content is static?
Java Runtime: appengine-web.xml
...
<static>
<include path="/**.png" />
<exclude path="/data/**.png />
</static>
...
Python Runtime: app.yaml
...
- url: /images
static_dir: static/images
OR
- url: /images/(.*)
static_files: static/images/1
upload: static/images/(.*)
...
28. Request For Static Content
Response to the user
Back to the Front End and out to the user
Specialized infrastructure
App runtimes don't serve static content
29. Life of a Request:
Request for Dynamic Content
30. Request for Dynamic Content: New Components
App Servers and App Master
App Servers
Serve dynamic requests
Where your code runs
App Master
Schedules applications
Informs Front Ends
31. Request for Dynamic Content: Appservers
What do they do?
Many applications
Many concurrent requests
Smaller app footprint + fast requests = more apps
Enforce Isolation
Keeps apps safe from each other
Enforce statelessness
Allows for scheduling flexibility
Service API requests
32. Request For Dynamic Content
Routing at the Frontend
Front Ends route dynamic
requests to App Servers
33. Request for Dynamic Content
App Server
1. Checks for cached runtime
If it exists, no initialization
2. Execute request
3. Cache the runtime
System is designed to maximize caching
Slow first request, faster subsequent requests
Optimistically cache data in your runtime!
35. API Requests
App Server
1. App issues API call
2. App Server accepts
3. App Server blocks runtime
4. App Server issues call
5. Returns the response
Use APIs to do things you
don't want to do in your
runtime, such as...
37. Memcacheg
A more persistent in-memory cache
Distributed in-memory cache
memcacheg
Also written by Brad Fitzpatrick
adds: set_multi, get_multi, add_multi
Optimistically cache for optimization
Very stable, robust and specialized
44. Entities table
Primary table
Every entity in every app
Generic, schemaless
Row name -> entity key
Column (only 1) serialized entity
45. Entity keys
Based on parent entities: root entity, then child, child, ...
class Grandparent(db.Model): pass
class Parent(db.Model): pass
class Child(db.Model): pass
Felipe = Grandparent()
Carlos = Parent(parent=Felipe)
Ignacio = Child(parent=Carlos)
my family
/Grandparent:Felipe
/Grandparent:Felipe/Parent:Carlos
/Grandparent:Felipe/Parent:Carlos/Child:Ignacio
46. Queries
GQL < SQL
Restrict by kind
Filter by property values
Sort on properties
Ancestor
SELECT * FROM Person ...
WHERE name = 'John';
ORDER BY name DESC;
WHERE city = 'Sonoma' AND state = 'CA'
AND country = 'USA';
WHERE ANCESTOR IS :Felipe ORDER BY name;
47. Indexes
Dedicated Bigtable tables
Map property values to entities
Each row = index data + entity key
Convert queries to scans
No filtering in memory
No sorting in memory
49. Kind index
SELECT * FROM Grandparent
1. Kind index
2. Prefix = Grandparent
3. Scan!
Row name Row name
50. Single-property index
Queries on single property (one ASC one DESC)
WHERE name = 'John'
ORDER BY name DESC
WHERE name >= 'B' AND name < 'C' ORDER BY name
Row name Key
54. Single-property index
WHERE name >= 'B' and name < 'C' ORDER BY name
1. RANGE = [Parent name B, Parent name C)
2. Scan!
55. The App Engine Datastore
Persistent storage
Your data is already partitioned
Use Entity Groups
Explicit Indexes make for fast reads
But slower writes
Replicated and fault tolerant
On commit: ≥3 machines
Geographically distributed
Bonus: Keep globally unique IDs for free
56. Other APIs
GMail Gadget API
Google Tasks Queue
Accounts
Picasaweb Google Talk
58. Build on Existing Google Technology
creative commons licensed photograph: http://www.flickr.com/photos/cote/54408562/
59. Provide an Integrated Environment
Why?
Manage all apps together
What it means for you:
Follow best practices
Some restrictions
Use our tools
Benefits:
Use our tools
Admin Console
All of your logs in one place
No machines to configure or manage
Easy deployment
60. Encourage Small Per-Request Footprints
Why?
Better utilization of App Servers
Fairness
What it means for your app:
Less Memory Usage
Limited CPU
Benefits:
Better use of resources
61. Encourage Fast Requests
Why?
Better utilization of appservers
Fairness between applications
Routing and scheduling agility
What it means for your app:
Runtime caching
Request deadlines
Benefits:
Optimistically share state between requests
Better throughput
Fault tolerance
Better use of resources
62. Maintain Isolation Between Apps
Why?
Safety
Predictability
What it means for your app:
Certain system calls unavailable
Benefits:
Security
Performance
63. Encourage Statelessness and Specialization
Why?
App Server performance
Load balancing
Fault tolerance
What this means for you app:
Use API calls
Benefits:
Automatic load balancing
Fault tolerance
Less code for you to write
Better use of resources
64. Require Partitioned Data Model
Why?
The Datastore
What this means for your app:
Data model + Indexes
Reads are fast, writes are slower
Benefits:
Design your schema once
No need to re-architect for scalability
More efficient use of cpu and memory
68. Open For Questions
The White House's "Open For Questions" application accepted
100K questions and 3.6M votes in under 48 hours
69. 18 months in review
Apr 2008 Python launch
May 2008 Memcache, Images API
Jul 2008 Logs export
Aug 2008 Batch write/delete
Oct 2008 HTTPS support
Dec 2008 Status dashboard, quota details
Feb 2009 Billing, larger files
Apr 2009 Java launch, DB import, cron support, SDC
May 2009 Key-only queries
Jun 2009 Task queues
Aug 2009 Kindless queries
Sep 2009 XMPP
Oct 2009 Incoming email
70. Roadmap
Storing/serving large files
Mapping operations across data
sets
Datastore cursors
Notification alerts for application
exceptions
Datastore dump and restore
facility