This document summarizes DreamObjects, an object storage platform powered by Ceph. It discusses the hardware used in storage and support nodes, including Intel and AMD processors, RAM, disks, and networking components. The document also provides details on Ceph configuration including replication, CRUSH mapping, OSD configuration, and application tuning. Monitoring tools discussed include Chef, pdsh, Sensu, collectd, graphite, logstash, Jenkins and future plans.
The document discusses JetBrains' use of feature branches and continuous integration in their development process. It provides details on their internal TeamCity installation which processes over 1000 VCS changes and 1500 builds per day. It also discusses how their .NET Products team has benefited from adopting feature branches in Mercurial after previously struggling with long build times and broken builds using Subversion without feature branches.
This document summarizes a presentation about running Kubernetes reliably and at scale on AWS. It discusses some common issues like out of memory kills affecting Etcd and other Kubernetes processes. It also covers AWS resource limits and volume issues that need to be addressed for cloud hygiene. The presentation recommends using auto scaling groups to scale infrastructure and introduces Applatix as a platform to build and run containerized apps on Kubernetes in the cloud with automation and devops workflows for monitoring, auditing and governance.
This document discusses functional programming in serverless environments. It begins by defining serverless computing and Function as a Service (FaaS). It then explores why serverless is useful from the perspectives of costs, architecture, and operations. The document examines using different programming languages like F# within serverless and the importance of tooling and context. It describes experiments running programs on AWS Lambda to measure predictability and constraints. Finally it provides references for further reading on serverless computing topics.
This document discusses scaling WordPress on AWS. It introduces AWS services like EC2, EFS, S3, RDS that can be used to deploy and scale a WordPress site. It explains different scaling approaches like vertical scaling by adding more resources, horizontal scaling by adding more machines, and global scaling across availability zones. An enhanced WordPress architecture using EC2 for the frontend and logic layers, RDS for the database, and S3 for file storage is proposed. Core and additional AWS services for development, operations, security and more that can help scale WordPress are also outlined.
The document provides an overview of various Azure services including Blob Storage, Table Storage, Queue Storage, Service Bus, SQL Database, DocumentDB, WebJobs, Virtual Machines, and App Service. It describes the purpose and basic functionality of each service. Key points include that Blob Storage can store files of all types, Table Storage is for structured data, Queue Storage sends and receives messages, and App Service hosts web, mobile, and API apps on Azure.
This document summarizes DreamObjects, an object storage platform powered by Ceph. It discusses the hardware used in storage and support nodes, including Intel and AMD processors, RAM, disks, and networking components. The document also provides details on Ceph configuration including replication, CRUSH mapping, OSD configuration, and application tuning. Monitoring tools discussed include Chef, pdsh, Sensu, collectd, graphite, logstash, Jenkins and future plans.
The document discusses JetBrains' use of feature branches and continuous integration in their development process. It provides details on their internal TeamCity installation which processes over 1000 VCS changes and 1500 builds per day. It also discusses how their .NET Products team has benefited from adopting feature branches in Mercurial after previously struggling with long build times and broken builds using Subversion without feature branches.
This document summarizes a presentation about running Kubernetes reliably and at scale on AWS. It discusses some common issues like out of memory kills affecting Etcd and other Kubernetes processes. It also covers AWS resource limits and volume issues that need to be addressed for cloud hygiene. The presentation recommends using auto scaling groups to scale infrastructure and introduces Applatix as a platform to build and run containerized apps on Kubernetes in the cloud with automation and devops workflows for monitoring, auditing and governance.
This document discusses functional programming in serverless environments. It begins by defining serverless computing and Function as a Service (FaaS). It then explores why serverless is useful from the perspectives of costs, architecture, and operations. The document examines using different programming languages like F# within serverless and the importance of tooling and context. It describes experiments running programs on AWS Lambda to measure predictability and constraints. Finally it provides references for further reading on serverless computing topics.
This document discusses scaling WordPress on AWS. It introduces AWS services like EC2, EFS, S3, RDS that can be used to deploy and scale a WordPress site. It explains different scaling approaches like vertical scaling by adding more resources, horizontal scaling by adding more machines, and global scaling across availability zones. An enhanced WordPress architecture using EC2 for the frontend and logic layers, RDS for the database, and S3 for file storage is proposed. Core and additional AWS services for development, operations, security and more that can help scale WordPress are also outlined.
The document provides an overview of various Azure services including Blob Storage, Table Storage, Queue Storage, Service Bus, SQL Database, DocumentDB, WebJobs, Virtual Machines, and App Service. It describes the purpose and basic functionality of each service. Key points include that Blob Storage can store files of all types, Table Storage is for structured data, Queue Storage sends and receives messages, and App Service hosts web, mobile, and API apps on Azure.
Rik Hepworth - ARM Yourself for Effective Azure ProvisioningWinOps Conf
Azure Resource Manager templates are a crucial part of your journey to the cloud. Learn the essentials of template creation and maintenance, with some examples of how to deal with complex deployments and manage the PaaS services that born in the cloud apps need.
This document discusses data storage approaches for AngularJS applications from basic to advanced. It introduces a data storage maturity model that progresses from 0) data dump to 1) structured storage, 2) CQRS (Command Query Responsibility Segregation), and finally 3) event sourcing as the most advanced approach. Event sourcing stores all changes to data as a sequence of events and uses these events to maintain and query projections of current data states. The document encourages providing feedback on the session through a QR code and promotes joining the Microsoft Virtual Academy for free online IT training.
WordCamp IL 2016 - WordPress Scale on AWSBoaz Ziniman
One of the most popular CMS, WordPress, was not designed for the cloud era. Running a high demand and highly available WordPress in a cluster can be a complex task.
There are several solutions to this problem and this session will focus on one of them. Using several AWS services (EC2, RDS, S3, EFS, CloudFormation and others) and Zend Server, we will create a complex setup running in minutes and scale it up and down by demand.
Ryan Armstrong - Monitoring More Than 6000 Devices in Zabbix | ZabConf2016Zabbix
Ryan will describe a Skunkworks project executed by Kinetic IT at the Department of Education to deliver an autonomous infrastructure monitoring solution for over 6000 devices distributed across WA. The team were given opportunity to experiment with DevOps practices such as Scrum product development, Infrastructure As Code and Continuous Integration to determine where the value lay and which practices should be adopted at greater scale.
Developing for Your Target Market - Social, Games & Mobile - AWS India Summit...Amazon Web Services
This document provides best practices for developing applications targeted at social, games, and mobile markets on AWS. It recommends offloading static content, caching at the edge, following DRY principles, load balancing from the start, using auto scaling appropriately, leveraging database services smartly, A/B testing, and using multiple availability zones, RDS replicas and slaves, auto-scaling groups, Elastic Load Balancing, and CloudFront and Route53 for edge services. The document stresses that following these practices can significantly reduce costs while improving performance, reliability, and the ability to scale to millions of users with only a few engineers.
This document provides an introduction and overview of Azure cloud services. It discusses why organizations choose the cloud over traditional on-premise infrastructure, highlighting benefits like reduced costs, automatic scaling, and global availability. It then outlines several key Azure services for compute, data, applications, and networking, including WebRoles, SQL Database, caching, storage, and virtual networks. The document uses examples to show how Azure provides these services at a lower cost than comparable AWS offerings.
RightScale User Conference: Why RightScale?Erik Osterman
RightScale provides a framework for operations that standardizes infrastructure management and allows operations to evolve alongside engineering. It treats infrastructure like software development with reusable components, simplifying operations and reducing technical debt. This framework allows organizations to build infrastructure consistently across clouds, commoditize resources, and empower engineers to take on operational roles through a modern DevOps approach.
The document discusses using Golang for serverless applications. It introduces serverless computing and why Golang is a good choice. Benefits of Golang include its simplicity with only requiring a single binary output and no dependencies. The document demonstrates building a serverless REST API with Golang and AWS Lambda, and addresses enhancing Lambda with provisioned concurrency. It concludes with references for further information.
Author: Dmitry Podrezov, www.easbacntech.com
This deck showcases what's new and what's been trimmed in the upcoming version of ASP.NET framework scheduled for release this summer. The framework was built from ground-up for multiple platforms and those trying to migrate existing solutions into it will need to be ready for a few breaking changes. This is not a 101 description the framework fundamentals, rather it is a demo of new features and changes. The talk is packed with demonstrations and live code experience.
This document provides an overview of moving from .NET development to Node.js development. It discusses why Node.js is popular, including being platform independent, scalable, faster, and lightweight. It then covers setting up a Node.js development environment, building a sample web application with Express, interacting with databases like MySQL, and testing and debugging Node.js applications. The objectives are to introduce Node.js concepts, show how to create a basic application, and discuss Node.js maintenance activities like testing and debugging.
RavenDB is a .NET document database that is fast and scalable. It has a .NET client and HTTP client via a REST API. RavenDB can be run as a console application, Windows service, embedded or in IIS. It uses lightweight document sessions for transactions and ID handling. RavenDB is designed to be stable through features like limiting results to 128 by default and batching operations in a session. Indexes in RavenDB support mapping, reducing, transforming and paging data.
Beyond Heroku: Hosting Your Rails App Yourselfstcarpenter
This document discusses hosting a Rails application yourself as an alternative to Heroku. It recommends using Unicorn as the application server, nginx as a reverse proxy, and deploying with Capistrano. Affordable hosting options mentioned include Amazon, Windows Azure, Digital Ocean, and Linode. Configuration management software and the features of Unicorn, nginx, and Capistrano are also outlined.
1) The document discusses different technology stacks and hosting options for websites, including LAMP (Linux, Apache, MySQL, PHP), LEMP (Linux, Nginx, Percona, PHP-FPM, Exim), dedicated servers, and cloud servers.
2) It provides an overview of components in the LEMP stack such as Nginx, Percona, and PHP-FPM, noting their advantages over traditional components like Apache and MySQL, including increased performance.
3) The document emphasizes the importance of choosing the right hosting solution based on the needs and merits of the specific website, considering factors like cost, reliability, performance, flexibility, and administration.
This document summarizes new features in Adobe CQ 5.5, including improved integration with Creative Suite for rich media management, enhancements to the authoring and developer experiences, and support for mobile applications and e-commerce. It highlights capabilities like editing rich media directly in Creative Suite and leveraging the cloud for asset transformations and delivery. The document also lists next steps like downloading a free CRX developer edition.
UK Azure User Group - Blazor and Azure (Tim Ebenezer)Richard Conway
This document summarizes a presentation on using Blazor and Azure in an enterprise environment. It begins with an introduction to Blazor, explaining that it is a front end framework that can run on the client or server using C# and interacts with Azure services. It then compares Blazor to JavaScript frameworks. An example high level Blazor and Azure architecture is shown. Key considerations for deploying Blazor at scale in an enterprise are discussed, including scaling the SignalR service, handling large file uploads, logging to Application Insights, and page lifecycles. A demonstration of SignalR scaling is provided. Follow up reading resources are listed at the end.
Alex Magnay - Azure Infrastructure as Code with Hashicorp TerraformWinOps Conf
This document summarizes a presentation about using Terraform and Azure. The presentation introduces Infrastructure as Code and Terraform, shows how to manage Azure resources with Terraform, demonstrates the Terraform workflow, and discusses use cases for operations, security, and development teams. It also covers tips for using Terraform effectively and safely with Azure. Microsoft and Hashicorp have partnered to improve support for provisioning Azure services with Terraform.
This document contains an agenda for a presentation on Azure storage concepts. The agenda includes discussing storage accounts, containers, blobs, and redundancy options. It also outlines demonstrating how to create a storage account and container in Azure and using the Azure Storage Explorer tool. The presentation will cover key Azure storage concepts and provide a live demo.
- The document discusses using CircleCI for DataOps workflows, including building pipelines for data preparation, ingestion, and portal development.
- Key aspects of the pipelines include using Terraform for infrastructure as code, Docker/ECR for containerization, and CircleCI for continuous integration and delivery.
- Challenges include getting approval from Dev, Ops, and security teams, and choosing the right tools for infrastructure definition, secrets management, and deployment.
The document discusses visual analysis using Google Cloud Platform. It provides an overview of Google Cloud services including App Engine, Container Engine, Compute Engine, Datastore, Cloud SQL, and Spanner for building and deploying applications at scale. It also mentions Machine Learning services for tasks like natural language processing, image analysis, and translation. The presentation then demonstrates a photo sharing application built on these services and discusses ways to enhance it further using App Engine Flex, video processing, document parsing, BigQuery, and analytics. It concludes by inviting Python developers interested in visual analysis to discuss job opportunities.
Rik Hepworth - ARM Yourself for Effective Azure ProvisioningWinOps Conf
Azure Resource Manager templates are a crucial part of your journey to the cloud. Learn the essentials of template creation and maintenance, with some examples of how to deal with complex deployments and manage the PaaS services that born in the cloud apps need.
This document discusses data storage approaches for AngularJS applications from basic to advanced. It introduces a data storage maturity model that progresses from 0) data dump to 1) structured storage, 2) CQRS (Command Query Responsibility Segregation), and finally 3) event sourcing as the most advanced approach. Event sourcing stores all changes to data as a sequence of events and uses these events to maintain and query projections of current data states. The document encourages providing feedback on the session through a QR code and promotes joining the Microsoft Virtual Academy for free online IT training.
WordCamp IL 2016 - WordPress Scale on AWSBoaz Ziniman
One of the most popular CMS, WordPress, was not designed for the cloud era. Running a high demand and highly available WordPress in a cluster can be a complex task.
There are several solutions to this problem and this session will focus on one of them. Using several AWS services (EC2, RDS, S3, EFS, CloudFormation and others) and Zend Server, we will create a complex setup running in minutes and scale it up and down by demand.
Ryan Armstrong - Monitoring More Than 6000 Devices in Zabbix | ZabConf2016Zabbix
Ryan will describe a Skunkworks project executed by Kinetic IT at the Department of Education to deliver an autonomous infrastructure monitoring solution for over 6000 devices distributed across WA. The team were given opportunity to experiment with DevOps practices such as Scrum product development, Infrastructure As Code and Continuous Integration to determine where the value lay and which practices should be adopted at greater scale.
Developing for Your Target Market - Social, Games & Mobile - AWS India Summit...Amazon Web Services
This document provides best practices for developing applications targeted at social, games, and mobile markets on AWS. It recommends offloading static content, caching at the edge, following DRY principles, load balancing from the start, using auto scaling appropriately, leveraging database services smartly, A/B testing, and using multiple availability zones, RDS replicas and slaves, auto-scaling groups, Elastic Load Balancing, and CloudFront and Route53 for edge services. The document stresses that following these practices can significantly reduce costs while improving performance, reliability, and the ability to scale to millions of users with only a few engineers.
This document provides an introduction and overview of Azure cloud services. It discusses why organizations choose the cloud over traditional on-premise infrastructure, highlighting benefits like reduced costs, automatic scaling, and global availability. It then outlines several key Azure services for compute, data, applications, and networking, including WebRoles, SQL Database, caching, storage, and virtual networks. The document uses examples to show how Azure provides these services at a lower cost than comparable AWS offerings.
RightScale User Conference: Why RightScale?Erik Osterman
RightScale provides a framework for operations that standardizes infrastructure management and allows operations to evolve alongside engineering. It treats infrastructure like software development with reusable components, simplifying operations and reducing technical debt. This framework allows organizations to build infrastructure consistently across clouds, commoditize resources, and empower engineers to take on operational roles through a modern DevOps approach.
The document discusses using Golang for serverless applications. It introduces serverless computing and why Golang is a good choice. Benefits of Golang include its simplicity with only requiring a single binary output and no dependencies. The document demonstrates building a serverless REST API with Golang and AWS Lambda, and addresses enhancing Lambda with provisioned concurrency. It concludes with references for further information.
Author: Dmitry Podrezov, www.easbacntech.com
This deck showcases what's new and what's been trimmed in the upcoming version of ASP.NET framework scheduled for release this summer. The framework was built from ground-up for multiple platforms and those trying to migrate existing solutions into it will need to be ready for a few breaking changes. This is not a 101 description the framework fundamentals, rather it is a demo of new features and changes. The talk is packed with demonstrations and live code experience.
This document provides an overview of moving from .NET development to Node.js development. It discusses why Node.js is popular, including being platform independent, scalable, faster, and lightweight. It then covers setting up a Node.js development environment, building a sample web application with Express, interacting with databases like MySQL, and testing and debugging Node.js applications. The objectives are to introduce Node.js concepts, show how to create a basic application, and discuss Node.js maintenance activities like testing and debugging.
RavenDB is a .NET document database that is fast and scalable. It has a .NET client and HTTP client via a REST API. RavenDB can be run as a console application, Windows service, embedded or in IIS. It uses lightweight document sessions for transactions and ID handling. RavenDB is designed to be stable through features like limiting results to 128 by default and batching operations in a session. Indexes in RavenDB support mapping, reducing, transforming and paging data.
Beyond Heroku: Hosting Your Rails App Yourselfstcarpenter
This document discusses hosting a Rails application yourself as an alternative to Heroku. It recommends using Unicorn as the application server, nginx as a reverse proxy, and deploying with Capistrano. Affordable hosting options mentioned include Amazon, Windows Azure, Digital Ocean, and Linode. Configuration management software and the features of Unicorn, nginx, and Capistrano are also outlined.
1) The document discusses different technology stacks and hosting options for websites, including LAMP (Linux, Apache, MySQL, PHP), LEMP (Linux, Nginx, Percona, PHP-FPM, Exim), dedicated servers, and cloud servers.
2) It provides an overview of components in the LEMP stack such as Nginx, Percona, and PHP-FPM, noting their advantages over traditional components like Apache and MySQL, including increased performance.
3) The document emphasizes the importance of choosing the right hosting solution based on the needs and merits of the specific website, considering factors like cost, reliability, performance, flexibility, and administration.
This document summarizes new features in Adobe CQ 5.5, including improved integration with Creative Suite for rich media management, enhancements to the authoring and developer experiences, and support for mobile applications and e-commerce. It highlights capabilities like editing rich media directly in Creative Suite and leveraging the cloud for asset transformations and delivery. The document also lists next steps like downloading a free CRX developer edition.
UK Azure User Group - Blazor and Azure (Tim Ebenezer)Richard Conway
This document summarizes a presentation on using Blazor and Azure in an enterprise environment. It begins with an introduction to Blazor, explaining that it is a front end framework that can run on the client or server using C# and interacts with Azure services. It then compares Blazor to JavaScript frameworks. An example high level Blazor and Azure architecture is shown. Key considerations for deploying Blazor at scale in an enterprise are discussed, including scaling the SignalR service, handling large file uploads, logging to Application Insights, and page lifecycles. A demonstration of SignalR scaling is provided. Follow up reading resources are listed at the end.
Alex Magnay - Azure Infrastructure as Code with Hashicorp TerraformWinOps Conf
This document summarizes a presentation about using Terraform and Azure. The presentation introduces Infrastructure as Code and Terraform, shows how to manage Azure resources with Terraform, demonstrates the Terraform workflow, and discusses use cases for operations, security, and development teams. It also covers tips for using Terraform effectively and safely with Azure. Microsoft and Hashicorp have partnered to improve support for provisioning Azure services with Terraform.
This document contains an agenda for a presentation on Azure storage concepts. The agenda includes discussing storage accounts, containers, blobs, and redundancy options. It also outlines demonstrating how to create a storage account and container in Azure and using the Azure Storage Explorer tool. The presentation will cover key Azure storage concepts and provide a live demo.
- The document discusses using CircleCI for DataOps workflows, including building pipelines for data preparation, ingestion, and portal development.
- Key aspects of the pipelines include using Terraform for infrastructure as code, Docker/ECR for containerization, and CircleCI for continuous integration and delivery.
- Challenges include getting approval from Dev, Ops, and security teams, and choosing the right tools for infrastructure definition, secrets management, and deployment.
The document discusses visual analysis using Google Cloud Platform. It provides an overview of Google Cloud services including App Engine, Container Engine, Compute Engine, Datastore, Cloud SQL, and Spanner for building and deploying applications at scale. It also mentions Machine Learning services for tasks like natural language processing, image analysis, and translation. The presentation then demonstrates a photo sharing application built on these services and discusses ways to enhance it further using App Engine Flex, video processing, document parsing, BigQuery, and analytics. It concludes by inviting Python developers interested in visual analysis to discuss job opportunities.
This document provides an overview of Azure Storage services including Blob Storage, CDN, Drive Storage, Queue Storage, Table Storage, and File Storage. It discusses key concepts such as containers, accounts, and storage artifacts. Specific services covered in more detail include Blob Storage (block blobs, page blobs, operations), Tables (entities, partitions, queries), and Drives (durability, mounting page blobs). Performance tests demonstrate benefits of multi-threaded uploads, copy operations, and batch operations versus single operations for Blobs and Tables.
Tokyo Azure Meetup #7 - Introduction to Serverless Architectures with Azure F...Tokyo Azure Meetup
Serverless architecture is the next big shift in computing - completely abstracting the underlying infrastructure and focusing 100% on the business logic.
Today we can create applications directly in our browser and leave the decision how they are hosted and scaled to the cloud provider. Moreover, this approach give us incredible control over the granularity of our applications since most of the time we are dealing with single function at a time.
In this presentation we will cover:
• Introduce Serverless Architectures
• Talk about the advantages of Serverless Architectures
• Discuss in details in event-driven computing
• Cover common Serverless approaches
• See practical applications with Azure Functions
• Compare AWS Lambda and Azure Functions
• Talk about open source alternatives
• Explore the relation between Microservices and Serverless Architectures
This talk will cover lessons learned at Community Engine regarding MongoDB, including: why we moved away from an Hybrid solution using SQL and MongoDB; an outline of the technologies and what we learned using MongoDB on Amazon Web Services; the MongoDB C# driver; MongoDB with SOLR for Full Text Search; how we do migration, deployment and more.
A Case Study of NoSQL Adoption: What Drove Wordnik Non-Relational?DATAVERSITY
Wordnik migrated from a MySQL relational database to the non-relational MongoDB database for 5 key reasons: speed, stability, scaling, simplicity, and fitting their object model better. They tested MongoDB extensively, iteratively improving their data mapping and access patterns. The migration was done without downtime by switching between the databases. While inserts were much faster in MongoDB, updates could be slow due to disk I/O. Wordnik addressed this through optimizations like pre-fetching on updates and moving to local storage. Overall, MongoDB was a better fit for Wordnik's large and evolving datasets.
Changing a few settings in IIS, optimizing HTML, CSS and JavaScript layout, and applying simple C# rules can lead to increased ASP.NET website performance. Tools like Chrome Developer Tools, YSlow, Google PageSpeed Insights and Fiddler can help optimize aspects like compression, caching, headers and static/dynamic content. Optimizing content delivery includes techniques like putting CSS at the top, JavaScript at the bottom, bundling/minification, using CDNs and removing etags.
A quick overview of AWS Kinesis: What is Kinesis, what problems does Kinesis solve, and how might you integrate Kinesis with an existing data warehouse.
This document discusses video streaming using cloud computing. It introduces VideoPublishing, a SaaS media platform built on AWS for content management, on-demand/live content delivery through a customizable API. It describes core concepts like high availability, scalability, and fault tolerance. Core services include an API, conversion service, content delivery, asset storage, and administration console. The architecture diagram and scalability issues are presented. Cloud benefits include no infrastructure costs and pay-as-you-go pricing. Information on Zitec, the company behind VideoPublishing, is provided.
Diễn giả: Nguyễn Minh Quý - DKT
Caching là một cơ chế không thể thiếu trong các kiến trúc website hiệu năng cao. Hãy đến tham dự và cùng tìm hiểu cách thức xây dựng kiến trúc cache cho BizWeb - nền tảng bán hàng trực tuyến có số lượng người dùng lớn nhất Việt Nam:
1. Giới thiệu Bizweb Model
2. Mô hình microservices Bizweb sử dụng
3. Frontend caching
4. API caching
5. Assets caching
6. Content delivery network
5 Common Mistakes You are Making on your WebsiteAcquia
The document discusses common mistakes that are often found during website audits. It covers 5 categories: content architecture, display architecture, site architecture, security, and performance. Some examples of mistakes mentioned include having similar content types, not reusing fields, extra modules installed that are not useful, reinventing functionality that Drupal already provides well, outdated core/contrib modules, and complex queries without indexes. The document provides best practices for each category such as planning content architecture ahead of time, separating logic from presentation, using the right hooks for custom modules, keeping software updated, and optimizing databases before caching. It emphasizes the importance of testing, environments, and maintenance for the website lifecycle.
For people who start to create a cloud service, it’s really important to know how to create a scalable cloud service to fit the growth of the future workloads. In this session, we will introduce how to design a scalable cloud service including AWS services introduction and best practices.
- Azure Data Lake makes big data easy to manage, debug, and optimize through services like Azure Data Lake Store and Azure Data Lake Analytics.
- Azure Data Lake Store provides a hyper-scale data lake that allows storing any data in its native format at unlimited scale. Azure Data Lake Analytics allows running distributed queries and analytics jobs on data stored in Data Lake Store.
- Azure Data Lake is based on open source technologies like Apache Hadoop, YARN, and provides a managed service with auto-scaling and a pay-per-use model through the Azure portal and tools like Visual Studio.
The document discusses DevOps workflow with Docker on AWS. It describes using Docker to isolate application environments, increasing team productivity and decreasing development team size. Key elements include using Gitlab for source control and CI/CD, building Docker images via Gitlab runners, and deploying to Kubernetes clusters. The workflow allows writing applications once and running them anywhere and forever through continuous integration and delivery of Docker images to private container registries on AWS.
AWS re:Invent 2016: Scaling Up to Your First 10 Million Users (ARC201)Amazon Web Services
Cloud computing gives you a number of advantages, such as the ability to scale your web application or website on demand. If you have a new web application and want to use cloud computing, you might be asking yourself, "Where do I start?" Join us in this session to understand best practices for scaling your resources from zero to millions of users. We show you how to best combine different AWS services, how to make smarter decisions for architecting your application, and how to scale your infrastructure in the cloud.
Valkuilen en successen binnen een implementatie van Office 365, SharePoint, Exchange en Lync Online in de Cloud. 4000 seats binnen Zorg - Health. Intramurele en extramurele medewerkers hebben samen een digitale werkomgeving. Het Nieuwe Werken voor een thuiszorginstelling.
The document discusses migrating a fast scaling system from physical servers to AWS. It outlines the agenda which includes an overview of physical systems and virtualization, the Topica Edumall system design, applying DevOps practices, and a Q&A. The Topica Edumall hybrid system is described as using VPS, physical servers, and AWS for core video streaming. Benefits of migrating the auto-scaling system to Docker and Kubernetes on AWS include high availability, easy scaling, auto-healing, and saving 40% costs with full utilization of AWS services. DevOps practices like CI/CD workflows are also discussed.
The document summarizes the development history of Urbanesia through multiple iterations. It describes improvements made to the technical architecture and infrastructure in each iteration, including moving to NoSQL databases, separating backend and frontend applications, improving caching, and focusing on asynchronous processing. It also discusses lessons learned around prioritizing users over technology, optimization techniques, and challenges in building out new features and scaling the system.
This document discusses LinkedIn's use of Couchbase as an in-memory data store. It describes how LinkedIn has grown to rely heavily on Couchbase, now running it in production, staging, and corporate environments. It also outlines some of the key use cases Couchbase supports at LinkedIn, such as serving as a read-through cache, storing counters, and acting as a source of truth datastore for some internal tools. Finally, it discusses the operational tooling and processes LinkedIn has developed to support Couchbase at scale.
Similar to PHP Silex and Microsoft Azure @ThankYouMotion (20)
Aujourd'hui, les entreprises se doivent d'être digitales. Certaines le sont depuis leurs créations, d'autres doivent se transformer et se digitaliser. Le rôle des Directions Techniques ou Direction des Systèmes d'Informations se renforce et devient de plus en plus central aux activités de l'entreprise. La collaboration entre les différentes cultures très techniques d'une part et très commercial/marketing/financières/... d'autre part doit faire partie du quotidien de chacun
Les directions "non techniques" nous rangent souvent dans la catégorie "geek" (sans trop savoir ce que cela veut dire), ne cherchent pas à nous comprendre, comprendre nos problématiques. On nous demande de tout faire pour avant-hier et surtout de lire entre les lignes de leurs cahiers des charges.
Il devient vital - pour nous développeurs, ingénieurs, admin sys, chefs de projets et bien d'autres - de mieux comprendre quelles sont leurs cultures et leurs objectifs afin de mieux échanger et communiquer avec eux, et ainsi contribuer à la réussite des projets et de l'entreprise
Industrialisation des environnements de dev avec Puppet et Amazon (mais en fa...Nicolas Silberman
Retour d'experience du Groupe Express Roularta sur l'intégration de Puppet (mais finalement Chef) dans leur système d'information, permettant en quelques cliques et quelques minutes de mettre en place une ou plusieurs machines de développement parfaitement fonctionnelle et à jour, le tout hébergé sur le cloud Amazon.
Le Devops est un terme émergent qui décrit un ensemble de méthode et pratiques pour favoriser la collaboration et la communication entre les équipes de développement logiciel et les équipes d’exploitation. Il est une réponse au besoin des acteurs du Web qui, face à une course effreinée à la fonctionnalité et l’explosion de leur trafic, ont du modifier leurs méthodes et rassembler l’ensemble des protagonistes pour minimiser l’impact de l’applicatif sur l’infrastructure et maitriser les coûts ou améliorer la performance. Nous verons dans cette conférence comment ces différentes équipes peuvent avancer ensemble en gardant une relation de partenaire plutôt que de client/prestataire
PHP est aujourd’hui la plate-forme de développement web la plus populaire au monde avec plus de 25 millions de sites web et près de 5 millions de développeurs dans le monde.
Découvrez les solutions stratégiques et techniques de PHP qui permettent aux décideurs d'industrialiser les développements de nouvelle génération.
Comment a-t-elle été créée, comment a-t-elle évolué ?
PHP en entreprise, comment tout un écosystème s'est professionnalisé ?
Est-elle adaptée à tous les types de projets ?
Quels outils et solutions pour industrialiser PHP ?
En France PHP est un exemple de réussite du modèle OpenSource avec un large écosystème professionnel où les associations telles que l'AFUP servent « d'interface » avec le monde professionnel.
Retour d'experience de 20minutes.fr autours des problématiques de développement, de tenue de la charge, de l'infrastructure, du cache, de mise en production,...
Infrastructure Challenges in Scaling RAG with Custom AI modelsZilliz
Building Retrieval-Augmented Generation (RAG) systems with open-source and custom AI models is a complex task. This talk explores the challenges in productionizing RAG systems, including retrieval performance, response synthesis, and evaluation. We’ll discuss how to leverage open-source models like text embeddings, language models, and custom fine-tuned models to enhance RAG performance. Additionally, we’ll cover how BentoML can help orchestrate and scale these AI components efficiently, ensuring seamless deployment and management of RAG systems in the cloud.
Threats to mobile devices are more prevalent and increasing in scope and complexity. Users of mobile devices desire to take full advantage of the features
available on those devices, but many of the features provide convenience and capability but sacrifice security. This best practices guide outlines steps the users can take to better protect personal devices and information.
Fueling AI with Great Data with Airbyte WebinarZilliz
This talk will focus on how to collect data from a variety of sources, leveraging this data for RAG and other GenAI use cases, and finally charting your course to productionalization.
Taking AI to the Next Level in Manufacturing.pdfssuserfac0301
Read Taking AI to the Next Level in Manufacturing to gain insights on AI adoption in the manufacturing industry, such as:
1. How quickly AI is being implemented in manufacturing.
2. Which barriers stand in the way of AI adoption.
3. How data quality and governance form the backbone of AI.
4. Organizational processes and structures that may inhibit effective AI adoption.
6. Ideas and approaches to help build your organization's AI strategy.
Things to Consider When Choosing a Website Developer for your Website | FODUUFODUU
Choosing the right website developer is crucial for your business. This article covers essential factors to consider, including experience, portfolio, technical skills, communication, pricing, reputation & reviews, cost and budget considerations and post-launch support. Make an informed decision to ensure your website meets your business goals.
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slackshyamraj55
Discover the seamless integration of RPA (Robotic Process Automation), COMPOSER, and APM with AWS IDP enhanced with Slack notifications. Explore how these technologies converge to streamline workflows, optimize performance, and ensure secure access, all while leveraging the power of AWS IDP and real-time communication via Slack notifications.
Your One-Stop Shop for Python Success: Top 10 US Python Development Providersakankshawande
Simplify your search for a reliable Python development partner! This list presents the top 10 trusted US providers offering comprehensive Python development services, ensuring your project's success from conception to completion.
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc
How does your privacy program stack up against your peers? What challenges are privacy teams tackling and prioritizing in 2024?
In the fifth annual Global Privacy Benchmarks Survey, we asked over 1,800 global privacy professionals and business executives to share their perspectives on the current state of privacy inside and outside of their organizations. This year’s report focused on emerging areas of importance for privacy and compliance professionals, including considerations and implications of Artificial Intelligence (AI) technologies, building brand trust, and different approaches for achieving higher privacy competence scores.
See how organizational priorities and strategic approaches to data security and privacy are evolving around the globe.
This webinar will review:
- The top 10 privacy insights from the fifth annual Global Privacy Benchmarks Survey
- The top challenges for privacy leaders, practitioners, and organizations in 2024
- Key themes to consider in developing and maintaining your privacy program
Essentials of Automations: The Art of Triggers and Actions in FMESafe Software
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
Best 20 SEO Techniques To Improve Website Visibility In SERPPixlogix Infotech
Boost your website's visibility with proven SEO techniques! Our latest blog dives into essential strategies to enhance your online presence, increase traffic, and rank higher on search engines. From keyword optimization to quality content creation, learn how to make your site stand out in the crowded digital landscape. Discover actionable tips and expert insights to elevate your SEO game.
Removing Uninteresting Bytes in Software FuzzingAftab Hussain
Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process.
In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds.
- These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.
CAKE: Sharing Slices of Confidential Data on BlockchainClaudio Di Ciccio
Presented at the CAiSE 2024 Forum, Intelligent Information Systems, June 6th, Limassol, Cyprus.
Synopsis: Cooperative information systems typically involve various entities in a collaborative process within a distributed environment. Blockchain technology offers a mechanism for automating such processes, even when only partial trust exists among participants. The data stored on the blockchain is replicated across all nodes in the network, ensuring accessibility to all participants. While this aspect facilitates traceability, integrity, and persistence, it poses challenges for adopting public blockchains in enterprise settings due to confidentiality issues. In this paper, we present a software tool named Control Access via Key Encryption (CAKE), designed to ensure data confidentiality in scenarios involving public blockchains. After outlining its core components and functionalities, we showcase the application of CAKE in the context of a real-world cyber-security project within the logistics domain.
Paper: https://doi.org/10.1007/978-3-031-61000-4_16
In his public lecture, Christian Timmerer provides insights into the fascinating history of video streaming, starting from its humble beginnings before YouTube to the groundbreaking technologies that now dominate platforms like Netflix and ORF ON. Timmerer also presents provocative contributions of his own that have significantly influenced the industry. He concludes by looking at future challenges and invites the audience to join in a discussion.
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUpanagenda
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-und-domino-lizenzkostenreduzierung-in-der-welt-von-dlau/
DLAU und die Lizenzen nach dem CCB- und CCX-Modell sind für viele in der HCL-Community seit letztem Jahr ein heißes Thema. Als Notes- oder Domino-Kunde haben Sie vielleicht mit unerwartet hohen Benutzerzahlen und Lizenzgebühren zu kämpfen. Sie fragen sich vielleicht, wie diese neue Art der Lizenzierung funktioniert und welchen Nutzen sie Ihnen bringt. Vor allem wollen Sie sicherlich Ihr Budget einhalten und Kosten sparen, wo immer möglich. Das verstehen wir und wir möchten Ihnen dabei helfen!
Wir erklären Ihnen, wie Sie häufige Konfigurationsprobleme lösen können, die dazu führen können, dass mehr Benutzer gezählt werden als nötig, und wie Sie überflüssige oder ungenutzte Konten identifizieren und entfernen können, um Geld zu sparen. Es gibt auch einige Ansätze, die zu unnötigen Ausgaben führen können, z. B. wenn ein Personendokument anstelle eines Mail-Ins für geteilte Mailboxen verwendet wird. Wir zeigen Ihnen solche Fälle und deren Lösungen. Und natürlich erklären wir Ihnen das neue Lizenzmodell.
Nehmen Sie an diesem Webinar teil, bei dem HCL-Ambassador Marc Thomas und Gastredner Franz Walder Ihnen diese neue Welt näherbringen. Es vermittelt Ihnen die Tools und das Know-how, um den Überblick zu bewahren. Sie werden in der Lage sein, Ihre Kosten durch eine optimierte Domino-Konfiguration zu reduzieren und auch in Zukunft gering zu halten.
Diese Themen werden behandelt
- Reduzierung der Lizenzkosten durch Auffinden und Beheben von Fehlkonfigurationen und überflüssigen Konten
- Wie funktionieren CCB- und CCX-Lizenzen wirklich?
- Verstehen des DLAU-Tools und wie man es am besten nutzt
- Tipps für häufige Problembereiche, wie z. B. Team-Postfächer, Funktions-/Testbenutzer usw.
- Praxisbeispiele und Best Practices zum sofortigen Umsetzen
Unlocking Productivity: Leveraging the Potential of Copilot in Microsoft 365, a presentation by Christoforos Vlachos, Senior Solutions Manager – Modern Workplace, Uni Systems
7. first install
• Time To First Byte (PHP) : 3 to 5 seconds !
• Slooooooooooooooow !!
8. improvements
• Cache
• OPCode cache with wincache for PHP 5.5
• Twig Cache (with auto_reload)
• HttpCacheServiceProvider, no need for ESI
• Cache-control headers !
• IIS cache for generated thumbnails