This document provides an overview of Microsoft's Azure cloud computing platform, including its core services like Web and Worker Roles, Storage, and SQL Data Services. It discusses how Azure provides a scalable platform as a service (PaaS) for building and hosting applications in the cloud using Microsoft's programming languages and tools. It also provides examples of how to structure applications and store data using Azure's queue-based messaging and non-relational storage services.
The document provides an overview of cloud computing concepts like running and storing applications and data in the cloud. It discusses key cloud services from Amazon and Microsoft including Amazon S3, EC2, Windows Azure, and SQL Data Services. It also summarizes how to develop, deploy, and scale applications on the Windows Azure platform, including using queues to decouple processing and web roles to handle requests. Storage options like blobs, tables, and queues are introduced along with their scalability, availability and programming interfaces.
This document provides information about Microsoft's SQL Data Services (SDS), a relational database service running in the cloud. The summary discusses the key points:
- SDS will provide a highly scalable and available relational data store in the cloud, accessible using familiar SQL Server tools and APIs.
- Initially, SDS will support core SQL Server capabilities but future versions may include additional data platform capabilities.
- SDS uses a symmetrical programming model designed to provide a consistent experience whether using the database on-premises or in the cloud.
- Microsoft is currently working towards commercial availability of SDS integrated with the Windows Azure platform in 2009.
Unlocking the Value of your Data Featuring AWS Enterprise Use CasesAmazon Web Services
This document provides an overview of how organizations can unlock the value of their data using Amazon Web Services (AWS). It discusses the information processing cycle of input, storage, process, and output and how AWS services can be applied at each stage. Examples are given of how customers have used AWS for disaster recovery, analytics, workflow orchestration, search, and content distribution. The conclusion emphasizes that AWS reference architectures and components like S3, EC2, and DynamoDB allow customers to focus on their applications rather than infrastructure maintenance.
Public Cloud Platforms for .NET DevelopersSvetlin Nakov
Public clouds platforms are rapidly growing and many businesses move partially or fully their IT infrastructure to the cloud. The big players like Microsoft, Google, Oracle and Amazon operate their own public cloud platforms while the smaller players provide cloud services and PaaS platforms and on top of the larger. What about the .NET developers and the cloud?
In this talk the speaker Svetlin Nakov introduces the public .NET clouds and compares the leading .NET PaaS clouds: Windows Azure, AppHarbor, Uhuru and AWS Elastic Beanstalk for .NET. The .NET public clouds are compared in terms of architecture, programming model, pricing, development stack, available services, deployment model and tools for administration and monitoring. A live demo shows how to deploy and run a typical .NET application (based on ASP.NET MVC and MS SQL Server) in AppHarbor and Uhuru.
Table of contents:
- Public Cloud Platforms
- Typical Cloud Architecture
- Public .NET Cloud Platforms
- Cloud Types: IaaS vs. PaaS
- Windows Azure
- Amazon AWS (+ Beanstalk for .NET)
- AppHarbor
- Uhuru
- Choosing a .NET Cloud
The presentation was delivered at DevReach 2012 (www.devreach.com) by Svetlin Nakov (www.nakov.com) in Sofiа on 4 October 2012.
YouTube video for this presentation: http://youtu.be/H2Jjiu8VyCk
This document summarizes new features in SQL Server 2008 for developers. It covers new data types like spatial, XML, and CLR types as well as features like table valued parameters, change tracking, and ADO.NET Entity Framework support. It also discusses enhancements to Integration Services, reporting services, and the core SQL Server engine.
This document discusses platform-as-a-service (PaaS) using Microsoft Windows Azure. It covers transaction processing and availability on Azure. Key topics include Azure storage options like queues, relational databases, blobs and tables. The document also discusses the benefits of PaaS over infrastructure-as-a-service, including less maintenance costs, security and flexibility. It provides an overview of roles in Azure applications and how to improve availability through techniques like monitoring, fault domains and multiple instances.
The document discusses a content repository, which is a generic API for content storage that provides CRUD functionality as well as versioning, transactions, and search capabilities. It describes how a content repository enforces simplicity, encourages standardization, and improves scalability. Examples of content repository implementations are provided, including Apache Jackrabbit and eXo Platform. Key features of content repositories are explored such as the content model, repository structure with workspaces and nodes/properties, and node type definitions.
The document provides an overview of cloud computing concepts like running and storing applications and data in the cloud. It discusses key cloud services from Amazon and Microsoft including Amazon S3, EC2, Windows Azure, and SQL Data Services. It also summarizes how to develop, deploy, and scale applications on the Windows Azure platform, including using queues to decouple processing and web roles to handle requests. Storage options like blobs, tables, and queues are introduced along with their scalability, availability and programming interfaces.
This document provides information about Microsoft's SQL Data Services (SDS), a relational database service running in the cloud. The summary discusses the key points:
- SDS will provide a highly scalable and available relational data store in the cloud, accessible using familiar SQL Server tools and APIs.
- Initially, SDS will support core SQL Server capabilities but future versions may include additional data platform capabilities.
- SDS uses a symmetrical programming model designed to provide a consistent experience whether using the database on-premises or in the cloud.
- Microsoft is currently working towards commercial availability of SDS integrated with the Windows Azure platform in 2009.
Unlocking the Value of your Data Featuring AWS Enterprise Use CasesAmazon Web Services
This document provides an overview of how organizations can unlock the value of their data using Amazon Web Services (AWS). It discusses the information processing cycle of input, storage, process, and output and how AWS services can be applied at each stage. Examples are given of how customers have used AWS for disaster recovery, analytics, workflow orchestration, search, and content distribution. The conclusion emphasizes that AWS reference architectures and components like S3, EC2, and DynamoDB allow customers to focus on their applications rather than infrastructure maintenance.
Public Cloud Platforms for .NET DevelopersSvetlin Nakov
Public clouds platforms are rapidly growing and many businesses move partially or fully their IT infrastructure to the cloud. The big players like Microsoft, Google, Oracle and Amazon operate their own public cloud platforms while the smaller players provide cloud services and PaaS platforms and on top of the larger. What about the .NET developers and the cloud?
In this talk the speaker Svetlin Nakov introduces the public .NET clouds and compares the leading .NET PaaS clouds: Windows Azure, AppHarbor, Uhuru and AWS Elastic Beanstalk for .NET. The .NET public clouds are compared in terms of architecture, programming model, pricing, development stack, available services, deployment model and tools for administration and monitoring. A live demo shows how to deploy and run a typical .NET application (based on ASP.NET MVC and MS SQL Server) in AppHarbor and Uhuru.
Table of contents:
- Public Cloud Platforms
- Typical Cloud Architecture
- Public .NET Cloud Platforms
- Cloud Types: IaaS vs. PaaS
- Windows Azure
- Amazon AWS (+ Beanstalk for .NET)
- AppHarbor
- Uhuru
- Choosing a .NET Cloud
The presentation was delivered at DevReach 2012 (www.devreach.com) by Svetlin Nakov (www.nakov.com) in Sofiа on 4 October 2012.
YouTube video for this presentation: http://youtu.be/H2Jjiu8VyCk
This document summarizes new features in SQL Server 2008 for developers. It covers new data types like spatial, XML, and CLR types as well as features like table valued parameters, change tracking, and ADO.NET Entity Framework support. It also discusses enhancements to Integration Services, reporting services, and the core SQL Server engine.
This document discusses platform-as-a-service (PaaS) using Microsoft Windows Azure. It covers transaction processing and availability on Azure. Key topics include Azure storage options like queues, relational databases, blobs and tables. The document also discusses the benefits of PaaS over infrastructure-as-a-service, including less maintenance costs, security and flexibility. It provides an overview of roles in Azure applications and how to improve availability through techniques like monitoring, fault domains and multiple instances.
The document discusses a content repository, which is a generic API for content storage that provides CRUD functionality as well as versioning, transactions, and search capabilities. It describes how a content repository enforces simplicity, encourages standardization, and improves scalability. Examples of content repository implementations are provided, including Apache Jackrabbit and eXo Platform. Key features of content repositories are explored such as the content model, repository structure with workspaces and nodes/properties, and node type definitions.
This document summarizes a presentation about using AWS Batch and AWS Step Functions for genomic analysis workflows. It discusses:
- AWS Batch for running containerized jobs on EC2 instances in a managed way. Jobs are run based on definitions, queues, and compute environments.
- AWS Step Functions for visualizing and coordinating the components of distributed applications using state machines and workflows.
- An example architecture using AWS Batch for the job execution layer and AWS Step Functions to orchestrate the workflow, providing flexibility, ease of deployment, and integration with non-Batch applications.
- Potential considerations for data sharing, multitenancy, and volume reuse when using AWS Batch for genomic analysis jobs.
This document provides an overview of data storage in the cloud using Windows Azure. It introduces cloud computing concepts and key characteristics like pay-per-use and elastic scaling. Windows Azure is presented as a platform for building and managing applications across Microsoft datacenters. Azure Storage is described as a scalable, durable cloud storage option that can be accessed from anywhere via REST APIs. Table storage concepts are explained, including entities, partitions, and queries. Tools for managing Azure resources like the Azure Portal and Azure Storage Explorer are also mentioned.
Scott Spangler has extensive technical skills and experience across many areas including Amazon Web Services, configuration management tools like Puppet and Chef, operating systems, protocols, programming languages, databases, application servers, datacenter infrastructure tools, system administration tools, hypervisors, hardware, storage, networking equipment and software. He has skills with tools from vendors such as Oracle, IBM, HP, Microsoft, Cisco, Juniper, Brocade, F5 and more.
JavaFX and Scala in the Cloud: Stephen Chinjaxconf
The document discusses using a cloud data architecture where the user's view of data is small to medium sized and mostly read-only. It notes advantages like offline operation, responsive performance, high availability and scalability at low cost. Specifically, it shows hosting 330KB of data for 1 million users would cost around $39 per month on Amazon S3.
Sharing data between different DBMS types is an inevitable need in Today's diverse IT environments. Need for real-time data integration, seamless migration and data warehousing are the main reasons driving demand for heterogenous replication. In this talk we'll review how open source Tungsten Replicator can replicate data in real-time between databases like MySQL, PostgreSQL, Oracle, MongoDB and others. Join us for this both technical and enlightening talk.
We'll cover fundamental steps behind configuring heterogeneous replication, the importance of transaction transforming filters and common challenges rising when replicating cross DBMS-type. We'll conclude with in-line demos to show you how it looks in action.
발표 영상 다시보기: https://kr-resources.awscloud.com/data-databases-and-analytics/%EC%A7%80%EA%B8%88-%EB%8B%B9%EC%9E%A5-dynamo-db-%ED%99%9C%EC%9A%A9%ED%95%98%EA%B8%B0-%EA%B0%95%EB%AF%BC%EC%84%9D-aws-database-modernization-day-%EC%98%A8%EB%9D%BC%EC%9D%B8-2
DynamoDB는 대량의 트래픽에 대해 빠른 응답시간을 보장하는 AWS의 NOSQL Database 서비스 입니다. 본 세션에서는 DynamoDB를 생성하고 테이블 디자인 후 데이터 입력, 삭제, 업데이트 및 성능에 관련된 설정에 대해서 진행합니다. 이 세션후 참석자들은 DyanmoDB에 대한 이해하며 직접 구성 및 사용할 수 있습니다.
This spring, the data warehouse team at Ancestry, flawlessly migrated and validated nearly half a trillion records from Actian Matrix to Amazon Redshift. During this session, the Ancestry team will describe how they orchestrated the entire migration in less than four months, the technical challenges they faced and overcame along the way, as well as share tips and tricks to break through common pitfalls of data warehouse migrations. They will also highlight how they tuned and optimized the Amazon Redshift environment, adopted Redshift Spectrum, and how they leverage their collaboration with Amazon to deliver a powerful customer experience.
This is a presentation I delivered at CodeMash 2.0.1.0 dealing with lessons learned while building an application for handling the post-processing of scientific data using the Windows Azure platform.
Amazon DynamoDB is a fully managed NoSQL database service for applications that need consistent, single-digit millisecond latency at any scale. This talk explores DynamoDB capabilities and benefits in detail and discusses how to get the most out of your DynamoDB database. We go over schema design best practices with DynamoDB across multiple use cases, including gaming, AdTech, IoT, and others. We also explore designing efficient indexes, scanning, and querying, and go into detail on a number of recently released features, including JSON document support, Streams, and more.
Raymond Gao gave a presentation on cloud computing at the 2010 IUT Cloud Computing Seminar. He began by introducing himself and his background. The presentation covered definitions of cloud computing, demonstrations of AWS services like EC2 and S3, trends in the industry and major players like Amazon and Google, and how universities can benefit from cloud computing services. Gao discussed concepts like elastic load balancing and auto scaling. He also demonstrated how to set up an AWS account and manage resources through the management console. The presentation provided an overview of cloud computing concepts and Amazon Web Services.
Scaling drupal horizontally and in cloudVladimir Ilic
Vancouver Drupal group presentation for April 25, 2013.
How to deploy Drupal on
- multiple web servers,
- multiple web and database servers, and
- how to join all that together and make site deployed on Amazon Cloud (Virtual Private Cloud) inside
- one availability zone
- multiple availability zones deployment.
Session cover details about what you need in order to get Drupal deployed on separate servers, what are issues/concerns, and how to solve them.
ScaleBase is a startup offering a database-as-a-service that provides unlimited database scalability and availability. It uses a Database Load Balancer to elastically scale any SQL database across multiple database instances in a shared-nothing architecture. This allows linear scaling of the database to meet increasing user demands and volumes of data while maintaining high availability.
Beyond the Query – Bringing Complex Access Patterns to NoSQL with DataStax - ...StampedeCon
Learn how to model beyond traditional direct access in Apache Cassandra. Utilizing the DataStax platform to harness the power of Spark and Solr to perform search, analytics, and complex operations in place on your Cassandra data!
Terracotta (an open source technology) provides a clustered, durable virtual heap. Terracotta's goal is to make Java apps scale with as little effort as possible. If you are using Hibernate, there are several patterns that can be used to leverage Terracotta and reduce the load on your database so your app can scale.
First, you can use the Terracotta clustered Hibernate cache. This is a high-performance clustered cache and allows you to avoid hitting the database on all nodes in your cluster. It's suitable, not just for read-only, but also for read-mostly and read-write use cases, which traditionally have not been viewed as good use cases for Hibernate second level cache.
Another high performance option is to disconnect your POJOs from their Hibernate session and manage them entirely in Terracotta shared heap instead. This is a great option for conversational data where the conversational data is not of long-term interest but must be persistent and highly-available. This pattern can significantly reduce your database load but does require more changes to your application than using second-level cache.
This talk will examine the basics of what Terracotta provides and examples of how you can scale your Hibernate application with both clustered second level cache and detached clustered state. Also, we'll take a look at Terracotta's Hibernate-specific monitoring tools.
The document discusses various hosting solutions for Drupal including web hosting, virtual private servers, dedicated servers, and Amazon EC2. It provides details on the costs, reliability, customization options, and maintenance requirements for each solution. Additionally, it covers some key terms and tools related to using Amazon EC2, such as instances, AMIs, EBS, S3 storage, the command line interface, and the ElasticFox browser plugin.
This document discusses using Apache Spark to perform analytics on Cassandra data. It provides an overview of Spark and how it can be used to query and aggregate Cassandra data through transformations and actions on resilient distributed datasets (RDDs). It also describes how to use the Spark Cassandra connector to load data from Cassandra into Spark and write data from Spark back to Cassandra.
AWS December 2015 Webinar Series - Amazon Aurora: Introduction and MigrationAmazon Web Services
Amazon Aurora is a MySQL-compatible database engine that combines the speed and availability of high-end commercial databases with the simplicity and cost-effectiveness of open source databases. Amazon Aurora is available through Amazon RDS as a fully managed database service.
This webinar introduces you to Amazon Aurora, explains common use cases for the service, and discusses methods to migrate your MySQL databases that are on Amazon RDS, Amazon EC2 or on-premises to Amazon Aurora.
Learning Objectives:
How Amazon Aurora is different and similar to traditional databases
Reliability and availability design in Aurora
How Amazon Aurora delivers up to 5x MySQL performance on similar hardware
Learn the scalability in Amazon Aurora: scaling instance size and database size, horizontal scaling with read replicas
Who Should Attend:
IT Managers, DBAs, Enterprise and Solution Architects , Devops Engineers and Developers
Introduction to Spark SQL and Catalyst / Spark SQLおよびCalalystの紹介scalaconfjp
SparkSQL is a Spark component that allows SQL queries to be executed on Spark. It uses Catalyst, which provides an execution planning framework for relational operations like SQL parsing, logical optimization, and physical planning. Catalyst defines logical and physical operators, expressions, data types and provides rule-based optimizations to transform query plans. The SQL core in SparkSQL builds SchemaRDDs to represent queries and allows reading/writing to Parquet and JSON formats.
Introducing the Embedded Rich Client Platform (eRCP) - Jim Robbins, IBMmfrancis
The document introduces eRCP (Embedded Rich Client Platform), which aims to investigate using Eclipse RCP components in embedded devices. It discusses that eRCP will provide a smaller deployment package for RCP apps to run on devices like phones and PDAs. Initial work will focus on adapting components like eSWT, Eclipse runtime, eJFace and eWorkbench for embedded use by reducing footprint, enhancing performance, and providing a targeted app model. IBM, Nokia, Motorola and others are involved in the project led by Jim Robbins. Deliverables include specifications and implementations of the adapted components with an initial focus on eSWT.
A Sensational Exposé With Bewildering DemonstrationsPeter Gasston
The document discusses HTML5 form validation constraints and APIs. It provides examples of how to add constraints like required fields, pattern matching, and value limits. It also demonstrates how to detect constraint validation support, check field and form validity, and access validation error messages through the validity API. The document is an introduction to HTML5 form validation features and constraints.
This document summarizes a presentation about using AWS Batch and AWS Step Functions for genomic analysis workflows. It discusses:
- AWS Batch for running containerized jobs on EC2 instances in a managed way. Jobs are run based on definitions, queues, and compute environments.
- AWS Step Functions for visualizing and coordinating the components of distributed applications using state machines and workflows.
- An example architecture using AWS Batch for the job execution layer and AWS Step Functions to orchestrate the workflow, providing flexibility, ease of deployment, and integration with non-Batch applications.
- Potential considerations for data sharing, multitenancy, and volume reuse when using AWS Batch for genomic analysis jobs.
This document provides an overview of data storage in the cloud using Windows Azure. It introduces cloud computing concepts and key characteristics like pay-per-use and elastic scaling. Windows Azure is presented as a platform for building and managing applications across Microsoft datacenters. Azure Storage is described as a scalable, durable cloud storage option that can be accessed from anywhere via REST APIs. Table storage concepts are explained, including entities, partitions, and queries. Tools for managing Azure resources like the Azure Portal and Azure Storage Explorer are also mentioned.
Scott Spangler has extensive technical skills and experience across many areas including Amazon Web Services, configuration management tools like Puppet and Chef, operating systems, protocols, programming languages, databases, application servers, datacenter infrastructure tools, system administration tools, hypervisors, hardware, storage, networking equipment and software. He has skills with tools from vendors such as Oracle, IBM, HP, Microsoft, Cisco, Juniper, Brocade, F5 and more.
JavaFX and Scala in the Cloud: Stephen Chinjaxconf
The document discusses using a cloud data architecture where the user's view of data is small to medium sized and mostly read-only. It notes advantages like offline operation, responsive performance, high availability and scalability at low cost. Specifically, it shows hosting 330KB of data for 1 million users would cost around $39 per month on Amazon S3.
Sharing data between different DBMS types is an inevitable need in Today's diverse IT environments. Need for real-time data integration, seamless migration and data warehousing are the main reasons driving demand for heterogenous replication. In this talk we'll review how open source Tungsten Replicator can replicate data in real-time between databases like MySQL, PostgreSQL, Oracle, MongoDB and others. Join us for this both technical and enlightening talk.
We'll cover fundamental steps behind configuring heterogeneous replication, the importance of transaction transforming filters and common challenges rising when replicating cross DBMS-type. We'll conclude with in-line demos to show you how it looks in action.
발표 영상 다시보기: https://kr-resources.awscloud.com/data-databases-and-analytics/%EC%A7%80%EA%B8%88-%EB%8B%B9%EC%9E%A5-dynamo-db-%ED%99%9C%EC%9A%A9%ED%95%98%EA%B8%B0-%EA%B0%95%EB%AF%BC%EC%84%9D-aws-database-modernization-day-%EC%98%A8%EB%9D%BC%EC%9D%B8-2
DynamoDB는 대량의 트래픽에 대해 빠른 응답시간을 보장하는 AWS의 NOSQL Database 서비스 입니다. 본 세션에서는 DynamoDB를 생성하고 테이블 디자인 후 데이터 입력, 삭제, 업데이트 및 성능에 관련된 설정에 대해서 진행합니다. 이 세션후 참석자들은 DyanmoDB에 대한 이해하며 직접 구성 및 사용할 수 있습니다.
This spring, the data warehouse team at Ancestry, flawlessly migrated and validated nearly half a trillion records from Actian Matrix to Amazon Redshift. During this session, the Ancestry team will describe how they orchestrated the entire migration in less than four months, the technical challenges they faced and overcame along the way, as well as share tips and tricks to break through common pitfalls of data warehouse migrations. They will also highlight how they tuned and optimized the Amazon Redshift environment, adopted Redshift Spectrum, and how they leverage their collaboration with Amazon to deliver a powerful customer experience.
This is a presentation I delivered at CodeMash 2.0.1.0 dealing with lessons learned while building an application for handling the post-processing of scientific data using the Windows Azure platform.
Amazon DynamoDB is a fully managed NoSQL database service for applications that need consistent, single-digit millisecond latency at any scale. This talk explores DynamoDB capabilities and benefits in detail and discusses how to get the most out of your DynamoDB database. We go over schema design best practices with DynamoDB across multiple use cases, including gaming, AdTech, IoT, and others. We also explore designing efficient indexes, scanning, and querying, and go into detail on a number of recently released features, including JSON document support, Streams, and more.
Raymond Gao gave a presentation on cloud computing at the 2010 IUT Cloud Computing Seminar. He began by introducing himself and his background. The presentation covered definitions of cloud computing, demonstrations of AWS services like EC2 and S3, trends in the industry and major players like Amazon and Google, and how universities can benefit from cloud computing services. Gao discussed concepts like elastic load balancing and auto scaling. He also demonstrated how to set up an AWS account and manage resources through the management console. The presentation provided an overview of cloud computing concepts and Amazon Web Services.
Scaling drupal horizontally and in cloudVladimir Ilic
Vancouver Drupal group presentation for April 25, 2013.
How to deploy Drupal on
- multiple web servers,
- multiple web and database servers, and
- how to join all that together and make site deployed on Amazon Cloud (Virtual Private Cloud) inside
- one availability zone
- multiple availability zones deployment.
Session cover details about what you need in order to get Drupal deployed on separate servers, what are issues/concerns, and how to solve them.
ScaleBase is a startup offering a database-as-a-service that provides unlimited database scalability and availability. It uses a Database Load Balancer to elastically scale any SQL database across multiple database instances in a shared-nothing architecture. This allows linear scaling of the database to meet increasing user demands and volumes of data while maintaining high availability.
Beyond the Query – Bringing Complex Access Patterns to NoSQL with DataStax - ...StampedeCon
Learn how to model beyond traditional direct access in Apache Cassandra. Utilizing the DataStax platform to harness the power of Spark and Solr to perform search, analytics, and complex operations in place on your Cassandra data!
Terracotta (an open source technology) provides a clustered, durable virtual heap. Terracotta's goal is to make Java apps scale with as little effort as possible. If you are using Hibernate, there are several patterns that can be used to leverage Terracotta and reduce the load on your database so your app can scale.
First, you can use the Terracotta clustered Hibernate cache. This is a high-performance clustered cache and allows you to avoid hitting the database on all nodes in your cluster. It's suitable, not just for read-only, but also for read-mostly and read-write use cases, which traditionally have not been viewed as good use cases for Hibernate second level cache.
Another high performance option is to disconnect your POJOs from their Hibernate session and manage them entirely in Terracotta shared heap instead. This is a great option for conversational data where the conversational data is not of long-term interest but must be persistent and highly-available. This pattern can significantly reduce your database load but does require more changes to your application than using second-level cache.
This talk will examine the basics of what Terracotta provides and examples of how you can scale your Hibernate application with both clustered second level cache and detached clustered state. Also, we'll take a look at Terracotta's Hibernate-specific monitoring tools.
The document discusses various hosting solutions for Drupal including web hosting, virtual private servers, dedicated servers, and Amazon EC2. It provides details on the costs, reliability, customization options, and maintenance requirements for each solution. Additionally, it covers some key terms and tools related to using Amazon EC2, such as instances, AMIs, EBS, S3 storage, the command line interface, and the ElasticFox browser plugin.
This document discusses using Apache Spark to perform analytics on Cassandra data. It provides an overview of Spark and how it can be used to query and aggregate Cassandra data through transformations and actions on resilient distributed datasets (RDDs). It also describes how to use the Spark Cassandra connector to load data from Cassandra into Spark and write data from Spark back to Cassandra.
AWS December 2015 Webinar Series - Amazon Aurora: Introduction and MigrationAmazon Web Services
Amazon Aurora is a MySQL-compatible database engine that combines the speed and availability of high-end commercial databases with the simplicity and cost-effectiveness of open source databases. Amazon Aurora is available through Amazon RDS as a fully managed database service.
This webinar introduces you to Amazon Aurora, explains common use cases for the service, and discusses methods to migrate your MySQL databases that are on Amazon RDS, Amazon EC2 or on-premises to Amazon Aurora.
Learning Objectives:
How Amazon Aurora is different and similar to traditional databases
Reliability and availability design in Aurora
How Amazon Aurora delivers up to 5x MySQL performance on similar hardware
Learn the scalability in Amazon Aurora: scaling instance size and database size, horizontal scaling with read replicas
Who Should Attend:
IT Managers, DBAs, Enterprise and Solution Architects , Devops Engineers and Developers
Introduction to Spark SQL and Catalyst / Spark SQLおよびCalalystの紹介scalaconfjp
SparkSQL is a Spark component that allows SQL queries to be executed on Spark. It uses Catalyst, which provides an execution planning framework for relational operations like SQL parsing, logical optimization, and physical planning. Catalyst defines logical and physical operators, expressions, data types and provides rule-based optimizations to transform query plans. The SQL core in SparkSQL builds SchemaRDDs to represent queries and allows reading/writing to Parquet and JSON formats.
Introducing the Embedded Rich Client Platform (eRCP) - Jim Robbins, IBMmfrancis
The document introduces eRCP (Embedded Rich Client Platform), which aims to investigate using Eclipse RCP components in embedded devices. It discusses that eRCP will provide a smaller deployment package for RCP apps to run on devices like phones and PDAs. Initial work will focus on adapting components like eSWT, Eclipse runtime, eJFace and eWorkbench for embedded use by reducing footprint, enhancing performance, and providing a targeted app model. IBM, Nokia, Motorola and others are involved in the project led by Jim Robbins. Deliverables include specifications and implementations of the adapted components with an initial focus on eSWT.
A Sensational Exposé With Bewildering DemonstrationsPeter Gasston
The document discusses HTML5 form validation constraints and APIs. It provides examples of how to add constraints like required fields, pattern matching, and value limits. It also demonstrates how to detect constraint validation support, check field and form validity, and access validation error messages through the validity API. The document is an introduction to HTML5 form validation features and constraints.
Microsoft Search Server 2008 - Technical Overviewukdpe
This document provides a technical overview of the capabilities of Microsoft Search Server 2008 Standard and Express. Dicussed is everything from hardware requirements, licensing, administration, and security. Of particular interest are the slides around search federation.
Silverlight 3 will ship in 2009 with new functionality for graphics and media, applications, and design tooling in a smaller download size. Key features include out-of-browser applications, dynamic styling, new controls, navigation improvements, reduced application sizes, SketchFlow prototyping, triggers and behaviors, H.264 and AAC support, validation, perspective transforms, shader effects, cross-application communication, easing animations, and bitmap caching. The document provides contact information for Mike Taulty of Microsoft regarding Essential Silverlight 3.
Windows Phone 7: How (Not) to Fail Marketplace Ingestionukdpe
The document provides guidance on how to avoid failures when submitting applications to the Windows Phone Marketplace. It outlines key policies around application certification requirements, iconography, support information, notifications, running apps under lock screen, back button behavior, themes, languages, common upload failures, and using the correct version of developer tools. Developers should thoroughly read certification documents, understand icon and notification policies, test on multiple devices and languages, and use the latest tools to avoid failures.
Introduction to the SQL and Windows Azure PlatformEduardo Castro
This presentation is an introduction to the Windows and SQL Azure Cloud Computing Platform.
Regards,
Dr. Eduardo Castro Martinez
http://comunidadwindows.org
http://ecastrom.blogspot.com
Windows Azure Platform Technical Deep Dive - Chris Auld (Intergen)Spiffy
This document provides a technical deep dive into the Windows Azure platform. It begins with some introductory notes and an example application called TicketDirect that will be used to demonstrate the Azure architecture. It then covers key aspects of the Azure architecture including roles, storage, queues, scaling, configuration, monitoring and SQL Azure. Throughout it provides examples and considerations for designing applications on the Azure platform.
SQLUG event: An evening in the cloud: the old, the new and the big Mike Martin
Belgian SQL UG talk On Windows Azure SQL Database and CO: The last couple of months have been very exciting times for Microsoft fans. With the release of the central flagship, SQL Server 2012, and the new and improved Cloud offering on Windows Azure, Microsoft managed to change the IT Landscape dramatically. During this talk we want to take you through all the SQL Server features in the Windows Azure Environment in either the full cloud spectrum or hybrid scenario’s. We’ll cover subjects like SQL Databases, IaaS, provisioning, integration, migration and touch some of the more computing topics in the Windows Azure when it comes to data. Going from the pure basics of all SQL related to the more advanced stuff you can do with this magnificent cloud platform.
Cloud for Developers: Azure vs. Google App Engine vs. Amazon vs. AppHarborSvetlin Nakov
Software Development for the Public Cloud Platforms: Windows Azure vs. Google App Engine vs. Amazon Web Services (AWS) vs AppHarbor.
In this talk the speaker will compare the most widely used public PaaS clouds (Azure, GAE and AWS) from the software developer’s perspective.
A parallel between Azure, GAE, AWS and few other clouds (like AppHarbor, Heroku, Cloudfoundry and AppForce) will be made based on several criteria: architecture, pricing, storage services (non-relational databases, relational databases in the cloud and blob/file storage), business-tier services (like queues, notifications, email, CDN, etc.), supported languages, platforms and frameworks and front-end technologies.
A live demo will be made to compare the way we build and deploy a multi-tiered application in Azure, Amazon and GAE and how to implement its back-end (using a cloud database), business tier (based on REST services) and front-end (based on HTML5).
The speaker Svetlin Nakov (http://www.nakov.com) is well-known software development expert and trainer, a head of the Telerik Software Academy and a main organizer of the Cloud Development course (http://clouddevcourse.telerik.com).
This document provides an overview of Windows Azure services. It defines key cloud computing terms and describes the benefits of cloud computing. It explains that Windows Azure provides a cloud operating system for building scalable applications. The core services include web and worker roles, storage for blobs, tables and queues, and SQL Azure for relational data. It outlines the programming model and tools for developing applications on the Windows Azure platform.
Microsoft/Zend Webcast on Cloud ComputingJosh Holmes
This document discusses using Zend Framework and Windows Azure for cloud computing. It provides an overview of cloud computing advantages like flexibility and cost savings. It then covers specifics of running PHP applications on Azure, including leveraging Azure storage for blobs, tables and queues. It also discusses using SQL Azure for relational data storage and running executables in Azure worker roles. Resources for PHP, MySQL and Azure development are also referenced.
In this presentation we review SQL Azure Federation and Scalability.
Best Regards,
Dr. Eduardo Castro Martinez
Microsoft SQL Server MVP
http://ecastrom.blogspot.com
http://tinyurl.com/comunidadwindows
The document discusses SaaS-ification and using AWS for software as a service models. It describes single tenant and multi tenant SaaS options. For single tenant SaaS, each customer gets their own isolated environment including dedicated compute and database resources. For multi tenant SaaS, resources are shared across customers requiring scalable architecture and automation for onboarding. Example architectures are provided for each approach using various AWS services.
This document provides best practices and recommendations for startups and developers building applications on AWS. It discusses principles like failing fast and cheap, building minimum viable products, focusing on core features, leveraging AWS services, loose coupling of services, auto-scaling, continuous delivery, and measuring everything to enable rapid iteration and innovation. The overall message is that AWS lowers the cost of failure, allowing companies to experiment more often and increase innovation.
Databases in the Cloud discusses AWS database services for moving workloads to the cloud. It describes Amazon Relational Database Service (RDS) which provides several fully managed relational database options including MySQL, PostgreSQL, MariaDB, Oracle, SQL Server, and Amazon Aurora. It also discusses non-relational database services like DynamoDB, ElastiCache, and Redshift for analytics workloads. The document provides guidance on choosing between SQL and NoSQL databases and discusses benefits of managed database services over hosting databases on-premises or in EC2 instances.
Best Practices Scaling Web Application Up to Your First 10 Million UsersAmazon Web Services
If you have a new web application and want to use cloud computing, you might be asking yourself, "Where do I start?" Cloud computing gives you a number of advantages, such as the ability to scale your web application on demand. Join us in this webinar to understand best practices for scaling your resources from zero to millions of users. We show you how to best combine different AWS services, how to make smarter decisions for architecting your application, and how to scale your infrastructure in the cloud.
1. Windows Azure is a cloud computing platform that provides a hosted environment for building, deploying and managing applications and services through a global network of Microsoft-managed data centers.
2. The platform provides compute, storage and networking services that together support development and hosting of applications scaled for the internet.
3. Key components include the Azure Services Platform for .NET and SQL-based services, Live Services for user-centric experiences, and support for building applications that integrate on-premises and cloud-hosted services using standard protocols.
SQL Azure Database provides SQL Server database technology as a cloud service, addressing issues with on-premises databases like high maintenance costs and difficulty achieving high availability. It allows databases to automatically scale out elastically with demand. SQL Azure Database uses multiple physical replicas of a single logical database to provide automatic fault tolerance and high availability without complex configuration. Developers can access SQL Azure using standard SQL client libraries and tools from any application.
Samedi SQL Québec - La plateforme data de AzureMSDEVMTL
6 juin 2015
Samedi SQL à Québec
Session 3 - Data (SQL Azure, Table et Blob Storage) (Eric Moreau)
SQL Azure est une base de données relationnelle en tant que service, Azure Storage permet de stocker et d'extraire de gros volumes de données non structurées (par exemple, des documents et fichiers multimédias) avec les objets blob Azure ; de données NoSql structurées avec les tables Azure ; de messages fiables avec les files d'attente Azure.
The document discusses the evolution of HTML5 and new web technologies like Web Workers, Web Storage, Web Databases, and Cache Manifests that allow web applications to work offline. It then introduces the Alexing Framework for building web applications using these HTML5 features with a backend database and synchronization between the client and server through a middleware layer. The framework aims to provide an architecture and APIs for developing offline-first applications using HTML5 technologies.
This document provides an overview and agenda for Amazon Web Services (AWS). It discusses Infrastructure as a Service (IaaS) and Platform as a Service (PaaS) models and then summarizes several key AWS services - Elastic Compute Cloud (EC2) for virtual machines, Relational Database Service (RDS) for databases, Simple Storage Service (S3) for cloud storage, CloudFront for content delivery, CloudFormation for infrastructure automation, and Elastic Beanstalk for application deployment and management. The presentation aims to demonstrate tools for accessing and using AWS services.
Serverless Analytics with Amazon Redshift Spectrum, AWS Glue, and Amazon Quic...Amazon Web Services
Learning Objectives:
- Understand how to build a serverless big data solution quickly and easily
- Learn how to discover and prepare all your data for analytics
- Learn how to query and visualize analytics on all your data to create actionable insights
This document provides an overview of the Windows Phone 7 platform, including its key features and capabilities. It discusses the personal, relevant, and connected design themes of WP7. It also summarizes the hardware specifications, development tools, APIs for location, notifications, and cloud services, and new controls available to developers. The document demonstrates several features of the platform through embedded code samples and videos.
The document discusses the Open Data Protocol (OData), which is an open specification that allows the creation of REST-based data services that support built-in operations like CRUD (Create, Read, Update, Delete) and querying capabilities. OData builds on fundamental web standards like HTTP, URI conventions, and XML or JSON for payloads to define a protocol that can be used for exposing and consuming data across systems via REST. The specification also covers addressing schemes, payloads, metadata, batching requests, and how OData can be implemented using technologies like WCF Data Services.
Mike Ormond from Microsoft discusses using jQuery with ASP.NET. jQuery is a popular JavaScript library that simplifies HTML document traversal, event handling, animation, and AJAX interactions. It was created by John Resig and is now the most widely used JavaScript library. Microsoft has invested in jQuery by including it in Visual Studio and providing IntelliSense support. jQuery complements ASP.NET nicely by focusing on client-side AJAX, while tools like the ASP.NET AJAX Control Toolkit focus more on server-side AJAX functionality. Resources for learning more about jQuery and ASP.NET AJAX are provided.
Microsoft UK TechDays - Top 10 ASP.NET 4.0 Featuresukdpe
Mike Ormond from Microsoft discusses new features in ASP.NET 4 including better tooling, markup cleanup, output caching, session state compression, application monitoring helpers, templates and validation, routing, deployment, Microsoft AJAX and jQuery integration, and data visualization. He also provides an overview of jQuery, how it can be used with ASP.NET, and Microsoft's commitment to jQuery including bundling it with Visual Studio and contributing to the jQuery project.
The document summarizes updates to the ASP.NET platform, including ASP.NET Core, ASP.NET Web Forms, and ASP.NET MVC. It highlights new features like performance monitoring and caching options for ASP.NET Core, improvements to routing and markup cleanup for Web Forms, and area partitioning and async controller support for MVC. The document also discusses updates to Visual Studio tooling for ASP.NET projects and a continued commitment to jQuery. In summary, it presents the ASP.NET framework as mature with many enhancements in ASP.NET 4.0 to support both traditional Web Forms and the newer MVC approach.
Mike Taulty MIX10 Silverlight 4 Patterns Frameworksukdpe
The document discusses various frameworks and patterns in Silverlight 4, including ASP.NET client application services, WCF data services, WCF RIA services, navigation, search, and extensibility with MEF. It provides an overview and demos of each technology. The presentation encourages attendees to check the schedule for additional in-depth sessions on topics like OData, WCF data services, WCF RIA services, navigation, search engine optimization, and MEF.
Mike Taulty MIX10 Silverlight 4 Accelerated Fundamentalsukdpe
The document discusses Silverlight 4 and provides an overview of its key features and capabilities. Silverlight is a browser plugin that allows for the creation of rich internet applications using .NET and XAML. It supports animation, layout, styling, data binding, media playback, and interoperability with the browser and underlying operating system. Controls, graphics, and media capabilities are built into the framework. Applications can also access resources on the local machine and communicate with JavaScript.
Mike Taulty TechDays 2010 Silverlight and Windows Phone 7 CTPukdpe
This document discusses Silverlight development for Windows Phone 7. It provides an overview of Silverlight functionality on the desktop and how it is adapted for Windows Phone 7. Key points include:
- Silverlight is a development platform for Windows Phone 7 applications, with a subset of Silverlight 3 functionality supported.
- Applications are built using XAML, C# and other Silverlight languages, and deployed as XAP files to the phone.
- Supported functionality includes controls, graphics, media, networking and core frameworks. Some capabilities are phone-specific like location services and sensors.
- The document demonstrates navigation, controls, input handling and reaching out to phone services from Silverlight applications. It also discusses push
Mike Taulty TechDays 2010 Silverlight 4 - What's New?ukdpe
Silverlight 4 is a major release that includes many new features such as support for additional browsers and platforms, improved networking capabilities including sockets support, enhanced data binding and validation, improved media support including offline DRM, and new controls. It also introduces the ability to create trusted out-of-browser applications that have increased desktop integration and access to native capabilities. The release strengthens support for MVVM, adds the Managed Extensibility Framework, and improves WCF RIA Services.
Mike Taulty DevDays 2010 Silverlight 4 - What's New Part 2ukdpe
Silverlight 4 is a major release with many new features, including controls enhancements, improved desktop integration capabilities for out-of-browser and trusted applications, and new frameworks like the Managed Extensibility Framework and WCF RIA Services. It allows applications to access local files, printers, webcams, and more when running as a trusted application. The document promotes upcoming sessions that will provide more details on Silverlight 4's new features for MEF and desktop developers.
Mike Taulty DevDays 2010 Silverlight 4 - What's New Part 1ukdpe
This document summarizes Mike Taulty's presentation on the new features in Silverlight 4. Some key points from part 1 include:
- Silverlight 4 includes improvements to controls, binding and validation, networking, and navigation. It also features better support for desktop and out-of-browser applications.
- Visual Studio 2010 and Expression Blend 4 have been updated with new design-time features for working with Silverlight.
- Networking capabilities have been expanded, including support for HTTP client stack, sockets, and WCF Data Services.
- Navigation in Silverlight 4 is now pluggable through a new UriMapper and ContentLoader system.
Part 2 of the presentation will cover
MEF is the Managed Extensibility Framework, which allows applications to be composed of loosely coupled parts that can be discovered and integrated at runtime. Silverlight 4 includes MEF, which allows parts defined by exports and imports to be automatically composed together into applications. MEF supports recomposing applications when new parts are added, through features like catalogs and contracts. MEF also supports the MVVM pattern by allowing user interface and functionality to be loosely bound and extensible.
Mike Taulty DevDays 2010 Silverlight 4 Networkingukdpe
This document discusses networking capabilities in Silverlight 4. It describes how Silverlight 4 apps can access networks with HTTP, TCP, UDP, and sockets. It discusses various protocols like SOAP, REST, and OData that can be used with HTTP and WCF. Examples are provided for making HTTP requests, using sockets for TCP/UDP, and calling RESTful WCF Data Services. The document aims to help developers choose the best approach for their networking needs in Silverlight 4 applications.
Mike Taulty MIX10 Silverlight Frameworks and Patternsukdpe
This document provides an overview and summary of Silverlight 4 frameworks, patterns, and capabilities. It discusses ASP.NET client application services, WCF data services, WCF RIA services, navigation, search, extensible applications using MEF, and the MVVM pattern. The document includes several demos that could be shown to illustrate these topics. It also provides information on related sessions at the conference to learn more.
This is an academic presentation that discusses as a philosophical level the transformation that IT is experiencing in relation to cloud computing. There is some emphasis and examples around Microsoft's implementation of Windows Azure, but the principles are reflected in most cloud platforms today.
This presentation is ideal to initiate students, academics, IT Managers, and CIOs on the implications of Cloud computing.
Steve Beswick, Director of Education Sector, discusses Microsoft's place in education. His presentation provide guidance and vision for headmasters, principals, IT managers, and administrators about a variety of technical topics related to education. Topics discussed in clude virtual learning gateways, SharePoint, data management, and organizational agility.
How Microsoft Secures its Online Services [WHITEPAPER]ukdpe
Service security must be proactively designed in to all aspects of the online experience, from the software itself to the supporting infrastructure, from the day-to-day best practices for your own information workers to the buildings housing the data centers. The security architecture for the Business Productivity Online Suite embodies the key principles of the company’s Trustworthy Computing Initiative: security created by design, by default, and by deployment. Developed for global enterprises, Microsoft’s multi-faceted security program applies a common set of security policies to manage risk and mitigate threats to customer data. Microsoft seeks to improve security by working to standardize the way it tests, implements, and monitor policies for all of its customers. In turn, each Business Productivity Online Suite customer benefits from Microsoft’s experience with the security concerns of customers all over the world — and from the practices Microsoft applies to address them.
Package, Stream, Manage. Application virtualiization isolates applications to create a conflict free environment with manageability as the cornerstone to successful service delivery in large organizations. With App-V, deploy applications in seconds to thousands of computers automagically.
Search engine optimisation is a key requirement for maximising the traffic to your site. The SEO Toolkit will perform an analysis of your site and catalogue issues that may impede search engines from traversing or indexing your site. The toolkit can also help you manage your sitemap and robots.txt files.
The next release of ASP.NET Web Forms and MVC offers a great number of improvements for web developers. As does Visual Studio 2010. This deck summarises many of the anticipated changes.
What is an RPA CoE? Session 4 – CoE ScalingDianaGray10
How to scale a COE to meet organizational missions.
Topics covered:
• What is the original focal area?
• How to expand the COE globally.
• Is a centralized or decentralized model better for scaling?
Speaker:
Chris Bolin, Senior Intelligent Automation Architect Anika Systems
This time, we're diving into the murky waters of the Fuxnet malware, a brainchild of the illustrious Blackjack hacking group.
Let's set the scene: Moscow, a city unsuspectingly going about its business, unaware that it's about to be the star of Blackjack's latest production. The method? Oh, nothing too fancy, just the classic "let's potentially disable sensor-gateways" move.
In a move of unparalleled transparency, Blackjack decides to broadcast their cyber conquests on ruexfil.com. Because nothing screams "covert operation" like a public display of your hacking prowess, complete with screenshots for the visually inclined.
Ah, but here's where the plot thickens: the initial claim of 2,659 sensor-gateways laid to waste? A slight exaggeration, it seems. The actual tally? A little over 500. It's akin to declaring world domination and then barely managing to annex your backyard.
For Blackjack, ever the dramatists, hint at a sequel, suggesting the JSON files were merely a teaser of the chaos yet to come. Because what's a cyberattack without a hint of sequel bait, teasing audiences with the promise of more digital destruction?
-------
This document presents a comprehensive analysis of the Fuxnet malware, attributed to the Blackjack hacking group, which has reportedly targeted infrastructure. The analysis delves into various aspects of the malware, including its technical specifications, impact on systems, defense mechanisms, propagation methods, targets, and the motivations behind its deployment. By examining these facets, the document aims to provide a detailed overview of Fuxnet's capabilities and its implications for cybersecurity.
The document offers a qualitative summary of the Fuxnet malware, based on the information publicly shared by the attackers and analyzed by cybersecurity experts. This analysis is invaluable for security professionals, IT specialists, and stakeholders in various industries, as it not only sheds light on the technical intricacies of a sophisticated cyber threat but also emphasizes the importance of robust cybersecurity measures in safeguarding critical infrastructure against emerging threats. Through this detailed examination, the document contributes to the broader understanding of cyber warfare tactics and enhances the preparedness of organizations to defend against similar attacks in the future.
Automation Student Developers Session 3: Introduction to UI AutomationUiPathCommunity
👉 Check out our full 'Africa Series - Automation Student Developers (EN)' page to register for the full program: http://bit.ly/Africa_Automation_Student_Developers
After our third session, you will find it easy to use UiPath Studio to create stable and functional bots that interact with user interfaces.
📕 Detailed agenda:
About UI automation and UI Activities
The Recording Tool: basic, desktop, and web recording
About Selectors and Types of Selectors
The UI Explorer
Using Wildcard Characters
💻 Extra training through UiPath Academy:
User Interface (UI) Automation
Selectors in Studio Deep Dive
👉 Register here for our upcoming Session 4/June 24: Excel Automation and Data Manipulation: https://community.uipath.com/events/details
Dev Dives: Mining your data with AI-powered Continuous DiscoveryUiPathCommunity
Want to learn how AI and Continuous Discovery can uncover impactful automation opportunities? Watch this webinar to find out more about UiPath Discovery products!
Watch this session and:
👉 See the power of UiPath Discovery products, including Process Mining, Task Mining, Communications Mining, and Automation Hub
👉 Watch the demo of how to leverage system data, desktop data, or unstructured communications data to gain deeper understanding of existing processes
👉 Learn how you can benefit from each of the discovery products as an Automation Developer
🗣 Speakers:
Jyoti Raghav, Principal Technical Enablement Engineer @UiPath
Anja le Clercq, Principal Technical Enablement Engineer @UiPath
⏩ Register for our upcoming Dev Dives July session: Boosting Tester Productivity with Coded Automation and Autopilot™
👉 Link: https://bit.ly/Dev_Dives_July
This session was streamed live on June 27, 2024.
Check out all our upcoming Dev Dives 2024 sessions at:
🚩 https://bit.ly/Dev_Dives_2024
Day 4 - Excel Automation and Data ManipulationUiPathCommunity
👉 Check out our full 'Africa Series - Automation Student Developers (EN)' page to register for the full program: https://bit.ly/Africa_Automation_Student_Developers
In this fourth session, we shall learn how to automate Excel-related tasks and manipulate data using UiPath Studio.
📕 Detailed agenda:
About Excel Automation and Excel Activities
About Data Manipulation and Data Conversion
About Strings and String Manipulation
💻 Extra training through UiPath Academy:
Excel Automation with the Modern Experience in Studio
Data Manipulation with Strings in Studio
👉 Register here for our upcoming Session 5/ June 25: Making Your RPA Journey Continuous and Beneficial: https://community.uipath.com/events/details/uipath-lagos-presents-session-5-making-your-automation-journey-continuous-and-beneficial/
Test Case Design Techniques as chapter 4 of ISTQB Foundation. Topics included are Equivalence Partition, Boundary Value Analysis, State Transition Testing, Decision Table Testing, Use Case Testing, Statement Coverage, Decision Coverage, Error Guessing, Exploratory Testing, Checklist Based Testing
Building an Agentic RAG locally with Ollama and MilvusZilliz
With the rise of Open-Source LLMs like Llama, Mistral, Gemma, and more, it has become apparent that LLMs might also be useful even when run locally. In this talk, we will see how to deploy an Agentic Retrieval Augmented Generation (RAG) setup using Ollama, with Milvus as the vector database on your laptop. That way, you can also avoid being Rate Limited by OpenAI like I have been in the past.
The document discusses fundamentals of software testing including definitions of testing, why testing is necessary, seven testing principles, and the test process. It describes the test process as consisting of test planning, monitoring and control, analysis, design, implementation, execution, and completion. It also outlines the typical work products created during each phase of the test process.
Test Management as Chapter 5 of ISTQB Foundation. Topics covered are Test Organization, Test Planning and Estimation, Test Monitoring and Control, Test Execution Schedule, Test Strategy, Risk Management, Defect Management
Enterprise Knowledge’s Joe Hilger, COO, and Sara Nash, Principal Consultant, presented “Building a Semantic Layer of your Data Platform” at Data Summit Workshop on May 7th, 2024 in Boston, Massachusetts.
This presentation delved into the importance of the semantic layer and detailed four real-world applications. Hilger and Nash explored how a robust semantic layer architecture optimizes user journeys across diverse organizational needs, including data consistency and usability, search and discovery, reporting and insights, and data modernization. Practical use cases explore a variety of industries such as biotechnology, financial services, and global retail.
For senior executives, successfully managing a major cyber attack relies on your ability to minimise operational downtime, revenue loss and reputational damage.
Indeed, the approach you take to recovery is the ultimate test for your Resilience, Business Continuity, Cyber Security and IT teams.
Our Cyber Recovery Wargame prepares your organisation to deliver an exceptional crisis response.
Event date: 19th June 2024, Tate Modern
CNSCon 2024 Lightning Talk: Don’t Make Me Impersonate My IdentityCynthia Thomas
Identities are a crucial part of running workloads on Kubernetes. How do you ensure Pods can securely access Cloud resources? In this lightning talk, you will learn how large Cloud providers work together to share Identity Provider responsibilities in order to federate identities in multi-cloud environments.
Call Girls Chennai ☎️ +91-7426014248 😍 Chennai Call Girl Beauty Girls Chennai...
Windows Azure - Ericnel
1. Eric Nelson
Developer & Platform Group
Microsoft Ltd
eric.nelson@microsoft.com
http://geekswithblogs.net/IUpdateable
http://twitter.com/ericnel
2. Cloud
101
Microsoft and Cloud
Introduce Azure Services Platform
Windows Azure
Web Role
Worker Role
Storage in the Cloud
SQL Data Services
Windows Azure Storage
Table, Blob
3.
4. Cloud Computing
Run/Store stuff in the cloud -
Somebody else has the data center/headaches
Infrastructure as a Service (IaaS)
Example: Amazon Elastic Compute Cloud
(EC2)
Platform as a Service (PaaS)
Example: Force.com,Google App Engine
Windows Azure is a PaaS
5. SQL Server Data Services (SSDS) – announced
at MIX 08 (March 2008)
“SQL Server in the cloud”
Azure Services Platform – announced at PDC
08 (October 2008)
Windows Azure “O.S. for the Cloud”
+ additional services
RESTful – enabling “any client” access
9. It is an operating system for the cloud
It is designed for utility computing
Many is better than one
Loose coupling
Simple stores scale
It provides facilities to:
Write your apps (developer experience)
Host your apps (compute)
Manage your apps (service management)
Store your data (storage)
22. Web Site
Web Site
Web Role
(ASPX, ASMX,
(ASPX, ASMX,
WCF)
(ASPX, WCF)
WCF)
2
SQL Data Services
L
B
Worker
Worker
Service
Role
Internet
Your Service
Queue
L
B
Blobs
1
Tables
Storage
Windows Azure Datacenter
23. Web Site
Web Site
Web Role
(ASPX, ASMX, WCF)
(ASPX, ASMX, WCF)
Queue SQL Data
Worker
Worker Service Services
Role Blobs Database ONE
Tables
Application ONE ONE Storage
Web Site
Web Site
Web Role
(ASPX, ASMX, WCF)
(ASPX, ASMX, WCF)
Queue
Worker
Worker Service
Role Blobs
Internet Application TWO Tables
TWO Storage
Web Site
Web Site
Web Role
(ASPX, ASMX, WCF)
(ASPX, ASMX, WCF) SQL Data
Worker
Worker Service
Services
Role Database THREE
Application THREE
Queue
Tables Blobs
FOUR Storage Windows Azure Datacenter
25. Azure Storage SQL Data Services
Vision Massively scalable,
highly available
store in the Cloud
Access REST
(Uses ADO.NET
Data Services)
Relational? (today) No
Relational? No
(tomorrow)
Analogy
26. Azure Storage SQL Data Services
Vision Massively scalable, Highly scalable,
highly available highly available
store in the Cloud relational store in
the Cloud
Access REST SqlClient + TSQL
(Use Azure Web Role + ADO.NET
(Uses ADO.NET Data Services if REST is required)
Data Services)
Relational? (today) No Yes – but with some
limitations
Relational? No Yes – with less and
(tomorrow) less limitations
Analogy
27. Azure Storage SQL Data Services
Vision Massively scalable, Highly scalable,
highly available highly available
store in the Cloud relational store in
the Cloud
Access REST SqlClient + TSQL
(Use Azure Web Role + ADO.NET
(Uses ADO.NET Data Services if REST is required)
Data Services)
Relational? (today) No Yes – but with some
limitations
Relational? No Yes – with less and
(tomorrow) less limitations
Analogy File System RDBMS – as it is!
28. Web Site
Web Site
Web Role
(ASPX, ASMX,
(ASPX, ASMX,
WCF)
(ASPX, WCF)
WCF)
SQL Data Services
L
B Easy
Worker
Worker
Service
Role
Internet
Your Service
Queue
L
Trickier
B
Blobs
Tables
Storage
Windows Azure Datacenter
29. Cloud
On Premise
Application
C#, VB, Ruby, PHP etc
Relational
Data
TSQL
30. Storage that is
Durable, Scalable, Highly Available, Secure,
Performant
Rich Data Abstractions
Service communication: queues, locks, …
Large user data items: blobs, blocks, …
Service state: tables, caches, …
Simple and Familiar Programming
Interfaces
REST Accessible and ADO.NET
33. Massively Scalable Tables
Billions of entities (rows) and TBs of data
Automatically scales to thousands of servers
as traffic grows
Highly Available
Can always access your data
Durable
Data is replicated at least 3 times
34. What tables don’t do What tables can do
Not relational Cheap
No Referential Integrity Very Scalable
If theseNo Joins
are Flexible
importantData
Limitedto you,
use SQL
Queries Durable
ServicesGroup by
No Store LOTS of stuff
No Aggregations
No Transactions
No Transactions
35. Data stored in Tables
A Table is a set of Entities (rows)
An Entity is a set of Properties (columns)
Entity has:
PartitionKey – enables scalability
RowKey – unique id within the partition
the only indexed property
Timestamp – for optimistic concurrency
255 properties total
Max size of 1MB
36. Partition Key Row Key Property 3 ….. Property N
Document Version Modification Description
Name Time
Examples Doc V1.0 8/2/2007 ….. Committed version
Partition
Examples Doc V2.0.1 9/28/2007 Alice’s working version 1
FAQ Doc V1.0 5/2/2007 Committed version
FAQ Doc V1.0.1 7/6/2007 Alice’s working version Partition
2
FAQ Doc V1.0.2 8/1/2007 Sally’s working version
37. Vessel Position Reporting System – SQL Server
VesselId Time Latitude Longitude Speed
xxx-xx1 10:15 14 Nov 01.23 53.24 0
xxx-xx1 10:05 14 Nov 04.45 54.32 5
xxx-xx1 09:55 14 Nov 02.32 52.34 4
xxx-xx2 10:15 14 Nov 01.23 51.23 10
To find last pos report for vessel in SQL:
select TOP(1) * from PosRpts
order by [Time] DESC
where VesselId = ???
38. Solving this the Azure way
PartitionKey
VesselId Time Latitude Longitude Speed
xxx-xx1 10:15 14 Nov 01.23 53.24 0
xxx-xx1 10:05 14 Nov 04.45 54.32 5
xxx-xx1 09:55 14 Nov 02.32 52.34 4
xxx-xx2 10:15 14 Nov 01.23 51.23 10
PartitionKey
39. Stored in-order:
RowKey needs to
Just need to do a
be a string
top on the
partition PartitionKey xxx-xx1
RowKey Latitude Longitude Speed
10:15 14 Nov
2521756430999999999 01.23 53.24 0
10:05 14 Nov
2521756436999999999 04.45 54.32 5
Makes it 14 Nov
09:55
2521756442999999999 02.32 52.34 4
descending
(DateTime.MaxValue – time).Ticks.ToString ()
time.Ticks.ToString ()
40. Developer CTP for Enable Full trust & Fast CGI
Services SDKs, and Geo-location support SDS Public CTP Windows Azure
Tools .NET Services Open CTP .NET Services
Live Framework Open CTP SQL Services
SDS Invitation-only CTP
41. Many is better than one
Let Microsoft worry about this
Loose coupling
Web Role and Worker Role
Storage choice
Azure Storage: Simple stores scale
Table, Blob, Queue
SQL Data Services: Full RDBMS
Stored Procedures, Schema, Transactions,
Views etc
42. • Play with Windows Azure – http://www.azure.com
Learn • Understand REST – good and bad practices
• Watch the MIX 09 recordings http://live.visitmix.com
• Slides at http://geekswithblogs.net/IUpdateable
Need • Students can get Visual Studio through Microsoft DreamSpark
• Startups get tools and more via BizSpark
• Developers can also use the free Visual Studio Express
tools? • Or just use none Microsoft tools and languages e.g. PHP
http://phpazure.codeplex.com/
• http://www.newcloudapp.com/
Win
S3S3 stores arbitrary objects up to 5 gigabytes in size, each accompanied by up to 2 kilobytes of metadata. Objects are organized into buckets (each owned by an AWS account), and identified within each bucket by a unique, user-assigned key.Buckets and objects can be created, listed, and retrieved using either a REST-style HTTP interface or a SOAP interface. Additionally, objects can be downloaded using the HTTP GET interface and the BitTorrent protocol.Requests are authorized using an access control list associated with each bucket and object.Bucket names and keys are chosen so that objects are addressable using HTTP URLs:http://s3.amazonaws.com/bucket/key http://bucket.s3.amazonaws.com/key EC2When it launched in August 2006, the EC2 service offered Linux and later Sun Microsystems' OpenSolaris and Solaris Express Community Edition. In October 2008, EC2 added the Windows Server 2003 operating system to the list of available operating systems
http://en.wikipedia.org/wiki/Operating_system An operating system (commonly abbreviated to either OS or O/S) is an interface between hardware and applications; it is responsible for the management and coordination of activities and the sharing of the limited resources of the computer. The operating system acts as a host for applications that are run on the machine. As a host, one of the purposes of an operating system is to handle the details of the operation of the hardware. This relieves application programs from having to manage these details and makes it easier to write applications.
An application execution environment that abstracts away the hardwareA shared file system with access controlResource allocation from a shared poolSupport for powerful programming modelsInter-operability with other systems
The “opportunities to get sacked” slide
http://eric.blob.core.windows.net/music/rock/rush/xanadu.mp3Blobs – Provide a simple interface for storing named files along with metadata for the fileTables – Provide structured storage. A Table is a set of entities, which contain a set of propertiesQueues – Provide reliable storage and delivery of messages for an applicationTab
Easy to use REST Put/Get/Delete interfaceCan read from any Offset, Length of BlobConditional Put and Get BlobMax Blob size50 GB using PutBlock and PutBlockList64 MB using PutBlobBlocks provide continuation for blob upload Put Blob/BlockList == Replace Blob for CTPCan replace an existing blob with new blob/blocksEach Blob is a list of blocksA Block can be up to 4MB each Each block can be variable sizeEach block has a 64 byte ID, scoped by blob nameBlock operationPutBlockPuts an uncommitted block defined by the block ID for the blob Block list operationsPutBlockListProvide the list of blocks to comprise the readable version of the blobCan use uncommitted blocks onlyGetBlockListReturns the list of committed blocks (not the block data)Block ID and size of block are returned for each block