Blue Sky Thinking
•
1 like•455 views
This document discusses using SQL Azure with geospatial data and integrating it with Azure websites and other live data sources. It covers using the SQL Azure database for geospatial data, connecting to it from SQL Server Management Studio. It also discusses using Azure web hosting, retrieving weather and location data from external sources to display on a map using Bing Maps.
Report
Share
Report
Share
Download to read offline
Recommended
Sql server 2016 Discovery Day
What's new in SQL Server 2016. A choice selection of some of the new and updated technologies in SQL Server 2016.
Discovery Day 2019 Sofia - Big data clusters
This document provides an overview of the architecture and components of SQL Server 2019 Big Data Clusters. It describes the key Kubernetes concepts used in Big Data Clusters like pods, services, and nodes. It then explains the different planes (control, compute, data) and nodes that make up a Big Data Cluster and their roles. Components in each plane like the SQL master instance, compute pools, storage pools, and data pools are also outlined.
Bi and AI updates in the Microsoft Data Platform stack
This document provides an overview and agenda for a presentation on new features in the Microsoft data platform universe including SQL Server, Azure, and Power BI, with a focus on business intelligence (BI) and artificial intelligence (AI).
The presentation covers new features in SQL Server 2019 for BI like calculation groups and dynamic formatting in Analysis Services tabular mode. It also highlights important updates in Azure including new serverless and hyperscale options for Azure SQL Database, updates to data ingestion and storage with Azure Data Factory v2 and Azure Data Lake Gen 2, and changes to data modeling, preparation, and serving capabilities in Azure SQL Data Warehouse.
The document concludes by discussing options for incorporating AI and machine learning into BI solutions using either
Discovery Day 2019 Sofia - What is new in SQL Server 2019
This document summarizes new features in SQL Server 2019 including:
- Support for big data analytics using SQL Server, Spark, and data lakes for high volume data storage and access.
- Enhanced data virtualization capabilities to combine data from multiple sources.
- An integrated AI platform to ingest, prepare, train, store, and operationalize machine learning models.
- Improved security, performance, and high availability features like Always Encrypted with secure enclaves and accelerated database recovery.
- Continued improvements based on community feedback.
Benchmark: Beyond Aurora. Scale-out SQL databases for AWS.
The document discusses options for scaling relational database management systems (RDBMS). It describes scale-up vs scale-out approaches, and compares solutions like master-slave replication, sharding, and using scale-out databases. It provides details on ClustrixDB's scale-out architecture with shared-nothing storage and automatic data distribution. Benchmark results show ClustrixDB outperforming Aurora for throughput and latency on OLTP workloads as nodes are added.
Gab document db scaling database
This document discusses data modeling strategies for DocumentDB. It recommends embedding data for one-to-few relationships that infrequently change and won't grow very large, as this provides better read performance. Normalizing data is recommended for one-to-many and many-to-many relationships, and data that frequently changes, as this generally provides better write performance. The document notes there is no single best approach and the optimal model depends on how the data will be written, read, and the specific access patterns. Developers should think about these factors to determine the best modeling strategy.
Migration to Redshift from SQL Server
RealityMine collects digital user behavior data to help companies with marketing, product development, and analyzing user patterns. They are migrating from an on-premise SQL Server data warehouse to Amazon Redshift to handle doubling data volumes. Redshift provides better performance and scalability at lower cost compared to other options. It requires extracting raw data from SQL Server without encoding issues, loading to S3, and transforming in Redshift using a star schema with careful consideration of distribution and sort keys for query performance. Ongoing database maintenance and backups are also different in Redshift.
Azure SQL DWH
This document provides an overview of Azure SQL Data Warehouse (SQL DWH), a cloud data warehouse service. It discusses SQL DWH's massively parallel processing (MPP) architecture that allows independent scaling of compute and storage. The document demonstrates how to create a SQL DWH, load data using PolyBase, and use common tools. It is intended to help users understand what SQL DWH is, how it works, and common scenarios it can be used for, such as processing large volumes of data without needing to purchase and manage hardware.
Recommended
Sql server 2016 Discovery Day
What's new in SQL Server 2016. A choice selection of some of the new and updated technologies in SQL Server 2016.
Discovery Day 2019 Sofia - Big data clusters
This document provides an overview of the architecture and components of SQL Server 2019 Big Data Clusters. It describes the key Kubernetes concepts used in Big Data Clusters like pods, services, and nodes. It then explains the different planes (control, compute, data) and nodes that make up a Big Data Cluster and their roles. Components in each plane like the SQL master instance, compute pools, storage pools, and data pools are also outlined.
Bi and AI updates in the Microsoft Data Platform stack
This document provides an overview and agenda for a presentation on new features in the Microsoft data platform universe including SQL Server, Azure, and Power BI, with a focus on business intelligence (BI) and artificial intelligence (AI).
The presentation covers new features in SQL Server 2019 for BI like calculation groups and dynamic formatting in Analysis Services tabular mode. It also highlights important updates in Azure including new serverless and hyperscale options for Azure SQL Database, updates to data ingestion and storage with Azure Data Factory v2 and Azure Data Lake Gen 2, and changes to data modeling, preparation, and serving capabilities in Azure SQL Data Warehouse.
The document concludes by discussing options for incorporating AI and machine learning into BI solutions using either
Discovery Day 2019 Sofia - What is new in SQL Server 2019
This document summarizes new features in SQL Server 2019 including:
- Support for big data analytics using SQL Server, Spark, and data lakes for high volume data storage and access.
- Enhanced data virtualization capabilities to combine data from multiple sources.
- An integrated AI platform to ingest, prepare, train, store, and operationalize machine learning models.
- Improved security, performance, and high availability features like Always Encrypted with secure enclaves and accelerated database recovery.
- Continued improvements based on community feedback.
Benchmark: Beyond Aurora. Scale-out SQL databases for AWS.
The document discusses options for scaling relational database management systems (RDBMS). It describes scale-up vs scale-out approaches, and compares solutions like master-slave replication, sharding, and using scale-out databases. It provides details on ClustrixDB's scale-out architecture with shared-nothing storage and automatic data distribution. Benchmark results show ClustrixDB outperforming Aurora for throughput and latency on OLTP workloads as nodes are added.
Gab document db scaling database
This document discusses data modeling strategies for DocumentDB. It recommends embedding data for one-to-few relationships that infrequently change and won't grow very large, as this provides better read performance. Normalizing data is recommended for one-to-many and many-to-many relationships, and data that frequently changes, as this generally provides better write performance. The document notes there is no single best approach and the optimal model depends on how the data will be written, read, and the specific access patterns. Developers should think about these factors to determine the best modeling strategy.
Migration to Redshift from SQL Server
RealityMine collects digital user behavior data to help companies with marketing, product development, and analyzing user patterns. They are migrating from an on-premise SQL Server data warehouse to Amazon Redshift to handle doubling data volumes. Redshift provides better performance and scalability at lower cost compared to other options. It requires extracting raw data from SQL Server without encoding issues, loading to S3, and transforming in Redshift using a star schema with careful consideration of distribution and sort keys for query performance. Ongoing database maintenance and backups are also different in Redshift.
Azure SQL DWH
This document provides an overview of Azure SQL Data Warehouse (SQL DWH), a cloud data warehouse service. It discusses SQL DWH's massively parallel processing (MPP) architecture that allows independent scaling of compute and storage. The document demonstrates how to create a SQL DWH, load data using PolyBase, and use common tools. It is intended to help users understand what SQL DWH is, how it works, and common scenarios it can be used for, such as processing large volumes of data without needing to purchase and manage hardware.
Apache Cassandra Lunch #78: Deploy Cassandra using DSE Operator to Kubernetes
In Cassandra Lunch #78, we will deploy Cassandra using DSE Operator to Kubernetes
Accompanying Blog: https://blog.anant.us/apache-cassandra-lunch-78-cass-operator/
Accompanying YouTube: https://youtu.be/Cfvks4WBtKk
Sign Up For Our Newsletter: http://eepurl.com/grdMkn
Join Cassandra Lunch Weekly at 12 PM EST Every Wednesday: https://www.meetup.com/Cassandra-DataStax-DC/events/
Cassandra.Link:
https://cassandra.link/
Follow Us and Reach Us At:
Anant:
https://www.anant.us/
Awesome Cassandra:
https://github.com/Anant/awesome-cassandra
Cassandra.Lunch:
https://github.com/Anant/Cassandra.Lunch
Email:
solutions@anant.us
LinkedIn:
https://www.linkedin.com/company/anant/
Twitter:
https://twitter.com/anantcorp
Eventbrite:
https://www.eventbrite.com/o/anant-1072927283
Facebook:
https://www.facebook.com/AnantCorp/
Join The Anant Team:
https://www.careers.anant.us
Database Architecture & Scaling Strategies, in the Cloud & on the Rack
Watch the recording here: https://www.youtube.com/watch?v=ZwERp38ynxQ&feature=youtu.be
In this webinar, Robbie Mihayli, VP of Engineering at Clustrix explores how to set up a SQL RDBMS architecture that scales out and is both elastic and consistent, while simultaneously delivering fault tolerance and ACID compliance.
He also covers how data gets distributed in this architecture, how the query processor works, how rebalancing happens and other architectural elements. Examples cited include cloud deployments and e-commerce use-cases.
In this webinar, you will learn:
1. Five RDBMS scaling strategies along with their trade offs
2. The importance of having no single point of failure for OLTP (fault tolerance)
3. The vagaries of the cloud and how it impacts using an RDBMS in the cloud
Who should watch?
1. People interested in high performance, real-time database solutions
2. Companies who have MySQL in their infrastructure and are concerned that their growth will soon overwhelm MySQL’s single-box design
3. DBA’s who implement ‘read slaves’, ‘multiple-masters’ and ‘sharding’ for MySQL databases and want to learn about better ways to scale
Vitalii Bondarenko "Machine Learning on Fast Data"
This document discusses machine learning on fast data. It presents an agenda covering ML on production systems, TensorFlow, Kafka, Docker and Kubernetes. It then describes the machine learning process and shows how an enterprise analytics platform can integrate data sources, a machine learning cluster using Kafka, and data destinations. Details are provided on using TensorFlow for linear regression and neural networks. Apache Kafka is explained as a distributed streaming platform using topics, brokers, and consumer groups. The Confluent platform, KStream and KTable APIs are also summarized. Docker and Kubernetes are mentioned for containerization.
IEEE International Conference on Data Engineering 2015
SK Telecom developed a Hadoop data warehouse (DW) solution to address the high costs and limitations of traditional DW systems for handling big data. The Hadoop DW provides a scalable architecture using Hadoop, Tajo and Spark to cost-effectively store and analyze over 30PB of data across 1000+ nodes. It offers SQL analytics through Tajo for faster querying and easier migration from RDBMS systems. The Hadoop DW has helped SK Telecom and other customers such as semiconductor manufacturers to more affordably store and process massive volumes of both structured and unstructured data for advanced analytics.
Modern ETL: Azure Data Factory, Data Lake, and SQL Database
This document discusses modern Extract, Transform, Load (ETL) tools in Azure, including Azure Data Factory, Azure Data Lake, and Azure SQL Database. It provides an overview of each tool and how they can be used together in a data warehouse architecture with Azure Data Lake acting as the data hub and Azure SQL Database being used for analytics and reporting through the creation of data marts. It also includes two demonstrations, one on Azure Data Factory and another showing Azure Data Lake Store and Analytics.
SQL Server 2016 - Stretch DB
Stretch Database allows migrating historical transactional data from an on-premises SQL Server database transparently to Microsoft Azure cloud storage. It enables seamless queries of data regardless of its location. Some limitations include inability to enforce uniqueness on stretched tables and limitations on allowed actions. Performance can degrade due to the additional overhead of query translation and data movement between on-premises and cloud locations. Remote data files provide an alternative method of archiving to cloud storage without changes to table structures but only overhead is additional latency.
Webinar | Getting Started With Amazon Redshift Spectrum
In the first webinar in our Amazon Redshift Spectrum Series, learn more about getting started with Spectrum.
Spectrum allows you to use the analytic capabilities of Amazon Redshift beyond the data which is in your data warehouse to query large amounts of semistructured and structured data in your “data lake,” without having to load or transform it into Amazon Redshift.
In this webinar learn:
- What is Amazon Redshift Spectrum?
- How to set up AWS Security for Amazon Redshift Spectrum
- What are external schemas and external tables
- How to query S3 data with Redshift SQL via Amazon Redshift Spectrum using Matillion ETL
Hive big-data meetup
1) Hive is a data warehouse infrastructure built on top of Hadoop for querying large datasets stored in HDFS. It provides SQL-like capabilities to analyze data and supports complex queries using a MapReduce execution engine.
2) Hive compiles SQL queries into a directed acyclic graph (DAG) of MapReduce jobs that are executed by Hadoop. The metadata is stored in a metastore (typically an RDBMS).
3) Hive supports advanced features like partitioning, bucketing, acid transactions, and complex types. It can handle petabyte-scale datasets and integrates with the Hadoop ecosystem but has limitations for low-latency queries.
Getting Started With Amazon Redshift
Have you decided on Amazon Redshift as your data warehouse but want to learn the latest tips and tricks to get started? Watch our webinar on Tuesday, August 29th to learn how to get started and how using Redshift can help you quickly and easily analyze your data to make business critical decisions.
A tour of Amazon Redshift
A quick tour in 16 slides of Amazon's Redshift clustered, massively parallel database.
Find out what differentiates it from the other database products Amazon has, including SimpleDB, DynamoDB and RDS (MySQL, SQL Server and Oracle).
Learn how it stores data on disk in a columnar format and how this relates to performance and interesting compression techniques.
Contrast the difference between Redshift and a MySQL instance and discover how the clustered architecture may help to dramatically reduce query time.
AWS Webcast - Redshift Overview and New Features
Amazon Redshift is a fast, fully managed, petabyte-scale data warehouse service that makes it simple and cost-effective to efficiently analyze all your data using your existing business intelligence tools.
This webinar will provide an overview of Redshift with an emphasis on the many changes we recently introduced. In particular, we will address the newly released DW2 instance types and what you can do with them.
This content is designed for database developers and architects interested in Amazon Redshift.
Andriy Zrobok "MS SQL 2019 - new for Big Data Processing"
This document discusses MS SQL Server 2019's capabilities for big data processing through PolyBase and Big Data Clusters. PolyBase allows SQL queries to join data stored externally in sources like HDFS, Oracle and MongoDB. Big Data Clusters deploy SQL Server on Linux in Kubernetes containers with separate control, compute and storage planes to provide scalable analytics on large datasets. Examples of using these technologies include data virtualization across sources, building data lakes in HDFS, distributed data marts for analysis, and integrated AI/ML tasks on HDFS and SQL data.
Spark streaming , Spark SQL
Spark Streaming allows processing of live data streams in Spark. It integrates streaming data and batch processing within the same Spark application. Spark SQL provides a programming abstraction called DataFrames and can be used to query structured data in Spark. Structured Streaming in Spark 2.0 provides a high-level API for building streaming applications on top of Spark SQL's engine. It allows running the same queries on streaming data as on batch data and unifies streaming, interactive, and batch processing.
Best practices for Data warehousing with Amazon Redshift - AWS PS Summit Canb...
Get a look under the hood: Understand how to take advantage of Amazon Redshift's columnar technology and parallel processing capabilities to improve your delivery of queries and improve overall database performance. You’ll also hear about how the University of Technology Sydney (UTS) are using Redshift. The University of Technology Sydney will describe how utilizing Amazon Redshift enabled agility in dealing with Data Quality, a capacity to scale when required, and optimizing development processes through rapid provisioning of Data Warehouse environments.
Speaker: Ganesh Raja, Solutions Architect, Amazon Web Services with Susan Gibson, Manager, Data and Business Intelligence, UTS
Level: 300
An intro to Azure Data Lake
Here are the slides for my talk "An intro to Azure Data Lake" at Techorama NL 2018. The session was held on Tuesday October 2nd from 15:00 - 16:00 in room 7.
[よくわかるAmazon Redshift in 大阪]Amazon Redshift最新情報と導入事例のご紹介
Amazon Redshift is a fully managed petabyte-scale data warehouse service in the cloud. It provides fast query performance at a very low cost. Updates since re:Invent 2013 include new features like distributed tables, remote data loading, approximate count distinct, and workload queue memory management. Customers have seen query performance improvements of 20-100x compared to Hive and cost reductions of 50-80%. Amazon Redshift makes it easy to setup, operate, and scale a data warehouse without having to worry about provisioning and managing hardware.
Data Warehousing in the Era of Big Data: Deep Dive into Amazon Redshift
by Tony Gibbs, Data Warehouse Specialist SA, AWS
Analyzing big data quickly and efficiently requires a data warehouse optimized to handle and scale for large datasets. Amazon Redshift is a fast, petabyte-scale data warehouse that makes it simple and cost-effective to analyze all of your data for a fraction of the cost of traditional data warehouses. In this session, we take an in-depth look at data warehousing with Amazon Redshift for big data analytics. We cover best practices to take advantage of Amazon Redshift's columnar technology and parallel processing capabilities to deliver high throughput and query performance. We also discuss how to design optimal schemas, load data efficiently, and use work load management.
SQLServer Database Structures
The document provides details about an SQL expert's background and certifications. It summarizes the expert's career starting in 1982 working with computers and 1988 starting in the computer industry. In 1996, they started working with SQL Server 6.0 and have since earned multiple Microsoft certifications. The expert now provides training and consultation services, and created an online school called SQL School Greece to teach SQL Server.
Introduction to Amazon Redshift
Amazon Redshift is a fast, powerful, fully managed data warehouse service that allows for petabyte-scale data warehousing at very low costs. It uses columnar storage and data compression techniques to dramatically reduce I/O and allow for very fast query performance. Redshift automatically provisions clusters on optimized hardware and scales easily from terabytes to petabytes of data with no downtime. It integrates with popular BI tools and simplifies tasks like provisioning, administration, backup/restore and scaling the data warehouse.
Let’s get to know Snowflake
As cloud computing continues to gather speed, organizations with years’ worth of data stored on legacy on-premise technologies are facing issues with scale, speed, and complexity. Your customers and business partners are likely eager to get data from you, especially if you can make the process easy and secure.
Challenges with performance are not uncommon and ongoing interventions are required just to “keep the lights on”.
Discover how Snowflake empowers you to meet your analytics needs by unlocking the potential of your data.
Agenda of Webinar :
~Understand Snowflake and its Architecture
~Quickly load data into Snowflake
~Leverage the latest in Snowflake’s unlimited performance and scale to make the data ready for analytics
~Deliver secure and governed access to all data – no more silos
Perth Azure Usergroup Build 2018 updates
Jonathan & Nirmal presenting on new announcements at Build 2018 conference, and other new capabilities in the Azure Cloud Platform
Azure Data Factory for Redmond SQL PASS UG Sept 2018
Azure Data Factory is a fully managed data integration service in the cloud. It provides a graphical user interface for building data pipelines without coding. Pipelines can orchestrate data movement and transformations across hybrid and multi-cloud environments. Azure Data Factory supports incremental loading, on-demand Spark, and lifting SQL Server Integration Services packages to the cloud.
More Related Content
What's hot
Apache Cassandra Lunch #78: Deploy Cassandra using DSE Operator to Kubernetes
In Cassandra Lunch #78, we will deploy Cassandra using DSE Operator to Kubernetes
Accompanying Blog: https://blog.anant.us/apache-cassandra-lunch-78-cass-operator/
Accompanying YouTube: https://youtu.be/Cfvks4WBtKk
Sign Up For Our Newsletter: http://eepurl.com/grdMkn
Join Cassandra Lunch Weekly at 12 PM EST Every Wednesday: https://www.meetup.com/Cassandra-DataStax-DC/events/
Cassandra.Link:
https://cassandra.link/
Follow Us and Reach Us At:
Anant:
https://www.anant.us/
Awesome Cassandra:
https://github.com/Anant/awesome-cassandra
Cassandra.Lunch:
https://github.com/Anant/Cassandra.Lunch
Email:
solutions@anant.us
LinkedIn:
https://www.linkedin.com/company/anant/
Twitter:
https://twitter.com/anantcorp
Eventbrite:
https://www.eventbrite.com/o/anant-1072927283
Facebook:
https://www.facebook.com/AnantCorp/
Join The Anant Team:
https://www.careers.anant.us
Database Architecture & Scaling Strategies, in the Cloud & on the Rack
Watch the recording here: https://www.youtube.com/watch?v=ZwERp38ynxQ&feature=youtu.be
In this webinar, Robbie Mihayli, VP of Engineering at Clustrix explores how to set up a SQL RDBMS architecture that scales out and is both elastic and consistent, while simultaneously delivering fault tolerance and ACID compliance.
He also covers how data gets distributed in this architecture, how the query processor works, how rebalancing happens and other architectural elements. Examples cited include cloud deployments and e-commerce use-cases.
In this webinar, you will learn:
1. Five RDBMS scaling strategies along with their trade offs
2. The importance of having no single point of failure for OLTP (fault tolerance)
3. The vagaries of the cloud and how it impacts using an RDBMS in the cloud
Who should watch?
1. People interested in high performance, real-time database solutions
2. Companies who have MySQL in their infrastructure and are concerned that their growth will soon overwhelm MySQL’s single-box design
3. DBA’s who implement ‘read slaves’, ‘multiple-masters’ and ‘sharding’ for MySQL databases and want to learn about better ways to scale
Vitalii Bondarenko "Machine Learning on Fast Data"
This document discusses machine learning on fast data. It presents an agenda covering ML on production systems, TensorFlow, Kafka, Docker and Kubernetes. It then describes the machine learning process and shows how an enterprise analytics platform can integrate data sources, a machine learning cluster using Kafka, and data destinations. Details are provided on using TensorFlow for linear regression and neural networks. Apache Kafka is explained as a distributed streaming platform using topics, brokers, and consumer groups. The Confluent platform, KStream and KTable APIs are also summarized. Docker and Kubernetes are mentioned for containerization.
IEEE International Conference on Data Engineering 2015
SK Telecom developed a Hadoop data warehouse (DW) solution to address the high costs and limitations of traditional DW systems for handling big data. The Hadoop DW provides a scalable architecture using Hadoop, Tajo and Spark to cost-effectively store and analyze over 30PB of data across 1000+ nodes. It offers SQL analytics through Tajo for faster querying and easier migration from RDBMS systems. The Hadoop DW has helped SK Telecom and other customers such as semiconductor manufacturers to more affordably store and process massive volumes of both structured and unstructured data for advanced analytics.
Modern ETL: Azure Data Factory, Data Lake, and SQL Database
This document discusses modern Extract, Transform, Load (ETL) tools in Azure, including Azure Data Factory, Azure Data Lake, and Azure SQL Database. It provides an overview of each tool and how they can be used together in a data warehouse architecture with Azure Data Lake acting as the data hub and Azure SQL Database being used for analytics and reporting through the creation of data marts. It also includes two demonstrations, one on Azure Data Factory and another showing Azure Data Lake Store and Analytics.
SQL Server 2016 - Stretch DB
Stretch Database allows migrating historical transactional data from an on-premises SQL Server database transparently to Microsoft Azure cloud storage. It enables seamless queries of data regardless of its location. Some limitations include inability to enforce uniqueness on stretched tables and limitations on allowed actions. Performance can degrade due to the additional overhead of query translation and data movement between on-premises and cloud locations. Remote data files provide an alternative method of archiving to cloud storage without changes to table structures but only overhead is additional latency.
Webinar | Getting Started With Amazon Redshift Spectrum
In the first webinar in our Amazon Redshift Spectrum Series, learn more about getting started with Spectrum.
Spectrum allows you to use the analytic capabilities of Amazon Redshift beyond the data which is in your data warehouse to query large amounts of semistructured and structured data in your “data lake,” without having to load or transform it into Amazon Redshift.
In this webinar learn:
- What is Amazon Redshift Spectrum?
- How to set up AWS Security for Amazon Redshift Spectrum
- What are external schemas and external tables
- How to query S3 data with Redshift SQL via Amazon Redshift Spectrum using Matillion ETL
Hive big-data meetup
1) Hive is a data warehouse infrastructure built on top of Hadoop for querying large datasets stored in HDFS. It provides SQL-like capabilities to analyze data and supports complex queries using a MapReduce execution engine.
2) Hive compiles SQL queries into a directed acyclic graph (DAG) of MapReduce jobs that are executed by Hadoop. The metadata is stored in a metastore (typically an RDBMS).
3) Hive supports advanced features like partitioning, bucketing, acid transactions, and complex types. It can handle petabyte-scale datasets and integrates with the Hadoop ecosystem but has limitations for low-latency queries.
Getting Started With Amazon Redshift
Have you decided on Amazon Redshift as your data warehouse but want to learn the latest tips and tricks to get started? Watch our webinar on Tuesday, August 29th to learn how to get started and how using Redshift can help you quickly and easily analyze your data to make business critical decisions.
A tour of Amazon Redshift
A quick tour in 16 slides of Amazon's Redshift clustered, massively parallel database.
Find out what differentiates it from the other database products Amazon has, including SimpleDB, DynamoDB and RDS (MySQL, SQL Server and Oracle).
Learn how it stores data on disk in a columnar format and how this relates to performance and interesting compression techniques.
Contrast the difference between Redshift and a MySQL instance and discover how the clustered architecture may help to dramatically reduce query time.
AWS Webcast - Redshift Overview and New Features
Amazon Redshift is a fast, fully managed, petabyte-scale data warehouse service that makes it simple and cost-effective to efficiently analyze all your data using your existing business intelligence tools.
This webinar will provide an overview of Redshift with an emphasis on the many changes we recently introduced. In particular, we will address the newly released DW2 instance types and what you can do with them.
This content is designed for database developers and architects interested in Amazon Redshift.
Andriy Zrobok "MS SQL 2019 - new for Big Data Processing"
This document discusses MS SQL Server 2019's capabilities for big data processing through PolyBase and Big Data Clusters. PolyBase allows SQL queries to join data stored externally in sources like HDFS, Oracle and MongoDB. Big Data Clusters deploy SQL Server on Linux in Kubernetes containers with separate control, compute and storage planes to provide scalable analytics on large datasets. Examples of using these technologies include data virtualization across sources, building data lakes in HDFS, distributed data marts for analysis, and integrated AI/ML tasks on HDFS and SQL data.
Spark streaming , Spark SQL
Spark Streaming allows processing of live data streams in Spark. It integrates streaming data and batch processing within the same Spark application. Spark SQL provides a programming abstraction called DataFrames and can be used to query structured data in Spark. Structured Streaming in Spark 2.0 provides a high-level API for building streaming applications on top of Spark SQL's engine. It allows running the same queries on streaming data as on batch data and unifies streaming, interactive, and batch processing.
Best practices for Data warehousing with Amazon Redshift - AWS PS Summit Canb...
Get a look under the hood: Understand how to take advantage of Amazon Redshift's columnar technology and parallel processing capabilities to improve your delivery of queries and improve overall database performance. You’ll also hear about how the University of Technology Sydney (UTS) are using Redshift. The University of Technology Sydney will describe how utilizing Amazon Redshift enabled agility in dealing with Data Quality, a capacity to scale when required, and optimizing development processes through rapid provisioning of Data Warehouse environments.
Speaker: Ganesh Raja, Solutions Architect, Amazon Web Services with Susan Gibson, Manager, Data and Business Intelligence, UTS
Level: 300
An intro to Azure Data Lake
Here are the slides for my talk "An intro to Azure Data Lake" at Techorama NL 2018. The session was held on Tuesday October 2nd from 15:00 - 16:00 in room 7.
[よくわかるAmazon Redshift in 大阪]Amazon Redshift最新情報と導入事例のご紹介
Amazon Redshift is a fully managed petabyte-scale data warehouse service in the cloud. It provides fast query performance at a very low cost. Updates since re:Invent 2013 include new features like distributed tables, remote data loading, approximate count distinct, and workload queue memory management. Customers have seen query performance improvements of 20-100x compared to Hive and cost reductions of 50-80%. Amazon Redshift makes it easy to setup, operate, and scale a data warehouse without having to worry about provisioning and managing hardware.
Data Warehousing in the Era of Big Data: Deep Dive into Amazon Redshift
by Tony Gibbs, Data Warehouse Specialist SA, AWS
Analyzing big data quickly and efficiently requires a data warehouse optimized to handle and scale for large datasets. Amazon Redshift is a fast, petabyte-scale data warehouse that makes it simple and cost-effective to analyze all of your data for a fraction of the cost of traditional data warehouses. In this session, we take an in-depth look at data warehousing with Amazon Redshift for big data analytics. We cover best practices to take advantage of Amazon Redshift's columnar technology and parallel processing capabilities to deliver high throughput and query performance. We also discuss how to design optimal schemas, load data efficiently, and use work load management.
SQLServer Database Structures
The document provides details about an SQL expert's background and certifications. It summarizes the expert's career starting in 1982 working with computers and 1988 starting in the computer industry. In 1996, they started working with SQL Server 6.0 and have since earned multiple Microsoft certifications. The expert now provides training and consultation services, and created an online school called SQL School Greece to teach SQL Server.
Introduction to Amazon Redshift
Amazon Redshift is a fast, powerful, fully managed data warehouse service that allows for petabyte-scale data warehousing at very low costs. It uses columnar storage and data compression techniques to dramatically reduce I/O and allow for very fast query performance. Redshift automatically provisions clusters on optimized hardware and scales easily from terabytes to petabytes of data with no downtime. It integrates with popular BI tools and simplifies tasks like provisioning, administration, backup/restore and scaling the data warehouse.
Let’s get to know Snowflake
As cloud computing continues to gather speed, organizations with years’ worth of data stored on legacy on-premise technologies are facing issues with scale, speed, and complexity. Your customers and business partners are likely eager to get data from you, especially if you can make the process easy and secure.
Challenges with performance are not uncommon and ongoing interventions are required just to “keep the lights on”.
Discover how Snowflake empowers you to meet your analytics needs by unlocking the potential of your data.
Agenda of Webinar :
~Understand Snowflake and its Architecture
~Quickly load data into Snowflake
~Leverage the latest in Snowflake’s unlimited performance and scale to make the data ready for analytics
~Deliver secure and governed access to all data – no more silos
What's hot (20)
Apache Cassandra Lunch #78: Deploy Cassandra using DSE Operator to Kubernetes
Apache Cassandra Lunch #78: Deploy Cassandra using DSE Operator to Kubernetes
Database Architecture & Scaling Strategies, in the Cloud & on the Rack
Database Architecture & Scaling Strategies, in the Cloud & on the Rack
Vitalii Bondarenko "Machine Learning on Fast Data"
Vitalii Bondarenko "Machine Learning on Fast Data"
IEEE International Conference on Data Engineering 2015
IEEE International Conference on Data Engineering 2015
Modern ETL: Azure Data Factory, Data Lake, and SQL Database
Modern ETL: Azure Data Factory, Data Lake, and SQL Database
Webinar | Getting Started With Amazon Redshift Spectrum
Webinar | Getting Started With Amazon Redshift Spectrum
Andriy Zrobok "MS SQL 2019 - new for Big Data Processing"
Andriy Zrobok "MS SQL 2019 - new for Big Data Processing"
Best practices for Data warehousing with Amazon Redshift - AWS PS Summit Canb...
Best practices for Data warehousing with Amazon Redshift - AWS PS Summit Canb...
[よくわかるAmazon Redshift in 大阪]Amazon Redshift最新情報と導入事例のご紹介
[よくわかるAmazon Redshift in 大阪]Amazon Redshift最新情報と導入事例のご紹介
Data Warehousing in the Era of Big Data: Deep Dive into Amazon Redshift
Data Warehousing in the Era of Big Data: Deep Dive into Amazon Redshift
Similar to Blue Sky Thinking
Perth Azure Usergroup Build 2018 updates
Jonathan & Nirmal presenting on new announcements at Build 2018 conference, and other new capabilities in the Azure Cloud Platform
Azure Data Factory for Redmond SQL PASS UG Sept 2018
Azure Data Factory is a fully managed data integration service in the cloud. It provides a graphical user interface for building data pipelines without coding. Pipelines can orchestrate data movement and transformations across hybrid and multi-cloud environments. Azure Data Factory supports incremental loading, on-demand Spark, and lifting SQL Server Integration Services packages to the cloud.
Azure Data Factory for Azure Data Week
The document discusses Azure Data Factory and its capabilities for cloud-first data integration and transformation. ADF allows orchestrating data movement and transforming data at scale across hybrid and multi-cloud environments using a visual, code-free interface. It provides serverless scalability without infrastructure to manage along with capabilities for lifting and running SQL Server Integration Services packages in Azure.
Microsoft Azure Tutorial | Microsoft Cloud Computing | Microsoft Azure Traini...
This Microsoft Azure Tutorial will get your basics right about Microsoft Azure. It starts from the basics, so shall be helpful to a beginner who doesn't know anything about Cloud Computing as well. Below are the topics covered in this tutorial:
1) What is Cloud?
2) What is Microsoft Azure?
3) Azure Job Trends
4) Different Domains in Azure
5) Azure Services
6) Azure Pricing Options
7) Demo on Azure
8) Azure Certifications
To take a structured training on Microsoft Azure, you can check complete details of our Microsoft Azure Certification Training course here: https://goo.gl/585NMJ
Azure SQL DB Managed Instances Built to easily modernize application data layer
Azure SQL DB Managed Instances Built to easily modernize application data layerMicrosoft Tech Community
The document discusses Azure SQL Database Managed Instance, a new fully managed database service that provides SQL Server compatibility. It offers seamless migration of SQL Server workloads to the cloud with full compatibility, isolation, security and manageability. Customers can realize up to a 406% ROI over on-premises solutions through lower TCO, automatic management and scaling capabilities.USQ Landdemos Azure Data Lake
This is a presentation about big data solutions on Microsoft Azure held at the Trivadis Azure Data Lake Event.
Ready for take-off - How to get your databases into the cloud
This document discusses options for migrating databases to the cloud using Azure services. It introduces Azure Database Migration Service (DMS) which provides a seamless way to migrate databases from on-premises SQL Server, Oracle and other platforms to Azure SQL Database. It offers pricing information for DMS, noting a limited-time free preview promotion. Additional resources and steps for planning a modern data estate journey to the cloud are outlined.
Azure SQL Data Warehouse
This document provides an overview of Azure SQL Data Warehouse. It discusses what Azure SQL Data Warehouse is, how it is provisioned and scaled, best practices for designing tables in Azure SQL DW including distribution keys and data types, and methods for loading and querying data including PolyBase and labeling queries for monitoring. The presentation also covers tuning aspects like statistics, indexing, and resource classes.
Migrating to Amazon RDS with Database Migration Service
The document provides an overview of database migration options using AWS Database Migration Service (DMS) and AWS Schema Conversion Tool (SCT). It discusses how DMS can be used to migrate databases across different database platforms with minimal downtime. It also outlines how SCT can be used to convert schemas from commercial databases to open-source databases like PostgreSQL. The document shares customer examples and benefits of using DMS and SCT for heterogeneous, scale-up, and split migrations. It also lists available resources for customers on DMS and SCT.
Azure vm introduction
We have discussed on azure virtual machines and provides the wider information on azure which will help to understand the azure modules
AWS Data migration services
The document provides an overview of AWS Database Migration Service (AWS DMS). It explains that AWS DMS allows users to easily and securely migrate or replicate databases to AWS. It describes how to use AWS DMS by creating a replication instance, specifying source and target endpoints, and then creating a migration task to transfer data from the source to target. Key aspects of the replication instance, endpoints, and tasks are also defined.
NoSQL's biggest lie: SQL never went away - Martin Esmann
The document discusses the capabilities of SQL querying for JSON data using N1QL in Couchbase Server 4.0. It begins with an introduction to NoSQL and shows how Couchbase allows SQL-like querying of JSON documents through N1QL. Examples are provided of basic queries with SELECT statements on sample JSON user profile and travel data, including filtering, aggregations, array operations, and joins. The document contrasts N1QL with traditional NoSQL querying methods and views, and discusses how Couchbase enables independent horizontal scaling of data, query, and indexing workloads through its multi-dimensional architecture.
OSS DB on Azure
This document provides an overview of using open source databases on Microsoft Azure. It discusses trends in open source databases and how Azure supports popular open source databases like MySQL, MariaDB, and PostgreSQL as fully managed database services. It covers benefits of migrating on-premises or third party databases to Azure databases, including cost savings, global scale, built-in high availability, security, and integration with other Azure services. Migration from commercial databases like Oracle to open source databases on Azure like PostgreSQL is also discussed.
Azure Databricks – Customer Experiences and Lessons Denzil Ribeiro Madhu Ganta
Spark is fast becoming a critical part of Customer Solutions on Azure. Databricks on Microsoft Azure provides a first-class experience for building and running Spark applications. The Microsoft Azure CAT team engaged with many early adopter customers helping them build their solutions on Azure Databricks.
In this session, we begin by reviewing typical workload patterns, integration with other Azure services like Azure Storage, Azure Data Lake, IoT / Event Hubs, SQL DW, PowerBI etc. Most importantly, we will share real-world tips and learnings that you can take and apply in your Data Engineering / Data Science workloads
New capabilities for modern data integration in the cloud
This document provides an overview of how to configure an Azure-SSIS Integration Runtime (IR) within Azure Data Factory. It describes the steps to name and describe the IR, select its location, node size, cluster size, edition/license, and connect it to an existing Azure SQL Database or Managed Instance that will host the SSIS catalog database. It also covers options for using Azure Active Directory authentication or bringing your own Azure SQL credentials. The document guides users through the entire configuration process for an Azure-SSIS IR within Azure Data Factory.
New capabilities for modern data integration in the cloud
The document describes how Azure Data Factory can be used to orchestrate data pipelines and execute SSIS packages in the cloud. It provides an overview of key capabilities like lifting and shifting existing SSIS packages to Azure, using various Azure services like SQL Data Warehouse and Databricks in data pipelines, and orchestrating workflows. It also discusses how Azure Data Factory allows scheduling SSIS package execution in a managed cloud environment using familiar SSIS authoring and monitoring tools.
ADF Mapping Data Flows Training Slides V1
Mapping Data Flow is a new feature of Azure Data Factory that allows users to build data transformations in a visual interface without code. It provides a serverless, scale-out transformation engine to transform data at scale in the cloud in a resilient manner for big data scenarios involving unstructured data. Mapping Data Flows can be operationalized with Azure Data Factory's scheduling, control flow, and monitoring capabilities.
Bridging to a hybrid cloud data services architecture
Enterprises are increasingly evolving their data infrastructures into entire cloud-facing environments. Interfacing private and public cloud data assets is a hallmark of initiatives such as logical data warehouses, data lakes and online transactional data hubs. These projects may involve deploying two or more of the following cloud-based data platforms into a hybrid architecture: Apache Hadoop, data warehouses, graph databases, NoSQL databases, multiworkload SQL databases, open source databases, data refineries and predictive analytics.
Data application developers, data scientists and analytics professionals are driving their organizations’ efforts to bridge their data to the cloud. Several questions are of keen interest to those who are driving an organization’s evolution of its data and analytics initiatives into more holistic cloud-facing environments:
• What is a hybrid cloud data services architecture?
• What are the chief applications and benefits of a hybrid cloud data services architecture?
• What are the best practices for bridging a logical data warehouse to the cloud?
• What are the best practices for bridging advanced analytics and data lakes to the cloud?
• What are the best practices for bridging an enterprise database hub to the cloud?
• What are the first steps to take for bridging private data assets to the cloud?
• How can you measure ROI from bridging private data to public cloud data services?
• Which case studies illustrate the value of bridging private data to the cloud?
Sign up now for a free 3-month trial of IBM Analytics for Apache Spark and IBM Cloudant, IBM dashDB or IBM DB2 on Cloud.
http://ibm.co/ibm-cloudant-trial
http://ibm.co/ibm-dashdb-trial
http://ibm.co/ibm-db2-trial
http://ibm.co/ibm-spark-trial
Azuresatpn19 - An Introduction To Azure Data Factory
Slide deck of my session during Azure Saturday 2019 in Pordenone.
We spoke about Azure Data Factory v2.
Cepta The Future of Data with Power BI
This document discusses the future of data and the Azure data ecosystem. It highlights that by 2025 there will be 175 zettabytes of data in the world and the average person will have over 5,000 digital interactions per day. It promotes Azure services like Power BI, Azure Synapse Analytics, Azure Data Factory and Azure Machine Learning for extracting value from data through analytics, visualization and machine learning. The document provides overviews of key Azure data and analytics services and how they fit together in an end-to-end data platform for business intelligence, artificial intelligence and continuous intelligence applications.
Similar to Blue Sky Thinking (20)
Azure Data Factory for Redmond SQL PASS UG Sept 2018
Azure Data Factory for Redmond SQL PASS UG Sept 2018
Microsoft Azure Tutorial | Microsoft Cloud Computing | Microsoft Azure Traini...
Microsoft Azure Tutorial | Microsoft Cloud Computing | Microsoft Azure Traini...
Azure SQL DB Managed Instances Built to easily modernize application data layer
Azure SQL DB Managed Instances Built to easily modernize application data layer
Ready for take-off - How to get your databases into the cloud
Ready for take-off - How to get your databases into the cloud
Migrating to Amazon RDS with Database Migration Service
Migrating to Amazon RDS with Database Migration Service
NoSQL's biggest lie: SQL never went away - Martin Esmann
NoSQL's biggest lie: SQL never went away - Martin Esmann
Azure Databricks – Customer Experiences and Lessons Denzil Ribeiro Madhu Ganta
Azure Databricks – Customer Experiences and Lessons Denzil Ribeiro Madhu Ganta
New capabilities for modern data integration in the cloud
New capabilities for modern data integration in the cloud
New capabilities for modern data integration in the cloud
New capabilities for modern data integration in the cloud
Bridging to a hybrid cloud data services architecture
Bridging to a hybrid cloud data services architecture
Azuresatpn19 - An Introduction To Azure Data Factory
Azuresatpn19 - An Introduction To Azure Data Factory
Recently uploaded
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-und-domino-lizenzkostenreduzierung-in-der-welt-von-dlau/
DLAU und die Lizenzen nach dem CCB- und CCX-Modell sind für viele in der HCL-Community seit letztem Jahr ein heißes Thema. Als Notes- oder Domino-Kunde haben Sie vielleicht mit unerwartet hohen Benutzerzahlen und Lizenzgebühren zu kämpfen. Sie fragen sich vielleicht, wie diese neue Art der Lizenzierung funktioniert und welchen Nutzen sie Ihnen bringt. Vor allem wollen Sie sicherlich Ihr Budget einhalten und Kosten sparen, wo immer möglich. Das verstehen wir und wir möchten Ihnen dabei helfen!
Wir erklären Ihnen, wie Sie häufige Konfigurationsprobleme lösen können, die dazu führen können, dass mehr Benutzer gezählt werden als nötig, und wie Sie überflüssige oder ungenutzte Konten identifizieren und entfernen können, um Geld zu sparen. Es gibt auch einige Ansätze, die zu unnötigen Ausgaben führen können, z. B. wenn ein Personendokument anstelle eines Mail-Ins für geteilte Mailboxen verwendet wird. Wir zeigen Ihnen solche Fälle und deren Lösungen. Und natürlich erklären wir Ihnen das neue Lizenzmodell.
Nehmen Sie an diesem Webinar teil, bei dem HCL-Ambassador Marc Thomas und Gastredner Franz Walder Ihnen diese neue Welt näherbringen. Es vermittelt Ihnen die Tools und das Know-how, um den Überblick zu bewahren. Sie werden in der Lage sein, Ihre Kosten durch eine optimierte Domino-Konfiguration zu reduzieren und auch in Zukunft gering zu halten.
Diese Themen werden behandelt
- Reduzierung der Lizenzkosten durch Auffinden und Beheben von Fehlkonfigurationen und überflüssigen Konten
- Wie funktionieren CCB- und CCX-Lizenzen wirklich?
- Verstehen des DLAU-Tools und wie man es am besten nutzt
- Tipps für häufige Problembereiche, wie z. B. Team-Postfächer, Funktions-/Testbenutzer usw.
- Praxisbeispiele und Best Practices zum sofortigen Umsetzen
Mind map of terminologies used in context of Generative AI
Mind map of common terms used in context of Generative AI.
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
Essentials of Automations: The Art of Triggers and Actions in FME
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
Communications Mining Series - Zero to Hero - Session 1
This session provides introduction to UiPath Communication Mining, importance and platform overview. You will acquire a good understand of the phases in Communication Mining as we go over the platform with you. Topics covered:
• Communication Mining Overview
• Why is it important?
• How can it help today’s business and the benefits
• Phases in Communication Mining
• Demo on Platform overview
• Q/A
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Are you ready to revolutionize how you handle data? Join us for a webinar where we’ll bring you up to speed with the latest advancements in Generative AI technology and discover how leveraging FME with tools from giants like Google Gemini, Amazon, and Microsoft OpenAI can supercharge your workflow efficiency.
During the hour, we’ll take you through:
Guest Speaker Segment with Hannah Barrington: Dive into the world of dynamic real estate marketing with Hannah, the Marketing Manager at Workspace Group. Hear firsthand how their team generates engaging descriptions for thousands of office units by integrating diverse data sources—from PDF floorplans to web pages—using FME transformers, like OpenAIVisionConnector and AnthropicVisionConnector. This use case will show you how GenAI can streamline content creation for marketing across the board.
Ollama Use Case: Learn how Scenario Specialist Dmitri Bagh has utilized Ollama within FME to input data, create custom models, and enhance security protocols. This segment will include demos to illustrate the full capabilities of FME in AI-driven processes.
Custom AI Models: Discover how to leverage FME to build personalized AI models using your data. Whether it’s populating a model with local data for added security or integrating public AI tools, find out how FME facilitates a versatile and secure approach to AI.
We’ll wrap up with a live Q&A session where you can engage with our experts on your specific use cases, and learn more about optimizing your data workflows with AI.
This webinar is ideal for professionals seeking to harness the power of AI within their data management systems while ensuring high levels of customization and security. Whether you're a novice or an expert, gain actionable insights and strategies to elevate your data processes. Join us to see how FME and AI can revolutionize how you work with data!
20240607 QFM018 Elixir Reading List May 2024
Everything I found interesting about the Elixir programming ecosystem in May 2024
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
Imagine a world where machines not only perform tasks but also learn, adapt, and make decisions. This is the promise of Artificial Intelligence (AI), a technology that's not just enhancing our lives but revolutionizing entire industries.
Best 20 SEO Techniques To Improve Website Visibility In SERP
Boost your website's visibility with proven SEO techniques! Our latest blog dives into essential strategies to enhance your online presence, increase traffic, and rank higher on search engines. From keyword optimization to quality content creation, learn how to make your site stand out in the crowded digital landscape. Discover actionable tips and expert insights to elevate your SEO game.
TrustArc Webinar - 2024 Global Privacy Survey
How does your privacy program stack up against your peers? What challenges are privacy teams tackling and prioritizing in 2024?
In the fifth annual Global Privacy Benchmarks Survey, we asked over 1,800 global privacy professionals and business executives to share their perspectives on the current state of privacy inside and outside of their organizations. This year’s report focused on emerging areas of importance for privacy and compliance professionals, including considerations and implications of Artificial Intelligence (AI) technologies, building brand trust, and different approaches for achieving higher privacy competence scores.
See how organizational priorities and strategic approaches to data security and privacy are evolving around the globe.
This webinar will review:
- The top 10 privacy insights from the fifth annual Global Privacy Benchmarks Survey
- The top challenges for privacy leaders, practitioners, and organizations in 2024
- Key themes to consider in developing and maintaining your privacy program
Climate Impact of Software Testing at Nordic Testing Days
My slides at Nordic Testing Days 6.6.2024
Climate impact / sustainability of software testing discussed on the talk. ICT and testing must carry their part of global responsibility to help with the climat warming. We can minimize the carbon footprint but we can also have a carbon handprint, a positive impact on the climate. Quality characteristics can be added with sustainability, and then measured continuously. Test environments can be used less, and in smaller scale and on demand. Test techniques can be used in optimizing or minimizing number of tests. Test automation can be used to speed up testing.
Presentation of the OECD Artificial Intelligence Review of Germany
Consult the full report at https://www.oecd.org/digital/oecd-artificial-intelligence-review-of-germany-609808d6-en.htm
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
Neha Bajwa, Vice President of Product Marketing, Neo4j
Join us as we explore breakthrough innovations enabled by interconnected data and AI. Discover firsthand how organizations use relationships in data to uncover contextual insights and solve our most pressing challenges – from optimizing supply chains, detecting fraud, and improving customer experiences to accelerating drug discoveries.
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
ABSTRACT: A prima vista, un mattoncino Lego e la backdoor XZ potrebbero avere in comune il fatto di essere entrambi blocchi di costruzione, o dipendenze di progetti creativi e software. La realtà è che un mattoncino Lego e il caso della backdoor XZ hanno molto di più di tutto ciò in comune.
Partecipate alla presentazione per immergervi in una storia di interoperabilità, standard e formati aperti, per poi discutere del ruolo importante che i contributori hanno in una comunità open source sostenibile.
BIO: Sostenitrice del software libero e dei formati standard e aperti. È stata un membro attivo dei progetti Fedora e openSUSE e ha co-fondato l'Associazione LibreItalia dove è stata coinvolta in diversi eventi, migrazioni e formazione relativi a LibreOffice. In precedenza ha lavorato a migrazioni e corsi di formazione su LibreOffice per diverse amministrazioni pubbliche e privati. Da gennaio 2020 lavora in SUSE come Software Release Engineer per Uyuni e SUSE Manager e quando non segue la sua passione per i computer e per Geeko coltiva la sua curiosità per l'astronomia (da cui deriva il suo nickname deneb_alpha).
National Security Agency - NSA mobile device best practices
Threats to mobile devices are more prevalent and increasing in scope and complexity. Users of mobile devices desire to take full advantage of the features
available on those devices, but many of the features provide convenience and capability but sacrifice security. This best practices guide outlines steps the users can take to better protect personal devices and information.
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
Maruthi Prithivirajan, Head of ASEAN & IN Solution Architecture, Neo4j
Get an inside look at the latest Neo4j innovations that enable relationship-driven intelligence at scale. Learn more about the newest cloud integrations and product enhancements that make Neo4j an essential choice for developers building apps with interconnected data and generative AI.
20240605 QFM017 Machine Intelligence Reading List May 2024
Everything I found interesting about machines behaving intelligently during May 2024
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
As the digital landscape continually evolves, operating systems play a critical role in shaping user experiences and productivity. The launch of Nitrux Linux 3.5.0 marks a significant milestone, offering a robust alternative to traditional systems such as Windows 11. This article delves into the essence of Nitrux Linux 3.5.0, exploring its unique features, advantages, and how it stands as a compelling choice for both casual users and tech enthusiasts.
Recently uploaded (20)
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Blue Sky Thinking
- 1. BLUE SKY THINKING SQL Azure Geospatial Mashup
- 2. ABOUT ME ▪ Thomas Sykes ▪ Data Platform Consultant for Quorum in Edinburgh ▪ Using SQL Server since version 7.0 ▪ MCDBA, MCITP and MCSE in SQL Server ▪ MCS in Azure Implementation and Hyper-V ▪ Certified Technical Trainer
- 3. THIS SESSION ▪ SQL Azure with Geospatial Data ▪ Azure Websites with Bing Maps ▪ Integrate another live data source
- 5. AZURE SQL DATABASE ▪ Windows Azure SQL Database ▪ Microsoft’s PaaS offering for SQL Server Database Engine ▪ With V12 is much closer to our IaaS or On- Premise Database Engine ▪ Scalable with various options from Basic development to Mission Critical Premium
- 6. AZURE SQL DATABASE ▪ Connect straight from Management Studio once you’ve allowed access ▪ Database size based on DTU’s ▪ Actively developing
- 8. NEW AZURE SQL DATABASE
- 9. AZURE WEB HOSTING ▪ Azure Websites - Microsoft’s Web Hosting Offering ▪ Various Tiers from Free, Shared, Basic, Standard Tier ▪ Scalable -More servers/Bigger servers ▪ Staged Publishing/Deployment slots ▪ http://<site>-<slot name>.azurewebsites.net/
- 11. NEW AZURE WEB HOSTING
- 12. SQL SPATIAL ▪ A spatial data type, such as geography (or geometry) can be indexed with a spatial index ▪ Various functions supported by spatial indexes ▪ We will use the STDistance function ▪ Returns the shortest distance between two geography points
- 13. DATA - GEOSPATIALS ▪ Get started with free digital map data ▪ OS Locator - A searchable gazetteer of road namesWe need current postcode’s ▪ Code-Point Open - All of the current postcode
- 14. DATABASE – POSTCODES For the postcodes table the obvious candidate for clustered index is the postcode field
- 15. DATABASE – HILLS For the Hills table a natural unique index would Latitude and Longitude
- 16. DATABASE Spatial Reference System Identifier (SRID) WGS84 — SRID 4326 "The World Geodetic System (WGS) is a standard for use in cartography, geodesy, and navigation. It comprises a standard coordinate system for the Earth, a standard spheroidal reference surface (the datum or reference ellipsoid) for raw altitude data, and a gravitational equipotential surface (the geoid) that defines the nominal sea level." - Wikipedia
- 17. DATABASE Loch Ness Centre Exhibition Experience at IV63 6TU
- 18. DATABASE Using nearest neighbour in SQL Azure we get the results:
- 19. DEMO
- 20. BING MAPS - RENDER
- 21. DATA – WEATHER DataPoint is a way of accessing freely available Met Office data feeds in a format that is suitable for application developers. UK 3-hourly site-specific forecast - A quality controlled forecast out to 5 days for more than 5,000 locations. The DataPoint service is operating as BETA
- 23. DATA – WEATHER – STATION DATA We can either get an XML stream or download the weather station locations as below;
- 24. DATA – WEATHER - GET STATION DECLARE @CurrentLocation geography SET @CurrentLocation = geography::Point(@lat, @long, 4326) SELECT TOP(1) ID,name, ROUND(GeoLocation.STDistance(@CurrentLocation)/ 1000,2) AS [Distance (Km)] FROM [dbo].[WeatherPlaces] WITH(INDEX([ix_GeoLocation])) WHERE GeoLocation.STDistance(@CurrentLocation) IS NOT NULL ORDER BY GeoLocation.STDistance(@CurrentLocation) ASC
- 25. DATA – WEATHER
- 26. DATA – DISPLAY WEATHER
- 27. THE SITE - VIDEO
- 28. USEFUL LINKS ▪ Azure ▪ http://azure.microsoft.com/en-us/documentation/articles/sql-database-preview- whats-new/ ▪ http://azure.microsoft.com/en-us/pricing/details/sql-database/ ▪ http://azure.microsoft.com/en-us/documentation/articles/sql-database-elastic- scale-get-started/ ▪ OS ▪ http://www.ordnancesurvey.co.uk/business-and-government/products/opendata- products.html ▪ Met Office - DataPoint ▪ http://www.metoffice.gov.uk/datapoint
- 29. CONTACT ▪ Thomas Sykes ▪ Blog: sqltomato.com ▪ twitter: @sqltomato ▪ email: tom@sqltomato.com
- 30. THANK YOU