Big query for data analysis quest
•Download as PPTX, PDF•
0 likes•66 views
BigQuery is an analytics engine that allows users to run SQL queries on large datasets stored in Google Cloud. The document discusses what BigQuery is, its components like projects, datasets and tables, and how to load databases into BigQuery from Cloud Storage and execute queries. It also covers exporting query results to CSV format and loading CSV files into Cloud SQL for analysis, as well as introducing the basics of SQL and CSV file formats.
Report
Share
Report
Share
Recommended
Azure Big Data Story
This document discusses Azure big data capabilities including the 5 V's of big data: volume, velocity, variety, veracity, and value. It notes that 60% of big data projects fail to move beyond pilot according to Gartner. It then provides details on Azure persistence choices for storing big data including storage, Data Lake, HDInsight, DocumentDB, SQL databases, and Hadoop options. It also discusses load and data cleaning choices on Azure like Stream Analytics, SQL Server, and Azure Machine Learning. Finally, it presents 5 architectural patterns for using Azure big data capabilities.
Database Choices
The document discusses database choices and provides an overview of different types of databases including relational, NoSQL, and Hadoop databases. It compares features of relational databases versus Hadoop/MapReduce and provides demos of various database options like AWS DynamoDB, MongoDB, Neo4j, SQL Server, and AWS Redshift. The document aims to help readers understand the different database choices available and which types may be best suited to different types of data and use cases.
Using Couchbase and Elasticsearch as data layers
This document summarizes Sizmek's use of Couchbase and Elasticsearch as their data layer technologies. They use Couchbase for its fast reads/writes and support for large, unstructured data volumes. Elasticsearch is used for its full-text search capabilities. Some key points:
- Couchbase is used for its JSON support, indexing, querying abilities, and cross data center replication. N1QL is used for queries.
- Elasticsearch faces consistency issues in clustered environments that can cause test failures. Solutions include waiting before checking for updates or using refresh to force index updates.
- Maintaining uniqueness constraints is done by saving uniqueness documents with entity names as keys and IDs as values.
- The Java
TechDays NL 2016 - Building your scalable secure IoT Solution on Azure
The Internet-of-Things was one of the big hypes in 2015 but it’s more than that – Customers want to build out their own infrastructures and act on their data.
Today we’ll look at how Microsoft Azure helps us to build scalable solutions to process events from thousands of devices in a secure manner and the challenges it has. Once the data is in the cloud we’ll also take a look at ways we can learn from our measurements.
SSDT-Database Project
The document discusses a database project in SQL Server Data Tools, which allows for offline development of SQL Server databases through a project-based approach. It provides an outline and overview of database projects, including their benefits like developer isolation, rich T-SQL support, error checking and coding standards enforcement. The document then describes a practical demonstration of creating a database project, importing a database, performing code reviews and schema compares, and versioning database objects.
Why Elastic? @ 50th Vinitaly 2016
Why do companies as different as Wikipedia, Netflix, USAA and NASA use the Elastic stack? And why should you, too?
Big data in Azure
This document discusses Big Data solutions in Microsoft Azure. It introduces Azure cloud services and provides an overview of Big Data and how it differs from traditional databases. It then outlines Microsoft's Big Data solutions built on Hortonworks Data Platform, including HDInsight which allows running Hadoop on Azure. HDInsight supports various data storage options and processing tools like Hive, Pig, and Storm. The document also covers designing HDInsight clusters and Azure Data Lake for unlimited storage of structured and unstructured data.
Solucion de BI en Azure
Material de la charla que presente en el azure bootcamp buenos aires 2018 sobre un overview de una solución de BI en azure
Recommended
Azure Big Data Story
This document discusses Azure big data capabilities including the 5 V's of big data: volume, velocity, variety, veracity, and value. It notes that 60% of big data projects fail to move beyond pilot according to Gartner. It then provides details on Azure persistence choices for storing big data including storage, Data Lake, HDInsight, DocumentDB, SQL databases, and Hadoop options. It also discusses load and data cleaning choices on Azure like Stream Analytics, SQL Server, and Azure Machine Learning. Finally, it presents 5 architectural patterns for using Azure big data capabilities.
Database Choices
The document discusses database choices and provides an overview of different types of databases including relational, NoSQL, and Hadoop databases. It compares features of relational databases versus Hadoop/MapReduce and provides demos of various database options like AWS DynamoDB, MongoDB, Neo4j, SQL Server, and AWS Redshift. The document aims to help readers understand the different database choices available and which types may be best suited to different types of data and use cases.
Using Couchbase and Elasticsearch as data layers
This document summarizes Sizmek's use of Couchbase and Elasticsearch as their data layer technologies. They use Couchbase for its fast reads/writes and support for large, unstructured data volumes. Elasticsearch is used for its full-text search capabilities. Some key points:
- Couchbase is used for its JSON support, indexing, querying abilities, and cross data center replication. N1QL is used for queries.
- Elasticsearch faces consistency issues in clustered environments that can cause test failures. Solutions include waiting before checking for updates or using refresh to force index updates.
- Maintaining uniqueness constraints is done by saving uniqueness documents with entity names as keys and IDs as values.
- The Java
TechDays NL 2016 - Building your scalable secure IoT Solution on Azure
The Internet-of-Things was one of the big hypes in 2015 but it’s more than that – Customers want to build out their own infrastructures and act on their data.
Today we’ll look at how Microsoft Azure helps us to build scalable solutions to process events from thousands of devices in a secure manner and the challenges it has. Once the data is in the cloud we’ll also take a look at ways we can learn from our measurements.
SSDT-Database Project
The document discusses a database project in SQL Server Data Tools, which allows for offline development of SQL Server databases through a project-based approach. It provides an outline and overview of database projects, including their benefits like developer isolation, rich T-SQL support, error checking and coding standards enforcement. The document then describes a practical demonstration of creating a database project, importing a database, performing code reviews and schema compares, and versioning database objects.
Why Elastic? @ 50th Vinitaly 2016
Why do companies as different as Wikipedia, Netflix, USAA and NASA use the Elastic stack? And why should you, too?
Big data in Azure
This document discusses Big Data solutions in Microsoft Azure. It introduces Azure cloud services and provides an overview of Big Data and how it differs from traditional databases. It then outlines Microsoft's Big Data solutions built on Hortonworks Data Platform, including HDInsight which allows running Hadoop on Azure. HDInsight supports various data storage options and processing tools like Hive, Pig, and Storm. The document also covers designing HDInsight clusters and Azure Data Lake for unlimited storage of structured and unstructured data.
Solucion de BI en Azure
Material de la charla que presente en el azure bootcamp buenos aires 2018 sobre un overview de una solución de BI en azure
Spring + QueryDSL + MongoDB Presentation
This document summarizes a presentation about Spring, Querydsl, and MongoDB. It introduces Spring and Spring Data frameworks, which make it easier to build Java applications and access data. It also describes Querydsl, a query building tool that works with Spring Data. The presentation demonstrates how to use Spring Data and Querydsl with MongoDB, a non-relational database, to build applications that can query and retrieve data from MongoDB in a type-safe way. Examples of building queries, entities, and repositories are provided.
Elasticsearch and the Database Market
The number of databases and database technologies has grown considerably. Databases are also becoming more and more application specific. Neither end of the spectrum is easy to manage. That's how database-as-a-service (DBaaS) can help. You can limit the number of technologies and still be flexible.
Analyzing StackExchange Data with Azure Data Lake (Tom Kerkhove @ Integration...
Why should we care about Big Data? Tom Kerkhove, Integration Professional at Codit, explains it all in this presentation.
BigQuery for the Big Data win
This document discusses Google BigQuery, a tool for analyzing large datasets that is fast, easy to use, and cost effective. It provides SQL-like queries against nested and columnar data stored in Google's infrastructure. Developers can access BigQuery through Google Cloud Storage, a REST API, or command line tools. BigQuery handles the infrastructure maintenance and offers on-demand or reserved pricing models.
Дмитрий Попович "How to build a data warehouse?"
To build a data warehouse, Tubular ingests raw data from multiple sources using Kafka and stores it permanently. The data is normalized using Spark - duplicates are removed, data is partitioned by time, and sources are joined. A metadata storage using Hive Metastore allows unified access to datasets discovered across various storage formats like Parquet and Avro. This centralized repository helps engineers, analysts and services access and analyze disparate data.
Big problems Big Data, simple solutions
How can you squeeze money from your big data, a real case scenario with Mondadori
AWSome Day Geneva 31/05/2017
Data mining by example forecasting and cross prediction using microsoft time ...
This document discusses using Microsoft Time Series for forecasting and cross prediction. It describes setting up a data mining project in SQL Server to create a time series mining structure and model using sales history from AdventureWorksDW. The model is processed, viewed, and queried to forecast trends and make predictions. Additional data can be added to the model using DMX, and cross prediction is demonstrated by creating new queries and mining structures. Microsoft Time Series provides an intuitive way to perform time series forecasting and analysis in SQL Server data mining projects.
Data mining by example - building predictive model using microsoft decision t...
This document discusses building a predictive model using Microsoft Decision Trees to predict a prospect's likelihood of purchasing a bike. It outlines setting up the necessary software including SQL Server and Visual Studio, creating a data mining project with a data source and mining structure using Microsoft Decision Trees, deploying and processing the model, and analyzing the model's accuracy using holdout data and visualizations. The summary emphasizes that Microsoft Decision Trees is a powerful yet easy to use model that can perform both single and mass predictions, and that holdout data and visualizations help test and explore the trained model.
An overview of BigQuery
A brief introduction to Google BigQuery concepts with learning resources. Understand the benefits, challenges, and core concepts of BigQuery.
BigQuery for Beginners
An short introduction on Big Query. With this presentation you'll quickly discover :
How load data in BigQuery
How to build dashboard using BigQuery
How to work with BigQuery
and, at last but not least, we've added some best practices
We hope you'll enjoy this presentation and that it will help you to start exploring this wonderful solution. Don't hesitate to send us your feedbacks or questions
Redshift VS BigQuery
in this presentation we go through the differences and similarities between Redshift and BigQuery. It was presented during the Athens Big Data meetup May 2017.
Artik cloud deview 2016
The document discusses Samsung ARTIK Cloud, an open data exchange platform for the Internet of Things (IoT). It allows users to easily create and connect IoT devices, collect and massage device data, and build new services and applications. The platform represents things in the cloud, facilitates interoperability across devices and clouds, and enables data to be transformed and accessed through APIs and SDKs. It also ensures user privacy by allowing users to control and grant access to their own data.
Metabase lj meetup
Things to consider when setting up your ETL pipeline, data warehouse, and choosing an analytics tool.
PSSUG Nov 2012: Big Data with SQL Server
Mark Kromer's presentation of Big Data Analytics with Hadoop, Teradata, SQL Server, Tableau, SAS & PowerPivot
Azure Global Bootcamp - CIS Handson
Presentation giving as part of the Global Azure Bootcamp 2017, April 22, 2017. Subject: one-day hands-on workshop about the Cortana Intelligence Suite.
Big objects in Salesforce Technology
How to extend the data limit in salesforce by using Big Objects.
How to use BigObjects.
Trailhead link: https://trailhead.salesforce.com/en/content/learn/modules/big_objects/big_objects_get_started
The Protein Regulatory Networks of COVID-19 - A Knowledge Graph Created by El...
Shobhna Srivastava discusses Elsevier's Research Citation network. She talks about how the journey of trying to simplify the existing data processing pipeline, to optimise costs, and choose the right solution to the problem opens the doors to other potential use cases and innovation. Graph technology has been applied to the scientific research domain to enhance content discovery.
BigQuery at AppsFlyer - past, present and future
- The document discusses the past, present, and future of using BigQuery for mobile campaign analytics. In the past, they used small Python services and CouchDB which had performance issues. They started using BigQuery which improved performance but had some limitations and cost challenges. Through optimizations like unified schemas and table decorators, they addressed these issues. Going forward, they are waiting for custom partitioning functions in BigQuery to further improve performance and reduce costs.
Machine Learning on the Microsoft Stack
This document provides an overview of machine learning solutions, including on-premise options using Excel add-ins, SQL Server, and R Studio, as well as cloud solutions on Azure and Predixion. It defines common machine learning roles and algorithms, discusses the R programming language, and compares features of the different solutions such as required infrastructure, complexity, costs, and capabilities.
DataStax Enterprise in Practice (Field Notes)
This document discusses several use cases from banks and financial institutions using DataStax Enterprise (DSE). It describes challenges faced and approaches taken for:
1. A global merchant transactions use case involving 100TB of credit card charges and migrating from mainframe to DSE for scalability and high availability.
2. A global payments use case replacing an Exadata dependency and ingesting over 5,000 transactions per second into DSE.
3. A global billing use case scaling an Oracle Coherence deployment with DSE to aggregate usage data.
It also discusses challenges around new technologies, data modeling, hardware requirements, and internal politics that were addressed when implementing DSE.
Tokyo azure meetup #2 big data made easy
- Azure Data Lake makes big data easy to manage, debug, and optimize through services like Azure Data Lake Store and Azure Data Lake Analytics.
- Azure Data Lake Store provides a hyper-scale data lake that allows storing any data in its native format at unlimited scale. Azure Data Lake Analytics allows running distributed queries and analytics jobs on data stored in Data Lake Store.
- Azure Data Lake is based on open source technologies like Apache Hadoop, YARN, and provides a managed service with auto-scaling and a pay-per-use model through the Azure portal and tools like Visual Studio.
Geek Sync | Deployment and Management of Complex Azure Environments
You can watch the replay of this Geek Sync webinar in the IDERA Resource Center: http://ow.ly/pg7N50A4svf.
Today's data management professional is finding their landscape changing. They have multiple database platforms to manage, multi-OS environments and everyone wants it now.
Join IDERA and Kellyn Pot’Vin-Gorman as she discusses the power of auto deployment in Azure when faced with complex environments and tips to increase the knowledge you need at the speed of light. Kellyn will cover scripting basics, advanced Portal features, opportunities to lessen the learning curve and how multi-platform and tier doesn't have to mean multi-cloud.
Attendees can expect to learn how to build automation scripts efficiently, even if you have little scripting experience, and how to work with Azure automation deployments. This session will allow you to begin building a repository of multi-platform development scripts to use as needed.
About Kellyn: Kellyn Pot’Vin-Gorman is a member of the Oak Table Network and an IDERA ACE and Oracle ACE Director alumnus. She is the newest Technical Solution Professional in Power BI with AI in the EdTech group at Microsoft. Kellyn is known for her extensive work with multi-database platforms, DevOps, cloud migrations, virtualization, visualizations, scripting, environment optimization tuning, automation, and architecture design. She has spoken at numerous technical conferences for Oracle, Big Data, DevOps, Testing and SQL Server. Her blog, http://dbakevlar.com and social media activity under her handle, DBAKevlar is well respected for her insight and content.
More Related Content
What's hot
Spring + QueryDSL + MongoDB Presentation
This document summarizes a presentation about Spring, Querydsl, and MongoDB. It introduces Spring and Spring Data frameworks, which make it easier to build Java applications and access data. It also describes Querydsl, a query building tool that works with Spring Data. The presentation demonstrates how to use Spring Data and Querydsl with MongoDB, a non-relational database, to build applications that can query and retrieve data from MongoDB in a type-safe way. Examples of building queries, entities, and repositories are provided.
Elasticsearch and the Database Market
The number of databases and database technologies has grown considerably. Databases are also becoming more and more application specific. Neither end of the spectrum is easy to manage. That's how database-as-a-service (DBaaS) can help. You can limit the number of technologies and still be flexible.
Analyzing StackExchange Data with Azure Data Lake (Tom Kerkhove @ Integration...
Why should we care about Big Data? Tom Kerkhove, Integration Professional at Codit, explains it all in this presentation.
BigQuery for the Big Data win
This document discusses Google BigQuery, a tool for analyzing large datasets that is fast, easy to use, and cost effective. It provides SQL-like queries against nested and columnar data stored in Google's infrastructure. Developers can access BigQuery through Google Cloud Storage, a REST API, or command line tools. BigQuery handles the infrastructure maintenance and offers on-demand or reserved pricing models.
Дмитрий Попович "How to build a data warehouse?"
To build a data warehouse, Tubular ingests raw data from multiple sources using Kafka and stores it permanently. The data is normalized using Spark - duplicates are removed, data is partitioned by time, and sources are joined. A metadata storage using Hive Metastore allows unified access to datasets discovered across various storage formats like Parquet and Avro. This centralized repository helps engineers, analysts and services access and analyze disparate data.
Big problems Big Data, simple solutions
How can you squeeze money from your big data, a real case scenario with Mondadori
AWSome Day Geneva 31/05/2017
Data mining by example forecasting and cross prediction using microsoft time ...
This document discusses using Microsoft Time Series for forecasting and cross prediction. It describes setting up a data mining project in SQL Server to create a time series mining structure and model using sales history from AdventureWorksDW. The model is processed, viewed, and queried to forecast trends and make predictions. Additional data can be added to the model using DMX, and cross prediction is demonstrated by creating new queries and mining structures. Microsoft Time Series provides an intuitive way to perform time series forecasting and analysis in SQL Server data mining projects.
Data mining by example - building predictive model using microsoft decision t...
This document discusses building a predictive model using Microsoft Decision Trees to predict a prospect's likelihood of purchasing a bike. It outlines setting up the necessary software including SQL Server and Visual Studio, creating a data mining project with a data source and mining structure using Microsoft Decision Trees, deploying and processing the model, and analyzing the model's accuracy using holdout data and visualizations. The summary emphasizes that Microsoft Decision Trees is a powerful yet easy to use model that can perform both single and mass predictions, and that holdout data and visualizations help test and explore the trained model.
An overview of BigQuery
A brief introduction to Google BigQuery concepts with learning resources. Understand the benefits, challenges, and core concepts of BigQuery.
BigQuery for Beginners
An short introduction on Big Query. With this presentation you'll quickly discover :
How load data in BigQuery
How to build dashboard using BigQuery
How to work with BigQuery
and, at last but not least, we've added some best practices
We hope you'll enjoy this presentation and that it will help you to start exploring this wonderful solution. Don't hesitate to send us your feedbacks or questions
Redshift VS BigQuery
in this presentation we go through the differences and similarities between Redshift and BigQuery. It was presented during the Athens Big Data meetup May 2017.
Artik cloud deview 2016
The document discusses Samsung ARTIK Cloud, an open data exchange platform for the Internet of Things (IoT). It allows users to easily create and connect IoT devices, collect and massage device data, and build new services and applications. The platform represents things in the cloud, facilitates interoperability across devices and clouds, and enables data to be transformed and accessed through APIs and SDKs. It also ensures user privacy by allowing users to control and grant access to their own data.
Metabase lj meetup
Things to consider when setting up your ETL pipeline, data warehouse, and choosing an analytics tool.
PSSUG Nov 2012: Big Data with SQL Server
Mark Kromer's presentation of Big Data Analytics with Hadoop, Teradata, SQL Server, Tableau, SAS & PowerPivot
Azure Global Bootcamp - CIS Handson
Presentation giving as part of the Global Azure Bootcamp 2017, April 22, 2017. Subject: one-day hands-on workshop about the Cortana Intelligence Suite.
Big objects in Salesforce Technology
How to extend the data limit in salesforce by using Big Objects.
How to use BigObjects.
Trailhead link: https://trailhead.salesforce.com/en/content/learn/modules/big_objects/big_objects_get_started
The Protein Regulatory Networks of COVID-19 - A Knowledge Graph Created by El...
Shobhna Srivastava discusses Elsevier's Research Citation network. She talks about how the journey of trying to simplify the existing data processing pipeline, to optimise costs, and choose the right solution to the problem opens the doors to other potential use cases and innovation. Graph technology has been applied to the scientific research domain to enhance content discovery.
BigQuery at AppsFlyer - past, present and future
- The document discusses the past, present, and future of using BigQuery for mobile campaign analytics. In the past, they used small Python services and CouchDB which had performance issues. They started using BigQuery which improved performance but had some limitations and cost challenges. Through optimizations like unified schemas and table decorators, they addressed these issues. Going forward, they are waiting for custom partitioning functions in BigQuery to further improve performance and reduce costs.
Machine Learning on the Microsoft Stack
This document provides an overview of machine learning solutions, including on-premise options using Excel add-ins, SQL Server, and R Studio, as well as cloud solutions on Azure and Predixion. It defines common machine learning roles and algorithms, discusses the R programming language, and compares features of the different solutions such as required infrastructure, complexity, costs, and capabilities.
DataStax Enterprise in Practice (Field Notes)
This document discusses several use cases from banks and financial institutions using DataStax Enterprise (DSE). It describes challenges faced and approaches taken for:
1. A global merchant transactions use case involving 100TB of credit card charges and migrating from mainframe to DSE for scalability and high availability.
2. A global payments use case replacing an Exadata dependency and ingesting over 5,000 transactions per second into DSE.
3. A global billing use case scaling an Oracle Coherence deployment with DSE to aggregate usage data.
It also discusses challenges around new technologies, data modeling, hardware requirements, and internal politics that were addressed when implementing DSE.
What's hot (20)
Analyzing StackExchange Data with Azure Data Lake (Tom Kerkhove @ Integration...
Analyzing StackExchange Data with Azure Data Lake (Tom Kerkhove @ Integration...
Data mining by example forecasting and cross prediction using microsoft time ...
Data mining by example forecasting and cross prediction using microsoft time ...
Data mining by example - building predictive model using microsoft decision t...
Data mining by example - building predictive model using microsoft decision t...
The Protein Regulatory Networks of COVID-19 - A Knowledge Graph Created by El...
The Protein Regulatory Networks of COVID-19 - A Knowledge Graph Created by El...
Similar to Big query for data analysis quest
Tokyo azure meetup #2 big data made easy
- Azure Data Lake makes big data easy to manage, debug, and optimize through services like Azure Data Lake Store and Azure Data Lake Analytics.
- Azure Data Lake Store provides a hyper-scale data lake that allows storing any data in its native format at unlimited scale. Azure Data Lake Analytics allows running distributed queries and analytics jobs on data stored in Data Lake Store.
- Azure Data Lake is based on open source technologies like Apache Hadoop, YARN, and provides a managed service with auto-scaling and a pay-per-use model through the Azure portal and tools like Visual Studio.
Geek Sync | Deployment and Management of Complex Azure Environments
You can watch the replay of this Geek Sync webinar in the IDERA Resource Center: http://ow.ly/pg7N50A4svf.
Today's data management professional is finding their landscape changing. They have multiple database platforms to manage, multi-OS environments and everyone wants it now.
Join IDERA and Kellyn Pot’Vin-Gorman as she discusses the power of auto deployment in Azure when faced with complex environments and tips to increase the knowledge you need at the speed of light. Kellyn will cover scripting basics, advanced Portal features, opportunities to lessen the learning curve and how multi-platform and tier doesn't have to mean multi-cloud.
Attendees can expect to learn how to build automation scripts efficiently, even if you have little scripting experience, and how to work with Azure automation deployments. This session will allow you to begin building a repository of multi-platform development scripts to use as needed.
About Kellyn: Kellyn Pot’Vin-Gorman is a member of the Oak Table Network and an IDERA ACE and Oracle ACE Director alumnus. She is the newest Technical Solution Professional in Power BI with AI in the EdTech group at Microsoft. Kellyn is known for her extensive work with multi-database platforms, DevOps, cloud migrations, virtualization, visualizations, scripting, environment optimization tuning, automation, and architecture design. She has spoken at numerous technical conferences for Oracle, Big Data, DevOps, Testing and SQL Server. Her blog, http://dbakevlar.com and social media activity under her handle, DBAKevlar is well respected for her insight and content.
Intro to Azure Data Factory v1
An introduction to the concepts and requirements to get started developing data pipelines in Azure Data Factory version 1.
Building a Web Application with Kafka as your Database
This document provides an overview of a presentation on building a web application using Apache Kafka as the database. The presentation discusses using Kafka for messaging in both request-driven and event-driven architectures. It then covers using Kafka and Kafka Streams as an alternative to a traditional database for the benefits of performance, scaling, and being the system of record. The presentation reviews building a quiz application called Quizzer that uses Kafka Streams to store and access data, including designing topologies for starting quizzes, submitting answers, and retrieving next questions. Key takeaways include using Kafka Streams features like transformations, joins, and state stores to access data within topologies.
Accelerating Business Intelligence Solutions with Microsoft Azure pass
Business Intelligence (BI) solutions need to move at the speed of business. Unfortunately, roadblocks related to availability of resources and deployment often present an issue. What if you could accelerate the deployment of an entire BI infrastructure to just a couple hours and start loading data into it by the end of the day. In this session, we'll demonstrate how to leverage Microsoft tools and the Azure cloud environment to build out a BI solution and begin providing analytics to your team with tools such as Power BI. By end of the session, you'll gain an understanding of the capabilities of Azure and how you can start building an end to end BI proof-of-concept today.
Building Modern Data Platform with Microsoft Azure
This document provides an overview of building a modern cloud analytics solution using Microsoft Azure. It discusses the role of analytics, a history of cloud computing, and a data warehouse modernization project. Key challenges covered include lack of notifications, logging, self-service BI, and integrating streaming data. The document proposes solutions to these challenges using Azure services like Data Factory, Kafka, Databricks, and SQL Data Warehouse. It also discusses alternative implementations using tools like Matillion ETL and Snowflake.
Introduction to Promitor
Promitor is an open source tool that scrapes metrics from Azure Monitor and other sources and makes them available to systems like Prometheus and Graphite. It works by declaring which metrics to collect from which Azure resources. It can also automatically discover resources using criteria like resource tags. The scraper agent queries Azure Monitor and resource discovery to collect metrics from both static and dynamic resources. Promitor supports scraping many Azure services and has over 140 stars on GitHub with growing adoption and downloads. Future plans include new authentication options and adding more Azure service scrapers.
ONE FOR ALL! Using Apache Calcite to make SQL smart
In the past when Hadoop was born, the big data world were focusing on how to build systems that scales. Now the world has evolved. HBase hits 2.0, Cassandra hits 3.0, Hive hits 3.0, etc. When scalability is conquered, what's next? That’s right, usability comes into play. If we look back into the history, NoSQL is really just using divide and concur mechanism to tackle big data problems by trading off SQL capabilities. But once big data problem solved, we see more and more NoSQL and data processing engines start to build up SQL or SQL-like interfaces. Therefore, a generic SQL engine that provides core SQL capabilities such as query parsing, relational algebra, and query optimization starts to shine.
In this talk, I'll walk you through the architecture, functionality, and design concept of Apache Calcite. Notice that Calcite itself is not a database, but many well known systems already incorporate Calcite as a library. For instance, Hive, Drill, Druid, Phoenix, Apex, Flink, Storm, Samza, and more. To better illustrate how Calcite works, I'll choose some of the systems and describe how they adopt Calcite and which part is enhanced by Calcite. Furthermore, I'll talk about several features that Calcite provides such as query optimization, heterogeneous data source, materialized view, and Stream SQL. From user's perspective, knowing better how these systems work behind the scene equips you with more knowledge to chose a system that ultimately suits your needs.
Migrating Data and Databases to Azure
This one-hour presentation covers the tools and techniques for migrating SQL Server databases and data to Azure SQL DB or SQL Server on VM. Includes SSMA, DMA, DMS, and more.
Modern ETL: Azure Data Factory, Data Lake, and SQL Database
This document discusses modern Extract, Transform, Load (ETL) tools in Azure, including Azure Data Factory, Azure Data Lake, and Azure SQL Database. It provides an overview of each tool and how they can be used together in a data warehouse architecture with Azure Data Lake acting as the data hub and Azure SQL Database being used for analytics and reporting through the creation of data marts. It also includes two demonstrations, one on Azure Data Factory and another showing Azure Data Lake Store and Analytics.
The Future of Data Engineering - 2019 InfoQ QConSF
The document summarizes the six stages of data pipeline maturity: from no pipeline (Stage 0) to fully decentralized pipelines (Stage 5). It uses the evolution of data infrastructure at WePay as an example, starting with a monolithic MySQL database (Stage 0) and progressing to a real-time integration of data across services using Kafka and automated operations/data management (Stages 3-4). The talk argues that as pipelines become fully automated, data teams should expose self-service tools to decentralize control and management of data to individual engineering teams through micro data warehouses.
AWS Lambda support for AWS X-Ray
This document discusses AWS Lambda support for AWS X-Ray. It provides an overview of X-Ray and how it helps with debugging Lambda functions. The X-Ray SDK captures metadata for calls to AWS services, HTTP/HTTPS endpoints, databases, and queues to provide trace data without requiring manual instrumentation. This data can be used to visualize service graphs, identify performance bottlenecks and errors, and pinpoint issues to specific services. The document provides tips for getting started with X-Ray and notes some best practices when using Lambda.
Deep thoughts from the real world of azure
I presented this at a user group in Sweden, as a compilation discussion of practical customer experiences with WIndows Azure. The slides led the discussion. Enjoy.
An introduction to QuerySurge webinar
Introduction to QuerySurge Webinar
Wednesday, April 29th 2020 @11am ET
Eric Smyth, Director of Alliances
Bill Hayduk, CEO
Matt Moss, Product Manager
This is the slide deck for our webinar. Learn how QuerySurge automates the data validation and testing of Big Data, Data Warehouses, Business Intelligence Reports and Enterprise Applications with full DevOps functionality for continuous testing.
---------------------------------------------------------------------------------
Objective
During this webinar, we demonstrate how QuerySurge solves the following challenges:
- Your need for data quality at speed
- How to automate your ETL testing process
- Your ability to test across your different data platforms
- How to integrate ETL testing into your DataOps pipeline
- How to analyze your data and pinpoint anomalies quickly
-------------------------------------------------------------------------------------
Who should view this?
- ETL Developers /Testers
- Data Architects / Analysts
- DBAs
- BI Developers / Analysts
- IT Architects
- Managers of Data, BI & Analytics groups: CTOs, Directors, Vice Presidents, Project Leads
And anyone else with an interest in the Data & Analytics space who is interested in an automation solution for data validation & testing while improving data quality.
Future of Data Engineering
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2OUz6dt.
Chris Riccomini talks about the current state-of-the-art in data pipelines and data warehousing, and shares some of the solutions to current problems dealing with data streaming and warehousing. Filmed at qconsf.com.
Chris Riccomini works as a Software Engineer at WePay.
Practical msbi(ssis, ssas,ssrs)
This document outlines the topics that will be covered in an online training course on practical MSBI (SQL Server Integration Services, SQL Server Analysis Services, and SQL Server Reporting Services). The training will cover topics such as SSIS package architecture, SQL Server Data Tools, control flow and data flow, variables and configurations, debugging and logging, MDX queries, cube modeling, report building, subscriptions, and more. It provides a detailed overview of the concepts and tasks that will be taught for each MSBI tool.
Practical msbi(ssis, ssas,ssrs)
SQLServer|Masters are pioners in offering real time industrail experts hands MSBI(SSIS, SSAS, SSRS) training.
along with Real Time Project senarios. All the sessions are completely PRACTICAL.
MSBI (MICROSOFT BUSINESS INTELLIGENCE) - SQL SERVER 2008 (SSIS, SSAS, SSRS)
SSIS Course Objectives:
Module 1: Architecture and Introduction to SQL Server Integration Services
Need for SSIS
SSIS and DTS Comparison
SSIS Architecture
Control Flow Architecture
Data Flow Architecture
Data Pipeline Usage
Precedence Constraints
SSIS Event Handler
SSIS Components
SSIS Development Studio - BIDS
SSIS Runtime Services
SSIS Package Deployment
SSIS Folders and File Structure
Module 2: Designing and Implementation of SSIS packages
SSIS Data Types,
SSIS Variables,
Connection Managers
Data Flow Tasks usage
SSIS Expressions
Module 3: Designing and Implementation of Control Flow & Data Flow.
Control Flow
For Loop Container
For each Loop Container
Sequence Container
Bulk Insert Task
Data Flow Task
Execute Package Task
Execute SQL Task
File System Task
FTP Task
Script Task
Send Mail Task
Transfer Database Task
WMI Data Reader Task WMI Event Watcher Task XML Task
Maintenance Plan Task Backup Database Task Shrink Database Task.
Row Transformation:
Character Map Transformation
Copy Column Transformation
Data Conversion Transformation Derived Column Transformation
Script Component Transformation OLEDB Command transformation
Rowset Transformation.
* Resume preparation and Interview assistance will be provided.
For any further details please contact +91-9052666559 or
visit www.sqlservermasters.com
Please mail your queries to training@sqlservermasters.com.
Big query
Google BigQuery is Google's fully managed big data analytics service that allows users to analyze very large datasets. It offers a fast and easy to use service with no infrastructure to manage. Developers can stream up to 100,000 rows of data per second for near real-time analysis. BigQuery bills users per project on a pay-as-you-go model, with the first 1TB of data processed each month free of charge.
Java in azure dev ops
This document discusses using Java with DevOps in Azure. It provides an overview of Azure services that can be used with Java like SQL Database, blob storage, and App Services. It also discusses using Visual Studio Team Services (VSTS) for source control, building, testing, and deploying Java applications. Specific topics covered include connecting a Java app to SQL Database, storing images in blob storage, creating a build definition, and continuous integration/deployment using VSTS.
Serverless SQL
Serverless SQL provides a serverless analytics platform that allows users to analyze data stored in object storage without having to manage infrastructure. Key features include seamless elasticity, pay-per-query consumption, and the ability to analyze data directly in object storage without having to move it. The platform includes serverless storage, data ingest, data transformation, analytics, and automation capabilities. It aims to create a sharing economy for analytics by allowing various users like developers, data engineers, and analysts flexible access to data and analytics.
Similar to Big query for data analysis quest (20)
Geek Sync | Deployment and Management of Complex Azure Environments
Geek Sync | Deployment and Management of Complex Azure Environments
Building a Web Application with Kafka as your Database
Building a Web Application with Kafka as your Database
Accelerating Business Intelligence Solutions with Microsoft Azure pass
Accelerating Business Intelligence Solutions with Microsoft Azure pass
Building Modern Data Platform with Microsoft Azure
Building Modern Data Platform with Microsoft Azure
ONE FOR ALL! Using Apache Calcite to make SQL smart
ONE FOR ALL! Using Apache Calcite to make SQL smart
Modern ETL: Azure Data Factory, Data Lake, and SQL Database
Modern ETL: Azure Data Factory, Data Lake, and SQL Database
The Future of Data Engineering - 2019 InfoQ QConSF
The Future of Data Engineering - 2019 InfoQ QConSF
Recently uploaded
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays, June 2024 with Maria Copot 20
UiPath Test Automation using UiPath Test Suite series, part 6
Welcome to UiPath Test Automation using UiPath Test Suite series part 6. In this session, we will cover Test Automation with generative AI and Open AI.
UiPath Test Automation with generative AI and Open AI webinar offers an in-depth exploration of leveraging cutting-edge technologies for test automation within the UiPath platform. Attendees will delve into the integration of generative AI, a test automation solution, with Open AI advanced natural language processing capabilities.
Throughout the session, participants will discover how this synergy empowers testers to automate repetitive tasks, enhance testing accuracy, and expedite the software testing life cycle. Topics covered include the seamless integration process, practical use cases, and the benefits of harnessing AI-driven automation for UiPath testing initiatives. By attending this webinar, testers, and automation professionals can gain valuable insights into harnessing the power of AI to optimize their test automation workflows within the UiPath ecosystem, ultimately driving efficiency and quality in software development processes.
What will you get from this session?
1. Insights into integrating generative AI.
2. Understanding how this integration enhances test automation within the UiPath platform
3. Practical demonstrations
4. Exploration of real-world use cases illustrating the benefits of AI-driven test automation for UiPath
Topics covered:
What is generative AI
Test Automation with generative AI and Open AI.
UiPath integration with generative AI
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean Lotus cyber threat actors represent a sophisticated, persistent, and politically motivated group that poses a significant risk to organizations and individuals in the Southeast Asian region. Their continuous evolution and adaptability underscore the need for robust cybersecurity measures and international cooperation to identify and mitigate the threats posed by such advanced persistent threat groups.
Skybuffer SAM4U tool for SAP license adoption
Manage and optimize your license adoption and consumption with SAM4U, an SAP free customer software asset management tool.
SAM4U, an SAP complimentary software asset management tool for customers, delivers a detailed and well-structured overview of license inventory and usage with a user-friendly interface. We offer a hosted, cost-effective, and performance-optimized SAM4U setup in the Skybuffer Cloud environment. You retain ownership of the system and data, while we manage the ABAP 7.58 infrastructure, ensuring fixed Total Cost of Ownership (TCO) and exceptional services through the SAP Fiori interface.
Introduction of Cybersecurity with OSS at Code Europe 2024
I develop the Ruby programming language, RubyGems, and Bundler, which are package managers for Ruby. Today, I will introduce how to enhance the security of your application using open-source software (OSS) examples from Ruby and RubyGems.
The first topic is CVE (Common Vulnerabilities and Exposures). I have published CVEs many times. But what exactly is a CVE? I'll provide a basic understanding of CVEs and explain how to detect and handle vulnerabilities in OSS.
Next, let's discuss package managers. Package managers play a critical role in the OSS ecosystem. I'll explain how to manage library dependencies in your application.
I'll share insights into how the Ruby and RubyGems core team works to keep our ecosystem safe. By the end of this talk, you'll have a better understanding of how to safeguard your code.
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Discover how MongoDB Atlas and vector search technology can revolutionize your application's search capabilities. This comprehensive presentation covers:
* What is Vector Search?
* Importance and benefits of vector search
* Practical use cases across various industries
* Step-by-step implementation guide
* Live demos with code snippets
* Enhancing LLM capabilities with vector search
* Best practices and optimization strategies
Perfect for developers, AI enthusiasts, and tech leaders. Learn how to leverage MongoDB Atlas to deliver highly relevant, context-aware search results, transforming your data retrieval process. Stay ahead in tech innovation and maximize the potential of your applications.
#MongoDB #VectorSearch #AI #SemanticSearch #TechInnovation #DataScience #LLM #MachineLearning #SearchTechnology
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for life science domain, where you retriever information from biomedical knowledge graphs using LLMs to increase the accuracy and performance of generated answers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Simplify your search for a reliable Python development partner! This list presents the top 10 trusted US providers offering comprehensive Python development services, ensuring your project's success from conception to completion.
HCL Notes and Domino License Cost Reduction in the World of DLAU
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-and-domino-license-cost-reduction-in-the-world-of-dlau/
The introduction of DLAU and the CCB & CCX licensing model caused quite a stir in the HCL community. As a Notes and Domino customer, you may have faced challenges with unexpected user counts and license costs. You probably have questions on how this new licensing approach works and how to benefit from it. Most importantly, you likely have budget constraints and want to save money where possible. Don’t worry, we can help with all of this!
We’ll show you how to fix common misconfigurations that cause higher-than-expected user counts, and how to identify accounts which you can deactivate to save money. There are also frequent patterns that can cause unnecessary cost, like using a person document instead of a mail-in for shared mailboxes. We’ll provide examples and solutions for those as well. And naturally we’ll explain the new licensing model.
Join HCL Ambassador Marc Thomas in this webinar with a special guest appearance from Franz Walder. It will give you the tools and know-how to stay on top of what is going on with Domino licensing. You will be able lower your cost through an optimized configuration and keep it low going forward.
These topics will be covered
- Reducing license cost by finding and fixing misconfigurations and superfluous accounts
- How do CCB and CCX licenses really work?
- Understanding the DLAU tool and how to best utilize it
- Tips for common problem areas, like team mailboxes, functional/test users, etc
- Practical examples and best practices to implement right away
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
Imagine a world where machines not only perform tasks but also learn, adapt, and make decisions. This is the promise of Artificial Intelligence (AI), a technology that's not just enhancing our lives but revolutionizing entire industries.
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift
Overview
Dive into the world of anomaly detection on edge devices with our comprehensive hands-on tutorial. This SlideShare presentation will guide you through the entire process, from data collection and model training to edge deployment and real-time monitoring. Perfect for those looking to implement robust anomaly detection systems on resource-constrained IoT/edge devices.
Key Topics Covered
1. Introduction to Anomaly Detection
- Understand the fundamentals of anomaly detection and its importance in identifying unusual behavior or failures in systems.
2. Understanding Edge (IoT)
- Learn about edge computing and IoT, and how they enable real-time data processing and decision-making at the source.
3. What is ArgoCD?
- Discover ArgoCD, a declarative, GitOps continuous delivery tool for Kubernetes, and its role in deploying applications on edge devices.
4. Deployment Using ArgoCD for Edge Devices
- Step-by-step guide on deploying anomaly detection models on edge devices using ArgoCD.
5. Introduction to Apache Kafka and S3
- Explore Apache Kafka for real-time data streaming and Amazon S3 for scalable storage solutions.
6. Viewing Kafka Messages in the Data Lake
- Learn how to view and analyze Kafka messages stored in a data lake for better insights.
7. What is Prometheus?
- Get to know Prometheus, an open-source monitoring and alerting toolkit, and its application in monitoring edge devices.
8. Monitoring Application Metrics with Prometheus
- Detailed instructions on setting up Prometheus to monitor the performance and health of your anomaly detection system.
9. What is Camel K?
- Introduction to Camel K, a lightweight integration framework built on Apache Camel, designed for Kubernetes.
10. Configuring Camel K Integrations for Data Pipelines
- Learn how to configure Camel K for seamless data pipeline integrations in your anomaly detection workflow.
11. What is a Jupyter Notebook?
- Overview of Jupyter Notebooks, an open-source web application for creating and sharing documents with live code, equations, visualizations, and narrative text.
12. Jupyter Notebooks with Code Examples
- Hands-on examples and code snippets in Jupyter Notebooks to help you implement and test anomaly detection models.
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
ABSTRACT: A prima vista, un mattoncino Lego e la backdoor XZ potrebbero avere in comune il fatto di essere entrambi blocchi di costruzione, o dipendenze di progetti creativi e software. La realtà è che un mattoncino Lego e il caso della backdoor XZ hanno molto di più di tutto ciò in comune.
Partecipate alla presentazione per immergervi in una storia di interoperabilità, standard e formati aperti, per poi discutere del ruolo importante che i contributori hanno in una comunità open source sostenibile.
BIO: Sostenitrice del software libero e dei formati standard e aperti. È stata un membro attivo dei progetti Fedora e openSUSE e ha co-fondato l'Associazione LibreItalia dove è stata coinvolta in diversi eventi, migrazioni e formazione relativi a LibreOffice. In precedenza ha lavorato a migrazioni e corsi di formazione su LibreOffice per diverse amministrazioni pubbliche e privati. Da gennaio 2020 lavora in SUSE come Software Release Engineer per Uyuni e SUSE Manager e quando non segue la sua passione per i computer e per Geeko coltiva la sua curiosità per l'astronomia (da cui deriva il suo nickname deneb_alpha).
Webinar: Designing a schema for a Data Warehouse
Are you new to data warehouses (DWH)? Do you need to check whether your data warehouse follows the best practices for a good design? In both cases, this webinar is for you.
A data warehouse is a central relational database that contains all measurements about a business or an organisation. This data comes from a variety of heterogeneous data sources, which includes databases of any type that back the applications used by the company, data files exported by some applications, or APIs provided by internal or external services.
But designing a data warehouse correctly is a hard task, which requires gathering information about the business processes that need to be analysed in the first place. These processes must be translated into so-called star schemas, which means, denormalised databases where each table represents a dimension or facts.
We will discuss these topics:
- How to gather information about a business;
- Understanding dictionaries and how to identify business entities;
- Dimensions and facts;
- Setting a table granularity;
- Types of facts;
- Types of dimensions;
- Snowflakes and how to avoid them;
- Expanding existing dimensions and facts.
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-und-domino-lizenzkostenreduzierung-in-der-welt-von-dlau/
DLAU und die Lizenzen nach dem CCB- und CCX-Modell sind für viele in der HCL-Community seit letztem Jahr ein heißes Thema. Als Notes- oder Domino-Kunde haben Sie vielleicht mit unerwartet hohen Benutzerzahlen und Lizenzgebühren zu kämpfen. Sie fragen sich vielleicht, wie diese neue Art der Lizenzierung funktioniert und welchen Nutzen sie Ihnen bringt. Vor allem wollen Sie sicherlich Ihr Budget einhalten und Kosten sparen, wo immer möglich. Das verstehen wir und wir möchten Ihnen dabei helfen!
Wir erklären Ihnen, wie Sie häufige Konfigurationsprobleme lösen können, die dazu führen können, dass mehr Benutzer gezählt werden als nötig, und wie Sie überflüssige oder ungenutzte Konten identifizieren und entfernen können, um Geld zu sparen. Es gibt auch einige Ansätze, die zu unnötigen Ausgaben führen können, z. B. wenn ein Personendokument anstelle eines Mail-Ins für geteilte Mailboxen verwendet wird. Wir zeigen Ihnen solche Fälle und deren Lösungen. Und natürlich erklären wir Ihnen das neue Lizenzmodell.
Nehmen Sie an diesem Webinar teil, bei dem HCL-Ambassador Marc Thomas und Gastredner Franz Walder Ihnen diese neue Welt näherbringen. Es vermittelt Ihnen die Tools und das Know-how, um den Überblick zu bewahren. Sie werden in der Lage sein, Ihre Kosten durch eine optimierte Domino-Konfiguration zu reduzieren und auch in Zukunft gering zu halten.
Diese Themen werden behandelt
- Reduzierung der Lizenzkosten durch Auffinden und Beheben von Fehlkonfigurationen und überflüssigen Konten
- Wie funktionieren CCB- und CCX-Lizenzen wirklich?
- Verstehen des DLAU-Tools und wie man es am besten nutzt
- Tipps für häufige Problembereiche, wie z. B. Team-Postfächer, Funktions-/Testbenutzer usw.
- Praxisbeispiele und Best Practices zum sofortigen Umsetzen
Choosing The Best AWS Service For Your Website + API.pptx
Have you ever been confused by the myriad of choices offered by AWS for hosting a website or an API?
Lambda, Elastic Beanstalk, Lightsail, Amplify, S3 (and more!) can each host websites + APIs. But which one should we choose?
Which one is cheapest? Which one is fastest? Which one will scale to meet our needs?
Join me in this session as we dive into each AWS hosting service to determine which one is best for your scenario and explain why!
Recently uploaded (20)
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
Big query for data analysis quest
- 1. BigQuery For Data Analysis Faizah Saeed CIS Student | IAU DSC Member @FaizahSa_ Second Quest in Data Science track
- 2. • What is bigQuery? where? When? How ? • bigQuery components What you will learn? • Basics of SQL (select, from, where, group By, AS, order by, count ). • Load database into bigQuery • Execute simple queries on bigQuery.
- 3. What you will learn? • Export CSV file and store it in Cloud Storage bucket • Create a new Cloud SQL instance and load your exported CSV file as a new table • Know what is CSV
- 4. What Is BigQuery ? • Analytics engine that lets you run SQL queries in the Cloud. Projects Datasets Tables C • Google cloud platform service works with BigData.
- 6. CSV Comma Separated Values CSV file:
- 8. Thank You! Faizah Saeed CIS Student | IAU DSC Member @FaizahSa_