In this practical webinar, we'll walk through some of the key location intelligence functions that are now available in BigQuery with our Spatial Extension.
Developing Spatial Applications with CARTO for React v1.1CARTO
In this hands-on webinar, we introduce the new features of CARTO for React v1.1 and showcase how this framework can be used to accelerate the development of cloud-native geospatial applications. You can watch the recorded webinar at: https://go.carto.com/webinars/carto-react-developers
Unlock the power of spatial analysis using CARTO and python [CARTOframes]CARTO
In this webinar, learn how to integrate spatial data and analysis to your data science models using CARTOframes—a Python package that allows data scientists to seamlessly integrate CARTO maps, data, and analysis into their current environment.
Watch the recorded at: https://go.carto.com/webinars/spatial-analysis-carto-python-recorded
In this webinar you learn some of the techniques and resources that can help you bolster your Spatial Data Science skills. You can watch the recorded webinar at: https://go.carto.com/webinars/spatial-expert-recorded
Developing Spatial Applications with Google Maps and CARTOCARTO
Learn how CARTO integrates with Google Maps to unlock the advanced visualization capabilities of deck.gl and enables developers to build geospatial apps. You can watch the recorded webinar here: https://go.carto.com/webinars/google-maps-and-carto
Why High-Resolution Spatial Data on Population MattersCARTO
In this webinar in partnership with WorldPop, you learn about how high-resolution data on human population distribution & characteristics are becoming more & more important. You can watch the recorded webinar at: https://go.carto.com/webinars/worldpop-global-demographic-insights
Think Spatial: Don't Ignore Location in your Models! [CARTOframes]CARTO
In this technical webinar, Giulia Carella and Steve Isaac share how thinking spatially can help you to build powerful models that outperform the typical data science tools. Watch it now at: https://go.carto.com/dont-ignore-location-in-models-webinar-recorded
Using Geospatial to Innovate in Last-Mile LogisticsCARTO
In this webinar in partnership with what3words, you learn about how new location analytics can enable logistics & supply chain players to improve their approach to route optimization. You can watch the recorded webinar at: https://go.carto.com/webinars/what3words-logistics
Developing Spatial Applications with CARTO for React v1.1CARTO
In this hands-on webinar, we introduce the new features of CARTO for React v1.1 and showcase how this framework can be used to accelerate the development of cloud-native geospatial applications. You can watch the recorded webinar at: https://go.carto.com/webinars/carto-react-developers
Unlock the power of spatial analysis using CARTO and python [CARTOframes]CARTO
In this webinar, learn how to integrate spatial data and analysis to your data science models using CARTOframes—a Python package that allows data scientists to seamlessly integrate CARTO maps, data, and analysis into their current environment.
Watch the recorded at: https://go.carto.com/webinars/spatial-analysis-carto-python-recorded
In this webinar you learn some of the techniques and resources that can help you bolster your Spatial Data Science skills. You can watch the recorded webinar at: https://go.carto.com/webinars/spatial-expert-recorded
Developing Spatial Applications with Google Maps and CARTOCARTO
Learn how CARTO integrates with Google Maps to unlock the advanced visualization capabilities of deck.gl and enables developers to build geospatial apps. You can watch the recorded webinar here: https://go.carto.com/webinars/google-maps-and-carto
Why High-Resolution Spatial Data on Population MattersCARTO
In this webinar in partnership with WorldPop, you learn about how high-resolution data on human population distribution & characteristics are becoming more & more important. You can watch the recorded webinar at: https://go.carto.com/webinars/worldpop-global-demographic-insights
Think Spatial: Don't Ignore Location in your Models! [CARTOframes]CARTO
In this technical webinar, Giulia Carella and Steve Isaac share how thinking spatially can help you to build powerful models that outperform the typical data science tools. Watch it now at: https://go.carto.com/dont-ignore-location-in-models-webinar-recorded
Using Geospatial to Innovate in Last-Mile LogisticsCARTO
In this webinar in partnership with what3words, you learn about how new location analytics can enable logistics & supply chain players to improve their approach to route optimization. You can watch the recorded webinar at: https://go.carto.com/webinars/what3words-logistics
Are you a Data Scientist working in the Real Estate industry? Are you trying to build a Data Science team with expertise in spatial?
We bring the London Real Estate Data Science community together to discuss use cases such as whitespace analysis, twin area analysis & indoor analytics - sharing best practices and experiences from both residential and commercial.
Jaime Sanchez walked through a specific case of Spatial Data Science applied to Shared Workspace investment analysis, with an interactive component, before we break out into a discussion about the challenges and opportunities of building Data Science teams in the Real Estate sector.
Geolytix joined the conversation to speak about location planning. As trusted advisors, they help their customers decide how many stores, who to acquire, where to open, which format and how to
optimize home delivery and click & collect operations.
Visit our website for more information: https://carto.com/
Embedding Location Intelligence in Web Apps that Enhance User Experience [Air...CARTO
This webinar focuses on how using CARTO's tech stack to embed Location Intelligence in a variety of web and mobile apps.
Our speakers, Román Jiménez and Víctor Velarde, showcase the latest products and features available for developers to reduce production time of custom-built apps and deliver superior user experiences. Watch the recorded at:
https://go.carto.com/airship-location-intelligence-web-apps-user-experience-recorded
The Role of Indoor Mapping in the “New Normal”CARTO
In this webinar in partnership with Situm, you learn about how technology & analytics can facilitate a safe return to work for your employees. You can watch the recorded webinar at: https://go.carto.com/webinars/situm-indoor-mapping
The Sum of our Parts: the Complete CARTO Journey [CARTO]CARTO
In this webinar, we put all of the pieces together - showing, using the example of the Real Estate market in Los Angeles, how the CARTO platform powers a data-to-decision workflow, showcasing every step along the way.
Watch it now at: https://go.carto.com/sum-parts-complete-carto-journey-webinar-recorded
How to Use Spatial Data Science in your Site Planning Process? [CARTOframes] CARTO
In this webinar, we show how CARTO can be used in site planning applications to analyze multivariate geolocated data and derive data-driven insights when opening, relocating or consolidating location sites.
Watch it now at: https://go.carto.com/how-spatial-data-science-site-planning-webinar-recorded
Helping insurers Uncover Location Data and the Predictive Analytics FactorCARTO
In this webinar, you learn the current challenges insurers are facing and how leveraging LI can help. You can watch the recorded webinar at: https://go.carto.com/insurance-location-data-and-predictive-analytics-factor-recorded
The Ultimate Guide to Location Data: New Datasets & MethodsCARTO
In this webinar, you learn how to get the best insights from existing third party and open data, as well as the need for new derived datasets. You can watch the recorded webinar at: https://go.carto.com/webinars/ultimate-guide-location-data
Applying Spatial Analysis to Real Estate Decision-MakingCARTO
In this webinar you learn the role of spatial data and analysis in Real Estate decision-making, as well as seeing some use cases and how to put it into practice with CARTOframes. You can watch the recorded webinar at: https://go.carto.com/en/webinars/cartoframes-real-estate-recorded
RasterFrames: Enabling Global-Scale Geospatial Machine LearningAstraea, Inc.
RasterFrames™, a proposed LocationTech project, brings the power of Spark SQL and Spark ML to the analysis of global-scale geospatial-temporal raster data. Employing the rich geospatial primitives of LocationTech GeoTrellis and GeoMesa, RasterFrames provides scientists, data scientists and software developers with a unified data and compute model for building image processing pipelines for ETL, data-product creation, statistical analysis, supervised & unsupervised machine learning, and deep learning. Data scientists particularly benefit from the DataFrame-centric entrypoint into big data geospatial analytics.
This talk will introduce RasterFrames, explaining the need it fulfills, the capabilities it provides, and context for determining if RasterFrames is right for the problems you're trying to solve.
By Simeon Fitch
In this webinar, you will learn how aggregated social media sentiment data mentioning COVID-19 can help inform companies' response to the crisis. You can watch the recorded webinar at: https://go.carto.com/webinars/spatialai
In this webinar in partnership with Focal Point, you learn about the future of Indoor Mapping & the role that next-generation GPS technology can play in a range of indoor use cases. You can watch the recorded webinar at: https://go.carto.com/webinars/focalpoint-indoor-mapping
How to Use Geospatial Data to Identify CPG Demnd HotspotsCARTO
The combination of new location data streams and spatial data science techniques opens up a new array of opportunities for CPG data and marketing professionals seeking where to prioritize in terms of ramping up distribution and identifying POS (points of sale).
Using R to Visualize Spatial Data: R as GIS - Guy LansleyGuy Lansley
This talk demonstrates some of the benefits of using R to visualize spatial data efficiently and clearly.
It was originally presented by Guy Lansley (UCL and the Consumer Data Research Centre) to the GIS for Social Data and Crisis Mapping Workshop at the University of Kent.
Understanding Retail Catchment Areas with Human Mobility DataCARTO
In this webinar in partnership with Databricks, you learn how to build more accurate catchment area analysis using human mobility location data. You can watch the recorded webinar at: https://go.carto.com/webinars/databricks-spatial-data-science
Advancing Spatial Analysis in BigQuery using CARTO Analytics ToolboxCARTO
Learn how Analysts and Data Scientists use CARTO Analytics Toolbox to unlock more than 100 spatial functions in BigQuery to enhance data, run advanced spatial analysis and apply industry-specific models to drive business decisioning. You can watch the webinar here: https://go.carto.com/webinars/analytics-toolbox-for-bigquery
Scaling Spatial Analytics with Google Cloud & CARTOCARTO
In this webinar, we focus on how Google Cloud and CARTO can be used to tackle even the most challenging Location Intelligence use cases at scale. You can watch the recorded webinar at: https://go.carto.com/webinars/google-cloud-spatial-analytics-at-scale
Are you a Data Scientist working in the Real Estate industry? Are you trying to build a Data Science team with expertise in spatial?
We bring the London Real Estate Data Science community together to discuss use cases such as whitespace analysis, twin area analysis & indoor analytics - sharing best practices and experiences from both residential and commercial.
Jaime Sanchez walked through a specific case of Spatial Data Science applied to Shared Workspace investment analysis, with an interactive component, before we break out into a discussion about the challenges and opportunities of building Data Science teams in the Real Estate sector.
Geolytix joined the conversation to speak about location planning. As trusted advisors, they help their customers decide how many stores, who to acquire, where to open, which format and how to
optimize home delivery and click & collect operations.
Visit our website for more information: https://carto.com/
Embedding Location Intelligence in Web Apps that Enhance User Experience [Air...CARTO
This webinar focuses on how using CARTO's tech stack to embed Location Intelligence in a variety of web and mobile apps.
Our speakers, Román Jiménez and Víctor Velarde, showcase the latest products and features available for developers to reduce production time of custom-built apps and deliver superior user experiences. Watch the recorded at:
https://go.carto.com/airship-location-intelligence-web-apps-user-experience-recorded
The Role of Indoor Mapping in the “New Normal”CARTO
In this webinar in partnership with Situm, you learn about how technology & analytics can facilitate a safe return to work for your employees. You can watch the recorded webinar at: https://go.carto.com/webinars/situm-indoor-mapping
The Sum of our Parts: the Complete CARTO Journey [CARTO]CARTO
In this webinar, we put all of the pieces together - showing, using the example of the Real Estate market in Los Angeles, how the CARTO platform powers a data-to-decision workflow, showcasing every step along the way.
Watch it now at: https://go.carto.com/sum-parts-complete-carto-journey-webinar-recorded
How to Use Spatial Data Science in your Site Planning Process? [CARTOframes] CARTO
In this webinar, we show how CARTO can be used in site planning applications to analyze multivariate geolocated data and derive data-driven insights when opening, relocating or consolidating location sites.
Watch it now at: https://go.carto.com/how-spatial-data-science-site-planning-webinar-recorded
Helping insurers Uncover Location Data and the Predictive Analytics FactorCARTO
In this webinar, you learn the current challenges insurers are facing and how leveraging LI can help. You can watch the recorded webinar at: https://go.carto.com/insurance-location-data-and-predictive-analytics-factor-recorded
The Ultimate Guide to Location Data: New Datasets & MethodsCARTO
In this webinar, you learn how to get the best insights from existing third party and open data, as well as the need for new derived datasets. You can watch the recorded webinar at: https://go.carto.com/webinars/ultimate-guide-location-data
Applying Spatial Analysis to Real Estate Decision-MakingCARTO
In this webinar you learn the role of spatial data and analysis in Real Estate decision-making, as well as seeing some use cases and how to put it into practice with CARTOframes. You can watch the recorded webinar at: https://go.carto.com/en/webinars/cartoframes-real-estate-recorded
RasterFrames: Enabling Global-Scale Geospatial Machine LearningAstraea, Inc.
RasterFrames™, a proposed LocationTech project, brings the power of Spark SQL and Spark ML to the analysis of global-scale geospatial-temporal raster data. Employing the rich geospatial primitives of LocationTech GeoTrellis and GeoMesa, RasterFrames provides scientists, data scientists and software developers with a unified data and compute model for building image processing pipelines for ETL, data-product creation, statistical analysis, supervised & unsupervised machine learning, and deep learning. Data scientists particularly benefit from the DataFrame-centric entrypoint into big data geospatial analytics.
This talk will introduce RasterFrames, explaining the need it fulfills, the capabilities it provides, and context for determining if RasterFrames is right for the problems you're trying to solve.
By Simeon Fitch
In this webinar, you will learn how aggregated social media sentiment data mentioning COVID-19 can help inform companies' response to the crisis. You can watch the recorded webinar at: https://go.carto.com/webinars/spatialai
In this webinar in partnership with Focal Point, you learn about the future of Indoor Mapping & the role that next-generation GPS technology can play in a range of indoor use cases. You can watch the recorded webinar at: https://go.carto.com/webinars/focalpoint-indoor-mapping
How to Use Geospatial Data to Identify CPG Demnd HotspotsCARTO
The combination of new location data streams and spatial data science techniques opens up a new array of opportunities for CPG data and marketing professionals seeking where to prioritize in terms of ramping up distribution and identifying POS (points of sale).
Using R to Visualize Spatial Data: R as GIS - Guy LansleyGuy Lansley
This talk demonstrates some of the benefits of using R to visualize spatial data efficiently and clearly.
It was originally presented by Guy Lansley (UCL and the Consumer Data Research Centre) to the GIS for Social Data and Crisis Mapping Workshop at the University of Kent.
Understanding Retail Catchment Areas with Human Mobility DataCARTO
In this webinar in partnership with Databricks, you learn how to build more accurate catchment area analysis using human mobility location data. You can watch the recorded webinar at: https://go.carto.com/webinars/databricks-spatial-data-science
Advancing Spatial Analysis in BigQuery using CARTO Analytics ToolboxCARTO
Learn how Analysts and Data Scientists use CARTO Analytics Toolbox to unlock more than 100 spatial functions in BigQuery to enhance data, run advanced spatial analysis and apply industry-specific models to drive business decisioning. You can watch the webinar here: https://go.carto.com/webinars/analytics-toolbox-for-bigquery
Scaling Spatial Analytics with Google Cloud & CARTOCARTO
In this webinar, we focus on how Google Cloud and CARTO can be used to tackle even the most challenging Location Intelligence use cases at scale. You can watch the recorded webinar at: https://go.carto.com/webinars/google-cloud-spatial-analytics-at-scale
Unlocking Geospatial Analytics Use Cases with CARTO and DatabricksDatabricks
Many companies need to analyze large datasets that include location information. To be able to derive business insights from these datasets you need a solution that provides geospatial analysis functionalities and can scale to manage large volumes of information. The combination of CARTO and Databricks allows you to solve this kind of large scale geospatial analytics problems. CARTO provides a location intelligence platform to discover and predict key insights through location data. In this session we will see how we can integrate CARTO and Databricks and how we can take advantage of this combination to solve specific problems for industries such as logistics, telecommunications or financial services.
As more workloads move to severless-like environments, the importance of properly handling downscaling increases. While recomputing the entire RDD makes sense for dealing with machine failure, if your nodes are more being removed frequently, you can end up in a seemingly loop-like scenario, where you scale down and need to recompute the expensive part of your computation, scale back up, and then need to scale back down again.
Even if you aren’t in a serverless-like environment, preemptable or spot instances can encounter similar issues with large decreases in workers, potentially triggering large recomputes. In this talk, we explore approaches for improving the scale-down experience on open source cluster managers, such as Yarn and Kubernetes-everything from how to schedule jobs to location of blocks and their impact (shuffle and otherwise).
Ehtsham Elahi, Senior Research Engineer, Personalization Science and Engineer...MLconf
Spark and GraphX in the Netflix Recommender System: We at Netflix strive to deliver maximum enjoyment and entertainment to our millions of members across the world. We do so by having great content and by constantly innovating on our product. A key strategy to optimize both is to follow a data-driven method. Data allows us to find optimal approaches to applications such as content buying or our renowned personalization algorithms. But, in order to learn from this data, we need to be smart about the algorithms we use, how we apply them, and how we can scale them to our volume of data (over 50 million members and 5 billion hours streamed over three months). In this talk we describe how Spark and GraphX can be leveraged to address some of our scale challenges. In particular, we share insights and lessons learned on how to run large probabilistic clustering and graph diffusion algorithms on top of GraphX, making it possible to apply them at Netflix scale.
Balancing Infrastructure with Optimization and Problem FormulationAlex D. Gaudio
- How do we currently think about Data Science?
- Why is infrastructure important to our field?
- Two tools we've built on Sailthru's Data Science team to deal with these problems are "Stolos" and "Relay.Mesos".
4 Ways Telecoms are Using GIS & Location Intelligence.pdfCARTO
In this webinar Helen McKenzie and Carmen de la O Millán explain how geospatial solutions can optimize telco operations and create new revenue streams, drawing on CARTO and Google Cloud’s collaborations with customers such as Telus and Vodafone.
Can Kanye West Save Gap? Real-Time Consumer Social Media Segmentation On CARTOCARTO
In this webinar, we use Location Intelligence to learn how Kanye West’s collaboration with the retail giant Gap impacted their in-store customer base. You can watch the recorded webinar at: https://go.carto.com/webinars/spatialai-can-kanye-west-save-gap
Location Intelligence: The Secret Sauce for OOH AdvertisingCARTO
In this webinar, Matt Forrest (VP of Solutions Engineering at CARTO) and Mary Layden (Senior Marketing Manager at CARTO) explore how to utilize spatial data science to accurately answer where, how, and when OOH professionals can reach their desired target audience to deliver the best ROI for their clients.
Sentiment, Popularity & Potentiality: 3 Unique KPIs to add to your Site Selec...CARTO
In this webinar, we focus on how to enhance POI datasets with Sentiment, Popularity, and Potentiality KPIs to improve Site Selection and Site Performance use cases. You can watch the recorded webinar at: https://go.carto.com/webinars/data-appeal-site-selection
Spatial Analytics in the Cloud Using Snowflake & CARTOCARTO
In this practical webinar, we focus on how Snowflake and CARTO can be used to tackle even the most advanced location intelligence use cases. You can watch the recorded webinar at: https://go.carto.com/webinars/spatial-extension-snowflake
What Spatial Analytics Tells Us About the Future of the UK High StreetCARTO
In this panel webinar, we'll explore different types of spatial analysis and data and how they can be used across the industry with real-life examples. You can watch the recorded webinar at: https://go.carto.com/webinars/spatial-analytics-uk-retail
Using Spatial Analysis to Drive Post-Pandemic Site Selection in RetailCARTO
In this webinar, we explore how geospatial data & analysis can help retailers better understand market dynamics and consolidate opportunities. You can watch the recorded webinar at: https://go.carto.com/webinars/retail-site-selection
6 Ways CPG Brands are Using Location Data to Prepare for the "Post-Pandemic"CARTO
In this webinar, we explore how leading CPG brands are turning to new location data streams and advanced analytics to emerge stronger from COVID-19. You can watch the recorded webinar at: https://go.carto.com/webinars/dotgis-cpg-location-analytics
Using Places (POI) Data for QSR Site SelectionCARTO
In this webinar in partnership with Foursquare, we outline how using POI & visits data can help QSRs strategically optimize their portfolio of site locations to generate more revenue. You can watch the recorded webinar at: https://go.carto.com/webinars/qsr-site-selection
5 Ways to Strategize for Emerging Short-Term Rental TrendsCARTO
In this webinar in partnership with Transparent, we explore the current state of short-term rentals and how to use vacation rental data to inform your strategy. You can watch the recorded webinar at: https://go.carto.com/webinars/transparent-short-term-rental-trends
Using Location Data to Adapt to the New normalCARTO
Retail and Real Estate professionals around the world are turning to human migration and location data to evolve their strategy and adapt to the new normal. You can watch the recorded webinar at: https://go.carto.com/webinars/unacast-human-migration-location-data
7 Reasons Why CPG Marketers Are Turning To Location AnalyticsCARTO
In this webinar, you will discover 7 reasons why CPG Marketers & Analysts are evolving their analytics by turning to location to drive category growth.
Analyzing the Rise of the Staycation during COVID-19CARTO
In this webinar, you learn how to use location data on commercial POIs & hygiene ratings for predictive analytics to support public health decision-making. You can watch the recorded webinar at: https://go.carto.com/webinars/doorda-staycation-covid19
Data Centers - Striving Within A Narrow Range - Research Report - MCG - May 2...pchutichetpong
M Capital Group (“MCG”) expects to see demand and the changing evolution of supply, facilitated through institutional investment rotation out of offices and into work from home (“WFH”), while the ever-expanding need for data storage as global internet usage expands, with experts predicting 5.3 billion users by 2023. These market factors will be underpinned by technological changes, such as progressing cloud services and edge sites, allowing the industry to see strong expected annual growth of 13% over the next 4 years.
Whilst competitive headwinds remain, represented through the recent second bankruptcy filing of Sungard, which blames “COVID-19 and other macroeconomic trends including delayed customer spending decisions, insourcing and reductions in IT spending, energy inflation and reduction in demand for certain services”, the industry has seen key adjustments, where MCG believes that engineering cost management and technological innovation will be paramount to success.
MCG reports that the more favorable market conditions expected over the next few years, helped by the winding down of pandemic restrictions and a hybrid working environment will be driving market momentum forward. The continuous injection of capital by alternative investment firms, as well as the growing infrastructural investment from cloud service providers and social media companies, whose revenues are expected to grow over 3.6x larger by value in 2026, will likely help propel center provision and innovation. These factors paint a promising picture for the industry players that offset rising input costs and adapt to new technologies.
According to M Capital Group: “Specifically, the long-term cost-saving opportunities available from the rise of remote managing will likely aid value growth for the industry. Through margin optimization and further availability of capital for reinvestment, strong players will maintain their competitive foothold, while weaker players exit the market to balance supply and demand.”
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Data and AI
Discussion on Vector Databases, Unstructured Data and AI
https://www.meetup.com/unstructured-data-meetup-new-york/
This meetup is for people working in unstructured data. Speakers will come present about related topics such as vector databases, LLMs, and managing data at scale. The intended audience of this group includes roles like machine learning engineers, data scientists, data engineers, software engineers, and PMs.This meetup was formerly Milvus Meetup, and is sponsored by Zilliz maintainers of Milvus.
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Data and AI
Round table discussion of vector databases, unstructured data, ai, big data, real-time, robots and Milvus.
A lively discussion with NJ Gen AI Meetup Lead, Prasad and Procure.FYI's Co-Found
Adjusting OpenMP PageRank : SHORT REPORT / NOTESSubhajit Sahu
For massive graphs that fit in RAM, but not in GPU memory, it is possible to take
advantage of a shared memory system with multiple CPUs, each with multiple cores, to
accelerate pagerank computation. If the NUMA architecture of the system is properly taken
into account with good vertex partitioning, the speedup can be significant. To take steps in
this direction, experiments are conducted to implement pagerank in OpenMP using two
different approaches, uniform and hybrid. The uniform approach runs all primitives required
for pagerank in OpenMP mode (with multiple threads). On the other hand, the hybrid
approach runs certain primitives in sequential mode (i.e., sumAt, multiply).
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...John Andrews
SlideShare Description for "Chatty Kathy - UNC Bootcamp Final Project Presentation"
Title: Chatty Kathy: Enhancing Physical Activity Among Older Adults
Description:
Discover how Chatty Kathy, an innovative project developed at the UNC Bootcamp, aims to tackle the challenge of low physical activity among older adults. Our AI-driven solution uses peer interaction to boost and sustain exercise levels, significantly improving health outcomes. This presentation covers our problem statement, the rationale behind Chatty Kathy, synthetic data and persona creation, model performance metrics, a visual demonstration of the project, and potential future developments. Join us for an insightful Q&A session to explore the potential of this groundbreaking project.
Project Team: Jay Requarth, Jana Avery, John Andrews, Dr. Dick Davis II, Nee Buntoum, Nam Yeongjin & Mat Nicholas
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
CARTO Cloud Native – An Introduction to the Spatial Extension for BigQuery
1. CARTO Cloud Native – An
introduction to the Spatial
Extension for BigQuery
Follow @CARTO on Twitter
2. CARTO — Unlock the power of spatial analysis
Introductions
Margara Tejera
Product Manager at CARTO
Miguel Álvarez
Data Scientist at CARTO
3. CARTO — Unlock the power of spatial analysis
Agenda
● Introduction to the Spatial Extension and vision
● Overview of the functions available in the Spatial Extension for BigQuery
● Demo: cluster, polygonize and spatial indexes
● Tiler + feature preview.
● Demo: solving a complete spatial analysis
● Spatial Extension for Snowflake
● Q&A
4. CARTO — Unlock the power of spatial analysis
POLL 1
Data Analyst ………..…………………………………………………………….
Data Scientist ………………….……….………………………………………..
Developer …..…………………………………...………………………………..
What’s your current role?
Other …..…………………………………………………………………………….
6. CARTO — Unlock the power of spatial analysis
CARTO is going cloud native
7. CARTO — Unlock the power of spatial analysis
The CARTO Spatial Extension is
a suite of user defined
functions (UDFs) and
procedures to perform spatial
analysis natively within the
cloud data warehouse
environment.
What’s the Spatial
Extension?
9. CARTO — Unlock the power of spatial analysis
● Scalable and serverless spatial analytics
● No more ETLs: everything happens within the data
warehouse
● Security compliance!
Some key benefits
10.
11. CARTO — Unlock the power of spatial analysis
Status in BigQuery
12. ● 60+ core functions
● 12 advanced
functions and
procedures
* Full list in the Documentation
13. CARTO — Unlock the power of spatial analysis
● Spatial Extension: BigQuery
project called bqcarto.
● Module: BigQuery dataset, e.g. h3,
quadkey, tiler, etc. Organises the
functionality of the Spatial Extension in
categories.
● Function / procedure:
BigQuery UDF functions and
procedures.
14. CARTO — Unlock the power of spatial analysis
POLL 2
Only CARTO ……………………………………………………………………….
Only BigQuery ………………………….………………………………………..
Both CARTO & BigQuery…..………………………………………………..
Do you use CARTO and/or BigQuery ?
15. CARTO — Unlock the power of spatial analysis
Examples & new
CARTO Cloud Native
16. CARTO — Unlock the power of spatial analysis
CARTO Cloud Native
Workspace
17.
18. CARTO — Unlock the power of spatial analysis
Cluster and polygonize
19. CARTO — Unlock the power of spatial analysis
Weather stations
coverage using Voronoi
diagrams
New police stations based
on Chicago Crime
locations
20. CARTO — Unlock the power of spatial analysis
Spatial Indexes
H3 · Quadkey · S2
21. CARTO — Unlock the power of spatial analysis
What are they?
22. CARTO — Unlock the power of spatial analysis
Spatial indices = scalable spatial analysis
Enable to partition the space at different resolutions [viz]
23. CARTO — Unlock the power of spatial analysis
Spatial indices = scalable spatial analysis
Expensive spatial operations like intersections become table JOINS
26. CARTO — Unlock the power of spatial analysis
BigQuery Tiler is a solution to visualise
massive datasets hosted in BigQuery
through the transformation of the original
data into vector tiles.
What is it?
27. CARTO — Unlock the power of spatial analysis
How it works
● Converts tables into tilesets: z, x, y, data (MVT), carto_partition
● Metadata stored in z/x/y -1/NULL/NULL (JSON)
● 4000 partitions using carto_partition: improve speed
● Uses procedures: reads query twice (get metadata, generate tileset)
z x y carto_partition data
16 45340 24576 3605 H4sIAAAAAAAA/5Py52JPdt3eyCLEwM (…)
28. CARTO — Unlock the power of spatial analysis
1. World Population (Worldpop)
2. New American Atlas (CDRC)
3. Night time lights (Colorado School of
Mines)
Examples
Publicly available in BigQuery
project carto-do-public-tilesets
29. CARTO — Unlock the power of spatial analysis
● No configuration needed
● Smart tile memory
management
Feature preview:
Smart Tiler
ST_GENERATETILESET(
input_sql STRING,
output_table_name STRING,
--OPTIONAL
options)
30. CARTO — Unlock the power of spatial analysis
CARTO offers a complete toolset
1. Create tilesets with BigQuery Tiler
2. Serve tiles through the Maps API
3. Visualise tilesets
○ In the Dashboard / Cloud Native Workspace
○ In custom apps through CARTO for deck.gl and CARTO for
React
31. CARTO — Unlock the power of spatial analysis
Point Aggregation
Tileset
● Encodes the original features
(points, lines, polygons) and
their attributes.
● Only for points or data that can be
converted to points.
● Encodes the aggregation of the
points’ attributes.
Simple Tileset
32. CARTO — Unlock the power of spatial analysis
It’s time for a real world example!
33. CARTO — Unlock the power of spatial analysis
Getting access
34. CARTO — Unlock the power of spatial analysis
1. Create BigQuery connection, OAuth type.
2. Choose any billing project
3. Check that you have access running this in BQ:
bqcarto.tiler.VERSION()
35. CARTO — Unlock the power of spatial analysis
Other data
warehouses
36. CARTO — Unlock the power of spatial analysis
Status in
Snowflake
● Same functionality as
in BigQuery, except
Tiler and Data module.
● Installation through the
Snowflake Data
Marketplace.
* Full list in the Documentation
Coming soon!
38. Thanks for listening!
Any questions?
Request a demo at CARTO.COM
Miguel Álvarez
Data Scientist at CARTO // malvarez@cartodb.com
Margara Tejera
Product Manager at CARTO // mtejera@cartodb.com