Map Analytics in Starcraft II

•

0 likes•139 views

gy8

2/7/2015

Data & Analytics

StarGazer:
!
Map Analytics in StarCraft II
Guang Yang

Pipeline
14
Ingestion
Streaming
Batch
Data-store
API/Front-end

Ingestion
15
API
AWS EC2 Node
AWS EC2 Node
AWS EC2 Node
AWS EC2 Node
Serialize
via Avro
Kafka Topics:
!
- Stream
!
- Batch
Example API Request: http://api.ggtracker.com/api/v1/matches/3529593.json

Serialization
via Avro
- reinforces schema
!
- splittable on HDFS
!
- backward compatible
!
- saves space (binary)

Pipeline
19
Ingestion
Streaming
Batch
Data-store
API/Front-end

Guang Yang
- B.A. in Computational and Applied Mathematics (Rice University)
- M.S. in Industrial Engineering & Operations Research (UC Berkeley)
- Got into Diamond League as Terran without making any Siege Tanks
- Email: gy8@berkeley.edu
- GitHub: github.com/gy8
20

What's hot

Federated Graphite in Docker - Denver Docker MeetupPhil Zimmerman

Graphite cluster setup blueprintAnatoliy Dobrosynets

Automating AWS Infrastructure Provisioning Using Concourse and TerraformCesar Rodriguez

Py datanyc2015rosettahub

Golang Arg / CABA Meetup #5 - go-carbonEzequiel Maraschio

CArcMOOC 03.04 - Gate-level designAlessandro Bogliolo

BASTA 2020 VS Code Data VisualisationMax Kleiner

Let's talk about GraphQLCommit Software Sh.p.k.

WS-VLAMaszbel

G2G マッピングに関するアップデートShota Matsumoto

Mapbox Surface APIbsudekum

Cypher for GremlinopenCypher

Sap standard pp reportsALEJANDRA GONZALEZ GARCIA

Intro to Airflow: Goodbye Cron, Welcome scheduled workflow managementBurasakorn Sabyeying

Weightlifting at SimplySocialBogdan Gaza

Andrii Soldatenko "The art of data engineering"Fwdays

MapMyCabPreetika Kulshrestha

Cypher for GremlinopenCypher

Using Spatial Data Streams In Real-TimeLars Schmitz

Altitude San Francisco 2018: WebAssembly Tools & ApplicationsFastly

What's hot (20)

Federated Graphite in Docker - Denver Docker Meetup

Graphite cluster setup blueprint

Automating AWS Infrastructure Provisioning Using Concourse and Terraform

Py datanyc2015

Golang Arg / CABA Meetup #5 - go-carbon

CArcMOOC 03.04 - Gate-level design

BASTA 2020 VS Code Data Visualisation

Let's talk about GraphQL

WS-VLAM

G2G マッピングに関するアップデート

Mapbox Surface API

Cypher for Gremlin

Sap standard pp reports

Intro to Airflow: Goodbye Cron, Welcome scheduled workflow management

Weightlifting at SimplySocial

Andrii Soldatenko "The art of data engineering"

MapMyCab

Cypher for Gremlin

Using Spatial Data Streams In Real-Time

Altitude San Francisco 2018: WebAssembly Tools & Applications

Similar to Map Analytics in Starcraft II

Map Analytics in Starcraft II (2/3/2015)gy8

SCIO : Apache Beam APIParis Data Engineers !

OSA Con 2022 - Arrow in Flight_ New Developments in Data Connectivity - David...Altinity Ltd

Introduction to Apache Beam (incubating) - DataCamp Salzburg - 7 dec 2016Sergio Fernández

Python Streaming Pipelines on Flink - Beam Meetup at Lyft 2019Thomas Weise

Flink Forward Berlin 2018: Robert Bradshaw & Maximilian Michels - "Universal ...Flink Forward

GraphQL in Apache Sling - but isn't it the opposite of REST?Bertrand Delacretaz

Apache Spark Structured Streaming + Apache Kafka = ♡Bartosz Konieczny

Kafka pours and Spark resolvesAlexey Zinoviev

Hands on with CoAP and CaliforniumJulien Vermillard

Introducing Kafka's Streams APIconfluent

Spark (Structured) Streaming vs. Kafka Streams - two stream processing platfo...Guido Schmutz

Rethinking Stream Processing with Apache Kafka: Applications vs. Clusters, St...Michael Noll

Academy PRO: Node.js - miscellaneous. Lecture 5Binary Studio

Building a Bridge between Terraform and ArgoCDCarlos Santana

簡単にレビュー環境が作れる仕組みを作ってる話し正貴小川

GraphQL in ProductionBogdan Nedelcu

Web 2 . .3 Development ServicesTheawaster485

Rethinking Stream Processing with Apache Kafka: Applications vs. Clusters, St...Michael Noll

"Intro to Stateful Services or How to get 1 million RPS from a single node", ...Fwdays

Similar to Map Analytics in Starcraft II (20)

Map Analytics in Starcraft II (2/3/2015)

SCIO : Apache Beam API

OSA Con 2022 - Arrow in Flight_ New Developments in Data Connectivity - David...

Introduction to Apache Beam (incubating) - DataCamp Salzburg - 7 dec 2016

Python Streaming Pipelines on Flink - Beam Meetup at Lyft 2019

Flink Forward Berlin 2018: Robert Bradshaw & Maximilian Michels - "Universal ...

GraphQL in Apache Sling - but isn't it the opposite of REST?

Apache Spark Structured Streaming + Apache Kafka = ♡

Kafka pours and Spark resolves

Hands on with CoAP and Californium

Introducing Kafka's Streams API

Spark (Structured) Streaming vs. Kafka Streams - two stream processing platfo...

Rethinking Stream Processing with Apache Kafka: Applications vs. Clusters, St...

Academy PRO: Node.js - miscellaneous. Lecture 5

Building a Bridge between Terraform and ArgoCD

簡単にレビュー環境が作れる仕組みを作ってる話し

GraphQL in Production

Web 2 . .3 Development Services

Rethinking Stream Processing with Apache Kafka: Applications vs. Clusters, St...

"Intro to Stateful Services or How to get 1 million RPS from a single node", ...

Recently uploaded

RA-11058_IRR-COMPRESS Do 198 series of 1998YohFuh

Unveiling Insights: The Role of a Data AnalystSamantha Rae Coolbeth

April 2024 - Crypto Market Report's Analysismanisha194592

Kantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdfSocial Samosa

Week-01-2.ppt BBB human Computer interactionfulawalesam

VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...Suhani Kapoor

Call Girls In Mahipalpur O9654467111 Escorts ServiceSapana Sha

Industrialised data - the key to AI success.pdfLars Albertsson

Delhi 99530 vip 56974 Genuine Escort Service Call Girls in Kishangarh9953056974 Low Rate Call Girls In Saket, Delhi NCR

EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptxthyngster

Customer Service Analytics - Make Sense of All Your Data.pptxEmmanuel Dauda

VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...Suhani Kapoor

04242024_CCC TUG_Joins and Relationshipsccctableauusergroup

Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Callshivangimorya083

Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsappssapnasaifi408

VidaXL dropshipping via API with DroFx.pptxolyaivanovalion

꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...Call Girls In Delhi Whatsup 9873940964 Enjoy Unlimited Pleasure

定制英国白金汉大学毕业证（UCB毕业证书）成绩单原版一比一ffjhghh

꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Callshivangimorya083

Generative AI on Enterprise Cloud with NiFi and MilvusTimothy Spann

Recently uploaded (20)

RA-11058_IRR-COMPRESS Do 198 series of 1998

Unveiling Insights: The Role of a Data Analyst

April 2024 - Crypto Market Report's Analysis

Kantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdf

Week-01-2.ppt BBB human Computer interaction

VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...

Call Girls In Mahipalpur O9654467111 Escorts Service

Industrialised data - the key to AI success.pdf

Delhi 99530 vip 56974 Genuine Escort Service Call Girls in Kishangarh

EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptx

Customer Service Analytics - Make Sense of All Your Data.pptx

VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...

04242024_CCC TUG_Joins and Relationships

Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call

Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsapps

VidaXL dropshipping via API with DroFx.pptx

꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...

定制英国白金汉大学毕业证（UCB毕业证书）成绩单原版一比一

꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call

Generative AI on Enterprise Cloud with NiFi and Milvus