Druid
Beginner Performance
Tips
Playground
● Raw data 15 TB
● 1 Datasource
○ 8.5 TB
○ Each segment file 400 MB
○ 23 dimensions - 3 metrics (2sum & 1 hyperUniq)
● Hdfs Deep Storage
● 1 Broker - r3-2x-large
Some Tips
● DO-NOT enable Debug Log while running perf tests or in production.
● Set ChunkPeriod in QueryContext
● DO-NOT use pretty while making http request query.
○ curl -X POST "http://broker:8082/druid/v2/?pretty" -H 'content-type:application/json' -d @query
● Groupby version v2 seems to be better.
● Make Druid SMILE :)
○ Use Content-Type ‘application/x-jackson-smile’ while making http
Thank you :)
I know this ppt is short!
-Vishnu rao-
mash213.wordpress.com
Tweet @ sweetweet213
Jaihind213 @ gmail dot com

Druid beginner performance tips

  • 1.
  • 2.
    Playground ● Raw data15 TB ● 1 Datasource ○ 8.5 TB ○ Each segment file 400 MB ○ 23 dimensions - 3 metrics (2sum & 1 hyperUniq) ● Hdfs Deep Storage ● 1 Broker - r3-2x-large
  • 3.
    Some Tips ● DO-NOTenable Debug Log while running perf tests or in production. ● Set ChunkPeriod in QueryContext ● DO-NOT use pretty while making http request query. ○ curl -X POST "http://broker:8082/druid/v2/?pretty" -H 'content-type:application/json' -d @query ● Groupby version v2 seems to be better. ● Make Druid SMILE :) ○ Use Content-Type ‘application/x-jackson-smile’ while making http
  • 4.
    Thank you :) Iknow this ppt is short! -Vishnu rao- mash213.wordpress.com Tweet @ sweetweet213 Jaihind213 @ gmail dot com