Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Elastic Stack roadmap deep dive

451 views

Published on

Learn about features with demos and announcements, from cross-cluster replication and frozen indices in Elasticsearch to Kibana Spaces and the ever-growing set of data integrations in Beats and Logstash.

Published in: Technology
  • Would you like to earn extra cash ➽➽ https://dwz1.cc/EWG1lhe4
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • DOWNLOAD THIS BOOKS INTO AVAILABLE FORMAT (2019 Update) ......................................................................................................................... ......................................................................................................................... Download Full PDF EBOOK here { https://soo.gd/irt2 } ......................................................................................................................... Download Full EPUB Ebook here { https://soo.gd/irt2 } ......................................................................................................................... Download Full doc Ebook here { https://soo.gd/irt2 } ......................................................................................................................... Download PDF EBOOK here { https://soo.gd/irt2 } ......................................................................................................................... Download EPUB Ebook here { https://soo.gd/irt2 } ......................................................................................................................... Download doc Ebook here { https://soo.gd/irt2 } ......................................................................................................................... ......................................................................................................................... ................................................................................................................................... eBook is an electronic version of a traditional print book THIS can be read by using a personal computer or by using an eBook reader. (An eBook reader can be a software application for use on a computer such as Microsoft's free Reader application, or a book-sized computer THIS is used solely as a reading device such as Nuvomedia's Rocket eBook.) Users can purchase an eBook on diskette or CD, but the most popular method of getting an eBook is to purchase a downloadable file of the eBook (or other reading material) from a Web site (such as Barnes and Noble) to be read from the user's computer or reading device. Generally, an eBook can be downloaded in five minutes or less ......................................................................................................................... .............. Browse by Genre Available eBooks .............................................................................................................................. Art, Biography, Business, Chick Lit, Children's, Christian, Classics, Comics, Contemporary, Cookbooks, Manga, Memoir, Music, Mystery, Non Fiction, Paranormal, Philosophy, Poetry, Psychology, Religion, Romance, Science, Science Fiction, Self Help, Suspense, Spirituality, Sports, Thriller, Travel, Young Adult, Crime, Ebooks, Fantasy, Fiction, Graphic Novels, Historical Fiction, History, Horror, Humor And Comedy, ......................................................................................................................... ......................................................................................................................... .....BEST SELLER FOR EBOOK RECOMMEND............................................................. ......................................................................................................................... Blowout: Corrupted Democracy, Rogue State Russia, and the Richest, Most Destructive Industry on Earth,-- The Ride of a Lifetime: Lessons Learned from 15 Years as CEO of the Walt Disney Company,-- Call Sign Chaos: Learning to Lead,-- StrengthsFinder 2.0,-- Stillness Is the Key,-- She Said: Breaking the Sexual Harassment Story THIS Helped Ignite a Movement,-- Atomic Habits: An Easy & Proven Way to Build Good Habits & Break Bad Ones,-- Everything Is Figureoutable,-- What It Takes: Lessons in the Pursuit of Excellence,-- Rich Dad Poor Dad: What the Rich Teach Their Kids About Money THIS the Poor and Middle Class Do Not!,-- The Total Money Makeover: Classic Edition: A Proven Plan for Financial Fitness,-- Shut Up and Listen!: Hard Business Truths THIS Will Help You Succeed, ......................................................................................................................... .........................................................................................................................
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

Elastic Stack roadmap deep dive

  1. 1. Shay Banon | Founder & CEO Aaron Katz | CRO Janesh Moorjani | CFO Elastic Overview Elastic Stack Updates and Roadmap Alex Francoeur
  2. 2. Ingest
  3. 3. Ingest
  4. 4. Ingest
  5. 5. Ingest
  6. 6. Ingest
  7. 7. Elastic Common Schema @timestamp http.request.method host.hostname source.ip geo.location
  8. 8. Ingest Node: Enrichment Processor source.ip => is_known_botnet? geo.location => city/region/country
  9. 9. Adding Data
  10. 10. • What technology? (eg. Nginx) • What to monitor? (eg. logs, metrics, packets) • Where is it? (eg. paths to logfiles) Integrations Manager
  11. 11. • Beats config • Ingest node config • Index template • First index • Index alias • Index lifecycle management policy • Snapshot lifecycle management policy • Index patterns • Kibana dashboards • Canvas workpads • Machine learning jobs • Alerts Automatically Setup
  12. 12. • Beats config • Ingest node config • Index template • First index • Index alias • Index lifecycle management policy • Snapshot lifecycle management policy • Index patterns • Kibana dashboards • Canvas workpads • Machine learning jobs • Alerts Automatically Setup
  13. 13. Filebeat Metricbeat Packetbeat WinLogBeat Heartbeat Journalbeat Beats Agent Beats Config
  14. 14. • Single config language • Installs required Beats • Upgrades Beats • Upgrades itself Beats Agent
  15. 15. Fleet • Centralized Config Deployment
 • Centralized Beats Monitoring
 • Centralized Upgrade Management
  16. 16. Data Management
  17. 17. Frozen Indices
  18. 18. Heap File system cache Disk
  19. 19. Heap File system cache Disk
  20. 20. Index Lifecycle Management
  21. 21. Hot Nodes 1 2 3 Cold NodesWarm Nodes
  22. 22. 1 2 3 1 2 3 Hot Nodes Cold NodesWarm Nodes
  23. 23. 1 2 3 1 2 3 Hot Nodes Cold NodesWarm Nodes
  24. 24. 231 2 3 Hot Nodes Cold NodesWarm Nodes 1
  25. 25. 1 Hot Nodes Cold NodesWarm Nodes 1 2 3
  26. 26. 1 Hot Nodes Cold NodesWarm Nodes 1 2 3
  27. 27. Hot Nodes Cold NodesWarm Nodes 1 2 3
  28. 28. Hot Nodes Cold NodesWarm Nodes 1 2 3
  29. 29. (coming soon to X-Pack)
  30. 30. Snapshot Lifecycle Management
  31. 31. • Periodic scheduled backups • Retention polices for automatic deletion Snapshot Management
  32. 32. Data Transforms
  33. 33. Clickstream Data
  34. 34. Page views per minute? Clickstream Data
  35. 35. 99th percentile latency? Clickstream Data
  36. 36. Most frequent URLs? Clickstream Data
  37. 37. How long was session 1? Clickstream Data
  38. 38. How long was session 1? Clickstream Data
  39. 39. Average session length? Clickstream Data
  40. 40. Average session length? Session Data
  41. 41. Average number of pages per session? Session Data
  42. 42. Most frequent exit page per session? Session Data
  43. 43. Session Data
  44. 44. How frequently do users visit the site? Session Data
  45. 45. How frequently do users visit the site? User Data
  46. 46. • Pivot • Pattern Matching Data Transformation
  47. 47. Advanced ML Analytics
  48. 48. • Outlier detection • Supervised model training for regression & classification • Ingest Prediction Processor Advanced ML Analytics
  49. 49. Search
  50. 50. Performance improvements
  51. 51. Query Before After Improvement Fuzzy 46 qps Phrase 4 qps Bool AND 9.3 qps Bool OR 3.3 qps Term 33 qps
  52. 52. Query Before After Improvement Fuzzy 46 qps 59 qps 28% Phrase 4 qps 7 qps 87% Bool AND 9.3 qps 23.5 qps 247% Bool OR 3.3 qps 9.8 qps 292% Term 33 qps 1,160 qps 3,700%
  53. 53. Magic WAND
  54. 54. "query" : "elasticsearch and lucene" max_score(and) == 1 max_score(lucene) == 5 max_score(elasticsearch) == 3 Weak-AND
  55. 55. Min top-10 score and (1) elasticsearch (3) lucene (5) <=1 ✓ ✓ ✓ > 1 and <= 4 ✗ ✓ ✓ > 4 and <= 9 ✗ ✗ ✓ > 9 ✗ ✗ ✗ Weak-AND
  56. 56. Weak-AND
  57. 57. Weak-AND "aggs": { ... } "track_total_hits": true
  58. 58. "hits": { "total": 123456789, "hits": [ ... ] } "hits": { "total": { "value": 10000, "relation": "gte" }, "hits": [ ... ] } Weak-AND
  59. 59. Search as you type
  60. 60. index_prefixes:
 qu, qui, quic, quick br, bro, brow, brown fo, fox, foxe, foxes

  61. 61. index_phrases: the_quick
 quick_brown
 brown_fox
 fox_jumped
 jumped_over over_the the_lazy lazy_dog
  62. 62. match_phrase_prefix: “quick brown f*”
  63. 63. Advanced Scoring
  64. 64. rank_feature: Advanced Scoring • Star Ratings • PageRank • Popularity
  65. 65. score = BM25(Text) + PageRank rank_feature: Advanced Scoring • Star Ratings • PageRank • Popularity
  66. 66. score = BM25(Text) + Saturation(PageRank) rank_feature: Advanced Scoring • Star Ratings • PageRank • Popularity
  67. 67. distance_feature: rank_feature: Advanced Scoring • Date • Geopoint • Numeric • Star Ratings • PageRank • Popularity
  68. 68. script_score: • Custom scoring, including vectors distance_feature: • Date • Geopoint • Numeric rank_feature: Advanced Scoring • Star Ratings • PageRank • Popularity
  69. 69. Work with WAND script_score: • Custom scoring, including vectors distance_feature: rank_feature: Advanced Scoring • Star Ratings • PageRank • Popularity • Date • Geopoint • Numeric
  70. 70. Result Pinning
  71. 71. Geoshapes
  72. 72. • v2.3: 1 dim, for numbers and dates • v5.0: 2 dim, for geopoints • v5.2: 2 dim, for number & date ranges • v6.7: 7 dim, for geoshapes BKD Trees
  73. 73. BKD Geoshapes
  74. 74. • Accurate to 1cm, vs 50m • Index is 60% smaller • Indexing 60% faster • Queries 50% faster • Plus BKD GeoPoints 80% faster indexing BKD Geoshapes
  75. 75. Distributed Layer
  76. 76. Zen
  77. 77. minimum_master_nodes: 2
  78. 78. minimum_master_nodes: 2
  79. 79. minimum_master_nodes: 2
  80. 80. minimum_master_nodes: 1
  81. 81. minimum_master_nodes: 1 cluster.initial_master_nodes
  82. 82. Cross Cluster Search
  83. 83. New York London Tokyo
  84. 84. v5.6 v6.7 v7.x Three Major Versions
  85. 85. Cross Cluster Replication
  86. 86. New York London Tokyo ldn_sales ldn_sales
  87. 87. New York London Tokyo tk_salesny_sales
  88. 88. New York London Tokyo tk_salesny_sales ldn_sales ldn_sales
  89. 89. Kibana
  90. 90. Security
  91. 91. PKI SAML Kerberos OpenID
  92. 92. Lens
  93. 93. New Platform
  94. 94. Custom Workflows Stable Plugin APIs Typescript Shared Services
  95. 95. Task Manager/Alerting
  96. 96. SIEM Stack Monitoring Machine Learning Observability
  97. 97. 112
  98. 98. Templated Alerts when [CPU] > [90%] then alert [alerts@me.com]
  99. 99. Chart-based Alerts
  100. 100. function my_alert() {…} Custom Alerts
  101. 101. Guides
  102. 102. News Feed
  103. 103. Thank you

×