Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Unlock the value of your big data infrastructure

91 views

Published on

Learn how to optimize big data apps and leverage graph databases for your business.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Unlock the value of your big data infrastructure

  1. 1. Applications Manager Unlock the value of your big data infrastructure
  2. 2. Presenter : Selvaraj Please comment 'YES' in the chat panel if the presenter's voice is audible and the presentation screen is clear.
  3. 3. Week Module Date Schedule Status 1. Key to Optimal End User Experience Nov 13 6:00 AM GMT 11:00 AM EST Completed Completed 2. Unlock the value of your big data infrastructure Nov 20 6:00 AM GMT 11:00 AM EST Completed In Progress 3. Building the right website monitoring strategy Dec 4 6:00 AM GMT 11:00 AM EST Upcoming Upcoming 4. Monitoring Cloud,Containers and hyperconverged infrastructure Dec 11 6:00 AM GMT 11:00 AM EST Upcoming Upcoming
  4. 4. Agenda Big data apps: Apache Hadoop & Spark Leverage graph database for your business NoSQL databases in Big Data frameworks Forecasting utilization trends and planning capacity
  5. 5. Discovery & mapping Big data apps
  6. 6. The Hadoop Architecture Hadoop Common HDFS YARN MapReduce
  7. 7. The key Hadoop components • HDFS • MapReduce • YARN • NoSQL Database
  8. 8. HDFS
  9. 9. MapReduce
  10. 10. YARN
  11. 11. Apache Spark architecture Spark Driver program Spark Scheduler Worker node Worker node HDFS NoSQ L Mesos /YARN
  12. 12. Spark key components • Drivers and Workers in Spark • Memory and resource utilization • Spark cores and applications • Spark RDDs • NoSQL database
  13. 13. Workers
  14. 14. Memory
  15. 15. Memory
  16. 16. Spark Core and Applications
  17. 17. RDDs
  18. 18. Leverage graph database for your business
  19. 19. Neo4j architecture
  20. 20. The key metrics • Nodes & Relationship • Memory • Page Cache • Transactions
  21. 21. Nodes & Relationship
  22. 22. Memory
  23. 23. Page Cache
  24. 24. Transactions
  25. 25. The NoSQL databases in Big Data set ups
  26. 26. MongoDB - Network & connections • Connections used • Connections available • Network traffic received • Network traffic sent
  27. 27. MongoDB - Lock & Asserted errors • Read Lock, Write Lock • Message, User asserts
  28. 28. Cassandra - CPU usage
  29. 29. Cassandra - Keyspace latency • Read Latency (/min) • Write Latency (/min)
  30. 30. Redis - Keys • Number of keys • Expired keys
  31. 31. Redis - Clients • Connected clients • Blocked clients
  32. 32. Discovery & mapping Disk and Memory issues in NoSQL databases
  33. 33. MongoDB memory utilization
  34. 34. MongoDB replication
  35. 35. Cassandra Memory Utilization • Free Memory • Used Memory
  36. 36. Cassandra-Cluster • Node state • Unreachable nodes
  37. 37. Redis-Memory utilization
  38. 38. Redis-Replication
  39. 39. Discovery & mapping Forecasting utilization trends and planning capacity
  40. 40. Trend analysis report Pull at a glance report of the DB server to have a quick glance at all monitored attributes
  41. 41. Trend analysis report Quick glance at the performance of all monitored attributes: • History Report • Hour of Day Report • Day of Week Report • Statistical Report • Heat Chart
  42. 42. Compare performance attribute reports of different monitors. View & compare reports
  43. 43. • Balance hardware costs with computing needs. • Plan future utilization requirements. Forecast report
  44. 44. Contact : eval-apm@manageengine.com Online Demo : demo.appmanager.com Quick Recap Big Data and the non-relational database • Big data apps: Apache Hadoop & Spark • Leverage graph database for your business • NoSQL databases in Big Data frameworks • Forecasting utilization trends and planning capacity
  45. 45. Contact : eval-apm@manageengine.com Online Demo : demo.appmanager.com Questions?
  46. 46. Contact : eval-apm@manageengine.com Online Demo : demo.appmanager.com Can I discover all the nodes in Mongo DB through Applications Manager?
  47. 47. Contact : eval-apm@manageengine.com Online Demo : demo.appmanager.com Am already monitoring my Cassandra DB with AppManager, However I need to customize polling for few metrics. Is it possible?
  48. 48. Contact : eval-apm@manageengine.com Online Demo : demo.appmanager.com Can I get a automatic report of Availability of my databases everyday?
  49. 49. Upcoming topics : Dec 4, 2019 Contact : eval-apm@manageengine.com Online Demo : demo.appmanager.com Building the right website monitoring strategy • Track key metrics of Apache, IIS, NGINX, NGINX Plus, etc. • Optimize individual URLs for better end user experience • Simulate web transactions with synthetic transaction monitoring • Detect unauthorized content changes in your website
  50. 50. Contact : eval-apm@manageengine.com Online Demo : demo.appmanager.com

×