Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Big data and non relational database

91 views

Published on

Learn how to monitor critical big data metrics and understand how effective capacity planning can help in achieving optimal database performance.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Big data and non relational database

  1. 1. Discovery & mapping Big Data and Non relational database
  2. 2. Applications Manager An all round on-premises application performance solution for IT Ops and DevOps
  3. 3. Week Module Date Schedule Status 1. Visibility: From web application interface to the database Aug 21 6:00 AM GMT 11:00 AM EDT Completed Completed 2. Big Data and the Non Relational database Aug 28 6:00 AM GMT 11:00 AM EDT In Progress Upcoming 3. Implementing the right website monitoring strategy Sept 4 6:00 AM GMT 11:00 AM EDT Upcoming Upcoming 4. Monitoring Cloud applications and Containers Sept 11 6:00 AM GMT 11:00 AM EDT Upcoming Upcoming
  4. 4. Agenda Big data apps: Apache Hadoop & Spark NoSQL databases in Big Data frameworks Disk and memory issues in NoSQL databases Forecasting utilization trends and planning capacity
  5. 5. Discovery & mapping Big data apps
  6. 6. The Hadoop Architecture Hadoop Common HDFS YARN MapReduce
  7. 7. The key Hadoop components • HDFS • MapReduce • YARN • NoSQL Database
  8. 8. HDFS
  9. 9. MapReduce
  10. 10. YARN
  11. 11. Apache Spark architecture Spark Driver program Spark Scheduler Worker node Worker node HDFS NoSQ L Mesos /YARN
  12. 12. Spark key components • Drivers and Workers in Spark • Memory and resource utilization • Spark cores and applications • Spark RDDs • NoSQL database
  13. 13. Workers
  14. 14. Memory
  15. 15. Memory
  16. 16. Spark Core and Applications
  17. 17. RDDs
  18. 18. The NoSQL databases in Big Data set ups
  19. 19. MongoDB - Network & connections • Connections used • Connections available • Network traffic received • Network traffic sent
  20. 20. MongoDB - Lock & asserted errors • Read Lock, Write Lock • Message, User asserts
  21. 21. Cassandra - CPU usage
  22. 22. Cassandra - Keyspace latency • Read Latency (/min) • Write Latency (/min)
  23. 23. Redis - Keys • Number of keys • Expired keys
  24. 24. Redis - Clients • Connected clients • Blocked clients
  25. 25. Discovery & mapping Disk and Memory issues in NoSQL databases
  26. 26. MongoDB memory utilization
  27. 27. MongoDB replication
  28. 28. Cassandra Memory Utilization • Free Memory • Used Memory
  29. 29. Cassandra-Cluster • Node state • Unreachable nodes
  30. 30. Redis-Memory utilization
  31. 31. Redis-Replication
  32. 32. Discovery & mapping Forecasting utilization trends and planning capacity
  33. 33. Trend analysis report Pull at a glance report of the DB server to have a quick glance at all monitored attributes
  34. 34. Trend analysis report Quick glance at the performance of all monitored attributes: • History Report • Hour of Day Report • Day of Week Report • Statistical Report • Heat Chart
  35. 35. Compare performance attribute reports of different monitors. View & compare reports
  36. 36. • Balance hardware costs with computing needs. • Plan future utilization requirements. Forecast report
  37. 37. Contact : eval-apm@manageengine.com Online Demo : demo.appmanager.com Quick Recap Big Data and the non-relational database • Big data apps: Apache Hadoop & Spark • NoSQL databases in Big Data frameworks • Disk and memory issues in NoSQL DBs • Forecasting utilization trends and planning capacity
  38. 38. Contact : eval-apm@manageengine.com Online Demo : demo.appmanager.com

×