The document outlines modules for managing big data and non-relational database applications, detailing their scheduling, agenda, and key topics such as visibility, monitoring strategies, and performance analysis. It covers essential components of Hadoop and Spark, as well as issues related to disk and memory in NoSQL databases like MongoDB, Cassandra, and Redis. The document also emphasizes forecasting utilization trends and capacity planning, providing contact information for further inquiry and an online demo.

1. Discovery & mapping
Big Data and Non relational database

2. Applications Manager
An all round on-premises application performance solution for IT Ops and DevOps

3. Week Module Date Schedule Status
1. Visibility: From web application
interface to the database
Aug 21 6:00 AM GMT
11:00 AM EDT
Completed
Completed
2. Big Data and the Non Relational
database
Aug 28 6:00 AM GMT
11:00 AM EDT
In Progress
Upcoming
3. Implementing the right website
monitoring strategy
Sept 4 6:00 AM GMT
11:00 AM EDT
Upcoming
Upcoming
4. Monitoring Cloud applications and
Containers
Sept 11 6:00 AM GMT
11:00 AM EDT
Upcoming
Upcoming

4. Agenda
Big data apps:
Apache Hadoop & Spark
NoSQL databases in Big Data
frameworks
Disk and memory issues in
NoSQL databases
Forecasting utilization trends and
planning capacity

5. Discovery & mapping
Big data apps

6. The Hadoop Architecture
Hadoop
Common
HDFS
YARN
MapReduce

7. The key Hadoop
components
• HDFS
• MapReduce
• YARN
• NoSQL Database

8. HDFS

9. MapReduce

10. YARN

11. Apache Spark
architecture
Spark Driver program
Spark Scheduler
Worker node Worker node
HDFS
NoSQ
L
Mesos /YARN

12. Spark key components
• Drivers and Workers in Spark
• Memory and resource utilization
• Spark cores and applications
• Spark RDDs
• NoSQL database

13. Workers

14. Memory

15. Memory

16. Spark Core and
Applications

17. RDDs

18. The NoSQL databases in Big Data set ups

19. MongoDB - Network & connections
• Connections used
• Connections available
• Network traffic received
• Network traffic sent

20. MongoDB - Lock & asserted errors
• Read Lock, Write Lock
• Message, User asserts

21. Cassandra - CPU
usage

22. Cassandra - Keyspace latency
• Read Latency (/min)
• Write Latency (/min)

23. Redis - Keys
• Number of keys
• Expired keys

24. Redis - Clients
• Connected clients
• Blocked clients

25. Discovery & mapping
Disk and Memory issues in NoSQL databases

26. MongoDB memory utilization

27. MongoDB replication

28. Cassandra Memory
Utilization
• Free Memory
• Used Memory

29. Cassandra-Cluster
• Node state
• Unreachable nodes

30. Redis-Memory utilization

31. Redis-Replication

32. Discovery & mapping
Forecasting utilization trends and planning capacity

33. Trend analysis report
Pull at a glance report of the DB server to have a quick glance at all monitored
attributes

34. Trend analysis report
Quick glance at the performance of all monitored attributes:
• History Report
• Hour of Day Report
• Day of Week Report
• Statistical Report
• Heat Chart

35. Compare performance attribute reports of different monitors.
View & compare reports

36. • Balance hardware
costs with computing
needs.
• Plan future utilization
requirements.
Forecast report

37. Contact : eval-apm@manageengine.com
Online Demo : demo.appmanager.com
Quick Recap
Big Data and the non-relational database
• Big data apps: Apache Hadoop & Spark
• NoSQL databases in Big Data frameworks
• Disk and memory issues in NoSQL DBs
• Forecasting utilization trends and planning capacity

38. Contact : eval-apm@manageengine.com
Online Demo : demo.appmanager.com