My Internship Presentation on the project "Real time Network analysis with Apex" along with QA Testing Automation.

1. Internship Semester
Presentation
Real Time Network Analysis with Apex
developed at
DONE BY: UNDER THE GUIDANCE OF:
AMEYA VIJAY GOKHALE DR. SWATI AHIRRAO
14070121505 ASSOCIATE PROFESSOR (CS&IT),
B.TECH (IT) SYMBIOSIS INSTITUTE OF TECHNOLOGY, PUNE

2. Contents
 Objective
 Introduction to BIG DATA / HADOOP
 Software Requirement Specification (SRS)
 Real time Network Analysis with Apex
 Operators & Working
 DataTorrent RTS WebGUI Testing & Automation
 Future scope

3. Objective
Work Environment
• To create an Apex App for Real time Network Analysis
• To Automate the unit testing of DataTorrent RTS WebGUI
• Handling Big Data
• Open-source
• Their Products

4. Introduction to BIG DATA /
HADOOP
 Big Data – large amount of data
 3 V’s – volume, variety and velocity
 Hadoop – distributed systems
 Why Hadoop ?
• Flexible
• Scalable
• Efficient
• Effective

5. SRS
 Software Tools
Operating System Ubuntu 16.04.1 LTS 64-bit
Scripting Language Java 1.8, Python 2.7, Shell Scripting
Server Administration Secure Shell (ssh)
Shell Bash
Text Editor (IDE) JetBrains IntelliJ IDEA & Pycharm
Build System Apache Maven
Version Control Git
System Environment Hadoop Distributed File System (HDFS)
Product in Use Datatorrent RTS 3.8.0

6. SRS
 Hardware Tools
Processor Intel® Core™ i7-4700MQ
Frequency 2.4Ghz
Cores 8
RAM 8GB DDR3
NIC Gigabit Ethernet
Storage 1TB

7. Gantt Chart

8. Slack

9. Real time Network Analysis
 Analysing network traffic in real time
 Analyses usage according to timeBucket
 Handles ~90000 tuples/second

10. Directed Acyclic Graph

11. Flow Chart

12. Operators
 Business Logic Implementation
 Made light weight with independent tasks.
 7 operators
 Ports

13. Operator Life Cycle

14. KafkaSinglePortInputOperator
Pycapa
Application

15. NetworkPacketParser

16. StringFileOutputOperator

17. DimensionsComputation
 Aggregators
 Hadoop Distributed Htable (HDHT)

18. Query & QueryResult

22. DataTorrent RTS WebGUI
Testing & Automation
 Robot Framework
 Acceptance Test-driven development (ATDD)
 Keywords
 Libraries

24. Life Cycle

25. TC Documentation

26. TC

27. Directory Structure
 Tree Structure
 Variables, Libraries, TC’s and Log

28. LOG

29. Future Scope
 Trend Analysis along with Usage
 Better handling of all packets
 Partitioning

31. THANK YOU