- Introduction This will cover a brief introduction of Apache Nifi and Minifi. - Customer Use Cases We will discuss few use cases using Apache Nifi. - How to create your Processor in Nifi We will show a sample implementation of Nifi Processor We will show case a simple log processing using Apache Nifi

1. Apache NiFi
Getting Started …
Tijo Thomas
Srinath Thota

2. Systems Fail
Data access exceeds capacity to consume
Boundary conditions are mere suggestion
Business Priority
Systems evolve at different rates
Compliance and security
Continuous improvement occurs in production

3. Source : https://www.confluent.io/blog/stream-data-platform-1/

4.  Systems Fail
◦ Networks fail, disks fail, software crashes
 Data access exceeds capacity to consume
◦ Sometimes a given data source can outpace some part of the processing
 Boundary conditions are mere suggestion
◦ You will invariably get data that is too big, too small, too fast, too slow, corrupt, wrong, or in the wrong
format.
 Business Priority
◦ Priorities of an organization change – rapidly
 Systems evolve at different rates
◦ The protocols and formats used by a given system can change anytime and often irrespective of the systems
around them
 Compliance and security
 Continuous improvement occurs in production

5.  Web based user interface for creating , monitoring and controlling data
flow
 Graph based approach for data routing and transformation
 Highly configurable
 Dynamic prioritization at runtime
 Provenance
 Back pressure
 Easy Extensions - Create your own components

6. Twitter feed Ingestion
Multi Source Data Ingestion

9. Key Differentiator
Provide Bi Directional Communication
NiFi is installed in the Data center
MiNiFi is a light weight client for Nifi can be installed in any IOT devices