Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Data-In-Motion Unleashed

406 views

Published on

See how you can go from zero to live streaming in under 10 minutes.

Published in: Technology
  • Be the first to comment

Data-In-Motion Unleashed

  1. 1. Data-in-Motion Unleashed Andrew Psaltis IoT Solutions Architect Hortonworks
  2. 2. Hortonworks DataFlow (HDF) à The HDF – Data in Motion – Journey at Summit à The End-to-End Data in Motion Challenge à Introducing Streaming Analytics Manager (SAM) HDF HORTONWORKS DATAFLOW
  3. 3. The HDF Journey STREAM PROCESSING HDF Real-time dashboard on top of HDP Hadoop Summit
  4. 4. Enhanced with enrichment and predictive analytics Hadoop Summit The HDF Journey STREAM PROCESSING HDF
  5. 5. The HDF Journey HDF FLOW MANAGEMENT All about Data Collection Hadoop Summit
  6. 6. The HDF Journey STREAM PROCESSING HDF ENTERPRISE SERVICES FLOW MANAGEMENT 2017 HDF 3.0 End-to-end solution for data in motion Dataworks Summit
  7. 7. Data In Motion Across the Enterprise DATA LIFECYCLE BEGINS DATA VISUALIZATIONS & OPERATIONS CONTROL ROUTING, STREAM PROCESSING & ANALYTICS
  8. 8. Across the Enterprise with HDF COLLECT DATA AT THE EDGE ANALYZE, VISUALIZE, PREDICT, & PRESCRIBE ROUTE, PROCESS, DELIVER, & SYNDICATE HDF SECURITY PROVENANCE DATA COMMAND & CONTROL FLOW MANAGEMENT STREAM PROCESSING & ANALYTICS
  9. 9. Collect Data at the Edge
  10. 10. Collect Data at the Edge SENT SECURED / CONTROLLED / TRACKED RECEIVED FROM VEHICLE SENSORS AQUIRE PRIORITIZE ANALYZE/ROUTE TRANSMIT
  11. 11. HDF Route, Process, Deliver and Syndicate Apache NiFi Apache Kafka
  12. 12. HDF Route, Process, Deliver and Syndicate Apache NiFi Apache Kafka
  13. 13. Analyze, Visualize, Predict and Prescribe HDF
  14. 14. Analyze, Visualize, Predict and Prescribe HDF
  15. 15. End-to-End Vision à Intelligence from edge to core à Closed-loop processing à Fully governed and secure à Centralized management/policy with distributed execution à Multi-tenant, multi-organization infrastructure
  16. 16. HDF: Data-in-Motion Platform à Scalable broker for streaming apps à Scale out computational engine à Complex event processing à Pattern matching à Prescriptive/predictive analytics FLOW MANAGEMENT STREAM PROCESSING / ANALYTICS ENTERPRISE SERVICES ▪ Acquisition and delivery ▪ Transformation, filtering, and routing ▪ Simple event processing ▪ Complete data provenance ▪ Bi-directional communication ▪ Provisioning and management ▪ Monitoring and security ▪ Auditing and compliance ▪ Governance and multi-tenancy
  17. 17. Find more #DWS17 sessions and slides at: www.DataWorksSummit.com
  18. 18. 18 T H A N K Y O U

×