More Related Content
Similar to Hello Streams Overview
Similar to Hello Streams Overview (20)
Hello Streams Overview
- 1. Copyright © 2014, Hello Streams
All rights reserved. http://www.HelloStreams.com. Private & Confidential.
Hello Streams
An End-To-End Solution for Realtime Analytics
of Streaming Big Data
- 2. Copyright © 2014, Hello Streams
All rights reserved. http://www.HelloStreams.com. Private & Confidential.
Complex Event Processing
Visualize data on
Custom Dashboards
Process
CacheIndex
Apps
Sensors
Servers
Query +
Visualization
Collect Events from Any
Source
Its an End to End Solution
End to End Latency : Few Seconds
- 3. Copyright © 2014, Hello Streams
All rights reserved. http://www.HelloStreams.com. Private & Confidential.
Key Benefits
• Realtime in true sense!
– Latency between data collection and availability on UI : few seconds
• Massively horizontally Scalable (built over STORM)
– From millions of events to billions of events in a day.
• Dynamic Schema Updates
– System automatically adapts to schema changes with 0 downtime.
• Open architecture
– Ability to export data into many output formats – MySQL, Cassandra, Elasticsearch,
Message Queues etc.
• Fully customizable dashboards
– Build a custom UI using configurable widgets – in minutes!
• Support for Adhoc Queries using REST interface
• No coding required after the data is sent to Hello Streams
• Cloud ready
– Can run in your private cloud and/or AWS
- 4. Copyright © 2014, Hello Streams
All rights reserved. http://www.HelloStreams.com. Private & Confidential.
Hello Streams Solution Stack
- 5. Copyright © 2014, Hello Streams
All rights reserved. http://www.HelloStreams.com. Private & Confidential.
Why not build it all yourself?
Short Answer : Its cumbersome!
You would rather spend your time and energy on analyzing the data, while the experts
do the heavy lifting for you.
But if you insist on doing it all yourself, here is the long answer. Building such a system
would require:
– A system to collect logs from disparate sources
– A system to process the data in a distributed manner
– A scalable datastore
– A distributed data indexing and caching system
– A data visualization toolkit
Additionally, you would need to take care of following aspects:
– High Availability
– Scalability
– Sizing
– Performance Tuning
- 6. Copyright © 2014, Hello Streams
All rights reserved. http://www.HelloStreams.com. Private & Confidential.
What Can You Send ?
Anything that you consider is a meaningful transaction
Sensor
Data
Impressions
Page Views
Signups
RTB Bid Stats
Orders
Ad Requests
Medical
Records
Server Errors
Clicks
Ecommerce
Transactions
- 7. Copyright © 2014, Hello Streams
All rights reserved. http://www.HelloStreams.com. Private & Confidential.
Distributed Stream Processing
(Over STORM)
• Filtering
– Supported filters: =, !=, >, <, >=, <=, IN, NOT IN, REGEX
• Aggregations
– Temporal: Time based Aggregations
– Spatial: Dimension based aggregations
– Aggregation Functions: SUM, MIN, MAX, AVERAGE, COUNT, DISTINCT
COUNT, SKETCHES
• Top N
• Sampling
• Long Tail Reduction
All operations happen in a distributed manner.
You can configure the parallelism of each operation.
- 8. Copyright © 2014, Hello Streams
All rights reserved. http://www.HelloStreams.com. Private & Confidential.
Fully Customizable Dashboards
• No code required.
• Business teams can customize the dashboards the way
they want.
• Many chart options: Histograms, Pie Charts, Bar
Charts, Time Series, Tables, Geo Charts and much more
• Powerful query syntax
– (US OR UK) AND age:[20 TO 30]
• Responsive UI
– Automatically adjusts as per screen size.
– Looks good on mobile, tablet and PC
- 9. Copyright © 2014, Hello Streams
All rights reserved. http://www.HelloStreams.com. Private & Confidential.
Pricing
• Usage based pricing providing you flexibility of starting with a small setup.
• Actual usage depends primarily on following factors:
– Events per day
– Memory requirements
– Storage requirements
• Here is the approximate cost normalized to the number of events processed in a
month:
Events / Month Cost / Month
10 million $500
30 million $1,000
150 million $3,000
300 million $5,000
1 billion $10,000
> 1 billion Negotiable