Big Content is a scalable big data platform that uses Hadoop, Spark, and other open source tools to process streaming and stored data from various public sources. It addresses common big data challenges like processing large datasets, real-time analytics, and integrating diverse data types through modular components like its content indexer, analysis chain, and interfaces for management and search. The platform helps customers gain insights from massive and growing amounts of information.

1. Big Data Consulting
Belga Big Content platform
The promise of Big Data...delivered

2. big industries’ dream team

3. the information tsunami

4. data relationships

5. the same story...again

6. new sources of information added all the time

7. multi-tenant isolation

8. scalable solution

9. realtime processing

10. we pitched hadoop

11. and spark

12. some other stuff

13. public datasets

14. modular processing chain

15. logical view
Stored Data
Source
Streamed Data
Source
Data Collection
Modules
Gateway
Content Indexer
Online Record
Storage
Content Search
Engine
Integration
Facade
Management
Interface
Analysis Chain

16. component view
ETL toolchain
HDFS
Spark-Streaming
Dbpedia Freebase
SolrCloud
HBase
Cloudera Hadoop
User Application
Node.JS
Titan
Wiktionary

17. roadblocks
■ processing freebase data
■ spark-streaming recovery
■ spark and java

18. current status

19. the front end

20. future plans