The document provides details on data sizes for various projects worked on using Hadoop/Spark, including the Panera LLC Capacity Planning and Predictive Analytics projects, AT&T Insights production and non-production projects, a CTL data lake ingestion project, and an AT&T Telegence Mobility project. It notes that the total data size across all projects is approximately 52.5 TB, with unstructured data making up 36.2 TB (69%), structured data accounting for 9 TB (17%), and semi-structured data consisting of 7.3 TB (14%).

1. Data size analysis of dataset worked so far on Hadoop/Spark.
Kindly go through below dataset size details worked in different projects.
Sr. Projects Enviorment
Data
Size(approx)
Type
1 Panera, LLC-
Capacity Planning
Development 3.4TB(6month
data)
Unstructured Data
2 Panera, LLC -
Predictive Analytics
Production 6.8 TB( 1 year
data)
Unstructured Data
3 AT&T Insights production 22 TB Structured and
Unstructured
4 AT&T Insights Non-
production(stan
dby)
22 TB Complex
Structured and
Unstructured data(
29 markets)
5 CTL Project
Development :
REST API Ingestion
for Data Lake
Development 310 GB Semi-
Structured(JSON)
6 AT&T Telegence
Mobility
Production 7 TB Semi-
Structured(XML
Text)
36.2 TB ( 69%)
9 TB (17%)
7.3 TB (14%)
Data Size Statistics: Structure vs
Unstructured
UnStructured Structured Semi Structured