Real-Time Big Data Analytical Architecture for Remote Sensing
Application:
Point to remember:
1. What is remote sensing?
2. What is big data?
3. What is data analytical architecture?
4. What is data processing?
Problem statement:
1. Scalability issues, which refer to the application, are likely to be running on large scale.
2. Extraction transformation loading method from low, raw data to well thought-out data up to certain extent;
3. Scalabledata management has been a vision for more than three decades and much research has
focused on largescaledata management in traditional enterprisesetting.
4. The run-time system takes careof the details of partitioningthe input data,schedulingthe program’s
execution across a setof machines,handlingmachinefailures,and managingthe required inter-machine
communication.
5. Difficult to handle & maintain huge amount in remote sensing application.
Proposed architectures:
1. Remote sensing big data acquisition unit.(RSDU)
Description of RSDU:
It collects the raw data from the earth atmosphere and send it to the ground station via
downlink channel.
2. Data processing unit (DPU).
Description of RSDU:
The collected raw data information are separated with the help of filtration and load
balancing algorithm , useful data for analysis since it only allows useful information,
whereas the rest of the data are blocked and are discarded.
3. Data analytics decision unit (DADU).
Description of DADU:
DADU, which is responsible for compilation, storage of the results, and generation of
decision based on the results received from DPU.
Proposed algorithms:
1. Filtration and Load Balancing Algorithm.
Description:
This algorithm takes satellite data or product and then filters and divides them into segments and
performs load-balancing algorithm.
2. Processing and Calculation Algorithm.
Description:
The processing algorithm computes the results for dissimilar restrictions against each incoming block
and sends themto the next level.
3. Aggregation and Compilation Algorithm.
Description:
It collects the results from each processing servers against each and then combines, organizes, and
stores these results in RDBMS database.
4. Decision-making algorithm.
Description:
The algorithm varies from requirement to requirement and depends on the analysis needs.

real time big data

  • 1.
    Real-Time Big DataAnalytical Architecture for Remote Sensing Application: Point to remember: 1. What is remote sensing? 2. What is big data? 3. What is data analytical architecture? 4. What is data processing? Problem statement: 1. Scalability issues, which refer to the application, are likely to be running on large scale. 2. Extraction transformation loading method from low, raw data to well thought-out data up to certain extent; 3. Scalabledata management has been a vision for more than three decades and much research has focused on largescaledata management in traditional enterprisesetting. 4. The run-time system takes careof the details of partitioningthe input data,schedulingthe program’s execution across a setof machines,handlingmachinefailures,and managingthe required inter-machine communication. 5. Difficult to handle & maintain huge amount in remote sensing application. Proposed architectures: 1. Remote sensing big data acquisition unit.(RSDU) Description of RSDU: It collects the raw data from the earth atmosphere and send it to the ground station via downlink channel. 2. Data processing unit (DPU). Description of RSDU: The collected raw data information are separated with the help of filtration and load balancing algorithm , useful data for analysis since it only allows useful information, whereas the rest of the data are blocked and are discarded.
  • 2.
    3. Data analyticsdecision unit (DADU). Description of DADU: DADU, which is responsible for compilation, storage of the results, and generation of decision based on the results received from DPU. Proposed algorithms: 1. Filtration and Load Balancing Algorithm. Description: This algorithm takes satellite data or product and then filters and divides them into segments and performs load-balancing algorithm. 2. Processing and Calculation Algorithm. Description: The processing algorithm computes the results for dissimilar restrictions against each incoming block and sends themto the next level. 3. Aggregation and Compilation Algorithm. Description: It collects the results from each processing servers against each and then combines, organizes, and stores these results in RDBMS database. 4. Decision-making algorithm. Description: The algorithm varies from requirement to requirement and depends on the analysis needs.