SlideShare a Scribd company logo
1 of 40
Prepared By:
Famela Memarzanjani
Fault tolerance in
Big Data
Fault tolerance
IRAN,Tehran, Islamic Azad University, Science and Research Branch, School of
Electrical and Computer Engineering
12 Dec. 2016
1

 Mobile Big Data Fault-Tolerant Processing for eHealth Networks

 Kun Wang, Yun Shao, Lei Shu, Chunsheng Zhu, and Yan Zhang
 Ken Wang is with Nanjing University of Posts and Telecommunications.
 Yun Shao is with the University of Southern California.
 Lei Shu is the corresponding author for this article, and is with Guangdong
 University of Petrochemical Technology, Dalian University of Technology,
 and Guangdong Provincial Key Laboratory of Petrochemical Equipment
 Fault Analysis.
 Chunsheng Zhu is with the University of British Columbia.
 Yan Zhang is with Simula Research Laboratory and the University of Oslo.

 DOI: 10.1109/MNET.2016.7389829
 Publisher: IEEE
 Page(s): 36 - 42
 Date of Publication: 25 January 2016   Volume: 30 Issue: 1
 Print ISSN: 0890-8044
2
E-Health (Electronic-Health



3

 Health Information Technology

4
5

 reduced variable neighborhood search
 (RVNS) queue architecture (IRQA)

6
7
DGL


8
DGL
IRQA



DIL
9
DIL

learning machin

10
11

RVNS
XF(X(
12
13http://ce.aut.ac.ir/islab
14http://ce.aut.ac.ir/islab
‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬
‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬ ‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬
‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬
‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬
‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬
‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬
‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬
(‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬‫ت‬)
‫تتتت‬ ‫تتت‬
‫تتتتتت‬ ‫تتتتتت‬
)GRASP(
)VNS(
)GLS(
)ILS(
)ACO(
)PSO(
15
NEIGHBOURHOOD SEARCH NS
VARIABLE NEIGHBOURHOOD SEARCH VNS
REDUCED NEIGHBOURHOOD SEARCH RVNS
16

FIFO

IRQARVNS
17
18
RVNS
19
20

 Harmony Search to Self-Configuration of Fault-Tolerant Grids for Big Data

 J. Balicki ( ) W. Korłub M. Tyszka✉ ⋅ ⋅
 Faculty of Telecommunications, Electronics and Informatics, Gdańsk University
 of Technology, Narutowicza 11/12, 80-233 Gdańsk, Poland
 e-mail: balicki@eti.pg.gda.pl
 W. Korłub
 e-mail: waldemar.korlub@pg.gda.pl
 M. Tyszka
 e-mail: tyszka.maciej@gmail.com
 © Springer International Publishing Switzerland 2016
 Z. Kowalczuk (ed.), Advanced and Intelligent Computations in Diagnosis
 and Control, Advances in Intelligent Systems and Computing 386,

 DOI: DOI 10.1007/978-3-319-23180-8_30
 Publisher: Springer International Publishing
 Page(s): 566-576
 Date of Publication: 25 January 2016   Volume: 30 Issue: 1
 Print ISSN: 978-3-319-45377-4
21




22
23
Big Data


MangoDB,Hadoop,Splunk
NS,VNS,RVNS,MAP-REDUCE
24
MONGO
c++

MASTER-SLAVE

25



10

 InfoSphere Guardium data security and protection for MongoDB, Part 1: Overview of the solution and data security
recommendations
 www.ibm.com/developerworks
26
HADOOP







 Hadoop Demystified
 IEEE JUNE 2012
27
28
29
SPARK


30
31
Apache Spark: core concepts, architecture and internals
03 MARCH 2016 on Spark, scheduling, RDD, DAG, shuffle
32
33
MAP-REDUCE
MAP-REDUCE
34
35
36
37
38
.
39
.
Telegram.me/FTinDB
EMAIL: MEMAR@IUST.AC.IR
40

More Related Content

Viewers also liked

Presentasi Balinese Culture Based - Tri Hita Karana
Presentasi Balinese Culture Based - Tri Hita KaranaPresentasi Balinese Culture Based - Tri Hita Karana
Presentasi Balinese Culture Based - Tri Hita KaranaGunawan Wicaksono
 
Dike Uzoamaka 0007981465
Dike Uzoamaka 0007981465Dike Uzoamaka 0007981465
Dike Uzoamaka 0007981465Uzoamaka Dike
 
Manifesto Transformação Digital Lei de Informática
Manifesto Transformação Digital Lei de InformáticaManifesto Transformação Digital Lei de Informática
Manifesto Transformação Digital Lei de InformáticaBrasscom
 
Generic Resume-Munira 1.2 16122013
Generic Resume-Munira 1.2 16122013Generic Resume-Munira 1.2 16122013
Generic Resume-Munira 1.2 16122013Munira Gheewala
 
RAKESH_KUMAR_SRIVASTAVA C.V (1)
RAKESH_KUMAR_SRIVASTAVA C.V (1)RAKESH_KUMAR_SRIVASTAVA C.V (1)
RAKESH_KUMAR_SRIVASTAVA C.V (1)RAKESH SRIVASTAVA
 
5 Things Everyone has thought when being contacted by a Recruiter
5 Things Everyone has thought when being contacted by a Recruiter5 Things Everyone has thought when being contacted by a Recruiter
5 Things Everyone has thought when being contacted by a RecruiterChristopher Anderson
 

Viewers also liked (11)

Presentasi Balinese Culture Based - Tri Hita Karana
Presentasi Balinese Culture Based - Tri Hita KaranaPresentasi Balinese Culture Based - Tri Hita Karana
Presentasi Balinese Culture Based - Tri Hita Karana
 
Evaluation question 1
Evaluation question 1Evaluation question 1
Evaluation question 1
 
Dike Uzoamaka 0007981465
Dike Uzoamaka 0007981465Dike Uzoamaka 0007981465
Dike Uzoamaka 0007981465
 
Manifesto Transformação Digital Lei de Informática
Manifesto Transformação Digital Lei de InformáticaManifesto Transformação Digital Lei de Informática
Manifesto Transformação Digital Lei de Informática
 
Generic Resume-Munira 1.2 16122013
Generic Resume-Munira 1.2 16122013Generic Resume-Munira 1.2 16122013
Generic Resume-Munira 1.2 16122013
 
kaustubh resume- Updated
kaustubh resume- Updatedkaustubh resume- Updated
kaustubh resume- Updated
 
2ª npc
2ª npc2ª npc
2ª npc
 
RAKESH_KUMAR_SRIVASTAVA C.V (1)
RAKESH_KUMAR_SRIVASTAVA C.V (1)RAKESH_KUMAR_SRIVASTAVA C.V (1)
RAKESH_KUMAR_SRIVASTAVA C.V (1)
 
Storyboard
Storyboard Storyboard
Storyboard
 
Factorsofproduction
FactorsofproductionFactorsofproduction
Factorsofproduction
 
5 Things Everyone has thought when being contacted by a Recruiter
5 Things Everyone has thought when being contacted by a Recruiter5 Things Everyone has thought when being contacted by a Recruiter
5 Things Everyone has thought when being contacted by a Recruiter
 

Similar to Fault tolerance in big data

The Transformation of Systems Biology Into A Large Data Science
The Transformation of Systems Biology Into A Large Data ScienceThe Transformation of Systems Biology Into A Large Data Science
The Transformation of Systems Biology Into A Large Data ScienceRobert Grossman
 
WATERSHED MODELING USING ARTIFICIAL NEURAL NETWORKS
WATERSHED MODELING USING ARTIFICIAL NEURAL NETWORKS WATERSHED MODELING USING ARTIFICIAL NEURAL NETWORKS
WATERSHED MODELING USING ARTIFICIAL NEURAL NETWORKS IAEME Publication
 
Opportunities for X-Ray science in future computing architectures
Opportunities for X-Ray science in future computing architecturesOpportunities for X-Ray science in future computing architectures
Opportunities for X-Ray science in future computing architecturesIan Foster
 
Error of Multileaf collimator prediction using recurrent neural network (LSTM)
Error of Multileaf collimator prediction using recurrent neural network (LSTM)Error of Multileaf collimator prediction using recurrent neural network (LSTM)
Error of Multileaf collimator prediction using recurrent neural network (LSTM)WonjoongCheon
 
Loss Prevention 2013 - atmospheric dispersion modelling by cellular automata ...
Loss Prevention 2013 - atmospheric dispersion modelling by cellular automata ...Loss Prevention 2013 - atmospheric dispersion modelling by cellular automata ...
Loss Prevention 2013 - atmospheric dispersion modelling by cellular automata ...Pierre Lauret
 
Open Analytics Environment
Open Analytics EnvironmentOpen Analytics Environment
Open Analytics EnvironmentIan Foster
 
A swarm intelligence-based unicast routing protocol for hybrid ad hoc networks
A swarm intelligence-based unicast routing protocol for hybrid ad hoc networksA swarm intelligence-based unicast routing protocol for hybrid ad hoc networks
A swarm intelligence-based unicast routing protocol for hybrid ad hoc networksMarc Manthey
 
Self-Similarity in Complex Networks
Self-Similarity in Complex NetworksSelf-Similarity in Complex Networks
Self-Similarity in Complex Networksnorman_fahrer
 
ZCT Precoding Based SLM Technique for PAPR Reduction
ZCT Precoding Based SLM Technique for PAPR ReductionZCT Precoding Based SLM Technique for PAPR Reduction
ZCT Precoding Based SLM Technique for PAPR Reductionijtsrd
 
A new multiple classifiers soft decisions fusion approach for exons predictio...
A new multiple classifiers soft decisions fusion approach for exons predictio...A new multiple classifiers soft decisions fusion approach for exons predictio...
A new multiple classifiers soft decisions fusion approach for exons predictio...Ismail M. El-Badawy
 
Darwin’s Magic: Evolutionary Computation in Nanoscience, Bioinformatics and S...
Darwin’s Magic: Evolutionary Computation in Nanoscience, Bioinformatics and S...Darwin’s Magic: Evolutionary Computation in Nanoscience, Bioinformatics and S...
Darwin’s Magic: Evolutionary Computation in Nanoscience, Bioinformatics and S...Natalio Krasnogor
 
Reliable and Efficient Data Acquisition in Wireless Sensor Network
Reliable and Efficient Data Acquisition in Wireless Sensor NetworkReliable and Efficient Data Acquisition in Wireless Sensor Network
Reliable and Efficient Data Acquisition in Wireless Sensor NetworkIJMTST Journal
 
Dynamics Behaviour of Multi Storeys Framed Structures by of Iterative Method
Dynamics Behaviour of Multi Storeys Framed  Structures by of Iterative Method Dynamics Behaviour of Multi Storeys Framed  Structures by of Iterative Method
Dynamics Behaviour of Multi Storeys Framed Structures by of Iterative Method AM Publications
 
A modified narmax model based self-tuner with fault tolerance for unknown non...
A modified narmax model based self-tuner with fault tolerance for unknown non...A modified narmax model based self-tuner with fault tolerance for unknown non...
A modified narmax model based self-tuner with fault tolerance for unknown non...ISA Interchange
 
The TIR revolution in plant stress biology
The TIR revolution in plant stress biologyThe TIR revolution in plant stress biology
The TIR revolution in plant stress biologyDmitryLapin2
 
Convergence Problems Of Contingency Analysis In Electrical Power Transmission...
Convergence Problems Of Contingency Analysis In Electrical Power Transmission...Convergence Problems Of Contingency Analysis In Electrical Power Transmission...
Convergence Problems Of Contingency Analysis In Electrical Power Transmission...CSCJournals
 
IRJET- Univariate Time Series Prediction of Reservoir Inflow using Artifi...
IRJET-  	  Univariate Time Series Prediction of Reservoir Inflow using Artifi...IRJET-  	  Univariate Time Series Prediction of Reservoir Inflow using Artifi...
IRJET- Univariate Time Series Prediction of Reservoir Inflow using Artifi...IRJET Journal
 

Similar to Fault tolerance in big data (20)

The Transformation of Systems Biology Into A Large Data Science
The Transformation of Systems Biology Into A Large Data ScienceThe Transformation of Systems Biology Into A Large Data Science
The Transformation of Systems Biology Into A Large Data Science
 
WATERSHED MODELING USING ARTIFICIAL NEURAL NETWORKS
WATERSHED MODELING USING ARTIFICIAL NEURAL NETWORKS WATERSHED MODELING USING ARTIFICIAL NEURAL NETWORKS
WATERSHED MODELING USING ARTIFICIAL NEURAL NETWORKS
 
Opportunities for X-Ray science in future computing architectures
Opportunities for X-Ray science in future computing architecturesOpportunities for X-Ray science in future computing architectures
Opportunities for X-Ray science in future computing architectures
 
Error of Multileaf collimator prediction using recurrent neural network (LSTM)
Error of Multileaf collimator prediction using recurrent neural network (LSTM)Error of Multileaf collimator prediction using recurrent neural network (LSTM)
Error of Multileaf collimator prediction using recurrent neural network (LSTM)
 
Loss Prevention 2013 - atmospheric dispersion modelling by cellular automata ...
Loss Prevention 2013 - atmospheric dispersion modelling by cellular automata ...Loss Prevention 2013 - atmospheric dispersion modelling by cellular automata ...
Loss Prevention 2013 - atmospheric dispersion modelling by cellular automata ...
 
Open Analytics Environment
Open Analytics EnvironmentOpen Analytics Environment
Open Analytics Environment
 
G013124354
G013124354G013124354
G013124354
 
A swarm intelligence-based unicast routing protocol for hybrid ad hoc networks
A swarm intelligence-based unicast routing protocol for hybrid ad hoc networksA swarm intelligence-based unicast routing protocol for hybrid ad hoc networks
A swarm intelligence-based unicast routing protocol for hybrid ad hoc networks
 
Self-Similarity in Complex Networks
Self-Similarity in Complex NetworksSelf-Similarity in Complex Networks
Self-Similarity in Complex Networks
 
ZCT Precoding Based SLM Technique for PAPR Reduction
ZCT Precoding Based SLM Technique for PAPR ReductionZCT Precoding Based SLM Technique for PAPR Reduction
ZCT Precoding Based SLM Technique for PAPR Reduction
 
A new multiple classifiers soft decisions fusion approach for exons predictio...
A new multiple classifiers soft decisions fusion approach for exons predictio...A new multiple classifiers soft decisions fusion approach for exons predictio...
A new multiple classifiers soft decisions fusion approach for exons predictio...
 
20320140501002
2032014050100220320140501002
20320140501002
 
Darwin’s Magic: Evolutionary Computation in Nanoscience, Bioinformatics and S...
Darwin’s Magic: Evolutionary Computation in Nanoscience, Bioinformatics and S...Darwin’s Magic: Evolutionary Computation in Nanoscience, Bioinformatics and S...
Darwin’s Magic: Evolutionary Computation in Nanoscience, Bioinformatics and S...
 
Reliable and Efficient Data Acquisition in Wireless Sensor Network
Reliable and Efficient Data Acquisition in Wireless Sensor NetworkReliable and Efficient Data Acquisition in Wireless Sensor Network
Reliable and Efficient Data Acquisition in Wireless Sensor Network
 
Dynamics Behaviour of Multi Storeys Framed Structures by of Iterative Method
Dynamics Behaviour of Multi Storeys Framed  Structures by of Iterative Method Dynamics Behaviour of Multi Storeys Framed  Structures by of Iterative Method
Dynamics Behaviour of Multi Storeys Framed Structures by of Iterative Method
 
A modified narmax model based self-tuner with fault tolerance for unknown non...
A modified narmax model based self-tuner with fault tolerance for unknown non...A modified narmax model based self-tuner with fault tolerance for unknown non...
A modified narmax model based self-tuner with fault tolerance for unknown non...
 
The TIR revolution in plant stress biology
The TIR revolution in plant stress biologyThe TIR revolution in plant stress biology
The TIR revolution in plant stress biology
 
Convergence Problems Of Contingency Analysis In Electrical Power Transmission...
Convergence Problems Of Contingency Analysis In Electrical Power Transmission...Convergence Problems Of Contingency Analysis In Electrical Power Transmission...
Convergence Problems Of Contingency Analysis In Electrical Power Transmission...
 
IRJET- Univariate Time Series Prediction of Reservoir Inflow using Artifi...
IRJET-  	  Univariate Time Series Prediction of Reservoir Inflow using Artifi...IRJET-  	  Univariate Time Series Prediction of Reservoir Inflow using Artifi...
IRJET- Univariate Time Series Prediction of Reservoir Inflow using Artifi...
 
TransPAC3/ACE Measurement & PerfSONAR Update
TransPAC3/ACE Measurement & PerfSONAR UpdateTransPAC3/ACE Measurement & PerfSONAR Update
TransPAC3/ACE Measurement & PerfSONAR Update
 

Fault tolerance in big data