SlideShare a Scribd company logo
1 of 106
DDAATTAA SSCCIIEENNCCEE 
Conference - Study : Jean-Antoine Moreau (Engineer - Lecturer) 
© Jean-Antoine Moreau 
copying and reproduction prohibited 
Managing my copyright ADAGP.
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
« The science of today is the technology of 
tomorrow. » 
Edward Teller 
JAM 2 / 108 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
« There does not exist a category of science to 
which one can give the name applied science. 
There are science and the applications of 
science, bound together as the fruit of the 
tree which bears it. » 
Louis Pasteur 
JAM 3 / 108 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 4 / 108 
Commerce and Research 
are being transformed by 
data-driven discovery and prediction. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
Skills required for data analytics at massive 
levels : 
– Scalable data management and off the cloud; 
– Parallel algorithm; 
– Statistical modeling. 
JAM 5 / 108 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
• The basic techniques of Data Science 
including both SQL and NoSql solutions for 
massive data management. 
JAM 6 / 108 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 7 / 108 
• Examples : 
– MapReduce; 
– Algorithme for Data mining; 
– Clustering; 
– Association of rules. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 8 / 108 
• Data Science Manipulation of the Scale : 
– Database; 
– Relational algebra; 
– Parallel database; 
– Parallel query progressing. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 9 / 108 
Contact http://www.jean-antoine-moreau.fr.nf 
• MapReduce; 
• Hadoop; 
• Relationship to database; 
• Algorithms; 
• Extensions languages; 
• Key value stores and NoSQL 
Tradeoffs of SQL and 
NoSQL. 
TToooollss
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 10 / 
• Supervised : 
– Rules; 
– Trees; 
– Forests; 
– Nearest; 
– Neighbor; 
– Regression; 
– Optimization. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 11 / 
• Communication results : 
– Visualization data products; 
– Visual data analytic; 
– Provenance (origin); 
– Belonging; 
– Ethics; 
– Governance. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 12 / 
TTooppiiccss 
Contact http://www.jean-antoine-moreau.fr.nf 
Graph Analytic : 
– Structure; 
– Transversals; 
– Analytics; 
– Page-Rank; 
– Community detection; 
– Recursive queries; 
– Semantic Web; 
– Quest.
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
« Most of the fundamental ideas of 
science are essentially simple, and may, 
as a rule, be expressed in a language 
comprehensible to everyone. » 
JAM 13 / 
Contact http://www.jean-antoine-moreau.fr.nf 
Albert Einstein 
A little break, to ask questions.
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 14 / 
Any e-commerce application is 
a data-driven application. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
• Learning systems; 
• High-frequency / low frequency data processing 
systems; 
• Distributed systems. 
JAM 15 / 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 16 / 
• Aggregation theory; 
• Data analysis; 
• Data mining; 
• Computational statistics; 
• Statistical signal processing. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 17 / 
• Kernel method; 
• Probabilistic method. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 18 / 
• Probabilistic Models 
• Probability Theory 
• Linear algebra 
Contact http://www.jean-antoine-moreau.fr.nf 
• New algorithm
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
The parallel processing of data 
JAM 19 / 
involves the use of 
parallel processing platform. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 20 / 
Service platform 
for 
parallel processing 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 21 / 
A service platform will pool: 
– Resources; 
– Costs. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 22 / 
Contact http://www.jean-antoine-moreau.fr.nf 
• Using : 
– Design NFA 
• nondeterministic finite automata ; 
– Design DFA 
• deterministic finite automaton .
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
parallelism and processing performance 
JAM 23 / 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
parallelism and processing performance 
JAM 24 / 
PParallel LLangage IIntegrated QQuery 
(PPLLIINNQQ) 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 25 / 
• Performance elapsed time; 
• Scalability degree of parallelism : 
– (number of tasks); 
– (number of cores); 
• Simplicity of the code (programming) 
• Facility to maintain in operational condition; 
• A method of using the memory; 
• Memory Mapping. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 26 / 
• Implementation method: 
– class; 
– objects. 
• Method of using the processors: 
– Physical; 
– Logical; 
– Virtual. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
Use the parallel processing to the databases 
JAM 27 / 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 28 / 
ppaarraalllleell aarrcchhiitteeccttuurree 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 29 / 
• Parallel architecture; 
• Specialized parallel machines. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 30 / 
SShhaarreedd--mmeemmoorryy aarrcchhiitteeccttuurree 
Process (1) Process (n) 
interconnection 
Contact http://www.jean-antoine-moreau.fr.nf 
Memory (1) 
Memory (n) 
Disk (1) Disk (n)
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
Processor (1) Processor (n) 
Memory (1) Memory (n) 
JAM 31 / 
Network 
Disk 1 Disk (n) 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
Transfer large volumes of data in main memory. 
JAM 32 / 
Calculator (processor) saturation risk 
Decentralized processing 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 33 / 
Central computer 
Backbone 
Dorsal Computer 
Machine Database 
Data Base 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 34 / 
• Only data used are transferred; 
• The central processor: 
– updates; 
– research; 
• Specialization of the computer; 
• Use parallel machines; 
– for data processing; 
– for treatment of discs; 
• Fault tolerance. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 35 / 
Database Machine 
• Control access and permissions; 
• Semantic integrity control; 
• Recovery Data Base; 
• Atomicity Control of transactions; 
• Restore of the database; 
• Simultaneous access; 
• Concurrent access; 
• Recovery data base. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
manager Data 
JAM 36 / 
host system communication 
Contact http://www.jean-antoine-moreau.fr.nf 
interface 
manager 
Manager 
associative 
memory 
query 
optimizer 
manager
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 37 / 
Database Machine 
• Interface database manager; 
• Communication manager; 
• Query optimizer manager; 
• Memory manager association. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
Central IT Local network 
JAM 38 / 
Contact http://www.jean-antoine-moreau.fr.nf 
Interconnexion 
Interlink 
System (1) 
Interconnexion 
Interlink 
System (2) 
Communication 
Processor (1) 
CP (2) CP (n) 
Bus (1) – Network YNET 
Bus (2) – Network YNET 
Bus (n) – Network YNET 
Processor Acces (1) PA (2) PA (n) 
DDisk SStorage UUnit (1) DDisk SStorage UUnit (2) DSU (n)
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
 Ynet, an interconnect structure for a highly concurrent database 
system which also requires high availability and real-time operation. 
 The Ynet is the basis of a multiple-instruction, multiple-data (MIMD) 
concurrent processing architecture which can connect up to 1024 high-performance 
microprocessors to form a very-high performance 
JAM 39 / 
Contact http://www.jean-antoine-moreau.fr.nf 
system. 
 the Ynet results from the logic implemented in the processor interface. 
 The processor interface is divided into three sections, each of which is 
implemented by a finite-state machine.
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
« In questions of science, the authority of a 
thousand is not worth the humble reasoning 
of a single individual. » 
JAM 40 / 
Contact http://www.jean-antoine-moreau.fr.nf 
Galileo Galilei 
A short break for you, to ask your questions.
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 41 / 
Database Machine 
Processor 
Processor Interface 
Central Interface 
Session control 
Data conversion 
SQL Parser (analyze – optimize) 
Compiler 
Dispatcher 
YNET interface 
PA YNET PA 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
• Processes and access processors can execute 
simultaneously on a single query; 
• The uniform distribution of data on Disk Storage 
Unit; 
• Using a hash algorithm. 
JAM 42 / 
Specifics 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 43 / 
Processing queries 
Processing steps of a query 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
• The programmer examines (study) the query 
rigorously and methodically; 
• The programmer writes the query; 
• The programmer tests its query; 
• The programmer sends the query from the host 
computer; 
JAM 44 / 
then ... more ... 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
• The Analyzer PProcessor IInterface (PI) 
verifies that the query is semantically 
correct and develop a plan for execution. 
JAM 45 / 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
• The value of the primary index is transformed 
into hashcode and is transmitted by the YNET 
PI interface. 
JAM 46 / 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
• A message is sent by YNET, to all processors. 
JAM 47 / 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
• The YNET interface of each processor can 
accept or reject the message. 
JAM 48 / 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
• One processor acces * (PA) will access its disk 
storage unit; 
JAM 49 / 
* Access Module Processor. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
• The processor access (PA) will build a 
YNET message containing the tuple. 
 A tuple is an ordered list of elements. In set theory, an n-tuple is a 
sequence (or ordered list) of n elements, where n is a non-negative 
integer. 
JAM 50 / 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
• The interface processor that sent the request 
receives the return message. 
JAM 51 / 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
• The message is sent via the YNET / IP; 
JAM 52 / 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
• YNET sends the message to all processes; 
JAM 53 / 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
• The YNET interface of each PA accepts the 
message. 
JAM 54 / 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
• The interface processor returns the message 
to the computer according to the protocol 
(TDP). 
JAM 55 / 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
• The host computer is completely discharged 
of the treatment response; 
JAM 56 / 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
Host PI / CP 
PA(1) PA(2) PA(n) 
DSU (1) DSU (2) DSU (n) 
JAM 57 / 
YNET 
Contact http://www.jean-antoine-moreau.fr.nf 
PI processor Interface
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
• The compiler of the Processor Interface 
generates the processing on multiple (PA); 
JAM 58 / 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
• Each PA will access the table on its DSU, 
and copy the tuples that match the answer in 
his workspace; 
• A message is then transmitted over the 
network YNET; 
JAM 59 / 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
– of the PI origin collects the responses already merged 
and sorted; 
JAM 60 / 
• The YNET interface 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
• The interface processor sends the contents 
of the buffer to the computer TDP; 
JAM 61 / 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
Processor Acces (1) Processor Acces (2) Processor Acces (n) 
T(4) T(3) T(2) 
DSU(1) DSU(2) DSU(n) 
JAM 62 / 
TThhee wwoorrkk ooff tthhee pprroocceessssoorr iinn ppaarraalllleell 
T(9) 
T(5) 
Transaction 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 63 / 
• Data protection : 
– Fallback; 
– Fallback clustering. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
« Science cannot solve the ultimate 
mystery of nature. And that is 
because, in the last analysis, we 
ourselves are a part of the mystery that 
we are trying to solve. » 
JAM 64 / 
Contact http://www.jean-antoine-moreau.fr.nf 
Max Planck 
A short break, to ask your questions.
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 65 / 
Primary Index 
It is essential 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
• The primary index is chosen according to 
the mode of use: 
JAM 66 / 
how decisions; 
transactional mode; 
frequency of updating; 
frequency of application. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 67 / 
PPrimary IIndex 
• Sigle / UUnique (UPI); 
• NNo UUnique (NUPI); 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 68 / 
• The query on UPI uses a single AMP; 
• The result returns a single tuple; 
(Access Module Processor) 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 69 / 
• Two kinds of access : 
– Direct access to the primary key; 
– Indirect access to the primary key, via an 
intermediate file. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
1 n 
JAM 70 / 
Primary Index Value 
Hash - Coding 
Contact http://www.jean-antoine-moreau.fr.nf 
AMP
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 71 / 
Secondary Index 
• The RDBC build for each : 
(Recursive Density Based Clustering - datamining algorithm) 
(Root Data Base Connectivity). 
– Unique (single) Secondary Index; 
– Non – Unique Secondary Index; 
a sub-table. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 72 / 
Sub – Table 
Sub-table contains all secondary indexes 
encoded in a hash algorithme; 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 73 / 
Sub – Table 
Each sub-index of this table is an identifier; 
the hash code value of the primary index, 
retrieves the tuple to select the DSU. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 74 / 
Contact http://www.jean-antoine-moreau.fr.nf 
Tuple 
Size 
Secondary index 
identifier 
Secondary Index 
Value 
Primary Index 
Identifier 
Tuple 
Size
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 75 / 
• The value of the secondary index is 
transformed by hashing into the AMP. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 76 / 
Secondary Index Value 
Contact http://www.jean-antoine-moreau.fr.nf 
USI 
Hash-coding 
AMP
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 77 / 
• Each sub-table has a column identifier; 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
• each value of this sub-table is one and only one tuple. 
JAM 78 / 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 79 / 
Secondary index 
not unique - single 
structure of storage 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
Secondary Index 
No unique (NUSI) Hash - Coding 
AMP (1) AMP (2) AMP (n) 
JAM 80 / 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 81 / 
Query Optimization 
SQL Query 
parser 
resolve 
optimizer 
Structured data 
Explain / Text generator 
Contact http://www.jean-antoine-moreau.fr.nf 
dispacher 
statistics
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 82 / 
• example commands: 
– collect statistic; 
– explain. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
The COLLECT STATISTICS command 
JAM 83 / 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
• The optimizer uses the statistics collected 
on the tables in search of better access to 
the data. 
JAM 84 / 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 85 / 
• Number tuple for each table; 
• Unique and no-unique index: 
Contact http://www.jean-antoine-moreau.fr.nf 
– Primary; 
– Secondary; 
• The number of the attribute values; 
• The maximal attribute values for each the tables; 
• The number of occurrences not duplicated in each table; 
• The collection of statistics is made in order.
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 86 / 
The EXPLAIN command 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 87 / 
• This command provides information on: 
– The nature of the requested tables to process the request 
– The indexes used : 
Contact http://www.jean-antoine-moreau.fr.nf 
• Primary; 
• Secondary; 
– The various stages of the request processing ; 
– Treatments of joints; 
– The contents of files created to stock the intermediate results; 
– The number of returned tuples at each stage of processing; 
– The execution of the various stages of the application time; 
– The types of joints; 
– The total time taken by the RDBC (datamining process).
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 88 / 
• Syntax example : 
EXPLAIN COUNT ( ….) 
FROM .. , .. , ..., 
Where … 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
• The minutes (report) of EXPLAIN, 
– the time set by the system to scan the tables and 
JAM 89 / 
selected information. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
It is important to make an algebraic tree. 
JAM 90 / 
• For each query: 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 91 / 
Query processing on RDBC 
– Recursive Density Based Clustering 
Query Single table 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
• Query on UPI (unique primary index); 
• A single AMP is accessed, and will look in 
the DSU the tuple corresponding to the 
query. 
JAM 92 / 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
– One AMP is indexed and accessed the duplicate 
tuples are placed in the same GPA. 
– The GPA will look in its DSU tuple or tuples 
satisfy the query. 
– GPA: Grade Point Average. 
JAM 93 / 
• Query on NUPI: 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 94 / 
• Query on : 
– Unique Secondary Index; 
– Non Unique Secondary Index; 
– Request on non-indexed attributes. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
« Science is organized knowledge. 
Wisdom is organized life. » 
JAM 95 / 
Contact http://www.jean-antoine-moreau.fr.nf 
Immanuel Kant 
A little break, to ask your questions
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 96 / 
Processing requests 
Processing Query 
RRDDBBCC 
Recursive Density Based Clustering 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 97 / 
multi-task application Request 
multi-task Query 
• The RDBC uses five types of joins : 
– NESTED JOIN; 
– MERGE JOIN; 
– PRODUCT JOIN; 
– EXCLUSION JOIN; 
– ROWID JOIN. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
• The wwhheerree condition specifies a constant 
value for a single (Primary or Secondary) 
index. 
JAM 98 / 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
join two unique primary index (UPI) 
JAM 99 / 
Select … from … , … where … ; 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
Select … from table (i), table (i+1) where *; 
JAM 100 / 
MMEERRGGEE JJOOIINN 
object-oriented programming : 
Select … from object (i), object (i+1) where *; 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
Select … from object (a) (i), object (a:b) (i+1), object (a:x) (n+1); 
where * ; 
with *; 
JAM 101 / 
PPRROODDUUCCTT JJOOIINN 
Select … from table (i), table (i+1), table (n+1); 
where * ; 
with *; 
object-oriented programming : 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 102 / 
NNEESSTTEEDD JJOOIINN 
Select … , * from *, attribute 
where x=y and y= (variable integer); 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 103 / 
CCAARRTTEESSIIAANN PPRROODDUUCCTT 
Select … , …. from … , … 
a PRODUCT JOIN without restriction. 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 104 / 
EEXXCCLLUUSSIIOONN JJOOIINN 
Select …,… 
from …,… 
where x=y and (select … from …); 
Contact http://www.jean-antoine-moreau.fr.nf
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
DDAATTAA SSCCIIEENNCCEE 
JAM 105 / 
ROWID JOIN 
select … from X,Y 
where X.a = constant 
And X.b=Y.c 
Contact http://www.jean-antoine-moreau.fr.nf 
with 
a : primary index 
b 
c secondary index
© Jean-Antoine 
Moreau 
copying and 
reproduction 
prohibited 
Managing my 
copyright ADAGP. 
end of the internet diffusion of this lesson 
JAM 106 / 
Contact http://www.jean-antoine-moreau.fr.nf

More Related Content

Viewers also liked

De Gelderlander - artikel vervoersbezuiniging dagbesteding 2013
De Gelderlander - artikel vervoersbezuiniging dagbesteding 2013De Gelderlander - artikel vervoersbezuiniging dagbesteding 2013
De Gelderlander - artikel vervoersbezuiniging dagbesteding 2013henske42
 
ambience creacions new launch
ambience creacions new launchambience creacions new launch
ambience creacions new launchNisha Chhabra
 
Étude et intégration d’une plateforme IMS dans un environnement virtualisé
Étude et intégration d’une plateforme IMS dans un environnement virtualiséÉtude et intégration d’une plateforme IMS dans un environnement virtualisé
Étude et intégration d’une plateforme IMS dans un environnement virtualiséTahraoui Samir
 
Assurez la confidentialité et la sécurité de vos données stratégiques - Oodrive
Assurez la confidentialité et la sécurité de vos données stratégiques - OodriveAssurez la confidentialité et la sécurité de vos données stratégiques - Oodrive
Assurez la confidentialité et la sécurité de vos données stratégiques - OodriveHélène Toutchkov
 
東工大学の教授が語る「東京工業大学電気電子工学科での多人数教室でのアクティブラーニングの試み」
東工大学の教授が語る「東京工業大学電気電子工学科での多人数教室でのアクティブラーニングの試み」東工大学の教授が語る「東京工業大学電気電子工学科での多人数教室でのアクティブラーニングの試み」
東工大学の教授が語る「東京工業大学電気電子工学科での多人数教室でのアクティブラーニングの試み」handbook_mktg
 
インバウンド(訪日客)対応の多言語販促ツール活用のポイントとは
インバウンド(訪日客)対応の多言語販促ツール活用のポイントとはインバウンド(訪日客)対応の多言語販促ツール活用のポイントとは
インバウンド(訪日客)対応の多言語販促ツール活用のポイントとはhandbook_mktg
 
企業におけるタブレット導入のROIを高める活用法
企業におけるタブレット導入のROIを高める活用法企業におけるタブレット導入のROIを高める活用法
企業におけるタブレット導入のROIを高める活用法handbook_mktg
 
タブレット企業導入を成功させる5つのポイント
タブレット企業導入を成功させる5つのポイントタブレット企業導入を成功させる5つのポイント
タブレット企業導入を成功させる5つのポイントhandbook_mktg
 
Study on: Tobacco in Movies and Impact on Youth (Indian Study - 2006)
Study on: Tobacco in Movies and Impact on Youth (Indian Study - 2006)Study on: Tobacco in Movies and Impact on Youth (Indian Study - 2006)
Study on: Tobacco in Movies and Impact on Youth (Indian Study - 2006)Burning Brain Society
 

Viewers also liked (15)

De Gelderlander - artikel vervoersbezuiniging dagbesteding 2013
De Gelderlander - artikel vervoersbezuiniging dagbesteding 2013De Gelderlander - artikel vervoersbezuiniging dagbesteding 2013
De Gelderlander - artikel vervoersbezuiniging dagbesteding 2013
 
ambience creacions new launch
ambience creacions new launchambience creacions new launch
ambience creacions new launch
 
teste
testeteste
teste
 
USB Device Policy
USB Device PolicyUSB Device Policy
USB Device Policy
 
սպիտակուցներ
սպիտակուցներսպիտակուցներ
սպիտակուցներ
 
Étude et intégration d’une plateforme IMS dans un environnement virtualisé
Étude et intégration d’une plateforme IMS dans un environnement virtualiséÉtude et intégration d’une plateforme IMS dans un environnement virtualisé
Étude et intégration d’une plateforme IMS dans un environnement virtualisé
 
Assurez la confidentialité et la sécurité de vos données stratégiques - Oodrive
Assurez la confidentialité et la sécurité de vos données stratégiques - OodriveAssurez la confidentialité et la sécurité de vos données stratégiques - Oodrive
Assurez la confidentialité et la sécurité de vos données stratégiques - Oodrive
 
東工大学の教授が語る「東京工業大学電気電子工学科での多人数教室でのアクティブラーニングの試み」
東工大学の教授が語る「東京工業大学電気電子工学科での多人数教室でのアクティブラーニングの試み」東工大学の教授が語る「東京工業大学電気電子工学科での多人数教室でのアクティブラーニングの試み」
東工大学の教授が語る「東京工業大学電気電子工学科での多人数教室でのアクティブラーニングの試み」
 
インバウンド(訪日客)対応の多言語販促ツール活用のポイントとは
インバウンド(訪日客)対応の多言語販促ツール活用のポイントとはインバウンド(訪日客)対応の多言語販促ツール活用のポイントとは
インバウンド(訪日客)対応の多言語販促ツール活用のポイントとは
 
企業におけるタブレット導入のROIを高める活用法
企業におけるタブレット導入のROIを高める活用法企業におけるタブレット導入のROIを高める活用法
企業におけるタブレット導入のROIを高める活用法
 
タブレット企業導入を成功させる5つのポイント
タブレット企業導入を成功させる5つのポイントタブレット企業導入を成功させる5つのポイント
タブレット企業導入を成功させる5つのポイント
 
Study on: Tobacco in Movies and Impact on Youth (Indian Study - 2006)
Study on: Tobacco in Movies and Impact on Youth (Indian Study - 2006)Study on: Tobacco in Movies and Impact on Youth (Indian Study - 2006)
Study on: Tobacco in Movies and Impact on Youth (Indian Study - 2006)
 
Système d'Information (S.I.) dans l’entreprise
Système d'Information (S.I.) dans l’entrepriseSystème d'Information (S.I.) dans l’entreprise
Système d'Information (S.I.) dans l’entreprise
 
Comprendre la securite web
Comprendre la securite webComprendre la securite web
Comprendre la securite web
 
Les tests de securite devops
Les tests de securite devopsLes tests de securite devops
Les tests de securite devops
 

Similar to Data Science Lesson 1 Jean-Antoine Moreau

DATA SCIENCE Lesson 2 Parallelism Computing Data Processing Performance Measu...
DATA SCIENCE Lesson 2 Parallelism Computing Data Processing Performance Measu...DATA SCIENCE Lesson 2 Parallelism Computing Data Processing Performance Measu...
DATA SCIENCE Lesson 2 Parallelism Computing Data Processing Performance Measu...Jean-Antoine Moreau
 
Big Data Lesson 3 Jean-Antoine Moreau
Big Data Lesson 3 Jean-Antoine MoreauBig Data Lesson 3 Jean-Antoine Moreau
Big Data Lesson 3 Jean-Antoine MoreauJean-Antoine Moreau
 
DATA SCIENCE Lesson 3 Data Architectures Data Processing Modeling -Algorithm ...
DATA SCIENCE Lesson 3 Data Architectures Data Processing Modeling -Algorithm ...DATA SCIENCE Lesson 3 Data Architectures Data Processing Modeling -Algorithm ...
DATA SCIENCE Lesson 3 Data Architectures Data Processing Modeling -Algorithm ...Jean-Antoine Moreau
 
DATA SCIENCE Lesson 5 Data Science Predictive Modeling and Modelling Methodol...
DATA SCIENCE Lesson 5 Data Science Predictive Modeling and Modelling Methodol...DATA SCIENCE Lesson 5 Data Science Predictive Modeling and Modelling Methodol...
DATA SCIENCE Lesson 5 Data Science Predictive Modeling and Modelling Methodol...Jean-Antoine Moreau
 
Business intelligence Conference Jean-Antoine Moreau
Business intelligence Conference Jean-Antoine MoreauBusiness intelligence Conference Jean-Antoine Moreau
Business intelligence Conference Jean-Antoine MoreauJean-Antoine Moreau
 
Collaboro - EclipseCon France 2013 - Ignite Talks Session
Collaboro - EclipseCon France 2013 - Ignite Talks SessionCollaboro - EclipseCon France 2013 - Ignite Talks Session
Collaboro - EclipseCon France 2013 - Ignite Talks SessionHugo Bruneliere
 
S4x16 europe krotofil_granular_dataflowsics
S4x16 europe krotofil_granular_dataflowsicsS4x16 europe krotofil_granular_dataflowsics
S4x16 europe krotofil_granular_dataflowsicsMarina Krotofil
 
DEF CON 24 - Bertin Bervis and James Jara - exploiting and attacking seismolo...
DEF CON 24 - Bertin Bervis and James Jara - exploiting and attacking seismolo...DEF CON 24 - Bertin Bervis and James Jara - exploiting and attacking seismolo...
DEF CON 24 - Bertin Bervis and James Jara - exploiting and attacking seismolo...Felipe Prado
 
Linux rt in financial markets
Linux rt in financial marketsLinux rt in financial markets
Linux rt in financial marketsAdrien Mahieux
 
SolarWinds NPM at Cisco Live! 2013
SolarWinds NPM at Cisco Live! 2013SolarWinds NPM at Cisco Live! 2013
SolarWinds NPM at Cisco Live! 2013Michal Hrncirik
 
Lafarge Process Kit - Air flow rate - Pitot V2.pdf
Lafarge Process Kit - Air flow rate - Pitot V2.pdfLafarge Process Kit - Air flow rate - Pitot V2.pdf
Lafarge Process Kit - Air flow rate - Pitot V2.pdfMario Charlin
 
Ditching Fibre Channel & SCSI: Saying hast la vista to your vendors and "ooh ...
Ditching Fibre Channel & SCSI: Saying hast la vista to your vendors and "ooh ...Ditching Fibre Channel & SCSI: Saying hast la vista to your vendors and "ooh ...
Ditching Fibre Channel & SCSI: Saying hast la vista to your vendors and "ooh ...jasonjwwilliams
 
Hacker's and painters Hardware Hacking 101 - 10th Oct 2014
Hacker's and painters Hardware Hacking 101 - 10th Oct 2014Hacker's and painters Hardware Hacking 101 - 10th Oct 2014
Hacker's and painters Hardware Hacking 101 - 10th Oct 2014Takeda Pharmaceuticals
 
Tommaso Cucinotta - Low-latency and power-efficient audio applications on Linux
Tommaso Cucinotta - Low-latency and power-efficient audio applications on LinuxTommaso Cucinotta - Low-latency and power-efficient audio applications on Linux
Tommaso Cucinotta - Low-latency and power-efficient audio applications on Linuxlinuxlab_conf
 
Lafarge Process Kit - Dry weigt consistency TEST.pdf
Lafarge Process Kit - Dry weigt consistency TEST.pdfLafarge Process Kit - Dry weigt consistency TEST.pdf
Lafarge Process Kit - Dry weigt consistency TEST.pdfMario Charlin
 
Loss Prevention 2013 - atmospheric dispersion modelling by cellular automata ...
Loss Prevention 2013 - atmospheric dispersion modelling by cellular automata ...Loss Prevention 2013 - atmospheric dispersion modelling by cellular automata ...
Loss Prevention 2013 - atmospheric dispersion modelling by cellular automata ...Pierre Lauret
 
Smart+er Grids: Challenges, Arequipa 05 October 2015
Smart+er Grids: Challenges, Arequipa 05 October 2015Smart+er Grids: Challenges, Arequipa 05 October 2015
Smart+er Grids: Challenges, Arequipa 05 October 2015Francisco Gonzalez-Longatt
 
Presentation of LEMMA Numerical Wave Basin stand-alone solver
Presentation of LEMMA Numerical Wave Basin stand-alone solverPresentation of LEMMA Numerical Wave Basin stand-alone solver
Presentation of LEMMA Numerical Wave Basin stand-alone solverREVOLUTION_CFSD
 

Similar to Data Science Lesson 1 Jean-Antoine Moreau (20)

DATA SCIENCE Lesson 2 Parallelism Computing Data Processing Performance Measu...
DATA SCIENCE Lesson 2 Parallelism Computing Data Processing Performance Measu...DATA SCIENCE Lesson 2 Parallelism Computing Data Processing Performance Measu...
DATA SCIENCE Lesson 2 Parallelism Computing Data Processing Performance Measu...
 
Big Data Lesson 3 Jean-Antoine Moreau
Big Data Lesson 3 Jean-Antoine MoreauBig Data Lesson 3 Jean-Antoine Moreau
Big Data Lesson 3 Jean-Antoine Moreau
 
DATA SCIENCE Lesson 3 Data Architectures Data Processing Modeling -Algorithm ...
DATA SCIENCE Lesson 3 Data Architectures Data Processing Modeling -Algorithm ...DATA SCIENCE Lesson 3 Data Architectures Data Processing Modeling -Algorithm ...
DATA SCIENCE Lesson 3 Data Architectures Data Processing Modeling -Algorithm ...
 
DATA SCIENCE Lesson 5 Data Science Predictive Modeling and Modelling Methodol...
DATA SCIENCE Lesson 5 Data Science Predictive Modeling and Modelling Methodol...DATA SCIENCE Lesson 5 Data Science Predictive Modeling and Modelling Methodol...
DATA SCIENCE Lesson 5 Data Science Predictive Modeling and Modelling Methodol...
 
Business intelligence Conference Jean-Antoine Moreau
Business intelligence Conference Jean-Antoine MoreauBusiness intelligence Conference Jean-Antoine Moreau
Business intelligence Conference Jean-Antoine Moreau
 
Collaboro - EclipseCon France 2013 - Ignite Talks Session
Collaboro - EclipseCon France 2013 - Ignite Talks SessionCollaboro - EclipseCon France 2013 - Ignite Talks Session
Collaboro - EclipseCon France 2013 - Ignite Talks Session
 
PenO1: les 2
PenO1: les 2PenO1: les 2
PenO1: les 2
 
Industry 4.0 Imperatives 工业4.0势在必行
Industry 4.0 Imperatives   工业4.0势在必行Industry 4.0 Imperatives   工业4.0势在必行
Industry 4.0 Imperatives 工业4.0势在必行
 
S4x16 europe krotofil_granular_dataflowsics
S4x16 europe krotofil_granular_dataflowsicsS4x16 europe krotofil_granular_dataflowsics
S4x16 europe krotofil_granular_dataflowsics
 
DEF CON 24 - Bertin Bervis and James Jara - exploiting and attacking seismolo...
DEF CON 24 - Bertin Bervis and James Jara - exploiting and attacking seismolo...DEF CON 24 - Bertin Bervis and James Jara - exploiting and attacking seismolo...
DEF CON 24 - Bertin Bervis and James Jara - exploiting and attacking seismolo...
 
Linux rt in financial markets
Linux rt in financial marketsLinux rt in financial markets
Linux rt in financial markets
 
SolarWinds NPM at Cisco Live! 2013
SolarWinds NPM at Cisco Live! 2013SolarWinds NPM at Cisco Live! 2013
SolarWinds NPM at Cisco Live! 2013
 
Lafarge Process Kit - Air flow rate - Pitot V2.pdf
Lafarge Process Kit - Air flow rate - Pitot V2.pdfLafarge Process Kit - Air flow rate - Pitot V2.pdf
Lafarge Process Kit - Air flow rate - Pitot V2.pdf
 
Ditching Fibre Channel & SCSI: Saying hast la vista to your vendors and "ooh ...
Ditching Fibre Channel & SCSI: Saying hast la vista to your vendors and "ooh ...Ditching Fibre Channel & SCSI: Saying hast la vista to your vendors and "ooh ...
Ditching Fibre Channel & SCSI: Saying hast la vista to your vendors and "ooh ...
 
Hacker's and painters Hardware Hacking 101 - 10th Oct 2014
Hacker's and painters Hardware Hacking 101 - 10th Oct 2014Hacker's and painters Hardware Hacking 101 - 10th Oct 2014
Hacker's and painters Hardware Hacking 101 - 10th Oct 2014
 
Tommaso Cucinotta - Low-latency and power-efficient audio applications on Linux
Tommaso Cucinotta - Low-latency and power-efficient audio applications on LinuxTommaso Cucinotta - Low-latency and power-efficient audio applications on Linux
Tommaso Cucinotta - Low-latency and power-efficient audio applications on Linux
 
Lafarge Process Kit - Dry weigt consistency TEST.pdf
Lafarge Process Kit - Dry weigt consistency TEST.pdfLafarge Process Kit - Dry weigt consistency TEST.pdf
Lafarge Process Kit - Dry weigt consistency TEST.pdf
 
Loss Prevention 2013 - atmospheric dispersion modelling by cellular automata ...
Loss Prevention 2013 - atmospheric dispersion modelling by cellular automata ...Loss Prevention 2013 - atmospheric dispersion modelling by cellular automata ...
Loss Prevention 2013 - atmospheric dispersion modelling by cellular automata ...
 
Smart+er Grids: Challenges, Arequipa 05 October 2015
Smart+er Grids: Challenges, Arequipa 05 October 2015Smart+er Grids: Challenges, Arequipa 05 October 2015
Smart+er Grids: Challenges, Arequipa 05 October 2015
 
Presentation of LEMMA Numerical Wave Basin stand-alone solver
Presentation of LEMMA Numerical Wave Basin stand-alone solverPresentation of LEMMA Numerical Wave Basin stand-alone solver
Presentation of LEMMA Numerical Wave Basin stand-alone solver
 

More from Jean-Antoine Moreau

l'Intelligence Artificielle Jean-Antoine Moreau
l'Intelligence Artificielle Jean-Antoine Moreaul'Intelligence Artificielle Jean-Antoine Moreau
l'Intelligence Artificielle Jean-Antoine MoreauJean-Antoine Moreau
 
Management of the Performance Jean-Antoine Moreau
Management of the Performance Jean-Antoine MoreauManagement of the Performance Jean-Antoine Moreau
Management of the Performance Jean-Antoine MoreauJean-Antoine Moreau
 
Management de la Performance Jean-Antoine Moreau
Management de la Performance Jean-Antoine MoreauManagement de la Performance Jean-Antoine Moreau
Management de la Performance Jean-Antoine MoreauJean-Antoine Moreau
 
Stratégie Économique Jean-Antoine Moreau
Stratégie Économique Jean-Antoine MoreauStratégie Économique Jean-Antoine Moreau
Stratégie Économique Jean-Antoine MoreauJean-Antoine Moreau
 
Economic Strategy Jean-Antoine Moreau
Economic Strategy Jean-Antoine MoreauEconomic Strategy Jean-Antoine Moreau
Economic Strategy Jean-Antoine MoreauJean-Antoine Moreau
 
Stratégie Industrielle Jean-Antoine Moreau
Stratégie Industrielle Jean-Antoine MoreauStratégie Industrielle Jean-Antoine Moreau
Stratégie Industrielle Jean-Antoine MoreauJean-Antoine Moreau
 
Industrial Strategy Jean-Antoine Moreau
Industrial Strategy Jean-Antoine MoreauIndustrial Strategy Jean-Antoine Moreau
Industrial Strategy Jean-Antoine MoreauJean-Antoine Moreau
 
Regional Economic Development Jean-Antoine Moreau
Regional Economic Development Jean-Antoine MoreauRegional Economic Development Jean-Antoine Moreau
Regional Economic Development Jean-Antoine MoreauJean-Antoine Moreau
 
MARKETING STRATEGY Jean-Antoine Moreau
MARKETING STRATEGY Jean-Antoine MoreauMARKETING STRATEGY Jean-Antoine Moreau
MARKETING STRATEGY Jean-Antoine MoreauJean-Antoine Moreau
 
Politique Industrielle Seconde Partie
Politique Industrielle Seconde PartiePolitique Industrielle Seconde Partie
Politique Industrielle Seconde PartieJean-Antoine Moreau
 
Politique industrielle Jean-Antoine Moreau
Politique industrielle Jean-Antoine MoreauPolitique industrielle Jean-Antoine Moreau
Politique industrielle Jean-Antoine MoreauJean-Antoine Moreau
 
Réindustrialisation,Politique Industrielle,Plan Industriel Jean-Antoine Moreau
Réindustrialisation,Politique Industrielle,Plan Industriel Jean-Antoine MoreauRéindustrialisation,Politique Industrielle,Plan Industriel Jean-Antoine Moreau
Réindustrialisation,Politique Industrielle,Plan Industriel Jean-Antoine MoreauJean-Antoine Moreau
 
Le Chômage en France Etude, Impacts sociétaux et économiques
Le Chômage en France Etude, Impacts sociétaux et économiquesLe Chômage en France Etude, Impacts sociétaux et économiques
Le Chômage en France Etude, Impacts sociétaux et économiquesJean-Antoine Moreau
 
Diagnostic Projet Jean-Antoine Moreau
Diagnostic Projet  Jean-Antoine MoreauDiagnostic Projet  Jean-Antoine Moreau
Diagnostic Projet Jean-Antoine MoreauJean-Antoine Moreau
 
Élaborer et Mesurer Une Stratégie d’Entreprise Modèle Méthode simple d’évalua...
Élaborer et Mesurer Une Stratégie d’Entreprise Modèle Méthode simple d’évalua...Élaborer et Mesurer Une Stratégie d’Entreprise Modèle Méthode simple d’évalua...
Élaborer et Mesurer Une Stratégie d’Entreprise Modèle Méthode simple d’évalua...Jean-Antoine Moreau
 
Systemic approach to commercial programming and commercial choices Jean-Antoi...
Systemic approach to commercial programming and commercial choices Jean-Antoi...Systemic approach to commercial programming and commercial choices Jean-Antoi...
Systemic approach to commercial programming and commercial choices Jean-Antoi...Jean-Antoine Moreau
 

More from Jean-Antoine Moreau (20)

Histoire de la Drogue en France
Histoire de la Drogue en FranceHistoire de la Drogue en France
Histoire de la Drogue en France
 
l'Intelligence Artificielle Jean-Antoine Moreau
l'Intelligence Artificielle Jean-Antoine Moreaul'Intelligence Artificielle Jean-Antoine Moreau
l'Intelligence Artificielle Jean-Antoine Moreau
 
Blockchain Jean-Antoine Moreau
Blockchain   Jean-Antoine MoreauBlockchain   Jean-Antoine Moreau
Blockchain Jean-Antoine Moreau
 
Management of the Performance Jean-Antoine Moreau
Management of the Performance Jean-Antoine MoreauManagement of the Performance Jean-Antoine Moreau
Management of the Performance Jean-Antoine Moreau
 
Management de la Performance Jean-Antoine Moreau
Management de la Performance Jean-Antoine MoreauManagement de la Performance Jean-Antoine Moreau
Management de la Performance Jean-Antoine Moreau
 
Le Budget Jean-Antoine Moreau
Le Budget Jean-Antoine MoreauLe Budget Jean-Antoine Moreau
Le Budget Jean-Antoine Moreau
 
Stratégie Économique Jean-Antoine Moreau
Stratégie Économique Jean-Antoine MoreauStratégie Économique Jean-Antoine Moreau
Stratégie Économique Jean-Antoine Moreau
 
Economic Strategy Jean-Antoine Moreau
Economic Strategy Jean-Antoine MoreauEconomic Strategy Jean-Antoine Moreau
Economic Strategy Jean-Antoine Moreau
 
Stratégie Industrielle Jean-Antoine Moreau
Stratégie Industrielle Jean-Antoine MoreauStratégie Industrielle Jean-Antoine Moreau
Stratégie Industrielle Jean-Antoine Moreau
 
Industrial Strategy Jean-Antoine Moreau
Industrial Strategy Jean-Antoine MoreauIndustrial Strategy Jean-Antoine Moreau
Industrial Strategy Jean-Antoine Moreau
 
Regional Economic Development Jean-Antoine Moreau
Regional Economic Development Jean-Antoine MoreauRegional Economic Development Jean-Antoine Moreau
Regional Economic Development Jean-Antoine Moreau
 
MARKETING STRATEGY Jean-Antoine Moreau
MARKETING STRATEGY Jean-Antoine MoreauMARKETING STRATEGY Jean-Antoine Moreau
MARKETING STRATEGY Jean-Antoine Moreau
 
Politique Industrielle Seconde Partie
Politique Industrielle Seconde PartiePolitique Industrielle Seconde Partie
Politique Industrielle Seconde Partie
 
Politique industrielle Jean-Antoine Moreau
Politique industrielle Jean-Antoine MoreauPolitique industrielle Jean-Antoine Moreau
Politique industrielle Jean-Antoine Moreau
 
Réindustrialisation,Politique Industrielle,Plan Industriel Jean-Antoine Moreau
Réindustrialisation,Politique Industrielle,Plan Industriel Jean-Antoine MoreauRéindustrialisation,Politique Industrielle,Plan Industriel Jean-Antoine Moreau
Réindustrialisation,Politique Industrielle,Plan Industriel Jean-Antoine Moreau
 
Le Chômage en France Etude, Impacts sociétaux et économiques
Le Chômage en France Etude, Impacts sociétaux et économiquesLe Chômage en France Etude, Impacts sociétaux et économiques
Le Chômage en France Etude, Impacts sociétaux et économiques
 
Diagnostic Projet Jean-Antoine Moreau
Diagnostic Projet  Jean-Antoine MoreauDiagnostic Projet  Jean-Antoine Moreau
Diagnostic Projet Jean-Antoine Moreau
 
Élaborer et Mesurer Une Stratégie d’Entreprise Modèle Méthode simple d’évalua...
Élaborer et Mesurer Une Stratégie d’Entreprise Modèle Méthode simple d’évalua...Élaborer et Mesurer Une Stratégie d’Entreprise Modèle Méthode simple d’évalua...
Élaborer et Mesurer Une Stratégie d’Entreprise Modèle Méthode simple d’évalua...
 
Systemic approach to commercial programming and commercial choices Jean-Antoi...
Systemic approach to commercial programming and commercial choices Jean-Antoi...Systemic approach to commercial programming and commercial choices Jean-Antoi...
Systemic approach to commercial programming and commercial choices Jean-Antoi...
 
SQL Jean-Antoine Moreau
SQL  Jean-Antoine MoreauSQL  Jean-Antoine Moreau
SQL Jean-Antoine Moreau
 

Recently uploaded

Work-Permit-Receiver-in-Saudi-Aramco.pptx
Work-Permit-Receiver-in-Saudi-Aramco.pptxWork-Permit-Receiver-in-Saudi-Aramco.pptx
Work-Permit-Receiver-in-Saudi-Aramco.pptxJuliansyahHarahap1
 
2016EF22_0 solar project report rooftop projects
2016EF22_0 solar project report rooftop projects2016EF22_0 solar project report rooftop projects
2016EF22_0 solar project report rooftop projectssmsksolar
 
"Lesotho Leaps Forward: A Chronicle of Transformative Developments"
"Lesotho Leaps Forward: A Chronicle of Transformative Developments""Lesotho Leaps Forward: A Chronicle of Transformative Developments"
"Lesotho Leaps Forward: A Chronicle of Transformative Developments"mphochane1998
 
notes on Evolution Of Analytic Scalability.ppt
notes on Evolution Of Analytic Scalability.pptnotes on Evolution Of Analytic Scalability.ppt
notes on Evolution Of Analytic Scalability.pptMsecMca
 
scipt v1.pptxcxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
scipt v1.pptxcxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...scipt v1.pptxcxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
scipt v1.pptxcxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...HenryBriggs2
 
Rums floating Omkareshwar FSPV IM_16112021.pdf
Rums floating Omkareshwar FSPV IM_16112021.pdfRums floating Omkareshwar FSPV IM_16112021.pdf
Rums floating Omkareshwar FSPV IM_16112021.pdfsmsksolar
 
Introduction to Serverless with AWS Lambda
Introduction to Serverless with AWS LambdaIntroduction to Serverless with AWS Lambda
Introduction to Serverless with AWS LambdaOmar Fathy
 
kiln thermal load.pptx kiln tgermal load
kiln thermal load.pptx kiln tgermal loadkiln thermal load.pptx kiln tgermal load
kiln thermal load.pptx kiln tgermal loadhamedmustafa094
 
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXssuser89054b
 
Computer Lecture 01.pptxIntroduction to Computers
Computer Lecture 01.pptxIntroduction to ComputersComputer Lecture 01.pptxIntroduction to Computers
Computer Lecture 01.pptxIntroduction to ComputersMairaAshraf6
 
Bhubaneswar🌹Call Girls Bhubaneswar ❤Komal 9777949614 💟 Full Trusted CALL GIRL...
Bhubaneswar🌹Call Girls Bhubaneswar ❤Komal 9777949614 💟 Full Trusted CALL GIRL...Bhubaneswar🌹Call Girls Bhubaneswar ❤Komal 9777949614 💟 Full Trusted CALL GIRL...
Bhubaneswar🌹Call Girls Bhubaneswar ❤Komal 9777949614 💟 Full Trusted CALL GIRL...Call Girls Mumbai
 
data_management_and _data_science_cheat_sheet.pdf
data_management_and _data_science_cheat_sheet.pdfdata_management_and _data_science_cheat_sheet.pdf
data_management_and _data_science_cheat_sheet.pdfJiananWang21
 
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptxHOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptxSCMS School of Architecture
 
DC MACHINE-Motoring and generation, Armature circuit equation
DC MACHINE-Motoring and generation, Armature circuit equationDC MACHINE-Motoring and generation, Armature circuit equation
DC MACHINE-Motoring and generation, Armature circuit equationBhangaleSonal
 
Hostel management system project report..pdf
Hostel management system project report..pdfHostel management system project report..pdf
Hostel management system project report..pdfKamal Acharya
 
Engineering Drawing focus on projection of planes
Engineering Drawing focus on projection of planesEngineering Drawing focus on projection of planes
Engineering Drawing focus on projection of planesRAJNEESHKUMAR341697
 
Minimum and Maximum Modes of microprocessor 8086
Minimum and Maximum Modes of microprocessor 8086Minimum and Maximum Modes of microprocessor 8086
Minimum and Maximum Modes of microprocessor 8086anil_gaur
 
Design For Accessibility: Getting it right from the start
Design For Accessibility: Getting it right from the startDesign For Accessibility: Getting it right from the start
Design For Accessibility: Getting it right from the startQuintin Balsdon
 

Recently uploaded (20)

Work-Permit-Receiver-in-Saudi-Aramco.pptx
Work-Permit-Receiver-in-Saudi-Aramco.pptxWork-Permit-Receiver-in-Saudi-Aramco.pptx
Work-Permit-Receiver-in-Saudi-Aramco.pptx
 
Integrated Test Rig For HTFE-25 - Neometrix
Integrated Test Rig For HTFE-25 - NeometrixIntegrated Test Rig For HTFE-25 - Neometrix
Integrated Test Rig For HTFE-25 - Neometrix
 
2016EF22_0 solar project report rooftop projects
2016EF22_0 solar project report rooftop projects2016EF22_0 solar project report rooftop projects
2016EF22_0 solar project report rooftop projects
 
"Lesotho Leaps Forward: A Chronicle of Transformative Developments"
"Lesotho Leaps Forward: A Chronicle of Transformative Developments""Lesotho Leaps Forward: A Chronicle of Transformative Developments"
"Lesotho Leaps Forward: A Chronicle of Transformative Developments"
 
notes on Evolution Of Analytic Scalability.ppt
notes on Evolution Of Analytic Scalability.pptnotes on Evolution Of Analytic Scalability.ppt
notes on Evolution Of Analytic Scalability.ppt
 
scipt v1.pptxcxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
scipt v1.pptxcxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...scipt v1.pptxcxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
scipt v1.pptxcxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
 
Rums floating Omkareshwar FSPV IM_16112021.pdf
Rums floating Omkareshwar FSPV IM_16112021.pdfRums floating Omkareshwar FSPV IM_16112021.pdf
Rums floating Omkareshwar FSPV IM_16112021.pdf
 
Introduction to Serverless with AWS Lambda
Introduction to Serverless with AWS LambdaIntroduction to Serverless with AWS Lambda
Introduction to Serverless with AWS Lambda
 
kiln thermal load.pptx kiln tgermal load
kiln thermal load.pptx kiln tgermal loadkiln thermal load.pptx kiln tgermal load
kiln thermal load.pptx kiln tgermal load
 
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
 
Computer Lecture 01.pptxIntroduction to Computers
Computer Lecture 01.pptxIntroduction to ComputersComputer Lecture 01.pptxIntroduction to Computers
Computer Lecture 01.pptxIntroduction to Computers
 
FEA Based Level 3 Assessment of Deformed Tanks with Fluid Induced Loads
FEA Based Level 3 Assessment of Deformed Tanks with Fluid Induced LoadsFEA Based Level 3 Assessment of Deformed Tanks with Fluid Induced Loads
FEA Based Level 3 Assessment of Deformed Tanks with Fluid Induced Loads
 
Bhubaneswar🌹Call Girls Bhubaneswar ❤Komal 9777949614 💟 Full Trusted CALL GIRL...
Bhubaneswar🌹Call Girls Bhubaneswar ❤Komal 9777949614 💟 Full Trusted CALL GIRL...Bhubaneswar🌹Call Girls Bhubaneswar ❤Komal 9777949614 💟 Full Trusted CALL GIRL...
Bhubaneswar🌹Call Girls Bhubaneswar ❤Komal 9777949614 💟 Full Trusted CALL GIRL...
 
data_management_and _data_science_cheat_sheet.pdf
data_management_and _data_science_cheat_sheet.pdfdata_management_and _data_science_cheat_sheet.pdf
data_management_and _data_science_cheat_sheet.pdf
 
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptxHOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx
 
DC MACHINE-Motoring and generation, Armature circuit equation
DC MACHINE-Motoring and generation, Armature circuit equationDC MACHINE-Motoring and generation, Armature circuit equation
DC MACHINE-Motoring and generation, Armature circuit equation
 
Hostel management system project report..pdf
Hostel management system project report..pdfHostel management system project report..pdf
Hostel management system project report..pdf
 
Engineering Drawing focus on projection of planes
Engineering Drawing focus on projection of planesEngineering Drawing focus on projection of planes
Engineering Drawing focus on projection of planes
 
Minimum and Maximum Modes of microprocessor 8086
Minimum and Maximum Modes of microprocessor 8086Minimum and Maximum Modes of microprocessor 8086
Minimum and Maximum Modes of microprocessor 8086
 
Design For Accessibility: Getting it right from the start
Design For Accessibility: Getting it right from the startDesign For Accessibility: Getting it right from the start
Design For Accessibility: Getting it right from the start
 

Data Science Lesson 1 Jean-Antoine Moreau

  • 1. DDAATTAA SSCCIIEENNCCEE Conference - Study : Jean-Antoine Moreau (Engineer - Lecturer) © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP.
  • 2. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. « The science of today is the technology of tomorrow. » Edward Teller JAM 2 / 108 Contact http://www.jean-antoine-moreau.fr.nf
  • 3. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. « There does not exist a category of science to which one can give the name applied science. There are science and the applications of science, bound together as the fruit of the tree which bears it. » Louis Pasteur JAM 3 / 108 Contact http://www.jean-antoine-moreau.fr.nf
  • 4. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 4 / 108 Commerce and Research are being transformed by data-driven discovery and prediction. Contact http://www.jean-antoine-moreau.fr.nf
  • 5. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE Skills required for data analytics at massive levels : – Scalable data management and off the cloud; – Parallel algorithm; – Statistical modeling. JAM 5 / 108 Contact http://www.jean-antoine-moreau.fr.nf
  • 6. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE • The basic techniques of Data Science including both SQL and NoSql solutions for massive data management. JAM 6 / 108 Contact http://www.jean-antoine-moreau.fr.nf
  • 7. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 7 / 108 • Examples : – MapReduce; – Algorithme for Data mining; – Clustering; – Association of rules. Contact http://www.jean-antoine-moreau.fr.nf
  • 8. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 8 / 108 • Data Science Manipulation of the Scale : – Database; – Relational algebra; – Parallel database; – Parallel query progressing. Contact http://www.jean-antoine-moreau.fr.nf
  • 9. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 9 / 108 Contact http://www.jean-antoine-moreau.fr.nf • MapReduce; • Hadoop; • Relationship to database; • Algorithms; • Extensions languages; • Key value stores and NoSQL Tradeoffs of SQL and NoSQL. TToooollss
  • 10. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 10 / • Supervised : – Rules; – Trees; – Forests; – Nearest; – Neighbor; – Regression; – Optimization. Contact http://www.jean-antoine-moreau.fr.nf
  • 11. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 11 / • Communication results : – Visualization data products; – Visual data analytic; – Provenance (origin); – Belonging; – Ethics; – Governance. Contact http://www.jean-antoine-moreau.fr.nf
  • 12. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 12 / TTooppiiccss Contact http://www.jean-antoine-moreau.fr.nf Graph Analytic : – Structure; – Transversals; – Analytics; – Page-Rank; – Community detection; – Recursive queries; – Semantic Web; – Quest.
  • 13. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. « Most of the fundamental ideas of science are essentially simple, and may, as a rule, be expressed in a language comprehensible to everyone. » JAM 13 / Contact http://www.jean-antoine-moreau.fr.nf Albert Einstein A little break, to ask questions.
  • 14. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 14 / Any e-commerce application is a data-driven application. Contact http://www.jean-antoine-moreau.fr.nf
  • 15. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE • Learning systems; • High-frequency / low frequency data processing systems; • Distributed systems. JAM 15 / Contact http://www.jean-antoine-moreau.fr.nf
  • 16. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 16 / • Aggregation theory; • Data analysis; • Data mining; • Computational statistics; • Statistical signal processing. Contact http://www.jean-antoine-moreau.fr.nf
  • 17. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 17 / • Kernel method; • Probabilistic method. Contact http://www.jean-antoine-moreau.fr.nf
  • 18. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 18 / • Probabilistic Models • Probability Theory • Linear algebra Contact http://www.jean-antoine-moreau.fr.nf • New algorithm
  • 19. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE The parallel processing of data JAM 19 / involves the use of parallel processing platform. Contact http://www.jean-antoine-moreau.fr.nf
  • 20. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 20 / Service platform for parallel processing Contact http://www.jean-antoine-moreau.fr.nf
  • 21. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 21 / A service platform will pool: – Resources; – Costs. Contact http://www.jean-antoine-moreau.fr.nf
  • 22. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 22 / Contact http://www.jean-antoine-moreau.fr.nf • Using : – Design NFA • nondeterministic finite automata ; – Design DFA • deterministic finite automaton .
  • 23. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE parallelism and processing performance JAM 23 / Contact http://www.jean-antoine-moreau.fr.nf
  • 24. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE parallelism and processing performance JAM 24 / PParallel LLangage IIntegrated QQuery (PPLLIINNQQ) Contact http://www.jean-antoine-moreau.fr.nf
  • 25. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 25 / • Performance elapsed time; • Scalability degree of parallelism : – (number of tasks); – (number of cores); • Simplicity of the code (programming) • Facility to maintain in operational condition; • A method of using the memory; • Memory Mapping. Contact http://www.jean-antoine-moreau.fr.nf
  • 26. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 26 / • Implementation method: – class; – objects. • Method of using the processors: – Physical; – Logical; – Virtual. Contact http://www.jean-antoine-moreau.fr.nf
  • 27. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE Use the parallel processing to the databases JAM 27 / Contact http://www.jean-antoine-moreau.fr.nf
  • 28. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 28 / ppaarraalllleell aarrcchhiitteeccttuurree Contact http://www.jean-antoine-moreau.fr.nf
  • 29. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 29 / • Parallel architecture; • Specialized parallel machines. Contact http://www.jean-antoine-moreau.fr.nf
  • 30. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 30 / SShhaarreedd--mmeemmoorryy aarrcchhiitteeccttuurree Process (1) Process (n) interconnection Contact http://www.jean-antoine-moreau.fr.nf Memory (1) Memory (n) Disk (1) Disk (n)
  • 31. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE Processor (1) Processor (n) Memory (1) Memory (n) JAM 31 / Network Disk 1 Disk (n) Contact http://www.jean-antoine-moreau.fr.nf
  • 32. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE Transfer large volumes of data in main memory. JAM 32 / Calculator (processor) saturation risk Decentralized processing Contact http://www.jean-antoine-moreau.fr.nf
  • 33. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 33 / Central computer Backbone Dorsal Computer Machine Database Data Base Contact http://www.jean-antoine-moreau.fr.nf
  • 34. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 34 / • Only data used are transferred; • The central processor: – updates; – research; • Specialization of the computer; • Use parallel machines; – for data processing; – for treatment of discs; • Fault tolerance. Contact http://www.jean-antoine-moreau.fr.nf
  • 35. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 35 / Database Machine • Control access and permissions; • Semantic integrity control; • Recovery Data Base; • Atomicity Control of transactions; • Restore of the database; • Simultaneous access; • Concurrent access; • Recovery data base. Contact http://www.jean-antoine-moreau.fr.nf
  • 36. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE manager Data JAM 36 / host system communication Contact http://www.jean-antoine-moreau.fr.nf interface manager Manager associative memory query optimizer manager
  • 37. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 37 / Database Machine • Interface database manager; • Communication manager; • Query optimizer manager; • Memory manager association. Contact http://www.jean-antoine-moreau.fr.nf
  • 38. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE Central IT Local network JAM 38 / Contact http://www.jean-antoine-moreau.fr.nf Interconnexion Interlink System (1) Interconnexion Interlink System (2) Communication Processor (1) CP (2) CP (n) Bus (1) – Network YNET Bus (2) – Network YNET Bus (n) – Network YNET Processor Acces (1) PA (2) PA (n) DDisk SStorage UUnit (1) DDisk SStorage UUnit (2) DSU (n)
  • 39. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE  Ynet, an interconnect structure for a highly concurrent database system which also requires high availability and real-time operation.  The Ynet is the basis of a multiple-instruction, multiple-data (MIMD) concurrent processing architecture which can connect up to 1024 high-performance microprocessors to form a very-high performance JAM 39 / Contact http://www.jean-antoine-moreau.fr.nf system.  the Ynet results from the logic implemented in the processor interface.  The processor interface is divided into three sections, each of which is implemented by a finite-state machine.
  • 40. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. « In questions of science, the authority of a thousand is not worth the humble reasoning of a single individual. » JAM 40 / Contact http://www.jean-antoine-moreau.fr.nf Galileo Galilei A short break for you, to ask your questions.
  • 41. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 41 / Database Machine Processor Processor Interface Central Interface Session control Data conversion SQL Parser (analyze – optimize) Compiler Dispatcher YNET interface PA YNET PA Contact http://www.jean-antoine-moreau.fr.nf
  • 42. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE • Processes and access processors can execute simultaneously on a single query; • The uniform distribution of data on Disk Storage Unit; • Using a hash algorithm. JAM 42 / Specifics Contact http://www.jean-antoine-moreau.fr.nf
  • 43. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 43 / Processing queries Processing steps of a query Contact http://www.jean-antoine-moreau.fr.nf
  • 44. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE • The programmer examines (study) the query rigorously and methodically; • The programmer writes the query; • The programmer tests its query; • The programmer sends the query from the host computer; JAM 44 / then ... more ... Contact http://www.jean-antoine-moreau.fr.nf
  • 45. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE • The Analyzer PProcessor IInterface (PI) verifies that the query is semantically correct and develop a plan for execution. JAM 45 / Contact http://www.jean-antoine-moreau.fr.nf
  • 46. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE • The value of the primary index is transformed into hashcode and is transmitted by the YNET PI interface. JAM 46 / Contact http://www.jean-antoine-moreau.fr.nf
  • 47. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE • A message is sent by YNET, to all processors. JAM 47 / Contact http://www.jean-antoine-moreau.fr.nf
  • 48. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE • The YNET interface of each processor can accept or reject the message. JAM 48 / Contact http://www.jean-antoine-moreau.fr.nf
  • 49. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE • One processor acces * (PA) will access its disk storage unit; JAM 49 / * Access Module Processor. Contact http://www.jean-antoine-moreau.fr.nf
  • 50. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE • The processor access (PA) will build a YNET message containing the tuple.  A tuple is an ordered list of elements. In set theory, an n-tuple is a sequence (or ordered list) of n elements, where n is a non-negative integer. JAM 50 / Contact http://www.jean-antoine-moreau.fr.nf
  • 51. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE • The interface processor that sent the request receives the return message. JAM 51 / Contact http://www.jean-antoine-moreau.fr.nf
  • 52. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE • The message is sent via the YNET / IP; JAM 52 / Contact http://www.jean-antoine-moreau.fr.nf
  • 53. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE • YNET sends the message to all processes; JAM 53 / Contact http://www.jean-antoine-moreau.fr.nf
  • 54. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE • The YNET interface of each PA accepts the message. JAM 54 / Contact http://www.jean-antoine-moreau.fr.nf
  • 55. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE • The interface processor returns the message to the computer according to the protocol (TDP). JAM 55 / Contact http://www.jean-antoine-moreau.fr.nf
  • 56. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE • The host computer is completely discharged of the treatment response; JAM 56 / Contact http://www.jean-antoine-moreau.fr.nf
  • 57. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE Host PI / CP PA(1) PA(2) PA(n) DSU (1) DSU (2) DSU (n) JAM 57 / YNET Contact http://www.jean-antoine-moreau.fr.nf PI processor Interface
  • 58. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE • The compiler of the Processor Interface generates the processing on multiple (PA); JAM 58 / Contact http://www.jean-antoine-moreau.fr.nf
  • 59. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE • Each PA will access the table on its DSU, and copy the tuples that match the answer in his workspace; • A message is then transmitted over the network YNET; JAM 59 / Contact http://www.jean-antoine-moreau.fr.nf
  • 60. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE – of the PI origin collects the responses already merged and sorted; JAM 60 / • The YNET interface Contact http://www.jean-antoine-moreau.fr.nf
  • 61. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE • The interface processor sends the contents of the buffer to the computer TDP; JAM 61 / Contact http://www.jean-antoine-moreau.fr.nf
  • 62. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE Processor Acces (1) Processor Acces (2) Processor Acces (n) T(4) T(3) T(2) DSU(1) DSU(2) DSU(n) JAM 62 / TThhee wwoorrkk ooff tthhee pprroocceessssoorr iinn ppaarraalllleell T(9) T(5) Transaction Contact http://www.jean-antoine-moreau.fr.nf
  • 63. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 63 / • Data protection : – Fallback; – Fallback clustering. Contact http://www.jean-antoine-moreau.fr.nf
  • 64. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. « Science cannot solve the ultimate mystery of nature. And that is because, in the last analysis, we ourselves are a part of the mystery that we are trying to solve. » JAM 64 / Contact http://www.jean-antoine-moreau.fr.nf Max Planck A short break, to ask your questions.
  • 65. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 65 / Primary Index It is essential Contact http://www.jean-antoine-moreau.fr.nf
  • 66. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE • The primary index is chosen according to the mode of use: JAM 66 / how decisions; transactional mode; frequency of updating; frequency of application. Contact http://www.jean-antoine-moreau.fr.nf
  • 67. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 67 / PPrimary IIndex • Sigle / UUnique (UPI); • NNo UUnique (NUPI); Contact http://www.jean-antoine-moreau.fr.nf
  • 68. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 68 / • The query on UPI uses a single AMP; • The result returns a single tuple; (Access Module Processor) Contact http://www.jean-antoine-moreau.fr.nf
  • 69. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 69 / • Two kinds of access : – Direct access to the primary key; – Indirect access to the primary key, via an intermediate file. Contact http://www.jean-antoine-moreau.fr.nf
  • 70. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE 1 n JAM 70 / Primary Index Value Hash - Coding Contact http://www.jean-antoine-moreau.fr.nf AMP
  • 71. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 71 / Secondary Index • The RDBC build for each : (Recursive Density Based Clustering - datamining algorithm) (Root Data Base Connectivity). – Unique (single) Secondary Index; – Non – Unique Secondary Index; a sub-table. Contact http://www.jean-antoine-moreau.fr.nf
  • 72. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 72 / Sub – Table Sub-table contains all secondary indexes encoded in a hash algorithme; Contact http://www.jean-antoine-moreau.fr.nf
  • 73. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 73 / Sub – Table Each sub-index of this table is an identifier; the hash code value of the primary index, retrieves the tuple to select the DSU. Contact http://www.jean-antoine-moreau.fr.nf
  • 74. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 74 / Contact http://www.jean-antoine-moreau.fr.nf Tuple Size Secondary index identifier Secondary Index Value Primary Index Identifier Tuple Size
  • 75. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 75 / • The value of the secondary index is transformed by hashing into the AMP. Contact http://www.jean-antoine-moreau.fr.nf
  • 76. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 76 / Secondary Index Value Contact http://www.jean-antoine-moreau.fr.nf USI Hash-coding AMP
  • 77. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 77 / • Each sub-table has a column identifier; Contact http://www.jean-antoine-moreau.fr.nf
  • 78. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE • each value of this sub-table is one and only one tuple. JAM 78 / Contact http://www.jean-antoine-moreau.fr.nf
  • 79. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 79 / Secondary index not unique - single structure of storage Contact http://www.jean-antoine-moreau.fr.nf
  • 80. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE Secondary Index No unique (NUSI) Hash - Coding AMP (1) AMP (2) AMP (n) JAM 80 / Contact http://www.jean-antoine-moreau.fr.nf
  • 81. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 81 / Query Optimization SQL Query parser resolve optimizer Structured data Explain / Text generator Contact http://www.jean-antoine-moreau.fr.nf dispacher statistics
  • 82. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 82 / • example commands: – collect statistic; – explain. Contact http://www.jean-antoine-moreau.fr.nf
  • 83. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE The COLLECT STATISTICS command JAM 83 / Contact http://www.jean-antoine-moreau.fr.nf
  • 84. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE • The optimizer uses the statistics collected on the tables in search of better access to the data. JAM 84 / Contact http://www.jean-antoine-moreau.fr.nf
  • 85. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 85 / • Number tuple for each table; • Unique and no-unique index: Contact http://www.jean-antoine-moreau.fr.nf – Primary; – Secondary; • The number of the attribute values; • The maximal attribute values for each the tables; • The number of occurrences not duplicated in each table; • The collection of statistics is made in order.
  • 86. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 86 / The EXPLAIN command Contact http://www.jean-antoine-moreau.fr.nf
  • 87. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 87 / • This command provides information on: – The nature of the requested tables to process the request – The indexes used : Contact http://www.jean-antoine-moreau.fr.nf • Primary; • Secondary; – The various stages of the request processing ; – Treatments of joints; – The contents of files created to stock the intermediate results; – The number of returned tuples at each stage of processing; – The execution of the various stages of the application time; – The types of joints; – The total time taken by the RDBC (datamining process).
  • 88. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 88 / • Syntax example : EXPLAIN COUNT ( ….) FROM .. , .. , ..., Where … Contact http://www.jean-antoine-moreau.fr.nf
  • 89. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE • The minutes (report) of EXPLAIN, – the time set by the system to scan the tables and JAM 89 / selected information. Contact http://www.jean-antoine-moreau.fr.nf
  • 90. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE It is important to make an algebraic tree. JAM 90 / • For each query: Contact http://www.jean-antoine-moreau.fr.nf
  • 91. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 91 / Query processing on RDBC – Recursive Density Based Clustering Query Single table Contact http://www.jean-antoine-moreau.fr.nf
  • 92. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE • Query on UPI (unique primary index); • A single AMP is accessed, and will look in the DSU the tuple corresponding to the query. JAM 92 / Contact http://www.jean-antoine-moreau.fr.nf
  • 93. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE – One AMP is indexed and accessed the duplicate tuples are placed in the same GPA. – The GPA will look in its DSU tuple or tuples satisfy the query. – GPA: Grade Point Average. JAM 93 / • Query on NUPI: Contact http://www.jean-antoine-moreau.fr.nf
  • 94. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 94 / • Query on : – Unique Secondary Index; – Non Unique Secondary Index; – Request on non-indexed attributes. Contact http://www.jean-antoine-moreau.fr.nf
  • 95. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. « Science is organized knowledge. Wisdom is organized life. » JAM 95 / Contact http://www.jean-antoine-moreau.fr.nf Immanuel Kant A little break, to ask your questions
  • 96. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 96 / Processing requests Processing Query RRDDBBCC Recursive Density Based Clustering Contact http://www.jean-antoine-moreau.fr.nf
  • 97. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 97 / multi-task application Request multi-task Query • The RDBC uses five types of joins : – NESTED JOIN; – MERGE JOIN; – PRODUCT JOIN; – EXCLUSION JOIN; – ROWID JOIN. Contact http://www.jean-antoine-moreau.fr.nf
  • 98. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE • The wwhheerree condition specifies a constant value for a single (Primary or Secondary) index. JAM 98 / Contact http://www.jean-antoine-moreau.fr.nf
  • 99. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE join two unique primary index (UPI) JAM 99 / Select … from … , … where … ; Contact http://www.jean-antoine-moreau.fr.nf
  • 100. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE Select … from table (i), table (i+1) where *; JAM 100 / MMEERRGGEE JJOOIINN object-oriented programming : Select … from object (i), object (i+1) where *; Contact http://www.jean-antoine-moreau.fr.nf
  • 101. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE Select … from object (a) (i), object (a:b) (i+1), object (a:x) (n+1); where * ; with *; JAM 101 / PPRROODDUUCCTT JJOOIINN Select … from table (i), table (i+1), table (n+1); where * ; with *; object-oriented programming : Contact http://www.jean-antoine-moreau.fr.nf
  • 102. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 102 / NNEESSTTEEDD JJOOIINN Select … , * from *, attribute where x=y and y= (variable integer); Contact http://www.jean-antoine-moreau.fr.nf
  • 103. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 103 / CCAARRTTEESSIIAANN PPRROODDUUCCTT Select … , …. from … , … a PRODUCT JOIN without restriction. Contact http://www.jean-antoine-moreau.fr.nf
  • 104. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 104 / EEXXCCLLUUSSIIOONN JJOOIINN Select …,… from …,… where x=y and (select … from …); Contact http://www.jean-antoine-moreau.fr.nf
  • 105. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. DDAATTAA SSCCIIEENNCCEE JAM 105 / ROWID JOIN select … from X,Y where X.a = constant And X.b=Y.c Contact http://www.jean-antoine-moreau.fr.nf with a : primary index b c secondary index
  • 106. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. end of the internet diffusion of this lesson JAM 106 / Contact http://www.jean-antoine-moreau.fr.nf