SlideShare a Scribd company logo
Data Intensive Engineering


 Xosé Manuel Carreira Rodríguez
http://www.linkedin.com/in/carreira
        13th December 2012
BRIEF



• In this presentation the possible use of the big
  data technologies in the civil engineering is
  overviewed.
“…probably indicates that these sectors face
 strong systemic barriers to increasing
productivity”
We collect enough data.
  We need to focus on
       1- connecting
 2 – identifying patterns
3- giving confidence level

                       Multiple data sources:

                       Books
                       Experts in the field
                       Information systems
                       Tests and surveying
                       Data repositories
                       Real time sensors
Data quality



• Processing is cheap and access is easy, the
  big problem is data quality.
• Considerable research but highly
  fragmented
Classic definition of Data Quality

• Accuracy
  – The data was recorded correctly.
• Completeness
  – All relevant data was recorded.
• Uniqueness
  – Entities are recorded once.
• Timeliness
  – The data is kept up to date.
     • Special problems in federated data: time consistency.
• Consistency
  – The data agrees with itself.
Finding a modern definition
• Data quality must
  – Reflect the use of the data
  – Lead to improvements in processes
  – Be measurable



• No silver bullets: Use several data quality
  metrics.
What is the problem to solve?
• Do you have a bunch of data and want to:
  – Estimate an unknown parameter from it?
     • True rainfall based on radar observations?
     • Amount of liquid content from in-situ measurements of
       temperature, pressure, etc?
     • Regression
  – Classify what the data correspond to?
     • A water surge?
     • A temperature inversion?
     • A boundary?
     • Classification
• Regression and classification aren’t that
  different                                               11
Case 1: Neural networks for flood
• Neural networks modelling of the rainfall-runoff
  relationship




• No physical model, just data driven model.
• Result: flow forecasting
Case 1: Neural networks for flood




• Input: several past rain gauges
  and flow gauges
• Result: Flow model
Case 1: Neural networks for flood




Training with 1st (larger) set of data
Case 1: Neural networks for flood




Verification with 2nd (smaller) set of data
Simulation
  sample
How can IT help in maintenance ?
• Information Technology has also found applications in
  post commission period of the project.

• IT can provide easy access to various statistics, drawing
  & various other data concerning the project.

• Self check tools can identify the problems in various
  systems like fire fighting, air conditioning & can
  automatically inform concerned service provider.

• IT can also help in prompt reporting of problem & its
  rectification.
Case 2: Bridge Management Systems

• Double click on the
  icon on your desktop



  – Introductory screen is
    displayed
  – Click OK button to
    continue to the Data
    collection form


                                       Page 18
Connecting
Bridge
Management
Systems
to
Asset
Management

             U.S. Department of Transportation
             Federal Highway Administration
Bridges in the U.S.
25% are structurally or functionally deficient
according to ASCE


 140000
 120000
 100000
  80000
  60000
  40000
  20000
     0
          Pre-1909


                      10s


                            20s


                                  30s


                                        40s


                                              50s


                                                    60s


                                                          70s


                                                                80s


                                                                      90s
                     Bridge Construction by Decade
Case 2: Bridge Management Systems
   Typical BMS Expectations
   A tool to evaluate:

   •   Bridge condition and serviceability
   •   Implications of project decisions
   •   Priorities and schedules
   •   Expected budget
   •   Cost of alternative standards
   •   Value of preventive maintenance
You can run a company from a coffee shop
Why not a lab or a civil infraestructure?
Desktop PCs are idle half the day




Desktop PCs tend to be active   But at night, during most of
during the workday.             the year, they’re idle. So
                                we’re only getting half their
                                value (or less).




                                                                24
Finally ,
          it is argued that IT can readily be
used by civil engineers given the low
capital investment levels required.

The “only” requirement is investment in
education among the civil engineers &
recognition of the enormous potential
lying beneath.

More Related Content

Viewers also liked

Mano miestas Tokijus
Mano miestas TokijusMano miestas Tokijus
Mano miestas Tokijustokyo18
 
Chapter15 pp ts
Chapter15 pp tsChapter15 pp ts
Chapter15 pp ts
Pradhumanrana
 
конкурс рмо
конкурс рмоконкурс рмо
конкурс рмо
Irina Podolskaya
 
第7章 语法制导翻译和中间代码生成
第7章 语法制导翻译和中间代码生成第7章 语法制导翻译和中间代码生成
第7章 语法制导翻译和中间代码生成
tjpucompiler
 
Blog pp cultural diversity
Blog pp cultural diversityBlog pp cultural diversity
Blog pp cultural diversity
PaulineHeadley
 
Tic angela
Tic angelaTic angela
Tic angela
angela-9403
 
PresCare Annual Report 2012-13
PresCare Annual Report 2012-13PresCare Annual Report 2012-13
PresCare Annual Report 2012-13
James Woods
 
動畫表演
動畫表演動畫表演
動畫表演zi_yong
 
Catalunya 77 Juliol-agost 2006
Catalunya 77 Juliol-agost 2006 Catalunya 77 Juliol-agost 2006
Catalunya 77 Juliol-agost 2006
Revista Catalunya
 
د _______ _د_____ç_د_خ_è _____ث___â_د__ _د___ç___»___è_ر
 د _______ _د_____ç_د_خ_è _____ث___â_د__ _د___ç___»___è_ر د _______ _د_____ç_د_خ_è _____ث___â_د__ _د___ç___»___è_ر
د _______ _د_____ç_د_خ_è _____ث___â_د__ _د___ç___»___è_رrawan102
 
Artefact Proposal
Artefact ProposalArtefact Proposal
Artefact Proposal
Joe Willmott
 

Viewers also liked (15)

Mano miestas Tokijus
Mano miestas TokijusMano miestas Tokijus
Mano miestas Tokijus
 
Houston
HoustonHouston
Houston
 
Chapter15 pp ts
Chapter15 pp tsChapter15 pp ts
Chapter15 pp ts
 
конкурс рмо
конкурс рмоконкурс рмо
конкурс рмо
 
File 1
File 1File 1
File 1
 
第7章 语法制导翻译和中间代码生成
第7章 语法制导翻译和中间代码生成第7章 语法制导翻译和中间代码生成
第7章 语法制导翻译和中间代码生成
 
Blog pp cultural diversity
Blog pp cultural diversityBlog pp cultural diversity
Blog pp cultural diversity
 
Tic angela
Tic angelaTic angela
Tic angela
 
PresCare Annual Report 2012-13
PresCare Annual Report 2012-13PresCare Annual Report 2012-13
PresCare Annual Report 2012-13
 
動畫表演
動畫表演動畫表演
動畫表演
 
Catalunya 77 Juliol-agost 2006
Catalunya 77 Juliol-agost 2006 Catalunya 77 Juliol-agost 2006
Catalunya 77 Juliol-agost 2006
 
د _______ _د_____ç_د_خ_è _____ث___â_د__ _د___ç___»___è_ر
 د _______ _د_____ç_د_خ_è _____ث___â_د__ _د___ç___»___è_ر د _______ _د_____ç_د_خ_è _____ث___â_د__ _د___ç___»___è_ر
د _______ _د_____ç_د_خ_è _____ث___â_د__ _د___ç___»___è_ر
 
Artefact Proposal
Artefact ProposalArtefact Proposal
Artefact Proposal
 
K401 L2
K401 L2K401 L2
K401 L2
 
Gamze bilg ödevi
Gamze bilg ödeviGamze bilg ödevi
Gamze bilg ödevi
 

Similar to Data Intensive Engineering

DeployingAnAdvancedDistribution.pdf
DeployingAnAdvancedDistribution.pdfDeployingAnAdvancedDistribution.pdf
DeployingAnAdvancedDistribution.pdf
bayu162365
 
Research Methodology Presentation - Research in Supply Chain Digital Twins
Research Methodology Presentation - Research in Supply Chain Digital TwinsResearch Methodology Presentation - Research in Supply Chain Digital Twins
Research Methodology Presentation - Research in Supply Chain Digital Twins
Arwa Abougharib
 
Re-Engineering Engineering
Re-Engineering EngineeringRe-Engineering Engineering
Re-Engineering Engineering
Iben Rodriguez
 
Visualizing Your Network Health - Driving Visibility in Increasingly Complex...
Visualizing Your Network Health -  Driving Visibility in Increasingly Complex...Visualizing Your Network Health -  Driving Visibility in Increasingly Complex...
Visualizing Your Network Health - Driving Visibility in Increasingly Complex...
DellNMS
 
Network Centric Cloud: Competing in a IT World with a Telecom Approach
Network Centric Cloud: Competing in a IT World with a Telecom ApproachNetwork Centric Cloud: Competing in a IT World with a Telecom Approach
Network Centric Cloud: Competing in a IT World with a Telecom Approach
Eduardo Mendez Polo
 
Barga ACM DEBS 2013 Keynote
Barga ACM DEBS 2013 KeynoteBarga ACM DEBS 2013 Keynote
Barga ACM DEBS 2013 Keynote
Roger Barga
 
The New Role of Data in the Changing Energy & Utilities Landscape
The New Role of Data in the Changing Energy & Utilities LandscapeThe New Role of Data in the Changing Energy & Utilities Landscape
The New Role of Data in the Changing Energy & Utilities Landscape
Denodo
 
Cloud Billing: Enabling consumers for pay for what they use
Cloud Billing: Enabling consumers for pay for what they useCloud Billing: Enabling consumers for pay for what they use
Cloud Billing: Enabling consumers for pay for what they use
Eduardo Mendez Polo
 
Elastic Software Infrastructure to Support the Industrial Internet
Elastic Software Infrastructure to Support the Industrial InternetElastic Software Infrastructure to Support the Industrial Internet
Elastic Software Infrastructure to Support the Industrial Internet
Real-Time Innovations (RTI)
 
Visualizing Your Network Health - Know your Network
Visualizing Your Network Health - Know your NetworkVisualizing Your Network Health - Know your Network
Visualizing Your Network Health - Know your Network
DellNMS
 
Cloud computing
Cloud computingCloud computing
Cloud computing
Amit Kumar
 
Data Con LA 2022 - Building Field-level Lineage from Scratch for Modern Data ...
Data Con LA 2022 - Building Field-level Lineage from Scratch for Modern Data ...Data Con LA 2022 - Building Field-level Lineage from Scratch for Modern Data ...
Data Con LA 2022 - Building Field-level Lineage from Scratch for Modern Data ...
Data Con LA
 
Harnessing Big Data_UCLA
Harnessing Big Data_UCLAHarnessing Big Data_UCLA
Harnessing Big Data_UCLA
Paul Barsch
 
IRJET - A Research on Eloquent Salvation and Productive Outsourcing of Massiv...
IRJET - A Research on Eloquent Salvation and Productive Outsourcing of Massiv...IRJET - A Research on Eloquent Salvation and Productive Outsourcing of Massiv...
IRJET - A Research on Eloquent Salvation and Productive Outsourcing of Massiv...
IRJET Journal
 
AI4SE: Challenges and opportunities in the integration of Systems Engineering...
AI4SE: Challenges and opportunities in the integration of Systems Engineering...AI4SE: Challenges and opportunities in the integration of Systems Engineering...
AI4SE: Challenges and opportunities in the integration of Systems Engineering...
CARLOS III UNIVERSITY OF MADRID
 
Models Done Better... - UDG2018 - Intertek and DHI
Models Done Better... - UDG2018 - Intertek and DHIModels Done Better... - UDG2018 - Intertek and DHI
Models Done Better... - UDG2018 - Intertek and DHI
Stephen Flood
 
Shikha fdp 62_14july2017
Shikha fdp 62_14july2017Shikha fdp 62_14july2017
Shikha fdp 62_14july2017
Dr. Shikha Mehta
 
UK Data Centre Capabilty Presentation Rev.A
UK Data Centre Capabilty Presentation Rev.AUK Data Centre Capabilty Presentation Rev.A
UK Data Centre Capabilty Presentation Rev.A
Gary Marshall
 
Enerji Sektöründe Endüstriyel IoT Uygulamaları - Şahin Çağlayan (Reengen)
Enerji Sektöründe Endüstriyel IoT Uygulamaları - Şahin Çağlayan (Reengen)Enerji Sektöründe Endüstriyel IoT Uygulamaları - Şahin Çağlayan (Reengen)
Enerji Sektöründe Endüstriyel IoT Uygulamaları - Şahin Çağlayan (Reengen)
ideaport
 
System Level Data and Technology Requirements of REV
System Level Data and Technology Requirements of REV System Level Data and Technology Requirements of REV
System Level Data and Technology Requirements of REV
Smarter Grid Solutions
 

Similar to Data Intensive Engineering (20)

DeployingAnAdvancedDistribution.pdf
DeployingAnAdvancedDistribution.pdfDeployingAnAdvancedDistribution.pdf
DeployingAnAdvancedDistribution.pdf
 
Research Methodology Presentation - Research in Supply Chain Digital Twins
Research Methodology Presentation - Research in Supply Chain Digital TwinsResearch Methodology Presentation - Research in Supply Chain Digital Twins
Research Methodology Presentation - Research in Supply Chain Digital Twins
 
Re-Engineering Engineering
Re-Engineering EngineeringRe-Engineering Engineering
Re-Engineering Engineering
 
Visualizing Your Network Health - Driving Visibility in Increasingly Complex...
Visualizing Your Network Health -  Driving Visibility in Increasingly Complex...Visualizing Your Network Health -  Driving Visibility in Increasingly Complex...
Visualizing Your Network Health - Driving Visibility in Increasingly Complex...
 
Network Centric Cloud: Competing in a IT World with a Telecom Approach
Network Centric Cloud: Competing in a IT World with a Telecom ApproachNetwork Centric Cloud: Competing in a IT World with a Telecom Approach
Network Centric Cloud: Competing in a IT World with a Telecom Approach
 
Barga ACM DEBS 2013 Keynote
Barga ACM DEBS 2013 KeynoteBarga ACM DEBS 2013 Keynote
Barga ACM DEBS 2013 Keynote
 
The New Role of Data in the Changing Energy & Utilities Landscape
The New Role of Data in the Changing Energy & Utilities LandscapeThe New Role of Data in the Changing Energy & Utilities Landscape
The New Role of Data in the Changing Energy & Utilities Landscape
 
Cloud Billing: Enabling consumers for pay for what they use
Cloud Billing: Enabling consumers for pay for what they useCloud Billing: Enabling consumers for pay for what they use
Cloud Billing: Enabling consumers for pay for what they use
 
Elastic Software Infrastructure to Support the Industrial Internet
Elastic Software Infrastructure to Support the Industrial InternetElastic Software Infrastructure to Support the Industrial Internet
Elastic Software Infrastructure to Support the Industrial Internet
 
Visualizing Your Network Health - Know your Network
Visualizing Your Network Health - Know your NetworkVisualizing Your Network Health - Know your Network
Visualizing Your Network Health - Know your Network
 
Cloud computing
Cloud computingCloud computing
Cloud computing
 
Data Con LA 2022 - Building Field-level Lineage from Scratch for Modern Data ...
Data Con LA 2022 - Building Field-level Lineage from Scratch for Modern Data ...Data Con LA 2022 - Building Field-level Lineage from Scratch for Modern Data ...
Data Con LA 2022 - Building Field-level Lineage from Scratch for Modern Data ...
 
Harnessing Big Data_UCLA
Harnessing Big Data_UCLAHarnessing Big Data_UCLA
Harnessing Big Data_UCLA
 
IRJET - A Research on Eloquent Salvation and Productive Outsourcing of Massiv...
IRJET - A Research on Eloquent Salvation and Productive Outsourcing of Massiv...IRJET - A Research on Eloquent Salvation and Productive Outsourcing of Massiv...
IRJET - A Research on Eloquent Salvation and Productive Outsourcing of Massiv...
 
AI4SE: Challenges and opportunities in the integration of Systems Engineering...
AI4SE: Challenges and opportunities in the integration of Systems Engineering...AI4SE: Challenges and opportunities in the integration of Systems Engineering...
AI4SE: Challenges and opportunities in the integration of Systems Engineering...
 
Models Done Better... - UDG2018 - Intertek and DHI
Models Done Better... - UDG2018 - Intertek and DHIModels Done Better... - UDG2018 - Intertek and DHI
Models Done Better... - UDG2018 - Intertek and DHI
 
Shikha fdp 62_14july2017
Shikha fdp 62_14july2017Shikha fdp 62_14july2017
Shikha fdp 62_14july2017
 
UK Data Centre Capabilty Presentation Rev.A
UK Data Centre Capabilty Presentation Rev.AUK Data Centre Capabilty Presentation Rev.A
UK Data Centre Capabilty Presentation Rev.A
 
Enerji Sektöründe Endüstriyel IoT Uygulamaları - Şahin Çağlayan (Reengen)
Enerji Sektöründe Endüstriyel IoT Uygulamaları - Şahin Çağlayan (Reengen)Enerji Sektöründe Endüstriyel IoT Uygulamaları - Şahin Çağlayan (Reengen)
Enerji Sektöründe Endüstriyel IoT Uygulamaları - Şahin Çağlayan (Reengen)
 
System Level Data and Technology Requirements of REV
System Level Data and Technology Requirements of REV System Level Data and Technology Requirements of REV
System Level Data and Technology Requirements of REV
 

Recently uploaded

Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
Jason Packer
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
Pixlogix Infotech
 
Recommendation System using RAG Architecture
Recommendation System using RAG ArchitectureRecommendation System using RAG Architecture
Recommendation System using RAG Architecture
fredae14
 
UI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentationUI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentation
Wouter Lemaire
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
ssuserfac0301
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
DanBrown980551
 
Skybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoptionSkybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoption
Tatiana Kojar
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
Edge AI and Vision Alliance
 
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracyGraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
Tomaz Bratanic
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
Zilliz
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
DianaGray10
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
Ivanti
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
Octavian Nadolu
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
Hiroshi SHIBATA
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
Zilliz
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Malak Abu Hammad
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
Matthew Sinclair
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
MichaelKnudsen27
 
Project Management Semester Long Project - Acuity
Project Management Semester Long Project - AcuityProject Management Semester Long Project - Acuity
Project Management Semester Long Project - Acuity
jpupo2018
 
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
saastr
 

Recently uploaded (20)

Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
 
Recommendation System using RAG Architecture
Recommendation System using RAG ArchitectureRecommendation System using RAG Architecture
Recommendation System using RAG Architecture
 
UI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentationUI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentation
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
 
Skybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoptionSkybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoption
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
 
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracyGraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
 
Project Management Semester Long Project - Acuity
Project Management Semester Long Project - AcuityProject Management Semester Long Project - Acuity
Project Management Semester Long Project - Acuity
 
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
 

Data Intensive Engineering

  • 1. Data Intensive Engineering Xosé Manuel Carreira Rodríguez http://www.linkedin.com/in/carreira 13th December 2012
  • 2. BRIEF • In this presentation the possible use of the big data technologies in the civil engineering is overviewed.
  • 3.
  • 4.
  • 5.
  • 6. “…probably indicates that these sectors face strong systemic barriers to increasing productivity”
  • 7. We collect enough data. We need to focus on 1- connecting 2 – identifying patterns 3- giving confidence level Multiple data sources: Books Experts in the field Information systems Tests and surveying Data repositories Real time sensors
  • 8. Data quality • Processing is cheap and access is easy, the big problem is data quality. • Considerable research but highly fragmented
  • 9. Classic definition of Data Quality • Accuracy – The data was recorded correctly. • Completeness – All relevant data was recorded. • Uniqueness – Entities are recorded once. • Timeliness – The data is kept up to date. • Special problems in federated data: time consistency. • Consistency – The data agrees with itself.
  • 10. Finding a modern definition • Data quality must – Reflect the use of the data – Lead to improvements in processes – Be measurable • No silver bullets: Use several data quality metrics.
  • 11. What is the problem to solve? • Do you have a bunch of data and want to: – Estimate an unknown parameter from it? • True rainfall based on radar observations? • Amount of liquid content from in-situ measurements of temperature, pressure, etc? • Regression – Classify what the data correspond to? • A water surge? • A temperature inversion? • A boundary? • Classification • Regression and classification aren’t that different 11
  • 12. Case 1: Neural networks for flood • Neural networks modelling of the rainfall-runoff relationship • No physical model, just data driven model. • Result: flow forecasting
  • 13. Case 1: Neural networks for flood • Input: several past rain gauges and flow gauges • Result: Flow model
  • 14. Case 1: Neural networks for flood Training with 1st (larger) set of data
  • 15. Case 1: Neural networks for flood Verification with 2nd (smaller) set of data
  • 17. How can IT help in maintenance ? • Information Technology has also found applications in post commission period of the project. • IT can provide easy access to various statistics, drawing & various other data concerning the project. • Self check tools can identify the problems in various systems like fire fighting, air conditioning & can automatically inform concerned service provider. • IT can also help in prompt reporting of problem & its rectification.
  • 18. Case 2: Bridge Management Systems • Double click on the icon on your desktop – Introductory screen is displayed – Click OK button to continue to the Data collection form Page 18
  • 19. Connecting Bridge Management Systems to Asset Management U.S. Department of Transportation Federal Highway Administration
  • 20. Bridges in the U.S. 25% are structurally or functionally deficient according to ASCE 140000 120000 100000 80000 60000 40000 20000 0 Pre-1909 10s 20s 30s 40s 50s 60s 70s 80s 90s Bridge Construction by Decade
  • 21. Case 2: Bridge Management Systems Typical BMS Expectations A tool to evaluate: • Bridge condition and serviceability • Implications of project decisions • Priorities and schedules • Expected budget • Cost of alternative standards • Value of preventive maintenance
  • 22. You can run a company from a coffee shop
  • 23. Why not a lab or a civil infraestructure?
  • 24. Desktop PCs are idle half the day Desktop PCs tend to be active But at night, during most of during the workday. the year, they’re idle. So we’re only getting half their value (or less). 24
  • 25. Finally , it is argued that IT can readily be used by civil engineers given the low capital investment levels required. The “only” requirement is investment in education among the civil engineers & recognition of the enormous potential lying beneath.