SlideShare a Scribd company logo
1 of 13
Download to read offline
Overview of DuraMat software tool development
Anubhav Jain
Lawrence Berkeley National Laboratory
w/contributions from:
Todd Karin (LBL), Xin Chen (LBL), Thushara Gunda (Sandia), Cliff Hansen (Sandia), Bennet
Meyers (Stanford), Brittany Smith (NREL) and their respective teams
Why a talk on software development?
• The “end product” of most conventional
funded research is a paper or report
– This is typically how projects are evaluated
• However, software can also be an
invaluable end product!
– Sometimes, more valuable than text
• Data can also be an end product!
– See poster on DuraMat Data Hub by R. White.
2
Given a data set, up to 10 analysts were asked to
calculate the degradation rate of 5 PV systems using
either (i) any approach they wanted, (ii) a documented
standard, or (iii) a documented codebase (RdTools).
Consistent results came only with the codebase,
highlighting the role software can play in
reproducibility and reusability.
Jordan, D. C., Luo, W., Jain, A., Saleh, M. U., von Korff, H., Hu, Y.,
Jaubert, J.-N., Mavromatakis, F., Deline, C., Deceglie, M. G., Nag, A.,
Kimball, G. M., Shinn, A. B., John, J. J., Alnuaimi, A. A. & Elnosh, A. B.
A. Reducing Interanalyst Variability in Photovoltaic Degradation
Rate Assessments. IEEE J. Photovoltaics 10, 206–212 (2020).
DuraMat-funded projects are developing software
to solve a spectrum of PV problems
3
Core functions common
to many PV analyses
Operation and
degradation in the field
Planning and
reduction of LCOE
pvanalytics
pv-pro data preprocessor
pv-pro
pvOps
pvARC
pv-vision
simple LCOE calculator
vocmax
DuraMat software projects share some DNA
• Open-source licenses
– Typically MIT / BSD which are commercial-friendly
• All based on Python / pydata stack for interoperability
– not mixing MATLAB, Python, Java, Excel macros, etc.
• Make use of large data sets and machine learning / statistical learning
– e.g., neural networks for vision, natural language processing for text
• Collaborative and sustainable development via the Github platform
– i.e., NOT a single developer sending around “script_v34” by email
• More integration forthcoming
– e.g., https://duramat.github.io/pv-terms/ to unify common variable names
4
pvlib/pvanalytics / Cliff Hansen, Will Vining, Matt Muller
5
• python library for automating analysis of data from PV systems
• Workflow independent, built up from base functions
• v0.1 released 20 November github.com/pvlib/pvanalytics
• Fully compatible with pvlib/pvlib-python for PV system modeling
Quality control functions
• Plausibility of irradiance and weather measurements
• Identification of missing, interpolated, or stale data
• outlier detection
• Identification of timestamp problems such as daylight
savings shifts
Feature identification functions
• inverter clipping
• clear-sky periods
• day/night detection from power or irradiance
Identification of system properties
• tilt and azimuth from power data
• differentiation between fixed and tracking PV systems
Metrics
• NREL weather corrected performance ratio
v0.1 Content
Core
PV-Pro Data Preprocessor /
Bennet Meyers, Todd Karin
6
PV-Pro can be found at: https://github.com/DuraMAT/pvpro
• 0: System at maximum power point.
• 1: System at open circuit conditions.
• 2: Clipped or curtailed.
• -1: No power/inverter off
• -2: Other (errors, corrupted data)
def run_preprocess(self,
correct_tz=True,
data_sampling=None,
correct_dst=False,
fix_shifts=True,
max_val=None):
Core
PVPRO/ Todd Karin, Anubhav Jain, Bruce King, Michael Deceglie,
Bennet Meyers, Dirk Jordan, Cliff Hanen, Laura Schelhas
7
PVPRO be found at: https://github.com/DuraMAT/pvpro
• Use operation data (DC current, DC voltage, module temperature and plane-of-
array irradiance) to determine module single diode model parameters vs. time.
PRODUCTION DATA
Time series
database
PVPRO
• Filter power data
• Meteorological data
• Circuit model
• Parameter estimation
• Uncertainty analysis
I-V Parameters
Rseries, Voc, Isc, Bvoc, …
Degradation Mode Estimates
Soiling, PID, Encpasulant
discoloration, solder bond failure
Output
BIG data analysis
Application
Technology
Degradation
mode
Solder bond damage detected
Methods
Actionable analytics
More accurate
power
predictions
Operation &
Degradation
pvOps / Thushara Gunda, Michael Hopwood, Hector Mendoza
8
pvOps is currently underdoing review and will be published on GitHub as part of pvlib in April 2021
Module 1: Text
• Date Extraction
• Consistent Labels
• Issue Summary
Module 2: Text2Time
• Date Alignments
• Quantify Impact
• Visualizations
{
“Date_EventStart”: XXX
“Date_EventEnd”:XXX
“Asset”:XXX
“ProductionImpact”:XXX
“Response”:XXX
“IssueDescription”:XXX
}
• Although text-based records can contain valuable contextual information to support data processing and site
assessment activities, significant diversity in these records makes it challenging to ascertain needed insights.
• The pvOps package contains two modules to support: 1) processing of text data and 2) fuse text with timeseries data
• Similar to other pvlib packages, pvOps is written as a series of individual functions that could be integrated using class
wrappers to support individual workflows
Operation &
Degradation
PVARC/ Todd Karin, David Miller, Anubhav Jain
9
PVARC be found at: https://github.com/DuraMAT/pvarc
• Extract coating parameters from spectral reflectance
data using thin-film interferometry model
“Non-destructive Characterization of Anti-reflection
Coatings on PV Modules” Posted arXiv:2101.05446. (in-
press at JPV).
Spectral Reflectance Measurement of PV
module glass
Quantify anti reflection properties
Operation &
Degradation
PV-vision/ Xin Chen, Todd Karin, Anubhav Jain
10
PV-vision be found at: https://github.com/hackingmaterials/pv-vision
Solar Cell Crack Detection Algorithm & Data Analytics Automatic Classification of Fire damaged Solar Modules
• Goal: automatically extract features of cracks on solar modules and
quantify the relationship between features and module power loss
• Tool developed for cropping out single cells from solar modules
with accuracy of 90%
• Goal: automatically classify the solar modules based on the
categories of defects which are induced by conflagration
• New tool assisted with CNN developed to do perspective
transform and cell cropping. Accuracy improved and will be
applied to all dataset
crop
• UNet model trained to segment the cracks with overall F1 metric of 0.89
• Initial tool developed to calculate crack features (length, orientation, etc.)
Fig.4 Left: original image. Right: predicted masks.
F1 metric=0.882
vectorized
Fig.5 Left: crack vectors. Middle: poly-fitted
cracks. Right: filter short cracks(length<30)
UNet
Fig.1 Solar module
Fig.2 Cropped solar cells
Fig.3 Masks predicted by UNet model. Left:
original image. Right: masks are highlighted in
different colors. Purple (crack), Green (power
loss area), brown (busbar). F1 metric=0.862
Fig.6 Original, perspective- transformed solar module and cropped cells
transform
(CNN assisted) crop
• Yolo model trained to detect defective cells in the solar
modules
• Solar modules classified based on the number of different
defective cells with accuracy of 98%
Fig.7 Defective cells detected by Yolo model.
Green: crack defect. Blue: Solder defect. Red:
Oxygen induced defect. Purple: Intra-cell defect.
Classification criterion
If no defective cell or ‘crack’ <= 1:
Category 1
If ‘crack’ >= 2 or ‘oxygen’ >= 1:
Category 2
If ‘intra’ >= 1:
Category 3
Operation &
Degradation
Simplified PV LCOE Calculator* / Brittany Smith (NREL)
11
The simplified PV LCOE calculator can be found at: www.github.com/NREL/PVLCOE
Currently, the calculator offers only two default degradation
rates (based on cell technology selection) and assumes
module degradation approximates system-level degradation.
DuraMAT analysis of PV Fleets data will provide updated
system-level degradation rates and could potentially populate
different default degradation rate values for:
• Cell technology
• Package type
• System type
• Install location
The calculator lets you select
from a set of system options:
Default values
pre-populate
based on selections
Results include LCOE,
module price, system cost
*calculator was originally developed outside of DuraMAT
Planning
& LCOE
Vocmax – a string length calculator for reducing LCOE /
Todd Karin, Anubhav Jain
12
Conventional string length calculations are unnecessarily
conservative
• Most common practice is to use minimum historical ambient temperature
and 1000 W/m2 for calculating maximum string Voc, but these conditions
do not co-occur in practice.
• Longer strings lower system costs – get more power through the same
wires.
Need a more realistic method for calculating string length
• We developed and validated a method for calculating the string length by
modeling the system VOC over time at the location of interest.
• Method is consistent with NEC 690.7(A)(3) standard.
Impact
• In the US, string lengths increased by 10% on average using site—specific
modeling, leading to a 1.2% reduction in LCOE !
https://github.com/toddkarin/vocmax
https://pvtools.lbl.gov/string-length-calculator
https://ieeexplore.ieee.org/document/9000497
Approach: model the distribution of operating and
open-circuit voltage over time to determine threshold
Planning
& LCOE
Conclusions
• In addition to papers and reports, software and data represent important
outputs for research
• DuraMat has a diverse portfolio of software development projects across
the chain of PV operation
• The software is available open-source and is the product of collaborative
development
• We would be very happy to hear from you!
13

More Related Content

What's hot

Conducting and Enabling Data-Driven Research Through the Materials Project
Conducting and Enabling Data-Driven Research Through the Materials ProjectConducting and Enabling Data-Driven Research Through the Materials Project
Conducting and Enabling Data-Driven Research Through the Materials ProjectAnubhav Jain
 
DuraMat Data Analytics
DuraMat Data AnalyticsDuraMat Data Analytics
DuraMat Data AnalyticsAnubhav Jain
 
Accelerated Materials Discovery Using Theory, Optimization, and Natural Langu...
Accelerated Materials Discovery Using Theory, Optimization, and Natural Langu...Accelerated Materials Discovery Using Theory, Optimization, and Natural Langu...
Accelerated Materials Discovery Using Theory, Optimization, and Natural Langu...Anubhav Jain
 
Open Source Tools for Materials Informatics
Open Source Tools for Materials InformaticsOpen Source Tools for Materials Informatics
Open Source Tools for Materials InformaticsAnubhav Jain
 
Evaluating Machine Learning Algorithms for Materials Science using the Matben...
Evaluating Machine Learning Algorithms for Materials Science using the Matben...Evaluating Machine Learning Algorithms for Materials Science using the Matben...
Evaluating Machine Learning Algorithms for Materials Science using the Matben...Anubhav Jain
 
Data dissemination and materials informatics at LBNL
Data dissemination and materials informatics at LBNLData dissemination and materials informatics at LBNL
Data dissemination and materials informatics at LBNLAnubhav Jain
 
Software tools for calculating materials properties in high-throughput (pymat...
Software tools for calculating materials properties in high-throughput (pymat...Software tools for calculating materials properties in high-throughput (pymat...
Software tools for calculating materials properties in high-throughput (pymat...Anubhav Jain
 
Software Tools, Methods and Applications of Machine Learning in Functional Ma...
Software Tools, Methods and Applications of Machine Learning in Functional Ma...Software Tools, Methods and Applications of Machine Learning in Functional Ma...
Software Tools, Methods and Applications of Machine Learning in Functional Ma...Anubhav Jain
 
Materials Informatics Overview
Materials Informatics OverviewMaterials Informatics Overview
Materials Informatics OverviewTony Fast
 
Software tools, crystal descriptors, and machine learning applied to material...
Software tools, crystal descriptors, and machine learning applied to material...Software tools, crystal descriptors, and machine learning applied to material...
Software tools, crystal descriptors, and machine learning applied to material...Anubhav Jain
 
The Status of ML Algorithms for Structure-property Relationships Using Matb...
The Status of ML Algorithms for Structure-property Relationships Using Matb...The Status of ML Algorithms for Structure-property Relationships Using Matb...
The Status of ML Algorithms for Structure-property Relationships Using Matb...Anubhav Jain
 
Computational materials design with high-throughput and machine learning methods
Computational materials design with high-throughput and machine learning methodsComputational materials design with high-throughput and machine learning methods
Computational materials design with high-throughput and machine learning methodsAnubhav Jain
 
Going Smart and Deep on Materials at ALCF
Going Smart and Deep on Materials at ALCFGoing Smart and Deep on Materials at ALCF
Going Smart and Deep on Materials at ALCFIan Foster
 
Computational Materials Design and Data Dissemination through the Materials P...
Computational Materials Design and Data Dissemination through the Materials P...Computational Materials Design and Data Dissemination through the Materials P...
Computational Materials Design and Data Dissemination through the Materials P...Anubhav Jain
 
Capturing and leveraging materials science knowledge from millions of journal...
Capturing and leveraging materials science knowledge from millions of journal...Capturing and leveraging materials science knowledge from millions of journal...
Capturing and leveraging materials science knowledge from millions of journal...Anubhav Jain
 
Density functional theory calculations and data mining for new thermoelectric...
Density functional theory calculations and data mining for new thermoelectric...Density functional theory calculations and data mining for new thermoelectric...
Density functional theory calculations and data mining for new thermoelectric...Anubhav Jain
 
TMS workshop on machine learning in materials science: Intro to deep learning...
TMS workshop on machine learning in materials science: Intro to deep learning...TMS workshop on machine learning in materials science: Intro to deep learning...
TMS workshop on machine learning in materials science: Intro to deep learning...BrianDeCost
 
Software tools for data-driven research and their application to thermoelectr...
Software tools for data-driven research and their application to thermoelectr...Software tools for data-driven research and their application to thermoelectr...
Software tools for data-driven research and their application to thermoelectr...Anubhav Jain
 
Materials Project computation and database infrastructure
Materials Project computation and database infrastructureMaterials Project computation and database infrastructure
Materials Project computation and database infrastructureAnubhav Jain
 
Software tools, crystal descriptors, and machine learning applied to material...
Software tools, crystal descriptors, and machine learning applied to material...Software tools, crystal descriptors, and machine learning applied to material...
Software tools, crystal descriptors, and machine learning applied to material...Anubhav Jain
 

What's hot (20)

Conducting and Enabling Data-Driven Research Through the Materials Project
Conducting and Enabling Data-Driven Research Through the Materials ProjectConducting and Enabling Data-Driven Research Through the Materials Project
Conducting and Enabling Data-Driven Research Through the Materials Project
 
DuraMat Data Analytics
DuraMat Data AnalyticsDuraMat Data Analytics
DuraMat Data Analytics
 
Accelerated Materials Discovery Using Theory, Optimization, and Natural Langu...
Accelerated Materials Discovery Using Theory, Optimization, and Natural Langu...Accelerated Materials Discovery Using Theory, Optimization, and Natural Langu...
Accelerated Materials Discovery Using Theory, Optimization, and Natural Langu...
 
Open Source Tools for Materials Informatics
Open Source Tools for Materials InformaticsOpen Source Tools for Materials Informatics
Open Source Tools for Materials Informatics
 
Evaluating Machine Learning Algorithms for Materials Science using the Matben...
Evaluating Machine Learning Algorithms for Materials Science using the Matben...Evaluating Machine Learning Algorithms for Materials Science using the Matben...
Evaluating Machine Learning Algorithms for Materials Science using the Matben...
 
Data dissemination and materials informatics at LBNL
Data dissemination and materials informatics at LBNLData dissemination and materials informatics at LBNL
Data dissemination and materials informatics at LBNL
 
Software tools for calculating materials properties in high-throughput (pymat...
Software tools for calculating materials properties in high-throughput (pymat...Software tools for calculating materials properties in high-throughput (pymat...
Software tools for calculating materials properties in high-throughput (pymat...
 
Software Tools, Methods and Applications of Machine Learning in Functional Ma...
Software Tools, Methods and Applications of Machine Learning in Functional Ma...Software Tools, Methods and Applications of Machine Learning in Functional Ma...
Software Tools, Methods and Applications of Machine Learning in Functional Ma...
 
Materials Informatics Overview
Materials Informatics OverviewMaterials Informatics Overview
Materials Informatics Overview
 
Software tools, crystal descriptors, and machine learning applied to material...
Software tools, crystal descriptors, and machine learning applied to material...Software tools, crystal descriptors, and machine learning applied to material...
Software tools, crystal descriptors, and machine learning applied to material...
 
The Status of ML Algorithms for Structure-property Relationships Using Matb...
The Status of ML Algorithms for Structure-property Relationships Using Matb...The Status of ML Algorithms for Structure-property Relationships Using Matb...
The Status of ML Algorithms for Structure-property Relationships Using Matb...
 
Computational materials design with high-throughput and machine learning methods
Computational materials design with high-throughput and machine learning methodsComputational materials design with high-throughput and machine learning methods
Computational materials design with high-throughput and machine learning methods
 
Going Smart and Deep on Materials at ALCF
Going Smart and Deep on Materials at ALCFGoing Smart and Deep on Materials at ALCF
Going Smart and Deep on Materials at ALCF
 
Computational Materials Design and Data Dissemination through the Materials P...
Computational Materials Design and Data Dissemination through the Materials P...Computational Materials Design and Data Dissemination through the Materials P...
Computational Materials Design and Data Dissemination through the Materials P...
 
Capturing and leveraging materials science knowledge from millions of journal...
Capturing and leveraging materials science knowledge from millions of journal...Capturing and leveraging materials science knowledge from millions of journal...
Capturing and leveraging materials science knowledge from millions of journal...
 
Density functional theory calculations and data mining for new thermoelectric...
Density functional theory calculations and data mining for new thermoelectric...Density functional theory calculations and data mining for new thermoelectric...
Density functional theory calculations and data mining for new thermoelectric...
 
TMS workshop on machine learning in materials science: Intro to deep learning...
TMS workshop on machine learning in materials science: Intro to deep learning...TMS workshop on machine learning in materials science: Intro to deep learning...
TMS workshop on machine learning in materials science: Intro to deep learning...
 
Software tools for data-driven research and their application to thermoelectr...
Software tools for data-driven research and their application to thermoelectr...Software tools for data-driven research and their application to thermoelectr...
Software tools for data-driven research and their application to thermoelectr...
 
Materials Project computation and database infrastructure
Materials Project computation and database infrastructureMaterials Project computation and database infrastructure
Materials Project computation and database infrastructure
 
Software tools, crystal descriptors, and machine learning applied to material...
Software tools, crystal descriptors, and machine learning applied to material...Software tools, crystal descriptors, and machine learning applied to material...
Software tools, crystal descriptors, and machine learning applied to material...
 

Similar to Overview of DuraMat software tool development

DuraMat CO1 Central Data Resource: How it started, how it’s going …
DuraMat CO1 Central Data Resource: How it started, how it’s going …DuraMat CO1 Central Data Resource: How it started, how it’s going …
DuraMat CO1 Central Data Resource: How it started, how it’s going …Anubhav Jain
 
Model-Simulation-and-Measurement-Based Systems Engineering of Power System Sy...
Model-Simulation-and-Measurement-Based Systems Engineering of Power System Sy...Model-Simulation-and-Measurement-Based Systems Engineering of Power System Sy...
Model-Simulation-and-Measurement-Based Systems Engineering of Power System Sy...Luigi Vanfretti
 
Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016
Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016
Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016Grid Protection Alliance
 
Activity Monitoring Using Wearable Sensors and Smart Phone
Activity Monitoring Using Wearable Sensors and Smart PhoneActivity Monitoring Using Wearable Sensors and Smart Phone
Activity Monitoring Using Wearable Sensors and Smart PhoneDrAhmedZoha
 
Advanced Automated Analytics Using OSS Tools
Advanced Automated Analytics Using OSS ToolsAdvanced Automated Analytics Using OSS Tools
Advanced Automated Analytics Using OSS ToolsGrid Protection Alliance
 
Advanced Automated Analytics Using OSS Tools
Advanced Automated Analytics Using OSS ToolsAdvanced Automated Analytics Using OSS Tools
Advanced Automated Analytics Using OSS ToolsGrid Protection Alliance
 
How HPC and large-scale data analytics are transforming experimental science
How HPC and large-scale data analytics are transforming experimental scienceHow HPC and large-scale data analytics are transforming experimental science
How HPC and large-scale data analytics are transforming experimental scienceinside-BigData.com
 
Machine Learning & Predictive Maintenance
Machine Learning &  Predictive MaintenanceMachine Learning &  Predictive Maintenance
Machine Learning & Predictive MaintenanceArnab Biswas
 
Scalable Similarity-Based Neighborhood Methods with MapReduce
Scalable Similarity-Based Neighborhood Methods with MapReduceScalable Similarity-Based Neighborhood Methods with MapReduce
Scalable Similarity-Based Neighborhood Methods with MapReducesscdotopen
 
Machine Learning Algorithms for Anomaly Detection in Particles Accelerators T...
Machine Learning Algorithms for Anomaly Detection in Particles Accelerators T...Machine Learning Algorithms for Anomaly Detection in Particles Accelerators T...
Machine Learning Algorithms for Anomaly Detection in Particles Accelerators T...Deep Learning Italia
 
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...Spark Summit
 
CloudLightning and the OPM-based Use Case
CloudLightning and the OPM-based Use CaseCloudLightning and the OPM-based Use Case
CloudLightning and the OPM-based Use CaseCloudLightning
 
Table of Contents
Table of ContentsTable of Contents
Table of Contentsbutest
 
Assessing Factors Underpinning PV Degradation through Data Analysis
Assessing Factors Underpinning PV Degradation through Data AnalysisAssessing Factors Underpinning PV Degradation through Data Analysis
Assessing Factors Underpinning PV Degradation through Data AnalysisAnubhav Jain
 
DATI, AI E ROBOTICA @POLITO
DATI, AI E ROBOTICA @POLITODATI, AI E ROBOTICA @POLITO
DATI, AI E ROBOTICA @POLITOMarcoMellia
 
Aplications for machine learning in IoT
Aplications for machine learning in IoTAplications for machine learning in IoT
Aplications for machine learning in IoTYashesh Shroff
 
Quantum Computing: Timing is Everything
Quantum Computing: Timing is EverythingQuantum Computing: Timing is Everything
Quantum Computing: Timing is Everythinginside-BigData.com
 
Application of machine learning and cognitive computing in intrusion detectio...
Application of machine learning and cognitive computing in intrusion detectio...Application of machine learning and cognitive computing in intrusion detectio...
Application of machine learning and cognitive computing in intrusion detectio...Mahdi Hosseini Moghaddam
 

Similar to Overview of DuraMat software tool development (20)

DuraMat CO1 Central Data Resource: How it started, how it’s going …
DuraMat CO1 Central Data Resource: How it started, how it’s going …DuraMat CO1 Central Data Resource: How it started, how it’s going …
DuraMat CO1 Central Data Resource: How it started, how it’s going …
 
Model-Simulation-and-Measurement-Based Systems Engineering of Power System Sy...
Model-Simulation-and-Measurement-Based Systems Engineering of Power System Sy...Model-Simulation-and-Measurement-Based Systems Engineering of Power System Sy...
Model-Simulation-and-Measurement-Based Systems Engineering of Power System Sy...
 
Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016
Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016
Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016
 
Activity Monitoring Using Wearable Sensors and Smart Phone
Activity Monitoring Using Wearable Sensors and Smart PhoneActivity Monitoring Using Wearable Sensors and Smart Phone
Activity Monitoring Using Wearable Sensors and Smart Phone
 
Advanced Automated Analytics Using OSS Tools
Advanced Automated Analytics Using OSS ToolsAdvanced Automated Analytics Using OSS Tools
Advanced Automated Analytics Using OSS Tools
 
Advanced Automated Analytics Using OSS Tools
Advanced Automated Analytics Using OSS ToolsAdvanced Automated Analytics Using OSS Tools
Advanced Automated Analytics Using OSS Tools
 
How HPC and large-scale data analytics are transforming experimental science
How HPC and large-scale data analytics are transforming experimental scienceHow HPC and large-scale data analytics are transforming experimental science
How HPC and large-scale data analytics are transforming experimental science
 
Machine Learning & Predictive Maintenance
Machine Learning &  Predictive MaintenanceMachine Learning &  Predictive Maintenance
Machine Learning & Predictive Maintenance
 
Scalable Similarity-Based Neighborhood Methods with MapReduce
Scalable Similarity-Based Neighborhood Methods with MapReduceScalable Similarity-Based Neighborhood Methods with MapReduce
Scalable Similarity-Based Neighborhood Methods with MapReduce
 
Recent and Planned Improvements to the System Advisor Model
Recent and Planned Improvements to the System Advisor ModelRecent and Planned Improvements to the System Advisor Model
Recent and Planned Improvements to the System Advisor Model
 
Machine Learning Algorithms for Anomaly Detection in Particles Accelerators T...
Machine Learning Algorithms for Anomaly Detection in Particles Accelerators T...Machine Learning Algorithms for Anomaly Detection in Particles Accelerators T...
Machine Learning Algorithms for Anomaly Detection in Particles Accelerators T...
 
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...
 
rerngvit_phd_seminar
rerngvit_phd_seminarrerngvit_phd_seminar
rerngvit_phd_seminar
 
CloudLightning and the OPM-based Use Case
CloudLightning and the OPM-based Use CaseCloudLightning and the OPM-based Use Case
CloudLightning and the OPM-based Use Case
 
Table of Contents
Table of ContentsTable of Contents
Table of Contents
 
Assessing Factors Underpinning PV Degradation through Data Analysis
Assessing Factors Underpinning PV Degradation through Data AnalysisAssessing Factors Underpinning PV Degradation through Data Analysis
Assessing Factors Underpinning PV Degradation through Data Analysis
 
DATI, AI E ROBOTICA @POLITO
DATI, AI E ROBOTICA @POLITODATI, AI E ROBOTICA @POLITO
DATI, AI E ROBOTICA @POLITO
 
Aplications for machine learning in IoT
Aplications for machine learning in IoTAplications for machine learning in IoT
Aplications for machine learning in IoT
 
Quantum Computing: Timing is Everything
Quantum Computing: Timing is EverythingQuantum Computing: Timing is Everything
Quantum Computing: Timing is Everything
 
Application of machine learning and cognitive computing in intrusion detectio...
Application of machine learning and cognitive computing in intrusion detectio...Application of machine learning and cognitive computing in intrusion detectio...
Application of machine learning and cognitive computing in intrusion detectio...
 

More from Anubhav Jain

Discovering advanced materials for energy applications: theory, high-throughp...
Discovering advanced materials for energy applications: theory, high-throughp...Discovering advanced materials for energy applications: theory, high-throughp...
Discovering advanced materials for energy applications: theory, high-throughp...Anubhav Jain
 
Applications of Large Language Models in Materials Discovery and Design
Applications of Large Language Models in Materials Discovery and DesignApplications of Large Language Models in Materials Discovery and Design
Applications of Large Language Models in Materials Discovery and DesignAnubhav Jain
 
An AI-driven closed-loop facility for materials synthesis
An AI-driven closed-loop facility for materials synthesisAn AI-driven closed-loop facility for materials synthesis
An AI-driven closed-loop facility for materials synthesisAnubhav Jain
 
Best practices for DuraMat software dissemination
Best practices for DuraMat software disseminationBest practices for DuraMat software dissemination
Best practices for DuraMat software disseminationAnubhav Jain
 
Best practices for DuraMat software dissemination
Best practices for DuraMat software disseminationBest practices for DuraMat software dissemination
Best practices for DuraMat software disseminationAnubhav Jain
 
Available methods for predicting materials synthesizability using computation...
Available methods for predicting materials synthesizability using computation...Available methods for predicting materials synthesizability using computation...
Available methods for predicting materials synthesizability using computation...Anubhav Jain
 
Efficient methods for accurately calculating thermoelectric properties – elec...
Efficient methods for accurately calculating thermoelectric properties – elec...Efficient methods for accurately calculating thermoelectric properties – elec...
Efficient methods for accurately calculating thermoelectric properties – elec...Anubhav Jain
 
Natural Language Processing for Data Extraction and Synthesizability Predicti...
Natural Language Processing for Data Extraction and Synthesizability Predicti...Natural Language Processing for Data Extraction and Synthesizability Predicti...
Natural Language Processing for Data Extraction and Synthesizability Predicti...Anubhav Jain
 
Machine Learning for Catalyst Design
Machine Learning for Catalyst DesignMachine Learning for Catalyst Design
Machine Learning for Catalyst DesignAnubhav Jain
 
Discovering new functional materials for clean energy and beyond using high-t...
Discovering new functional materials for clean energy and beyond using high-t...Discovering new functional materials for clean energy and beyond using high-t...
Discovering new functional materials for clean energy and beyond using high-t...Anubhav Jain
 
Natural language processing for extracting synthesis recipes and applications...
Natural language processing for extracting synthesis recipes and applications...Natural language processing for extracting synthesis recipes and applications...
Natural language processing for extracting synthesis recipes and applications...Anubhav Jain
 
Accelerating New Materials Design with Supercomputing and Machine Learning
Accelerating New Materials Design with Supercomputing and Machine LearningAccelerating New Materials Design with Supercomputing and Machine Learning
Accelerating New Materials Design with Supercomputing and Machine LearningAnubhav Jain
 
The Materials Project
The Materials ProjectThe Materials Project
The Materials ProjectAnubhav Jain
 
Evaluating Chemical Composition and Crystal Structure Representations using t...
Evaluating Chemical Composition and Crystal Structure Representations using t...Evaluating Chemical Composition and Crystal Structure Representations using t...
Evaluating Chemical Composition and Crystal Structure Representations using t...Anubhav Jain
 
Perspectives on chemical composition and crystal structure representations fr...
Perspectives on chemical composition and crystal structure representations fr...Perspectives on chemical composition and crystal structure representations fr...
Perspectives on chemical composition and crystal structure representations fr...Anubhav Jain
 
Discovering and Exploring New Materials through the Materials Project
Discovering and Exploring New Materials through the Materials ProjectDiscovering and Exploring New Materials through the Materials Project
Discovering and Exploring New Materials through the Materials ProjectAnubhav Jain
 
The Materials Project: Applications to energy storage and functional materia...
The Materials Project: Applications to energy storage and functional materia...The Materials Project: Applications to energy storage and functional materia...
The Materials Project: Applications to energy storage and functional materia...Anubhav Jain
 
The Materials Project: A Community Data Resource for Accelerating New Materia...
The Materials Project: A Community Data Resource for Accelerating New Materia...The Materials Project: A Community Data Resource for Accelerating New Materia...
The Materials Project: A Community Data Resource for Accelerating New Materia...Anubhav Jain
 
Machine Learning Platform for Catalyst Design
Machine Learning Platform for Catalyst DesignMachine Learning Platform for Catalyst Design
Machine Learning Platform for Catalyst DesignAnubhav Jain
 
Applications of Natural Language Processing to Materials Design
Applications of Natural Language Processing to Materials DesignApplications of Natural Language Processing to Materials Design
Applications of Natural Language Processing to Materials DesignAnubhav Jain
 

More from Anubhav Jain (20)

Discovering advanced materials for energy applications: theory, high-throughp...
Discovering advanced materials for energy applications: theory, high-throughp...Discovering advanced materials for energy applications: theory, high-throughp...
Discovering advanced materials for energy applications: theory, high-throughp...
 
Applications of Large Language Models in Materials Discovery and Design
Applications of Large Language Models in Materials Discovery and DesignApplications of Large Language Models in Materials Discovery and Design
Applications of Large Language Models in Materials Discovery and Design
 
An AI-driven closed-loop facility for materials synthesis
An AI-driven closed-loop facility for materials synthesisAn AI-driven closed-loop facility for materials synthesis
An AI-driven closed-loop facility for materials synthesis
 
Best practices for DuraMat software dissemination
Best practices for DuraMat software disseminationBest practices for DuraMat software dissemination
Best practices for DuraMat software dissemination
 
Best practices for DuraMat software dissemination
Best practices for DuraMat software disseminationBest practices for DuraMat software dissemination
Best practices for DuraMat software dissemination
 
Available methods for predicting materials synthesizability using computation...
Available methods for predicting materials synthesizability using computation...Available methods for predicting materials synthesizability using computation...
Available methods for predicting materials synthesizability using computation...
 
Efficient methods for accurately calculating thermoelectric properties – elec...
Efficient methods for accurately calculating thermoelectric properties – elec...Efficient methods for accurately calculating thermoelectric properties – elec...
Efficient methods for accurately calculating thermoelectric properties – elec...
 
Natural Language Processing for Data Extraction and Synthesizability Predicti...
Natural Language Processing for Data Extraction and Synthesizability Predicti...Natural Language Processing for Data Extraction and Synthesizability Predicti...
Natural Language Processing for Data Extraction and Synthesizability Predicti...
 
Machine Learning for Catalyst Design
Machine Learning for Catalyst DesignMachine Learning for Catalyst Design
Machine Learning for Catalyst Design
 
Discovering new functional materials for clean energy and beyond using high-t...
Discovering new functional materials for clean energy and beyond using high-t...Discovering new functional materials for clean energy and beyond using high-t...
Discovering new functional materials for clean energy and beyond using high-t...
 
Natural language processing for extracting synthesis recipes and applications...
Natural language processing for extracting synthesis recipes and applications...Natural language processing for extracting synthesis recipes and applications...
Natural language processing for extracting synthesis recipes and applications...
 
Accelerating New Materials Design with Supercomputing and Machine Learning
Accelerating New Materials Design with Supercomputing and Machine LearningAccelerating New Materials Design with Supercomputing and Machine Learning
Accelerating New Materials Design with Supercomputing and Machine Learning
 
The Materials Project
The Materials ProjectThe Materials Project
The Materials Project
 
Evaluating Chemical Composition and Crystal Structure Representations using t...
Evaluating Chemical Composition and Crystal Structure Representations using t...Evaluating Chemical Composition and Crystal Structure Representations using t...
Evaluating Chemical Composition and Crystal Structure Representations using t...
 
Perspectives on chemical composition and crystal structure representations fr...
Perspectives on chemical composition and crystal structure representations fr...Perspectives on chemical composition and crystal structure representations fr...
Perspectives on chemical composition and crystal structure representations fr...
 
Discovering and Exploring New Materials through the Materials Project
Discovering and Exploring New Materials through the Materials ProjectDiscovering and Exploring New Materials through the Materials Project
Discovering and Exploring New Materials through the Materials Project
 
The Materials Project: Applications to energy storage and functional materia...
The Materials Project: Applications to energy storage and functional materia...The Materials Project: Applications to energy storage and functional materia...
The Materials Project: Applications to energy storage and functional materia...
 
The Materials Project: A Community Data Resource for Accelerating New Materia...
The Materials Project: A Community Data Resource for Accelerating New Materia...The Materials Project: A Community Data Resource for Accelerating New Materia...
The Materials Project: A Community Data Resource for Accelerating New Materia...
 
Machine Learning Platform for Catalyst Design
Machine Learning Platform for Catalyst DesignMachine Learning Platform for Catalyst Design
Machine Learning Platform for Catalyst Design
 
Applications of Natural Language Processing to Materials Design
Applications of Natural Language Processing to Materials DesignApplications of Natural Language Processing to Materials Design
Applications of Natural Language Processing to Materials Design
 

Recently uploaded

Analytical Profile of Coleus Forskohlii | Forskolin .pdf
Analytical Profile of Coleus Forskohlii | Forskolin .pdfAnalytical Profile of Coleus Forskohlii | Forskolin .pdf
Analytical Profile of Coleus Forskohlii | Forskolin .pdfSwapnil Therkar
 
Spermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatidSpermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatidSarthak Sekhar Mondal
 
Isotopic evidence of long-lived volcanism on Io
Isotopic evidence of long-lived volcanism on IoIsotopic evidence of long-lived volcanism on Io
Isotopic evidence of long-lived volcanism on IoSérgio Sacani
 
VIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C PVIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C PPRINCE C P
 
STERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCE
STERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCESTERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCE
STERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCEPRINCE C P
 
Recombinant DNA technology (Immunological screening)
Recombinant DNA technology (Immunological screening)Recombinant DNA technology (Immunological screening)
Recombinant DNA technology (Immunological screening)PraveenaKalaiselvan1
 
Is RISC-V ready for HPC workload? Maybe?
Is RISC-V ready for HPC workload? Maybe?Is RISC-V ready for HPC workload? Maybe?
Is RISC-V ready for HPC workload? Maybe?Patrick Diehl
 
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43bNightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43bSérgio Sacani
 
Call Girls in Munirka Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Munirka Delhi 💯Call Us 🔝8264348440🔝Call Girls in Munirka Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Munirka Delhi 💯Call Us 🔝8264348440🔝soniya singh
 
Boyles law module in the grade 10 science
Boyles law module in the grade 10 scienceBoyles law module in the grade 10 science
Boyles law module in the grade 10 sciencefloriejanemacaya1
 
GFP in rDNA Technology (Biotechnology).pptx
GFP in rDNA Technology (Biotechnology).pptxGFP in rDNA Technology (Biotechnology).pptx
GFP in rDNA Technology (Biotechnology).pptxAleenaTreesaSaji
 
Analytical Profile of Coleus Forskohlii | Forskolin .pptx
Analytical Profile of Coleus Forskohlii | Forskolin .pptxAnalytical Profile of Coleus Forskohlii | Forskolin .pptx
Analytical Profile of Coleus Forskohlii | Forskolin .pptxSwapnil Therkar
 
Call Girls in Mayapuri Delhi 💯Call Us 🔝9953322196🔝 💯Escort.
Call Girls in Mayapuri Delhi 💯Call Us 🔝9953322196🔝 💯Escort.Call Girls in Mayapuri Delhi 💯Call Us 🔝9953322196🔝 💯Escort.
Call Girls in Mayapuri Delhi 💯Call Us 🔝9953322196🔝 💯Escort.aasikanpl
 
Traditional Agroforestry System in India- Shifting Cultivation, Taungya, Home...
Traditional Agroforestry System in India- Shifting Cultivation, Taungya, Home...Traditional Agroforestry System in India- Shifting Cultivation, Taungya, Home...
Traditional Agroforestry System in India- Shifting Cultivation, Taungya, Home...jana861314
 
Cultivation of KODO MILLET . made by Ghanshyam pptx
Cultivation of KODO MILLET . made by Ghanshyam pptxCultivation of KODO MILLET . made by Ghanshyam pptx
Cultivation of KODO MILLET . made by Ghanshyam pptxpradhanghanshyam7136
 
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...Lokesh Kothari
 
Artificial Intelligence In Microbiology by Dr. Prince C P
Artificial Intelligence In Microbiology by Dr. Prince C PArtificial Intelligence In Microbiology by Dr. Prince C P
Artificial Intelligence In Microbiology by Dr. Prince C PPRINCE C P
 
Hubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroidsHubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroidsSérgio Sacani
 
Behavioral Disorder: Schizophrenia & it's Case Study.pdf
Behavioral Disorder: Schizophrenia & it's Case Study.pdfBehavioral Disorder: Schizophrenia & it's Case Study.pdf
Behavioral Disorder: Schizophrenia & it's Case Study.pdfSELF-EXPLANATORY
 

Recently uploaded (20)

Analytical Profile of Coleus Forskohlii | Forskolin .pdf
Analytical Profile of Coleus Forskohlii | Forskolin .pdfAnalytical Profile of Coleus Forskohlii | Forskolin .pdf
Analytical Profile of Coleus Forskohlii | Forskolin .pdf
 
Spermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatidSpermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatid
 
Isotopic evidence of long-lived volcanism on Io
Isotopic evidence of long-lived volcanism on IoIsotopic evidence of long-lived volcanism on Io
Isotopic evidence of long-lived volcanism on Io
 
VIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C PVIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C P
 
STERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCE
STERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCESTERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCE
STERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCE
 
Recombinant DNA technology (Immunological screening)
Recombinant DNA technology (Immunological screening)Recombinant DNA technology (Immunological screening)
Recombinant DNA technology (Immunological screening)
 
Is RISC-V ready for HPC workload? Maybe?
Is RISC-V ready for HPC workload? Maybe?Is RISC-V ready for HPC workload? Maybe?
Is RISC-V ready for HPC workload? Maybe?
 
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43bNightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
 
Call Girls in Munirka Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Munirka Delhi 💯Call Us 🔝8264348440🔝Call Girls in Munirka Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Munirka Delhi 💯Call Us 🔝8264348440🔝
 
Boyles law module in the grade 10 science
Boyles law module in the grade 10 scienceBoyles law module in the grade 10 science
Boyles law module in the grade 10 science
 
GFP in rDNA Technology (Biotechnology).pptx
GFP in rDNA Technology (Biotechnology).pptxGFP in rDNA Technology (Biotechnology).pptx
GFP in rDNA Technology (Biotechnology).pptx
 
Analytical Profile of Coleus Forskohlii | Forskolin .pptx
Analytical Profile of Coleus Forskohlii | Forskolin .pptxAnalytical Profile of Coleus Forskohlii | Forskolin .pptx
Analytical Profile of Coleus Forskohlii | Forskolin .pptx
 
Call Girls in Mayapuri Delhi 💯Call Us 🔝9953322196🔝 💯Escort.
Call Girls in Mayapuri Delhi 💯Call Us 🔝9953322196🔝 💯Escort.Call Girls in Mayapuri Delhi 💯Call Us 🔝9953322196🔝 💯Escort.
Call Girls in Mayapuri Delhi 💯Call Us 🔝9953322196🔝 💯Escort.
 
Engler and Prantl system of classification in plant taxonomy
Engler and Prantl system of classification in plant taxonomyEngler and Prantl system of classification in plant taxonomy
Engler and Prantl system of classification in plant taxonomy
 
Traditional Agroforestry System in India- Shifting Cultivation, Taungya, Home...
Traditional Agroforestry System in India- Shifting Cultivation, Taungya, Home...Traditional Agroforestry System in India- Shifting Cultivation, Taungya, Home...
Traditional Agroforestry System in India- Shifting Cultivation, Taungya, Home...
 
Cultivation of KODO MILLET . made by Ghanshyam pptx
Cultivation of KODO MILLET . made by Ghanshyam pptxCultivation of KODO MILLET . made by Ghanshyam pptx
Cultivation of KODO MILLET . made by Ghanshyam pptx
 
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
 
Artificial Intelligence In Microbiology by Dr. Prince C P
Artificial Intelligence In Microbiology by Dr. Prince C PArtificial Intelligence In Microbiology by Dr. Prince C P
Artificial Intelligence In Microbiology by Dr. Prince C P
 
Hubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroidsHubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroids
 
Behavioral Disorder: Schizophrenia & it's Case Study.pdf
Behavioral Disorder: Schizophrenia & it's Case Study.pdfBehavioral Disorder: Schizophrenia & it's Case Study.pdf
Behavioral Disorder: Schizophrenia & it's Case Study.pdf
 

Overview of DuraMat software tool development

  • 1. Overview of DuraMat software tool development Anubhav Jain Lawrence Berkeley National Laboratory w/contributions from: Todd Karin (LBL), Xin Chen (LBL), Thushara Gunda (Sandia), Cliff Hansen (Sandia), Bennet Meyers (Stanford), Brittany Smith (NREL) and their respective teams
  • 2. Why a talk on software development? • The “end product” of most conventional funded research is a paper or report – This is typically how projects are evaluated • However, software can also be an invaluable end product! – Sometimes, more valuable than text • Data can also be an end product! – See poster on DuraMat Data Hub by R. White. 2 Given a data set, up to 10 analysts were asked to calculate the degradation rate of 5 PV systems using either (i) any approach they wanted, (ii) a documented standard, or (iii) a documented codebase (RdTools). Consistent results came only with the codebase, highlighting the role software can play in reproducibility and reusability. Jordan, D. C., Luo, W., Jain, A., Saleh, M. U., von Korff, H., Hu, Y., Jaubert, J.-N., Mavromatakis, F., Deline, C., Deceglie, M. G., Nag, A., Kimball, G. M., Shinn, A. B., John, J. J., Alnuaimi, A. A. & Elnosh, A. B. A. Reducing Interanalyst Variability in Photovoltaic Degradation Rate Assessments. IEEE J. Photovoltaics 10, 206–212 (2020).
  • 3. DuraMat-funded projects are developing software to solve a spectrum of PV problems 3 Core functions common to many PV analyses Operation and degradation in the field Planning and reduction of LCOE pvanalytics pv-pro data preprocessor pv-pro pvOps pvARC pv-vision simple LCOE calculator vocmax
  • 4. DuraMat software projects share some DNA • Open-source licenses – Typically MIT / BSD which are commercial-friendly • All based on Python / pydata stack for interoperability – not mixing MATLAB, Python, Java, Excel macros, etc. • Make use of large data sets and machine learning / statistical learning – e.g., neural networks for vision, natural language processing for text • Collaborative and sustainable development via the Github platform – i.e., NOT a single developer sending around “script_v34” by email • More integration forthcoming – e.g., https://duramat.github.io/pv-terms/ to unify common variable names 4
  • 5. pvlib/pvanalytics / Cliff Hansen, Will Vining, Matt Muller 5 • python library for automating analysis of data from PV systems • Workflow independent, built up from base functions • v0.1 released 20 November github.com/pvlib/pvanalytics • Fully compatible with pvlib/pvlib-python for PV system modeling Quality control functions • Plausibility of irradiance and weather measurements • Identification of missing, interpolated, or stale data • outlier detection • Identification of timestamp problems such as daylight savings shifts Feature identification functions • inverter clipping • clear-sky periods • day/night detection from power or irradiance Identification of system properties • tilt and azimuth from power data • differentiation between fixed and tracking PV systems Metrics • NREL weather corrected performance ratio v0.1 Content Core
  • 6. PV-Pro Data Preprocessor / Bennet Meyers, Todd Karin 6 PV-Pro can be found at: https://github.com/DuraMAT/pvpro • 0: System at maximum power point. • 1: System at open circuit conditions. • 2: Clipped or curtailed. • -1: No power/inverter off • -2: Other (errors, corrupted data) def run_preprocess(self, correct_tz=True, data_sampling=None, correct_dst=False, fix_shifts=True, max_val=None): Core
  • 7. PVPRO/ Todd Karin, Anubhav Jain, Bruce King, Michael Deceglie, Bennet Meyers, Dirk Jordan, Cliff Hanen, Laura Schelhas 7 PVPRO be found at: https://github.com/DuraMAT/pvpro • Use operation data (DC current, DC voltage, module temperature and plane-of- array irradiance) to determine module single diode model parameters vs. time. PRODUCTION DATA Time series database PVPRO • Filter power data • Meteorological data • Circuit model • Parameter estimation • Uncertainty analysis I-V Parameters Rseries, Voc, Isc, Bvoc, … Degradation Mode Estimates Soiling, PID, Encpasulant discoloration, solder bond failure Output BIG data analysis Application Technology Degradation mode Solder bond damage detected Methods Actionable analytics More accurate power predictions Operation & Degradation
  • 8. pvOps / Thushara Gunda, Michael Hopwood, Hector Mendoza 8 pvOps is currently underdoing review and will be published on GitHub as part of pvlib in April 2021 Module 1: Text • Date Extraction • Consistent Labels • Issue Summary Module 2: Text2Time • Date Alignments • Quantify Impact • Visualizations { “Date_EventStart”: XXX “Date_EventEnd”:XXX “Asset”:XXX “ProductionImpact”:XXX “Response”:XXX “IssueDescription”:XXX } • Although text-based records can contain valuable contextual information to support data processing and site assessment activities, significant diversity in these records makes it challenging to ascertain needed insights. • The pvOps package contains two modules to support: 1) processing of text data and 2) fuse text with timeseries data • Similar to other pvlib packages, pvOps is written as a series of individual functions that could be integrated using class wrappers to support individual workflows Operation & Degradation
  • 9. PVARC/ Todd Karin, David Miller, Anubhav Jain 9 PVARC be found at: https://github.com/DuraMAT/pvarc • Extract coating parameters from spectral reflectance data using thin-film interferometry model “Non-destructive Characterization of Anti-reflection Coatings on PV Modules” Posted arXiv:2101.05446. (in- press at JPV). Spectral Reflectance Measurement of PV module glass Quantify anti reflection properties Operation & Degradation
  • 10. PV-vision/ Xin Chen, Todd Karin, Anubhav Jain 10 PV-vision be found at: https://github.com/hackingmaterials/pv-vision Solar Cell Crack Detection Algorithm & Data Analytics Automatic Classification of Fire damaged Solar Modules • Goal: automatically extract features of cracks on solar modules and quantify the relationship between features and module power loss • Tool developed for cropping out single cells from solar modules with accuracy of 90% • Goal: automatically classify the solar modules based on the categories of defects which are induced by conflagration • New tool assisted with CNN developed to do perspective transform and cell cropping. Accuracy improved and will be applied to all dataset crop • UNet model trained to segment the cracks with overall F1 metric of 0.89 • Initial tool developed to calculate crack features (length, orientation, etc.) Fig.4 Left: original image. Right: predicted masks. F1 metric=0.882 vectorized Fig.5 Left: crack vectors. Middle: poly-fitted cracks. Right: filter short cracks(length<30) UNet Fig.1 Solar module Fig.2 Cropped solar cells Fig.3 Masks predicted by UNet model. Left: original image. Right: masks are highlighted in different colors. Purple (crack), Green (power loss area), brown (busbar). F1 metric=0.862 Fig.6 Original, perspective- transformed solar module and cropped cells transform (CNN assisted) crop • Yolo model trained to detect defective cells in the solar modules • Solar modules classified based on the number of different defective cells with accuracy of 98% Fig.7 Defective cells detected by Yolo model. Green: crack defect. Blue: Solder defect. Red: Oxygen induced defect. Purple: Intra-cell defect. Classification criterion If no defective cell or ‘crack’ <= 1: Category 1 If ‘crack’ >= 2 or ‘oxygen’ >= 1: Category 2 If ‘intra’ >= 1: Category 3 Operation & Degradation
  • 11. Simplified PV LCOE Calculator* / Brittany Smith (NREL) 11 The simplified PV LCOE calculator can be found at: www.github.com/NREL/PVLCOE Currently, the calculator offers only two default degradation rates (based on cell technology selection) and assumes module degradation approximates system-level degradation. DuraMAT analysis of PV Fleets data will provide updated system-level degradation rates and could potentially populate different default degradation rate values for: • Cell technology • Package type • System type • Install location The calculator lets you select from a set of system options: Default values pre-populate based on selections Results include LCOE, module price, system cost *calculator was originally developed outside of DuraMAT Planning & LCOE
  • 12. Vocmax – a string length calculator for reducing LCOE / Todd Karin, Anubhav Jain 12 Conventional string length calculations are unnecessarily conservative • Most common practice is to use minimum historical ambient temperature and 1000 W/m2 for calculating maximum string Voc, but these conditions do not co-occur in practice. • Longer strings lower system costs – get more power through the same wires. Need a more realistic method for calculating string length • We developed and validated a method for calculating the string length by modeling the system VOC over time at the location of interest. • Method is consistent with NEC 690.7(A)(3) standard. Impact • In the US, string lengths increased by 10% on average using site—specific modeling, leading to a 1.2% reduction in LCOE ! https://github.com/toddkarin/vocmax https://pvtools.lbl.gov/string-length-calculator https://ieeexplore.ieee.org/document/9000497 Approach: model the distribution of operating and open-circuit voltage over time to determine threshold Planning & LCOE
  • 13. Conclusions • In addition to papers and reports, software and data represent important outputs for research • DuraMat has a diverse portfolio of software development projects across the chain of PV operation • The software is available open-source and is the product of collaborative development • We would be very happy to hear from you! 13