SlideShare a Scribd company logo
1 of 38
Engaging scientists to build
better drug discovery software
Marek Nowakowski – User Experience
Rosalie de Beaumont - Oncology
NIBR UX
NIBR NX
Agenda
1.Introductions
2.The Project
3.User Research
4.Design
5.Key Takeaways
Business Use Only2
NIBR NX
Cancer Genetic mutation Therapy
Chronic Myelo. Leukemia BCR-ABL translocation Gleevec
Melanoma BRAF mutation Dabrafenib
PTC
Cancer is a Genetic Disease
Rationale for Targeted Therapy - Find the oncogene & hit it with a drug
3
NIBR NX
Pooled library screening
Business Use Only4
Lets you ask the cancer cells what they need to live
Lentiviral shRNA pool
Add to Cells Select
Initial representation Final representation
Culture
10-14
Days
deep sequencing
WT Mutant
Growth
promotion
Growth
inhibition
shRNAs
Candidates for
Targeted Therapies
Cell lines
NIBR NX
Pooled Screen Workflow overview
Complex multistep process with many different data and user types
Library Building
• Design
• Cloning
• Virus Packaging
Cell Culture
• Infect with libraries
• Add treatments
• Collect cell pellets
gDNA prep and PCR/NGS
• gDNA extraction
• PCR automation
• NGS
Data Analysis
ABACUS
NIBR NX
ABACUS: Suite of web applications
6
Ties together entire pooled screen workflow and stores the data
Design Experiments
Track samples
Store sequencing results
Group and analyze data
Register samples
NIBR NX
Analysis of pooled library screening
7
Informatics and Outlier Metrics
(A) screening and analytical workflow. 2-week pooled shRNA viability
screens were followed by an NGS readout and shRNA gene-level
aggregation by RSA and ATARiS. Feature correlation was performed
using k-means clustering (k = 3) to identify sensitive and insensitive
populations with resulting display of top sensitivity correlations. KRAS
example is shown.
(B) gene activity categorization into inert, active, or essential profiles.
Essential gene dependency correlations include self-CN/expr and AGO2
CN/expr correlations. RSA waterfall plot for PHF5A, colored by PHF5A
copy number. RSA sensitivity cutoff shown at −3 indicates that this is an
essential gene in most lines tested. PSMC5 RSA sensitivity plotted against
AGO2 CN and colored by AGO2 expression.
(C) Normality LRT compares the fit of a skewed Student’s t distribution and
a normal distribution. Profiles with better skewed Student’s t distribution fit
over normal have high NormLRT scores.
(D) Top outliers by class colored by their presence in COSMIC. Non-
COSMIC genes labeled and TFs shown as triangles.
Cell 2017 170, 577-592.e10DOI: (10.1016/j.cell.2017.07.005)
NIBR NX
Business Use Only8
NIBR NX
Business Use Only9
NIBR NX
Do not get distracted by
the complexity of the
science.
Business Use Only10
Key
Learning
NIBR NX
About the Project
• Full commitment from Science and IT
• Clear goals and deliverables
• User Centered Design
• Agile delivery model
• The Team
– Delivery Lead/Project Manager/Scrum Master
– UX Researcher/Designer
– Business Analyst
– Software Engineers
– Data Engineer
– Multiple scientists engaged throughout
Business Use Only11
Understand the User and the
Workflows
NIBR NX
Business Use Only13
NIBR NX
Business Use Only14
NIBR NX
Business Use Only15
NIBR NX
Business Use Only16
NIBR NX
Make sure words/artifacts
are understood the same
way by everyone
Business Use Only17
Key
Learning
NIBR NX
Business Use Only18
NIBR NX
Business Use Only19
NIBR NX
Keep asking questions
until you fully understand
what they’re saying
Business Use Only20
Key
Learning
NIBR NX
Business Use Only21
NIBR NX
Business Use Only22
NIBR NX
Understand the process
well before you start
designing the solution
Business Use Only23
Key
Learning
Design and Test the Solution
NIBR NX
Encourage participatory
design. It will reduce the
number of re-design
cycles you will go through
Business Use Only25
Key
Learning
NIBR NX
Business Use Only26
NIBR NX
Business Use Only27
NIBR NX
Let users/stakeholders
work out their differences
Business Use Only28
Key
Learning
NIBR NX
Business Use Only29
NIBR NX
Business Use Only30
NIBR NX
Don’t make things “pretty”
until you worked out the
functionality
Business Use Only31
Key
Learning
NIBR NX
Business Use Only32
NIBR NX
Business Use Only33
NIBR NX
Business Use Only34
NIBR NX
Business Use Only35
NIBR NX
Scientist Perspective – What worked
well
• Involve scientists early and often
• Be able to teach and learn on both sides
– Thorough explanation of our process was very helpful
• Got what we needed, not what we asked for
• All stakeholders making decisions together, resolving
differences together
– Suite of tools, not one large tool
• Leadership buy-in on both sides is key
Business Use Only36
NIBR NX
Scientist Perspective – What was
difficult
• Working style and time expectations are very different
• Finding a common language, two ways
• Reassuring leadership that time investment is being
productive prior to release
– Lots of time/work before you see a product
Business Use Only37
Thank you

More Related Content

Similar to Enagaging scientists to build better drug discovery software

Evaluating Cloud vs On-Premises for NGS Clinical Workflows
Evaluating Cloud vs On-Premises for NGS Clinical WorkflowsEvaluating Cloud vs On-Premises for NGS Clinical Workflows
Evaluating Cloud vs On-Premises for NGS Clinical Workflows
Golden Helix
 

Similar to Enagaging scientists to build better drug discovery software (20)

GIAB and long reads for bio it world 190417
GIAB and long reads for bio it world 190417GIAB and long reads for bio it world 190417
GIAB and long reads for bio it world 190417
 
ThesisPresentation
ThesisPresentationThesisPresentation
ThesisPresentation
 
NRNB Annual Report 2017
NRNB Annual Report 2017NRNB Annual Report 2017
NRNB Annual Report 2017
 
Whole Genome Trait Association in SVS
Whole Genome Trait Association in SVSWhole Genome Trait Association in SVS
Whole Genome Trait Association in SVS
 
Droplet digital PCR and its applications
Droplet digital PCR and its applicationsDroplet digital PCR and its applications
Droplet digital PCR and its applications
 
NRNB Annual Report 2018
NRNB Annual Report 2018NRNB Annual Report 2018
NRNB Annual Report 2018
 
RNA-Seq 2013 Brochure
RNA-Seq 2013 BrochureRNA-Seq 2013 Brochure
RNA-Seq 2013 Brochure
 
VarSeq 2.4.0: VSClinical ACMG Workflow from the User Perspective
VarSeq 2.4.0: VSClinical ACMG Workflow from the User PerspectiveVarSeq 2.4.0: VSClinical ACMG Workflow from the User Perspective
VarSeq 2.4.0: VSClinical ACMG Workflow from the User Perspective
 
VarSeq 2.4.0: VSClinical ACMG Workflow from the User Perspective
VarSeq 2.4.0: VSClinical ACMG Workflow from the User PerspectiveVarSeq 2.4.0: VSClinical ACMG Workflow from the User Perspective
VarSeq 2.4.0: VSClinical ACMG Workflow from the User Perspective
 
NRNB Annual Report 2016: Overall
NRNB Annual Report 2016: OverallNRNB Annual Report 2016: Overall
NRNB Annual Report 2016: Overall
 
qPCR Design Strategies for Specific Applications
qPCR Design Strategies for Specific ApplicationsqPCR Design Strategies for Specific Applications
qPCR Design Strategies for Specific Applications
 
Evaluating Cloud vs On-Premises for NGS Clinical Workflows
Evaluating Cloud vs On-Premises for NGS Clinical WorkflowsEvaluating Cloud vs On-Premises for NGS Clinical Workflows
Evaluating Cloud vs On-Premises for NGS Clinical Workflows
 
OpenPOWER Academia and Research team's webinar - Presentations from Oak Ridg...
OpenPOWER Academia and Research team's webinar  - Presentations from Oak Ridg...OpenPOWER Academia and Research team's webinar  - Presentations from Oak Ridg...
OpenPOWER Academia and Research team's webinar - Presentations from Oak Ridg...
 
New Technologies at the Center for Bioinformatics & Functional Genomics at Mi...
New Technologies at the Center for Bioinformatics & Functional Genomics at Mi...New Technologies at the Center for Bioinformatics & Functional Genomics at Mi...
New Technologies at the Center for Bioinformatics & Functional Genomics at Mi...
 
Molecular Markers and Their Application in Animal Breed.pptx
Molecular Markers and Their Application in Animal Breed.pptxMolecular Markers and Their Application in Animal Breed.pptx
Molecular Markers and Their Application in Animal Breed.pptx
 
May 15 workshop
May 15  workshopMay 15  workshop
May 15 workshop
 
2019 Project Showcase - Alexander Adam Laurence
2019 Project Showcase - Alexander Adam Laurence2019 Project Showcase - Alexander Adam Laurence
2019 Project Showcase - Alexander Adam Laurence
 
Variant analysis and whole exome sequencing
Variant analysis and whole exome sequencingVariant analysis and whole exome sequencing
Variant analysis and whole exome sequencing
 
Digital RNAseq for Gene Expression Profiling: Digital RNAseq Webinar Part 2
Digital RNAseq for Gene Expression Profiling: Digital RNAseq Webinar Part 2Digital RNAseq for Gene Expression Profiling: Digital RNAseq Webinar Part 2
Digital RNAseq for Gene Expression Profiling: Digital RNAseq Webinar Part 2
 
Understanding and controlling for sample and platform biases in NGS assays
Understanding and controlling for sample and platform biases in NGS assaysUnderstanding and controlling for sample and platform biases in NGS assays
Understanding and controlling for sample and platform biases in NGS assays
 

Recently uploaded

Structuring Teams and Portfolios for Success
Structuring Teams and Portfolios for SuccessStructuring Teams and Portfolios for Success
Structuring Teams and Portfolios for Success
UXDXConf
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
panagenda
 
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider  Progress from Awareness to Implementation.pptxTales from a Passkey Provider  Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
FIDO Alliance
 

Recently uploaded (20)

Oauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoftOauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoft
 
Structuring Teams and Portfolios for Success
Structuring Teams and Portfolios for SuccessStructuring Teams and Portfolios for Success
Structuring Teams and Portfolios for Success
 
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdfHow Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
 
Event-Driven Architecture Masterclass: Challenges in Stream Processing
Event-Driven Architecture Masterclass: Challenges in Stream ProcessingEvent-Driven Architecture Masterclass: Challenges in Stream Processing
Event-Driven Architecture Masterclass: Challenges in Stream Processing
 
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdfThe Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
 
Intro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptxIntro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptx
 
Microsoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - QuestionnaireMicrosoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - Questionnaire
 
ADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptxADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptx
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
 
Overview of Hyperledger Foundation
Overview of Hyperledger FoundationOverview of Hyperledger Foundation
Overview of Hyperledger Foundation
 
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
 
Collecting & Temporal Analysis of Behavioral Web Data - Tales From The Inside
Collecting & Temporal Analysis of Behavioral Web Data - Tales From The InsideCollecting & Temporal Analysis of Behavioral Web Data - Tales From The Inside
Collecting & Temporal Analysis of Behavioral Web Data - Tales From The Inside
 
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
 
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsContinuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
 
Intro in Product Management - Коротко про професію продакт менеджера
Intro in Product Management - Коротко про професію продакт менеджераIntro in Product Management - Коротко про професію продакт менеджера
Intro in Product Management - Коротко про професію продакт менеджера
 
WebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceWebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM Performance
 
Using IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & IrelandUsing IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & Ireland
 
Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024
 
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider  Progress from Awareness to Implementation.pptxTales from a Passkey Provider  Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
 
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
 

Enagaging scientists to build better drug discovery software

  • 1. Engaging scientists to build better drug discovery software Marek Nowakowski – User Experience Rosalie de Beaumont - Oncology NIBR UX
  • 2. NIBR NX Agenda 1.Introductions 2.The Project 3.User Research 4.Design 5.Key Takeaways Business Use Only2
  • 3. NIBR NX Cancer Genetic mutation Therapy Chronic Myelo. Leukemia BCR-ABL translocation Gleevec Melanoma BRAF mutation Dabrafenib PTC Cancer is a Genetic Disease Rationale for Targeted Therapy - Find the oncogene & hit it with a drug 3
  • 4. NIBR NX Pooled library screening Business Use Only4 Lets you ask the cancer cells what they need to live Lentiviral shRNA pool Add to Cells Select Initial representation Final representation Culture 10-14 Days deep sequencing WT Mutant Growth promotion Growth inhibition shRNAs Candidates for Targeted Therapies Cell lines
  • 5. NIBR NX Pooled Screen Workflow overview Complex multistep process with many different data and user types Library Building • Design • Cloning • Virus Packaging Cell Culture • Infect with libraries • Add treatments • Collect cell pellets gDNA prep and PCR/NGS • gDNA extraction • PCR automation • NGS Data Analysis ABACUS
  • 6. NIBR NX ABACUS: Suite of web applications 6 Ties together entire pooled screen workflow and stores the data Design Experiments Track samples Store sequencing results Group and analyze data Register samples
  • 7. NIBR NX Analysis of pooled library screening 7 Informatics and Outlier Metrics (A) screening and analytical workflow. 2-week pooled shRNA viability screens were followed by an NGS readout and shRNA gene-level aggregation by RSA and ATARiS. Feature correlation was performed using k-means clustering (k = 3) to identify sensitive and insensitive populations with resulting display of top sensitivity correlations. KRAS example is shown. (B) gene activity categorization into inert, active, or essential profiles. Essential gene dependency correlations include self-CN/expr and AGO2 CN/expr correlations. RSA waterfall plot for PHF5A, colored by PHF5A copy number. RSA sensitivity cutoff shown at −3 indicates that this is an essential gene in most lines tested. PSMC5 RSA sensitivity plotted against AGO2 CN and colored by AGO2 expression. (C) Normality LRT compares the fit of a skewed Student’s t distribution and a normal distribution. Profiles with better skewed Student’s t distribution fit over normal have high NormLRT scores. (D) Top outliers by class colored by their presence in COSMIC. Non- COSMIC genes labeled and TFs shown as triangles. Cell 2017 170, 577-592.e10DOI: (10.1016/j.cell.2017.07.005)
  • 10. NIBR NX Do not get distracted by the complexity of the science. Business Use Only10 Key Learning
  • 11. NIBR NX About the Project • Full commitment from Science and IT • Clear goals and deliverables • User Centered Design • Agile delivery model • The Team – Delivery Lead/Project Manager/Scrum Master – UX Researcher/Designer – Business Analyst – Software Engineers – Data Engineer – Multiple scientists engaged throughout Business Use Only11
  • 12. Understand the User and the Workflows
  • 17. NIBR NX Make sure words/artifacts are understood the same way by everyone Business Use Only17 Key Learning
  • 20. NIBR NX Keep asking questions until you fully understand what they’re saying Business Use Only20 Key Learning
  • 23. NIBR NX Understand the process well before you start designing the solution Business Use Only23 Key Learning
  • 24. Design and Test the Solution
  • 25. NIBR NX Encourage participatory design. It will reduce the number of re-design cycles you will go through Business Use Only25 Key Learning
  • 28. NIBR NX Let users/stakeholders work out their differences Business Use Only28 Key Learning
  • 31. NIBR NX Don’t make things “pretty” until you worked out the functionality Business Use Only31 Key Learning
  • 36. NIBR NX Scientist Perspective – What worked well • Involve scientists early and often • Be able to teach and learn on both sides – Thorough explanation of our process was very helpful • Got what we needed, not what we asked for • All stakeholders making decisions together, resolving differences together – Suite of tools, not one large tool • Leadership buy-in on both sides is key Business Use Only36
  • 37. NIBR NX Scientist Perspective – What was difficult • Working style and time expectations are very different • Finding a common language, two ways • Reassuring leadership that time investment is being productive prior to release – Lots of time/work before you see a product Business Use Only37

Editor's Notes

  1. 5/17/2018 6:18 PM