SlideShare a Scribd company logo
Ben Busby, Ph.D.
Data Science Education Something…
NCBI et al
Founder, Department of Bioinformatics and Data Science, FAES
ben.busby@nih.gov, @dcgenomics, LinkedIn
Making the Transition from Sharing Data to Sharing Knowledge
4
EUtils (Search API) Command Line
EDirect
Google for
EDirect Cookbook
5
EDirect Local Caching!
6
PubMed and PMC (Open) FTP
7
Instead of PubMed FTP…
An automated tool (alpha)
Pubrunner.org
©MartineZilversmit2013
COOL
THING
#1 !
https://trace.ncbi.nlm.nih.gov/Traces/study/
?stat_search= 1561
Please check out slideshare to grab the details.
https://www.slideshare.net/benbusby
23
24
25
26
27
28
29
Punch line: lsrr is not different in typically virulent vs
avirulent strains of E coli so now I need to look at
expression -- but how do I do that?
(Fast section over.)
30
31
32
34
tar -xvzf ncbi-magicblast...
makeblastdb -dbtype nucl -in <fasta> -parse_seqids
magicblast -db <fasta> -sra SRR… -splice F -no_unaligned
35
magicblast -db <fasta> -sra SRR… -splice F -no_unaligned
-num_threads X
39
40
42
43
Polygenic SNP Search Tool
https://github.com/NCBI-
Hackathons/PSST
45
https://github.com/NCBI-
Hackathons/GenomicRobots
https://github.com/NCBI-Hackathons/Complex_Phenogeno
48
phenvar.colorado.edu
50
Combined score is
the average of SVs,
mappability, GC..
NCBI region list
Encode blacklist
53
EUtils (Search API) Command Line
EDirect
Google for
EDirect Cookbook
54
EUtils (Search API) Command Line
EDirect
Google for
EDirect Cookbook
https://github.com/NCBI-
Hackathons/ViruSpy
https://github.com/NCBI-
Hackathons/EndoVir
https://github.com/NCBI-
Hackathons/VirusFriends
59
https://www.ncbi.nlm.nih.gov/core/assets/sra/files/Factsheet_SRA.pdf
Available to
anyone!
First 5 lectures
now available
on
65
66
Blog post coming soon!
77
https://ncbi-hackathons.github.io/GeneExpressionAging/ideogram
79
80
81
“Joseph Halstead” is another incredibly common name (+team)
82
Robert Butler and Lucy Wang (+team)
83
84
85
MASSIF-BLAST
91
93
Other People’s Hackathons
Other People’s Hackathons
@DCGenomics
Communication
Creating a Community
https://biohackathons.github.io
Creating a Community
99
Planned Events
RNAseq – UNC, March 11-13 2019;
Palo Alto, June 2019
Smaller events at USF and Pittsburgh
Human PanGenomics – UCSC, 25-27 March 2019;
Haplotype Annotation, Baltimore, June 2019
Variant Synthetic Dataset Generation –
Boston, April 15-16, 2019
AMR and Prokaryotic Genome Annotate-athon
NIH Campus, August 2019
100
101
102
103
Virus Discovery!
104
105
106
107
108
RNA-seq Indexing!
109
RNA-seq Indexing!
110
111
112
https://github.com/NCBI-Hackathons/RNA-Seq-in-the-Cloud
113
Building a Usable Human Pangenome!
114
Building a Usable Human Pangenome!
115
Building a Usable Human Pangenome!
116
Building a Usable Human Pangenome!
117
Building a Usable Human Pangenome!
118
Building a Usable Human Pangenome!
Creating a Community
https://biohackathons.github.io
MACHINE LEARNING
PROJECT MANAGEMENT
PRODUCT MANAGEMENT
120
NCBI Visiting Bioinformaticians Group
May 2018
Visiting
Bioinformatician
Program
122
123
124
125
126
AA/Typhi
127
128

More Related Content

More from Ben Busby

Addressing privacy concerns_in_the_age_of_federated_data_access
Addressing privacy concerns_in_the_age_of_federated_data_accessAddressing privacy concerns_in_the_age_of_federated_data_access
Addressing privacy concerns_in_the_age_of_federated_data_access
Ben Busby
 
Containerized attribute indexing and graph genomes for federated data access
Containerized attribute indexing and graph genomes for federated data accessContainerized attribute indexing and graph genomes for federated data access
Containerized attribute indexing and graph genomes for federated data access
Ben Busby
 
Artificial_Intelligence_for_Data_Reuse_2019
Artificial_Intelligence_for_Data_Reuse_2019Artificial_Intelligence_for_Data_Reuse_2019
Artificial_Intelligence_for_Data_Reuse_2019
Ben Busby
 
Dream.recomb.ncbi.hackathons v003
Dream.recomb.ncbi.hackathons v003Dream.recomb.ncbi.hackathons v003
Dream.recomb.ncbi.hackathons v003
Ben Busby
 
Human_Pangenomics_Bio-IT_2019
Human_Pangenomics_Bio-IT_2019Human_Pangenomics_Bio-IT_2019
Human_Pangenomics_Bio-IT_2019
Ben Busby
 
RNAML_Bio-IT_2019
RNAML_Bio-IT_2019RNAML_Bio-IT_2019
RNAML_Bio-IT_2019
Ben Busby
 
Hackathon_Bio-IT_2019
Hackathon_Bio-IT_2019Hackathon_Bio-IT_2019
Hackathon_Bio-IT_2019
Ben Busby
 
Sage 2 19_v5_busby
Sage 2 19_v5_busbySage 2 19_v5_busby
Sage 2 19_v5_busby
Ben Busby
 
Bb health ai_jan26_v2
Bb health ai_jan26_v2Bb health ai_jan26_v2
Bb health ai_jan26_v2
Ben Busby
 
BB_NCBI_PAG_2019_Workshop
BB_NCBI_PAG_2019_WorkshopBB_NCBI_PAG_2019_Workshop
BB_NCBI_PAG_2019_Workshop
Ben Busby
 
Hackathons lightning v_nbs
Hackathons lightning v_nbsHackathons lightning v_nbs
Hackathons lightning v_nbs
Ben Busby
 
Bioinformatics_resources_SVAI_v2
Bioinformatics_resources_SVAI_v2Bioinformatics_resources_SVAI_v2
Bioinformatics_resources_SVAI_v2
Ben Busby
 
Pag three ways_to_ngs_at_ncbi
Pag three ways_to_ngs_at_ncbiPag three ways_to_ngs_at_ncbi
Pag three ways_to_ngs_at_ncbi
Ben Busby
 
NIH Hackathons Lightning Slides
NIH Hackathons Lightning SlidesNIH Hackathons Lightning Slides
NIH Hackathons Lightning Slides
Ben Busby
 
Genomic futures mn_v002
Genomic futures mn_v002Genomic futures mn_v002
Genomic futures mn_v002
Ben Busby
 
Robots and hackathons_ga4_gh_v001
Robots and hackathons_ga4_gh_v001Robots and hackathons_ga4_gh_v001
Robots and hackathons_ga4_gh_v001
Ben Busby
 
Datasets and tools_from_ncbi_and_elsewhere_for_microbiome_research_v_62817
Datasets and tools_from_ncbi_and_elsewhere_for_microbiome_research_v_62817Datasets and tools_from_ncbi_and_elsewhere_for_microbiome_research_v_62817
Datasets and tools_from_ncbi_and_elsewhere_for_microbiome_research_v_62817
Ben Busby
 
Genomic futures v_ucsd
Genomic futures v_ucsdGenomic futures v_ucsd
Genomic futures v_ucsd
Ben Busby
 
Leveraging large public_data_for_individualized_medicine
Leveraging large public_data_for_individualized_medicineLeveraging large public_data_for_individualized_medicine
Leveraging large public_data_for_individualized_medicine
Ben Busby
 
Isoforms glbio v1
Isoforms glbio v1Isoforms glbio v1
Isoforms glbio v1
Ben Busby
 

More from Ben Busby (20)

Addressing privacy concerns_in_the_age_of_federated_data_access
Addressing privacy concerns_in_the_age_of_federated_data_accessAddressing privacy concerns_in_the_age_of_federated_data_access
Addressing privacy concerns_in_the_age_of_federated_data_access
 
Containerized attribute indexing and graph genomes for federated data access
Containerized attribute indexing and graph genomes for federated data accessContainerized attribute indexing and graph genomes for federated data access
Containerized attribute indexing and graph genomes for federated data access
 
Artificial_Intelligence_for_Data_Reuse_2019
Artificial_Intelligence_for_Data_Reuse_2019Artificial_Intelligence_for_Data_Reuse_2019
Artificial_Intelligence_for_Data_Reuse_2019
 
Dream.recomb.ncbi.hackathons v003
Dream.recomb.ncbi.hackathons v003Dream.recomb.ncbi.hackathons v003
Dream.recomb.ncbi.hackathons v003
 
Human_Pangenomics_Bio-IT_2019
Human_Pangenomics_Bio-IT_2019Human_Pangenomics_Bio-IT_2019
Human_Pangenomics_Bio-IT_2019
 
RNAML_Bio-IT_2019
RNAML_Bio-IT_2019RNAML_Bio-IT_2019
RNAML_Bio-IT_2019
 
Hackathon_Bio-IT_2019
Hackathon_Bio-IT_2019Hackathon_Bio-IT_2019
Hackathon_Bio-IT_2019
 
Sage 2 19_v5_busby
Sage 2 19_v5_busbySage 2 19_v5_busby
Sage 2 19_v5_busby
 
Bb health ai_jan26_v2
Bb health ai_jan26_v2Bb health ai_jan26_v2
Bb health ai_jan26_v2
 
BB_NCBI_PAG_2019_Workshop
BB_NCBI_PAG_2019_WorkshopBB_NCBI_PAG_2019_Workshop
BB_NCBI_PAG_2019_Workshop
 
Hackathons lightning v_nbs
Hackathons lightning v_nbsHackathons lightning v_nbs
Hackathons lightning v_nbs
 
Bioinformatics_resources_SVAI_v2
Bioinformatics_resources_SVAI_v2Bioinformatics_resources_SVAI_v2
Bioinformatics_resources_SVAI_v2
 
Pag three ways_to_ngs_at_ncbi
Pag three ways_to_ngs_at_ncbiPag three ways_to_ngs_at_ncbi
Pag three ways_to_ngs_at_ncbi
 
NIH Hackathons Lightning Slides
NIH Hackathons Lightning SlidesNIH Hackathons Lightning Slides
NIH Hackathons Lightning Slides
 
Genomic futures mn_v002
Genomic futures mn_v002Genomic futures mn_v002
Genomic futures mn_v002
 
Robots and hackathons_ga4_gh_v001
Robots and hackathons_ga4_gh_v001Robots and hackathons_ga4_gh_v001
Robots and hackathons_ga4_gh_v001
 
Datasets and tools_from_ncbi_and_elsewhere_for_microbiome_research_v_62817
Datasets and tools_from_ncbi_and_elsewhere_for_microbiome_research_v_62817Datasets and tools_from_ncbi_and_elsewhere_for_microbiome_research_v_62817
Datasets and tools_from_ncbi_and_elsewhere_for_microbiome_research_v_62817
 
Genomic futures v_ucsd
Genomic futures v_ucsdGenomic futures v_ucsd
Genomic futures v_ucsd
 
Leveraging large public_data_for_individualized_medicine
Leveraging large public_data_for_individualized_medicineLeveraging large public_data_for_individualized_medicine
Leveraging large public_data_for_individualized_medicine
 
Isoforms glbio v1
Isoforms glbio v1Isoforms glbio v1
Isoforms glbio v1
 

Recently uploaded

Mudde & Rovira Kaltwasser. - Populism in Europe and the Americas - Threat Or...
Mudde &  Rovira Kaltwasser. - Populism in Europe and the Americas - Threat Or...Mudde &  Rovira Kaltwasser. - Populism in Europe and the Americas - Threat Or...
Mudde & Rovira Kaltwasser. - Populism in Europe and the Americas - Threat Or...
frank0071
 
Chapter 12 - climate change and the energy crisis
Chapter 12 - climate change and the energy crisisChapter 12 - climate change and the energy crisis
Chapter 12 - climate change and the energy crisis
tonzsalvador2222
 
Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...
Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...
Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...
University of Maribor
 
Toxic effects of heavy metals : Lead and Arsenic
Toxic effects of heavy metals : Lead and ArsenicToxic effects of heavy metals : Lead and Arsenic
Toxic effects of heavy metals : Lead and Arsenic
sanjana502982
 
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Ana Luísa Pinho
 
Nucleophilic Addition of carbonyl compounds.pptx
Nucleophilic Addition of carbonyl  compounds.pptxNucleophilic Addition of carbonyl  compounds.pptx
Nucleophilic Addition of carbonyl compounds.pptx
SSR02
 
BREEDING METHODS FOR DISEASE RESISTANCE.pptx
BREEDING METHODS FOR DISEASE RESISTANCE.pptxBREEDING METHODS FOR DISEASE RESISTANCE.pptx
BREEDING METHODS FOR DISEASE RESISTANCE.pptx
RASHMI M G
 
Topic: SICKLE CELL DISEASE IN CHILDREN-3.pdf
Topic: SICKLE CELL DISEASE IN CHILDREN-3.pdfTopic: SICKLE CELL DISEASE IN CHILDREN-3.pdf
Topic: SICKLE CELL DISEASE IN CHILDREN-3.pdf
TinyAnderson
 
ANAMOLOUS SECONDARY GROWTH IN DICOT ROOTS.pptx
ANAMOLOUS SECONDARY GROWTH IN DICOT ROOTS.pptxANAMOLOUS SECONDARY GROWTH IN DICOT ROOTS.pptx
ANAMOLOUS SECONDARY GROWTH IN DICOT ROOTS.pptx
RASHMI M G
 
Anemia_ types_clinical significance.pptx
Anemia_ types_clinical significance.pptxAnemia_ types_clinical significance.pptx
Anemia_ types_clinical significance.pptx
muralinath2
 
Seminar of U.V. Spectroscopy by SAMIR PANDA
 Seminar of U.V. Spectroscopy by SAMIR PANDA Seminar of U.V. Spectroscopy by SAMIR PANDA
Seminar of U.V. Spectroscopy by SAMIR PANDA
SAMIR PANDA
 
ESR spectroscopy in liquid food and beverages.pptx
ESR spectroscopy in liquid food and beverages.pptxESR spectroscopy in liquid food and beverages.pptx
ESR spectroscopy in liquid food and beverages.pptx
PRIYANKA PATEL
 
Oedema_types_causes_pathophysiology.pptx
Oedema_types_causes_pathophysiology.pptxOedema_types_causes_pathophysiology.pptx
Oedema_types_causes_pathophysiology.pptx
muralinath2
 
SAR of Medicinal Chemistry 1st by dk.pdf
SAR of Medicinal Chemistry 1st by dk.pdfSAR of Medicinal Chemistry 1st by dk.pdf
SAR of Medicinal Chemistry 1st by dk.pdf
KrushnaDarade1
 
platelets_clotting_biogenesis.clot retractionpptx
platelets_clotting_biogenesis.clot retractionpptxplatelets_clotting_biogenesis.clot retractionpptx
platelets_clotting_biogenesis.clot retractionpptx
muralinath2
 
What is greenhouse gasses and how many gasses are there to affect the Earth.
What is greenhouse gasses and how many gasses are there to affect the Earth.What is greenhouse gasses and how many gasses are there to affect the Earth.
What is greenhouse gasses and how many gasses are there to affect the Earth.
moosaasad1975
 
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
University of Maribor
 
Richard's aventures in two entangled wonderlands
Richard's aventures in two entangled wonderlandsRichard's aventures in two entangled wonderlands
Richard's aventures in two entangled wonderlands
Richard Gill
 
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills MN
 
Eukaryotic Transcription Presentation.pptx
Eukaryotic Transcription Presentation.pptxEukaryotic Transcription Presentation.pptx
Eukaryotic Transcription Presentation.pptx
RitabrataSarkar3
 

Recently uploaded (20)

Mudde & Rovira Kaltwasser. - Populism in Europe and the Americas - Threat Or...
Mudde &  Rovira Kaltwasser. - Populism in Europe and the Americas - Threat Or...Mudde &  Rovira Kaltwasser. - Populism in Europe and the Americas - Threat Or...
Mudde & Rovira Kaltwasser. - Populism in Europe and the Americas - Threat Or...
 
Chapter 12 - climate change and the energy crisis
Chapter 12 - climate change and the energy crisisChapter 12 - climate change and the energy crisis
Chapter 12 - climate change and the energy crisis
 
Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...
Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...
Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...
 
Toxic effects of heavy metals : Lead and Arsenic
Toxic effects of heavy metals : Lead and ArsenicToxic effects of heavy metals : Lead and Arsenic
Toxic effects of heavy metals : Lead and Arsenic
 
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
 
Nucleophilic Addition of carbonyl compounds.pptx
Nucleophilic Addition of carbonyl  compounds.pptxNucleophilic Addition of carbonyl  compounds.pptx
Nucleophilic Addition of carbonyl compounds.pptx
 
BREEDING METHODS FOR DISEASE RESISTANCE.pptx
BREEDING METHODS FOR DISEASE RESISTANCE.pptxBREEDING METHODS FOR DISEASE RESISTANCE.pptx
BREEDING METHODS FOR DISEASE RESISTANCE.pptx
 
Topic: SICKLE CELL DISEASE IN CHILDREN-3.pdf
Topic: SICKLE CELL DISEASE IN CHILDREN-3.pdfTopic: SICKLE CELL DISEASE IN CHILDREN-3.pdf
Topic: SICKLE CELL DISEASE IN CHILDREN-3.pdf
 
ANAMOLOUS SECONDARY GROWTH IN DICOT ROOTS.pptx
ANAMOLOUS SECONDARY GROWTH IN DICOT ROOTS.pptxANAMOLOUS SECONDARY GROWTH IN DICOT ROOTS.pptx
ANAMOLOUS SECONDARY GROWTH IN DICOT ROOTS.pptx
 
Anemia_ types_clinical significance.pptx
Anemia_ types_clinical significance.pptxAnemia_ types_clinical significance.pptx
Anemia_ types_clinical significance.pptx
 
Seminar of U.V. Spectroscopy by SAMIR PANDA
 Seminar of U.V. Spectroscopy by SAMIR PANDA Seminar of U.V. Spectroscopy by SAMIR PANDA
Seminar of U.V. Spectroscopy by SAMIR PANDA
 
ESR spectroscopy in liquid food and beverages.pptx
ESR spectroscopy in liquid food and beverages.pptxESR spectroscopy in liquid food and beverages.pptx
ESR spectroscopy in liquid food and beverages.pptx
 
Oedema_types_causes_pathophysiology.pptx
Oedema_types_causes_pathophysiology.pptxOedema_types_causes_pathophysiology.pptx
Oedema_types_causes_pathophysiology.pptx
 
SAR of Medicinal Chemistry 1st by dk.pdf
SAR of Medicinal Chemistry 1st by dk.pdfSAR of Medicinal Chemistry 1st by dk.pdf
SAR of Medicinal Chemistry 1st by dk.pdf
 
platelets_clotting_biogenesis.clot retractionpptx
platelets_clotting_biogenesis.clot retractionpptxplatelets_clotting_biogenesis.clot retractionpptx
platelets_clotting_biogenesis.clot retractionpptx
 
What is greenhouse gasses and how many gasses are there to affect the Earth.
What is greenhouse gasses and how many gasses are there to affect the Earth.What is greenhouse gasses and how many gasses are there to affect the Earth.
What is greenhouse gasses and how many gasses are there to affect the Earth.
 
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
 
Richard's aventures in two entangled wonderlands
Richard's aventures in two entangled wonderlandsRichard's aventures in two entangled wonderlands
Richard's aventures in two entangled wonderlands
 
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
 
Eukaryotic Transcription Presentation.pptx
Eukaryotic Transcription Presentation.pptxEukaryotic Transcription Presentation.pptx
Eukaryotic Transcription Presentation.pptx
 

Data science futures_v_vu2

Editor's Notes

  1. Talk about relative sizes of databases, particularly SRA
  2. Now… with AMR data!
  3. Now… with AMR data!
  4. Now… with AMR data!
  5. Now… with AMR data!
  6. Now… with AMR data!
  7. Things you can build ON!
  8. Things you can build ON!
  9. Things you can build ON!
  10. Things you can build ON!
  11. Things you can build ON!
  12. Things you can build ON!
  13. Things you can build ON!
  14. Things you can build ON!
  15. Things you can build ON!
  16. Things you can build ON!
  17. Things you can build ON!
  18. Things you can build ON!
  19. Things you can build ON!
  20. Now… with AMR data!
  21. Show suggestive search..
  22. Show suggestive search..
  23. Show suggestive search..
  24. Now… with AMR data!
  25. Now… with AMR data!
  26. Now… with AMR data!
  27. Now… with AMR data!
  28. Now… with AMR data!
  29. Mention CUNY-SDSU competition!
  30. Mention CUNY-SDSU competition!
  31. Now… with AMR data!
  32. Now… with AMR data!
  33. Now… with AMR data!
  34. Now… with AMR data!
  35. Now… with AMR data!
  36. Now… with AMR data!
  37. Now… with AMR data!
  38. Now… with AMR data!
  39. Now… with AMR data!
  40. Now… with AMR data!
  41. Now… with AMR data!
  42. Now… with AMR data!
  43. Now… with AMR data!
  44. Now… with AMR data!
  45. Now… with AMR data!
  46. Now… with AMR data!
  47. Now… with AMR data!
  48. Now… with AMR data!
  49. Mention Data Science Mentoring