ChemSpider – An Online Database and  Registration System Linking the Web Antony Williams and Valery Tkachenko EBI Chemical Registry Systems Workshop, October 2011
www.chemspider.com
ChemSpider… >26 million unique molecules from >400 sources .NET, SQL Server and GGA Indigo toolkit  Multiple Open Source components – Jmol, JSpecView, Balloon, OpenBabel, MediaWiki Slices of data are Open but the entire data collection is not Open Crowdsourced depositions and curations Uses  InChIs  for navigating and linking the web
Vancomycin
Vancomycin Search Molecular SKELETON Search Full Molecule
Full  Skeleton  Search: 104 Hits
Full  Molecule  Search: 4 Hits
ChemSpider… >26 million unique molecules from >400 sources .NET, SQL Server and GGA Indigo toolkit  Multiple Open Source components – Jmol, JSpecView, Balloon, OpenBabel, MediaWiki Slides of data are Open but the entire data collection is not Open Crowdsourced depositions and curations Uses  InChIs  for navigating and linking the web Uses  Names  for navigating and linking the web
I want to know about “Vincristine” If all algorithms work then everything on the page is correct by default except the name-structure relationship!
Vincristine: Identifiers and Properties
Vincristine: Vendors and Sources Linked by  Structure
Vincristine: Patents Linked by  Name
Vincristine: Articles Linked by  Name
ORIGINAL  ChemSpider “ Create a system for linking and navigating databases on the web ” Use the power of  InChI , and the proliferation of  InChIs  in databases, to make connections Developed on .NET and SQL Server for speed of implementation and existing skill sets Seeded with PubChem database of 10.5M chemicals and expanded using other sources to 20M
How do we build it? We deal in Molfiles or SDF files – with coordinates Deposit anything that has an InChI – we support what InChI can handle, good and bad Standardization based on “InChI standardization” InChIs aggregate (certain) tautomers We link out to external sites using their IDs
InChIs – both on ChemSpider
Downsides of InChI InChI was a moving target (multi versions) but overall worked as planned. Good for small molecules – but no polymers, issues with inorganics, organometallics, imperfect stereochemistry. ChemSpider is “small molecules” InChI used as the “deduplicator” –  FIRST  version of a compound into the database becomes THE structure to deduplicate against…
Side Effects of InChI Usage
SMILES by comparison…
Side Effects of InChI Usage
Standardization Issues Depiction based on molfile
Downsides of Overall Approach Meshing data together based on InChIs worked for simple molecules 2D layout errors inherited or limited by algorithm Complex molecules that are  meant  to be the same thing were NOT deduplicated. Compounds differing by one stereocenter,  named  the same, meant to be the same, are not the same
Yohimbine
Originally 15 compounds “called” Yohimbine 54 Skeletons for Yohimbine
ChemSpider as an Aggregator ChemSpider has inherited many errors, and it continues but we are way more careful now with pre-filtering Cannot deposit chemicals without an InChI Deprecated compounds remain deprecated Curated name-structure relationships do NOT remove the related structure If Taxol is removed from 20 asserted “incorrect structures” those compounds remain in the database
Chemistry Databases on the Internet Some public databases are “trusted” as primary sources Trust is granted without investigation or understanding of the content What do we know about some of the online resources?
PHYSPROP Database The freely downloadable database under the EPI Suite prediction software Very Basic filters suggest data quality issues
The  Stereochemistry challenge. 12500 chemicals with “missed” stereo
Searches on ChemSpider Most searches are text-based: people searching for information about known chemicals Creating accurate name-structure dictionaries is critical
NIST Webbook
PubChem
NPC Browser  http://tripod.nih.gov/npc/
NPC Browser  http://tripod.nih.gov/npc/
 
NPC Browser  http://tripod.nih.gov/npc/
Synonyms on PubChem 1,3-DICHLORO-PROPAN-2-ONE (2R,3R)-Butanediol bis(methanesulfonate) Ethyl-1-propenyl ether, mixture of cis and trans PSS-[2-[(Chloromethyl)phenyl]ethyl]-Heptaisobutyl substituted 1-Chlorobenzylethyl-3,5,7,9,11,13,15-heptaisobutylpentacyclo [9.5.1.1(3,9).1(5,15).1(7,13)]octasiloxane
Synonyms on PubChem
Data Proliferation
 
 
 
 
 
What is meant by a name?
Choose a Starting Point
“ The First 10”
What is getting into Our Databases? Large aggregators are inheriting junk data Data HAS proliferated from ChemSpider through PubChem – in process of deprecating and redepositing A lot of data is for chemicals that will never exist (probably)
Standardization of Patent Data???
Standardization of Patent Data???
WYSIWYG compounds
WYSIWYG compounds
Text Mining Chemical Name Errors
“ DPA”
All aggegators suffer dilution!
Structures have timelines
Name-Structure Dictionaries…
Depiction for Humans
Human Depiction versus Algorithms
Human Depiction versus Algorithms
Identifier Dictionaries Reciprocal curation processes…share curation with each other. If a database has a compound already then use InChiKeys to match “suggested” validation against the compound. A series of “added” and “removed” synonyms against InChIKeys for matching.
Proof of Concept Data Curation Sharing
Structure Validation using feed Look for approved synonyms Compare feed InChIKey with database InChIKey If different, flag for inspection
Open PHACTS : partnership between European Community and EFPIA Freely accessible for knowledge discovery and verification. Data on  small molecules Pharmacological profiles Pharmacokinetics ADMET data Biological targets and pathways  Proprietary and public data sources.
Adopting Modified FDA Rules As already used by ChEMBL…
Nitro groups
Salt and Ionic Bonds
Ammonium salts
Parent and Child Chemical entities reduced to primary component plus relationships salt forms solvates combinations
ChemSpider Standardization Entire ChemSpider database will be standardized using modified FDA rule set Original Molfiles will be standardized and all properties (predicted properties, SMILES, InChIs, Names) will all be regenerated Standardization procedures automatically applied to all future depositions
Project Status Standardization pipelining process initiated  Rule implementation and checking – iterative work with Open PHACTS pharma members Data model development to support parent-child relationships In dialog with the FDA about latest form of recommendations
Conclusions ChemSpider has an important role in quality data Crowdsourced deposition, validation and curation works but  low  engagement to date  Standardization of our entire backfile is necessary Designing the standardization processes with input from pharma and general chemists is necessary
Acknowledgments  The ChemSpider team Our data providers, depositors, collaborators and curators Software providers – OpenEye, ChemDoodle, ACD/Labs, GGA Software, Open Source (Jmol, JSpecView, OpenBabel)
Thank you Email: williamsa@rsc.org  Twitter: ChemConnector Blog: www.chemspider.com/blog Personal Blog:  www.chemconnector.com   SLIDES:  www.slideshare.net/AntonyWilliams

ChemSpider – An Online Database and Registration System Linking the Web

  • 1.
    ChemSpider – AnOnline Database and Registration System Linking the Web Antony Williams and Valery Tkachenko EBI Chemical Registry Systems Workshop, October 2011
  • 2.
  • 3.
    ChemSpider… >26 millionunique molecules from >400 sources .NET, SQL Server and GGA Indigo toolkit Multiple Open Source components – Jmol, JSpecView, Balloon, OpenBabel, MediaWiki Slices of data are Open but the entire data collection is not Open Crowdsourced depositions and curations Uses InChIs for navigating and linking the web
  • 4.
  • 5.
    Vancomycin Search MolecularSKELETON Search Full Molecule
  • 6.
    Full Skeleton Search: 104 Hits
  • 7.
    Full Molecule Search: 4 Hits
  • 8.
    ChemSpider… >26 millionunique molecules from >400 sources .NET, SQL Server and GGA Indigo toolkit Multiple Open Source components – Jmol, JSpecView, Balloon, OpenBabel, MediaWiki Slides of data are Open but the entire data collection is not Open Crowdsourced depositions and curations Uses InChIs for navigating and linking the web Uses Names for navigating and linking the web
  • 9.
    I want toknow about “Vincristine” If all algorithms work then everything on the page is correct by default except the name-structure relationship!
  • 10.
  • 11.
    Vincristine: Vendors andSources Linked by Structure
  • 12.
  • 13.
  • 14.
    ORIGINAL ChemSpider“ Create a system for linking and navigating databases on the web ” Use the power of InChI , and the proliferation of InChIs in databases, to make connections Developed on .NET and SQL Server for speed of implementation and existing skill sets Seeded with PubChem database of 10.5M chemicals and expanded using other sources to 20M
  • 15.
    How do webuild it? We deal in Molfiles or SDF files – with coordinates Deposit anything that has an InChI – we support what InChI can handle, good and bad Standardization based on “InChI standardization” InChIs aggregate (certain) tautomers We link out to external sites using their IDs
  • 16.
    InChIs – bothon ChemSpider
  • 17.
    Downsides of InChIInChI was a moving target (multi versions) but overall worked as planned. Good for small molecules – but no polymers, issues with inorganics, organometallics, imperfect stereochemistry. ChemSpider is “small molecules” InChI used as the “deduplicator” – FIRST version of a compound into the database becomes THE structure to deduplicate against…
  • 18.
    Side Effects ofInChI Usage
  • 19.
  • 20.
    Side Effects ofInChI Usage
  • 21.
  • 22.
    Downsides of OverallApproach Meshing data together based on InChIs worked for simple molecules 2D layout errors inherited or limited by algorithm Complex molecules that are meant to be the same thing were NOT deduplicated. Compounds differing by one stereocenter, named the same, meant to be the same, are not the same
  • 23.
  • 24.
    Originally 15 compounds“called” Yohimbine 54 Skeletons for Yohimbine
  • 25.
    ChemSpider as anAggregator ChemSpider has inherited many errors, and it continues but we are way more careful now with pre-filtering Cannot deposit chemicals without an InChI Deprecated compounds remain deprecated Curated name-structure relationships do NOT remove the related structure If Taxol is removed from 20 asserted “incorrect structures” those compounds remain in the database
  • 26.
    Chemistry Databases onthe Internet Some public databases are “trusted” as primary sources Trust is granted without investigation or understanding of the content What do we know about some of the online resources?
  • 27.
    PHYSPROP Database Thefreely downloadable database under the EPI Suite prediction software Very Basic filters suggest data quality issues
  • 28.
    The Stereochemistrychallenge. 12500 chemicals with “missed” stereo
  • 29.
    Searches on ChemSpiderMost searches are text-based: people searching for information about known chemicals Creating accurate name-structure dictionaries is critical
  • 30.
  • 31.
  • 32.
    NPC Browser http://tripod.nih.gov/npc/
  • 33.
    NPC Browser http://tripod.nih.gov/npc/
  • 34.
  • 35.
    NPC Browser http://tripod.nih.gov/npc/
  • 36.
    Synonyms on PubChem1,3-DICHLORO-PROPAN-2-ONE (2R,3R)-Butanediol bis(methanesulfonate) Ethyl-1-propenyl ether, mixture of cis and trans PSS-[2-[(Chloromethyl)phenyl]ethyl]-Heptaisobutyl substituted 1-Chlorobenzylethyl-3,5,7,9,11,13,15-heptaisobutylpentacyclo [9.5.1.1(3,9).1(5,15).1(7,13)]octasiloxane
  • 37.
  • 38.
  • 39.
  • 40.
  • 41.
  • 42.
  • 43.
  • 44.
    What is meantby a name?
  • 45.
  • 46.
  • 47.
    What is gettinginto Our Databases? Large aggregators are inheriting junk data Data HAS proliferated from ChemSpider through PubChem – in process of deprecating and redepositing A lot of data is for chemicals that will never exist (probably)
  • 48.
  • 49.
  • 50.
  • 51.
  • 52.
  • 53.
  • 54.
  • 55.
  • 56.
  • 57.
  • 58.
  • 59.
  • 60.
    Identifier Dictionaries Reciprocalcuration processes…share curation with each other. If a database has a compound already then use InChiKeys to match “suggested” validation against the compound. A series of “added” and “removed” synonyms against InChIKeys for matching.
  • 61.
    Proof of ConceptData Curation Sharing
  • 62.
    Structure Validation usingfeed Look for approved synonyms Compare feed InChIKey with database InChIKey If different, flag for inspection
  • 63.
    Open PHACTS :partnership between European Community and EFPIA Freely accessible for knowledge discovery and verification. Data on small molecules Pharmacological profiles Pharmacokinetics ADMET data Biological targets and pathways Proprietary and public data sources.
  • 64.
    Adopting Modified FDARules As already used by ChEMBL…
  • 65.
  • 66.
  • 67.
  • 68.
    Parent and ChildChemical entities reduced to primary component plus relationships salt forms solvates combinations
  • 69.
    ChemSpider Standardization EntireChemSpider database will be standardized using modified FDA rule set Original Molfiles will be standardized and all properties (predicted properties, SMILES, InChIs, Names) will all be regenerated Standardization procedures automatically applied to all future depositions
  • 70.
    Project Status Standardizationpipelining process initiated Rule implementation and checking – iterative work with Open PHACTS pharma members Data model development to support parent-child relationships In dialog with the FDA about latest form of recommendations
  • 71.
    Conclusions ChemSpider hasan important role in quality data Crowdsourced deposition, validation and curation works but low engagement to date Standardization of our entire backfile is necessary Designing the standardization processes with input from pharma and general chemists is necessary
  • 72.
    Acknowledgments TheChemSpider team Our data providers, depositors, collaborators and curators Software providers – OpenEye, ChemDoodle, ACD/Labs, GGA Software, Open Source (Jmol, JSpecView, OpenBabel)
  • 73.
    Thank you Email:williamsa@rsc.org Twitter: ChemConnector Blog: www.chemspider.com/blog Personal Blog: www.chemconnector.com SLIDES: www.slideshare.net/AntonyWilliams