Jean-Claude Bradley presents on "Peer Review and Science2.0: blogs, wikis and social networking sites" as a guest lecturer for the “Peer Review Culture in Scholarly Publication and Grantmaking” course at Drexel University. The main thrust of the presentation is that peer review alone is not capable of coping with the increasing flood of scientific information being generated and shared. Arguments are made to show that providing sufficient proof for scientific findings does scale and weakens the tragedy of the trusted source cascade.

1. Peer Review and Science2.0: blogs, wikis and social networking sites Jean-Claude Bradley March 15, 2010 Guest Lecture for “Peer Review Culture in Scholarly Publication and Grantmaking ” course at Drexel University Associate Professor of Chemistry Drexel University

3. What Peer Review does not do Verify the analysis of all the raw data supporting an article.

4. Even if peer-reviewing tried to take on the responsibility of verifying all the raw data, there are not enough resources to cope.

5. TRUST PROOF A solution that scales: Open Notebook Science

6. How bad is our current system? Try to find the solubility EGCG?

7. =2.3 g/L WTF?!

8. The End of the Chain of Provenance

9. The Tragedy of the Trusted Source Cascade

10. The NaH oxidation controversy

11. Information spreads quickly through the blogosphere

12. 15% NMR yield

14. Khalid Mirza and Marshall Moritz

16. Top results on a Google search

17. The Scandal of Bell’s Lab Notebook

18. Motivation: Faster Science, Better Science

19. Open Notebook Science Logos (Andy Lang, Shirley Wu) Sharing: how much and when

20. There are NO FACTS, only measurements embedded within assumptions Open Notebook Science maintains the integrity of data provenance by making assumptions explicit

21. The solubility of 4-chlorobenzaldehyde

22. The Log makes Assumptions Explicit

23. The Rationale of Findings Explicit

24. Raw Data Made Public Splatter? Some liquid

25. YouTube for demonstrating experimental set-up

26. Calculations Made Public on Google Spreadsheets

27. Revision History on Google Spreadsheets

28. Wiki Page History

29. Comparing Wiki Page Versions

30. Proof of Purity with interactive NMR spectrum using JSpecView and JCAMP-DX

31. Linking to Molecules in Chemistry Databases

32. Experimental Spectra and User-Deposited Data on ChemSpider

33. (Andy Lang, Tony Williams) Open Data JCAMP spectra for education (Andy Lang, Tony Williams, Robert Lancashire)

34. Database Curation via Game Playing

35. Over 100,000 spectrum views so far - worldwide

36. Link Spectral Game to Open Educational Content

37. The Ugi reaction: can we predict precipitation? Can we predict solubility in organic solvents?

38. Crowdsourcing Solubility Data

39. ONS Submeta Award Winners

40. ONS Challenge Judges

41. Teaching Lab: Brent Friesen (Dominican University)

42. Solubility Experiment List

43. Solubilities collected in a Google Spreadsheet

44. Rajarshi Guha’s Live Web Query using Google Viz API

45. WE ARE HERE How can the scientific process become more automated?

46. Semi-Automated Measurement of solubility via web service analysis of JCAMP-DX files (Andy Lang)

48. Solubility Prediction (Andy Lang’s Model)

49. Understanding in addition to empirical modeling Missed in a prior publication on solubility for this compound

50. Data provenance: From Wikipedia to…

51. … the lab notebook and raw data

52. Including links to the literature

54. Paper written on Wiki

55. References to papers, blog posts, lab notebook pages, raw data

56. Paper on Journal of Visualized Experiments (JoVE)

57. Pre-print on Nature Precedings

58. ChemSpider Automated Mark-up of Chemical Names

59. BUT… Open Access: the Choice that Keeps Giving.. and Giving…

60. Beware of your addiction to metrics: redundancy will reduce them

61. Cameron Neylon’s Notebooks Other Open Notebooks

62. Anthony Salvagno’s Notebook (Steve Koch group)

63. Archiving Open Notebook Science Projects What is the role of the librarians, researchers and other parties? What are options for citing?

64. Librarians and Science 2.0 "The Internet Archive is a 501(c)(3) non-profit that was founded to build an Internet library, with the purpose of offering permanent access for researchers, historians, and scholars to historical collections that exist in digital format." The internet Archive is not practical for practitioners of Open Notebook Science or Science 2.0

65. Good concept but.....

66. Most pages look like this....

67. Where We Began: The ONS backup spreadsheet and ONSPreserver

68. Publishing Google Spreadsheets as XLS

69. Where We Are Now

70. ONSArchive: Semi-Automated Snapshot of the Entire Scientific Record

71. Snapshot is Self-Contained and Live on the Internet

72. Lulu.com Data Disks

73. DSpace – Handle (hdl)

74. Lulu.com - ISBN Google Spreadsheets Google Documents Web Services ChemSpider & Indiana Real Time Linear Regression, Unit Conversions, Style Sheet, etc Data Book

77. Bradley, Jean-Claude; Lang Andrew. Solubilities Summary Sheet. Open Notebook Science Challenge. 2009-12-11. URL:http://spreadsheets.google.com/pub?key=plwwufp30hfq0udnEmRD1aQ&output=xls. Accessed: 2009-12-11. (Archived by WebCite® at http://www.webcitation.org/5lx5ry3BV )

78. Book Editions on Nature Precedings

79. More about the ONSarchive project:

80. 1) Accept that reporting science in real time is not always pretty. Do your best to avoid and correct mistakes as soon as possible but mistakes and ambiguous results will happen on the way to completing any scientific project. Just be honest about your level of certainty when discussing preliminary results. 2) Provide as much raw data as is reasonable and frame it in such a way that other researchers can understand what you have done and follow your conclusions based on your data without having to ask you questions. 3) Don't wait for the perfect technological solutions before starting to share. General purpose wikis can serve as an excellent starting point for an Open Lab Notebook. 4) Don't wait for the perfect data structuring scheme before starting to share. First share for human readability - you can always restructure the data later for machine readability. Open Notebook Science Tips - I

81. 5) Periodically write summaries of your research progress in the form of milestones or significant challenges in a format that non-specialists can understand. A blog is a good platform for this. If you link to specific lab notebook pages from your summaries, experts can always click through to dig deeper. 6) Create snapshot archives of your notebooks and supporting raw data files. You can use these as backups and as a convenient way to cite a particular version of your entire research project. 7) Cite specific lab notebook pages and archives when publishing in peer-reviewed journals. Open Notebook Science Tips - II