David Cohen U900 INSERM - Mines ParisTech - Institut Curie Biocuration 2013 – Cambridge, UK
Biocuration 2014 - The Resource Identification Initiative
-
Upload
mhaendel -
Category
Technology
-
view
112 -
download
1
description
Transcript of Biocuration 2014 - The Resource Identification Initiative
![Page 1: Biocuration 2014 - The Resource Identification Initiative](https://reader035.fdocuments.net/reader035/viewer/2022062617/54c69fd14a795999798b4586/html5/thumbnails/1.jpg)
Melissa Haendel, OHSU LibraryApril 9, 2014
The Resource Identification Initiative:
What are we curating anyway?
@ontowonka #RII
![Page 2: Biocuration 2014 - The Resource Identification Initiative](https://reader035.fdocuments.net/reader035/viewer/2022062617/54c69fd14a795999798b4586/html5/thumbnails/2.jpg)
Journal guidelines for methods are often poor and space is limited
“All companies from which materials were obtained should be listed.” - A well-known journal
Reproducibility is dependent at a minimum, on using the same resources. But…
![Page 3: Biocuration 2014 - The Resource Identification Initiative](https://reader035.fdocuments.net/reader035/viewer/2022062617/54c69fd14a795999798b4586/html5/thumbnails/3.jpg)
How identifiable are resources in the published literature?
![Page 4: Biocuration 2014 - The Resource Identification Initiative](https://reader035.fdocuments.net/reader035/viewer/2022062617/54c69fd14a795999798b4586/html5/thumbnails/4.jpg)
An experiment in reproducibility
Domains:ImmunologyCell biologyNeuroscienceDevelopmental biology
General biology
Impact factors:HighMediumLow
84 Journals
248 papers
707 antibodies
104 cell lines
258 constructs
210 knockdown reagents
437 model organisms
Reporting Guidelines:StringentSatisfactoryLoose
![Page 5: Biocuration 2014 - The Resource Identification Initiative](https://reader035.fdocuments.net/reader035/viewer/2022062617/54c69fd14a795999798b4586/html5/thumbnails/5.jpg)
Only ~50% of resources were identifiableVasilevsky et al, 2013, PeerJ
![Page 6: Biocuration 2014 - The Resource Identification Initiative](https://reader035.fdocuments.net/reader035/viewer/2022062617/54c69fd14a795999798b4586/html5/thumbnails/6.jpg)
There is no correlation between impact factor and resource identification
Journal Impact Factor
0 10 20 30 40
Fra
ctio
n of
res
ourc
es id
entif
ied
0.0
0.2
0.4
0.6
0.8
1.0AntibodiesCell LinesConstructsKnockdown reagentsOrganisms
![Page 7: Biocuration 2014 - The Resource Identification Initiative](https://reader035.fdocuments.net/reader035/viewer/2022062617/54c69fd14a795999798b4586/html5/thumbnails/7.jpg)
Resources are not more identifiable in journals with stricter reporting requirements
![Page 8: Biocuration 2014 - The Resource Identification Initiative](https://reader035.fdocuments.net/reader035/viewer/2022062617/54c69fd14a795999798b4586/html5/thumbnails/8.jpg)
http://validation.scienceexchange.com/#/cancer-biology
Attempting to reproduce 50 prominent cancer studies
![Page 9: Biocuration 2014 - The Resource Identification Initiative](https://reader035.fdocuments.net/reader035/viewer/2022062617/54c69fd14a795999798b4586/html5/thumbnails/9.jpg)
Even for some of the highest profile papers, we still have to go back to the authors to identify resources
Resources reported in the 50 Reproducibility Initiative studies show similar results
Vasilevsky et al., 2013, PeerJ Reproducibility Initiativehttp://shar.es/BSsab
![Page 10: Biocuration 2014 - The Resource Identification Initiative](https://reader035.fdocuments.net/reader035/viewer/2022062617/54c69fd14a795999798b4586/html5/thumbnails/10.jpg)
Maybe labs are just disorganized?
![Page 11: Biocuration 2014 - The Resource Identification Initiative](https://reader035.fdocuments.net/reader035/viewer/2022062617/54c69fd14a795999798b4586/html5/thumbnails/11.jpg)
Meet the Urban Lab
Meet the Urban Lab
![Page 12: Biocuration 2014 - The Resource Identification Initiative](https://reader035.fdocuments.net/reader035/viewer/2022062617/54c69fd14a795999798b4586/html5/thumbnails/12.jpg)
A+ organization!
The Urban lab antibodies
![Page 13: Biocuration 2014 - The Resource Identification Initiative](https://reader035.fdocuments.net/reader035/viewer/2022062617/54c69fd14a795999798b4586/html5/thumbnails/13.jpg)
Of 9 antibodies published in 5 articles, only 44% were identifiable
Per
cen
t id
enti
fiab
le
Commerical Ab identifiable
Catalog number reported
Source organism reported
Target uniquely identifiable
0%
25%
50%
75%
100%
![Page 14: Biocuration 2014 - The Resource Identification Initiative](https://reader035.fdocuments.net/reader035/viewer/2022062617/54c69fd14a795999798b4586/html5/thumbnails/14.jpg)
Resource information is not adequately getting into the literature, EVEN
THOUGH IT IS READILY AVAILABLE
The problem is a lack of standards, review, and tools
![Page 15: Biocuration 2014 - The Resource Identification Initiative](https://reader035.fdocuments.net/reader035/viewer/2022062617/54c69fd14a795999798b4586/html5/thumbnails/15.jpg)
http://www.force11.org/Resource_Identification_Initiative
Numerous endorsers https://www.force11.org/RII/SignUpImplementation of the new standard http://biosharing.org/bsg-000532
![Page 16: Biocuration 2014 - The Resource Identification Initiative](https://reader035.fdocuments.net/reader035/viewer/2022062617/54c69fd14a795999798b4586/html5/thumbnails/16.jpg)
Promoting use of Research Resource IDs (RRIDs) in the published literature
Antibodies
Software & Tools
Model Organisms
Pilot project runs from February – April
RRIDs should be: Machine Readable
Consistent across publishers and journals
Free to generate and access
Resources:
![Page 17: Biocuration 2014 - The Resource Identification Initiative](https://reader035.fdocuments.net/reader035/viewer/2022062617/54c69fd14a795999798b4586/html5/thumbnails/17.jpg)
Resource
Identification
Portal
Sample citation: Polyclonal rabbit anti-MAPK3 antibody, Abgent, Cat# AP7251E, RRID:AB_2140114
1. Researcher submits a manuscript for publication
2. Editor or Publisher asks for inclusion of RRID
3. Author goes to Research Identification Portal to locate RRID
4. RRID is included in Methods section and as Keyword
Publishing Workflow
![Page 18: Biocuration 2014 - The Resource Identification Initiative](https://reader035.fdocuments.net/reader035/viewer/2022062617/54c69fd14a795999798b4586/html5/thumbnails/18.jpg)
Potential outcomes
Better reporting of materials and methods Making the literature machine readable
outside the paywall Reduce the curation load Change how we utilize the literature –
observations span journals and formats Credit and citation tracking for contributions
of resources Better retrospective reanalysis of data Ability for authors to subscribe to resources
and semantically similar entities
![Page 19: Biocuration 2014 - The Resource Identification Initiative](https://reader035.fdocuments.net/reader035/viewer/2022062617/54c69fd14a795999798b4586/html5/thumbnails/19.jpg)
Be a beta tester!
http://www.antibodies-online.com/resource-identification-initiative/
Free gift!
![Page 20: Biocuration 2014 - The Resource Identification Initiative](https://reader035.fdocuments.net/reader035/viewer/2022062617/54c69fd14a795999798b4586/html5/thumbnails/20.jpg)
Questions and issues• Should the RRIDs be: DOIs? URIs? Nanopubs?
– Most sources do not create these• Part of a new bibliographic type?
– For pilot, going into keywords to be outside paywall• What is the best way to incorporate the RIID portal
into the publishers workflow?– Provide text-mined checklist when author submits?
• How to best synchronize and coordinate nomenclature with authoritative sources aggregated in the RII Portal?
• How to utilize the RII Portal in dataset contribution to data repositories?