The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf ·...
Transcript of The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf ·...
![Page 1: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/1.jpg)
The Long Road to JATS
Paul Donohoe – Senior XML Developer Jenny Sherman – XML Developer Ashwin Mistry -‐ XML Developer
Macmillan Science and EducaBon
![Page 2: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/2.jpg)
In the beginning …
• over half a million arBcles (increased to a million by the Bme the project started)
• 143 journals (increased to 180) • three in-‐house DTDs • five typesePers • numerous workflows and producBon systems • teams based across the world
![Page 3: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/3.jpg)
Mapping process
![Page 4: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/4.jpg)
Mapping to JATS – the value of examining the content <!ELEMENT artpubdt (#PCDATA)> <!-‐-‐ Date of iniBal online arBcle publicaBon under "conBnuous publishing" program. -‐-‐> Feasibility report mapping <artpubdt>19991125</artpubdt> Maps to: <pub-‐date pub-‐type="epreprint" year="1999" month="11" day="25"/>
![Page 5: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/5.jpg)
Mapping to JATS – the value of examining the content <!ELEMENT artpubdt (#PCDATA)> <!-‐-‐ Date of iniBal online arBcle publicaBon under "conBnuous publishing" program. -‐-‐> Content-‐based mapping <artpubdt>19991125</artpubdt> Maps to: Nothing. Used for only 10 arBcles in one supplement.
![Page 6: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/6.jpg)
StandardizaBon to JATS
List type mapping from JATS to AJ or NPG
AJ JATS NPG
Numbers 1 2 3 1 2 3 1 2 3
Numbers with parens 1) 2) 3) 1) 2) 3)
LePers a b c a b c a b c
LePers with parens a) b) c) a) b) c)
Uppercase lePers A B C A B C
Roman numerals i ii iii i ii iii i ii iii
Roman numerals with parens i) ii) iii) i) ii) iii)
Uppercase Roman numerals I II III I II III
Bullets • • • • • • • • •
![Page 7: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/7.jpg)
Project kickoff
![Page 8: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/8.jpg)
External needs
![Page 9: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/9.jpg)
Internal needs
![Page 10: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/10.jpg)
ExisBng workflow
Staging Live
![Page 11: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/11.jpg)
ExisBng to final desired workflow
Staging Live
Content Hub
![Page 12: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/12.jpg)
Suggested interim workflow
Staging Live
Staging
![Page 13: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/13.jpg)
Current hybrid workflow
Staging
Live
![Page 14: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/14.jpg)
OpportuniBes
![Page 15: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/15.jpg)
OpportuniBes
npg:baseUriTemplate "{journal-‐id}/{year}/{arBcle-‐id}/" ;
![Page 16: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/16.jpg)
Scrum Development Process
![Page 17: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/17.jpg)
(Re)Write a test
Does the test fail?
(Re)Write production
code
Run all tests
Clean up code
Test Succeeds
Test Fails Tests Fail
All Tests Succeed
Repeat
Test Driven Development
![Page 18: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/18.jpg)
Unit TesBng
![Page 19: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/19.jpg)
MarkLogic
Content Ingestion Service
Content Hub API
Asset Service
Triple-store
Content Gateway
MongoDB
Transformation Service
Validation Service
FTP Hot
Folder
New Publishing Platform
incl
Article Rendering
Search
Product Set Up tool
MySQL
Content Work Flow
Tool
File System
Ontologies
Content Hub Architecture
![Page 20: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/20.jpg)
Core Ontology
![Page 21: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/21.jpg)
Content Hub { "article": { "id": "nplants20151", "titleXml": "<article-title>Plant hormones: On-the-spot reporting</article-title>", ... "hasContributor": { "id": "rainer-waadt-nplants20151", "type": "contributors", "name": "Rainer Waadt", "isCorresponding": true }, ... "hasSummary": { "bodyXml": "<abstract><p>The development of a new ... </p></abstract>", "hasSummaryType": {"id": "standfirst"} }, ... "hasFigure": { "id": "nplants20151-f1", "captionXml": "<p><bold>a</bold>, Expression-based reporters ...</p>", "titleXml": “<title>The toolbox of plant hormone reporters.<title>", "hasImageAsset": {"id": "nplants20151-f1.jpg"} } } }
![Page 22: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/22.jpg)
The Big Picture
![Page 23: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/23.jpg)
New Publishing Plalorm
![Page 24: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/24.jpg)
New Search
![Page 25: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/25.jpg)
Other benefits
![Page 26: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/26.jpg)
![Page 27: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/27.jpg)
ConBnuous Modelling
![Page 28: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/28.jpg)
Four DTDs
![Page 29: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/29.jpg)
Next Steps
• Single environment publishing • Data sends for third parBes • Archive conversion
![Page 30: The$Long$Road$to$JATS$ - Nature Researchdata.nature.com/downloads/docs/The-long-road-to-JATS.pdf · 2015. 5. 18. · The$Long$Road$to$JATS$ Paul$Donohoe$–Senior$XML$Developer$ Jenny$Sherman$–XML$Developer$](https://reader035.fdocuments.net/reader035/viewer/2022071410/61051206930f311dd77774b4/html5/thumbnails/30.jpg)
Lessons Learned
• Don’t start from here! • Do not rely on DTD to DTD mappings • Agile development methodology for tool development