Electronic Platform for Collection, Analysis and Sharing ...
SeedMe Platform for Sharing Research Results
-
Upload
achourasia -
Category
Technology
-
view
243 -
download
0
Transcript of SeedMe Platform for Sharing Research Results
![Page 1: SeedMe Platform for Sharing Research Results](https://reader035.fdocuments.net/reader035/viewer/2022062900/58d031801a28ab04288b5bed/html5/thumbnails/1.jpg)
Your results from disk to device
Stream Encode Explore and Disseminate My Experiments
SeedMe name inspired by Seed : proliferate and grow
![Page 2: SeedMe Platform for Sharing Research Results](https://reader035.fdocuments.net/reader035/viewer/2022062900/58d031801a28ab04288b5bed/html5/thumbnails/2.jpg)
National Science FoundationThis material is based upon work supported by the National Science
Foundation under Grant No. OCI-1235505
AcknowledgementsKristen Levy, Mahidhar Tatineni, Michael Dwyer, Tom Hutton, & Doug Weimer, SDSC
Apple Inc. : Provided test hardware/software on loan during conceptualization phase
TeamAmit Chourasia
Mona WongDavid Nadeau
Andrew FerbertMichael Norman
![Page 3: SeedMe Platform for Sharing Research Results](https://reader035.fdocuments.net/reader035/viewer/2022062900/58d031801a28ab04288b5bed/html5/thumbnails/3.jpg)
Presentation Overview
• Situate context & define problem• Introduce SeedMe• Sample use cases• Sample end user interaction• Q & A
![Page 4: SeedMe Platform for Sharing Research Results](https://reader035.fdocuments.net/reader035/viewer/2022062900/58d031801a28ab04288b5bed/html5/thumbnails/4.jpg)
Computation Cycle
Compute/IngestPost ProcessAnalyze
Monitor?
Validate?
Abstract?
![Page 5: SeedMe Platform for Sharing Research Results](https://reader035.fdocuments.net/reader035/viewer/2022062900/58d031801a28ab04288b5bed/html5/thumbnails/5.jpg)
Monitoring
Validation
Derived Products
Abstraction
![Page 6: SeedMe Platform for Sharing Research Results](https://reader035.fdocuments.net/reader035/viewer/2022062900/58d031801a28ab04288b5bed/html5/thumbnails/6.jpg)
Direct Access Direct Web Sharing
Not All Members
Have Access----
Need Exact Location +
Permissions
Inflexible Security Policy
Derived Products(Preliminary Results)(Transient Content)
Many customers
![Page 7: SeedMe Platform for Sharing Research Results](https://reader035.fdocuments.net/reader035/viewer/2022062900/58d031801a28ab04288b5bed/html5/thumbnails/7.jpg)
WebpageEmail
Download + SendScattered ResultsCan’t share larger contentManual
Download + UploadHandle Privacy Significant time commitmentManual
Cloud Drive
Download + UploadCannot describe contentManual
Sharing Derived Products(Many customers)
![Page 8: SeedMe Platform for Sharing Research Results](https://reader035.fdocuments.net/reader035/viewer/2022062900/58d031801a28ab04288b5bed/html5/thumbnails/8.jpg)
Compute Anticipate React
Waterworld (1995)
![Page 9: SeedMe Platform for Sharing Research Results](https://reader035.fdocuments.net/reader035/viewer/2022062900/58d031801a28ab04288b5bed/html5/thumbnails/9.jpg)
Accessibility Irony1993
“NCSA Mosaic, or simply Mosaic, is the web browser credited with popularizing the World Wide Web.”
Mosaic (Web browser), Wikipediahttp://en.wikipedia.org/wiki/Mosaic_(web_browser)
1990“The web was originally conceived and developed to meet the demand for automatic information-sharing between scientists in universities and institutes around the world.”
The birth of the web. CERNhttp://home.web.cern.ch/topics/birth-web
Mission Dashboard at NASA – JPL Voyager space crafts have been sharing
information since 1977
2007Mobile devices can share content instantly
2014Computation simulations cannot share information with us
• No place to push information (no infrastructure)• Lack of easy tools
![Page 10: SeedMe Platform for Sharing Research Results](https://reader035.fdocuments.net/reader035/viewer/2022062900/58d031801a28ab04288b5bed/html5/thumbnails/10.jpg)
Pitfalls in sharing derived content
Download Upload
Download (Round Trip + 1)
Video Encoding
Complexity
Missing Easy Automation
How To Describe &
Discuss Content
Replication &
Scalability
![Page 11: SeedMe Platform for Sharing Research Results](https://reader035.fdocuments.net/reader035/viewer/2022062900/58d031801a28ab04288b5bed/html5/thumbnails/11.jpg)
Why not use existing tools?
![Page 12: SeedMe Platform for Sharing Research Results](https://reader035.fdocuments.net/reader035/viewer/2022062900/58d031801a28ab04288b5bed/html5/thumbnails/12.jpg)
Your results from disk to device
SeedMe offers you to• Seamlessly seed (upload) your research content• Share and access your content• Generate dashboards for your simulation or expt.• Describe your content (everything is not a file)• Discuss your work, right next to your content
![Page 13: SeedMe Platform for Sharing Research Results](https://reader035.fdocuments.net/reader035/viewer/2022062900/58d031801a28ab04288b5bed/html5/thumbnails/13.jpg)
SeedMe Collection
Ticker(Text)
Ephemeral
Sequences(Image set)
Videos(video)
Files(Catch all)
Meta Data(Title, Description, Tags, Key Value Pairs, Credits, License)
Privacy + Collaborators(Public, Group, Private) + (emails)
Plots(Image)
![Page 14: SeedMe Platform for Sharing Research Results](https://reader035.fdocuments.net/reader035/viewer/2022062900/58d031801a28ab04288b5bed/html5/thumbnails/14.jpg)
SeedMe: How it Works
![Page 15: SeedMe Platform for Sharing Research Results](https://reader035.fdocuments.net/reader035/viewer/2022062900/58d031801a28ab04288b5bed/html5/thumbnails/15.jpg)
SeedMe User Interactions
• Create Collection ( CLI, API, Web Browser)
• Update Collection ( CLI, API, Web Browser)
• View Collection (Web Browser only)
![Page 16: SeedMe Platform for Sharing Research Results](https://reader035.fdocuments.net/reader035/viewer/2022062900/58d031801a28ab04288b5bed/html5/thumbnails/16.jpg)
Hardware
Software
MySQL
Drupal
Apache
Gearman Scheduler
Web nodes Storage
Video encoding
nodes
Responsive Web Output
Desktops
Phones
Tablets
IngestionHTTPSWeb
Browser REST
SeedMe Architecture
Network Switch 20 gbe20 gbe
![Page 17: SeedMe Platform for Sharing Research Results](https://reader035.fdocuments.net/reader035/viewer/2022062900/58d031801a28ab04288b5bed/html5/thumbnails/17.jpg)
SeedMe Processing
Ingestion (Atomic or Recurring)
Instant Processing
(Text, Images)
NotificationResponsive
Content Access
Batch Processing
(Videos)
![Page 18: SeedMe Platform for Sharing Research Results](https://reader035.fdocuments.net/reader035/viewer/2022062900/58d031801a28ab04288b5bed/html5/thumbnails/18.jpg)
Use Case: Sequence to VideoSequences of images are generated by
Visualizations Confocal scans Time lapse recording
Requirements Frame rate High Quality
EncodingUniversal playbackAutomation
seedme.cmd -t “Seq Collection” \ # Collection title
-sp "sample/sequences/steam" \ # Seq Path
-st "sequence title" \ # Seq Title
-sd "Desc of sequence" \ # Seq Description
-sr "5" \ # Seq frame Rate
-se # Trigger Seq Encode
Command line example, but you can upload content simply via Web Browser
![Page 19: SeedMe Platform for Sharing Research Results](https://reader035.fdocuments.net/reader035/viewer/2022062900/58d031801a28ab04288b5bed/html5/thumbnails/19.jpg)
Use Case: Create DashboardsResults from simulations, instruments, analysis
Files Plots SequencesVideos
Requirements Managed SharingUniversal accessAutomation
seedme.cmd -t “Quick Start” \ # Collection title
-privacy group \ # Privacy
-email [email protected] \ # Share
-notify \ # Notify (not automatic)
-pp "sample/plots/node.png" \ # Plot Path -sp "sample/sequences/steam" \ # Seq Path
-vp "sample/videos/air.mp4" \ # Video Path
-fp "sample/files/doc.pdf” # File Path
Command line example, but you can upload content simply via Web Browser
![Page 20: SeedMe Platform for Sharing Research Results](https://reader035.fdocuments.net/reader035/viewer/2022062900/58d031801a28ab04288b5bed/html5/thumbnails/20.jpg)
Use Case: MonitorComputation state
Progress %Progress parametersLast file created
Requirements SharingUniversal accessAutomation
seedme.cmd -t “Progress Tracking” \ # Create new Collection
seedme.cmd -update 29643 \ # Update collection ID
-tic "step 1" \ # Ticker Text
-tic "step 2" \ # Ticker Text
-fp "sample/files/doc.pdf” # File Path
Command line example, but you can upload content simply via Web Browser
![Page 21: SeedMe Platform for Sharing Research Results](https://reader035.fdocuments.net/reader035/viewer/2022062900/58d031801a28ab04288b5bed/html5/thumbnails/21.jpg)
Use Case: Share & Reuse
Disseminate
Share and reuse content IPython notebook
State files from vis tools
R scriptsMatlab scripts
Applications Exploring :‘Save to SeedMe’
Kepler Workflow
VisIt softwareYT software
Integrate SeedMe Python Module or write your own REST client
![Page 22: SeedMe Platform for Sharing Research Results](https://reader035.fdocuments.net/reader035/viewer/2022062900/58d031801a28ab04288b5bed/html5/thumbnails/22.jpg)
Demo: Web Browser
Types of Collections: My Shared Publichttp://www.seedme.org/collections
You may Add, Edit and Notify collaborators
Add a new collectionhttps://www.seedme.org/collections/add
View a collection with monitoring infohttps://www.seedme.org/collection/14924
View a collection with variety of contenthttps://www.seedme.org/collection/16567
![Page 23: SeedMe Platform for Sharing Research Results](https://reader035.fdocuments.net/reader035/viewer/2022062900/58d031801a28ab04288b5bed/html5/thumbnails/23.jpg)
seedme.cmd -title "SeedMe Quick Start"
seedme.cmd -update 29643 \ # Update-fp "sample/files/doc.pdf" \ # File Path-pp "sample/plots/node.png" \ # Plot Path-sp "sample/sequences/steam" \ # Seq Dir
Path
-vp "sample/videos/air.mp4" \ # Video Path
seedme.cmd -update 29643 \ -privacy group \ -email [email protected] \ -email [email protected]
seedme.cmd -update 29643 -notify
Demo: Command Line InteractionCreate a new
collection
Add image seq.+ create video
from it
Setup sharing
Notify Group
![Page 24: SeedMe Platform for Sharing Research Results](https://reader035.fdocuments.net/reader035/viewer/2022062900/58d031801a28ab04288b5bed/html5/thumbnails/24.jpg)
Getting Started
Interaction• Web Browser• Standalone executable
(command line)• Python module with API
(demo.py)• Curl
Information• Quick Start Guide• Use Cases• Documentation• Tips for C, Fortran codes• Blog
![Page 25: SeedMe Platform for Sharing Research Results](https://reader035.fdocuments.net/reader035/viewer/2022062900/58d031801a28ab04288b5bed/html5/thumbnails/25.jpg)
Signup / Share http://www.seedme.org
Contact Usamit sdsc.edu
https://www.seedme.org/contact
Twitter@SeedmeOrg