Bookshelf.EXE - BX A dynamic version of Bookshelf –Automatic submission of algorithm...
-
Upload
patrick-hawkins -
Category
Documents
-
view
213 -
download
0
Transcript of Bookshelf.EXE - BX A dynamic version of Bookshelf –Automatic submission of algorithm...
![Page 1: Bookshelf.EXE - BX A dynamic version of Bookshelf –Automatic submission of algorithm implementations, data and benchmarks into database Distributed computing.](https://reader036.fdocuments.net/reader036/viewer/2022080905/56649cf95503460f949ca3e2/html5/thumbnails/1.jpg)
Bookshelf.EXE - BX
• A dynamic version of Bookshelf– Automatic submission of algorithm implementations,
data and benchmarks into database
• Distributed computing– Distribution of execution of algorithms
• Scripting with data dependencies– Allows for control and data flows for a sequence of
executed algorithm implementations
![Page 2: Bookshelf.EXE - BX A dynamic version of Bookshelf –Automatic submission of algorithm implementations, data and benchmarks into database Distributed computing.](https://reader036.fdocuments.net/reader036/viewer/2022080905/56649cf95503460f949ca3e2/html5/thumbnails/2.jpg)
Bookshelf.EXE - BX
• Nomenclature– Vicereine; main controlling server software
– Diplomat; client (computational hosts) software
• Network backend– XML RPC
• RPC standard – XML data encoding
– HTTP network transport
• C/C++, Perl, Python, etc. compatible
• All communications between modules
Key:ImplementedIn progress
![Page 3: Bookshelf.EXE - BX A dynamic version of Bookshelf –Automatic submission of algorithm implementations, data and benchmarks into database Distributed computing.](https://reader036.fdocuments.net/reader036/viewer/2022080905/56649cf95503460f949ca3e2/html5/thumbnails/3.jpg)
• Web interface– PERL CGI; communicates to BX via XML
RPC– Preliminary interface:– Submit job and data– Results
Bookshelf.EXE – BX
![Page 4: Bookshelf.EXE - BX A dynamic version of Bookshelf –Automatic submission of algorithm implementations, data and benchmarks into database Distributed computing.](https://reader036.fdocuments.net/reader036/viewer/2022080905/56649cf95503460f949ca3e2/html5/thumbnails/4.jpg)
Bookshelf.EXE – BX
• Scheduler– Basic “least load” scheduler
• Plan: Add several heuristics as provided by user
• Data logistics and storage– Berkeley DB2 backend for internal state
– NFS for network transport• Plan: A URL scheme to specify locations
• Data consistency– Callbacks/delegations from server
![Page 5: Bookshelf.EXE - BX A dynamic version of Bookshelf –Automatic submission of algorithm implementations, data and benchmarks into database Distributed computing.](https://reader036.fdocuments.net/reader036/viewer/2022080905/56649cf95503460f949ca3e2/html5/thumbnails/5.jpg)
Bookshelf.EXE• Data properties
– Executables• Architecture, binary format• Input and output formats
– Data/Benchmarks• MIME-like type
– Creates affinity with executables
• Current client (Diplomat) functionality– Start job, kill job, query client
• Current server (Vicereine) functionality– Authenticate (insecure), start job, kill job, submit executable, submit
benchmark
![Page 6: Bookshelf.EXE - BX A dynamic version of Bookshelf –Automatic submission of algorithm implementations, data and benchmarks into database Distributed computing.](https://reader036.fdocuments.net/reader036/viewer/2022080905/56649cf95503460f949ca3e2/html5/thumbnails/6.jpg)
Bookshelf.EXE – BX
Architecture
overview: