OGSA-DAI Activities
-
Upload
john-chaney -
Category
Documents
-
view
12 -
download
0
description
Transcript of OGSA-DAI Activities
![Page 1: OGSA-DAI Activities](https://reader035.fdocuments.net/reader035/viewer/2022072014/56812e77550346895d941894/html5/thumbnails/1.jpg)
OGSA -DA I
OGSA-DAI Activities
OGSA-DAI for Developers
GridWorld 2006, Washington DC
11 September 2006
![Page 2: OGSA-DAI Activities](https://reader035.fdocuments.net/reader035/viewer/2022072014/56812e77550346895d941894/html5/thumbnails/2.jpg)
2
OGSA -DA I
http://www.ogsadai.org.uk/
Outline
What are activities? A new activity framework How activities are processed Monitoring
![Page 3: OGSA-DAI Activities](https://reader035.fdocuments.net/reader035/viewer/2022072014/56812e77550346895d941894/html5/thumbnails/3.jpg)
3
OGSA -DA I
http://www.ogsadai.org.uk/
Activity Framework
The Activity Framework is a core component of OGSA-DAI
It is reponsible for performing operations (“activities”) and streaming data
![Page 4: OGSA-DAI Activities](https://reader035.fdocuments.net/reader035/viewer/2022072014/56812e77550346895d941894/html5/thumbnails/4.jpg)
4
OGSA -DA I
http://www.ogsadai.org.uk/
Activities
Activities are specific processing tasks Activities often interact with a data resource Activities usually consume and produce data Activities can be chained by connecting
outputs and inputs
![Page 5: OGSA-DAI Activities](https://reader035.fdocuments.net/reader035/viewer/2022072014/56812e77550346895d941894/html5/thumbnails/5.jpg)
5
OGSA -DA I
http://www.ogsadai.org.uk/
OGSA-DAI Activities
Many activities are shipped with the OGSA-DAI release
Mix and match activities to provide functionality you need
Or implement your own activities that meet specific requirements!
![Page 6: OGSA-DAI Activities](https://reader035.fdocuments.net/reader035/viewer/2022072014/56812e77550346895d941894/html5/thumbnails/6.jpg)
6
OGSA -DA I
http://www.ogsadai.org.uk/
Example Activity Pipeline
DB Query
Delivery
block
block
Produces data in blocks
Stores and provides access to data blocks
Consumes data blocks
Pipe
![Page 7: OGSA-DAI Activities](https://reader035.fdocuments.net/reader035/viewer/2022072014/56812e77550346895d941894/html5/thumbnails/7.jpg)
7
OGSA -DA I
http://www.ogsadai.org.uk/
Activity Processing (Current Release)
Processing of blocks (and therefore, activities) is controlled by the pipe – from outside the activity processBlock() is called many times until
processing is completed Usually consumes and produces a single block
per call
![Page 8: OGSA-DAI Activities](https://reader035.fdocuments.net/reader035/viewer/2022072014/56812e77550346895d941894/html5/thumbnails/8.jpg)
8
OGSA -DA I
http://www.ogsadai.org.uk/
Activity Processing (Future)
Processing of blocks will be controlled by the activity process() is called exactly once Consumes and produces blocks as necessary Each activity in a pipeline processes within
its own thread Pipes receive and may buffer blocks until
they are requested
![Page 9: OGSA-DAI Activities](https://reader035.fdocuments.net/reader035/viewer/2022072014/56812e77550346895d941894/html5/thumbnails/9.jpg)
9
OGSA -DA I
http://www.ogsadai.org.uk/
Current Release
Activity AprocessBlock()
Activity BprocessBlock()
RequestProcessor
processBlock
getBlock block
processBlock block
Called repeatedly
Pipe
![Page 10: OGSA-DAI Activities](https://reader035.fdocuments.net/reader035/viewer/2022072014/56812e77550346895d941894/html5/thumbnails/10.jpg)
10
OGSA -DA I
http://www.ogsadai.org.uk/
Future Release
Activity Aprocess()
Activity Bprocess()
getBlock
process putBlock
block
ProcessingService initialise
process
Called Once
Pipe
![Page 11: OGSA-DAI Activities](https://reader035.fdocuments.net/reader035/viewer/2022072014/56812e77550346895d941894/html5/thumbnails/11.jpg)
11
OGSA -DA I
http://www.ogsadai.org.uk/
Activity Interface
All activities must implement the Activity interface
Activities may extend the abstract BaseActivity class which implements common functionality => only need to implement process()
![Page 12: OGSA-DAI Activities](https://reader035.fdocuments.net/reader035/viewer/2022072014/56812e77550346895d941894/html5/thumbnails/12.jpg)
12
OGSA -DA I
http://www.ogsadai.org.uk/
Activity Extension Interfaces
New interfaces extend the base activity to provide access to necessary information Activities that access data resources Activites that create new requests Activities that are configurable …
![Page 13: OGSA-DAI Activities](https://reader035.fdocuments.net/reader035/viewer/2022072014/56812e77550346895d941894/html5/thumbnails/13.jpg)
13
OGSA -DA I
http://www.ogsadai.org.uk/
Monitoring
Monitoring Framework: Provides Listener interfaces
Activity Listeners: Receive activity events, for example Activity initialised Activity processing Error occurred Processing completed Custom events …
![Page 14: OGSA-DAI Activities](https://reader035.fdocuments.net/reader035/viewer/2022072014/56812e77550346895d941894/html5/thumbnails/14.jpg)
14
OGSA -DA I
http://www.ogsadai.org.uk/
More Listeners
Pipe Listeners: Receive pipe events, for example Block produced Block consumed
Various listeners may be implemented to support logging, auditing, debugging etc.
![Page 15: OGSA-DAI Activities](https://reader035.fdocuments.net/reader035/viewer/2022072014/56812e77550346895d941894/html5/thumbnails/15.jpg)
15
OGSA -DA I
http://www.ogsadai.org.uk/
Summary
The next release of OGSA-DAI will introduce a new Activity Framework
Improved pipeline processing Simplified interfaces A monitoring framework
![Page 16: OGSA-DAI Activities](https://reader035.fdocuments.net/reader035/viewer/2022072014/56812e77550346895d941894/html5/thumbnails/16.jpg)
16
OGSA -DA I
http://www.ogsadai.org.uk/
The End
Questions?
http://www.ogsadai.org.ukOGSA -DA I