XAM and OSD J Jensen hepsysman RAL June 2008. Filesystem Device Middleware/Apps open(), fopen()...
-
Upload
virginia-banks -
Category
Documents
-
view
215 -
download
0
description
Transcript of XAM and OSD J Jensen hepsysman RAL June 2008. Filesystem Device Middleware/Apps open(), fopen()...
![Page 1: XAM and OSD J Jensen hepsysman RAL June 2008. Filesystem Device Middleware/Apps open(), fopen() Kernel scsi etc.](https://reader036.fdocuments.net/reader036/viewer/2022082621/5a4d1b617f8b9ab0599ad9f5/html5/thumbnails/1.jpg)
XAM and OSD
J Jensenhepsysman RAL June 2008
![Page 2: XAM and OSD J Jensen hepsysman RAL June 2008. Filesystem Device Middleware/Apps open(), fopen() Kernel scsi etc.](https://reader036.fdocuments.net/reader036/viewer/2022082621/5a4d1b617f8b9ab0599ad9f5/html5/thumbnails/2.jpg)
Filesystem
Device
Middleware/Apps
open(), fopen()
Kernel
scsi etc
![Page 3: XAM and OSD J Jensen hepsysman RAL June 2008. Filesystem Device Middleware/Apps open(), fopen() Kernel scsi etc.](https://reader036.fdocuments.net/reader036/viewer/2022082621/5a4d1b617f8b9ab0599ad9f5/html5/thumbnails/3.jpg)
Filesystem
Device
Middleware/Apps
Kernel
File
![Page 4: XAM and OSD J Jensen hepsysman RAL June 2008. Filesystem Device Middleware/Apps open(), fopen() Kernel scsi etc.](https://reader036.fdocuments.net/reader036/viewer/2022082621/5a4d1b617f8b9ab0599ad9f5/html5/thumbnails/4.jpg)
Filesystem
Device
Middleware/Apps
KernelFile meta
data
File
![Page 5: XAM and OSD J Jensen hepsysman RAL June 2008. Filesystem Device Middleware/Apps open(), fopen() Kernel scsi etc.](https://reader036.fdocuments.net/reader036/viewer/2022082621/5a4d1b617f8b9ab0599ad9f5/html5/thumbnails/5.jpg)
Filesystem
Device
Middleware/Apps
Kernel
File
metadataFile
File
metadata
metadata
![Page 6: XAM and OSD J Jensen hepsysman RAL June 2008. Filesystem Device Middleware/Apps open(), fopen() Kernel scsi etc.](https://reader036.fdocuments.net/reader036/viewer/2022082621/5a4d1b617f8b9ab0599ad9f5/html5/thumbnails/6.jpg)
Filesystem
Device
Middleware/Apps
Kernel
File
metadataFile
File
metadata
metadata
![Page 7: XAM and OSD J Jensen hepsysman RAL June 2008. Filesystem Device Middleware/Apps open(), fopen() Kernel scsi etc.](https://reader036.fdocuments.net/reader036/viewer/2022082621/5a4d1b617f8b9ab0599ad9f5/html5/thumbnails/7.jpg)
Introducing OSD
• Object Storage Devices• SNIA (www.snia.org)• Standardisation: ANSI T10
(www.t10.org)
![Page 8: XAM and OSD J Jensen hepsysman RAL June 2008. Filesystem Device Middleware/Apps open(), fopen() Kernel scsi etc.](https://reader036.fdocuments.net/reader036/viewer/2022082621/5a4d1b617f8b9ab0599ad9f5/html5/thumbnails/8.jpg)
Filesystem
Device
Kernel
File metadata
Device stores objects rather than blocksKnows about metadataDevices do space management & security
object
![Page 9: XAM and OSD J Jensen hepsysman RAL June 2008. Filesystem Device Middleware/Apps open(), fopen() Kernel scsi etc.](https://reader036.fdocuments.net/reader036/viewer/2022082621/5a4d1b617f8b9ab0599ad9f5/html5/thumbnails/9.jpg)
DeviceFile meta
data
Panasas
Lustre
• Consistent view, enforced at low level• Improve scalability and performance
object
![Page 10: XAM and OSD J Jensen hepsysman RAL June 2008. Filesystem Device Middleware/Apps open(), fopen() Kernel scsi etc.](https://reader036.fdocuments.net/reader036/viewer/2022082621/5a4d1b617f8b9ab0599ad9f5/html5/thumbnails/10.jpg)
OSD Feature(sets)• Object creation/access
(duh)• Meta: format, list, flush
(partial (v2))• Data Security
– Integrity, in-flight enc• 64 bit friendly CDB
(v2)
• Device security– CDB capabilities (v2)
• Groups (collections)– Bulk ops (v2)
• Partition mgmt– Clone/snapshot (v2)
• Exception mgmt (v2)
![Page 11: XAM and OSD J Jensen hepsysman RAL June 2008. Filesystem Device Middleware/Apps open(), fopen() Kernel scsi etc.](https://reader036.fdocuments.net/reader036/viewer/2022082621/5a4d1b617f8b9ab0599ad9f5/html5/thumbnails/11.jpg)
eXtensible Access Method
• API• Metadata• Records• Querying
Filesystem
Middleware/Apps
Kernel
File
metadataFile
File
metadata
metadata
![Page 12: XAM and OSD J Jensen hepsysman RAL June 2008. Filesystem Device Middleware/Apps open(), fopen() Kernel scsi etc.](https://reader036.fdocuments.net/reader036/viewer/2022082621/5a4d1b617f8b9ab0599ad9f5/html5/thumbnails/12.jpg)
• Storage system can access metadata– Recovery– Device data is meaningful– ILM
![Page 13: XAM and OSD J Jensen hepsysman RAL June 2008. Filesystem Device Middleware/Apps open(), fopen() Kernel scsi etc.](https://reader036.fdocuments.net/reader036/viewer/2022082621/5a4d1b617f8b9ab0599ad9f5/html5/thumbnails/13.jpg)
XSet - XAM Objects
• Hierarchical• XLibrary
> XSystem > XSet
![Page 14: XAM and OSD J Jensen hepsysman RAL June 2008. Filesystem Device Middleware/Apps open(), fopen() Kernel scsi etc.](https://reader036.fdocuments.net/reader036/viewer/2022082621/5a4d1b617f8b9ab0599ad9f5/html5/thumbnails/14.jpg)
XAM to OSD
• Recommendation – XSet to Object– Names stored as OSD attributes– Different options for properties
• Functions to commands• Management policies• Ongoing work…