Manager, High Performance File Systems Indiana University
Transcript of Manager, High Performance File Systems Indiana University
![Page 1: Manager, High Performance File Systems Indiana University](https://reader031.fdocuments.net/reader031/viewer/2022012507/6184137bc0372715b061a92d/html5/thumbnails/1.jpg)
Choose LustreStephen Simms
Manager, High Performance File SystemsIndiana University
![Page 2: Manager, High Performance File Systems Indiana University](https://reader031.fdocuments.net/reader031/viewer/2022012507/6184137bc0372715b061a92d/html5/thumbnails/2.jpg)
https://www.flickr.com/photos/kubina/521327318
![Page 3: Manager, High Performance File Systems Indiana University](https://reader031.fdocuments.net/reader031/viewer/2022012507/6184137bc0372715b061a92d/html5/thumbnails/3.jpg)
Lustre is scalable – 55 PB at LLNL
http://www.flickr.com/photos/shadowstorm/404158384/
![Page 4: Manager, High Performance File Systems Indiana University](https://reader031.fdocuments.net/reader031/viewer/2022012507/6184137bc0372715b061a92d/html5/thumbnails/4.jpg)
https://www.flickr.com/photos/jackol/874066https://www.flickr.com/photos/davesag/18735941
![Page 5: Manager, High Performance File Systems Indiana University](https://reader031.fdocuments.net/reader031/viewer/2022012507/6184137bc0372715b061a92d/html5/thumbnails/5.jpg)
Lustre is fast – 1 TB/s at ORNL
http://www.flickr.com/photos/dvd5/163647219/
![Page 6: Manager, High Performance File Systems Indiana University](https://reader031.fdocuments.net/reader031/viewer/2022012507/6184137bc0372715b061a92d/html5/thumbnails/6.jpg)
https://www.flickr.com/photos/johngarghan/5688711425
![Page 7: Manager, High Performance File Systems Indiana University](https://reader031.fdocuments.net/reader031/viewer/2022012507/6184137bc0372715b061a92d/html5/thumbnails/7.jpg)
Lustre can support thousands of clients
vidiot http://www.flickr.com/photos/vidiot/431357888/https://www.flickr.com/photos/gogrimm/3525598147
![Page 8: Manager, High Performance File Systems Indiana University](https://reader031.fdocuments.net/reader031/viewer/2022012507/6184137bc0372715b061a92d/html5/thumbnails/8.jpg)
Lustre is Open
![Page 9: Manager, High Performance File Systems Indiana University](https://reader031.fdocuments.net/reader031/viewer/2022012507/6184137bc0372715b061a92d/html5/thumbnails/9.jpg)
That means it’s “Free Like Beer”
right?
Lustre is Open source software under GPLv2
![Page 10: Manager, High Performance File Systems Indiana University](https://reader031.fdocuments.net/reader031/viewer/2022012507/6184137bc0372715b061a92d/html5/thumbnails/10.jpg)
Actually, more like a free puppy…
![Page 11: Manager, High Performance File Systems Indiana University](https://reader031.fdocuments.net/reader031/viewer/2022012507/6184137bc0372715b061a92d/html5/thumbnails/11.jpg)
It Takes Lots of Work to Maintain Lustre
• Bug Fixes• Rigorous Testing• Feature Development• Maintaining Documentation• Tree Hosting• Code Reviews by Peers
![Page 12: Manager, High Performance File Systems Indiana University](https://reader031.fdocuments.net/reader031/viewer/2022012507/6184137bc0372715b061a92d/html5/thumbnails/12.jpg)
Many Hands Make Lighter Work
Lustre Needs You to Join the Party!
![Page 13: Manager, High Performance File Systems Indiana University](https://reader031.fdocuments.net/reader031/viewer/2022012507/6184137bc0372715b061a92d/html5/thumbnails/13.jpg)
https://www.flickr.com/photos/alvi2047/3688993279/
![Page 14: Manager, High Performance File Systems Indiana University](https://reader031.fdocuments.net/reader031/viewer/2022012507/6184137bc0372715b061a92d/html5/thumbnails/14.jpg)
Lustre is moving forward
• Hiccup when Lustre moved from Oracle
• Lustre 2.0 – Fall 2010• Lustre 2.1 – Fall 2011
• Since then Lustre has accelerated• Goal of 2 major releases a year• Spring / Fall
![Page 15: Manager, High Performance File Systems Indiana University](https://reader031.fdocuments.net/reader031/viewer/2022012507/6184137bc0372715b061a92d/html5/thumbnails/15.jpg)
Alright, alright, stop the marketing
Lustre = Linux +Cluster
Lustre is a parallel distributed file system• High performance filesystem used by >60 of the
top 100 supercomputers in the world• POSIX compliant – behaves like other file systems
![Page 16: Manager, High Performance File Systems Indiana University](https://reader031.fdocuments.net/reader031/viewer/2022012507/6184137bc0372715b061a92d/html5/thumbnails/16.jpg)
Lustre: The Players
MDSmetadata server
ClientOSS
object storageserver
![Page 17: Manager, High Performance File Systems Indiana University](https://reader031.fdocuments.net/reader031/viewer/2022012507/6184137bc0372715b061a92d/html5/thumbnails/17.jpg)
Lustre Architecture - MDS• Metadata Server (MDS)
– Node(s) that manage namespace, file creation and layout, and locking. • Directory operations• File open/close• File status• File creation• Map of file object location
– Relatively expensive serial atomic transactions to maintain consistency
• Metadata Target (MDT)– Block device that stores metadata
![Page 18: Manager, High Performance File Systems Indiana University](https://reader031.fdocuments.net/reader031/viewer/2022012507/6184137bc0372715b061a92d/html5/thumbnails/18.jpg)
Lustre Architecture - OSS
• Object Storage Server (OSS)– Multiple nodes that manage network requests
for file objects on disk.
• Object Storage Target (OST)– Block device that stores file objects
![Page 19: Manager, High Performance File Systems Indiana University](https://reader031.fdocuments.net/reader031/viewer/2022012507/6184137bc0372715b061a92d/html5/thumbnails/19.jpg)
Simplest Lustre System
![Page 20: Manager, High Performance File Systems Indiana University](https://reader031.fdocuments.net/reader031/viewer/2022012507/6184137bc0372715b061a92d/html5/thumbnails/20.jpg)
Lustre Parallel I/O
![Page 21: Manager, High Performance File Systems Indiana University](https://reader031.fdocuments.net/reader031/viewer/2022012507/6184137bc0372715b061a92d/html5/thumbnails/21.jpg)
Striping Data• Lustre allows you to control how data is
written, if you want
– Stripe data across multiple OSTs• can stripe files OR directories
– Can increase I/O performance with reading and writing
– With DNE2 metadata can be Stripedacross multiple MDTs
• Striping analogous to RAID 0
• Default striping set by sysadmin
![Page 22: Manager, High Performance File Systems Indiana University](https://reader031.fdocuments.net/reader031/viewer/2022012507/6184137bc0372715b061a92d/html5/thumbnails/22.jpg)
Take Home MessageChoose Lustre!
It scales – size, speed, clientsIt’s open, growing, and needs your helpIt gives users powerful options Tools available to help with installationFilets, Chops, Removes household odorsAct now and no salesman will visit your home
![Page 23: Manager, High Performance File Systems Indiana University](https://reader031.fdocuments.net/reader031/viewer/2022012507/6184137bc0372715b061a92d/html5/thumbnails/23.jpg)
![Page 24: Manager, High Performance File Systems Indiana University](https://reader031.fdocuments.net/reader031/viewer/2022012507/6184137bc0372715b061a92d/html5/thumbnails/24.jpg)
www.opensfs.org
Open Scalable File Systems, Inc.3855 SW 153rd DriveBeaverton, OR 97006Ph: 503-619-0561Fax: [email protected]
Thank You for Your Time and Attention
Copyright © 2016 OpenSFS.