Reprints from my posting to SAN-Tech Mailing List and ...


[san-tech][03516] "Whamcloud and EMC Collaborate on PLFS and Lustre Integration", April 9, 2012 & Lustre 2.2, March 15, 2012

Date: Tue, 10 Apr 2012 11:34:42 +0900
"Interview: EMC Speeds Lustre Integration with Whamcloud"
  "To get the full story, I caught up with Percy Tzelnic from EMC's CTO
   Office and the SVP Fast Data Group."

"Press Release: Whamcloud and EMC Collaborate on PLFS and Lustre Integration"
 April 9, 2012

  "... The relationship between the two companies began over a year ago
   and promotes the open source availability of Lustre. Whamcloud and EMC,
   a fellow member of the OpenSFS consortium, are extending their
   collaboration for an additional year.

   Whamcloud and EMC will continue working together to provide deeper
   integration between the Parallel Log-structured File System (PLFS)
   and Lustre. ..."

  "PLFS is a parallel IO abstraction layer that rearranges unstructured,
   concurrent writes by many clients into sequential writes to unique
   files (N-1 into N-N) to improve the efficiency of the underlying
   parallel filesystem. PLFS can reduce checkpoint time by up to several
   orders of magnitude. Lustre is an open source massively parallel file
   system, generally used for large scale cluster computing. It is found
   in over 60% of the TOP100 supercomputing sites"

[san-tech][03422] PLFS, a Parallel Log-structured File System, Version2..1, 2011-10-13
  Date: Fri, 16 Dec 2011 21:02:37 +0900
[san-tech][03429] Re: PLFS, a Parallel Log-structured File System, Version2..1, 2011-10-13
  Date: Thu, 22 Dec 2011 09:32:30 +0900
> "Los Alamos and EMC collaborate to advance high-performance computing"
>  December 21, 2011

"Lustre Parallel Directory Operations Coming in Lustre 2.2"
 March 15, 2012
  "Until now in Lustre, filename lookup and file system modifying
   operations (such as create and unlink) were protected by a single
   lock for an entire directory, thus limiting file writes to
   the directory to serialized access. Whamcloud has eliminated this
   bottleneck by introducing a parallel locking mechanism for the entire
   directory. This capability, called parallel directory operations (PDO),
   enables multiple metadata service threads to concurrently perform
   lookup, create, and unlink operations on a single directory.
   Multiple Object Indexes (MOIs) have also been implemented with PDO.
   These allow parallel lookups of a files inode from the File Identifier
   (FID), which is how a client identifies a unique file in the Lustre
   file system."

0 件のコメント: