Using PVFS

The best way to write code to take advantage of the tremendous speed potential of PVFS2 is to use MPI-IO. ROMIO has been updated to readily use PVFS2. The various hints and data access techniques within ROMIO have been updated to use PVFS2 to the fullest extent possible. This change makes a lot of sense since MPI-IO is part of the MPI-2 standard and is not supposed to change from vendor to vendor.

In addition to MPI-IO, there will be a library for interacting with PVFS2. However rather than have I/O functions that are very close to the UNIX/POSIX I/O functions, these are likely to be closer to the VFS functions that PVFS2 needs for speed and scalability. The difficulty for most people will be the lack of familiarity with the VFS functions in Linux. The best suggestion that Dr. Rob Ross, the lead developer of PVFS2 gives is to, "... suggest that people write serial tools to the UNIX I/O API and parallel ones to the MPI-IO API; that will get them both the best overall performance in the parallel case and the best portability in both cases."

{mosgoogle right}

Sidebar One: Links Mentioned in Column
PVFS1

PVFS2

ROMIO

MPI-2 Book

MPI-IO Doc 1

MPI-IO Doc 2

MPI-IO Doc 3

"Scalable I/O on Clusters, Part 1";, Forrest Hoffman, Linux Magazine, July 2002.

"High Performance I/O PVFS2 for Clusters," Neill Miller, Rob Latham, Rob Ross, and Phil Carns, ClusterWorld Magazine, Vol. 2, No. 4, April 2004.

"A Next Generation Parallel File System for Linux Clusters," Robert Ross, Rob Latham, Neill Miller, and Phillip Carns, January 2004.

"Scalable I/O on Clusters, Part ", Forrest Hoffman, Linux Magazine, August 2002.


This article was originally published in ClusterWorld Magazine. It has been updated and formated for the web. If you want to read more about HPC clusters and Linux you may wish to visit Linux Magazine.

Dr. Jeff Layton hopes to someday have a 20 TB file system in his home computer. He lives in the Atlanta area and can sometimes be found lounging at the nearby Fry's, dreaming of hardware and drinking coffee (but never during working hours).

    Search

    Feedburner

    Login Form

    Share The Bananas


    Creative Commons License
    ©2005-2012 Copyright Seagrove LLC, Some rights reserved. Except where otherwise noted, this site is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 2.5 License. The Cluster Monkey Logo and Monkey Character are Trademarks of Seagrove LLC.