[Beowulf] PetaBytes on a budget, take 2

Greg Lindahl lindahl at pbm.com
Thu Jul 21 14:29:56 EDT 2011


On Thu, Jul 21, 2011 at 12:28:00PM -0400, Ellis H. Wilson III wrote:

>  For traditional Beowulfers, spending a year or two developing custom
> software just to manage big data is likely not worth it.

There are many open-souce packages for big data, HDFS being one
file-oriented example in the Hadoop family. While they generally don't
have the features you'd want for running with HPC programs, they do
have sufficient features to do things like backups.

-- greg

_______________________________________________
Beowulf mailing list, Beowulf at beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf

-- 
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.



More information about the Beowulf mailing list