[Beowulf] PetaBytes on a budget, take 2

[Greg Lindahl]

On Thu, Jul 21, 2011 at 02:55:30PM -0400, Ellis H. Wilson III wrote:

> My personal experience with getting large amounts of data from local
> storage to HDFS has been suboptimal compared to something more raw,

If you're writing 3 copies of everything on 3 different nodes, then
sure, it's a lot slower than writing 1 copy. The benefit you get from
this extra up-front expense is resilience.

-- greg


_______________________________________________
Beowulf mailing list, Beowulf at beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf

-- 
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.