[Beowulf] High Performance for Large Database
kmurphy at dolphinics.com
Wed Oct 27 06:39:41 EDT 2004
Check out this url http://www.linuxlabs.com/clusgres.html they look like
they have a solution for scaleable Postgres
kmurphy at dolphinics.com
----- Original Message -----
From: "Laurence Liew" <laurenceliew at yahoo.com.sg>
To: "Joshua Marsh" <icub3d at gmail.com>
Cc: <beowulf at beowulf.org>
Sent: Wednesday, October 27, 2004 3:29 AM
Subject: Re: [Beowulf] High Performance for Large Database
> You may wish to search thru the beowulf list or google for "beowulf and
> databases and postgresql"... there were a couple of threads on exeactly
> this issue.
> Very briefly
> 1. Beowulf clusters CANNOT help make Postgresql or any databases run
> faster. You need the database code to be modified to do that (think
> Oracle 10g). I met a company at Supercomputer 03 last year that had
> Mysql running on a cluster... you may wish to query for them.
> 2. You could try to sponsor the development of a parallel postrgresql -
> talk to the postgresql development team... when I broached the idea in
> 1998.. there was some interest.. unfortunately.. I could not afford the
> development/sponsorship costs then.
> 3. Try running Postgresql on a cluster filesystem like PVFS - it is not
> gauranteed as it probably fails the ACID test for a SQL compliant
> database. The basic idea is that if we cannot parallelise the database -
> we make the underlying IO parallel and hence boost the IO performance of
> the system.. and any applications that run on them.. and this includes
> Hope this helps.
> Scalable Systems
> Joshua Marsh wrote:
> > Hi all,
> > I'm currently working on a project that will require fast access to
> > data stored in a postgreSQL database server. I've been told that a
> > Beowulf cluster may help increase performance. Since I'm not very
> > familar with Beowulf clusters, I was hoping that you might have some
> > advice or information on whether a cluster would increase performance
> > for a PostgreSQL database. The major tables accessed are around
> > 150-200 million records. On a stand alone server, it can take several
> > minutes to perform a simple select query.
> > It seems like once we start pricing for servers with 16+ processors
> > and 64+ GB of RAM, the prices sky rocket. If I can acheive high
> > performance with a cluster, using 15-20 dual processor machines, that
> > would be great.
> > Thanks for any help you may have!
> > -Josh
> > _______________________________________________
> > Beowulf mailing list, Beowulf at beowulf.org
> > To change your subscription (digest mode or unsubscribe) visit
> Beowulf mailing list, Beowulf at beowulf.org
> To change your subscription (digest mode or unsubscribe) visit
Beowulf mailing list, Beowulf at beowulf.org
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf
More information about the Beowulf