> On Wed, 25 Nov 1998, Ariel Faigon wrote:
> > I've seen way much higher numbers. They are not official, and
> > are not supposed to be used in sales situations, but were obtained
> > in our labs with XFS and arrays that were designed and tuned to
> > maximize bandwidth and to prove that XFS is not the bottleneck.
> > I believe they also used fiberchannel etc. Anyway, there are
> > some much greater experts on this subject on this list if they
> > care to give the details.
> I was under the impression the O2k memory bandwidth was limited to
> ~800MB/s. If so, even if you can read 4GB/s what are you foing to do with
> it? It would have to go over the CrayLink "network" and that doesn't do
> 4GB/s. The only way I can see 4GB/s disk throughput is multiple of the
> node accessing "local" drives and adding all the bandwidth together.
A single node is only 800 MB/s, but an 8P Origin 2000 has four nodes,
and a 32P has 16 nodes. The router network bandwidth scales with the number
of nodes, so the memory bandwidth of a 32P Origin 2000 is far more than enough
for 4 GB/s. If you attach the drives to multiple controllers on multiple
nodes, then it is easy to stripe across them with the volume manager to
get high bandwidth. The volume manager does requests in parallel, so it
is not a bottleneck.
The Origin architecture does not have a central bus, so it is not bus
limited. Just add boxes until the bandwidth is enough for what you need.