Hi,
I am starting to worry about capturing large amounts of data and at high
rates, and then processing it.
For example, I would like to capture, say, a whole IOZONE run with 8
threads all transferring 5GB of data over GigE. That's 40 or more GB of
capture data. Although, I can cut the length captured for each frame, it's
still a lot of data, and if I want to grab say, the write, rewrite, read
and reread sessions, that is 4 times as much data.
My next interest is going to be to capture 10GigE traffic of the same
sort.
What sort of capture devices can we use that can sustain such data rates?
Could we use passive taps, but if we do, that is two GigE streams to
worry about.
Could we use a 64-bit processor, with, say, 64GB of memory, and capture to
memory, and only write to disk after the capture is over (I worry about
having enough memory bandwidth to capture and write that stuff all at
once).
Something to think about, eg.
Regards
-----
Richard Sharpe, rsharpe[at]richardsharpe.com, rsharpe[at]samba.org,
sharpe[at]ethereal.com, http://www.richardsharpe.com
