Re: hidden buffers for async

[Richard Stallman]

    The number of buffers would be 1:1 with the number of files being
    downloaded. Aggregating the data is the problem I was trying to avoid.
    Because the downloads all finish at different times it makes sorting
    the data difficult.

When you say "sorting the data", do you mean that literally?  What I
would think of doing is simply looking thru the data assembling the
contents that add up to one file, and saving it out when it is
complete.

    I agree that downloading a lot of files will be silly. Perhaps I will
    set up a pool of 20 or so buffers for downloads and block or error
    when the pool is exhausted.

That should work, if it is ok to do only 20 transfers in parallel.
It should block, not error, when all are in use.