[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: Why the memory usage of sort does not seem to increase as the input
From: |
Peng Yu |
Subject: |
Re: Why the memory usage of sort does not seem to increase as the input file size increases? |
Date: |
Mon, 26 May 2014 13:45:42 -0500 |
> Sort takes a divide and conquer approach,
> by sorting parts of the input to temporary files,
> and then merging the results with a bounded amount of memory.
>
> sort currently defaults to using a large memory buffer
> to minimize overhead associated with writing and reading
> temp files, so you may be seeing just this large memory
> allocation each time.
>
> The memory allocation can be controlled with --buffer-size
If I have enough memory, is it always faster to sort without using
temp files. How to force sort always use memory only? Thanks.
--
Regards,
Peng