Welcome to the Linux Foundation Forum!

is the performance of sort command affected by buffer size?

I have load of huge apache log to sort, it takes almost a day to sort 4GB apache log. I would like to know the performance if I set the buffer size to 100MB or above (I have not set it explicitly, and I dont know the default buffer size....I just see a list of the temporary sorting files with the size of 23MB showing up in my disk)

Comments

  • Posts: 501
    What are you using to sort the data set? The system sort command? If so, then I expect that if you have adequate system memory, increasing it to some bigger number than the default will help performance - possibly significantly.
  • Posts: 647
    Of course it's affected by buffer size.

    I'm pretty sure the larger the buffer size is the better

    Regards

Welcome!

It looks like you're new here. Sign in or register to get started.
Sign In

Welcome!

It looks like you're new here. Sign in or register to get started.
Sign In

Categories

Upcoming Training