Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Cave!: includes fix for #6398
noticable speedup with 6 recorders ( 8 cpu ), max-payload=1000, run twice, took average:
original: Requests imported per second: ~600 requests per second
patched:
request-cache-size=6: ~620 requests per second
request-cache-size=12: ~700 requests per second
request-cache-size=30: ~830 requests per second
maximum with this machine seems to be around 950 - 1000 requests per second
raw values:
no cache:
/tmp/import_orig1: Requests imported per second: 607.05 requests per second
/tmp/import_orig2: Requests imported per second: 612.01 requests per second
cache=6
/tmp/import6_1: Requests imported per second: 646.4 requests per second
/tmp/import6_2: Requests imported per second: 606.66 requests per second
cache=12
/tmp/import12_1: Requests imported per second: 663.66 requests per second
/tmp/import12_2: Requests imported per second: 732.35 requests per second
cache=30:
/tmp/import30_1: Requests imported per second: 833.28 requests per second
/tmp/import30_2: Requests imported per second: 816.96 requests per second
/tmp/import_new: Requests imported per second: 841.25 requests per second
Try: max-payload=2000, cache=100, recorder=6
Requests imported per second: 767.68 requests per second
Try: max-payload=1000, recorder=(2*CPUs)=12
Requests imported per second: 977.24 requests per second
Requests imported per second: 927.23 requests per second