Page 1 of 5
How to increase download speed?
Posted: 21 Sep 2017, 14:14
by Panja
I'm running NZBGet 19.1 in a docker container on my Synology DS415+
The DS415+ is running 4 WD reds in SHR1 (RAID 5).
Since a while we moved from a 150/15 to a 300/30 connection.
My usenet provider is capable of running gigabit speeds.
Using NZBvortex on my Mac I'm hitting the 36-37 MB/s.
Though NZBGet can't keep up with my current bandwidth and is maxing out around 24 MB/s (= 192 mbit).
But mostly it's around 20 - 22 MB/s. I have tried disabling SSL, lowering threads/connections but nothing seems to help.
When I'm hitting the 24 MB/s the cpu is @ 34% max, memory is around 10% (of 8GB).
Is there anything I can do to increase the speed?
Don't get me wrong, 20 (or even a little more sometimes) is quite awesome but more is always better.
Re: How to increase download speed?
Posted: 21 Sep 2017, 15:37
by hugbug
For the start:
Code: Select all
InterDir=<fast-non-RAID-disk, preferably SSD>
DestDir=<final drive, preferably another physical drive>
FlushQueue=no
ArticleCache=500
WriteBuffer=1024
DirectWrite=yes
WriteLog=rotate (or "none" during testing)
DetailTarget=none
Test with 20 or 30 news server connections (if you have less at the moment).
Also see
Performance tips and
Performing Speed Tests.
Re: How to increase download speed?
Posted: 21 Sep 2017, 17:10
by Panja
InterDir=<fast-non-RAID-disk, preferably SSD>
Unfortunately not possible. DS415+ can have 4 disks, already full with 4x WD Red's.
DestDir=<final drive, preferably another physical drive>
Unfortunately not possible. DS415+ can have 4 disks, already full with 4x WD Red's.
FlushQueue=no
Ok, changed this.
ArticleCache=500
This was already set to 512.
WriteBuffer=1024
This was already set at 1024 KB.
DirectWrite=yes
Was already on.
WriteLog=rotate (or "none" during testing)
Was already set to rotate.
DetailTarget=none
Ok, changed this.
Test with 20 or 30 news server connections (if you have less at the moment).
Sorry, forgot to mention I already tried this. I have a it set at 30 connections by default. Tried 20 and 10.
Lowering the connections makes it worse.
After doing some more test with the 2 changes mentioned above (FlushQueue=no + DetailTarget=none) I'm getting a lot more speed now!
After switching the DetailTarget back to DetailTarget=both but leave the FlushQueue to NO, I get good speeds as well.
So I guess I'll leave FlushQueue to NO.
Re: How to increase download speed?
Posted: 21 Sep 2017, 17:16
by hugbug
Also:
What's nzbget and total system CPU usage now?
Re: How to increase download speed?
Posted: 21 Sep 2017, 17:19
by hugbug
And try with WriteLog=none just to make sure logging isn't the issue.
Re: How to increase download speed?
Posted: 21 Sep 2017, 17:48
by Panja
ContinuePartial=no
WriteLog=none
CPU is around 47% (total).
Getting a little better speeds.
Download speed: 33.3 MB/s
Re: How to increase download speed?
Posted: 21 Sep 2017, 17:53
by hugbug
I suggest to make a speed test as explained in "Performing speed test" (link my first post).
Re: How to increase download speed?
Posted: 21 Sep 2017, 19:00
by Panja
Ok, done that.
Because the server and client are on the same machine I activated the cache function.
When doing the first download/run it maxed out my disk I/O with almost 100%.
The second run, after the cache was created, gave me a download speed of
CPU was around 60% and the I/O again was very high. The download finished at 27.7 MB/s.
Re: How to increase download speed?
Posted: 21 Sep 2017, 22:53
by hugbug
Have you tested without cache? Because cache on a spinning drive may make performance worse.
Re: How to increase download speed?
Posted: 22 Sep 2017, 09:49
by Panja
Just did a test without the cache.
Download finished with 28.7 MB/s
Though, this morning I did a "normal" download from usenet with the following changes applied:
FlushQueue=no
ContinuePartial=no
WriteLog=none
And my download finished with 35.3 MB/s