How to increase download speed?

Get help, report and discuss bugs.
Panja
Posts: 119
Joined: 11 Aug 2015, 07:42

How to increase download speed?

Post by Panja » 21 Sep 2017, 14:14

I'm running NZBGet 19.1 in a docker container on my Synology DS415+
The DS415+ is running 4 WD reds in SHR1 (RAID 5).

Since a while we moved from a 150/15 to a 300/30 connection.
My usenet provider is capable of running gigabit speeds.
Using NZBvortex on my Mac I'm hitting the 36-37 MB/s.

Though NZBGet can't keep up with my current bandwidth and is maxing out around 24 MB/s (= 192 mbit).
But mostly it's around 20 - 22 MB/s. I have tried disabling SSL, lowering threads/connections but nothing seems to help.

When I'm hitting the 24 MB/s the cpu is @ 34% max, memory is around 10% (of 8GB).

Is there anything I can do to increase the speed?
Don't get me wrong, 20 (or even a little more sometimes) is quite awesome but more is always better. :lol:

hugbug
Developer & Admin
Posts: 7417
Joined: 09 Sep 2008, 11:58
Location: Germany

Re: How to increase download speed?

Post by hugbug » 21 Sep 2017, 15:37

For the start:

Code: Select all

InterDir=<fast-non-RAID-disk, preferably SSD>
DestDir=<final drive, preferably another physical drive>
FlushQueue=no
ArticleCache=500
WriteBuffer=1024
DirectWrite=yes
WriteLog=rotate (or "none" during testing)
DetailTarget=none
Test with 20 or 30 news server connections (if you have less at the moment).

Also see Performance tips and Performing Speed Tests.

Panja
Posts: 119
Joined: 11 Aug 2015, 07:42

Re: How to increase download speed?

Post by Panja » 21 Sep 2017, 17:10

InterDir=<fast-non-RAID-disk, preferably SSD>
Unfortunately not possible. DS415+ can have 4 disks, already full with 4x WD Red's.

DestDir=<final drive, preferably another physical drive>
Unfortunately not possible. DS415+ can have 4 disks, already full with 4x WD Red's.

FlushQueue=no
Ok, changed this.

ArticleCache=500
This was already set to 512.

WriteBuffer=1024
This was already set at 1024 KB.

DirectWrite=yes
Was already on.

WriteLog=rotate (or "none" during testing)
Was already set to rotate.

DetailTarget=none
Ok, changed this.

Test with 20 or 30 news server connections (if you have less at the moment).
Sorry, forgot to mention I already tried this. I have a it set at 30 connections by default. Tried 20 and 10.
Lowering the connections makes it worse.

After doing some more test with the 2 changes mentioned above (FlushQueue=no + DetailTarget=none) I'm getting a lot more speed now! 8-)

Code: Select all

Download speed	31.6 MB/s
After switching the DetailTarget back to DetailTarget=both but leave the FlushQueue to NO, I get good speeds as well.

Code: Select all

Download speed	31.6 MB/s
So I guess I'll leave FlushQueue to NO.

hugbug
Developer & Admin
Posts: 7417
Joined: 09 Sep 2008, 11:58
Location: Germany

Re: How to increase download speed?

Post by hugbug » 21 Sep 2017, 17:16

Also:

Code: Select all

ContinuePartial=no
What's nzbget and total system CPU usage now?

hugbug
Developer & Admin
Posts: 7417
Joined: 09 Sep 2008, 11:58
Location: Germany

Re: How to increase download speed?

Post by hugbug » 21 Sep 2017, 17:19

And try with WriteLog=none just to make sure logging isn't the issue.

Panja
Posts: 119
Joined: 11 Aug 2015, 07:42

Re: How to increase download speed?

Post by Panja » 21 Sep 2017, 17:48

ContinuePartial=no
WriteLog=none

CPU is around 47% (total).

Getting a little better speeds.
Download speed: 33.3 MB/s

hugbug
Developer & Admin
Posts: 7417
Joined: 09 Sep 2008, 11:58
Location: Germany

Re: How to increase download speed?

Post by hugbug » 21 Sep 2017, 17:53

I suggest to make a speed test as explained in "Performing speed test" (link my first post).

Panja
Posts: 119
Joined: 11 Aug 2015, 07:42

Re: How to increase download speed?

Post by Panja » 21 Sep 2017, 19:00

Ok, done that.
Because the server and client are on the same machine I activated the cache function.
When doing the first download/run it maxed out my disk I/O with almost 100%.
The second run, after the cache was created, gave me a download speed of
CPU was around 60% and the I/O again was very high. The download finished at 27.7 MB/s.

hugbug
Developer & Admin
Posts: 7417
Joined: 09 Sep 2008, 11:58
Location: Germany

Re: How to increase download speed?

Post by hugbug » 21 Sep 2017, 22:53

Have you tested without cache? Because cache on a spinning drive may make performance worse.

Panja
Posts: 119
Joined: 11 Aug 2015, 07:42

Re: How to increase download speed?

Post by Panja » 22 Sep 2017, 09:49

Just did a test without the cache.
Download finished with 28.7 MB/s

Though, this morning I did a "normal" download from usenet with the following changes applied:
FlushQueue=no
ContinuePartial=no
WriteLog=none

And my download finished with 35.3 MB/s

Post Reply

Who is online

Users browsing this forum: No registered users and 9 guests