SSD and config not performing

Get help, report and discuss bugs.
Post Reply
modbox14
Posts: 14
Joined: 15 Oct 2014, 11:05

SSD and config not performing

Post by modbox14 » 10 Jun 2019, 07:06

I bought an SSD to use as a place to have files downloaded to until they are completed and can be moved to HDD. As many others I am sure, I am working with larger files, maybe 30gb on average.

Here are some highlights of settings from me reading the performance tips section of this website:
Direct Write = enabled
Connections = tried all but best speed with max / 30
SSL = makes no difference in speed, so enabled
Article Cache = 200mb
Write Buffer = 1024 (tried it 4096 since I have 16gb and wanted to dedicate 4gb, thinking it would help - it didn't)
Intermediate Directory = supposedly set to my SSD path which I checked via ssh.

I am using a QNAP TS-453Be-2g and have gigabit internet.
I also have confirmed that I am able to get that speed down using my MacBook Pro.

Wondering if anyone has any advice for me here?

Image
Image

sanderj
Posts: 184
Joined: 10 Feb 2014, 21:46

Re: SSD and config not performing

Post by sanderj » 10 Jun 2019, 07:34


modbox14
Posts: 14
Joined: 15 Oct 2014, 11:05

Re: SSD and config not performing

Post by modbox14 » 11 Jun 2019, 03:05

sanderj wrote:
10 Jun 2019, 07:34
Is this a follow-up to https://forum.nzbget.net/viewtopic.php? ... 281#p21281 ?
Sure is.
Figured it was separate enough of support request from the other one to be worthy a fresh post rather than bumping an old one.

hugbug
Developer & Admin
Posts: 7645
Joined: 09 Sep 2008, 11:58
Location: Germany

Re: SSD and config not performing

Post by hugbug » 11 Jun 2019, 07:47

Check CPU usage and disk activity to find out where the bottleneck is. Maybe some process takes most of CPU time.
Put QueueDir and TempDir on SSD. Make sure SSD is formated with a simple file system, not some kind of NAS special. Use latest NZBGet from nzbget download page.

modbox14
Posts: 14
Joined: 15 Oct 2014, 11:05

Re: SSD and config not performing

Post by modbox14 » 13 Jun 2019, 07:14

hugbug wrote:
11 Jun 2019, 07:47
Check CPU usage and disk activity to find out where the bottleneck is. Maybe some process takes most of CPU time.
While downloading:
Average CPU: ~6% with ~3% as system resources and 2-3% for nzbget
Average Memory: 2.65gb / 15.5gb used (16gb installed)
hugbug wrote:
11 Jun 2019, 07:47
Put QueueDir and TempDir on SSD.
I did this and directly after the speeds went to 55MB/s - progress!
hugbug wrote:
11 Jun 2019, 07:47
Make sure SSD is formated with a simple file system, not some kind of NAS special.
I will double check when I'm more awake, but I do believe I thought of this during install. I want to say ext4... I'll have to look up how to figure this out again.
hugbug wrote:
11 Jun 2019, 07:47
Use latest NZBGet from nzbget download page.
Already done.

What else can I do to get this a close to 100MB/s as I can directly plugged in with my MacBook Pro?

hugbug
Developer & Admin
Posts: 7645
Joined: 09 Sep 2008, 11:58
Location: Germany

Re: SSD and config not performing

Post by hugbug » 13 Jun 2019, 08:46

For a test try FlushQueue=no; if that doesn't help it's better to set it back to "yes" then.
Also set ContinuePartial=no.
Increase article cache with ArticleCash=1000. 200 MB can be too small if you download large rar-files with BD-images.

If DirectUnpack is on, test with it "off" to make sure it's not parallel disk access by nzbget and unrar.

Another test: try option SkipWrite=yes - that's only for a test! Don't forget to set it back.

And an important question: are you sure this device can download at 100 MB/s from the Internet? Maybe the connection between the NAS and router isn't that good? Try downloading something with wget or curl. Even better: can you test SAB there?

modbox14
Posts: 14
Joined: 15 Oct 2014, 11:05

Re: SSD and config not performing

Post by modbox14 » 21 Jun 2019, 05:03

hugbug wrote:
13 Jun 2019, 08:46
For a test try FlushQueue=no; if that doesn't help it's better to set it back to "yes" then.
This added 50-60 MB/s. In other words, this fixed the issue; thank you!! Follow up, so why does this help, what is the benefit of flushing the queue, is that like a cleanup of sorts?
hugbug wrote:
13 Jun 2019, 08:46
Also set ContinuePartial=no.
Done. Didn't affect positively / negatively
hugbug wrote:
13 Jun 2019, 08:46
Increase article cache with ArticleCash=1000. 200 MB can be too small if you download large rar-files with BD-images.
This appeared to help about 10%... but seemed to fluctuate back down so who knows. I kept it since it made sense to. Not sure my CPU/RAM combo lets this make a difference in speed? I probably just don't understand it fully enough.
hugbug wrote:
13 Jun 2019, 08:46
If DirectUnpack is on, test with it "off" to make sure it's not parallel disk access by nzbget and unrar.
Done. Didn't affect positively / negatively
hugbug wrote:
13 Jun 2019, 08:46
Another test: try option SkipWrite=yes - that's only for a test! Don't forget to set it back.
Fixed it before I got to this (fortunately I guess, since it seems like a very raw and verbose testing only type thing to isolate an issue?)
hugbug wrote:
13 Jun 2019, 08:46
And an important question: are you sure this device can download at 100 MB/s from the Internet? Maybe the connection between the NAS and router isn't that good? Try downloading something with wget or curl. Even better: can you test SAB there?
Just wanted to comment on this since you took the time to write it - I only found one website to do this from in which I thought would be reliable enough on the server-side to provide that speed... but it gave me about 20 MB/s to the SSD with wget... assuming that site could handle it, not sure why this would be since, as mentioned above, I was after disabling flushqueue about to hit 100-110 MB/s... but not important and I can ask elsewhere to understand this

So my largest question that remains is... why is disabling flushing the queue resolving this issue?

hugbug
Developer & Admin
Posts: 7645
Joined: 09 Sep 2008, 11:58
Location: Germany

Re: SSD and config not performing

Post by hugbug » 22 Jun 2019, 06:22

What is your nzbget version?
Was it installed using official installer from nzbget home page or via a third-party package?

modbox14
Posts: 14
Joined: 15 Oct 2014, 11:05

Re: SSD and config not performing

Post by modbox14 » 22 Jun 2019, 10:10

hugbug wrote:
22 Jun 2019, 06:22
What is your nzbget version?
Was it installed using official installer from nzbget home page or via a third-party package?
Version: 21.0 (latest as of today)
Resource: QNAP App Center (third party repo)

hugbug
Developer & Admin
Posts: 7645
Joined: 09 Sep 2008, 11:58
Location: Germany

Re: SSD and config not performing

Post by hugbug » 22 Jun 2019, 10:55

Now with ContinuePartial=no try activating FlushQueue again.

Post Reply

Who is online

Users browsing this forum: No registered users and 46 guests