[BUG?] Hanging downloads

Get help, report and discuss bugs.
hugbug
Developer & Admin
Posts: 7645
Joined: 09 Sep 2008, 11:58
Location: Germany

Explanation to workaround

Post by hugbug » 10 Dec 2008, 13:44

It looks like network errors occur in one thread, but connections are working in other threads.

I do not know what could cause this behaviour, but implemented a workaround. Nzbget counts connection errors. After at least 10 attempts (depends of option "retries", attempts = retries*2, but at least 10) nzbget exits current download thread and retry in another thread.
If my assumption about "damaged networking in one thread" was correct, the workaround should fix the problem.
doctorvangogh wrote:I immediately shutdown the server after seeing six or seven errors in a row.
Do you mean, that errors occur very often and you do not need to wait hours to see them? In that case you dns-script might be a better solution. Nevertheless I would like to know if the implemented workaround works.

doctorvangogh
Posts: 21
Joined: 29 Oct 2008, 01:03
Location: Germany (NRW)

Re: [BUG?] Hanging downloads

Post by doctorvangogh » 10 Dec 2008, 15:01

Well, it's been five weeks since I last encountered the error, but from what i remember once the error occurs, the 'connection' usually hangs. With a retry interval of 30 seconds I've had periods with no sucessfull transfer for more than one or two hours on a particular connection (I presume there's one thread per connection).
What I usually did, was just forsake the hanging download part, unpause a corresponding number of par files and grab the incomplete file from the working directory and do a par repair. Usually in about 75% of all cases the unpaused par would download fine. If it didn't I would just unpause another par ;) I cannot remember ever having to unpause more than 2 or three pars.
hugbug wrote: Do you mean, that errors occur very often and you do not need to wait hours to see them?
Well, this time it sure did. Stopped my r22something nzbget, ran 'make install' for r266, restarted the server from the webinterface and the first couple of lines of the log were: 'daemon started', 'found collection xyz', 'unknown resolver error 110' x7. That was when I shutdown the server again.

But I'll give your workaround another try on my next download.

doctorvangogh
Posts: 21
Joined: 29 Oct 2008, 01:03
Location: Germany (NRW)

Re: Explanation to workaround

Post by doctorvangogh » 11 Dec 2008, 06:55

hugbug wrote:Nevertheless I would like to know if the implemented workaround works.
Well, had some other things to download. Tested r266 without my dns cache script and got
  • tons or resolver errros
  • hanging downloads

Code: Select all

Thu Dec 11 06:24:01 2008	INFO	Collection <Collection A>.nzb found
Thu Dec 11 06:24:02 2008	INFO	Collection <Collection A>.nzb added to queue
Thu Dec 11 06:24:02 2008	INFO	Collection <Collection B>.nzb found
Thu Dec 11 06:24:04 2008	INFO	Collection <Collection B>.nzb added to queue
Thu Dec 11 06:24:43 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:24:43 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:24:43 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:24:43 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:24:43 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:24:43 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:24:43 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:24:43 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:24:43 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:24:43 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:25:53 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:25:53 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:25:53 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:25:53 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:25:53 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:25:53 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:25:53 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:25:53 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:25:53 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:26:53 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 0, Resolver Error 0 (no error)
Thu Dec 11 06:27:03 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:27:03 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:27:03 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:27:03 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:27:03 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:27:03 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:27:03 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:27:03 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:28:14 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:28:14 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:28:14 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:28:14 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:28:14 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:28:14 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:28:14 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:28:14 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:29:24 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:29:24 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:29:24 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:29:24 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:29:24 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:29:24 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:29:24 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:29:24 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:30:12 2008	INFO	Successfully downloaded <Collection A>/<somefile>.<part18>
Thu Dec 11 06:30:34 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:30:34 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:30:34 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:30:34 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:30:34 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:30:34 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:30:34 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:30:34 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:31:44 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:31:44 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:31:44 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:31:44 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:31:44 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:31:44 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:31:44 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:31:44 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 06:32:37 2008	INFO	Successfully downloaded <Collection A>/<somefile>.<part17>

...

Thu Dec 11 07:18:34 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 07:18:34 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 07:19:45 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 07:19:45 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 07:20:47 2008	INFO	Successfully downloaded <Collection A>/<somefile>.<part16>
Thu Dec 11 07:20:56 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 07:20:56 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 07:22:06 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 07:22:06 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 07:23:11 2008	INFO	Successfully downloaded <Collection A>/<somefile>.<part00>
Thu Dec 11 07:23:17 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 07:23:17 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 07:24:27 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 07:24:27 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 07:25:31 2008	INFO	Successfully downloaded <Collection A>/<somefile>.<part05>
Thu Dec 11 07:25:37 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 07:25:37 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 07:26:47 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 07:26:47 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 07:27:48 2008	INFO	Successfully downloaded <Collection B>/<somefile>.<part16>
Thu Dec 11 07:27:58 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 07:27:58 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 07:29:08 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 07:29:08 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 07:30:13 2008	INFO	Successfully downloaded <Collection B>/<somefile>.<part19>
Thu Dec 11 07:30:19 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 07:30:19 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 07:31:29 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 07:31:29 2008	ERROR	Could not resolve hostname <server 1>: ErrNo 110, Unknown resolver error
Thu Dec 11 07:32:14 2008	INFO	Successfully downloaded <Collection A>/<somefile>.<part15>
Thu Dec 11 07:32:14 2008	INFO	Collection <Collection A> completely downloaded
Thu Dec 11 07:32:14 2008	INFO	Queueing <Collection A>/<somefile> for par-check
Thu Dec 11 07:32:14 2008	INFO	Checking pars for <Collection A>/<somefile>
Thu Dec 11 07:32:14 2008	INFO	Verifying <Collection A>/<somefile>
Thu Dec 11 07:32:15 2008	INFO	Loading file <somefile>.par2
Thu Dec 11 07:32:35 2008	INFO	Successfully downloaded <Collection B>/<somefile>.<part12>
Notice the errors right from the start and especially the behavior from 07:25:31 onward:
The second to last part of Collection A downloads, but from then on only parts of Collection B arrive. The last part (<Collection A>/<somefile>.<part15>) refused to download the last MB of it's 50MB.
At 07:31 I reenabled my dns cache script, ran it once to update /etc/hosts, hit pause & resume on the server and 20 seconds later, the previously hanging download finished.

So it seems, the workaround does not fix my particular problem. But since I can work around the problem by caching the hostnames locally, I'm not too bothered by this.

hugbug
Developer & Admin
Posts: 7645
Joined: 09 Sep 2008, 11:58
Location: Germany

Re: [BUG?] Hanging downloads

Post by hugbug » 11 Dec 2008, 08:15

Thanks for testing.
Sorry that the fix doesn't help.
Will see if it works better for licolan.

Post Reply

Who is online

Users browsing this forum: No registered users and 58 guests