Download succes, but file corrupt

Get help, report and discuss bugs.
najarip
Posts: 4
Joined: 24 Apr 2021, 12:54

Download succes, but file corrupt

Post by najarip » 24 Apr 2021, 13:14

Hi,

Since a long time I'm having problems with NZBGet downloading good files. Everything seems OK, no errors, ut the files do not play and appear to be corrupt.
If I download the same NZB on my PC with Sabnzbd, everything is fine.

It doesn't happen with all downloads, but it seems to be getting worse. Maybe it has something to do with downloads with just 1 file and nog RARs, but I could not verify yet.

I use NZBGet 21.0 on a synology nas. Is there anyone who recognizes this problem and knows a fix? Below I will paste the log of one download and if you need it, I can sned the NZB.

Sat Apr 24 2021 14:11:25 INFO Collection Godzilla.vs.Kong.2021.1080p.HMAX.WEB-DL.DDP5.1.Atmos.x264-MZABI.mkv-xpost added to queue
Sat Apr 24 2021 14:11:25 INFO Reordering files for Godzilla.vs.Kong.2021.1080p.HMAX.WEB-DL.DDP5.1.Atmos.x264-MZABI.mkv-xpost
Sat Apr 24 2021 14:36:02 INFO Successfully downloaded Godzilla.vs.Kong.2021.1080p.HMAX.WEB-DL.DDP5.1.Atmos.x264-MZABI.mkv-xpost/abc.xyz.bc57ebc872b7f9.mkv
Sat Apr 24 2021 14:36:02 INFO Collection Godzilla.vs.Kong.2021.1080p.HMAX.WEB-DL.DDP5.1.Atmos.x264-MZABI.mkv-xpost completely downloaded
Sat Apr 24 2021 14:36:02 INFO Queueing Godzilla.vs.Kong.2021.1080p.HMAX.WEB-DL.DDP5.1.Atmos.x264-MZABI.mkv-xpost for post-processing
Sat Apr 24 2021 14:36:03 INFO Checking renamed files for Godzilla.vs.Kong.2021.1080p.HMAX.WEB-DL.DDP5.1.Atmos.x264-MZABI.mkv-xpost
Sat Apr 24 2021 14:36:03 INFO No renamed files found for Godzilla.vs.Kong.2021.1080p.HMAX.WEB-DL.DDP5.1.Atmos.x264-MZABI.mkv-xpost
Sat Apr 24 2021 14:36:03 INFO Checking renamed archive files for Godzilla.vs.Kong.2021.1080p.HMAX.WEB-DL.DDP5.1.Atmos.x264-MZABI.mkv-xpost
Sat Apr 24 2021 14:36:03 INFO No renamed archive files found for Godzilla.vs.Kong.2021.1080p.HMAX.WEB-DL.DDP5.1.Atmos.x264-MZABI.mkv-xpost
Sat Apr 24 2021 14:36:04 INFO Nothing to unpack for Godzilla.vs.Kong.2021.1080p.HMAX.WEB-DL.DDP5.1.Atmos.x264-MZABI.mkv-xpost
Sat Apr 24 2021 14:36:04 INFO Cleaning up Godzilla.vs.Kong.2021.1080p.HMAX.WEB-DL.DDP5.1.Atmos.x264-MZABI.mkv-xpost
Sat Apr 24 2021 14:36:04 INFO Nothing to cleanup for Godzilla.vs.Kong.2021.1080p.HMAX.WEB-DL.DDP5.1.Atmos.x264-MZABI.mkv-xpost
Sat Apr 24 2021 14:36:05 INFO Moving completed files for Godzilla.vs.Kong.2021.1080p.HMAX.WEB-DL.DDP5.1.Atmos.x264-MZABI.mkv-xpost
Sat Apr 24 2021 14:36:05 INFO Moving file abc.xyz.bc57ebc872b7f9.mkv to /xxxxxxxxxxxxxxxxxxxx/downloads/dst/Godzilla.vs.Kong.2021.1080p.HMAX.WEB-DL.DDP5.1.Atmos.x264-MZABI.mkv-xpost
Sat Apr 24 2021 14:36:05 INFO Move for Godzilla.vs.Kong.2021.1080p.HMAX.WEB-DL.DDP5.1.Atmos.x264-MZABI.mkv-xpost successful
Sat Apr 24 2021 14:36:05 INFO Collection Godzilla.vs.Kong.2021.1080p.HMAX.WEB-DL.DDP5.1.Atmos.x264-MZABI.mkv-xpost added to history

hugbug
Developer & Admin
Posts: 7628
Joined: 09 Sep 2008, 11:58
Location: Germany

Re: Download succes, but file corrupt

Post by hugbug » 24 Apr 2021, 13:22

We need more logging.
Set options DetailTarget, WarningTarget, ErrorTarget, InfoTarget to "both".
Delete log file (option LogFile).
Download this nzb again.
Post the whole log-file (not the copy from webui message) via pastebin.com.

najarip
Posts: 4
Joined: 24 Apr 2021, 12:54

Re: Download succes, but file corrupt

Post by najarip » 24 Apr 2021, 15:01

Thank you for your quick reply.
The logsettings are now as you asked.

I could only paste part of the 5MB log, but there is no error whatsoever in the log. The lines I snipped are all the same, apart from the counter. I really don't get why everything seems ok and the file is not.

https://pastebin.com/m2S7uX4e

hugbug
Developer & Admin
Posts: 7628
Joined: 09 Sep 2008, 11:58
Location: Germany

Re: Download succes, but file corrupt

Post by hugbug » 24 Apr 2021, 19:34

This nzb contains video file directly. Usually video files are packed into rar. That adds a CRC verification during unpacking. The nzb also doesn't have par2-files. Therefore there is no way to verify if the file is correct.

Nonetheless assuming nzb includes all necessary articles, if no errors were reported during downloading the file should be correct. Can you download that same nzb on a PC using NZBGet for PC? Then also download with SAB on PC.
Then use some tool to calculate hash (md5 or sha) of all three files to compare if they are the same. Do they have the same size BTW?

najarip
Posts: 4
Joined: 24 Apr 2021, 12:54

Re: Download succes, but file corrupt

Post by najarip » 25 Apr 2021, 16:30

Hi again,

I've downloaded like you asked with Sabnzbd (windows) and NZBGet (Windows). The file sizes are all the same according to windows (all 3 downloads).
The Windows downloaded files both play, the NAS file does not play.

NZBGet NAS:
MD5 hash of Z:\downloads\dst\Godzilla.vs.Kong.2021.1080p.HMAX.WEB-DL.DDP5.1.Atmos.x264-MZABI.mkv-xpost\Godzilla.vs.Kong.2021.1080p.HMAX.WEB-DL.DDP5.1.Atmos.x264-MZABI.mkv-xpost.mkv:
MD5: 85295cea16ff005a6704e92a4859cbcb

NZBGet Windows
MD5 hash of C:\ProgramData\NZBGet\complete\Godzilla.vs.Kong.2021.1080p.HMAX.WEB-DL.DDP5.1.Atmos.x264-MZABI.mkv-xpost\abc.xyz.bc57ebc872b7f9.mkv:
MD5: c92d5a4f51f553cd1358bfbfcf3e8b06

SABNZBD:
MD5 hash of D:\Newspro\downloads\SABComplete\Godzilla.vs.Kong.2021.1080p.HMAX.WEB-DL.DDP5.1.Atmos.x264-MZABI.mkv-xpost\abc.xyz.bc57ebc872b7f9 (3).mkv:
MD5: c92d5a4f51f553cd1358bfbfcf3e8b06

hugbug
Developer & Admin
Posts: 7628
Joined: 09 Sep 2008, 11:58
Location: Germany

Re: Download succes, but file corrupt

Post by hugbug » 25 Apr 2021, 19:20

Could it be the hard drive is failing? If you have multiple drives on NAS try setting InterDir and DestDir to another drive and testest this same nzb.

The NZBGet you use on NAS - was it installed using installer from NZBGet home page? If not - install NZBGet using installer from NZBGet download page and try this same nzb. You can keep your existing NZBGet instance, just shut it down during installing and testing of NZBGet version from home page. You can then delete this Test instance of NZBGet by simply deleting its installation directory. The installer doesn't touch any other files on the system; it install nzbgets into one directory, which can be easily removed.

najarip
Posts: 4
Joined: 24 Apr 2021, 12:54

Re: Download succes, but file corrupt

Post by najarip » 27 Apr 2021, 14:30

I don't think it is the hard drive, I have not seen any errors with other programs and backup, but I will try to verify this.

There are no other drives instelled, but maybe I can use a USB drive just to check for this specific issue.

NZBGet is installed from a synology community (package) I don't know if the default installer will work, do I need the Linux version then, or are there builds for Synology DS214+?

Thank you for your helpful input, I will try all of the above and get back to you, this may take some time...

hugbug
Developer & Admin
Posts: 7628
Joined: 09 Sep 2008, 11:58
Location: Germany

Re: Download succes, but file corrupt

Post by hugbug » 27 Apr 2021, 14:43

Yes, the Linux version. You need terminal access to the NAS.

ryan
Posts: 11
Joined: 25 Sep 2019, 21:23

Re: Download succes, but file corrupt

Post by ryan » 15 May 2021, 18:31

I've been having this issue, also with a nzb that is just the mkv file. The NZB file has par2 files in it.
NZBGet log shows it loading the first par2 file, then "Verifying file: xxxxx.mkv" then "Repair not needed for xxxxx.mkv".

That'z NZBGet running on a Raspberry Pi 4. Currently running version 21.0 on the Pi. Can't recall how I installed it.

I've downloaded the same file on sab on windows 10, and it plays fine.

I've just check md5 on both and they differ.
File sizes are the exact same bytes.
13486152724 on ls -l on the Pi, and 13,486,152,724 on dir on Windows.

I haven't tried NZBGet on Windows yet (just happened to have sab installed from years ago). I can try though if needed.


Some settings info: I previously had ParCheck to Auto. I changed to Always to see if it made a difference. I'm going to try Force.
ParQuick: Yes - I'm going to try No.

Download Queue settings:
ArticleCache: 512 - this was previously 1024, but that would cause nzbget to quit/crash when downloading these mkv files and I'm not sure why. The Pi always has 2gb+ ram available. Lowering to 512 allowed the download to complete, although corrupt.
DirectWrite: Yes
WriteBuffer: 4096

ryan
Posts: 11
Joined: 25 Sep 2019, 21:23

Re: Download succes, but file corrupt

Post by ryan » 15 May 2021, 19:28

I've just downloaded the same nzb again with quick check turned off - the PAR check does now fail: 3127 bad blocks of 3854.
The file size is correct though.

I've installed NZBGet on Windows, and used my Pi's settings - backed up, then restored them to my windows NZBGet install.
That downloaded, and par checked fine, and plays fine.

Is it possible the segments are downloading fine on the Pi, and quickcheck is verifying those as they download and everything is fine, but nzbget (on my Pi4) is writing them to disk incorrectly? I don't have the issue with any rar files I download - I rarely have corruption that needs repairing.

Post Reply

Who is online

Users browsing this forum: No registered users and 15 guests