Cypheros Transportstream Forum

English-speaking Support => TS-Doctor 1.2 => Thema gestartet von: chalu am Oktober 02, 2010, 12:01:54

Titel: works slowly
Beitrag von: chalu am Oktober 02, 2010, 12:01:54
Hello,

The latest version 1.0.67 works very slowly on my pc to fix errors
my pc: Windows7 64bit, Core i7 920 2.67 GHz, 6 GB ram.
One core works.
After 15 minutes = 4 %

Older versions of TS doctor worked faster.
What's going on ?
Titel: Re:works slowly
Beitrag von: Cypheros am Oktober 02, 2010, 23:48:54
Is there something special with the file e.g. many errors?
Titel: Re:works slowly
Beitrag von: chalu am Oktober 03, 2010, 08:42:40
Not error: I merged 5 files *.ts with version 1.0.67
After to fix errors, there is a bug with version 1.0.67
I tried by answering yes and no for detections of advertising.
TS-Doctor stop , only one core works (on 100 %)
 
With version 1.0.49, the same file is cleaned in 15/20 minutes and there is 0 error.

I think the problem is at the point of reattachment, or the first commercial ad.
I record HDTV in France with the decoder Akira DHB B36HR (http://www.akiraeurope.com/fr/Catalog/4/2/1/).
It make file *.ts (not more 2Go per file) but not standart (192 bytes)


Is it possible to download TS Doctor version 1.0.58 to try ?
Titel: Re:works slowly
Beitrag von: Cypheros am Oktober 03, 2010, 12:29:21
Hi,

older versions can be found here:
http://www.cypheros.de/tsdoctor_alte_versionen_e.html (http://www.cypheros.de/tsdoctor_alte_versionen_e.html)

The TS-Doctor creates a log file for all fixed files. Do you have one of such a "slow" fixing?
Titel: Re:works slowly
Beitrag von: chalu am Oktober 03, 2010, 17:44:33
Yes I have a log but with beta 1.0.66
I believe that it's the same softaware. When i want to install teh last version after beat 1.0.66
There is a window with repair and remove.

The log is more than 800 kb --> with zip it's ok.
Titel: Re:works slowly
Beitrag von: Cypheros am Oktober 03, 2010, 18:27:16
Hi,

I found the reason for the slow down.

Zitat....
Scanning for audio details
$0082 2 different AC3 types detected!
$0082 selecting AC3 type with mode 5.1
Audio stream 1: E-AC3 5.1 48000Hz (FRA)
Audio stream 2: E-AC3 2.0 48000Hz (QAA)
...
Starting at paket $003526F8 PCR: 00:10:29.220 (04:15:05.607)
Error deleting AC3 2.0 packet $003526D4! Packet not found!
Error deleting AC3 2.0 packet $0035270F! Packet not found!
Error deleting AC3 2.0 packet $00352748! Packet not found!
Deleted 0 AC3 2.0 packets for PID $0082!
...

There is a change in number of audio channels from 5.1 to 2.0 (possibly commercial breaks) . If you have the option "Force AC3 type consistence" under Correction behavior activated, the TS-Doctor tries to delete all 2.0 audio parts but this seams not to work correctly and takes alot of time. I guess it's something special with the EAC3 audio stream in your recordings.

This option is only for some hardware players that don't like changes of the number of audio channels.
Try to disable this option.

Maybe you could upload a sample of such a problem file to my FTP-Server then I could try to find out why the EAC3 2.0 packet deletion is not working as it should for French broadcasts.
France seams to be more advances regarding audio standards. Here in Germany we have only AC3 for broadcasts  :'(


Greetings
Cypheros
Titel: Re:works slowly
Beitrag von: CoolRaoul am Oktober 03, 2010, 19:55:32
I jump into this thread since I'm having the same issue (posted here (http://forum.cypheros.de/index.php?topic=18.msg1888#msg1888)).

I do'nt have option "Force AC3 type consistence" set

I'm able to (with some difficulties) abort the check phase (which is fully using a full cpu core for itself)

The "stream error" window wich appears then is filled with "PES ERROR: ControlBitsPTS2" entries

PS: I've also another issue with *both* versions regarding format conversion which hangs at 100% without using any cpu. Maybe I'd  better open a new thread later about this specific problem.
Titel: Re:works slowly
Beitrag von: chalu am Oktober 03, 2010, 20:00:44
yes I have the option "Force AC3 type consistence" under Correction behavior activated.
I try without
it's strange : TS doctor 1.0.58 works faster with this option.
But I think too that commercial breaks  inside video are a problem.
tsMuxer can't make *.m2ts with the file *.ts output TS doctor
at cut commercial, video stop.

ZitatMaybe you could upload a sample of such a problem file to my FTP-Server then I could try to find out why the EAC3 2.0 packet deletion is not working as it should for French broadcasts
the file *.ts are big (2 Go for one, video = 5 files = 9 Go)
How many need you ? with commercial break ?
Titel: Re:works slowly
Beitrag von: Cypheros am Oktober 03, 2010, 21:08:46
Hi,

don't need the whole file. 30 seconds movie + commercials + 30 seconds movie. So I can see the audio channel transitions from 5.1 to 2.0 and back to 5.1.

I'll send you the FTP server access details via PM.

Thanks in advance.
Titel: Re:works slowly
Beitrag von: chalu am Oktober 04, 2010, 09:35:31
It's ok
The name is test.ts
Titel: Re:works slowly
Beitrag von: casha am Oktober 04, 2010, 11:09:37
Hi, i have problem with cutting my streams. (hotbird 13e, channels: polsat HD/ tvp HD)
I attach the log. I have also ts file.
Titel: Re:works slowly
Beitrag von: Cypheros am Oktober 05, 2010, 00:02:44
Zitat von: chalu am Oktober 04, 2010, 09:35:31
It's ok
The name is test.ts


Thanks for the sample file. It's perfect because I can reproduce some strange problems with this sample. Found a bug where the commercial search failed to get the last part of a movie is the file ends with 5.1 channels. This will be fixed in the next Beta.

Also find a problem where the TS-Doctor judges the audio channels wrong if it detects more 2.0 parts than 5.1 parts. I will have to change that for the next version.

The slowdown is caused by the "force AC3 consistence" option. Will find a solution for this, too.
Titel: Re:works slowly
Beitrag von: chalu am Oktober 05, 2010, 19:03:40
Thank you for this job  :)
Titel: Re:works slowly
Beitrag von: CoolRaoul am Oktober 05, 2010, 19:11:21
Zitat von: Cypheros am Oktober 05, 2010, 00:02:44
The slowdown is caused by the "force AC3 consistence" option. Will find a solution for this, too.

Please don't forget that I also have *extreme* slowdowns (haven't got  the patience to wait for job completion) with last version *without* having "force AC3 consistence" option set. 

I'm just currently running another test on a sample .ts file (1,69GB, 2h5mn duration, used "only checking"), TS-doctor process has already used 7 Minutes of cpu time, progress bar is only at 3%


Titel: Re:works slowly
Beitrag von: Cypheros am Oktober 05, 2010, 22:07:30
I would guess that you have many error in the stream and a very big log file. Am I right?

Could you be so kind and post the first 100 lines of the log?
Maybe that sheds light on this problem.
Titel: Re:works slowly
Beitrag von: CoolRaoul am Oktober 05, 2010, 23:50:27
Zitat von: Cypheros am Oktober 05, 2010, 22:07:30
I would guess that you have many error in the stream and a very big log file. Am I right?

Could you be so kind and post the first 100 lines of the log?
Maybe that sheds light on this problem.


Link to log file (zipped): tsdoctor.zip (http://www.cijoint.fr/cj201010/cijJdF4ncH.zip)
Titel: Re:works slowly
Beitrag von: Cypheros am Oktober 06, 2010, 20:18:10
Hi,

in the log you see many many entries like that:

ZitatPES ERROR: For PID 0044 00:00:00.048 PES paket $00000003 is invalid (ControlBitsPTS2), starting with TS paket $0000000A
PES ERROR: For PID 0044 00:00:00.088 PES paket $00000004 is invalid (ControlBitsPTS2), starting with TS paket $0000000B

This means that the PES packet structur is invalid. Did you use any software tool on this stream or is it a direct copy from the receiver?

I will try to suppress this error message so the speed will not influenced so much because of this problem.
Titel: Re:works slowly
Beitrag von: Cypheros am Oktober 06, 2010, 20:27:57
Zitat von: casha am Oktober 04, 2010, 11:09:37
Hi, i have problem with cutting my streams. (hotbird 13e, channels: polsat HD/ tvp HD)
I attach the log. I have also ts file.

Hi, thanks for the many samples but after some short test I can't find any problems. I could cut the files and process them.

Can you describe how I can reproduce  the problem?
Titel: Re:works slowly
Beitrag von: CoolRaoul am Oktober 07, 2010, 08:57:49
Zitat von: Cypheros am Oktober 06, 2010, 20:18:10


This means that the PES packet structur is invalid. Did you use any software tool on this stream or is it a direct copy from the receiver?

It is a direct copy, and I'm able to play that .ts file using vlc or others software players using appropriates directshow filters.

The file comes from a TV recording made with my ISP ADSL-TV Decoder (click here for details (http://en.wikipedia.org/wiki/Freebox))
I have simply transferred the file from the box to the PC using simple ftp.

Don't forget that  previous version os TSdoctor is able to process this file (and others) witout any slowdown.

I may send you a subset of the file to anaylze if you want to

Maybe something around  10 1st megabytes could be sufficient?
Titel: Re:works slowly
Beitrag von: Cypheros am Oktober 07, 2010, 13:23:03
Hi,

10 Mb of the beginning of such a file would be sufficient to analyse the stream structur. You can send it via email to support(at)cypheros(dot)de

Thanks in advance
Cypheros
Titel: Re:works slowly
Beitrag von: casha am Oktober 07, 2010, 14:52:33
Zitat von: Cypheros am Oktober 06, 2010, 20:27:57
Zitat von: casha am Oktober 04, 2010, 11:09:37
Hi, i have problem with cutting my streams. (hotbird 13e, channels: polsat HD/ tvp HD)
I attach the log. I have also ts file.

Hi, thanks for the many samples but after some short test I can't find any problems. I could cut the files and process them.

Can you describe how I can reproduce  the problem?

Ahhh my mistake, bad H.264/AVC Decoder.
Sorry for that  :-\
Titel: Re:works slowly
Beitrag von: CoolRaoul am Oktober 07, 2010, 20:23:16
Zitat von: Cypheros am Oktober 07, 2010, 13:23:03
10 Mb of the beginning of such a file would be sufficient to analyse the stream structur. You can send it via email to support(at)cypheros(dot)de

Done, check your email (message subject "ts sample file to investigate")
Titel: Re:works slowly
Beitrag von: Cypheros am Oktober 07, 2010, 22:01:44
Hi,

thank you for the sample. In the next version the non DVB/ATSC conform control bit settings will produce no longer a slow down during the processing. The hundreds of log entries are also no longer a problem. You will only get an entry in the log so you can see that there is a unconform PES format.

By the way this not conform PES format seams to have no impact on the stream. It runs on my players without problems. Looks like it's broadcasted this way and not an error of the receiver/decoder.

New beta is scheduled for the weekend.

Titel: Re:works slowly
Beitrag von: CoolRaoul am Oktober 13, 2010, 23:28:39
Zitat von: Cypheros am Oktober 07, 2010, 22:01:44
New beta is scheduled for the weekend.
1.0.68 beta seem to have fixed slowdown problem (for me at least)

I'm still having with mkv conversion  freezing at 100% but I can live with it for the moment.
Titel: Re: works slowly
Beitrag von: marcus am Oktober 11, 2011, 00:13:54
Hello,
I didn't use TS-Doctor for some time. When started processing files again, I was surprised to find, that processing takes maybe 50 times longer than before :o. Windows Task manager says that it isn't responding most of the time.
Cleaning ts also takes much longer.
I don't remember if ffdshow icons in the taskbar should be present. Whey are absent.
I am attaching log. Can you help me, please?
Titel: Re: works slowly
Beitrag von: Cypheros am Oktober 11, 2011, 08:29:05
Hi,

could it be that you use a USB memory stick? Most of them have a very low write speed and if you use the stick to read and write at the same time you will get such terrible processing speed.

Made some tests with HDDs and a fast memory stick:

Sample (3,26GB recording, Das Erste (SDTV), DVB-T, the same recording all the time):

Sata-HDD1 to Sata-HDD2 = Speed: 55,7 MBytes/sec
Sata-HDD1 to Sata-HDD1 = Speed: 36,1 MBytes/sec
USB-Stick1 to Sata-HDD2 = Speed: 37,9 MBytes/sec (16GB Transcend JetFlash 700, Read up to 70 Mb/s, Write up to 20 Mb/s )
USB-Stick1 to USB-Stick1 = Speed: 9,3 MBytes/sec (16GB Transcend JetFlash 700, Read up to 70 Mb/s, Write up to 20 Mb/s )

If you use a slow stick the speed will be even lower.
Try to save the file on your HDD and I guess it will be much faster.
Titel: Re: works slowly
Beitrag von: marcus am Oktober 11, 2011, 21:10:29
 :D Thank you. You put me on the right way. Following your advice I transferred recorded files from external drive to my laptop and after processing saved them to my laptop again.
Since it wasn't using slow USB ports anymore[my laptop's USB ports became slower for some reason], all the process became very fast.
Titel: Re: works slowly
Beitrag von: Cypheros am Oktober 11, 2011, 22:43:27
You're welcome  :D