Digiguide grabber detail in 3.10.00W

Discussion of Version 3 and developing lua grabbers
b00sfuk
Posts: 31
Joined: Wed Dec 14, 2005 11:18 am

Digiguide grabber detail in 3.10.00W

Post by b00sfuk » Mon Jun 02, 2008 12:09 pm

Love the new support for grabbing Digiguide data. Got it working but there is only basic data grabbed, is there anything I'm missing to get the full range of fields (series/episode etc.) or is this a "to do"? The associated sageTV DG2XML utility does capture all these fields.
Thanks again

alanbirtles
Site Admin
Posts: 495
Joined: Mon Sep 06, 2004 4:44 pm

Re: Digiguide grabber detail in 3.10.00W

Post by alanbirtles » Mon Jun 02, 2008 2:54 pm

This was something that i knocked together in a few minutes at the request of a gbpvr user. I thought that DG2XML was outputting all of the available data and the grabber simply downloads and parses it. the problem is probably due to the downloaded file not following the xmltv schema (e.g. dates are in the wrong format but the grabber should cope). I will look into it but if you are feeling brave you could fix it yourself by editing the lua

alanbirtles
Site Admin
Posts: 495
Joined: Mon Sep 06, 2004 4:44 pm

Re: Digiguide grabber detail in 3.10.00W

Post by alanbirtles » Mon Jun 02, 2008 2:59 pm

just checked the dg2xml package and it does output non-standard tags which will need translating by the grabber

grahamleggat
Posts: 24
Joined: Wed Oct 06, 2004 8:50 am

Re: Digiguide grabber detail in 3.10.00W

Post by grahamleggat » Mon Jun 02, 2008 6:08 pm

Hi Alan

This is something I've wanted for a long time. Its brilliant that you've incorporated Digiguide as I've been a subscriber to it for years and its in a different league to the Radio Times listings.

I've set it up as instructed, but it hangs on the grabber with the following:

18:03:41 - Starting pass 1 of grabber UK_Digi
18:03:41 - Logging In
18:03:42 - Getting start date
18:03:42 - Downloading h t t p : / / localhost:2402/skin-DG2XML/
sid-815E9693-56BD-4094-9E31-4ECF7B6D30BB/viewmultichannelgrid?
htd=3000&dt=1211821422&chi=0&noc=1000
18:04:42 - Read timed out retrying 5 more times in 3000 ms

Could this be my firewall?

Thanks in advance
Last edited by grahamleggat on Mon Jun 02, 2008 6:10 pm, edited 1 time in total.

alanbirtles
Site Admin
Posts: 495
Joined: Mon Sep 06, 2004 4:44 pm

Re: Digiguide grabber detail in 3.10.00W

Post by alanbirtles » Mon Jun 02, 2008 6:10 pm

possibly, can you open that url in you browser. Also are you using a proxy as the grabber will try and route all communications through the proxy and that wont work for local addresses

alanbirtles
Site Admin
Posts: 495
Joined: Mon Sep 06, 2004 4:44 pm

Re: Digiguide grabber detail in 3.10.00W

Post by alanbirtles » Mon Jun 02, 2008 6:11 pm

or try increasing the timeouts as didiguide can take a while to generate that page if you have a lot of channels

grahamleggat
Posts: 24
Joined: Wed Oct 06, 2004 8:50 am

Re: Digiguide grabber detail in 3.10.00W

Post by grahamleggat » Mon Jun 02, 2008 6:15 pm

Hi Alan

I placed the URL in firefox and it hung for a while then I got a looping output consisting of

50 minutes 25 minutes 5 minutes 30 minutes 27 minutes 3 minutes 30 minutes 30 minutes 1 hour and 30 minutes 10 minutes 8 minutes 2 minutes 1 hour and 55 minutes 5 minutes 1 hour 30 minutes 45 minutes 2 hours and 55 minutes 3 hours and 15 minutes 45 minutes 1 hour 30 minutes 45 minutes 45 minutes 30 minutes 15 minutes 30 minutes 45 minutes 5 minutes 25 minutes 25 minutes 10 minutes 10 minutes 20 minutes 25 minutes 15

Should it have returned the listings within the browser?

Also tried in IE7 and it just hung

Cheers

grahamleggat
Posts: 24
Joined: Wed Oct 06, 2004 8:50 am

Re: Digiguide grabber detail in 3.10.00W

Post by grahamleggat » Mon Jun 02, 2008 6:17 pm

Sorry forgot to mention, not using a proxy

b00sfuk
Posts: 31
Joined: Wed Dec 14, 2005 11:18 am

Re: Digiguide grabber detail in 3.10.00W

Post by b00sfuk » Mon Jun 02, 2008 7:51 pm

Alan, thanks for the replies. I'll look at the tags/grabber and have a play.
N.B. In my limited testing so far I also saw the timeouts. If I increased the defaults, allowed the port through my firewall and also restarted the GUI grabber before each grab then it seemed to work OK.

alanbirtles
Site Admin
Posts: 495
Joined: Mon Sep 06, 2004 4:44 pm

Re: Digiguide grabber detail in 3.10.00W

Post by alanbirtles » Mon Jun 02, 2008 8:22 pm

grahamleggat wrote:Hi Alan

I placed the URL in firefox and it hung for a while then I got a looping output consisting of

50 minutes 25 minutes 5 minutes 30 minutes 27 minutes 3 minutes 30 minutes 30 minutes 1 hour and 30 minutes 10 minutes 8 minutes 2 minutes 1 hour and 55 minutes 5 minutes 1 hour 30 minutes 45 minutes 2 hours and 55 minutes 3 hours and 15 minutes 45 minutes 1 hour 30 minutes 45 minutes 45 minutes 30 minutes 15 minutes 30 minutes 45 minutes 5 minutes 25 minutes 25 minutes 10 minutes 10 minutes 20 minutes 25 minutes 15

Should it have returned the listings within the browser?

Also tried in IE7 and it just hung

Cheers
that is the correct output. Set the timeouts to a minute or more and see if it works

grahamleggat
Posts: 24
Joined: Wed Oct 06, 2004 8:50 am

Re: Digiguide grabber detail in 3.10.00W

Post by grahamleggat » Mon Jun 02, 2008 10:16 pm

Thanks Alan that worked.

I enabled port 4202 on my router as well.

I will test this further and let you know.

Thanks very much :o)))

b00sfuk
Posts: 31
Joined: Wed Dec 14, 2005 11:18 am

Re: Digiguide grabber detail in 3.10.00W

Post by b00sfuk » Tue Jun 03, 2008 8:10 am

I've had a look at the lua files and for some it seems to be a "simple" matter of changing the variable names in xmltv_parse.lua. However I'm stumped when trying to match multiple fields to one in the grabber (e.g. episode num equates to series-number + episode-number and probably for credits sub-fields). Any quick insights? I'm trying to read up on lua syntax but I'm limited with time sitting in front of the PC as I'm recovering from a slipped disc.

Also the channel numbers now have a "UK_Digi_" prefix? I don't know yet if I can use altchids.txt to fix this for import into GB-PVR.

thanks again

alanbirtles
Site Admin
Posts: 495
Joined: Mon Sep 06, 2004 4:44 pm

Re: Digiguide grabber detail in 3.10.00W

Post by alanbirtles » Tue Jun 03, 2008 9:53 am

I made some progress on this last night and have everything apart from the credits working

b00sfuk
Posts: 31
Joined: Wed Dec 14, 2005 11:18 am

Re: Digiguide grabber detail in 3.10.00W

Post by b00sfuk » Tue Jun 03, 2008 11:24 am

alanbirtles wrote:I made some progress on this last night and have everything apart from the credits working
Wow, thanks for spending time working on this.

P.S. seen somebody has just announced your new Digiguide support in the GB-PVR forums.

austinwhite
Posts: 1
Joined: Tue Jun 03, 2008 5:33 pm

Re: Digiguide grabber detail in 3.10.00W

Post by austinwhite » Tue Jun 03, 2008 5:35 pm

Yes, I've seen this on the GBPVR forum, and am anxious to give Digiguide a try. But, no luck, probably due to my ignorance on the related network issues.

The grabber logs on but then times out, even when set to a long timeout. In Digiguide, the web services are set up with the static IP from my router, but I cannot access them, so I think it's a firewall problem, but I don't know what to change. Any ideas?

Post Reply