EPGImport mod from Dorik1972 Latest

Tools EPGImport mod from Dorik1972 Latest New Fix for Version 1.9.0

No permission to download

Ferret.

Administrator
Staff member
Ferret. submitted a new resource:

EPGImport mod from Dorik1972 Version 1.4 - EPGImport mod from Dorik1972 Version 1.4

EPGImport mod from Dorik1972
Version 1.4


plugin.png


Differences from the original
1) The algorithm for "bypassing" xmltv and parsing events is maximally optimized and accelerated.
2) All file uploads have been changed to twisted.web.client.Agent (), instead of deprecated getPage and downloadPage
3) Checking ssl certificates is completely disabled. In the case of downloading xmltv and channels.xml - no threat : '(. Zero problems with...

Read more about this resource...
 
Ferret. updated EPGImport mod from Dorik1972 Version 1.4 with a new update entry:

EPGImport mod from Dorik1972 Version1.5

EPGImport mod from Dorik1972

Version1.5


In Agent.request, by default, there is only the connectTimeout parameter, in fact, as in any other method tied to the Agent. This timeout only affects the TCP connection setup timeout. Setting it to 5 means that if a TCP connection to the HTTP server for a specific URL cannot be established in less than 5 seconds, the request attempt will fail with a timeout error. However, if the connection is successfully established, the timeout no longer...

Read the rest of this update entry...
 
Tried 1.89 and it trows an exception and nothing is stored:

Code:
journalctl -f | grep EPG
Aug 24 11:47:34 dm7080 enigma2[290]: [EPGC] cleanupOutdated
Aug 24 11:47:41 dm7080 enigma2[290]: warning, skin is missing element key_blue in <class 'Plugins.Extensions.EPGImport.plugin.EPGImportSources'>
Aug 24 11:47:51 dm7080 enigma2[290]: [EPGImport] Selected source: "red"
Aug 24 11:47:53 dm7080 enigma2[290]: [EPGImport] Oudeis patch not detected, using eEPGCache.load
Aug 24 11:47:53 dm7080 enigma2[290]: [EPGDB] save EPG cache to /media/SanDisk240GB/XMLTV-EPG/epg.db
Aug 24 11:47:53 dm7080 enigma2[290]: [EPGC] db thread stopped
Aug 24 11:47:53 dm7080 enigma2[290]: [EPGC] Saving database from memory
Aug 24 11:47:53 dm7080 enigma2[290]: [EPGImport] EPG database located at /media/SanDisk240GB/XMLTV-EPG/epg.db
Aug 24 11:47:53 dm7080 enigma2[290]: [EPGImport] ### start import, source = "red"
Aug 24 11:47:53 dm7080 enigma2[290]: [EPGImport] Downloading: http://*****&next_days=7 to local path: /media/hdd/epgimport.tmp
Aug 24 11:47:53 dm7080 enigma2[290]: [EPGImport] Not checking the server since nocheck is set for: http://****&next_days=7
Aug 24 11:47:54 dm7080 enigma2[290]: [EPGC] db thread started
Aug 24 11:47:54 dm7080 enigma2[290]: [EPGC] start caching events(1661334474)
Aug 24 11:47:54 dm7080 enigma2[290]: [EPGDB] epgcache save finished
Aug 24 11:48:01 dm7080 enigma2[290]: [EPGC] abort non avail schedule other reading
Aug 24 11:48:01 dm7080 enigma2[290]: [EPGC] abort non avail viasat reading
Aug 24 11:48:10 dm7080 enigma2[290]: [EPGC] nownext finished(1661334490)
Aug 24 11:48:32 dm7080 enigma2[290]: [EPGImport] afterDownload /media/hdd/epgimport.tmp
Aug 24 11:48:32 dm7080 enigma2[290]: [EPGImport] unlink /media/hdd/epgimport.tmp
Aug 24 11:48:32 dm7080 enigma2[290]: [EPGImport] afterChannelDownload None
Aug 24 11:48:32 dm7080 enigma2[290]: [EPGImport] ### using twisted thread, yay!
Aug 24 11:48:32 dm7080 enigma2[290]: [EPGConfig] Enumerating channels lookup table XML file
Aug 24 11:48:34 dm7080 enigma2[290]: [EPGConfig] Processed: 1468 channels
Aug 24 11:48:34 dm7080 enigma2[290]: [EPGConfig] Formed lookup table for: 779 channels id
Aug 24 11:48:34 dm7080 enigma2[290]: [XMLTVConverter] Keep outdated EPG set to: 01:00:00
Aug 24 11:48:41 dm7080 enigma2[290]: [EPGC] schedule finished(1661334521)
Aug 24 11:48:41 dm7080 enigma2[290]: [EPGC] stop caching events(1661334521)
Aug 24 11:48:41 dm7080 enigma2[290]: [EPGC] next update in 60 min
Aug 24 11:48:42 dm7080 enigma2[290]: [EPGDB] not connected, retrying
Aug 24 11:48:42 dm7080 enigma2[290]: [EPGDB] /media/SanDisk240GB/XMLTV-EPG/epg.db exists
Aug 24 11:48:42 dm7080 enigma2[290]: [EPGDB] connect to /media/SanDisk240GB/XMLTV-EPG/epg.db failed
Aug 24 11:48:44 dm7080 enigma2[290]: [EPGImport] ### importEvents exception: NameError("global name 'connection' is not defined",) (71 times)
Aug 24 11:48:44 dm7080 enigma2[290]: [EPGImport] ### importEvents exception: NameError("global name 'connection' is not defined",) (26 times)
Aug 24 11:48:47 dm7080 enigma2[290]: [EPGC] cleanup invalid data
Aug 24 11:48:48 dm7080 enigma2[290]: [EPGImport] ### importEvents exception: NameError("global name 'connection' is not defined",) (15 times)
Aug 24 11:48:49 dm7080 enigma2[290]: [EPGImport] ### importEvents exception: NameError("global name 'connection' is not defined",) (25 times)
Aug 24 11:48:50 dm7080 enigma2[290]: [EPGImport] ### importEvents exception: NameError("global name 'connection' is not defined",) (54 times)
Aug 24 11:48:50 dm7080 enigma2[290]: [EPGImport] ### importEvents exception: NameError("global name 'connection' is not defined",) (4 times)
Aug 24 11:48:51 dm7080 enigma2[290]: [EPGImport] ### importEvents exception: NameError("global name 'connection' is not defined",) (43 times)
Aug 24 11:48:51 dm7080 enigma2[290]: [EPGImport] ### importEvents exception: NameError("global name 'connection' is not defined",) (11 times)
.
.
.

uname -a
Linux dm7080 3.4-4.0-dm7080 #1 SMP Fri Feb 9 15:16:04 UTC 2018 mips mips mips GNU/Linux

DreamOS
 
Tried 1.89 and it trows an exception and nothing is stored:

Code:
journalctl -f | grep EPG
Aug 24 11:47:34 dm7080 enigma2[290]: [EPGC] cleanupOutdated
Aug 24 11:47:41 dm7080 enigma2[290]: warning, skin is missing element key_blue in <class 'Plugins.Extensions.EPGImport.plugin.EPGImportSources'>
Aug 24 11:47:51 dm7080 enigma2[290]: [EPGImport] Selected source: "red"
Aug 24 11:47:53 dm7080 enigma2[290]: [EPGImport] Oudeis patch not detected, using eEPGCache.load
Aug 24 11:47:53 dm7080 enigma2[290]: [EPGDB] save EPG cache to /media/SanDisk240GB/XMLTV-EPG/epg.db
Aug 24 11:47:53 dm7080 enigma2[290]: [EPGC] db thread stopped
Aug 24 11:47:53 dm7080 enigma2[290]: [EPGC] Saving database from memory
Aug 24 11:47:53 dm7080 enigma2[290]: [EPGImport] EPG database located at /media/SanDisk240GB/XMLTV-EPG/epg.db
Aug 24 11:47:53 dm7080 enigma2[290]: [EPGImport] ### start import, source = "red"
Aug 24 11:47:53 dm7080 enigma2[290]: [EPGImport] Downloading: http://*****&next_days=7 to local path: /media/hdd/epgimport.tmp
Aug 24 11:47:53 dm7080 enigma2[290]: [EPGImport] Not checking the server since nocheck is set for: http://****&next_days=7
Aug 24 11:47:54 dm7080 enigma2[290]: [EPGC] db thread started
Aug 24 11:47:54 dm7080 enigma2[290]: [EPGC] start caching events(1661334474)
Aug 24 11:47:54 dm7080 enigma2[290]: [EPGDB] epgcache save finished
Aug 24 11:48:01 dm7080 enigma2[290]: [EPGC] abort non avail schedule other reading
Aug 24 11:48:01 dm7080 enigma2[290]: [EPGC] abort non avail viasat reading
Aug 24 11:48:10 dm7080 enigma2[290]: [EPGC] nownext finished(1661334490)
Aug 24 11:48:32 dm7080 enigma2[290]: [EPGImport] afterDownload /media/hdd/epgimport.tmp
Aug 24 11:48:32 dm7080 enigma2[290]: [EPGImport] unlink /media/hdd/epgimport.tmp
Aug 24 11:48:32 dm7080 enigma2[290]: [EPGImport] afterChannelDownload None
Aug 24 11:48:32 dm7080 enigma2[290]: [EPGImport] ### using twisted thread, yay!
Aug 24 11:48:32 dm7080 enigma2[290]: [EPGConfig] Enumerating channels lookup table XML file
Aug 24 11:48:34 dm7080 enigma2[290]: [EPGConfig] Processed: 1468 channels
Aug 24 11:48:34 dm7080 enigma2[290]: [EPGConfig] Formed lookup table for: 779 channels id
Aug 24 11:48:34 dm7080 enigma2[290]: [XMLTVConverter] Keep outdated EPG set to: 01:00:00
Aug 24 11:48:41 dm7080 enigma2[290]: [EPGC] schedule finished(1661334521)
Aug 24 11:48:41 dm7080 enigma2[290]: [EPGC] stop caching events(1661334521)
Aug 24 11:48:41 dm7080 enigma2[290]: [EPGC] next update in 60 min
Aug 24 11:48:42 dm7080 enigma2[290]: [EPGDB] not connected, retrying
Aug 24 11:48:42 dm7080 enigma2[290]: [EPGDB] /media/SanDisk240GB/XMLTV-EPG/epg.db exists
Aug 24 11:48:42 dm7080 enigma2[290]: [EPGDB] connect to /media/SanDisk240GB/XMLTV-EPG/epg.db failed
Aug 24 11:48:44 dm7080 enigma2[290]: [EPGImport] ### importEvents exception: NameError("global name 'connection' is not defined",) (71 times)
Aug 24 11:48:44 dm7080 enigma2[290]: [EPGImport] ### importEvents exception: NameError("global name 'connection' is not defined",) (26 times)
Aug 24 11:48:47 dm7080 enigma2[290]: [EPGC] cleanup invalid data
Aug 24 11:48:48 dm7080 enigma2[290]: [EPGImport] ### importEvents exception: NameError("global name 'connection' is not defined",) (15 times)
Aug 24 11:48:49 dm7080 enigma2[290]: [EPGImport] ### importEvents exception: NameError("global name 'connection' is not defined",) (25 times)
Aug 24 11:48:50 dm7080 enigma2[290]: [EPGImport] ### importEvents exception: NameError("global name 'connection' is not defined",) (54 times)
Aug 24 11:48:50 dm7080 enigma2[290]: [EPGImport] ### importEvents exception: NameError("global name 'connection' is not defined",) (4 times)
Aug 24 11:48:51 dm7080 enigma2[290]: [EPGImport] ### importEvents exception: NameError("global name 'connection' is not defined",) (43 times)
Aug 24 11:48:51 dm7080 enigma2[290]: [EPGImport] ### importEvents exception: NameError("global name 'connection' is not defined",) (11 times)
.
.
.

uname -a
Linux dm7080 3.4-4.0-dm7080 #1 SMP Fri Feb 9 15:16:04 UTC 2018 mips mips mips GNU/Linux

DreamOS
Your on an old version try this
 

Attachments

  • enigma2-plugin-extensions-EPGImport-mod-dorik1972_1.8.9_all.deb (1).rar
    122.1 KB · Views: 4
Your on an old version try this
Thanks for the plugin but that one can't be mixed the version of last Friday (1.89) and it seems that I will have to wait till this plugin is also updated. I am now back at much older version (1.84) of the plugin that works fine after having changed the extension check on the downloaded XML files.
 
Last edited:
Thanks for the plugin but that one can't be mixed the version of last Friday (1.89) and it seems that I will have to wait till this plugin is also updated. I am now back at much older version (1.84) of the plugin that works fine after having changed the extension check on the downloaded XML files.
Have you not been using the dorik1972 mod version then ?
 
@Ferret. is this a good EPG downloader for OpenATV? I'm currently on version 6.4 (Is version 7 stable? or even public?

I've used CrossEPG in the past but its always crashed when using it on a VU box.
 
I would not use OpenATV 7 myself and im a OpenATV fan.

This epgimport or just the standard version is fine for me on 6.4
 
Pepsik and I had many discussions and most stuff is now solved in 1.91 updated. A big problem is still importing sources with a separate channels list. I posted a work-around for it. Pepsik will try to solve it in the future so patience is a good thing.

In EPGImport.py:

Code:
    def afterChannelDownload(self, result, filename, deleteFile=True):
        print("[EPGImport] afterChannelDownload", filename, file=log)
        if filename is not None:
            try:
                if not os.path.getsize(filename):
                    raise Exception("File is empty")
            except Exception as e:
                self.channelDownloadFail(repr(e))
                return

        ##if twisted.python.runtime.platform.supportsThreads():
        if twisted.python.runtime.platform.supportsThreads() and not (self.channelFiles and isDreamOS):

The last line is added and the line above is marked out. A reboot/restart is needed to activate the work-around.
 
I wanted to run EPGImport with the adaptation I made and noticed that activated Twisted on the third import in the same group, channels filename the same, so for now it only works if twisted is avoided for the whole import.

Code:
    def afterChannelDownload(self, result, filename, deleteFile=True):
        print("[EPGImport] afterChannelDownload", filename, file=log)
        if filename is not None:
            try:
                if not os.path.getsize(filename):
                    raise Exception("File is empty")
            except Exception as e:
                self.channelDownloadFail(repr(e))
                return

        ##if twisted.python.runtime.platform.supportsThreads():
        if twisted.python.runtime.platform.supportsThreads() and not isDreamOS:
        ##if twisted.python.runtime.platform.supportsThreads() and not (self.channelFiles and isDreamOS):
 
Back
Top