LDP
/
python-tldp
mirror of https://github.com/tLDP/python-tldp
0
1
Fork 0
Code Releases Activity

need to fall back to iso-8859-1 for SGML docs

This commit is contained in:
Martin A. Brown 2016-03-15 13:26:03 -07:00
parent 912cda9328
commit e4b5c5d8bb
1 changed files with 7 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

9
tldp/typeguesser.py
View File

@ -80,8 +80,13 @@ def guess(fname):
for doctype in possible:
logger.debug("%s extension %s could be %s.", stem, ext, doctype)
with codecs.open(fname, encoding='utf-8') as f:
buf = f.read(1024)
try:
with codecs.open(fname, encoding='utf-8') as f:
buf = f.read(1024)
except UnicodeDecodeError:
# -- a wee bit ugly, but many SGML docs used iso-8859-1, so fall back
with codecs.open(fname, encoding='iso-8859-1') as f:
buf = f.read(1024)
guesses = list()
for doctype in possible: