psf/requests-html
When requesting a page that is ISO-8859-1 encoded, HTML is still interpreted as UTF-8
开放
#442 创建于 2021年1月27日
help wanted
仓库指标
- 星标
- (13,555 个星标)
- PR 合并指标
- (30 天内没有已合并 PR)
描述
When requesting a page that is ISO-8859-1 encoded:
>>> r = session.get('https://gerda.geus.dk/Gerda/Search')
>>> r.encoding
'ISO-8859-1'
>>> r.html.default_encoding
'ISO-8859-1'
>>> r.html.encoding
'utf8'
>>> r.html.find("option")[-1].text
'Bygge-anl�g'
Expected behavior:
>>> r.html.find("option")[-1].text
'Bygge-anlæg'
As far as I can see, there are two problems:
r.html.encodingis incorrectly setr.html.element(ThePyQueryinstance) does not take encoding into account at all but just assumes utf-8