Switch to using requests for better charset detection

Python requests does a better job of detecting the charsets of
webpages, performing automatic decoding when the text content is
requested, avoiding issues around needing to do detection.

This allows checking the following urls & anchors correctly:

    http://www.yaml.org/spec/1.2/spec.html#id2761803
    http://www.yaml.org/spec/1.2/spec.html#id2765878
    http://www.yaml.org/spec/1.2/spec.html#id2765878
This commit is contained in:
Darragh Bailey
2016-03-23 15:34:40 +00:00
parent 4959a75c6f
commit 0b9ee8d451
3 changed files with 48 additions and 61 deletions

View File

@@ -12,3 +12,4 @@ whoosh>=2.0
alabaster
sphinx_rtd_theme
imagesize
requests