Commit Graph
3 Commits
Author SHA1 Message Date
Darragh Bailey dba030668e Update CHANGES for PR#2389 2016-04-21 13:20:31 +01:00
Darragh Bailey 2f46c7899c Some sites also return 403 on HEAD requests
Atlassian websites will return a 403 Forbidden access code when
queried, so add this to the list of codes that should trigger using a
GET request as a fallback.
2016-04-21 13:20:02 +01:00
Darragh Bailey 0b9ee8d451 Switch to using requests for better charset detection
Python requests does a better job of detecting the charsets of
webpages, performing automatic decoding when the text content is
requested, avoiding issues around needing to do detection.

This allows checking the following urls & anchors correctly:

    http://www.yaml.org/spec/1.2/spec.html#id2761803
    http://www.yaml.org/spec/1.2/spec.html#id2765878
    http://www.yaml.org/spec/1.2/spec.html#id2765878
2016-04-21 13:20:02 +01:00