4 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Darragh Bailey	22765990f0	Allow skipping anchor checking by regex ... To avoid needing to turn off anchor checking across the entire documentation allow skipping based on matching the anchor against a regex. Some sites/pages use JavaScript to perform anchor assignment in a webpage, which would require rendering the page to determine whether the anchor exists. Allow fine grain control of whether the anchor is checked based on pattern matching, until such stage as the retrieved URLs can be passed through an engine for deeper checking on the HTML doctree.	2016-10-27 10:52:04 +01:00
Darragh Bailey	dba030668e	Update CHANGES for PR#2389	2016-04-21 13:20:31 +01:00
Darragh Bailey	2f46c7899c	Some sites also return 403 on HEAD requests ... Atlassian websites will return a 403 Forbidden access code when queried, so add this to the list of codes that should trigger using a GET request as a fallback.	2016-04-21 13:20:02 +01:00
Darragh Bailey	0b9ee8d451	Switch to using requests for better charset detection ... Python requests does a better job of detecting the charsets of webpages, performing automatic decoding when the text content is requested, avoiding issues around needing to do detection. This allows checking the following urls & anchors correctly: http://www.yaml.org/spec/1.2/spec.html#id2761803 http://www.yaml.org/spec/1.2/spec.html#id2765878 http://www.yaml.org/spec/1.2/spec.html#id2765878	2016-04-21 13:20:02 +01:00