Commit Graph

74 Commits

Author SHA1 Message Date
Takeshi KOMIYA
aa6dfb8b41 Merge branch 'stable' 2017-03-18 18:25:50 +09:00
Takeshi KOMIYA
2dae11aa68 Fix #3552: linkcheck raises UnboundLocalError 2017-03-18 18:17:59 +09:00
Takeshi KOMIYA
554199d30e Upgrade to mypy-0.5 2017-03-03 23:17:34 +09:00
Takeshi KOMIYA
035ba39c2d Fix mypy violations 2017-01-22 00:46:49 +09:00
Takeshi KOMIYA
9ac221b140 Merge branch 'stable' 2017-01-20 12:17:38 +09:00
Takeshi KOMIYA
a0c2029b3c Fix #3295: Could not import extension sphinx.builders.linkcheck 2017-01-20 12:16:18 +09:00
Takeshi KOMIYA
38d6c34f35 Merge branch 'stable' 2017-01-12 13:03:53 +09:00
Takeshi KOMIYA
412bb9aae8 Fix flake8 violations 2017-01-12 10:09:44 +09:00
Takeshi KOMIYA
e755a8c004 Use loggers 2017-01-02 12:59:51 +09:00
Takeshi KOMIYA
b43523fcbe Use sphinx.util.logging instead app.info(), verbose(), debug() and debug2() 2017-01-02 12:59:50 +09:00
Takeshi KOMIYA
d5288567fd Update type annotations 2016-12-15 19:22:40 +09:00
Takeshi KOMIYA
e645ea59db Merge branch 'stable' 2016-12-14 00:12:23 +09:00
Takeshi KOMIYA
d72954d498 builtin extensions return metadata to allow parallel build 2016-12-12 21:22:16 +09:00
Takeshi KOMIYA
88887bad88 Update type annotation 2016-12-03 16:51:18 +09:00
Takeshi KOMIYA
e63afbc60e Merge branch '1.5-release' 2016-11-23 13:31:02 +09:00
Takeshi KOMIYA
8006d31b32 Fix #3095: Add tls_verify and tls_cacerts to support self-signed servers 2016-11-17 23:12:39 +09:00
Takeshi KOMIYA
23b1c3d5f2 Add type-check annotations to sphinx.builders 2016-11-16 12:06:22 +09:00
Darragh Bailey
22765990f0 Allow skipping anchor checking by regex
To avoid needing to turn off anchor checking across the entire
documentation allow skipping based on matching the anchor against a
regex.

Some sites/pages use JavaScript to perform anchor assignment in a
webpage, which would require rendering the page to determine whether
the anchor exists. Allow fine grain control of whether the anchor is
checked based on pattern matching, until such stage as the retrieved
URLs can be passed through an engine for deeper checking on the HTML
doctree.
2016-10-27 10:52:04 +01:00
Hiroaki Itoh
42604a1ff6 Fix #2990: linkcheck raises "Can't convert 'bytes' object to str implicitly" error if linkcheck_anchors enabled 2016-10-06 18:59:24 +09:00
Takeshi KOMIYA
4c7bec6460 Fix #3008: `linkcheck` builder ignores self-signed certificate URL 2016-10-06 12:46:23 +09:00
Takeshi KOMIYA
ce7fea9a35 Fix #2988: linkcheck: retry with GET request if denied HEAD request 2016-10-04 12:47:59 +09:00
Takeshi KOMIYA
07e30b279b Merge pull request #2884 from tk0miya/refactor_intersphinx
Refactor intersphinx: Use requests package
2016-08-27 16:43:54 +09:00
Takeshi KOMIYA
2b5c7057a7 Fix linkcheck builder does not send User-Agent header 2016-08-22 21:17:55 +09:00
Takeshi KOMIYA
fe1e5f7a7d linkcheck: Move requests package loader to sphinx.util.requests 2016-08-22 20:35:11 +09:00
Takeshi KOMIYA
54247c96fe Fix #2811: Show warning if requests < 2.4.1 2016-07-27 13:28:07 +09:00
Takeshi KOMIYA
8a45aa5e59 Now all builders and domains work as built-in extensions 2016-07-06 23:25:45 +09:00
Alex Gaynor
830e986b7a Include additional info on broken links in linkcheck 2016-05-29 10:30:33 -07:00
Darragh Bailey
2f46c7899c Some sites also return 403 on HEAD requests
Atlassian websites will return a 403 Forbidden access code when
queried, so add this to the list of codes that should trigger using a
GET request as a fallback.
2016-04-21 13:20:02 +01:00
Darragh Bailey
0b9ee8d451 Switch to using requests for better charset detection
Python requests does a better job of detecting the charsets of
webpages, performing automatic decoding when the text content is
requested, avoiding issues around needing to do detection.

This allows checking the following urls & anchors correctly:

    http://www.yaml.org/spec/1.2/spec.html#id2761803
    http://www.yaml.org/spec/1.2/spec.html#id2765878
    http://www.yaml.org/spec/1.2/spec.html#id2765878
2016-04-21 13:20:02 +01:00
Georg Brandl
fed5a34568 Merge pull request #2313 from alex/idiomatic
Make some code in linkcheck more idiomatic
2016-02-13 18:12:02 +01:00
Georg Brandl
222edf59e7 linkcheck: dont check anchors starting with "!".
Add changelog entry for #1099.
2016-02-13 16:06:55 +01:00
Alex Gaynor
3f2612ee78 Make some code in linkcheck more idiomatic 2016-02-13 09:54:51 -05:00
Alex Gaynor
e6980adaf6 oops, lost this 2016-02-13 09:02:44 -05:00
Alex Gaynor
863e2f468f moved more logic around 2016-02-13 08:55:55 -05:00
Alex Gaynor
ae5bfe500e syntax error 2016-02-13 08:55:00 -05:00
Alex Gaynor
4f00a9905c Fixed #1099 -- allow the linkcheck builder to retry on errors.
This is useful because if you run linkcheck often, you are likely to see lots of transient network errors, which usually disappear if you simply try again.
2016-02-13 08:52:38 -05:00
Georg Brandl
46d7e8558e Obligatory copyright update. 2016-01-14 22:54:04 +01:00
Takeshi KOMIYA
2bcf92dfb0 Fix #1815: linkcheck does not raise an exception if warniserror set to true and link is broken 2016-01-03 20:12:33 +09:00
Takeshi KOMIYA
8b57bc7227 Fix #2003: decode error under python2 (only) when `make linkcheck` is run 2015-12-21 22:34:04 +09:00
Takeshi KOMIYA
788c0ebffc Add testcase for encoding URIs in linkcheck builder 2015-12-19 22:49:14 +09:00
Barry Warsaw
5d30bc635b One way to work around the lack of html.parser.HTMLParserError in Python 3.5 2015-07-24 15:58:50 +02:00
Georg Brandl
ea97e6658c Linkcheck now works with non-ASCII URIs.
Fixes: #1739
2015-02-25 12:49:45 +01:00
Georg Brandl
2b6f7f4afe Closes #1687: for linkcheck purposes, HTTP 401 Unauthorized is working. 2015-01-19 19:50:31 +01:00
Georg Brandl
a23903d8d5 Merge branch 'stable' 2015-01-03 21:41:14 +01:00
Georg Brandl
567d52f199 all: update copyright 2015-01-03 21:36:32 +01:00
Takayuki Shimizukawa
74fbd611ab merge with stable 2014-06-09 22:45:05 +09:00
Takayuki Shimizukawa
82a53382d5 Fix: In python3 environment, make linkcheck cause "Can't convert 'bytes'
object to str implicitly" error when link target url has a hash part.
Thanks to Jorge_C. Closes #1457
2014-05-04 00:43:50 +09:00
Takayuki Shimizukawa
2d1549b35a wrap py3 iterators with list() for each places that expect a list object. refs #1350. 2014-04-30 23:25:44 +09:00
Takayuki Shimizukawa
f31d9113ff use six privided functions/classes to support py2/py3 in one source. refs #1350 2014-04-30 20:39:26 +09:00
Takayuki Shimizukawa
c3c879f2c6 use six privided functions/classes to support py2/py3 in one source. refs #1350. 2014-04-29 19:59:58 +09:00