Commit Graph

51 Commits

Author SHA1 Message Date
Takeshi KOMIYA
fe1e5f7a7d linkcheck: Move requests package loader to sphinx.util.requests 2016-08-22 20:35:11 +09:00
Takeshi KOMIYA
54247c96fe Fix #2811: Show warning if requests < 2.4.1 2016-07-27 13:28:07 +09:00
Takeshi KOMIYA
8a45aa5e59 Now all builders and domains work as built-in extensions 2016-07-06 23:25:45 +09:00
Alex Gaynor
830e986b7a Include additional info on broken links in linkcheck 2016-05-29 10:30:33 -07:00
Darragh Bailey
2f46c7899c Some sites also return 403 on HEAD requests
Atlassian websites will return a 403 Forbidden access code when
queried, so add this to the list of codes that should trigger using a
GET request as a fallback.
2016-04-21 13:20:02 +01:00
Darragh Bailey
0b9ee8d451 Switch to using requests for better charset detection
Python requests does a better job of detecting the charsets of
webpages, performing automatic decoding when the text content is
requested, avoiding issues around needing to do detection.

This allows checking the following urls & anchors correctly:

    http://www.yaml.org/spec/1.2/spec.html#id2761803
    http://www.yaml.org/spec/1.2/spec.html#id2765878
    http://www.yaml.org/spec/1.2/spec.html#id2765878
2016-04-21 13:20:02 +01:00
Georg Brandl
fed5a34568 Merge pull request #2313 from alex/idiomatic
Make some code in linkcheck more idiomatic
2016-02-13 18:12:02 +01:00
Georg Brandl
222edf59e7 linkcheck: dont check anchors starting with "!".
Add changelog entry for #1099.
2016-02-13 16:06:55 +01:00
Alex Gaynor
3f2612ee78 Make some code in linkcheck more idiomatic 2016-02-13 09:54:51 -05:00
Alex Gaynor
e6980adaf6 oops, lost this 2016-02-13 09:02:44 -05:00
Alex Gaynor
863e2f468f moved more logic around 2016-02-13 08:55:55 -05:00
Alex Gaynor
ae5bfe500e syntax error 2016-02-13 08:55:00 -05:00
Alex Gaynor
4f00a9905c Fixed #1099 -- allow the linkcheck builder to retry on errors.
This is useful because if you run linkcheck often, you are likely to see lots of transient network errors, which usually disappear if you simply try again.
2016-02-13 08:52:38 -05:00
Georg Brandl
46d7e8558e Obligatory copyright update. 2016-01-14 22:54:04 +01:00
Takeshi KOMIYA
2bcf92dfb0 Fix #1815: linkcheck does not raise an exception if warniserror set to true and link is broken 2016-01-03 20:12:33 +09:00
Takeshi KOMIYA
8b57bc7227 Fix #2003: decode error under python2 (only) when `make linkcheck` is run 2015-12-21 22:34:04 +09:00
Takeshi KOMIYA
788c0ebffc Add testcase for encoding URIs in linkcheck builder 2015-12-19 22:49:14 +09:00
Barry Warsaw
5d30bc635b One way to work around the lack of html.parser.HTMLParserError in Python 3.5 2015-07-24 15:58:50 +02:00
Georg Brandl
ea97e6658c Linkcheck now works with non-ASCII URIs.
Fixes: #1739
2015-02-25 12:49:45 +01:00
Georg Brandl
2b6f7f4afe Closes #1687: for linkcheck purposes, HTTP 401 Unauthorized is working. 2015-01-19 19:50:31 +01:00
Georg Brandl
a23903d8d5 Merge branch 'stable' 2015-01-03 21:41:14 +01:00
Georg Brandl
567d52f199 all: update copyright 2015-01-03 21:36:32 +01:00
Takayuki Shimizukawa
74fbd611ab merge with stable 2014-06-09 22:45:05 +09:00
Takayuki Shimizukawa
82a53382d5 Fix: In python3 environment, make linkcheck cause "Can't convert 'bytes'
object to str implicitly" error when link target url has a hash part.
Thanks to Jorge_C. Closes #1457
2014-05-04 00:43:50 +09:00
Takayuki Shimizukawa
2d1549b35a wrap py3 iterators with list() for each places that expect a list object. refs #1350. 2014-04-30 23:25:44 +09:00
Takayuki Shimizukawa
f31d9113ff use six privided functions/classes to support py2/py3 in one source. refs #1350 2014-04-30 20:39:26 +09:00
Takayuki Shimizukawa
c3c879f2c6 use six privided functions/classes to support py2/py3 in one source. refs #1350. 2014-04-29 19:59:58 +09:00
Georg Brandl
ac92719ac3 Update copyright year. 2014-03-01 08:18:23 +01:00
Georg Brandl
e030031321 Update copyright year. 2014-03-01 08:18:16 +01:00
Dmitry Shachnev
ce2185ce27 Modernize the code now that Python 2.5 is no longer supported
- Use print function instead of print statement;
- Use new exception handling;
- Use in operator instead of has_key();
- Do not use tuple arguments in functions;
- Other miscellaneous improvements.

This is based on output of `futurize --stage1`, with some
manual corrections.
2014-01-19 14:17:10 +04:00
Takayuki Shimizukawa
cc7509966c merge heads 2014-01-15 05:25:56 +00:00
Georg Brandl
5406bff1cd Closes #1292: In the linkchecker, retry HEAD requests when denied by HTTP 405.
Also make the redirect code apparent and tweak the output a bit to be
more obvious.
2014-01-12 23:52:16 +01:00
Takayuki Shimizukawa
a8fc938d1b Drop python-2.5 and remove 2.4,2.5 support codes 2013-12-15 14:16:53 +09:00
Georg Brandl
151856819c Copyright update. 2013-01-01 22:13:15 +01:00
Jonathan Waltman
55b28b0198 Fix whitespace / line length issues reported by "make test" 2012-11-03 11:04:32 -05:00
Georg Brandl
166c7e8d27 Style fixes. 2012-03-10 18:13:55 +01:00
Marti Raudsepp
e0e9d2a7fa Add #anchor checking to 'linkcheck' builder.
This requires us to download the document and parse its HTML.
2012-02-28 20:12:59 +02:00
Georg Brandl
17efae5622 merge with 1.0 2011-01-04 11:29:09 +01:00
Georg Brandl
51852c0e87 #472: linkcheck builder: Check links in parallel, use HTTP HEAD requests and allow configuring the timeout.
New config values: :confval:`linkcheck_timeout` and :confval:`linkcheck_workers`.
2011-01-04 11:27:42 +01:00
Georg Brandl
0e1db6ad90 New year update. 2011-01-04 10:00:51 +01:00
Georg Brandl
b72621c447 #521: Added :confval:linkcheck_ignore config value. 2010-10-22 11:40:38 +02:00
Georg Brandl
9f4c61b154 #391: do not report local links as "malformed" in the linkcheck builder. 2010-07-11 11:00:07 +02:00
Georg Brandl
c8c703805c merge with 0.6 2010-05-22 12:59:18 +02:00
Georg Brandl
f5d52fa4f4 #377: Fix crash in linkcheck builder if all parent nodes have no line number set. 2010-04-18 09:55:38 +02:00
Georg Brandl
436693cea6 linkcheck builder now shows the line number in console output. 2010-01-03 10:25:21 +01:00
Georg Brandl
f6a56192d1 Happy new year! 2010-01-01 14:09:13 +01:00
Georg Brandl
b244dbf9b5 Use standard `file:line: warning: message` format for warning messages. 2009-03-05 09:21:35 +01:00
Georg Brandl
b068e91803 Reformat to EOL80. 2009-01-10 21:23:39 +01:00
Georg Brandl
f16f94f2cd Merge in copyright style changes from 0.5. 2009-01-03 12:15:19 +01:00
Georg Brandl
26d7aafaae Explicitly refer to the license in :license: tags. 2008-12-27 12:19:17 +01:00