IntenseWebs/discourse
3
0
Fork 0
mirror of https://github.com/discourse/discourse.git synced 2025-02-25 18:55:32 -06:00
Code Issues Packages Projects Releases Wiki Activity

FIX: Topic Crawling should only crawl HTTP/S urls

Browse Source
This commit is contained in:
Robin Ward 2017-05-22 11:57:20 -04:00
parent 76229535ac
commit 773445b8df
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
app/jobs/regular/crawl_topic_link.rb
View File

@ -28,6 +28,7 @@ module Jobs
uri = URI(url)
return if uri.blank? || uri.host.blank?
return unless ['https', 'http'].include?(uri.scheme)
return unless [80, 443].include?(uri.port)
headers = CrawlTopicLink.request_headers(uri)
head = Excon.head(url, read_timeout: 20, headers: headers)