Commit Graph

2683 Commits

Author SHA1 Message Date
Chocobozzz
23fdb0ff38 Add latin to languages 2021-09-07 09:05:57 +02:00
Chocobozzz
61e9908c31 Increase timeout 2021-09-07 08:33:58 +02:00
Chocobozzz
ddd677e4fd Remove unused timeout option 2021-09-07 08:33:51 +02:00
Chocobozzz
02b286f890 More robust webtorrent redundancy download
Avoid issues with inconsistencies between magnet infohash and torrent
infohash, blocking webtorrent upload that will timeout
2021-09-06 16:19:49 +02:00
Chocobozzz
70430c2796 Wait mock server termination 2021-09-06 08:13:11 +02:00
Chocobozzz
f4e75a6fd0 Increase contact form tests timeout 2021-09-02 09:11:51 +02:00
Chocobozzz
3419e0e1fe Migrate to webdriverio 2021-09-01 15:06:46 +02:00
Chocobozzz
f2e31d589c Fix pending job table migration 2021-08-30 16:28:36 +02:00
Chocobozzz
fcf9ae8aa6 Reduce 4k transcode test time 2021-08-30 10:38:50 +02:00
Chocobozzz
e4671228c8 Fix ws import 2021-08-30 09:47:17 +02:00
Chocobozzz
e874edd9f8 forceConsistentCasingInFileNames to true 2021-08-30 09:37:18 +02:00
Chocobozzz
e3c9ea7226 Add peertube import test 2021-08-27 16:21:19 +02:00
Chocobozzz
41fb13c330 esModuleInterop to true 2021-08-27 15:12:22 +02:00
Chocobozzz
8f58172565 Allow accounts to skip account setup modal 2021-08-27 10:15:55 +02:00
Chocobozzz
e111a5a3a1 Don't throw when there is no error 2021-08-26 15:51:37 +02:00
Chocobozzz
095094872a Remove too much log for webtorrent download 2021-08-26 15:28:51 +02:00
Chocobozzz
0bae66632a More logs for webtorrent download 2021-08-26 15:19:11 +02:00
Chocobozzz
52b1fd15fa Better logs for redundancy 2021-08-26 11:02:41 +02:00
Chocobozzz
7b6cf83e33 Fix redundancy remove on host redundancy update 2021-08-26 10:01:42 +02:00
Chocobozzz
5a298a5a3d Better logs for transcoding 2021-08-26 10:01:42 +02:00
Chocobozzz
98ab5dc810 Remove useless async 2021-08-26 10:01:42 +02:00
Chocobozzz
851675c559 Rename jobs list command 2021-08-26 10:01:42 +02:00
smilekison
8729a87024 Support proxies for PeerTube (#4346)
* Updated with latest code

* Updated Support proxies for PeerTube

* Support Proxies for PeerTube (Updated with change request)

* Cleanup proxy PR

Co-authored-by: Chocobozzz <me@florianbigard.com>
2021-08-25 15:08:37 +02:00
Ms Kimsible
4e1592daa4 Alert user for low quota and video auto-block on upload page (#4336)
* Replace wording of instance contact

* Add contact-us button to no-quota alert on upload page

* Add alert for accounts with auto-blocked videos on upload page

* Add alert for accounts without enough quota + refacto on upload page

* Using ng-container and ng-template

* Add alert for daily quota

* Add hook filter for upload page alert messages

* Add instance name as subtitle in contact modal

* Fix eslint max-len on  string

* Fix missing word in quota left daily message - upload page

Co-authored-by: Kimsible <kimsible@users.noreply.github.com>
2021-08-25 11:38:10 +02:00
Chocobozzz
e5d3e0c79d Fix object storage migration
It's too long on big instances
2021-08-19 09:27:14 +02:00
Chocobozzz
586a7478b6 Fix caption log 2021-08-18 11:25:08 +02:00
Chocobozzz
1d1da33661 More robust optimize transcoding job 2021-08-18 10:59:38 +02:00
Chocobozzz
cbb1d46b91 Fix hls tests 2021-08-18 10:02:48 +02:00
Chocobozzz
f645af4396 Remove useless condition 2021-08-18 09:33:48 +02:00
Chocobozzz
0d4a3c62ab Set ACL when uploading objects 2021-08-18 09:19:09 +02:00
Chocobozzz
1f6125be8b Optimize torrent URL update 2021-08-18 09:14:51 +02:00
Chocobozzz
c186a67f90 Support short uuid for scripts 2021-08-17 11:06:10 +02:00
Chocobozzz
66a7fc9473 Remove optimize old videos script
It is not compatible with HLS and I don't have time to maintain it
2021-08-17 10:33:36 +02:00
Jelle Besseling
0305db28c9 Add support for saving video files to object storage (#4290)
* Add support for saving video files to object storage

* Add support for custom url generation on s3 stored files

Uses two config keys to support url generation that doesn't directly go
to (compatible s3). Can be used to generate urls to any cache server or
CDN.

* Upload files to s3 concurrently and delete originals afterwards

* Only publish after move to object storage is complete

* Use base url instead of url template

* Fix mistyped config field

* Add rudenmentary way to download before transcode

* Implement Chocobozzz suggestions

https://github.com/Chocobozzz/PeerTube/pull/4290#issuecomment-891670478

The remarks in question:
    Try to use objectStorage prefix instead of s3 prefix for your function/variables/config names
    Prefer to use a tree for the config: s3.streaming_playlists_bucket -> object_storage.streaming_playlists.bucket
    Use uppercase for config: S3.STREAMING_PLAYLISTS_BUCKETINFO.bucket -> OBJECT_STORAGE.STREAMING_PLAYLISTS.BUCKET (maybe BUCKET_NAME instead of BUCKET)
    I suggest to rename moveJobsRunning to pendingMovingJobs (or better, create a dedicated videoJobInfo table with a pendingMove & videoId columns so we could also use this table to track pending transcoding jobs)
    https://github.com/Chocobozzz/PeerTube/pull/4290/files#diff-3e26d41ca4bda1de8e1747af70ca2af642abcc1e9e0bfb94239ff2165acfbde5R19 uses a string instead of an integer
    I think we should store the origin object storage URL in fileUrl, without base_url injection. Instead, inject the base_url at "runtime" so admins can easily change this configuration without running a script to update DB URLs

* Import correct function

* Support multipart upload

* Remove import of node 15.0 module stream/promises

* Extend maximum upload job length

Using the same value as for redundancy downloading seems logical

* Use dynamic part size for really large uploads

Also adds very small part size for local testing

* Fix decreasePendingMove query

* Resolve various PR comments

* Move to object storage after optimize

* Make upload size configurable and increase default

* Prune webtorrent files that are stored in object storage

* Move files after transcoding jobs

* Fix federation

* Add video path manager

* Support move to external storage job in client

* Fix live object storage tests

Co-authored-by: Chocobozzz <me@florianbigard.com>
2021-08-17 08:26:20 +02:00
Chocobozzz
5b075bc549 Fix search index tests 2021-08-11 11:49:01 +02:00
Chocobozzz
31aa391d13 Update server dependencies 2021-08-11 11:49:00 +02:00
Chocobozzz
18998c45c0 Correctly handle large HLS files for redundancy 2021-08-06 15:25:45 +02:00
Chocobozzz
7942e72e38 Fix cli build 2021-08-06 14:39:28 +02:00
Chocobozzz
679c12e69c Improve target bitrate calculation 2021-08-06 14:13:26 +02:00
Chocobozzz
c826f34a45 Limit live bitrate 2021-08-06 10:39:40 +02:00
Chocobozzz
e83d06a702 Remove deprecated transcoding job names 2021-08-05 14:29:44 +02:00
Chocobozzz
45570e9397 Fix upload without files 2021-08-05 14:24:03 +02:00
Chocobozzz
27db78400c Fix backend channel name validator consistency 2021-08-05 13:54:35 +02:00
Chocobozzz
352819ef92 Do not index remote actors 2021-08-05 13:29:55 +02:00
Chocobozzz
d26836cd95 Refactor notifier 2021-08-02 10:39:51 +02:00
Chocobozzz
9e87894973 Merge branch 'release/3.3.0' into develop 2021-07-29 17:18:28 +02:00
Chocobozzz
cd162f25d2 Fix video format utils 2021-07-29 17:18:09 +02:00
Chocobozzz
9c9a236b54 Refactor options in models 2021-07-29 14:17:03 +02:00
Chocobozzz
56d07460b5 Update search index tests 2021-07-29 13:41:27 +02:00
Chocobozzz
20c7087689 Correctly cleanup test servers 2021-07-29 13:34:51 +02:00