Florent Beauchamp
7baa5ac804
feat(@xen-orchestra/fs): impement null writer for performance testing
2023-03-28 10:04:07 +02:00
Florent Beauchamp
c2e0c97d94
refactor(@xen-orchestra/fs): remove unused code
2023-03-24 18:03:04 +01:00
Florent Beauchamp
a5447fda3c
fix(@xen-orchestra/fs): reduce memory usage during outputstream (full VM backup)
2023-03-24 18:03:04 +01:00
Florent Beauchamp
13837e0bf3
feat(xo-server): new API method esxi.listVms
2023-02-27 09:29:38 +01:00
Florent Beauchamp
f5d19fd28a
fix(vmware-explorer/Esxi#search): handle more than 100 entries
2023-02-27 09:29:38 +01:00
Florent Beauchamp
3ff8064f1b
feat(backups): add more info about NBD backups in logs
2023-01-12 10:28:30 +01:00
Florent Beauchamp
834459186d
fix(backups): useNbd must follow the config
2023-01-12 10:28:30 +01:00
Florent Beauchamp
feef1f8b0a
fix(backups/cleanVm): fix tests
2023-01-04 10:54:22 +01:00
Florent Beauchamp
1a5e2fde4f
fix(vhd-lib/merge): require aliases for VHD directories
2023-01-04 10:54:22 +01:00
Florent Beauchamp
011d582b80
fix(vhd-lib/merge): delete old data AFTER the alias has been overwritten
2022-11-29 16:42:57 +01:00
Florent Beauchamp
3862fb2664
fix(fs/rename): throw ENOENT when source file is missing
2022-11-28 17:33:57 +01:00
Florent Beauchamp
c5b3acfce2
fix(vhd-lib): remove unsafe VhdAbstract.rename implementation
...
actual implementation was deleting the target vhd even if the source did not exist, leading to ptential data loss
2022-11-23 14:31:37 +01:00
Florent Beauchamp
2c456e4c89
fix(vhd-lib): create directory for merged blocks
2022-11-22 11:05:51 +01:00
Florent Beauchamp
1460e63449
fix(vhd-lib): write state at the begining
2022-11-22 11:05:51 +01:00
Florent Beauchamp
545a65521a
fix(vhd-lib): improve openVhd error handling
2022-10-27 09:26:49 +02:00
Florent Beauchamp
0cf6f94677
test: rework tests following 05161bd4df
...
Test of cleanVm are still failin , untill we fix the error condition of cleanVm broken vhd removing
- don't use handler to / (need root to run)
- don't create file at the root of the remote (conflict with the metadata and encryption.json)
- test more unhappy paths
2022-10-27 09:26:49 +02:00
Florent Beauchamp
14e205ab69
fix(vhd-cli): sync handler
2022-10-27 09:26:49 +02:00
Florent Beauchamp
c3da87a40c
fix(@xen-orchestra/fs): do not create metadata on non encrypted remote
...
this was creating file in wrong place during test or when running cli
introduced by #05161bd4df5b42e5ecfa0ae11e60c466ab2eabdf
2022-10-27 09:26:49 +02:00
Florent Beauchamp
5e589019d0
fix(xo-web): do not throw an error when editing a non encrypted remote
...
Introduced by dca3f39
2022-10-05 11:08:14 +02:00
Florent Beauchamp
feaad13ac3
fix(xo-web): save region on S3 remote creation
...
Introduced by f755365
2022-10-05 11:08:14 +02:00
Florent Beauchamp
ab9428a9c4
fix(xo-remote-parser): correctly handle empty S3 region
...
Introduced by c219ea0
2022-10-05 11:08:14 +02:00
Florent Beauchamp
1297c925ad
feat: server side of backup encryption
2022-08-23 12:04:16 +02:00
Florent Beauchamp
61691ac46b
fix(vhd-lib/VhdDirectory#mergeBlock): fix rename condition
...
Introduced by fd752fee8
2022-08-12 16:18:25 +02:00
Florent Beauchamp
512b96af24
fix(backups/cleanVm): fix path of merge state
...
Introduced by ad149740b1
2022-08-12 16:07:44 +02:00
Florent Beauchamp
ad149740b1
feat(backups/cleanVm,vhd-lib): support resuming merge of VHD chains
...
The whole chain is now stored in the merge state.
2022-08-04 15:25:31 +02:00
Florent Beauchamp
9a4e938b91
fix(backups/cleanVm): fix parent/child order when resuming merge
2022-08-04 15:25:31 +02:00
Florent Beauchamp
b181c59698
fix(fs/S3#_createReadStream): avoid race condition when checking file exist
2022-05-17 10:34:08 +02:00
Florent BEAUCHAMP
b820dcd73f
fix(xo-server/authorizations): add missing smart backups and S3 ( #6141 )
...
Introduced by 4e8dc2
2022-03-12 09:57:42 +01:00
Florent BEAUCHAMP
0a412c0ef7
feat(CI): use github action ( #5987 )
2022-03-11 17:18:21 +01:00
Florent BEAUCHAMP
db75f8046c
feat(fs/S3#list): workaround Backblaze issue ( #6139 )
...
Workaround for #6138
2022-03-11 16:12:08 +01:00
Florent Beauchamp
7bdd1a4a3a
fix(vhd-lib): fix tests
2022-03-11 14:55:55 +01:00
Florent BEAUCHAMP
c99120bd24
feat: support VM/hosts consoles behind HTTP proxy ( #6133 )
...
This is a major change in the way xo-server connect to a console, from connecting directly as a TCP socket to using a WebSocket in binary mode.
This was already the case prior c17620e but was changed due to XenServer issues with their WebSocket console implementation, it appears to be working fine now.
2022-03-10 13:54:32 +01:00
Florent BEAUCHAMP
8ce1b4bf71
feat(xo-server): server side authorization ( #6107 )
2022-03-10 11:45:04 +01:00
Florent Beauchamp
97d94b7952
feat(vhd-lib): merge blocks in parallel for VhdDirectory, throttle mergestate writes
2022-01-24 10:37:34 +01:00
Florent Beauchamp
96eb793298
feat(fs): s3#rmtree parallelize object deletion
2022-01-24 10:37:34 +01:00
Florent Beauchamp
b4f15de7be
feat(fs): s3#copy don't use multi part copy for objects smaller than 5GB
2022-01-24 10:37:34 +01:00
Florent BEAUCHAMP
692e72a78a
fix(vhd-lib): fixes asserts on existing merge state ( #6099 )
...
Introduced by 5a933bad9
2022-01-21 12:40:45 +01:00
Florent BEAUCHAMP
b60a1958b6
fix(fs#S3#{list,rmtree}): fix support of more than 1000 files ( #6103 )
...
Bug found when working on #6100
2022-01-20 14:31:13 +01:00
Florent Beauchamp
f6a2b505db
feat(backups): execute cleanup on each related vm dir after a backup deletion
2022-01-19 10:46:15 +01:00
Florent Beauchamp
38aacdbd7d
feat(xo-web): delete all the backups at once and let xo-server handle the cleanup
2022-01-19 10:46:15 +01:00
Florent Beauchamp
089b877cc5
fix(backups): use handler.unlink for deleting metadat instead of VhdAbstract.unlink
2022-01-19 10:46:15 +01:00
Florent BEAUCHAMP
c10601d905
fix(backups/_MixinBackupWriter#afterBackup): execute merge on S3 ( #6095 )
...
Introduced by 47f9da216
2022-01-18 11:05:55 +01:00
Florent BEAUCHAMP
e15be7ebd3
fix(backups/_cleanVm): fixes for aliases cleaning ( #6094 )
...
Introduced in 249f638495
2022-01-18 10:07:56 +01:00
Florent BEAUCHAMP
249f638495
feat(backups/_cleanVm): check VHD aliases ( #6043 )
2022-01-13 16:07:28 +01:00
Florent BEAUCHAMP
6cf5e10195
feat(fs/S3#_writeFile): retry on remote internal error ( #6086 )
2022-01-13 15:46:12 +01:00
Florent BEAUCHAMP
b78a946458
feat(proxy): implement reverse proxies ( #6072 )
2022-01-13 14:54:10 +01:00
Florent BEAUCHAMP
729db5c662
fix(backups): race condition in checkBaseVdi preventing delta backup ( #6075 )
...
Fixes zammad#4751, zammad#4729, zammad#4665 and zammad#4300
2022-01-05 09:58:06 +01:00
Florent BEAUCHAMP
5d605d1bd7
feat(backups): compress VHDs on S3 ( #5932 )
2021-12-21 17:18:27 +01:00
Florent BEAUCHAMP
93069159dd
fix(backups/cleanVm): don't warn on size change due to merged VHDs ( #6010 )
2021-12-20 14:57:54 +01:00
Florent BEAUCHAMP
478d88e97f
fix(fs/s3#_rmtree): infinite loop ( #6067 )
2021-12-17 16:01:57 +01:00
Florent BEAUCHAMP
6fb397a729
fix(vhd-lib): parseVhdStream int overflow when rebuilding the bat ( #6066 )
...
BAT should contain sector address, not byte address
We were not really rebuilding the BAT, since we were using the data read in the old bat and write it as is in the new one
2021-12-17 14:28:48 +01:00
Florent BEAUCHAMP
315f54497a
fix(vhd-lib/resolveAlias): limit size ( #6004 )
...
Current resolution loads whole file in memory. It can lead to crash is the alias is malformed (for example a full VHD named `.alias.vhd`).
2021-12-12 14:19:40 +01:00
Florent BEAUCHAMP
f3eeeef389
fix(fs/S3#list): should not look into all the file tree ( #6048 )
2021-12-09 14:06:21 +01:00
Florent BEAUCHAMP
8d69208197
fix(backups/MixinBackupWriter#_cleanVm): always returns an object ( #6050 )
2021-12-09 10:38:31 +01:00
Florent BEAUCHAMP
8ea4c1c1fd
fix(vhd-lib): output parent locator in VhdAbstract#stream ( #6035 )
2021-12-07 14:14:39 +01:00
Florent BEAUCHAMP
faa7ba6f24
fix(vhd-lib, fs): use rmtree and not rmTree ( #6041 )
2021-12-06 14:25:09 +01:00
Florent Beauchamp
ff806a3ff9
fix(vhd-lib): use parent locator of root disk in VhdSynthetic
2021-12-02 16:48:19 +01:00
Florent Beauchamp
949b17dee6
fix(vhd-lib): fix footer and header accessor in vhd hierarchy
2021-12-02 16:48:19 +01:00
Florent Beauchamp
b1fdc68623
fix(vhd-lib): platformDataSpace in sectors not bytes
2021-12-02 16:48:19 +01:00
Florent BEAUCHAMP
f502facfd1
fix(backup): createAlias to data instead of circular alias ( #6029 )
2021-12-02 13:56:20 +01:00
Florent BEAUCHAMP
2f607357c6
feat: release 5.65 ( #6028 )
2021-11-30 17:45:31 +01:00
Florent BEAUCHAMP
ae24b10da0
feat: technical release ( #6025 )
2021-11-30 15:45:36 +01:00
Florent BEAUCHAMP
407b05b643
fix(backups): use the full VHD hierarchy for restore ( #6027 )
2021-11-30 15:27:54 +01:00
Florent BEAUCHAMP
3ad8508ea5
feat(vhd-lib/VhdDirectory#_writeChunk): use outputFile ( #6019 )
...
This is much faster than manually creating parent directories.
2021-11-29 09:52:47 +01:00
Florent BEAUCHAMP
1f1ae759e0
feat(fs): use keepalive for queries to s3 ( #6018 )
2021-11-27 10:10:19 +01:00
Florent BEAUCHAMP
bbd3d31b6a
fix(backups/writeVhd): await outputStream ( #6017 )
2021-11-25 16:34:21 +01:00
Florent BEAUCHAMP
a2f2b50f57
feat(s3): allow self signed certificate ( #5961 )
2021-11-25 11:32:08 +01:00
Florent BEAUCHAMP
7f8190056d
fix(backups/RemoteAdapter): unused import and path in writeVhd ( #6014 )
2021-11-25 11:26:59 +01:00
Florent Beauchamp
d5f21bc27c
feat(backups): handle the choice of the vhd type to use during backup
2021-11-24 21:08:15 +01:00
Florent Beauchamp
8c3b452c0d
feat(backup): DeltaBackupWriter can handle any type of vhd
2021-11-24 21:08:15 +01:00
Florent Beauchamp
9cacb92c2c
feat(backups): remoteadapter can delete any type of vhd
2021-11-24 21:08:15 +01:00
Florent Beauchamp
7a1b56db87
feat(backups): checkvhd can handle all vhd types
2021-11-24 21:08:15 +01:00
Florent Beauchamp
56c3d70149
feat(vhd-lib): generate a vhd directory from a vhd stream
2021-11-24 21:08:15 +01:00
Florent Beauchamp
1ec8fcc73f
feat(vhd-lib): extract computeSectorsPerBlock, computeBlockBitmapSize and computeSectorOfBitmap to utils
2021-11-24 21:08:15 +01:00
Florent Beauchamp
a9c2c9b6ba
refator(vhd-lib): move createSyntheticStream to backup, move stream() tests to vhdabstracts
2021-11-23 15:56:25 +01:00
Florent Beauchamp
5b2a6bc56b
chore(vhd-lib/createSyntheticStream): based on VhdSynthetic#stream()
2021-11-23 15:56:25 +01:00
Florent Beauchamp
19c8693b62
fix(vhd-lib/VhdSynthetic#readHeaderAndFooter()): root vhd can be a dynamic and check chaining
2021-11-23 15:56:25 +01:00
Florent Beauchamp
c4720e1215
fix(vhd-lib/VhdAbstract#stream()): stream.length should contain blocks
2021-11-23 15:56:25 +01:00
Florent BEAUCHAMP
b6d4c8044c
feat(backups/cleanVm) : support VHD dirs and aliases ( #6000 )
2021-11-22 17:14:29 +01:00
Florent BEAUCHAMP
57dd6ebfba
chore(vhd-lib): use openVhd for chain and checkChain ( #5997 )
2021-11-22 15:50:30 +01:00
Florent BEAUCHAMP
d7ee13f98d
feat(vhd-lib/merge): use Vhd* classes ( #5950 )
2021-11-18 11:30:04 +01:00
Florent BEAUCHAMP
a4bb453401
feat(vhd-lib): add VhdAbstract#{stream,rawContent}() methods ( #5992 )
2021-11-17 09:16:34 +01:00
Florent BEAUCHAMP
5c8ebce9eb
feat(vhd-lib): add vhd synthetic class ( #5990 )
2021-11-17 09:15:13 +01:00
Florent Beauchamp
547d318e55
fix(vhd-lib): write parent locator before the blocks
2021-11-08 18:03:46 +01:00
Florent Beauchamp
cb5a2c18f2
fix(vhd-lib): ensure block allocation table is written after modifying it in tests
2021-11-08 18:03:46 +01:00
Florent Beauchamp
e01ca3ad07
refactor(vhd-lib): use method from test/utils when possible
2021-11-08 18:03:46 +01:00
Florent Beauchamp
314d193f35
fix(vhd-lib): set platform code when setting unique parent locator
2021-11-08 18:03:46 +01:00
Florent Beauchamp
e0200bb730
refactor(vhd-lib): split tests
2021-11-08 18:03:46 +01:00
Florent BEAUCHAMP
2a3f4a6f97
feat(vhd-lib): handle file alias ( #5962 )
2021-11-08 14:46:00 +01:00
Florent BEAUCHAMP
1b0a885ac3
feat(vhd-cli): use any remote for copy and compare ( #5927 )
2021-11-03 15:45:52 +01:00
Florent BEAUCHAMP
a950a1fe24
refactor(vhd-lib): centralize test methods ( #5968 )
2021-11-02 09:53:30 +01:00
Florent BEAUCHAMP
2412f8b1e2
feat(xen-api): add HTTP proxy support ( #5958 )
...
See #5436
Using an IP address as HTTPS proxy show this warning: `DeprecationWarning: Setting the TLS ServerName to an IP address is not permitted by RFC 6066`
The corresponding issue is there : TooTallNate/node-https-proxy-agent#127
2021-10-27 17:30:41 +02:00
Florent BEAUCHAMP
c62d727cbe
feat(vhd-cli compare): compare metadata and content of two VHDs ( #5920 )
2021-10-18 16:21:40 +02:00
Florent BEAUCHAMP
7ef89d5043
feat(vhd-{cli,lib}): implement chunking and copy command ( #5919 )
2021-10-18 14:56:58 +02:00
Florent BEAUCHAMP
84dccd800f
feat(backups): clean up other schedules snapshots ( #5949 )
...
Fixes xoa-support#4129
2021-10-14 14:44:40 +02:00
Florent BEAUCHAMP
f53ec8968b
feat(xo-web/SortedTable): move filter and pagination to top ( #5914 )
2021-09-29 17:35:46 +02:00
Florent BEAUCHAMP
2773591e1f
feat(xo-web): add go back to ActionButton and use it when saving a backup ( #5913 )
...
See xoa-support#2149
2021-09-24 11:38:37 +02:00
Florent BEAUCHAMP
9d5e9dd9e5
Use desktop notification when avilable and when the browser is minified
...
without jquery, and using angular $window and $document
2015-10-06 20:37:56 +02:00
Florent BEAUCHAMP
e7dc00991e
remove cubism from package.json
2015-09-24 21:26:45 +02:00
Florent BEAUCHAMP
dd9da82ed3
Merge branch 'cubism' of https://github.com/vatesfr/xo-web into cubism
2015-09-24 21:18:59 +02:00