NuKVM/xen-orchestra
3
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,646 Commits 184 Branches 894 Tags
213eb6a56a1579a296d11666aa4ba89d90ae59e1
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Florent BEAUCHAMP 213eb6a56a feat(xo-web/sr): show coalescing status (#7241) 2023-12-21 11:29:32 +01:00
Florent BEAUCHAMP 54808967f6 fix(backups): handle undefined isVhdDifferencing (#7248) 
Introduced by e13d55bfa9

Fixes https://xcp-ng.org/forum/post/68600
 2023-12-20 15:23:23 +01:00
Florent BEAUCHAMP 439c721472 refactor(backups/cleanVm) use of merge parameter 2023-12-19 15:42:59 +01:00
Florent BEAUCHAMP b2f2c3cbc4 feat: release 5.89.0 (#7212) 2023-11-30 13:57:49 +01:00
Florent BEAUCHAMP 0f7ac004ad feat: technical release (#7211) 2023-11-30 10:42:54 +01:00
Florent BEAUCHAMP 2748aea4e9 feat: technical release (#7210) 2023-11-29 15:39:25 +01:00
Florent BEAUCHAMP b856c1a6b4 feat(xo-server,xo-web): show link to the SR for the garbage collector (coalesce) task (#7189) 
See https://github.com/vatesfr/xen-orchestra/issues/5379#issuecomment-1765170973
 2023-11-29 09:07:05 +01:00
Florent BEAUCHAMP 57940e0a52 fix(backups): import on non default SR (#7209) 2023-11-28 14:35:08 +01:00
Florent BEAUCHAMP 6cc95efe51 feat: technical release (#7208) 2023-11-28 09:30:32 +01:00
Florent BEAUCHAMP c4535c6bae fix(fs/s3): enable md5 if object lock status is unknown (#7195) 
From https://xcp-ng.org/forum/topic/7939/unable-to-connect-to-backblaze-b2/7?_=1700572613725
Following 796e2ab674 

User report it fixes the issue https://xcp-ng.org/forum/post/67633
 2023-11-23 16:43:25 +01:00
Florent BEAUCHAMP 858ecbc217 fix(xapi/VDI_importContent): other_config entries must be strings (#7198) 
Introduced byffd523679de80b36b2eacd30cc98de3c588a2b77
 2023-11-21 16:55:53 +01:00
Florent BEAUCHAMP ffd523679d feat(backups): update VDI importing status its name_label 2023-11-21 14:38:49 +01:00
Florent BEAUCHAMP bd9db437f1 feat(xapi/VDI_importContent): store task UUID and stream length into other_config 2023-11-21 14:38:49 +01:00
Florent BEAUCHAMP 0365bacfbb feat(backups): show more detail on restored VM (#7186) 2023-11-21 12:28:53 +01:00
Florent BEAUCHAMP 4504141cbf refactor(backups/importIncrementalVm): move base detection to callers (#7165) 2023-11-20 14:52:59 +01:00
Florent BEAUCHAMP 9ca3f3df26 fix(xo-vmdk-to-vhd): improve compatibilty of ova with disk bigger than 8.2GB (#7183) 
following #7047, from https://xcp-ng.org/forum/topic/7946/ova-export-not-functional?_=1700051758755

ova exported from xo with more than 8.2G data per disk can't be imported in virtual box 

tar-stream@3 pack and entry are now streams
 2023-11-15 16:23:33 +01:00
Florent BEAUCHAMP af7aa29c91 feat(nbd-client): various fixes (#6964) 2023-11-15 10:04:09 +01:00
Florent BEAUCHAMP 46ec2dfd56 fix(vmware-explorer): better handling of VM import without any storage (#7168) 2023-11-14 15:14:13 +01:00
Florent BEAUCHAMP 2bfdb60dda fix(fs): handle object storage server not implementing Object lock (#7157) 2023-11-06 17:18:00 +01:00
Florent BEAUCHAMP f6819b23f9 fix(xo-web/dashboard): empty VDIs shouldn't be flagged as orphan (#7102) 
Fixes zammad#15524
 2023-11-06 13:57:44 +01:00
Florent BEAUCHAMP 3410cbc3b9 fix(backups): use VDI virtual_size instead of physical_size 
`physical_size` appears to be broken
 2023-10-30 15:55:30 +01:00
Florent BEAUCHAMP 93fce0d4bf fix(backups): pass type to Xapi#getRecord 
Fixes #7131

Introduced by 37b211376
 2023-10-30 15:55:30 +01:00
Florent BEAUCHAMP 37b2113763 feat(fs/s3): compute sensible chunk size for uploads 2023-10-23 10:23:50 +02:00
Florent BEAUCHAMP 5048485a85 feat(fs/s3): object lock mode need content md5 
and the middleware consume addiitionnal memory
 2023-10-23 10:23:50 +02:00
Florent BEAUCHAMP 9e667533e9 fix(fs/s3): throw error if upload >50GB 2023-10-23 10:23:50 +02:00
Florent BEAUCHAMP eb69234a8e feat(xo-server/host): implement smartctl api call 2023-09-28 17:14:09 +02:00
Florent BEAUCHAMP 2ba81d55f8 fix(vhd-lib/test): collision during tests (#7062) 
multiple tests use the same temporary files
 2023-09-28 16:49:00 +02:00
Florent BEAUCHAMP 988179a3f0 fix(xo-server): add mbr for cloud-init only for windows VM (#7050) 
Fixes zammad#16808
 2023-09-28 09:09:13 +02:00
Florent BEAUCHAMP f0f429a473 fix(xo-server-backup-report): send report for Mirror Backup (#7049) 2023-09-27 16:39:27 +02:00
Florent BEAUCHAMP c8bfda9cf5 fix(xo-vmdk-to-vhd): handle ova with disk position collision (#7051) 
Some OVA have multiple disks with the same position, which prevent the VM from being created (error while creating VBD). Renumeroting the problematic disk works around the issue.

This may lead to unbootable VM in case the renumeroted disk was the bootable one (VMware-VirtualSAN-Witness-7.0.0-15843807.ova for example).

Fixes #7046
 2023-09-22 11:44:12 +02:00
Florent BEAUCHAMP e5c5f19219 fix(backups): mirror must not replicate themselves (#7043) 
Fixes zammad#16871
 2023-09-21 14:45:29 +02:00
Florent BEAUCHAMP db92f0e365 fix(vhd-lib): VhdFile implementation is not compatible with encrypted remote (#7045) 2023-09-21 11:18:44 +02:00
Florent BEAUCHAMP 90e0f26845 fix(xo-server): ova export with files bigger than 8.2GB (#7047) 
Following 15f69a1

Updating tar-stream to latest version fixes support of files bigger than 8.2GB
 2023-09-20 17:17:45 +02:00
Florent BEAUCHAMP 6a0df7aec2 feat(fs/s3): retry on failures (#6966) 2023-08-31 09:51:28 +02:00
Florent BEAUCHAMP 311b420b74 feat(backups): expose preferNbd setting per backup job (#6995) 2023-08-30 16:59:36 +02:00
Florent BEAUCHAMP f5d3bc1f2d feat(backups): merge worker concurrency (#6965) 2023-08-30 09:38:37 +02:00
Florent BEAUCHAMP 3a3fa2882c fix(backup/healthcheck): mirror backup appeared detached (#7000) 2023-08-29 14:52:44 +02:00
Florent BEAUCHAMP a13fda5fe9 fix(backups/_MixinXapiWriter): typo _heathCheckSr → _healthCheckSr (#6969) 
Fix `TypeError: Cannot read properties of undefined (reading 'uuid') at #isAlreadyOnHealthCheckSr`
 2023-08-08 09:48:53 +02:00
Florent BEAUCHAMP 66bee59774 fix(xen-api/getResource): don't fail silently when HTTP request fails without response (#6970) 
Seen while investigating zammad#16309
 2023-08-08 09:39:18 +02:00
Florent BEAUCHAMP 152cf09b7e feat(vmware-explorer): handle sesparse files (#6909) 2023-07-27 17:15:29 +02:00
Florent BEAUCHAMP 1c23bd5ff7 feat(read-chunk/readChunkStrict): attach read chunk to error if small text (#6940) 2023-07-20 17:01:26 +02:00
Florent BEAUCHAMP 61d960d4b1 fix(vmware-explorer): handle snapshot of 1TB+ disks 2023-07-20 10:25:28 +02:00
Florent BEAUCHAMP 02d3465832 feat(vmware-explorer): don't transform stream for raw import in thick mode 2023-07-20 10:25:28 +02:00
Florent BEAUCHAMP 4bbadc9515 feat(vmware-explorer): improve import 
- use one stream instead of per block queries if possible
- retry block reading if failing
- handle unaligned end block
 2023-07-20 10:25:28 +02:00
Florent BEAUCHAMP 78586291ca fix(vmware-explorer): better disk size computation 2023-07-20 10:25:28 +02:00
Florent BEAUCHAMP 945dec94bf feat(vmware-explorer): retry connection to ESXi 2023-07-20 10:25:28 +02:00
Florent BEAUCHAMP 8347ac6ed8 fix(xo-server/xapi-stats): simplify caching (#6920) 
Following #6903

- change cache system per object => per host
- update cache at the beginning of the query to handle race conditions leading to duplicate requests
- remove concurrency limit (was leading to a huge backlog of queries, and response handling is quite fast)
 2023-07-18 09:47:39 +02:00
Florent BEAUCHAMP b03935ad2f feat(backups): can limit parallel VDI transfers per VM per job (#6787) 2023-06-28 16:47:39 +02:00
Florent BEAUCHAMP 161c20b534 feat(xo-server): add MBR to cloud-init drive (#6889) 2023-06-28 10:42:01 +02:00
Florent BEAUCHAMP 0f0c0ec0d0 fix(vmware-explorer): handle selef signed certifictae during download (#6908) 2023-06-26 14:24:37 +02:00
Florent BEAUCHAMP e5932e2c33 fix(node-vsphere-soap): don't disable TLS1.2 used by ESXi (#6913) 2023-06-26 11:31:24 +02:00
Florent BEAUCHAMPMathieuJon Sands
 		a62575e3cf docs(backups): new terminology and mirror backups (#6837) 
Co-authored-by: Mathieu <70369997+MathieuRA@users.noreply.github.com>
Co-authored-by: Jon Sands <fohdeesha@gmail.com>
 2023-06-23 16:33:10 +02:00
Florent BEAUCHAMP 0d801c9766 fix(backups): fix DR not deleting older VM (#6912) 
Introduced by aa36629def
 2023-06-23 10:59:51 +02:00
Florent BEAUCHAMP 311098adc2 feat(backups): use the right SR for health check during replication (#6902) 2023-06-22 11:35:47 +02:00
Florent BEAUCHAMP 4c05064294 feat(vmware-exporer): use @vates/node-vsphere-soap 2023-06-19 09:31:07 +02:00
Florent BEAUCHAMP c135f1394f fix(node-vsphere-soap): disable tests since they need a running vsphere/esxi 2023-06-19 09:31:07 +02:00
Florent BEAUCHAMP d68f4215f1 fix(node-vsphere-soap): better handling of self signed cert 2023-06-19 09:31:07 +02:00
Florent BEAUCHAMP af562f3c3a chore(node-vsphere-soap): fix lint issues 2023-06-19 09:31:07 +02:00
Florent BEAUCHAMP d3e256289b feat(node-vsphere-soap): fork 2023-06-19 09:31:07 +02:00
Florent BEAUCHAMP 1ad406c7dd test(nbd-client): test secure connection 2023-06-07 10:24:14 +02:00
Florent BEAUCHAMP 4e032e11b1 fix(nbd-client/readBlocks): BigInt handling for default generator 2023-06-07 10:24:14 +02:00
Florent BEAUCHAMP 9c4e0464f0 fix(backups): fix vm is undefined error (#6873) 2023-06-01 14:21:43 +02:00
Florent BEAUCHAMP b18ebcc38d fix(backups): fix CR not deleting older VM (#6871) 
scheduleId was not passed to the writers constructor. It leads to missing scheduleId in metadata (I think there is no consequence), and a bad filter to detect VM to delete after a successfull replication

Users may need to delete manually the VM created that way
 2023-06-01 10:33:33 +02:00
Florent BEAUCHAMP 3f316fcaea fix(backups): handles task end in CR without health check (#6866) 2023-05-30 16:06:23 +02:00
Florent BEAUCHAMP 8b7b162c76 feat(backups): implement mirror backup 2023-05-30 15:21:53 +02:00
Florent BEAUCHAMP aa36629def refactor(backup/writers): pass the vm and snapshot in transfer/run 2023-05-30 15:21:53 +02:00
Florent BEAUCHAMP 61324d10f9 fix(xo-web): VHD directory tooltip (#6865) 2023-05-30 09:27:24 +02:00
Florent BEAUCHAMP b456394663 refactor(backups): extract method forkDeltaExport 2023-05-26 13:01:15 +02:00
Florent BEAUCHAMP 94f599bdbd refactor(backups/RemoteAdapter): extract method listAllVms 2023-05-26 13:01:08 +02:00
Florent BEAUCHAMP d466ca143a refactor(backups/runner): Vms -> VmsXapi 2023-05-26 12:48:56 +02:00
Florent BEAUCHAMP 78ed85a49f feat(backups): add ability to read only one delta instead of the full chain 2023-05-26 12:47:42 +02:00
Florent BEAUCHAMP c24e7f9ecd refactor(backup/remoteAdapter): readDeltaVmBackup -> readIncrementalVmBackup 2023-05-26 12:24:56 +02:00
Florent BEAUCHAMP ac8c146cf7 refactor(backups): separate full and incremental VM runners 2023-05-23 09:27:47 +02:00
Florent BEAUCHAMP 2ba437be31 refactor(backups): separate VMs and metadata runners 2023-05-23 09:27:47 +02:00
Florent BEAUCHAMP bd8bb73309 refactor(backups): move Runner, VmBackup, writers and specific method to a private folder 2023-05-23 09:27:47 +02:00
Florent BEAUCHAMP 485c2f4669 refactor(backups/Backup.createRunner): factory 
BREAKING CHANGE: Backup can no longer be instantiated directly.
 2023-05-23 09:27:47 +02:00
Florent BEAUCHAMP 6fb562d92f refactor(backups/Backup): extract getAdaptersByRemote, RemoteTimeoutError and runTasks 2023-05-23 09:27:47 +02:00
Florent BEAUCHAMP 85efdcf7b9 refactor(backups/_incrementalVm): delta → incremental 2023-05-23 09:27:47 +02:00
Florent BEAUCHAMP fc1357d5d6 refactor(backups): _deltaVm → _incrementalVm 2023-05-23 09:27:47 +02:00
Florent BEAUCHAMP 88b015bda4 refactor(backups/writers) : replication → xapi 2023-05-23 09:27:47 +02:00
Florent BEAUCHAMP b46f76cccf refactor(backups/writers): backup → remote 2023-05-23 09:27:47 +02:00
Florent BEAUCHAMP c3bb2185c2 refactor(backups/writers): delta → incremental 2023-05-23 09:27:47 +02:00
Florent BEAUCHAMP a240853fe0 refactor(backups/_VmBackup): delta → incremental 2023-05-23 09:27:47 +02:00
Florent BEAUCHAMP 1b0ec9839e fix(xo-server): import OVA with broken VMDK size in metadata (#6824) 
ova generated from oracle virtualization server seems to have the size of the vmdk
instead of the disk size in the metadata

this will cause the transfer to fail when the import try to write data

after the size of the vmdk, for example a 50GB disk make a 10GB vmdk. It will fail when import reach data in the 10-50GB range
 2023-05-22 10:20:04 +02:00
Florent BEAUCHAMP 4bd5b38aeb fix(backups): fix health check task during CR (#6830) 
Fixes https://xcp-ng.org/forum/post/62073

`healthCheck` is launched after `cleanVm`, therefore it should be closing the parent task, not `cleanVm`.
 2023-05-12 10:45:32 +02:00
Florent BEAUCHAMP 3e822044f2 fix(xo-vmdk-to-vhd): wait for OVA stream to be written before reading more data (#6800) 2023-05-11 12:23:06 +02:00
Florent BEAUCHAMP 82c229c755 fix(xo-server): better handling of importing running VM from ESXi (#6825) 
Fixes https://xcp-ng.org/forum/post/59879

Fixes `Cannot read properties of undefined (reading 'stream')` error message
 2023-05-10 18:25:37 +02:00
Florent BEAUCHAMP a562c74492 feat(backups/health check): support custom checks via XenStore (#6784) 2023-04-27 09:02:00 +02:00
Florent BEAUCHAMP 3430ee743b feat(xapi/VDI_exportContent) : implement NBD block level retry (#6763) 2023-04-26 11:32:38 +02:00
Florent BEAUCHAMP 75989cf92d fix(backups/restore): fix boolean/int cast for backups created on XS<7.1 (#6772) 2023-04-25 10:26:06 +02:00
Florent BEAUCHAMP 15f69a19f5 fix(xo-server/OVA import): revert to tar-stream@2 (#6779) 
Fixes https://xcp-ng.org/forum/post/60648

Introduced by 656d13d

tar-stream@3 uses different kind of streams (`streamx`) which breaks `stream.read(size)`.
 2023-04-18 14:38:18 +02:00
Florent BEAUCHAMP a4d1d41b6a refactor(xapi/VDI_exportContent): can export from NBD (#6716) 2023-03-30 18:21:39 +02:00
Florent BEAUCHAMP 23da202790 fix(xo-web): relax pattern for bucket (#6757) 
bucket from AWS follow some naming convention, but other providers are more relaxed.
removing the regex check will allow the user to tests connecting and see the back-end specific error message
 2023-03-29 14:45:26 +02:00
Florent BEAUCHAMP 53e0f17c55 feat(xo-server): import multiple from ESXi (#6708) 2023-03-28 19:29:34 +02:00
Florent BEAUCHAMP e19c7b949d feat(vmware-explorer): improve error handling (#6734) 2023-03-27 17:11:41 +02:00
Florent BEAUCHAMP d87f698512 fix(vmware-explorer): fix dcPath parameter (#6729) 2023-03-15 14:42:34 +01:00
Florent BEAUCHAMP 77b1adae37 feat(backups/writeVhd): check file has expected size (#6703) 2023-03-10 10:06:53 +01:00
Florent BEAUCHAMP 4af57810d6 fix(xo-server): log handling when restoring a VM from a proxy (#6702) 2023-03-08 16:37:24 +01:00
Florent BEAUCHAMP 3f57287d79 fix(backups): connect to NBD only when useVhdDirectory (#6707) 2023-03-08 15:09:19 +01:00
Florent BEAUCHAMP 86f5f9eba3 feat(xo-server): use dcpath in ESXI import (#6694) 2023-03-06 16:25:46 +01:00