StorPool: resize of an encrypted volume does not account for the LUKS header (live resize fails with "Cannot grow device files", guest ends up 2 MiB short)
Les mainteneurs répondent en général sous 1 jour
Personne n'a encore pris cette issue.
Évaluation
Cette issue n'a pas encore été évaluée.
Description
problem
When a LUKS-encrypted volume on StorPool primary storage is resized, the
plugin resizes the StorPool volume to exactly the requested size. At creation
the plugin adds 2 MiB (2097152 bytes) for the LUKS header, but the resize path
does not.
Effects:
-
Live resize fails inside QEMU. The agent runs
virsh blockresizewith the
new size; QEMU needs new size + LUKS payload offset on the underlying block
device, which is larger than the device, and returns:internal error: unable to execute QEMU command 'block_resize': Cannot grow device filesThe failure is not surfaced.
notifyqemu()inresizevolume.shonly logs
"failed to live resize", the script exits 0, the agent returns success and
the resizeVolume job succeeds. The guest keeps seeing the old size. -
Size mismatch. CloudStack records the requested size, but once QEMU
re-reads the device (VM stop/start, or a manual blockresize) the guest sees
the requested size minus the LUKS header. The same shortfall applies to
offline resize, without any error (from code reading, not tested). -
Rollback uses the same unadjusted size (from code reading, not tested).
If the StorPool API call or the agent command fails,resizeVolume()calls
StorPoolUtil.volumeUpdate(name, oldSize, true, ...), i.e. shrinkOk=true
with the CloudStack size. For an encrypted volume that has never been
resized the device is oldSize + 2097152, so this requests a 2 MiB shrink of
a LUKS device.
Code references (main at cc30155defc89bce24a253df892a0494ae8bba1e):
- Create adds the allowance:
https://github.com/apache/cloudstack/blob/cc30155defc89bce24a253df892a0494ae8bba1e/plugins/storage/volume/storpool/src/main/java/org/apache/cloudstack/storage/datastore/driver/StorPoolPrimaryDataStoreDriver.java#L302
(also L876 and L879 for volumes created from a template/snapshot) - Resize does not (
updateVolumeByStorPoolQoS,updateVolumeByOffering):
https://github.com/apache/cloudstack/blob/cc30155defc89bce24a253df892a0494ae8bba1e/plugins/storage/volume/storpool/src/main/java/org/apache/cloudstack/storage/datastore/driver/StorPoolPrimaryDataStoreDriver.java#L495-L512 - Rollback with oldSize and shrinkOk=true:
https://github.com/apache/cloudstack/blob/cc30155defc89bce24a253df892a0494ae8bba1e/plugins/storage/volume/storpool/src/main/java/org/apache/cloudstack/storage/datastore/driver/StorPoolPrimaryDataStoreDriver.java#L420-L436 - QEMU side:
block_crypto_co_truncateadds the payload offset, and
raw_co_truncaterejects growth of a block device:
https://github.com/qemu/qemu/blob/v9.0.0/block/crypto.c#L433-L449
https://github.com/qemu/qemu/blob/v9.0.0/block/file-posix.c#L2670-L2678
The header allowance was introduced with StorPool encryption support in #7539.
versions
on all versions
The steps to reproduce the bug
- KVM zone with StorPool primary storage and a host that supports volume
encryption. Create a custom-size disk offering with encrypt=true, tagged
to the StorPool pool. - Create a 10 GiB data volume from that offering and attach it to a running
VM. On the host,blockdev --getsize64on the StorPool device shows
10739515392 (10 GiB + 2097152); the guest sees 10737418240. - Resize the volume while the VM is running:
cmk resize volume id= size=20 - Observe:
- the resizeVolume job succeeds and CloudStack reports 20 GiB
blockdev --getsize64shows 21474836480 (exactly 20 GiB, no allowance)- libvirtd logs the block_resize "Cannot grow device files" error
- the guest still sees 10 GiB
Expected: the StorPool volume is resized to 20 GiB + 2097152, blockresize
succeeds, and the guest sees 20 GiB, matching what CloudStack reports.
What to do about it?
Apply the same allowance on resize as on create, for encrypted volumes only:
- In
updateVolumeByOfferingandupdateVolumeByStorPoolQoS, send
payload.newSize + 2097152to the StorPool API when the volume has a
passphrase (or KMS key on main).updateVolumeByStorPoolQoSneeds the
volume passed in. - Use the same adjusted size for the rollback in
resizeVolume(). - Keep
payload.newSizefor the agent command and for the size stored in
the database.
Sketch:
private static long getStorPoolVolumeSize(VolumeObject vol, long size) {
boolean encrypted = vol.getPassphraseId() != null || vol.getKmsKeyId() != null;
return encrypted ? size + 2097152 : size;
}
Volumes already resized under this bug have no allowance; the next resize
after the fix would correct them.
Separately, it may be worth surfacing the blockresize failure instead of
returning success, so a failed live resize is visible in the job result.
- Langage dominant
- Java
- Étoiles
- 3.1k
- Forks
- 1.4k
- Merge moyen
- 7 j 16 h
- PR mergées (30 j)
- 15
Préparer son environnement
- Aucun Dockerfile ni fichier Docker Compose
- Propose un modèle de pull request
- Lire le guide de contribution
Par où commencer
- Lisez l'issue en entier, puis le guide de contribution du projet.
- Signalez en commentaire que vous la prenez — cela évite que deux personnes fassent le même travail.
- Forkez le dépôt et travaillez sur une branche.
- Ouvrez une pull request qui référence le numéro de l'issue.
Autres issues de apache/cloudstack
-
resizeVolume of a running system VM's volume is accepted but the VM never sees the new sizePeut-être pris @bhouse-nexthop l’a pris il y a 3 jours. Ouverte
Difficulté 2/5 1-3 heures Accessibilité débutants 72/100
apache/cloudstack#14645 · 1 commentaire ·
Les mainteneurs répondent en général sous 1 jour
-
VR reports a load balancer change as applied when haproxy.cfg cannot be replacedPeut-être pris @bhouse-nexthop l’a pris il y a 3 jours. Ouverte
Difficulté 2/5 1-3 heures Accessibilité débutants 78/100
apache/cloudstack#14633 · 1 commentaire ·
Les mainteneurs répondent en général sous 1 jour
-
restartNetwork reports a ResourceUnavailableException as an unexpected error (530), unlike restartVPC (534)Peut-être pris @bhouse-nexthop l’a pris il y a 3 jours. Ouverte
Difficulté 2/5 1-3 heures Accessibilité débutants 78/100
apache/cloudstack#14631 · 1 commentaire ·
Les mainteneurs répondent en général sous 1 jour
-
Difficulté 2/5 1-3 heures Accessibilité débutants 68/100
apache/cloudstack#14625 · 1 commentaire ·
Les mainteneurs répondent en général sous 1 jour
-
Remote access VPN users are disconnected on every LB, ACL, port forward or firewall change (xl2tpd restarted on every iptables pass)Peut-être pris @willbennett-devops l’a pris il y a 12 jours. Ouverte
Difficulté 2/5 1-3 heures Accessibilité débutants 72/100
apache/cloudstack#14545 · 1 commentaire ·
Les mainteneurs répondent en général sous 1 jour
Toutes les issues de apache/cloudstack
Issues similaires
-
bug emitter:client:csharp
Difficulté 2/5 1-3 heures Accessibilité débutants 84/100
microsoft/typespec#12572 · 1 commentaire · 1 réaction ·
Les mainteneurs répondent en général sous 1 jour
-
[BUG]: Java SDK MountRequest always sends update-optional fields, resetting stored mount settingsOuvertebug
Difficulté 2/5 1-3 heures Accessibilité débutants 75/100
Les mainteneurs répondent en général sous 1 jour
-
GCC 15.2: -Wcast-qual warning - cast discards const qualifier from pointer target type (H5trace.c)Ouverte
Difficulté 2/5 1-3 heures Accessibilité débutants 73/100
Les mainteneurs répondent en général sous 1 jour
-
[Bug] RemotingHelper.connect swaps the socket send and receive buffer configurationPeut-être pris @amalsaidov l’a pris aujourd’hui. Ouverte
Difficulté 2/5 1-3 heures Accessibilité débutants 82/100
Les mainteneurs répondent en général sous 1 jour
-
needs-area-label
Difficulté 2/5 1-3 heures Accessibilité débutants 78/100
Les mainteneurs répondent en général sous 2 jours