Raspberry Pi OS update out of storage

I’ve been working on converting a customized Raspberry Pi OS 12 (bookworm, 32-bit) image using this “Convert your own image” procedure. I’ve been largely successful, but I’m encountering an issue when I try to deploy rootfs-image artifacts.

In short, I can convert an image, write the converted image to a microSD card, and boot a Raspberry Pi 4B exactly as expected. I then create rootfs-image update artifacts with small but obvious changes using mender-artifact following the “Create a Mender Artifact using the snapshot feature” procedure from the docs. I can then upload the artifact to hosted Mender, which appears to create a release as expected. For reference, I am using the following versions in this workflow:

  • mender-convert version 4.2.2
  • mender-artifact version 3.11.2
  • mender-update version 4.0.2

When I then try to deploy those images back to the same device (or another device using the same converted image), the deployment always fails with the error:

info: Update Module output (stderr): Input/output error: Reached size of the destination volume, source too big.

I’ve done a bit of experimentation, and I am able to achieve successful deployments if and only if I configure mender-convert to use MENDER_STORAGE_TOTAL_SIZE_MB with a value that is less than or equal to the default value (8192). Unfortunately that’s not a feasible solution for me; to the best of my knowledge, my current “golden image” requires MENDER_STORAGE_TOTAL_SIZE_MB to be greater than 8192.

Has anyone else tried a similar workflow with and have successfully deployed updates when using MENDER_STORAGE_TOTAL_SIZE_MB greater than 8192?

Hi @amcdonald-ipa,

That’s definitely unexpected - I have regularly used MENDER_STORAGE_TOTAL_SIZE_MB in the range of 24000 and more. Usually I don’t walk through the snapshot feature, so this is the only unknown here. As a quick check, does it also occur if you take the microSD card out of the device, dd it to a file and mender-convert from there?

On the counterpart, I’ll give the snapshot route a spin.

Greetz,
Josef

Hi @amcdonald-ipa

Thanks again for reporting the issue! Your question together with Update Module output (stderr): No space left on device let us identify the probable root cause. We’re now working on the fix and releasing it. I will report back with more details no later than Thursday, Oct 17th.

Greetz,
Josef

@TheYoctoJester Thanks for the response Josef. Do you have any updates regarding this issue and/or availability of a fix?

Hi @amcdonald-ipa,

Yes and no. The fixes have been merged to the Mender Client and Mender Flash, which were both affected, but the release process of Mender Client is not done yet. So for a mender-convert based workflow, I don’t think there is a straightforwards work around at the moment. I’ll raise the topic internally and hopefully be back with news soon.

Greetz,
Josef