Mender client crash after module reboot

General Discussions
,
1

Good Day Friends!
In recent times it comes to my attention that sometimes the mender client is crasing after module update triggers a reboot. This results in device stuck in “rebooting” in the UI, basically for ever.

The module has

    NeedsArtifactReboot)
        # This will trigger a propper reboot
        # https://github.com/mendersoftware/mender/blob/master/Documentation/update-modules-v3-file-api.md#artifactreboot-state
        echo "Automatic"
        ;;

Logs before reboot (successfull update)

time="2024-10-18T07:35:09Z" level=info msg="State transition: idle [Idle] -> check-wait [Idle]"
time="2024-10-18T07:35:09Z" level=info msg="State transition: check-wait [Idle] -> inventory-update [Sync]"
time="2024-10-18T07:35:10Z" level=info msg="State transition: inventory-update [Sync] -> check-wait [Idle]"
time="2024-10-18T07:36:37Z" level=info msg="State transition: check-wait [Idle] -> update-check [Sync]"
time="2024-10-18T07:37:07Z" level=info msg="request POST to https://mender.<redacted>.com/api/devices/v2/deployments/device/deployments/next returned HTTP 404"
time="2024-10-18T07:37:08Z" level=info msg="Validating the Update Info: https://artifacts.<redacted>.com/mender-artifact-storage/<redacted> [name: system-update-1.0.4-DEV; devices: [RadxaZero]]"
time="2024-10-18T07:37:08Z" level=info msg="State transition: update-check [Sync] -> update-fetch [Download_Enter]"
time="2024-10-18T07:37:08Z" level=info msg="Running Mender client version: 3.4.0"
time="2024-10-18T07:37:08Z" level=info msg="State transition: update-fetch [Download_Enter] -> update-store [Download_Enter]"
time="2024-10-18T07:37:08Z" level=info msg="Installer: authenticated digital signature of artifact"
time="2024-10-18T07:37:35Z" level=info msg="State transition: update-store [Download_Enter] -> update-after-store [Download_Leave]"
time="2024-10-18T07:37:35Z" level=info msg="State transition: update-after-store [Download_Leave] -> mender-update-control-refresh-maps [none]"
time="2024-10-18T07:37:35Z" level=info msg="State transition: mender-update-control-refresh-maps [none] -> mender-update-control [none]"
time="2024-10-18T07:37:35Z" level=info msg="State transition: mender-update-control [none] -> update-install [ArtifactInstall]"
time="2024-10-18T07:37:41Z" level=info msg="Output (stdout) from command \"/usr/share/mender/modules/v3/install-system-update\": Resizing the filesystem on /dev/mmcblk2p2 to 3418112 (1k) blocks."
time="2024-10-18T07:37:41Z" level=info msg="Output (stdout) from command \"/usr/share/mender/modules/v3/install-system-update\": The filesystem on /dev/mmcblk2p2 is now 3418112 (1k) blocks long."
time="2024-10-18T07:37:41Z" level=info msg="Output (stdout) from command \"/usr/share/mender/modules/v3/install-system-update\": \n"
time="2024-10-18T07:37:41Z" level=info msg="State transition: update-install [ArtifactInstall] -> mender-update-control-refresh-maps [none]"
time="2024-10-18T07:37:41Z" level=info msg="State transition: mender-update-control-refresh-maps [none] -> mender-update-control [none]"
time="2024-10-18T07:37:41Z" level=info msg="State transition: mender-update-control [none] -> reboot [ArtifactReboot_Enter]"
time="2024-10-18T07:37:42Z" level=info msg="Rebooting device(s)"
time="2024-10-18T07:37:42Z" level=info msg="Daemon terminated with SIGTERM"

Logs after reboot

Mender Client

# mender --version
3.4.0	runtime: go1.19.3

It seems that the client crashed. Is there something I can do to ensure this do not happen?

2

Hi @mister_kanister,

I know it’s a bit of a boring question, but - does this also happen on a current stable client? 3.4.0 is not exactly up to date, neither in version nor patch level.

Greetz,
Josef