I’m seeing above error message in the device logs.
Here are some more logs:
time="2025-05-02T19:16:05+02:00" level=info msg="State transition: inventory-update-retry-wait [Sync] -> inventory-update [Sync]"
time="2025-05-02T19:16:05+02:00" level=info msg="Output (stderr) from command \"/usr/share/mender/inventory/mender-inventory-geo\": wget: note: TLS certificate validation not implemented"
time="2025-05-02T19:16:06+02:00" level=info msg="Output (stderr) from command \"/usr/share/mender/inventory/mender-inventory-geo\": /usr/share/mender/inventory/mender-inventory-geo: Unable to get IP info from ipinfo.io"
time="2025-05-02T19:16:06+02:00" level=warning msg="Inventory tool /usr/share/mender/inventory/mender-inventory-geo wait failed: exit status 2"
time="2025-05-02T19:16:08+02:00" level=info msg="Device unauthorized; attempting reauthorization"
time="2025-05-02T19:16:13+02:00" level=info msg="successfully received new authorization data from server https://hosted.mender.io"
time="2025-05-02T19:16:13+02:00" level=info msg="Local proxy started" thread=proxy
time="2025-05-02T19:16:13+02:00" level=info msg="Reauthorization successful"
time="2025-05-02T19:16:13+02:00" level=error msg="Got unexpected HTTP status when submitting to inventory 500 server error message: internal error"
time="2025-05-02T19:16:13+02:00" level=warning msg="Failed to refresh inventory: failed to submit inventory data: Got unexpected HTTP status when submitting to inventory 500 server error message: internal error"
time="2025-05-02T19:16:13+02:00" level=info msg="State transition: inventory-update [Sync] -> inventory-update-retry-wait [Sync]"
time="2025-05-02T19:16:13+02:00" level=info msg="Handle update inventory retry state try: 1"
time="2025-05-02T19:16:14+02:00" level=info msg="Output (stderr) from command \"/usr/share/mender/inventory/mender-inventory-geo\": wget: note: TLS certificate validation not implemented"
time="2025-05-02T19:16:14+02:00" level=info msg="Output (stderr) from command \"/usr/share/mender/inventory/mender-inventory-geo\": /usr/share/mender/inventory/mender-inventory-geo: Unable to get IP info from ipinfo.io"
time="2025-05-02T19:16:14+02:00" level=warning msg="Inventory tool /usr/share/mender/inventory/mender-inventory-geo wait failed: exit status 2"
time="2025-05-02T19:16:16+02:00" level=error msg="Got unexpected HTTP status when submitting to inventory 500 server error message: internal error"
time="2025-05-02T19:16:16+02:00" level=warning msg="Failed to refresh inventory: failed to submit inventory data: Got unexpected HTTP status when submitting to inventory 500 server error message: internal error"
time="2025-05-02T19:16:16+02:00" level=info msg="Wait 1m0s before next inventory update attempt in 59.999937333s"
time="2025-05-02T19:17:17+02:00" level=info msg="State transition: inventory-update-retry-wait [Sync] -> inventory-update [Sync]"
time="2025-05-02T19:17:17+02:00" level=info msg="Output (stderr) from command \"/usr/share/mender/inventory/mender-inventory-geo\": wget: note: TLS certificate validation not implemented"
time="2025-05-02T19:17:18+02:00" level=info msg="Output (stderr) from command \"/usr/share/mender/inventory/mender-inventory-geo\": /usr/share/mender/inventory/mender-inventory-geo: Unable to get IP info from ipinfo.io"
time="2025-05-02T19:17:18+02:00" level=warning msg="Inventory tool /usr/share/mender/inventory/mender-inventory-geo wait failed: exit status 2"
time="2025-05-02T19:17:20+02:00" level=error msg="Got unexpected HTTP status when submitting to inventory 500 server error message: internal error"
time="2025-05-02T19:17:20+02:00" level=warning msg="Failed to refresh inventory: failed to submit inventory data: Got unexpected HTTP status when submitting to inventory 500 server error message: internal error"
time="2025-05-02T19:17:20+02:00" level=info msg="State transition: inventory-update [Sync] -> inventory-update-retry-wait [Sync]"
time="2025-05-02T19:17:20+02:00" level=info msg="Handle update inventory retry state try: 2"
time="2025-05-02T19:17:20+02:00" level=info msg="Output (stderr) from command \"/usr/share/mender/inventory/mender-inventory-geo\": wget: note: TLS certificate validation not implemented"
time="2025-05-02T19:17:23+02:00" level=info msg="Output (stderr) from command \"/usr/share/mender/inventory/mender-inventory-geo\": /usr/share/mender/inventory/mender-inventory-geo: Unable to get IP info from ipinfo.io"
time="2025-05-02T19:17:23+02:00" level=warning msg="Inventory tool /usr/share/mender/inventory/mender-inventory-geo wait failed: exit status 2"
time="2025-05-02T19:17:25+02:00" level=error msg="Got unexpected HTTP status when submitting to inventory 500 server error message: internal error"
time="2025-05-02T19:17:25+02:00" level=warning msg="Failed to refresh inventory: failed to submit inventory data: Got unexpected HTTP status when submitting to inventory 500 server error message: internal error"
time="2025-05-02T19:17:25+02:00" level=info msg="Wait 1m0s before next inventory update attempt in 59.999960667s"
On the server side the device shows up with “status: noauth”.
I probably had deleted/dismissed any key that it had.
I’m removing mender-agent.pem expecting it to show up on the server with a new key but it doesn’t.
Logs after removing the key on the device:
time="2025-05-02T19:22:06+02:00" level=info msg="Loaded configuration file: /etc/mender/mender.conf"
time="2025-05-02T19:22:06+02:00" level=info msg="'UpdateControlMapExpirationTimeSeconds' is not set in the Mender configuration file. Falling back to the default of 2*UpdatePollIntervalSeconds"
time="2025-05-02T19:22:06+02:00" level=info msg="'UpdateControlMapBootExpirationTimeSeconds' is not set in the Mender configuration file. Falling back to the default of 600 seconds"
time="2025-05-02T19:22:07+02:00" level=info msg="Mender running on partition: /dev/mmcblk0p7"
time="2025-05-02T19:22:08+02:00" level=info msg="State transition: init [none] -> init [none]"
time="2025-05-02T19:22:08+02:00" level=info msg="State transition: init [none] -> idle [Idle]"
time="2025-05-02T19:22:08+02:00" level=info msg="State transition: idle [Idle] -> check-wait [Idle]"
time="2025-05-02T19:22:08+02:00" level=info msg="State transition: check-wait [Idle] -> inventory-update [Sync]"
time="2025-05-02T19:22:08+02:00" level=info msg="Output (stderr) from command \"/usr/share/mender/inventory/mender-inventory-geo\": wget: bad address 'ipinfo.io'"
time="2025-05-02T19:22:08+02:00" level=info msg="Output (stderr) from command \"/usr/share/mender/inventory/mender-inventory-geo\": /usr/share/mender/inventory/mender-inventory-geo: Unable to get IP info from ipinfo.io"
time="2025-05-02T19:22:08+02:00" level=warning msg="Inventory tool /usr/share/mender/inventory/mender-inventory-geo wait failed: exit status 2"
time="2025-05-02T19:22:10+02:00" level=info msg="Device unauthorized; attempting reauthorization"
time="2025-05-02T19:22:10+02:00" level=info msg="Device keys not present or bootstrap forced, generating"
time="2025-05-02T19:22:14+02:00" level=error msg="Failure occurred while executing authorization request: Method: Post, URL: https://hosted.mender.io/api/devices/v1/authentication/auth_requests"
time="2025-05-02T19:22:14+02:00" level=error msg="Failed to authorize with \"https://hosted.mender.io\": Unknown url.Error type: dial tcp: lookup hosted.mender.io on [::1]:53: dial udp [::1]:53: socket: address family not supported by protocol"
time="2025-05-02T19:22:14+02:00" level=warning msg="Reauthorization failed with error: transient error: authorization request failed"
time="2025-05-02T19:22:14+02:00" level=error msg="Failed to submit inventory data: transient error: authorization request failed"
time="2025-05-02T19:22:14+02:00" level=error msg="inventory submit failed: transient error: authorization request failed"
time="2025-05-02T19:22:14+02:00" level=warning msg="Failed to refresh inventory: failed to submit inventory data: inventory submit failed: transient error: authorization request failed"
time="2025-05-02T19:22:14+02:00" level=info msg="State transition: inventory-update [Sync] -> inventory-update-retry-wait [Sync]"
time="2025-05-02T19:22:14+02:00" level=info msg="Handle update inventory retry state try: 0"
time="2025-05-02T19:22:14+02:00" level=info msg="Output (stderr) from command \"/usr/share/mender/inventory/mender-inventory-geo\": wget: bad address 'ipinfo.io'"
time="2025-05-02T19:22:14+02:00" level=info msg="Output (stderr) from command \"/usr/share/mender/inventory/mender-inventory-geo\": /usr/share/mender/inventory/mender-inventory-geo: Unable to get IP info from ipinfo.io"
time="2025-05-02T19:22:14+02:00" level=warning msg="Inventory tool /usr/share/mender/inventory/mender-inventory-geo wait failed: exit status 2"
time="2025-05-02T19:22:15+02:00" level=info msg="Device unauthorized; attempting reauthorization"
time="2025-05-02T19:22:15+02:00" level=error msg="Failure occurred while executing authorization request: Method: Post, URL: https://hosted.mender.io/api/devices/v1/authentication/auth_requests"
time="2025-05-02T19:22:15+02:00" level=error msg="Failed to authorize with \"https://hosted.mender.io\": Unknown url.Error type: dial tcp: lookup hosted.mender.io on [::1]:53: dial udp [::1]:53: socket: address family not supported by protocol"
time="2025-05-02T19:22:15+02:00" level=warning msg="Reauthorization failed with error: transient error: authorization request failed"
time="2025-05-02T19:22:15+02:00" level=error msg="Failed to submit inventory data: transient error: authorization request failed"
time="2025-05-02T19:22:15+02:00" level=error msg="inventory submit failed: transient error: authorization request failed"
time="2025-05-02T19:22:15+02:00" level=warning msg="Failed to refresh inventory: failed to submit inventory data: inventory submit failed: transient error: authorization request failed"
time="2025-05-02T19:22:15+02:00" level=info msg="Wait 1m0s before next inventory update attempt in 59.999964333s"
mender client version 3.5.1 connected to hosted.mender.io.
Any help would be appreciated.
Thanks,
Stephan