ERRO[0200] Download connection broken: unexpected EOF module=update_resumer

gmeat · July 11, 2019, 2:34am

I integrated mender 2.0.0 into my imx6ull14x14 board,which is running linux 4.14.78.
When I test the mender upgrade,I met the error. I want help.

INFO[0000] Loaded configuration file: /etc/mender/mender.conf  module=config
INFO[0000] Mender running on partition: /dev/mmcblk1p2   module=main
INFO[0001] API Gateway certificate (in PEM format): 
-----BEGIN CERTIFICATE-----
MIIBfTCCASKgAwIBAgIJALeeZiIEEOpeMAoGCCqGSM49BAMCMBkxFzAVBgNVBAMM
Dm1lbmRlci5zZ3cuY29tMB4XDTE5MDcxMTAwMzkyNVoXDTI5MDcwODAwMzkyNVow
GTEXMBUGA1UEAwwObWVuZGVyLnNndy5jb20wWTATBgcqhkjOPQIBBggqhkjOPQMB
BwNCAARvLo0z4NPXRtfTncC0Muu6+GdZtbm3yKI3+EUbclV0ujOl4jTCZDUAgKZd
u5Br/tyUCSa2dxOqMi0dz0VFoMugo1MwUTAdBgNVHQ4EFgQUjd2A2m9q3Su6+xze
lCs3Aux94OkwHwYDVR0jBBgwFoAUjd2A2m9q3Su6+xzelCs3Aux94OkwDwYDVR0T
AQH/BAUwAwEB/zAKBggqhkjOPQQDAgNJADBGAiEA7NTmy31wddies1TXOOPPinS5
WAZGXfGKftTvOrFIOAUCIQCE/okPiQRgpOKFG96C4nFCNUFzHdJas+M7cyjZqbzd
og==
-----END CERTIFICATE-----
-----BEGIN CERTIFICATE-----
MIIBdTCCARqgAwIBAgIJAPl5SBsibPTOMAoGCCqGSM49BAMCMBUxEzARBgNVBAMM
CnMzLnNndy5jb20wHhcNMTkwNzExMDAzOTI1WhcNMjkwNzA4MDAzOTI1WjAVMRMw
EQYDVQQDDApzMy5zZ3cuY29tMFkwEwYHKoZIzj0CAQYIKoZIzj0DAQcDQgAEP5Oh
Z4EJTHFCuYqgxbUv99RP/TaB4RQNSpV/kNrEVBWTW1N0HG4P2xqwpYOyX8eWZu7k
mPCev1+Ht8AYiCzjvaNTMFEwHQYDVR0OBBYEFOOZuQkGy/hoYw4PMIt8fZDQEe4w
MB8GA1UdIwQYMBaAFOOZuQkGy/hoYw4PMIt8fZDQEe4wMA8GA1UdEwEB/wQFMAMB
Af8wCgYIKoZIzj0EAwIDSQAwRgIhAOuR8qLSvFNxStB9hFv8iaZuB2VcqC9TjlUF
rXClsnkxAiEAxPQn0Cd+tTfCB5CnRBKxJQQdWIRXO5pvxuay9VQQpek=
-----END CERTIFICATE-----
  module=client
INFO[0001] Issuer: [], Valid from: 2019-07-11 00:39:25 +0000 UTC, Valid to: 2029-07-08 00:39:25 +0000 UTC  module=client
INFO[0001] State transition: init [none] -> init [none]  module=mender
INFO[0001] State transition: init [none] -> idle [Idle]  module=mender
INFO[0001] authorization data present and valid          module=mender
INFO[0001] State transition: idle [Idle] -> check-wait [Idle]  module=mender
INFO[0001] State transition: check-wait [Idle] -> inventory-update [Sync]  module=mender
INFO[0001] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender
INFO[0001] State transition: check-wait [Idle] -> update-check [Sync]  module=mender
INFO[0001] State transition: update-check [Sync] -> check-wait [Idle]  module=mender
INFO[0006] State transition: check-wait [Idle] -> inventory-update [Sync]  module=mender
INFO[0006] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender
INFO[0006] State transition: check-wait [Idle] -> update-check [Sync]  module=mender
INFO[0006] State transition: update-check [Sync] -> check-wait [Idle]  module=mender
INFO[0011] State transition: check-wait [Idle] -> inventory-update [Sync]  module=mender
INFO[0011] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender
INFO[0011] State transition: check-wait [Idle] -> update-check [Sync]  module=mender
INFO[0011] State transition: update-check [Sync] -> check-wait [Idle]  module=mender
INFO[0016] State transition: check-wait [Idle] -> inventory-update [Sync]  module=mender
INFO[0016] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender
INFO[0016] State transition: check-wait [Idle] -> update-check [Sync]  module=mender
INFO[0016] State transition: update-check [Sync] -> check-wait [Idle]  module=mender
INFO[0021] State transition: check-wait [Idle] -> inventory-update [Sync]  module=mender
INFO[0021] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender
INFO[0021] State transition: check-wait [Idle] -> update-check [Sync]  module=mender
INFO[0021] State transition: update-check [Sync] -> check-wait [Idle]  module=mender
INFO[0026] State transition: check-wait [Idle] -> inventory-update [Sync]  module=mender
INFO[0026] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender
INFO[0026] State transition: check-wait [Idle] -> update-check [Sync]  module=mender
INFO[0026] State transition: update-check [Sync] -> check-wait [Idle]  module=mender
INFO[0031] State transition: check-wait [Idle] -> inventory-update [Sync]  module=mender
INFO[0031] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender
INFO[0031] State transition: check-wait [Idle] -> update-check [Sync]  module=mender
INFO[0031] State transition: update-check [Sync] -> check-wait [Idle]  module=mender
INFO[0036] State transition: check-wait [Idle] -> inventory-update [Sync]  module=mender
INFO[0036] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender
INFO[0036] State transition: check-wait [Idle] -> update-check [Sync]  module=mender
INFO[0036] State transition: update-check [Sync] -> check-wait [Idle]  module=mender
INFO[0041] State transition: check-wait [Idle] -> inventory-update [Sync]  module=mender
INFO[0041] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender
INFO[0041] State transition: check-wait [Idle] -> update-check [Sync]  module=mender
INFO[0041] State transition: update-check [Sync] -> check-wait [Idle]  module=mender
INFO[0046] State transition: check-wait [Idle] -> inventory-update [Sync]  module=mender
INFO[0046] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender
INFO[0046] State transition: check-wait [Idle] -> update-check [Sync]  module=mender
INFO[0046] State transition: update-check [Sync] -> check-wait [Idle]  module=mender
INFO[0051] State transition: check-wait [Idle] -> inventory-update [Sync]  module=mender
INFO[0051] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender
INFO[0051] State transition: check-wait [Idle] -> update-check [Sync]  module=mender
INFO[0051] State transition: update-check [Sync] -> check-wait [Idle]  module=mender
INFO[0056] State transition: check-wait [Idle] -> inventory-update [Sync]  module=mender
INFO[0056] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender
INFO[0056] State transition: check-wait [Idle] -> update-check [Sync]  module=mender
INFO[0056] State transition: update-check [Sync] -> check-wait [Idle]  module=mender
INFO[0061] State transition: check-wait [Idle] -> inventory-update [Sync]  module=mender
INFO[0061] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender
INFO[0061] State transition: check-wait [Idle] -> update-check [Sync]  module=mender
INFO[0061] State transition: update-check [Sync] -> check-wait [Idle]  module=mender
INFO[0066] State transition: check-wait [Idle] -> inventory-update [Sync]  module=mender
INFO[0066] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender
INFO[0066] State transition: check-wait [Idle] -> update-check [Sync]  module=mender
INFO[0066] State transition: update-check [Sync] -> check-wait [Idle]  module=mender
INFO[0071] State transition: check-wait [Idle] -> inventory-update [Sync]  module=mender
INFO[0071] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender
INFO[0071] State transition: check-wait [Idle] -> update-check [Sync]  module=mender
INFO[0071] State transition: update-check [Sync] -> check-wait [Idle]  module=mender
INFO[0076] State transition: check-wait [Idle] -> inventory-update [Sync]  module=mender
INFO[0076] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender
INFO[0076] State transition: check-wait [Idle] -> update-check [Sync]  module=mender
INFO[0076] State transition: update-check [Sync] -> check-wait [Idle]  module=mender
INFO[0081] State transition: check-wait [Idle] -> inventory-update [Sync]  module=mender
INFO[0081] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender
INFO[0081] State transition: check-wait [Idle] -> update-check [Sync]  module=mender
INFO[0081] State transition: update-check [Sync] -> check-wait [Idle]  module=mender
INFO[0086] State transition: check-wait [Idle] -> inventory-update [Sync]  module=mender
INFO[0086] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender
INFO[0086] State transition: check-wait [Idle] -> update-check [Sync]  module=mender
INFO[0086] State transition: update-check [Sync] -> check-wait [Idle]  module=mender
INFO[0091] State transition: check-wait [Idle] -> inventory-update [Sync]  module=mender
INFO[0091] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender
INFO[0091] State transition: check-wait [Idle] -> update-check [Sync]  module=mender
INFO[0091] State transition: update-check [Sync] -> check-wait [Idle]  module=mender
INFO[0096] State transition: check-wait [Idle] -> inventory-update [Sync]  module=mender
INFO[0096] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender
INFO[0096] State transition: check-wait [Idle] -> update-check [Sync]  module=mender
INFO[0096] State transition: update-check [Sync] -> check-wait [Idle]  module=mender
INFO[0101] State transition: check-wait [Idle] -> inventory-update [Sync]  module=mender
INFO[0101] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender
INFO[0101] State transition: check-wait [Idle] -> update-check [Sync]  module=mender
INFO[0101] State transition: update-check [Sync] -> check-wait [Idle]  module=mender
INFO[0106] State transition: check-wait [Idle] -> inventory-update [Sync]  module=mender
INFO[0106] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender
INFO[0106] State transition: check-wait [Idle] -> update-check [Sync]  module=mender
INFO[0106] State transition: update-check [Sync] -> check-wait [Idle]  module=mender
INFO[0111] State transition: check-wait [Idle] -> inventory-update [Sync]  module=mender
INFO[0111] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender
INFO[0111] State transition: check-wait [Idle] -> update-check [Sync]  module=mender
INFO[0111] Correct request for getting image from: https://s3.sgw.com:9000/mender-artifact-storage/a46a5c84-e8d3-4ecd-a487-727ca23e314e?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Credential=mender-deployments%2F20190711%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20190711T013556Z&X-Amz-Expires=86400&X-Amz-SignedHeaders=host&response-content-type=application%2Fvnd.mender-artifact&X-Amz-Signature=03a5a86579fb57a757adf204f611783382fb0254aff1e0349902ce3c1067958e [name: SGW6010; devices: [imx6ull14x14evk]]  module=client_update
INFO[0111] State transition: update-check [Sync] -> update-fetch [Download_Enter]  module=mender
INFO[0111] Running Mender version 2.0.0                  module=deployment_logger
INFO[0111] State transition: update-fetch [Download_Enter] -> update-store [Download_Enter]  module=mender
INFO[0112] no public key was provided for authenticating the artifact  module=installer
INFO[0112] native sector size of block device /dev/mmcblk1p3 is 512, we will write in chunks of 1048576  module=dual_rootfs_device
INFO[0112] opening device /dev/mmcblk1p3 for writing     module=block_device
INFO[0112] partition /dev/mmcblk1p3 size: 1392508928     module=block_device
ERRO[0200] Download connection broken: unexpected EOF    module=update_resumer
INFO[0200] Resuming download in 1m0s                     module=update_resumer
INFO[0260] Attempting to resume artifact download from offset 3505622  module=update_resumer
ERRO[0330] Download connection broken: unexpected EOF    module=update_resumer
INFO[0330] Resuming download in 1m0s                     module=update_resumer
INFO[0390] Attempting to resume artifact download from offset 7011181  module=update_resumer
ERRO[0490] Download connection broken: unexpected EOF    module=update_resumer
INFO[0490] Resuming download in 1m0s                     module=update_resumer
INFO[0550] Attempting to resume artifact download from offset 25213188  module=update_resumer
ERRO[0616] Download connection broken: unexpected EOF    module=update_resumer
INFO[0616] wrote 199274489/1392508928 bytes of update to device /dev/mmcblk1p3  module=dual_rootfs_device
ERRO[0617] Artifact install failed: reader: error reading data: invalid checksum; expected: [d0660816b5124436a5f1a186d309f3260337c63854ae5246f81836c66cc04cae]; actual: [f59da380dc12e8604cfe64883e38d958f903cfb68e23a6d1f0d41784e3e09e69]  module=state
INFO[0617] State transition: update-store [Download_Enter] -> cleanup [Error]  module=mender
INFO[0617] State transition: cleanup [Error] -> update-status-report [none]  module=mender
INFO[0617] State transition: update-status-report [none] -> idle [Idle]  module=mender
INFO[0617] authorization data present and valid          module=mender
INFO[0617] State transition: idle [Idle] -> check-wait [Idle]  module=mender
INFO[0617] State transition: check-wait [Idle] -> inventory-update [Sync]  module=mender
INFO[0618] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender
INFO[0618] State transition: check-wait [Idle] -> update-check [Sync]  module=mender
INFO[0618] State transition: update-check [Sync] -> check-wait [Idle]  module=mender
INFO[0622] State transition: check-wait [Idle] -> inventory-update [Sync]  module=mender
INFO[0622] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender
INFO[0623] State transition: check-wait [Idle] -> update-check [Sync]  module=mender
INFO[0623] State transition: update-check [Sync] -> check-wait [Idle]  module=mender
INFO[0627] State transition: check-wait [Idle] -> inventory-update [Sync]  module=mender
INFO[0627] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender
INFO[0628] State transition: check-wait [Idle] -> update-check [Sync]  module=mender

Edit: @mirzak: apply syntax highlighting

mirzak · July 11, 2019, 7:54am

Hi @gmeat,

Welcome to Mender Hub.

Lets break out the interesting parts.

This means the update has started and it is downloading the necessary bytes,

INFO[0112] opening device /dev/mmcblk1p3 for writing     module=block_device
INFO[0112] partition /dev/mmcblk1p3 size: 1392508928     module=block_device

Here it seems that you keep losing network connectivity and the mender client resumes a couple of times.

ERRO[0200] Download connection broken: unexpected EOF    module=update_resumer
INFO[0200] Resuming download in 1m0s                     module=update_resumer
INFO[0260] Attempting to resume artifact download from offset 3505622  module=update_resumer
ERRO[0330] Download connection broken: unexpected EOF    module=update_resumer
INFO[0330] Resuming download in 1m0s                     module=update_resumer
INFO[0390] Attempting to resume artifact download from offset 7011181  module=update_resumer
ERRO[0490] Download connection broken: unexpected EOF    module=update_resumer
INFO[0490] Resuming download in 1m0s                     module=update_resumer
INFO[0550] Attempting to resume artifact download from offset 25213188  module=update_resumer
ERRO[0616] Download connection broken: unexpected EOF    module=update_resumer

And here it finishes the download due to to many network interruptions (I think, @kacf can you confirm? ), but as it is not complete the checksum is wrong and the update is marked as failed.

INFO[0616] wrote 199274489/1392508928 bytes of update to device /dev/mmcblk1p3  module=dual_rootfs_device
ERRO[0617] Artifact install failed: reader: error reading data: invalid checksum; expected: [d0660816b5124436a5f1a186d309f3260337c63854ae5246f81836c66cc04cae]; actual: [f59da380dc12e8604cfe64883e38d958f903cfb68e23a6d1f0d41784e3e09e69]  module=state

[/quote]

gmeat · July 11, 2019, 8:23am

Hi Mirzak：
Thank you for your reply.
I used “ping mender.sgw.com”( mender.sgw.com is my mender server IP) command to check the network,and it never disconnect when the board downloading the .mender file.

kacf · July 11, 2019, 8:25am

I think so, yes.

gmeat · July 11, 2019, 8:50am

Hi Mirzak &Kacf:
Thank you for your help!!!
I have success to download the .mender file after I expand the memery to 8GB of server.
But now I met the other problem. When the board reboot,it haven’t boot from Rootfs B(/dev/mmcblk1p3), it still boot from RootfsA(/dev/mmcblk1p2). How to set it boot from the rootfsB after update-install ?

    INFO[7641] State transition: inventory-update [Sync] -> check-wait [Idle]  module=mender

INFO[7641] State transition: check-wait [Idle] -> update-check [Sync] module=mender
INFO[7641] Correct request for getting image from: https://s3.sgw.com:9000/mender-artifact-storage/83cbafbb-06d0-40bc-9f0c-00c9d615dc6a?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Credential=mender-deployments%2F20190711%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20190711T080812Z&X-Amz-Expires=86400&X-Amz-SignedHeaders=host&response-content-type=application%2Fvnd.mender-artifact&X-Amz-Signature=e526ba95dab25b1ea9573a6a5ac1dd14701c32af44e2629523823559721330d9 [name: SGW6010-v0.2; devices: [imx6ull14x14evk]] module=client_update
INFO[7641] State transition: update-check [Sync] -> update-fetch [Download_Enter] module=mender
INFO[7641] Running Mender version 2.0.0 module=deployment_logger
INFO[7641] State transition: update-fetch [Download_Enter] -> update-store [Download_Enter] module=mender
INFO[7642] no public key was provided for authenticating the artifact module=installer
INFO[7642] native sector size of block device /dev/mmcblk1p3 is 512, we will write in chunks of 1048576 module=dual_rootfs_device
INFO[7642] opening device /dev/mmcblk1p3 for writing module=block_device
INFO[7642] partition /dev/mmcblk1p3 size: 973078528 module=block_device
ERRO[7781] Download connection broken: read tcp 192.168.0.128:34508->192.168.0.149:9000: read: connection reset by peer module=update_resumer
INFO[7781] Resuming download in 1m0s module=update_resumer
INFO[7841] Attempting to resume artifact download from offset 2129366 module=update_resumer
INFO[8349] wrote 973078528/973078528 bytes of update to device /dev/mmcblk1p3 module=dual_rootfs_device
INFO[8350] State transition: update-store [Download_Enter] -> update-after-store [Download_Leave] module=mender
INFO[8350] State transition: update-after-store [Download_Leave] -> update-install [ArtifactInstall] module=mender
INFO[8350] Enabling partition with new image installed to be a boot candidate: 3 module=dual_rootfs_device
INFO[8350] State transition: update-install [ArtifactInstall] -> reboot [ArtifactReboot_Enter] module=mender
INFO[8350] rebooting device(s) module=state
INFO[8350] Mender rebooting from active partition: /dev/mmcblk1p2 module=dual_rootfs_device
[ OK ] Stopped target Host and Network Name Lookups.Preformatted text
[ OK ] Stopped target Bluetooth.
Stopping Bluetooth service…
[ OK ] Stopped target Timers.

mirzak · July 11, 2019, 8:54am

The log is incomplete so hard to comment.

Anyway, please verify the integration by following this checklist,

https://docs.mender.io/2.0/devices/yocto-project/bootloader-support/u-boot/integration-checklist

Topic		Replies	Views
What does "ERRO[0000] mkdir /var/lib/mender: file exists module=main" means? General Discussions yocto , sumo , nxp , standalone	7	963	October 12, 2019
Still x509 error while executing authorization request General Discussions	2	418	November 6, 2020
Application update in i.MX8M Mini General Discussions	10	953	September 24, 2020
Failure updating with Mender General Discussions yocto	5	861	January 22, 2022
Check manually for available updates General Discussions yocto , raspberry-pi-3	0	450	April 10, 2023

ERRO[0200] Download connection broken: unexpected EOF module=update_resumer

Related topics