# Upload of Mender Artifacts constantly failing due to POST EOF FAILURE, likely a server side problem **URL:** \ **Category:** General Discussions\ **Tags:** yocto, mender-client, mender-artifact\ **Created:** [June 3, 2020, 7:44am UTC](https://hub.mender.io/t/upload-of-mender-artifacts-constantly-failing-due-to-post-eof-failure-likely-a-server-side-problem/1999 "2020-06-03T07:44:26Z")\ **Posts on this page:** 14\ **Page:** 1
**Author:** ![deffo](https://avatars.discourse-cdn.com/v4/letter/d/ec9cab/32.png) [@deffo](https://hub.mender.io/u/deffo)\ **Post date:** [June 3, 2020, 7:44am UTC](https://hub.mender.io/t/upload-of-mender-artifacts-constantly-failing-due-to-post-eof-failure-likely-a-server-side-problem/1999/1 "2020-06-03T07:44:26Z")
I’m trying to upload different mender artifacts via the mender-cli and browser, both are failing. With the mender-cli I get this error message: machine:~$ mender-cli artifacts --server [https://hosted.mender.io](https://hosted.mender.io) upload core-image-base-xxx-20200603064344.mender 460.88 MiB / 460.88 MiB [======================================================================================================================================================================================================] 100.00% 19s Processing uploaded file. This may take around one minute. FAILURE: POST /artifacts request failed: Post [https://hosted.mender.io/api/management/v1/deployments/artifacts:](https://hosted.mender.io/api/management/v1/deployments/artifacts:) EOF I’m pretty sure this is a server side problem, as on May 29, 2020 the same artifact was uploaded successfully. Tried it on June 2, 2020 again and it gave me the above error again and again, for different artifacts. Can you please help here. ---
**Author:** ![oleorhagen](https://yyz2.discourse-cdn.com/flex036/user_avatar/hub.mender.io/oleorhagen/32/297_2.png) [@oleorhagen](https://hub.mender.io/u/oleorhagen)\ **Post date:** [June 3, 2020, 8:19am UTC](https://hub.mender.io/t/upload-of-mender-artifacts-constantly-failing-due-to-post-eof-failure-likely-a-server-side-problem/1999/2 "2020-06-03T08:19:30Z")
Interesting. I was not able to reproduce however. I take it this is consistent. In general uploading the same Artifact twice should be an error anyways though. This is what I get: ```auto FAILURE: artifact upload failed with status 422, reason: {"error":"Artifact not unique","request_id":"274e366b-486c-4450-880e-43202b9168d5"} ``` But I feel like I have seen this EOF failure somewhere before. Give me a few minutes. ---
**Author:** ![deffo](https://avatars.discourse-cdn.com/v4/letter/d/ec9cab/32.png) [@deffo](https://hub.mender.io/u/deffo)\ **Post date:** [June 3, 2020, 8:38am UTC](https://hub.mender.io/t/upload-of-mender-artifacts-constantly-failing-due-to-post-eof-failure-likely-a-server-side-problem/1999/3 "2020-06-03T08:38:39Z")
Thanks for your quick reply. I have to add, that we are on Yocto warrior and thus using tag warrior-v2020.05 of meta-mender. ---
**Author:** ![lukas\_e](https://avatars.discourse-cdn.com/v4/letter/l/f9ae1b/32.png) [@lukas\_e](https://hub.mender.io/u/lukas_e)\ **Post date:** [June 3, 2020, 9:48am UTC](https://hub.mender.io/t/upload-of-mender-artifacts-constantly-failing-due-to-post-eof-failure-likely-a-server-side-problem/1999/4 "2020-06-03T09:48:55Z")
Hi, I work on the same project with deffo. Unfortunately I see the same bug in a different build environment. But I could “hot-fix” the bug by reducing MENDER\_STORAGE\_TOTAL\_SIZE\_MB from about 30GB to 4GB. I’m very confused, that can/should have nothing to do with it? ---
**Author:** ![mirzak](https://yyz2.discourse-cdn.com/flex036/user_avatar/hub.mender.io/mirzak/32/2056_2.png) [@mirzak](https://hub.mender.io/u/mirzak)\ **Post date:** [June 3, 2020, 10:33am UTC](https://hub.mender.io/t/upload-of-mender-artifacts-constantly-failing-due-to-post-eof-failure-likely-a-server-side-problem/1999/5 "2020-06-03T10:33:58Z")
Hm, we have had similar issues before, one example: [https://tracker.mender.io/browse/MEN-2428](https://tracker.mender.io/browse/MEN-2428) Above is fixed though, and not sure if it is related. There was also another thread on this topic, [Mender-proxy/deployments unable to upload files to minio](https://hub.mender.io/t/mender-proxy-deployments-unable-to-upload-files-to-minio/1637/10). This was related to on-premise though, and should be resolved in hosted Mender. In conclusion, there has been issues with very large Artifacts, where the API gateway timeouts. @tranchitella probably has the most up to date information here. ---
**Author:** ![lukas\_e](https://avatars.discourse-cdn.com/v4/letter/l/f9ae1b/32.png) [@lukas\_e](https://hub.mender.io/u/lukas_e)\ **Post date:** [June 8, 2020, 6:26am UTC](https://hub.mender.io/t/upload-of-mender-artifacts-constantly-failing-due-to-post-eof-failure-likely-a-server-side-problem/1999/6 "2020-06-08T06:26:05Z")
Any news here? The problem is kind of critical for us as we cannot use our desired partition layout. How can we help fix the problem? The strange thing in our case is that the actual artifact size does not seem to be the problem. ---
**Author:** ![nielsavonds](https://yyz2.discourse-cdn.com/flex036/user_avatar/hub.mender.io/nielsavonds/32/658_2.png) [@nielsavonds](https://hub.mender.io/u/nielsavonds)\ **Post date:** [June 9, 2020, 8:16am UTC](https://hub.mender.io/t/upload-of-mender-artifacts-constantly-failing-due-to-post-eof-failure-likely-a-server-side-problem/1999/7 "2020-06-09T08:16:49Z")
We’re having the same issue here with a 1.02GiB artifact. The upload fails consistently with the EOF error: FAILURE: POST /artifacts request failed: Post [https://hosted.mender.io/api/management/v1/deployments/artifacts:](https://hosted.mender.io/api/management/v1/deployments/artifacts:) EOF ---
**Author:** ![oleorhagen](https://yyz2.discourse-cdn.com/flex036/user_avatar/hub.mender.io/oleorhagen/32/297_2.png) [@oleorhagen](https://hub.mender.io/u/oleorhagen)\ **Post date:** [June 10, 2020, 12:36pm UTC](https://hub.mender.io/t/upload-of-mender-artifacts-constantly-failing-due-to-post-eof-failure-likely-a-server-side-problem/1999/8 "2020-06-10T12:36:15Z")
Alright, good to hear @nielsavonds. We are investigating the issue atm. However, it seems to be somewhat tricky to dig this one out. Are you uploading through the UI, or how are you uploading your Artifacts? We seem to only be able to reproduce this with the `mender-cli` tool. ---
**Author:** ![nielsavonds](https://yyz2.discourse-cdn.com/flex036/user_avatar/hub.mender.io/nielsavonds/32/658_2.png) [@nielsavonds](https://hub.mender.io/u/nielsavonds)\ **Post date:** [June 10, 2020, 3:28pm UTC](https://hub.mender.io/t/upload-of-mender-artifacts-constantly-failing-due-to-post-eof-failure-likely-a-server-side-problem/1999/9 "2020-06-10T15:28:59Z")
We are using mender-cli, haven’t tried the gui yet. This is our Jenkins server doing the upload. ---
**Author:** ![oleorhagen](https://yyz2.discourse-cdn.com/flex036/user_avatar/hub.mender.io/oleorhagen/32/297_2.png) [@oleorhagen](https://hub.mender.io/u/oleorhagen)\ **Post date:** [June 11, 2020, 7:54am UTC](https://hub.mender.io/t/upload-of-mender-artifacts-constantly-failing-due-to-post-eof-failure-likely-a-server-side-problem/1999/10 "2020-06-11T07:54:20Z")
I see. [This](https://github.com/mendersoftware/mender-api-gateway-docker/pull/133#event-3430723435) should be a temporary fix. I’m not sure if it is deployed yet or not. @merlin can you confirm this? ---
**Author:** ![alfrunes](https://yyz2.discourse-cdn.com/flex036/user_avatar/hub.mender.io/alfrunes/32/703_2.png) [@alfrunes](https://hub.mender.io/u/alfrunes)\ **Post date:** [June 11, 2020, 1:59pm UTC](https://hub.mender.io/t/upload-of-mender-artifacts-constantly-failing-due-to-post-eof-failure-likely-a-server-side-problem/1999/11 "2020-06-11T13:59:04Z")
We found an issue with the proxy causing requests with chunked transfer-encoding (which mender-cli uses) to become stale for too long and time out. This issue should now be resolved in Hosted Mender. ---
**Author:** ![lukas\_e](https://avatars.discourse-cdn.com/v4/letter/l/f9ae1b/32.png) [@lukas\_e](https://hub.mender.io/u/lukas_e)\ **Post date:** [January 4, 2021, 1:55pm UTC](https://hub.mender.io/t/upload-of-mender-artifacts-constantly-failing-due-to-post-eof-failure-likely-a-server-side-problem/1999/12 "2021-01-04T13:55:59Z")
Unfortunately, we see a new variant of the error. The upload works, but our pipeline (jenkins) stucks at the upload step forever. We have been seeing this behavior since December 22. (Hosted Mender (Enterprise), CLI-1.3 / CLI-1.5) Do you have any ideas? ![grafik](https://canada1.discourse-cdn.com/flex036/uploads/mender/original/2X/1/1374b5662b33ad26eb37a2780b93bf03157ec640.png) ---
**Author:** ![oleorhagen](https://yyz2.discourse-cdn.com/flex036/user_avatar/hub.mender.io/oleorhagen/32/297_2.png) [@oleorhagen](https://hub.mender.io/u/oleorhagen)\ **Post date:** [January 6, 2021, 7:34am UTC](https://hub.mender.io/t/upload-of-mender-artifacts-constantly-failing-due-to-post-eof-failure-likely-a-server-side-problem/1999/13 "2021-01-06T07:34:47Z")
Hi @lukas_e I just did a quick test on my desktop with an Artifact of 325MiBs, and it uploaded just fine to my hosted mender account. Is this present only on your CI service, or can you reproduce locally as well? ---
**Author:** ![lukas\_e](https://avatars.discourse-cdn.com/v4/letter/l/f9ae1b/32.png) [@lukas\_e](https://hub.mender.io/u/lukas_e)\ **Post date:** [January 7, 2021, 6:20pm UTC](https://hub.mender.io/t/upload-of-mender-artifacts-constantly-failing-due-to-post-eof-failure-likely-a-server-side-problem/1999/14 "2021-01-07T18:20:36Z")
Hi @oleorhagen, sorry for the late response. Unfortunately, I haven’t had much time for further investigations. In a first local test, the behavior actually did not occur 😕 . I will let you know when I have new information. Thanks for you help