# Mender minio: trouble connecting with other containers

**URL:** https://hub.mender.io/t/mender-minio-trouble-connecting-with-other-containers/916
**Category:** General Discussions
**Tags:** minio
**Created:** [August 14, 2019, 3:13pm UTC](https://hub.mender.io/t/mender-minio-trouble-connecting-with-other-containers/916 "2019-08-14T15:13:03Z")
**Posts on this page:** 10
**Page:** 1

<div class="post-metadata">

### Author: ![genedupre](https://yyz2.discourse-cdn.com/flex036/user_avatar/hub.mender.io/genedupre/32/289_2.png) [@genedupre](https://hub.mender.io/u/genedupre)
#### Post date: [August 14, 2019, 3:13pm UTC](https://hub.mender.io/t/mender-minio-trouble-connecting-with-other-containers/916/1 "2019-08-14T15:13:03Z")

</div>

Hello everyone,  
i created several mender-production servers, but none of them have a working ‘release’ tab.  
this has probably to do with the minio and the mender-deployment container not been able to communicate & when i go to releases, i get an empty white screen

 ![minio-mender](https://canada1.discourse-cdn.com/flex036/uploads/mender/original/1X/ca48198fa209c022ddbd00b5cfc971d4afebc3c0.png)  
now the question i’m having is why, maybe ive done something wrong with the dns names or certificates, as these are the only things i’m aware of that could affect this situation.  
loggin into the minio itself is not a problem, ofcourse ignoring to cert prompt from the browser & also the containers are working like intended,  
in ./run up does does it show normal http request without an error

–logs  
prod.yml can be found [here](https://pastebin.com/y1D0QdU2)  
and for the key gen i used

```auto
CERT_API_CN=mender.inuits.io CERT_STORAGE_CN=mender.inuits.io ../keygen

```

As always thanks!

---

<div class="post-metadata">

### Author: ![drewmoseley](https://yyz2.discourse-cdn.com/flex036/user_avatar/hub.mender.io/drewmoseley/32/47_2.png) [@drewmoseley](https://hub.mender.io/u/drewmoseley)
#### Post date: [August 14, 2019, 7:56pm UTC](https://hub.mender.io/t/mender-minio-trouble-connecting-with-other-containers/916/2 "2019-08-14T19:56:46Z")

</div>

Hi @genedupre, nothing immediately jumps out at me. We will definitely need the logs to help diagnose this. The following will pull all the logs into individual files:

> $ for i in $(./run ps | grep menderprod | cut -d\_ -f2); do ./run logs $i \> $i.log.txt; done

I did see that you are using the same FQDN for both the API gateway and the storage gateway. I have not tried that so it _may_ be related.

---

<div class="post-metadata">

### Author: ![genedupre](https://yyz2.discourse-cdn.com/flex036/user_avatar/hub.mender.io/genedupre/32/289_2.png) [@genedupre](https://hub.mender.io/u/genedupre)
#### Post date: [August 16, 2019, 9:20am UTC](https://hub.mender.io/t/mender-minio-trouble-connecting-with-other-containers/916/3 "2019-08-16T09:20:42Z")

</div>

hello @drewmoseley thank you for answering,  
i also think it will have to do with the FQDN, but maybe it is because i dont fully understand the documentation,

in the production [documentation](https://docs.mender.io/2.1/administration/production-installation), there is an example of s3.

```auto
    storage-proxy:
        networks:
            mender:
                aliases:
                    - s3.example.com
    ...

```

i assume, this is the place where the ‘minio’ connects to, now we will be hosting the server ourselves, so i assume IRL this would be [mender.inuits.com](http://mender.inuits.com) the same goes for

```auto
 ...
    mender-deployments:
        ...
        environment:
            DEPLOYMENTS_AWS_AUTH_KEY: mender-deployments
            DEPLOYMENTS_AWS_AUTH_SECRET: ahshagheeD1ooPaeT8lut0Shaezeipoo
            DEPLOYMENTS_AWS_URI: https://mender.inuits.com:9000
    ...

```

and

```auto
    ...
    mender-api-gateway:
        ...
        environment:
            ALLOWED_HOSTS: mender.inuits.com
    ...

```

as everything will be put inside this one server, i assume everything should also be pointing to the same place, thus all having the same FQDN

what does the api ALLOWED\_HOSTS actually do?

as for your command @drewmoseley, this may be a novice question, but i assume this is a line for bash and i insert this line inside the run file?

Thanks for the help!

---

<div class="post-metadata">

### Author: ![drewmoseley](https://yyz2.discourse-cdn.com/flex036/user_avatar/hub.mender.io/drewmoseley/32/47_2.png) [@drewmoseley](https://hub.mender.io/u/drewmoseley)
#### Post date: [August 16, 2019, 1:21pm UTC](https://hub.mender.io/t/mender-minio-trouble-connecting-with-other-containers/916/4 "2019-08-16T13:21:29Z")

</div>

Yes, the alias under the storage-proxy setting the the URL that will be used for the Minio instance. Basically, the Mender server will store artifacts there and the URL generated when a deployment is created will be based off of that. That URL will be passed to the client for download of the new artifact. It seems like [mender.inuits.com](http://mender.inuits.com) is the URL you are using for the Mender API gateway (ie where the web UI shows up and also where the clients connect). In that case, I think you want something with a different name such as [s3.mender.inuits.com](http://s3.mender.inuits.com). I’m not sure if using a different port (9000) is enough here.

(Note that even if you use [s3.example.com](http://s3.example.com), it is not going to AWS but rather using an S3-compatible API.)

The ALLOWED\_HOSTS entry under the mender-api-gateway specifies the FQDN of the API gateway itself. This is for security purposes. More details here: [https://docs.mender.io/2.0/administration/production-installation#api-gateway](https://docs.mender.io/2.0/administration/production-installation#api-gateway)

The command I recommended needs to be run manually from a login shell on the server running your Mender instance. It will dump the logs for review.

But at the moment my best suggestion is to setup a different FQDN for the storage proxy and see if that helps.

Drew

---

<div class="post-metadata">

### Author: ![MBConsultingUK](https://yyz2.discourse-cdn.com/flex036/user_avatar/hub.mender.io/mbconsultinguk/32/243_2.png) [@MBConsultingUK](https://hub.mender.io/u/MBConsultingUK)
#### Post date: [August 17, 2019, 10:47am UTC](https://hub.mender.io/t/mender-minio-trouble-connecting-with-other-containers/916/5 "2019-08-17T10:47:40Z")

</div>

FWIW, this is identical to the issue that I’m seeing at [https://hub.mender.io/t/issue-with-mender-2-0-ui-blank-release-list-page/](https://hub.mender.io/t/issue-with-mender-2-0-ui-blank-release-list-page/) I’d not thought to look at the storage yet, but I’ll do that now, please let me know if it makes a difference for you!

---

<div class="post-metadata">

### Author: ![MBConsultingUK](https://yyz2.discourse-cdn.com/flex036/user_avatar/hub.mender.io/mbconsultinguk/32/243_2.png) [@MBConsultingUK](https://hub.mender.io/u/MBConsultingUK)
#### Post date: [August 19, 2019, 3:34pm UTC](https://hub.mender.io/t/mender-minio-trouble-connecting-with-other-containers/916/6 "2019-08-19T15:34:04Z")

</div>

Try the solution at [Working with S3 instead of Minio - no artifacts found and blank releases page](https://hub.mender.io/t/working-with-s3-instead-of-minio-no-artifacts-found-and-blank-releases-page/946/9) - it fixed my issue completely.

---

<div class="post-metadata">

### Author: ![genedupre](https://yyz2.discourse-cdn.com/flex036/user_avatar/hub.mender.io/genedupre/32/289_2.png) [@genedupre](https://hub.mender.io/u/genedupre)
#### Post date: [August 20, 2019, 9:32am UTC](https://hub.mender.io/t/mender-minio-trouble-connecting-with-other-containers/916/7 "2019-08-20T09:32:27Z")

</div>

hello @drewmoseley  
thanks for informing me about that, i had the presumption that s3 was always meant using an amazon service.

i edited the prod.yml to let the storage.proxy point to

> [s3.mender.inuits.io](http://s3.mender.inuits.io)

and mender-deployments to

> DEPLOYMENTS\_AWS\_URI: [https://s3.mender.inuits.io:9000](https://s3.mender.inuits.io:9000)

and remade the keys using

> sudo CERT\_API\_CN=[mender.inuits.com](http://mender.inuits.com) CERT\_STORAGE\_CN=[s3.mender.inuits.com](http://s3.mender.inuits.com) …/keygen

this however did not fix the problem, now i did a docker log, and saw that mender-deployments was complaining about multiple certificates, which surprises me since i removed the docker containers & volumes & rebuild them but maybe i’m still having residu files that keep pilling up each other  
( docker rmi $(docker images -q) & docker volume rm & rm -rf /var/lib/docker/volumes/)

i have made an [log](https://pastebin.com/aiT7LNne) of the containers that showed errors, at the moment i assume that it is a certificate problem that i dont yet understand

@MBConsultingUK  
thank you for the suggestion  
i was already watching your posts, will keep an eye on it as things develop

edit: made an complete version of the logs using your shell command, there to be found [here](https://filebin.ca/4s9zkbtthbgr/mender_logs_gene.zip)

---

<div class="post-metadata">

### Author: ![genedupre](https://yyz2.discourse-cdn.com/flex036/user_avatar/hub.mender.io/genedupre/32/289_2.png) [@genedupre](https://hub.mender.io/u/genedupre)
#### Post date: [August 22, 2019, 2:59pm UTC](https://hub.mender.io/t/mender-minio-trouble-connecting-with-other-containers/916/8 "2019-08-22T14:59:42Z")

</div>

so i was not finding the solution to the problem at all, so what ive done is make an exact copy of the  
[Production installation | Mender documentation](https://docs.mender.io/2.1/administration/production-installation) doc’s  
using the [mender.example.com](http://mender.example.com) FQDN and by adding both (s3)[mender.example.com](http://mender.example.com) in my /etc/hosts of my server & workstation

using standard

> CERT\_API\_CN=[mender.example.com](http://mender.example.com) CERT\_STORAGE\_CN=[s3.example.com](http://s3.example.com) …/keygen  
> for the key-gen,

after running these containers, there still seems to be no connection to the storage

 ![Screenshot%20from%202019-08-22%2016-40-53](https://canada1.discourse-cdn.com/flex036/uploads/mender/original/1X/290cf97a36b428011513476d5fa5d11f5887d018.png)  
connection to the minio with an browser works fine tough  
 ![Screenshot%20from%202019-08-22%2016-41-18](https://canada1.discourse-cdn.com/flex036/uploads/mender/original/1X/8491ef003e6af1faac8322ab3edc0176fbd354a3.png)

ive made a complete logs list [here](https://filebin.ca/4sOMsiQUHqL1/mender_logs_gene-22-08-2019.zip)  
if somebody would take a look at them & point me to what i’m doing wrong, i would really appreciate that

Thanks!

edit: i made an 1.7 mender-server, and this one seems te work fine,i cant upload artifact to it though, but this is probably because of been out-of-date in reference with my ‘fresh’ artifacts & not because of minio,

> Artifact couldn’t be uploaded. unsupported version: 3; supported versions are: 1, 2 [Request ID: ff21af7b]

---

<div class="post-metadata">

### Author: ![MBConsultingUK](https://yyz2.discourse-cdn.com/flex036/user_avatar/hub.mender.io/mbconsultinguk/32/243_2.png) [@MBConsultingUK](https://hub.mender.io/u/MBConsultingUK)
#### Post date: [August 23, 2019, 5:50am UTC](https://hub.mender.io/t/mender-minio-trouble-connecting-with-other-containers/916/9 "2019-08-23T05:50:26Z")

</div>

Dd you add the `- GATEWAY_IP=my.mender.server` to your config under the `mender-gui` section?

This is what solved it for me - everything was connecting fine with Minio _apart_ from the UI container, and adding this in fixed the issue.

Note that you can set `- GATEWAY_IP` to a hostname as well as an IP address.

---

<div class="post-metadata">

### Author: ![genedupre](https://yyz2.discourse-cdn.com/flex036/user_avatar/hub.mender.io/genedupre/32/289_2.png) [@genedupre](https://hub.mender.io/u/genedupre)
#### Post date: [September 10, 2019, 9:26am UTC](https://hub.mender.io/t/mender-minio-trouble-connecting-with-other-containers/916/10 "2019-09-10T09:26:24Z")

</div>

the problem was indeed as @drewmoseley suggested to do with the FQDN
