Kubernetes deployments endpoint is not working, pod crashing

mister_kanister
Fri, 31 Mar 2023 10:56:34 +0000
General Discussions

Good Day, Friends!

I installed self-hosted mender on Azure VM using K3s like in the documentaion. I needed to make some adjustments because it’s not working like described in the documentaion (outdated/wrong). Every pod don’t report any errors so far. I can login and use Mender UI except for the releases tab.

Deployments pod is constantly crashing because the livenessProbe failes
deployments-7b765947b9-cb9sh 0/1 CrashLoopBackOff 251 (27s ago) 21h

Pod logs report an error I can’t comprehend

~$ kubectl logs deployments-7b765947b9-cb9sh
time="2023-03-31T10:40:28Z" level=info msg="'presign.secret' not configured. Generating a random secret." file=main.go func=main.doMain.func1 line=99
time="2023-03-31T10:40:28Z" level=info msg="Deployments Service starting up" file=main.go func=main.cmdServer line=138
time="2023-03-31T10:40:28Z" level=info msg="automigrate is ON, will apply migrations" file=migrations.go func=mongo.Migrate line=48
time="2023-03-31T10:40:28Z" level=info msg="migrating deployment_service" file=migrations.go func=mongo.MigrateSingle line=70
time="2023-03-31T10:40:28Z" level=info msg="migration to version 1.2.1 skipped" db=deployment_service file=migrator_simple.go func="migrate.(*SimpleMigrator).Apply" line=125
time="2023-03-31T10:40:28Z" level=info msg="migration to version 1.2.2 skipped" db=deployment_service file=migrator_simple.go func="migrate.(*SimpleMigrator).Apply" line=125
time="2023-03-31T10:40:28Z" level=info msg="migration to version 1.2.3 skipped" db=deployment_service file=migrator_simple.go func="migrate.(*SimpleMigrator).Apply" line=125
time="2023-03-31T10:40:28Z" level=info msg="migration to version 1.2.4 skipped" db=deployment_service file=migrator_simple.go func="migrate.(*SimpleMigrator).Apply" line=125
time="2023-03-31T10:40:28Z" level=info msg="migration to version 1.2.5 skipped" db=deployment_service file=migrator_simple.go func="migrate.(*SimpleMigrator).Apply" line=125
time="2023-03-31T10:40:28Z" level=info msg="migration to version 1.2.6 skipped" db=deployment_service file=migrator_simple.go func="migrate.(*SimpleMigrator).Apply" line=125
time="2023-03-31T10:40:28Z" level=info msg="migration to version 1.2.7 skipped" db=deployment_service file=migrator_simple.go func="migrate.(*SimpleMigrator).Apply" line=125
time="2023-03-31T10:40:28Z" level=info msg="migration to version 1.2.9 skipped" db=deployment_service file=migrator_simple.go func="migrate.(*SimpleMigrator).Apply" line=125
time="2023-03-31T10:40:28Z" level=info msg="migration to version 1.2.10 skipped" db=deployment_service file=migrator_simple.go func="migrate.(*SimpleMigrator).Apply" line=125
time="2023-03-31T10:40:28Z" level=info msg="migration to version 1.2.11 skipped" db=deployment_service file=migrator_simple.go func="migrate.(*SimpleMigrator).Apply" line=125
time="2023-03-31T10:40:28Z" level=info msg="DB migrated to version 1.2.11" db=deployment_service file=migrator_simple.go func="migrate.(*SimpleMigrator).Apply" line=140
RequestCanceled: request context canceled
caused by: context deadline exceeded

Here are my variables I used for the K3S installation. I used .yaml snippets from the documentation with minor tweaks.

export CERT_MANAGER_CHART_VERSION="v1.10.0"
export LETSENCRYPT_SERVER_URL="https://acme-v02.api.letsencrypt.org/directory"
export LETSENCRYPT_EMAIL="<email>"
export MONGODB_CHART_VERSION="12.1.31"
export MONGODB_TAG="5.0.10-debian-11-r7"
export NATS_IMAGE="nats:2.7.4-alpine"
export NATS_CHART_VERSION="0.15.1"
export MINIO_TAG="RELEASE.2021-06-17T00-10-46Z"
export MINIO_CHART_VERSION="4.1.7"
export MINIO_DOMAIN_NAME="<public-accessible-domain>" # I can upload files here
export MENDER_SERVER_DOMAIN="<public-accessible-domain>" # UI accessible
export MENDER_SERVER_URL="https://${MENDER_SERVER_DOMAIN}"
export MENDER_VERSION="3.4.0" # Chart and app version

Thanks in advance!

8 posts - 3 participants