I recently re-setup Kobo-install on my server, however, the nginx-certbot-nginx_ssl_proxy-1 container keeps restarting every minute.
After first running the setup script I get the following messages:
writing new private key to '/etc/letsencrypt/live/kf.mydomain/privkey.pem'
-----
[+] Running 1/1
β Ώ Container nginx-certbot-nginx_ssl_proxy-1 Started 1.2ss
Saving debug log to /var/log/letsencrypt/letsencrypt.log
Some challenges have failed.
Ask for help or search for solutions at https://community.letsencrypt.org. See the logfile /var/log/letsencrypt/letsencrypt.log or re-run Certbot with -v for more details.
Error response from daemon: Container 61cba5326b70e8a19460b7550a54b36fe10a16ea8106919e67fbe7b201544711 is restarting, wait until the container is running
### Downloading recommended TLS parameters ...
### Creating dummy certificate for kf.mydomain,kc.mydomain,ee.mydomain ...
### Starting nginx ...
### Deleting dummy certificate for kf.mydomain,kc.mydomain,ee.mydomain ...
### Requesting Let's Encrypt certificate for kf.mydomain,kc.mydomain,ee.mydomain ...
Account registered.
Requesting a certificate for kf.mydomain and 2 more domains
Certbot failed to authenticate some domains (authenticator: webroot). The Certificate Authority reported these problems:
Domain: kc.mydomain
Type: connection
Detail: mypublicipaddress: Fetching http://kc.mydomain/.well-known/acme-challenge/7jGGqP3D2e0pPndC4uSGKf-YM1oibX_bEwadNs05Oi8: Connection refused
Domain: kf.mydomain
Type: connection
Detail: mypublicipaddress: Fetching http://kf.mydomain/.well-known/acme-challenge/Z1JjCXLyrSx5BDYyk-kbKqgzHJO2Q950g-D7R8W9Y_o: Connection refused
Domain: ee.mydomain
Type: connection
Detail: mypublicipaddress: Fetching http://ee.mydomain/.well-known/acme-challenge/Ag-yWpJ555O5p-xAJYUe7ea498D5gyMD26sYC39kE-o: Connection refused
Hint: The Certificate Authority failed to download the temporary challenge files created by Certbot. Ensure that the listed domains serve their content from the provided --webroot-path/-w and that files created there can be downloaded from the internet.
### Reloading nginx ...
An error has occurred
If I run python3 run.py again it gets to the point of wating for the environment to be ready, but that never completes. Running python run.py --logs shows the following:.
kobofe-kobocat-1 | KoBoCAT intializing...
kobofe-kobocat-1 | Waiting for container `mongo`.
kobofe-kobocat-1 | wait-for-it: waiting 40 seconds for mongo.stats.gov.private:27017
kobofe-kobocat-1 | wait-for-it: mongo.stats.gov.private:27017 is available after 0 seconds
kobofe-kobocat-1 | Container `mongo` up.
kobofe-kobocat-1 | Waiting for container `postgres`.
kobofe-kobocat-1 | wait-for-it: waiting 20 seconds for postgres.stats.gov.private:5432
kobofe-kobocat-1 | wait-for-it: postgres.stats.gov.private:5432 is available after 0 seconds
kobofe-kobocat-1 | Container `postgres` up.
kobofe-kobocat-1 | Waiting for Postgres service.
kobofe-kobocat-1 | postgres.stats.gov.private:5432 - accepting connections
kobofe-kobocat-1 | Postgres service running; ensuring kobocat database exists and has PostGIS extensions...
kobofe-kobocat-1 | ERROR: database "kobocat" already exists
kobofe-kobocat-1 | You are now connected to database "kobocat" as user "kobo".
kobofe-kobocat-1 | NOTICE: extension "postgis" already exists, skipping
kobofe-kobocat-1 | NOTICE: extension "postgis_topology" already exists, skipping
kobofe-kobocat-1 | NOTICE: extension "fuzzystrmatch" already exists, skipping
kobofe-kobocat-1 | NOTICE: extension "postgis_tiger_geocoder" already exists, skipping
kobofe-kobocat-1 | CREATE EXTENSION
kobofe-kobocat-1 | CREATE EXTENSION
kobofe-kobocat-1 | CREATE EXTENSION
kobofe-kobocat-1 | CREATE EXTENSION
kobofe-kobocat-1 | Postgres database kobocat ready for use!
kobofe-kobocat-1 | Running migrations...
kobofe-kobocat-1 | Your environment is:"onadata.settings.prod"
kobofe-kobocat-1 | Operations to perform:
kobofe-kobocat-1 | Apply all migrations: admin, api, auth, authtoken, contenttypes, django_celery_beat, django_digest, guardian, logger, main, oauth2_provider, re
kobofe-kobocat-1 | Running migrations:
kobofe-kobocat-1 | No migrations to apply.
kobofe-kobocat-1 | Your models in app(s): 'logger' have changes that are not yet reflected in a migration, and so won't be applied.
kobofe-kobocat-1 | Run 'manage.py makemigrations' to make new migrations, and then re-run 'manage.py migrate' to apply them.
kobofe-kobocat-1 | Setting up cron tasks...
kobofe-kobocat-1 | KoBoCAT tmp clean-up cron installed
kobofe-kobocat-1 | KoBoCAT media automatic backup schedule: 0 0 * * 0
kobofe-kobocat-1 | Collecting static files...
kobofe-kobocat-1 | Your environment is:"onadata.settings.prod"
kobofe-kobocat-1 | Done
kobofe-kobocat-1 | Resetting ownership of media directory...
kobofe-nginx-1 | /docker-entrypoint.sh: /docker-entrypoint.d/ is not empty, will attempt to perform configuration
kobofe-nginx-1 | /docker-entrypoint.sh: Looking for shell scripts in /docker-entrypoint.d/
kobofe-nginx-1 | /docker-entrypoint.sh: Launching /docker-entrypoint.d/10-listen-on-ipv6-by-default.sh
kobofe-nginx-1 | 10-listen-on-ipv6-by-default.sh: info: Getting the checksum of /etc/nginx/conf.d/default.conf
kobofe-nginx-1 | 10-listen-on-ipv6-by-default.sh: info: Enabled listen on IPv6 in /etc/nginx/conf.d/default.conf
kobofe-nginx-1 | /docker-entrypoint.sh: Launching /docker-entrypoint.d/20-envsubst-on-templates.sh
kobofe-nginx-1 | /docker-entrypoint.sh: Launching /docker-entrypoint.d/30-init-kobo-nginx.sh
kobofe-nginx-1 | Creating includes directory
kobofe-kobocat-1 | Done.
kobofe-nginx-1 | Overwriting default nginx configuration
kobofe-nginx-1 | Clearing out any default configurations
kobofe-nginx-1 | Proxying to `kobocat` through uWSGI.
kobofe-nginx-1 | Proxying to `kpi` through uWSGI.
kobofe-nginx-1 | /docker-entrypoint.sh: Launching /docker-entrypoint.d/30-tune-worker-processes.sh
kobofe-nginx-1 | /docker-entrypoint.sh: Configuration complete; ready for start up
kobofe-kobocat-1 | %%%%%%% NOTICE %%%%%%%
kobofe-kobocat-1 | % To avoid long delays, we no longer reset ownership *recursively*
kobofe-kobocat-1 | % every time this container starts. If you have trouble with
kobofe-kobocat-1 | % permissions, please run the following command inside the
kobofe-kobocat-1 | % KoBoCAT container:
kobofe-kobocat-1 | % chown -R "kobo" "/srv/src/kobocat"
kobofe-kobocat-1 | %%%%%%%%%%%%%%%%%%%%%%
kobofe-kobocat-1 | Syncing to nginx folder...
kobofe-kobocat-1 | Done
kobofe-kobocat-1 | Cleaning up Celery PIDs...
kobofe-kobocat-1 | KoBoCAT initialization complete.
kobofe-kobocat-1 | *** Starting uWSGI 2.0.20 (64bit) on [Mon Apr 3 15:58:30 2023] ***
kobofe-kobocat-1 | compiled with version: 10.2.1 20210110 on 06 February 2023 20:38:57
kobofe-kobocat-1 | os: Linux-5.4.0-146-generic #163-Ubuntu SMP Fri Mar 17 18:26:02 UTC 2023
kobofe-kobocat-1 | nodename: kobocat
kobofe-kobocat-1 | machine: x86_64
kobofe-kobocat-1 | clock source: unix
kobofe-kobocat-1 | pcre jit disabled
kobofe-kobocat-1 | detected number of CPU cores: 4
kobofe-kobocat-1 | current working directory: /etc/service/uwsgi_wrong_port_warning
kobofe-kobocat-1 | detected binary path: /opt/venv/bin/uwsgi
kobofe-kobocat-1 | setgid() to 1000
kobofe-kobocat-1 | setuid() to 1000
kobofe-kobocat-1 | *** WARNING: you are running uWSGI without its master process manager ***
kobofe-enketo_express-1 |
kobofe-enketo_express-1 | -------------
kobofe-enketo_express-1 |
kobofe-enketo_express-1 | __/\\\\\\\\\\\\\____/\\\\____________/\\\\____/\\\\\\\\\_____
kobofe-enketo_express-1 | _\/\\\/////////\\\_\/\\\\\\________/\\\\\\__/\\\///////\\\___
kobofe-enketo_express-1 | _\/\\\_______\/\\\_\/\\\//\\\____/\\\//\\\_\///______\//\\\__
kobofe-enketo_express-1 | _\/\\\\\\\\\\\\\/__\/\\\\///\\\/\\\/_\/\\\___________/\\\/___
kobofe-enketo_express-1 | _\/\\\/////////____\/\\\__\///\\\/___\/\\\________/\\\//_____
kobofe-enketo_express-1 | _\/\\\_____________\/\\\____\///_____\/\\\_____/\\\//________
kobofe-enketo_express-1 | _\/\\\_____________\/\\\_____________\/\\\___/\\\/___________
kobofe-enketo_express-1 | _\/\\\_____________\/\\\_____________\/\\\__/\\\\\\\\\\\\\\\_
kobofe-enketo_express-1 | _\///______________\///______________\///__\///////////////__
kobofe-enketo_express-1 |
kobofe-enketo_express-1 |
kobofe-enketo_express-1 | Runtime Edition
kobofe-enketo_express-1 |
kobofe-enketo_express-1 | PM2 is a Production Process Manager for Node.js applications
kobofe-enketo_express-1 | with a built-in Load Balancer.
kobofe-enketo_express-1 |
kobofe-enketo_express-1 | Start and Daemonize any application:
kobofe-enketo_express-1 | $ pm2 start app.js
kobofe-enketo_express-1 |
kobofe-enketo_express-1 | Load Balance 4 instances of api.js:
kobofe-enketo_express-1 | $ pm2 start api.js -i 4
kobofe-enketo_express-1 |
kobofe-enketo_express-1 | Monitor in production:
kobofe-enketo_express-1 | $ pm2 monitor
kobofe-enketo_express-1 |
kobofe-enketo_express-1 | Make pm2 auto-boot at server restart:
kobofe-enketo_express-1 | $ pm2 startup
kobofe-enketo_express-1 |
kobofe-enketo_express-1 | To go further checkout:
kobofe-enketo_express-1 | http://pm2.io/
kobofe-enketo_express-1 |
kobofe-enketo_express-1 |
kobofe-enketo_express-1 | -------------
kobofe-enketo_express-1 |
kobofe-enketo_express-1 | pm2 launched in no-daemon mode (you can add DEBUG="*" env variable to get more messages)
kobofe-enketo_express-1 | 2023-04-03T15:58:20: PM2 log: Launching in no daemon mode
kobofe-enketo_express-1 | 2023-04-03T15:58:20: PM2 log: [PM2] Starting /srv/src/enketo_express/app.js in fork_mode (1 instance)
kobofe-enketo_express-1 | 2023-04-03T15:58:20: PM2 log: App [enketo:0] starting in -fork mode-
kobofe-enketo_express-1 | 2023-04-03T15:58:20: PM2 log: App [enketo:0] online
kobofe-enketo_express-1 | 2023-04-03T15:58:20: PM2 log: [PM2] Done.
kobofe-enketo_express-1 | 2023-04-03T15:58:21: PM2 log: βββββββ¬ββββββββββββ¬ββββββββββββββ¬ββββββββββ¬ββββββββββ¬βββββββββββ¬βββββββββ¬βββββββ¬ββββββββββββ¬βββββββββββ¬βββββββββββ¬β
kobofe-enketo_express-1 | β id β name β namespace β version β mode β pid β uptime β βΊ β status β cpu β mem β user β watching β
kobofe-enketo_express-1 | βββββββΌββββββββββββΌββββββββββββββΌββββββββββΌββββββββββΌβββββββββββΌβββββββββΌβββββββΌββββββββββββΌβββββββββββΌβββββββββββΌβββββββββββΌβββββββββββ€
kobofe-enketo_express-1 | β 0 β enketo β default β 5.0.0 β fork β 20 β 0s β 0 β online β 0% β 30.5mb β root β disabled β
kobofe-enketo_express-1 | βββββββ΄ββββββββββββ΄ββββββββββββββ΄ββββββββββ΄ββββββββββ΄βββββββββββ΄βββββββββ΄βββββββ΄ββββββββββββ΄βββββββββββ΄βββββββββββ΄βββββββββββ΄βββββββββββ
kobofe-enketo_express-1 | 2023-04-03T15:58:21: PM2 log: [--no-daemon] Continue to stream logs
kobofe-enketo_express-1 | 2023-04-03T15:58:21: PM2 log: [--no-daemon] Exit on target PM2 exit pid=1
kobofe-enketo_express-1 | 2023-04-03T15:58:21: PM2 log: [PM2] This PM2 is not UP TO DATE
kobofe-enketo_express-1 | 2023-04-03T15:58:21: PM2 log: [PM2] Upgrade to version 5.3.0
kobofe-enketo_express-1 | 15:58:21 PM2 | [PM2] This PM2 is not UP TO DATE
kobofe-enketo_express-1 | 15:58:21 PM2 | [PM2] Upgrade to version 5.3.0
kobofe-enketo_express-1 | 15:58:24 0|enketo | Worker 4 ready for duty at port 8005! (environment: production)
kobofe-enketo_express-1 | 15:58:24 0|enketo | Worker 3 ready for duty at port 8005! (environment: production)
kobofe-enketo_express-1 | 15:58:25 0|enketo | Worker 1 ready for duty at port 8005! (environment: production)
kobofe-enketo_express-1 | 15:58:25 0|enketo | Worker 2 ready for duty at port 8005! (environment: production)
kobofe-kobocat-1 | your memory page size is 4096 bytes
kobofe-kobocat-1 | detected max file descriptor number: 1048576
kobofe-kobocat-1 | lock engine: pthread robust mutexes
kobofe-kobocat-1 | thunder lock: disabled (you can enable it with --thunder-lock)
kobofe-kobocat-1 | uwsgi socket 0 bound to TCP address :8000 fd 3
kobofe-kobocat-1 | Python version: 3.10.9 (main, Jan 23 2023, 22:43:18) [GCC 10.2.1 20210110]
kobofe-kobocat-1 | Running `KoBoCAT` container with uWSGI application server.
kobofe-kobocat-1 | [uWSGI] getting INI configuration from /srv/src/kobocat/docker/uwsgi.ini
kobofe-kobocat-1 | *** Python threads support is disabled. You can enable it with --enable-threads ***
kobofe-kobocat-1 | Python main interpreter initialized at 0x5599f1fc1e30
kobofe-kobocat-1 | your server socket listen backlog is limited to 100 connections
kobofe-kobocat-1 | your mercy for graceful operations on workers is 60 seconds
kobofe-kobocat-1 | mapped 72920 bytes (71 KB) for 1 cores
kobofe-kobocat-1 | *** Operational MODE: single process ***
kobofe-kobocat-1 | WSGI app 0 (mountpoint='') ready in 0 seconds on interpreter 0x5599f1fc1e30 pid: 91 (default app)
kobofe-kobocat-1 | *** uWSGI is running in multiple interpreter mode ***
kobofe-kobocat-1 | spawned uWSGI worker 1 (and the only) (pid: 91, cores: 1)
kobofe-kobocat-1 |
kobofe-kobocat-1 | -------------- kobocat_main_worker@kobocat v5.2.6 (dawn-chorus)
kobofe-kobocat-1 | --- ***** -----
kobofe-kobocat-1 | -- ******* ---- Linux-5.4.0-146-generic-x86_64-with-glibc2.31 2023-04-03 15:58:35
kobofe-kobocat-1 | - *** --- * ---
kobofe-kobocat-1 | - ** ---------- [config]
kobofe-kobocat-1 | - ** ---------- .> app: onadata:0x7fb7444c3490
kobofe-kobocat-1 | - ** ---------- .> transport: redis://:**@redis-main.stats.gov.private:6379/2
kobofe-kobocat-1 | - ** ---------- .> results: redis://:**@redis-main.stats.gov.private:6379/2
kobofe-kobocat-1 | - *** --- * --- .> concurrency: 4 (prefork)
kobofe-kobocat-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
kobofe-kobocat-1 | --- ***** -----
kobofe-kobocat-1 | -------------- [queues]
kobofe-kobocat-1 | .> kobocat_queue exchange=kobocat_queue(direct) key=kobocat_queue
kobofe-kobocat-1 |
kobofe-kobocat-1 |
kobofe-kobocat-1 | [tasks]
kobofe-kobocat-1 | . onadata.apps.logger.tasks.delete_daily_counters
kobofe-kobocat-1 | . onadata.apps.logger.tasks.fix_root_node_names
kobofe-kobocat-1 | . onadata.apps.logger.tasks.generate_stats_zip
kobofe-kobocat-1 | . onadata.apps.restservice.tasks.service_definition_task
kobofe-kobocat-1 | . onadata.apps.viewer.models.parsed_instance.update_mongo_instance
kobofe-kobocat-1 | . onadata.apps.viewer.tasks.create_csv_export
kobofe-kobocat-1 | . onadata.apps.viewer.tasks.create_kml_export
kobofe-kobocat-1 | . onadata.apps.viewer.tasks.create_xls_export
kobofe-kobocat-1 | . onadata.apps.viewer.tasks.create_zip_export
kobofe-kobocat-1 | . onadata.apps.viewer.tasks.delete_export
kobofe-kobocat-1 | . onadata.apps.viewer.tasks.email_mongo_sync_status
kobofe-kobocat-1 | . onadata.apps.viewer.tasks.log_stuck_exports_and_mark_failed
kobofe-kobocat-1 | . onadata.celery.debug_task
kobofe-kobocat-1 |
kobofe-kpi-1 | KoBoForm initializing...
kobofe-kpi-1 | diff: /srv/tmp/pip_dependencies.txt: No such file or directory
kobofe-kpi-1 | Syncing production pip dependencies...
kobofe-kpi-1 |
kobofe-kpi-1 | [notice] A new release of pip available: 22.3.1 -> 23.0.1
kobofe-kpi-1 | [notice] To update, run: pip install --upgrade pip
kobofe-kpi-1 | Waiting for container `mongo`.
kobofe-kpi-1 | wait-for-it: waiting 40 seconds for mongo.stats.gov.private:27017
kobofe-kpi-1 | wait-for-it: mongo.stats.gov.private:27017 is available after 0 seconds
kobofe-kpi-1 | Container `mongo` up.
kobofe-kpi-1 | Waiting for container `postgres`.
kobofe-kpi-1 | wait-for-it: waiting 20 seconds for postgres.stats.gov.private:5432
kobofe-kpi-1 | wait-for-it: postgres.stats.gov.private:5432 is available after 0 seconds
kobofe-kpi-1 | Container `postgres` up.
kobofe-kpi-1 | Waiting for Postgres service.
kobofe-kpi-1 | postgres.stats.gov.private:5432 - accepting connections
kobofe-kpi-1 | Postgres service running; ensuring koboform database exists and has PostGIS extensions...
kobofe-kpi-1 | ERROR: database "koboform" already exists
kobofe-kpi-1 | You are now connected to database "koboform" as user "kobo".
kobofe-kpi-1 | NOTICE: extension "postgis" already exists, skipping
kobofe-kpi-1 | CREATE EXTENSION
kobofe-kpi-1 | CREATE EXTENSION
kobofe-kpi-1 | CREATE EXTENSION
kobofe-kpi-1 | CREATE EXTENSION
kobofe-kpi-1 | NOTICE: extension "postgis_topology" already exists, skipping
kobofe-kpi-1 | NOTICE: extension "fuzzystrmatch" already exists, skipping
kobofe-kpi-1 | NOTICE: extension "postgis_tiger_geocoder" already exists, skipping
kobofe-kpi-1 | Postgres database koboform ready for use!
kobofe-kpi-1 | Running migrations...
kobofe-kpi-1 | Operations to perform:
kobofe-kpi-1 | Apply all migrations: account, accounts, admin, audit_log, auth, authtoken, contenttypes, database, django_celery_beat, django_digest, external project_views, reversion, sessions, socialaccount, subsequences, taggit, trackers, trench
kobofe-kpi-1 | Running migrations:
kobofe-kpi-1 | No migrations to apply.
kobofe-kpi-1 | Your models in app(s): 'external_integrations', 'hook', 'hub' have changes that are not yet reflected in a migration, and so won't be applied.
kobofe-kpi-1 | Run 'manage.py makemigrations' to make new migrations, and then re-run 'manage.py migrate' to apply them.
kobofe-kpi-1 | Creating superuser...
kobofe-kpi-1 | User already exists.
kobofe-kpi-1 | Copying static files to nginx volume...
kobofe-kpi-1 | Cleaning up Celery PIDs...
kobofe-kpi-1 | Restore permissions on Celery logs folder
kobofe-kpi-1 | KoBoForm initialization completed.
kobofe-kpi-1 | Running `kpi` container with uWSGI application server.
kobofe-kpi-1 | [uWSGI] getting INI configuration from /srv/src/kpi/docker/uwsgi.ini
kobofe-kpi-1 |
kobofe-kpi-1 | -------------- kpi_main_worker@kpi v5.2.6 (dawn-chorus)
kobofe-kpi-1 | --- ***** -----
kobofe-kpi-1 | -- ******* ---- Linux-5.4.0-146-generic-x86_64-with-glibc2.31 2023-04-03 15:58:58
kobofe-kpi-1 | - *** --- * ---
kobofe-kpi-1 | - ** ---------- [config]
kobofe-kpi-1 | - ** ---------- .> app: kobo:0x7f50b4d57460
kobofe-kpi-1 | - ** ---------- .> transport: redis://:**@redis-main.stats.gov.private:6379/1
kobofe-kpi-1 | - ** ---------- .> results: redis://:**@redis-main.stats.gov.private:6379/1
kobofe-kpi-1 | - *** --- * --- .> concurrency: {min=2, max=6} (prefork)
kobofe-kpi-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
kobofe-kpi-1 | --- ***** -----
kobofe-kpi-1 | -------------- [queues]
kobofe-kpi-1 | .> kpi_queue exchange=kpi_queue(direct) key=kpi_queue
kobofe-kpi-1 |
kobofe-kpi-1 |
kobofe-kpi-1 | [tasks]
kobofe-kpi-1 | . kobo.apps.hook.tasks.failures_reports
kobofe-kpi-1 | . kobo.apps.hook.tasks.retry_all_task
kobofe-kpi-1 | . kobo.apps.hook.tasks.service_definition_task
kobofe-kpi-1 | . kobo.apps.subsequences.tasks.handle_translation_operation.handle_google_translation_operation
kobofe-kpi-1 | . kobo.apps.superuser_stats.tasks.generate_continued_usage_report
kobofe-kpi-1 | . kobo.apps.superuser_stats.tasks.generate_country_report
kobofe-kpi-1 | . kobo.apps.superuser_stats.tasks.generate_domain_report
kobofe-kpi-1 | . kobo.apps.superuser_stats.tasks.generate_forms_count_by_submission_range
kobofe-kpi-1 | . kobo.apps.superuser_stats.tasks.generate_media_storage_report
kobofe-kpi-1 | . kobo.apps.superuser_stats.tasks.generate_user_count_by_organization
kobofe-kpi-1 | . kobo.apps.superuser_stats.tasks.generate_user_details_report
kobofe-kpi-1 | . kobo.apps.superuser_stats.tasks.generate_user_report
kobofe-kpi-1 | . kobo.apps.superuser_stats.tasks.generate_user_statistics_report
kobofe-kpi-1 | . kobo.celery.debug_task
kobofe-kpi-1 | . kpi.tasks.enketo_flush_cached_preview
kobofe-kpi-1 | . kpi.tasks.export_in_background
kobofe-kpi-1 | . kpi.tasks.import_in_background
kobofe-kpi-1 | . kpi.tasks.project_view_export_in_background
kobofe-kpi-1 | . kpi.tasks.remove_asset_snapshots
kobofe-kpi-1 | . kpi.tasks.sync_kobocat_xforms
kobofe-kpi-1 | . kpi.tasks.sync_media_files
kobofe-kpi-1 |
kobofe-kpi-1 |
kobofe-kpi-1 | -------------- kpi_main_worker@kpi v5.2.6 (dawn-chorus)
kobofe-kpi-1 | --- ***** -----
kobofe-kpi-1 | -- ******* ---- Linux-5.4.0-146-generic-x86_64-with-glibc2.31 2023-04-03 15:58:58
kobofe-kpi-1 | - *** --- * ---
kobofe-kpi-1 | - ** ---------- [config]
kobofe-kpi-1 | - ** ---------- .> app: kobo:0x7fb883d33460
kobofe-kpi-1 | - ** ---------- .> transport: redis://:**@redis-main.stats.gov.private:6379/1
kobofe-kpi-1 | - ** ---------- .> results: redis://:**@redis-main.stats.gov.private:6379/1
kobofe-kpi-1 | - *** --- * --- .> concurrency: {min=2, max=2} (prefork)
kobofe-kpi-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
kobofe-kpi-1 | --- ***** -----
kobofe-kpi-1 | -------------- [queues]
kobofe-kpi-1 | .> kpi_low_priority_queue exchange=kpi_low_priority_queue(direct) key=kpi_low_priority_queue
kobofe-kpi-1 |
kobofe-kpi-1 |
kobofe-kpi-1 | [tasks]
kobofe-kpi-1 | . kobo.apps.hook.tasks.failures_reports
kobofe-kpi-1 | . kobo.apps.hook.tasks.retry_all_task
kobofe-kpi-1 | . kobo.apps.hook.tasks.service_definition_task
kobofe-kpi-1 | . kobo.apps.subsequences.tasks.handle_translation_operation.handle_google_translation_operation
kobofe-kpi-1 | . kobo.apps.superuser_stats.tasks.generate_continued_usage_report
kobofe-kpi-1 | . kobo.apps.superuser_stats.tasks.generate_country_report
kobofe-kpi-1 | . kobo.apps.superuser_stats.tasks.generate_domain_report
kobofe-kpi-1 | . kobo.apps.superuser_stats.tasks.generate_forms_count_by_submission_range
kobofe-kpi-1 | . kobo.apps.superuser_stats.tasks.generate_media_storage_report
kobofe-kpi-1 | . kobo.apps.superuser_stats.tasks.generate_user_count_by_organization
kobofe-kpi-1 | . kobo.apps.superuser_stats.tasks.generate_user_details_report
kobofe-kpi-1 | . kobo.apps.superuser_stats.tasks.generate_user_report
kobofe-kpi-1 | . kobo.apps.superuser_stats.tasks.generate_user_statistics_report
kobofe-kpi-1 | . kobo.celery.debug_task
kobofe-kpi-1 | . kpi.tasks.enketo_flush_cached_preview
kobofe-kpi-1 | . kpi.tasks.export_in_background
kobofe-kpi-1 | . kpi.tasks.import_in_background
kobofe-kpi-1 | . kpi.tasks.project_view_export_in_background
kobofe-kpi-1 | . kpi.tasks.remove_asset_snapshots
kobofe-kpi-1 | . kpi.tasks.sync_kobocat_xforms
kobofe-kpi-1 | . kpi.tasks.sync_media_files
kobofe-kpi-1 |
Running docker logs shows the following repeated error:
[emerg] 1#1: cannot load certificate "/etc/letsencrypt/live/kf.mydomain/fullchain.pem": BIO_new_file() failed (SSL: error:02001002:system library:fopen:No such file or directory:fopen('/etc/letsencrypt/live/kf.mydomain/fullchain.pem','r') error:2006D080:BIO routines:BIO_new_file:no such file)
nginx: [emerg] cannot load certificate "/etc/letsencrypt/live/kf.mydomain/fullchain.pem": BIO_new_file() failed (SSL: error:02001002:system library:fopen:No such file or directory:fopen('/etc/letsencrypt/live/kf.mydomain/fullchain.pem','r') error:2006D080:BIO routines:BIO_new_file:no such file)
I suspect that it is looking for old certificates that no longer exist, but I have no idea of how to resolve this.