KPI keeps on crashing.Error 504

Hello,

I have Kobo on my own server and my KPI keeps ons crashing and giving error 504.But enketo_express and kobocat are working okay.What could be the issue?
I could post my logs here.
@Kal_Lam @stephanealoo

Linking you with @ks_1!

@ks_1 Should I share my logs with you?

Hi,
You can post the docker logs…

1 Like

http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:45:32,404 tasks 213 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:45:47,816 tasks 212 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 |
kobocat_1 | -------------- kobocat_main_worker@kobocat v4.4.6 (cliffs)
kobocat_1 | β€” ***** -----
kobocat_1 | – ******* ---- Linux-4.15.0-175-generic-x86_64-with-glibc2.2.5 2022-04-22 04:41:19
kobocat_1 | - *** β€” * β€”
kobocat_1 | - ** ---------- [config]
kobocat_1 | - ** ---------- .> app: onadata:0x7f1c07484fd0
kobocat_1 | - ** ---------- .> transport: redis://:@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - ** ---------- .> results: redis://:
@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - *** β€” * β€” .> concurrency: 4 (prefork)
kobocat_1 | – ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
kobocat_1 | β€” ***** -----
kobocat_1 | -------------- [queues]
kobocat_1 | .> kobocat_queue exchange=kobocat_queue(direct) key=kobocat_queue
kobocat_1 |
kobocat_1 |
kobocat_1 | [tasks]
kobocat_1 | . onadata.apps.logger.tasks.create_monthly_counters
kobocat_1 | . onadata.apps.logger.tasks.fix_root_node_names
kobocat_1 | . onadata.apps.logger.tasks.generate_stats_zip
kobocat_1 | . onadata.apps.restservice.tasks.service_definition_task
kobocat_1 | . onadata.apps.viewer.models.parsed_instance.update_mongo_instance
kobocat_1 | . onadata.apps.viewer.tasks.create_csv_export
kobocat_1 | . onadata.apps.viewer.tasks.create_kml_export
kobocat_1 | . onadata.apps.viewer.tasks.create_xls_export
kobocat_1 | . onadata.apps.viewer.tasks.create_zip_export
kobocat_1 | . onadata.apps.viewer.tasks.delete_export
kobocat_1 | . onadata.apps.viewer.tasks.email_mongo_sync_status
kobocat_1 | . onadata.apps.viewer.tasks.log_stuck_exports_and_mark_failed
kobocat_1 | . onadata.celery.debug_task
kobocat_1 |
kobocat_1 | ERROR 2022-04-23 02:45:56,160 tasks 214 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:46:26,748 tasks 211 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:46:42,660 tasks 213 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:46:56,896 tasks 212 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:47:00,927 tasks 214 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 |
kobocat_1 | -------------- kobocat_main_worker@kobocat v4.4.6 (cliffs)
kobocat_1 | β€” ***** -----
kobocat_1 | – ******* ---- Linux-4.15.0-175-generic-x86_64-with-glibc2.2.5 2022-04-22 04:41:19
kobocat_1 | - *** β€” * β€”
kobocat_1 | - ** ---------- [config]
kobocat_1 | - ** ---------- .> app: onadata:0x7f1c07484fd0
kobocat_1 | - ** ---------- .> transport: redis://:@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - ** ---------- .> results: redis://:
@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - *** β€” * β€” .> concurrency: 4 (prefork)
kobocat_1 | – ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
kobocat_1 | β€” ***** -----
kobocat_1 | -------------- [queues]
kobocat_1 | .> kobocat_queue exchange=kobocat_queue(direct) key=kobocat_queue
kobocat_1 |
kobocat_1 |
kobocat_1 | [tasks]
kobocat_1 | . onadata.apps.logger.tasks.create_monthly_counters
kobocat_1 | . onadata.apps.logger.tasks.fix_root_node_names
kobocat_1 | . onadata.apps.logger.tasks.generate_stats_zip
kobocat_1 | . onadata.apps.restservice.tasks.service_definition_task
kobocat_1 | . onadata.apps.viewer.models.parsed_instance.update_mongo_instance
kobocat_1 | . onadata.apps.viewer.tasks.create_csv_export
kobocat_1 | . onadata.apps.viewer.tasks.create_kml_export
kobocat_1 | . onadata.apps.viewer.tasks.create_xls_export
kobocat_1 | . onadata.apps.viewer.tasks.create_zip_export
kobocat_1 | . onadata.apps.viewer.tasks.delete_export
kobocat_1 | . onadata.apps.viewer.tasks.email_mongo_sync_status
kobocat_1 | . onadata.apps.viewer.tasks.log_stuck_exports_and_mark_failed
kobocat_1 | . onadata.celery.debug_task
kobocat_1 |
kobocat_1 | ERROR 2022-04-23 02:47:27,048 tasks 215 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:47:42,695 tasks 213 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:47:56,920 tasks 212 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:48:00,950 tasks 214 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:48:27,112 tasks 215 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:48:42,725 tasks 213 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 |
kobocat_1 | -------------- kobocat_main_worker@kobocat v4.4.6 (cliffs)
kobocat_1 | β€” ***** -----
kobocat_1 | – ******* ---- Linux-4.15.0-175-generic-x86_64-with-glibc2.2.5 2022-04-22 04:41:19
kobocat_1 | - *** β€” * β€”
kobocat_1 | - ** ---------- [config]
kobocat_1 | - ** ---------- .> app: onadata:0x7f1c07484fd0
kobocat_1 | - ** ---------- .> transport: redis://:@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - ** ---------- .> results: redis://:
@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - *** β€” * β€” .> concurrency: 4 (prefork)
kobocat_1 | – ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
kobocat_1 | β€” ***** -----
kobocat_1 | -------------- [queues]
kobocat_1 | .> kobocat_queue exchange=kobocat_queue(direct) key=kobocat_queue
kobocat_1 |
kobocat_1 |
kobocat_1 | [tasks]
kobocat_1 | . onadata.apps.logger.tasks.create_monthly_counters
kobocat_1 | . onadata.apps.logger.tasks.fix_root_node_names
kobocat_1 | . onadata.apps.logger.tasks.generate_stats_zip
kobocat_1 | . onadata.apps.restservice.tasks.service_definition_task
kobocat_1 | . onadata.apps.viewer.models.parsed_instance.update_mongo_instance
kobocat_1 | . onadata.apps.viewer.tasks.create_csv_export
kobocat_1 | . onadata.apps.viewer.tasks.create_kml_export
kobocat_1 | . onadata.apps.viewer.tasks.create_xls_export
kobocat_1 | . onadata.apps.viewer.tasks.create_zip_export
kobocat_1 | . onadata.apps.viewer.tasks.delete_export
kobocat_1 | . onadata.apps.viewer.tasks.email_mongo_sync_status
kobocat_1 | . onadata.apps.viewer.tasks.log_stuck_exports_and_mark_failed
kobocat_1 | . onadata.celery.debug_task
kobocat_1 |
kobocat_1 | ERROR 2022-04-23 02:48:57,283 tasks 216 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:49:00,977 tasks 214 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:49:27,136 tasks 215 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:49:42,759 tasks 213 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:49:57,344 tasks 216 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:50:01,002 tasks 214 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:50:27,158 tasks 215 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:50:42,788 tasks 213 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:50:57,369 tasks 216 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:51:01,032 tasks 214 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:51:27,180 tasks 215 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 |
kobocat_1 | -------------- kobocat_main_worker@kobocat v4.4.6 (cliffs)
kobocat_1 | β€” ***** -----
kobocat_1 | – ******* ---- Linux-4.15.0-175-generic-x86_64-with-glibc2.2.5 2022-04-22 04:41:19
kobocat_1 | - *** β€” * β€”
kobocat_1 | - ** ---------- [config]
kobocat_1 | - ** ---------- .> app: onadata:0x7f1c07484fd0
kobocat_1 | - ** ---------- .> transport: redis://:@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - ** ---------- .> results: redis://:
@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - *** β€” * β€” .> concurrency: 4 (prefork)
kobocat_1 | – ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
kobocat_1 | β€” ***** -----
kobocat_1 | -------------- [queues]
kobocat_1 | .> kobocat_queue exchange=kobocat_queue(direct) key=kobocat_queue
kobocat_1 |
kobocat_1 |
kobocat_1 | [tasks]
kobocat_1 | . onadata.apps.logger.tasks.create_monthly_counters
kobocat_1 | . onadata.apps.logger.tasks.fix_root_node_names
kobocat_1 | . onadata.apps.logger.tasks.generate_stats_zip
kobocat_1 | . onadata.apps.restservice.tasks.service_definition_task
kobocat_1 | . onadata.apps.viewer.models.parsed_instance.update_mongo_instance
kobocat_1 | . onadata.apps.viewer.tasks.create_csv_export
kobocat_1 | . onadata.apps.viewer.tasks.create_kml_export
kobocat_1 | . onadata.apps.viewer.tasks.create_xls_export
kobocat_1 | . onadata.apps.viewer.tasks.create_zip_export
kobocat_1 | . onadata.apps.viewer.tasks.delete_export
kobocat_1 | . onadata.apps.viewer.tasks.email_mongo_sync_status
kobocat_1 | . onadata.apps.viewer.tasks.log_stuck_exports_and_mark_failed
kobocat_1 | . onadata.celery.debug_task
kobocat_1 |
kobocat_1 | ERROR 2022-04-23 02:51:43,120 tasks 217 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:51:57,391 tasks 216 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:52:01,055 tasks 214 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:52:57,415 tasks 215 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:07:26,827 tasks 216 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:08:01,435 tasks 215 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:08:42,726 tasks 216 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:09:01,457 tasks 217 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:09:42,756 tasks 216 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 |
kobocat_1 | -------------- kobocat_main_worker@kobocat v4.4.6 (cliffs)
kobocat_1 | β€” ***** -----
kobocat_1 | – ******* ---- Linux-4.15.0-175-generic-x86_64-with-glibc2.2.5 2022-04-22 04:41:19
kobocat_1 | - *** β€” * β€”
kobocat_1 | - ** ---------- [config]
kobocat_1 | - ** ---------- .> app: onadata:0x7f1c07484fd0
kobocat_1 | - ** ---------- .> transport: redis://:@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - ** ---------- .> results: redis://:
@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - *** β€” * β€” .> concurrency: 4 (prefork)
kobocat_1 | – ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
kobocat_1 | β€” ***** -----
kobocat_1 | -------------- [queues]
kobocat_1 | .> kobocat_queue exchange=kobocat_queue(direct) key=kobocat_queue
kobocat_1 |
kobocat_1 |
kobocat_1 | [tasks]
kobocat_1 | . onadata.apps.logger.tasks.create_monthly_counters
kobocat_1 | . onadata.apps.logger.tasks.fix_root_node_names
kobocat_1 | . onadata.apps.logger.tasks.generate_stats_zip
kobocat_1 | . onadata.apps.restservice.tasks.service_definition_task
kobocat_1 | . onadata.apps.viewer.models.parsed_instance.update_mongo_instance
kobocat_1 | . onadata.apps.viewer.tasks.create_csv_export
kobocat_1 | . onadata.apps.viewer.tasks.create_kml_export
kobocat_1 | . onadata.apps.viewer.tasks.create_xls_export
kobocat_1 | . onadata.apps.viewer.tasks.create_zip_export
kobocat_1 | . onadata.apps.viewer.tasks.delete_export
kobocat_1 | . onadata.apps.viewer.tasks.email_mongo_sync_status
kobocat_1 | . onadata.apps.viewer.tasks.log_stuck_exports_and_mark_failed
kobocat_1 | . onadata.celery.debug_task
kobocat_1 |
kobocat_1 | ERROR 2022-04-23 03:10:27,763 tasks 219 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 |
kobocat_1 | -------------- kobocat_main_worker@kobocat v4.4.6 (cliffs)
kobocat_1 | β€” ***** -----
kobocat_1 | – ******* ---- Linux-4.15.0-175-generic-x86_64-with-glibc2.2.5 2022-04-22 04:41:19
kobocat_1 | - *** β€” * β€”
kobocat_1 | - ** ---------- [config]
kobocat_1 | - ** ---------- .> app: onadata:0x7f1c07484fd0
kobocat_1 | - ** ---------- .> transport: redis://:@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - ** ---------- .> results: redis://:
@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - *** β€” * β€” .> concurrency: 4 (prefork)
kobocat_1 | – ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
kobocat_1 | β€” ***** -----
kobocat_1 | -------------- [queues]
kobocat_1 | .> kobocat_queue exchange=kobocat_queue(direct) key=kobocat_queue
kobocat_1 |
kobocat_1 |
kobocat_1 | [tasks]
kobocat_1 | . onadata.apps.logger.tasks.create_monthly_counters
kobocat_1 | . onadata.apps.logger.tasks.fix_root_node_names
kobocat_1 | . onadata.apps.logger.tasks.generate_stats_zip
kobocat_1 | . onadata.apps.restservice.tasks.service_definition_task
kobocat_1 | . onadata.apps.viewer.models.parsed_instance.update_mongo_instance
kobocat_1 | . onadata.apps.viewer.tasks.create_csv_export
kobocat_1 | . onadata.apps.viewer.tasks.create_kml_export
kobocat_1 | . onadata.apps.viewer.tasks.create_xls_export
kobocat_1 | . onadata.apps.viewer.tasks.create_zip_export
kobocat_1 | . onadata.apps.viewer.tasks.delete_export
kobocat_1 | . onadata.apps.viewer.tasks.email_mongo_sync_status
kobocat_1 | . onadata.apps.viewer.tasks.log_stuck_exports_and_mark_failed
kobocat_1 | . onadata.celery.debug_task
kobocat_1 |
kobocat_1 | ERROR 2022-04-23 03:10:43,035 tasks 218 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 |
kobocat_1 | -------------- kobocat_main_worker@kobocat v4.4.6 (cliffs)
kobocat_1 | β€” ***** -----
kobocat_1 | – ******* ---- Linux-4.15.0-175-generic-x86_64-with-glibc2.2.5 2022-04-22 04:41:19
kobocat_1 | - *** β€” * β€”
kobocat_1 | - ** ---------- [config]
kobocat_1 | - ** ---------- .> app: onadata:0x7f1c07484fd0
kobocat_1 | - ** ---------- .> transport: redis://:@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - ** ---------- .> results: redis://:
@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - *** β€” * β€” .> concurrency: 4 (prefork)
kobocat_1 | – ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
kobocat_1 | β€” ***** -----
kobocat_1 | -------------- [queues]
kobocat_1 | .> kobocat_queue exchange=kobocat_queue(direct) key=kobocat_queue
kobocat_1 |
kobocat_1 |
kobocat_1 | [tasks]
kobocat_1 | . onadata.apps.logger.tasks.create_monthly_counters
kobocat_1 | . onadata.apps.logger.tasks.fix_root_node_names
kobocat_1 | . onadata.apps.logger.tasks.generate_stats_zip
kobocat_1 | . onadata.apps.restservice.tasks.service_definition_task
kobocat_1 | . onadata.apps.viewer.models.parsed_instance.update_mongo_instance
kobocat_1 | . onadata.apps.viewer.tasks.create_csv_export
kobocat_1 | . onadata.apps.viewer.tasks.create_kml_export
kobocat_1 | . onadata.apps.viewer.tasks.create_xls_export
kobocat_1 | . onadata.apps.viewer.tasks.create_zip_export
kobocat_1 | . onadata.apps.viewer.tasks.delete_export
kobocat_1 | . onadata.apps.viewer.tasks.email_mongo_sync_status
kobocat_1 | . onadata.apps.viewer.tasks.log_stuck_exports_and_mark_failed
kobocat_1 | . onadata.celery.debug_task
kobocat_1 |
kobocat_1 | ERROR 2022-04-23 03:11:01,032 tasks 220 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:11:27,767 tasks 217 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:11:43,093 tasks 219 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:11:57,658 tasks 218 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:12:01,095 tasks 220 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:12:27,789 tasks 217 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:12:43,268 tasks 219 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:12:57,679 tasks 218 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:13:01,115 tasks 220 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:13:57,699 tasks 219 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File β€œ/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File β€œ/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/

@ks_1 Here it is

What about the kpi logs?

1 Like

How do I get this please? @Kal_Lam

Tips to Fix 504 Gateway Timeout Error
Refresh the Page. This tip may sound simple, but it’s one of the most common fixes to resolve the 504 gateway timeout error.
Check the Order Usage.
Try a Different Browser.
Flush DNS.
Test with Different Devices.
Check the Error Log.
Check Plugins.
Check CDNs.

Regards,
Rachel Gomez

1 Like