KPI keeps on crashing.Error 504

Hello,

I have Kobo on my own server and my KPI keeps ons crashing and giving error 504.But enketo_express and kobocat are working okay.What could be the issue?
I could post my logs here.
@Kal_Lam @stephanealoo

Linking you with @ks_1!

@ks_1 Should I share my logs with you?

Hi,
You can post the docker logs…

1 Like

http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:45:32,404 tasks 213 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:45:47,816 tasks 212 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 |
kobocat_1 | -------------- kobocat_main_worker@kobocat v4.4.6 (cliffs)
kobocat_1 | — ***** -----
kobocat_1 | – ******* ---- Linux-4.15.0-175-generic-x86_64-with-glibc2.2.5 2022-04-22 04:41:19
kobocat_1 | - *** — * —
kobocat_1 | - ** ---------- [config]
kobocat_1 | - ** ---------- .> app: onadata:0x7f1c07484fd0
kobocat_1 | - ** ---------- .> transport: redis://:@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - ** ---------- .> results: redis://:
@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - *** — * — .> concurrency: 4 (prefork)
kobocat_1 | – ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
kobocat_1 | — ***** -----
kobocat_1 | -------------- [queues]
kobocat_1 | .> kobocat_queue exchange=kobocat_queue(direct) key=kobocat_queue
kobocat_1 |
kobocat_1 |
kobocat_1 | [tasks]
kobocat_1 | . onadata.apps.logger.tasks.create_monthly_counters
kobocat_1 | . onadata.apps.logger.tasks.fix_root_node_names
kobocat_1 | . onadata.apps.logger.tasks.generate_stats_zip
kobocat_1 | . onadata.apps.restservice.tasks.service_definition_task
kobocat_1 | . onadata.apps.viewer.models.parsed_instance.update_mongo_instance
kobocat_1 | . onadata.apps.viewer.tasks.create_csv_export
kobocat_1 | . onadata.apps.viewer.tasks.create_kml_export
kobocat_1 | . onadata.apps.viewer.tasks.create_xls_export
kobocat_1 | . onadata.apps.viewer.tasks.create_zip_export
kobocat_1 | . onadata.apps.viewer.tasks.delete_export
kobocat_1 | . onadata.apps.viewer.tasks.email_mongo_sync_status
kobocat_1 | . onadata.apps.viewer.tasks.log_stuck_exports_and_mark_failed
kobocat_1 | . onadata.celery.debug_task
kobocat_1 |
kobocat_1 | ERROR 2022-04-23 02:45:56,160 tasks 214 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:46:26,748 tasks 211 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:46:42,660 tasks 213 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:46:56,896 tasks 212 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:47:00,927 tasks 214 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 |
kobocat_1 | -------------- kobocat_main_worker@kobocat v4.4.6 (cliffs)
kobocat_1 | — ***** -----
kobocat_1 | – ******* ---- Linux-4.15.0-175-generic-x86_64-with-glibc2.2.5 2022-04-22 04:41:19
kobocat_1 | - *** — * —
kobocat_1 | - ** ---------- [config]
kobocat_1 | - ** ---------- .> app: onadata:0x7f1c07484fd0
kobocat_1 | - ** ---------- .> transport: redis://:@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - ** ---------- .> results: redis://:
@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - *** — * — .> concurrency: 4 (prefork)
kobocat_1 | – ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
kobocat_1 | — ***** -----
kobocat_1 | -------------- [queues]
kobocat_1 | .> kobocat_queue exchange=kobocat_queue(direct) key=kobocat_queue
kobocat_1 |
kobocat_1 |
kobocat_1 | [tasks]
kobocat_1 | . onadata.apps.logger.tasks.create_monthly_counters
kobocat_1 | . onadata.apps.logger.tasks.fix_root_node_names
kobocat_1 | . onadata.apps.logger.tasks.generate_stats_zip
kobocat_1 | . onadata.apps.restservice.tasks.service_definition_task
kobocat_1 | . onadata.apps.viewer.models.parsed_instance.update_mongo_instance
kobocat_1 | . onadata.apps.viewer.tasks.create_csv_export
kobocat_1 | . onadata.apps.viewer.tasks.create_kml_export
kobocat_1 | . onadata.apps.viewer.tasks.create_xls_export
kobocat_1 | . onadata.apps.viewer.tasks.create_zip_export
kobocat_1 | . onadata.apps.viewer.tasks.delete_export
kobocat_1 | . onadata.apps.viewer.tasks.email_mongo_sync_status
kobocat_1 | . onadata.apps.viewer.tasks.log_stuck_exports_and_mark_failed
kobocat_1 | . onadata.celery.debug_task
kobocat_1 |
kobocat_1 | ERROR 2022-04-23 02:47:27,048 tasks 215 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:47:42,695 tasks 213 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:47:56,920 tasks 212 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:48:00,950 tasks 214 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:48:27,112 tasks 215 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:48:42,725 tasks 213 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 |
kobocat_1 | -------------- kobocat_main_worker@kobocat v4.4.6 (cliffs)
kobocat_1 | — ***** -----
kobocat_1 | – ******* ---- Linux-4.15.0-175-generic-x86_64-with-glibc2.2.5 2022-04-22 04:41:19
kobocat_1 | - *** — * —
kobocat_1 | - ** ---------- [config]
kobocat_1 | - ** ---------- .> app: onadata:0x7f1c07484fd0
kobocat_1 | - ** ---------- .> transport: redis://:@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - ** ---------- .> results: redis://:
@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - *** — * — .> concurrency: 4 (prefork)
kobocat_1 | – ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
kobocat_1 | — ***** -----
kobocat_1 | -------------- [queues]
kobocat_1 | .> kobocat_queue exchange=kobocat_queue(direct) key=kobocat_queue
kobocat_1 |
kobocat_1 |
kobocat_1 | [tasks]
kobocat_1 | . onadata.apps.logger.tasks.create_monthly_counters
kobocat_1 | . onadata.apps.logger.tasks.fix_root_node_names
kobocat_1 | . onadata.apps.logger.tasks.generate_stats_zip
kobocat_1 | . onadata.apps.restservice.tasks.service_definition_task
kobocat_1 | . onadata.apps.viewer.models.parsed_instance.update_mongo_instance
kobocat_1 | . onadata.apps.viewer.tasks.create_csv_export
kobocat_1 | . onadata.apps.viewer.tasks.create_kml_export
kobocat_1 | . onadata.apps.viewer.tasks.create_xls_export
kobocat_1 | . onadata.apps.viewer.tasks.create_zip_export
kobocat_1 | . onadata.apps.viewer.tasks.delete_export
kobocat_1 | . onadata.apps.viewer.tasks.email_mongo_sync_status
kobocat_1 | . onadata.apps.viewer.tasks.log_stuck_exports_and_mark_failed
kobocat_1 | . onadata.celery.debug_task
kobocat_1 |
kobocat_1 | ERROR 2022-04-23 02:48:57,283 tasks 216 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:49:00,977 tasks 214 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:49:27,136 tasks 215 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:49:42,759 tasks 213 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:49:57,344 tasks 216 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:50:01,002 tasks 214 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:50:27,158 tasks 215 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:50:42,788 tasks 213 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:50:57,369 tasks 216 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:51:01,032 tasks 214 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:51:27,180 tasks 215 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 |
kobocat_1 | -------------- kobocat_main_worker@kobocat v4.4.6 (cliffs)
kobocat_1 | — ***** -----
kobocat_1 | – ******* ---- Linux-4.15.0-175-generic-x86_64-with-glibc2.2.5 2022-04-22 04:41:19
kobocat_1 | - *** — * —
kobocat_1 | - ** ---------- [config]
kobocat_1 | - ** ---------- .> app: onadata:0x7f1c07484fd0
kobocat_1 | - ** ---------- .> transport: redis://:@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - ** ---------- .> results: redis://:
@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - *** — * — .> concurrency: 4 (prefork)
kobocat_1 | – ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
kobocat_1 | — ***** -----
kobocat_1 | -------------- [queues]
kobocat_1 | .> kobocat_queue exchange=kobocat_queue(direct) key=kobocat_queue
kobocat_1 |
kobocat_1 |
kobocat_1 | [tasks]
kobocat_1 | . onadata.apps.logger.tasks.create_monthly_counters
kobocat_1 | . onadata.apps.logger.tasks.fix_root_node_names
kobocat_1 | . onadata.apps.logger.tasks.generate_stats_zip
kobocat_1 | . onadata.apps.restservice.tasks.service_definition_task
kobocat_1 | . onadata.apps.viewer.models.parsed_instance.update_mongo_instance
kobocat_1 | . onadata.apps.viewer.tasks.create_csv_export
kobocat_1 | . onadata.apps.viewer.tasks.create_kml_export
kobocat_1 | . onadata.apps.viewer.tasks.create_xls_export
kobocat_1 | . onadata.apps.viewer.tasks.create_zip_export
kobocat_1 | . onadata.apps.viewer.tasks.delete_export
kobocat_1 | . onadata.apps.viewer.tasks.email_mongo_sync_status
kobocat_1 | . onadata.apps.viewer.tasks.log_stuck_exports_and_mark_failed
kobocat_1 | . onadata.celery.debug_task
kobocat_1 |
kobocat_1 | ERROR 2022-04-23 02:51:43,120 tasks 217 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:51:57,391 tasks 216 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:52:01,055 tasks 214 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 02:52:57,415 tasks 215 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:07:26,827 tasks 216 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:08:01,435 tasks 215 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:08:42,726 tasks 216 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:09:01,457 tasks 217 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:09:42,756 tasks 216 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 |
kobocat_1 | -------------- kobocat_main_worker@kobocat v4.4.6 (cliffs)
kobocat_1 | — ***** -----
kobocat_1 | – ******* ---- Linux-4.15.0-175-generic-x86_64-with-glibc2.2.5 2022-04-22 04:41:19
kobocat_1 | - *** — * —
kobocat_1 | - ** ---------- [config]
kobocat_1 | - ** ---------- .> app: onadata:0x7f1c07484fd0
kobocat_1 | - ** ---------- .> transport: redis://:@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - ** ---------- .> results: redis://:
@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - *** — * — .> concurrency: 4 (prefork)
kobocat_1 | – ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
kobocat_1 | — ***** -----
kobocat_1 | -------------- [queues]
kobocat_1 | .> kobocat_queue exchange=kobocat_queue(direct) key=kobocat_queue
kobocat_1 |
kobocat_1 |
kobocat_1 | [tasks]
kobocat_1 | . onadata.apps.logger.tasks.create_monthly_counters
kobocat_1 | . onadata.apps.logger.tasks.fix_root_node_names
kobocat_1 | . onadata.apps.logger.tasks.generate_stats_zip
kobocat_1 | . onadata.apps.restservice.tasks.service_definition_task
kobocat_1 | . onadata.apps.viewer.models.parsed_instance.update_mongo_instance
kobocat_1 | . onadata.apps.viewer.tasks.create_csv_export
kobocat_1 | . onadata.apps.viewer.tasks.create_kml_export
kobocat_1 | . onadata.apps.viewer.tasks.create_xls_export
kobocat_1 | . onadata.apps.viewer.tasks.create_zip_export
kobocat_1 | . onadata.apps.viewer.tasks.delete_export
kobocat_1 | . onadata.apps.viewer.tasks.email_mongo_sync_status
kobocat_1 | . onadata.apps.viewer.tasks.log_stuck_exports_and_mark_failed
kobocat_1 | . onadata.celery.debug_task
kobocat_1 |
kobocat_1 | ERROR 2022-04-23 03:10:27,763 tasks 219 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 |
kobocat_1 | -------------- kobocat_main_worker@kobocat v4.4.6 (cliffs)
kobocat_1 | — ***** -----
kobocat_1 | – ******* ---- Linux-4.15.0-175-generic-x86_64-with-glibc2.2.5 2022-04-22 04:41:19
kobocat_1 | - *** — * —
kobocat_1 | - ** ---------- [config]
kobocat_1 | - ** ---------- .> app: onadata:0x7f1c07484fd0
kobocat_1 | - ** ---------- .> transport: redis://:@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - ** ---------- .> results: redis://:
@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - *** — * — .> concurrency: 4 (prefork)
kobocat_1 | – ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
kobocat_1 | — ***** -----
kobocat_1 | -------------- [queues]
kobocat_1 | .> kobocat_queue exchange=kobocat_queue(direct) key=kobocat_queue
kobocat_1 |
kobocat_1 |
kobocat_1 | [tasks]
kobocat_1 | . onadata.apps.logger.tasks.create_monthly_counters
kobocat_1 | . onadata.apps.logger.tasks.fix_root_node_names
kobocat_1 | . onadata.apps.logger.tasks.generate_stats_zip
kobocat_1 | . onadata.apps.restservice.tasks.service_definition_task
kobocat_1 | . onadata.apps.viewer.models.parsed_instance.update_mongo_instance
kobocat_1 | . onadata.apps.viewer.tasks.create_csv_export
kobocat_1 | . onadata.apps.viewer.tasks.create_kml_export
kobocat_1 | . onadata.apps.viewer.tasks.create_xls_export
kobocat_1 | . onadata.apps.viewer.tasks.create_zip_export
kobocat_1 | . onadata.apps.viewer.tasks.delete_export
kobocat_1 | . onadata.apps.viewer.tasks.email_mongo_sync_status
kobocat_1 | . onadata.apps.viewer.tasks.log_stuck_exports_and_mark_failed
kobocat_1 | . onadata.celery.debug_task
kobocat_1 |
kobocat_1 | ERROR 2022-04-23 03:10:43,035 tasks 218 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 |
kobocat_1 | -------------- kobocat_main_worker@kobocat v4.4.6 (cliffs)
kobocat_1 | — ***** -----
kobocat_1 | – ******* ---- Linux-4.15.0-175-generic-x86_64-with-glibc2.2.5 2022-04-22 04:41:19
kobocat_1 | - *** — * —
kobocat_1 | - ** ---------- [config]
kobocat_1 | - ** ---------- .> app: onadata:0x7f1c07484fd0
kobocat_1 | - ** ---------- .> transport: redis://:@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - ** ---------- .> results: redis://:
@redis-main.datacollection.amref.private:6379/2
kobocat_1 | - *** — * — .> concurrency: 4 (prefork)
kobocat_1 | – ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
kobocat_1 | — ***** -----
kobocat_1 | -------------- [queues]
kobocat_1 | .> kobocat_queue exchange=kobocat_queue(direct) key=kobocat_queue
kobocat_1 |
kobocat_1 |
kobocat_1 | [tasks]
kobocat_1 | . onadata.apps.logger.tasks.create_monthly_counters
kobocat_1 | . onadata.apps.logger.tasks.fix_root_node_names
kobocat_1 | . onadata.apps.logger.tasks.generate_stats_zip
kobocat_1 | . onadata.apps.restservice.tasks.service_definition_task
kobocat_1 | . onadata.apps.viewer.models.parsed_instance.update_mongo_instance
kobocat_1 | . onadata.apps.viewer.tasks.create_csv_export
kobocat_1 | . onadata.apps.viewer.tasks.create_kml_export
kobocat_1 | . onadata.apps.viewer.tasks.create_xls_export
kobocat_1 | . onadata.apps.viewer.tasks.create_zip_export
kobocat_1 | . onadata.apps.viewer.tasks.delete_export
kobocat_1 | . onadata.apps.viewer.tasks.email_mongo_sync_status
kobocat_1 | . onadata.apps.viewer.tasks.log_stuck_exports_and_mark_failed
kobocat_1 | . onadata.celery.debug_task
kobocat_1 |
kobocat_1 | ERROR 2022-04-23 03:11:01,032 tasks 220 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:11:27,767 tasks 217 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:11:43,093 tasks 219 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:11:57,658 tasks 218 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:12:01,095 tasks 220 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:12:27,789 tasks 217 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:12:43,268 tasks 219 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:12:57,679 tasks 218 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:13:01,115 tasks 220 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | ERROR 2022-04-23 03:13:57,699 tasks 219 139758382352192 service_definition_task - 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/
kobocat_1 | Traceback (most recent call last):
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/tasks.py”, line 26, in service_definition_task
kobocat_1 | service.send(rest_service.service_url, data)
kobocat_1 | File “/srv/src/kobocat/onadata/apps/restservice/services/kpi_hook.py”, line 34, in send
kobocat_1 | response.raise_for_status()
kobocat_1 | File “/opt/venv/lib/python3.8/site-packages/requests/models.py”, line 941, in raise_for_status
kobocat_1 | raise HTTPError(http_error_msg, response=self)
kobocat_1 | requests.exceptions.HTTPError: 504 Server Error: Gateway Time-out for url: http://kf.datacollection.amref.internal/api/v2/assets/aWtVhYzgo22BCTG6GtUzBT/hook-signal/

@ks_1 Here it is

What about the kpi logs?

1 Like

How do I get this please? @Kal_Lam