Random Submission Not Submitted to Rest Service

joshworkman · October 19, 2022, 9:00pm

Description

On one of our in use Surveys on the Kobo Humanitarian service, we discovered a single form submission that was not sent out via the Rest-Service set up. I’ve been unable to find anything unique about this form submission that would cause it not to be transmitted.

Steps to Reproduce

I am unable to reproduce the issue, which is part of the problem.

Expected behavior

I expect Every form submission to be transmitted to the configured Rest Service

Actual behavior

One specific submission does not show up in the list of sent submissions on the Rest Service, and my receiving service does not show it in the logs.

Not in this list anywhere

Kal_Lam · October 20, 2022, 2:41pm

@joshworkman, did you mean all the other submissions were successful while one submission was not successful?

joshworkman · October 20, 2022, 4:56pm

@Kal_Lam, sort of.

I mean that every other submission shows that it attempted to send it to the rest-service, except for one which doesn’t show up anywhere in the logs.

So, it’s not that it failed, it’s that it didn’t even try to send that one submission.

joshworkman · October 24, 2022, 4:02pm

@Kal_Lam, this is an urgent issue that has occurred again on another submission.

Do you have any suggestions or guidance on how to proceed, or debugging steps?

Josh · October 26, 2022, 7:44am

Hi @joshworkman, I have raised the issue with the team and we will investigate. If the matter is urgent, I suggest resubmitting the data associated with those submissions so that they will (hopefully) be sent to your external server by the REST Service. If there is a bug on our end, it won’t necessarily be patched on your urgent timeline and will only affect future submissions.

To resubmit the data, you can enter it back into a form manually or do it through the API. If you need assistance with the API, then I can help.

joshworkman · October 26, 2022, 2:40pm

Thanks @Josh . I’ve made a quick utility to manually import submissions using the API, which works well if we know which submission was missed. Our concern is that we may not notice a missed submission in time.

Josh · October 27, 2022, 5:35am

Hi @joshworkman that’s great! We will investigate the REST Service problem in the meantime so that this won’t be a persistent issue.

Josh · October 27, 2022, 6:20am

github.com/kobotoolbox/kpi

Rest Service Not Transmitting All Submissions

opened 04:26PM - 24 Oct 22 UTC

joshua-workman

bug backend

## Description The REST Service configured for our form is not transmitting eve…ry submission. So far, we've found two form submissions that do not show up in the list of transmitted submissions in the logs on Kobo, or in the logs of received messages on our cloud function. ## Steps to Reproduce We have not been able to determine a pattern or how to reproduce the issue, which is part of the concern. ## Expected behavior I expect the Rest Service to forward every submission to the configured endpoint. ## Actual behavior In an unpredictable manner, some submissions are not forwarded, and there is no logging or messaging to indicate why this happens. ## Additional details Our form is on the humanitarian response domain. The REST Services configuration is pointing at a HTTP function in Azure that just pops the submission into a queue to be processed later. These two submissions are the ones that did not get sent. ![image](https://user-images.githubusercontent.com/68927591/197575846-943e6b6b-41dc-4126-91a7-6cffe20a1813.png) ![image](https://user-images.githubusercontent.com/68927591/197576849-8cdf9dc8-9246-4673-8724-00b47abc29c1.png) This is the only list I can find on the KOBO side to show what submissions are sent. Neither of the two submissions above can be found anywhere in this list. ![image](https://user-images.githubusercontent.com/68927591/197575610-f222b0c9-28ae-49f5-a143-9d850daa0067.png)