Gateway timeout / unable to deploy error

I would suggest going back one week and reload the XLS Form that was working well and rebuild from there, testing frequently. I imagine that someone introduced a logical error.

1 Like

I went through each of the ~5,200 lines of the xls file and found no errors other than some duplicate select_one names. I updated those and added options for them on the choices tab. I’ve done all of the standard troubleshooting, none of it helps.

Hi
Just confirming whether you actually tried working of a previous version of XLS that worked as suggested by @jblackman. If not then maybe you should do so.

It would also be important to show which errors are you exactly seeing.

Regards
Stephane

I included my errors in the very first post, because I had already spent a significant amount of time troubleshooting the issues and decided to reach out for ideas in case someone else had experienced this and found a workaround.

As I said above, I went through each row to check for errors. And yes, I went back and looked at older versions and timed all versions up to the largest:

  1. The deploy process works fine until about 1,500 rows, where it slows down but is still usable.

  2. At about 2,100 rows, the deploy process and the preview page starts to take ~5 minutes each to load.

  3. At 3,500 rows, deploy takes about 8 mins, the preview takes about 7 minutes with intermittently choosing to continue the slow loading script,

  4. At 4,300 rows, deploy becomes so unreliable that it can only be uploaded maybe once or twice per day, after refreshing the browser and cache all day, and, apparently, catching the server at a low traffic moment. Preview takes 9 or so minutes to load.

  5. At 5,000+ rows, deploy is impossible, preview loads after 10+ minutes.

Hi @tnkai, thanks for the detailed troubleshooting you’ve done. Are the bulk of the ~5,200 rows in the choices sheet, and, if so, have you tried http://xlsform.org/en/#external-selects?

If you’re willing to share your form with the development team for further troubleshooting, please send it to me via private message on this forum.

1 Like

No, the “choices” sheet only has around 1,600 lines. I’ll send you one of the most recent versions of the form, where the “survey” sheet has over 7,000 lines and includes most of the info we need to use.

1 Like

@tnkai, I know we have a separate private conversation going on now, but for the public’s benefit, what are you using to fill out this form? Enketo, Collect, or something else? I’m curious to know how the client performs with a form this large.

1 Like

For the most part, we are using the multiple submission link and working from a browser. Some of our reviewers have to use the form where there is no wifi access, so I had them pre-load the forms before they went out of range. They field tested it using laptops and they said it worked well enough (barring some other issues with printing, shared forms, etc.)

I have tested it with Collect - it loads fine, but the questions are hard to keep track of and come across strangely because of how I currently have the questions set up for the grid theme. It’s also quite difficult to navigate through so many sections on a small device.

Hi there,

Sorry to bother you. But I’ve been having the exact same issues as tnkai and was wondering whether you managed to find a solution to the problem.

The survey sheet of our form has 4840 rows and the choices sheet has 2171 rows.

The xls form does not contain any syntax errors other than some duplicate select_multiple.

Very grateful for any help you could offer.

Best
Vincent

Welcome to the community, @VincentG! Are you able to share your xlsform with the community? The community would wish to look at your xlsform and see if there is anything we could help you out with.

1 Like

Hi @Kal_Lam

As a new user, it says I cannot updoad attachment. Is there another way to share my xlsform?

Many thanks.

@VincentG, try it now, and you should be able to. If you still have an issue, please refresh your browser.

VincentG_form.xlsx (479.2 KB)

Many thanks in advance for your help on this!

@VincentG, I see that you have a very long set of questions and an equally long set of choices. Generally if your survey project is either too large or complex, the system may time out before deployment completes. Kindly please be informed that the web server only allows each request to take 120 seconds. Hence such forms do not get deployed.

Thanks for your answer @Kal_Lam . I guess I’ll just have to split the form into 2.

Best
Vincent

2 Likes

Hello - I ended up changing some of the question types to version that required fewer lines and then I split the form into two sets. The longer set is still a little slow, but at least it loads. :neutral_face:

2 Likes

Welcome back to the community, @tnkai! And, thank you for sharing your workaround with the community! It should help the community having similar issues in the upcoming days.

1 Like

Hi @tnkai

thanks for your answer - yes, I’m going to split the form into two sets. A bit annoying but hey…

Cheers,
V

1 Like

Hi @tnkai and @Kal_Lam,

We have ~1650 rows (1383 questions) that we cannot deploy due to a timeout of just 60s, not 120s as mentioned.

Is it possible to configure this timeout in the application? We run Kobo Toolbox on our server.

@Kal_Lam in this post you were able to deploy 4685 questions. Did that import work in less than 60s or the timeout changed since then?

Thank you!

Sharing for others: in kobo-docker/nginx/kobo-docker-scripts/nginx.conf add a new proxy_read_timeout setting under http:

http {
   ...
  proxy_read_timeout 300;
  ...
}
1 Like