Urgent- Sever slow down on the system

aamra · April 22, 2020, 7:14am

Dear KoBo support team,

We are having sever slow down now and we are unable to open the system.

Best Regards, Abd-Rabu

emreozkan90 · April 22, 2020, 8:20am

Same server slow down problem also we are facing from the morning.
I think admin didnt realize yet

ahmetcelik · April 22, 2020, 9:22am

system does not work server gives error

mcaglidil · April 22, 2020, 9:36am

Now slow down issue evolved to 502 Bad gateway or failed to load environment data.

mcaglidil · April 22, 2020, 9:49am

Seems, now entire server is down.

Dear @admins, could you please look at this asap?

Thanks,

eimanosman · April 22, 2020, 10:15am

Server is down, and when it works it is very slow.

aamra · April 22, 2020, 11:59am

Today was a day from hell. and we don’t find any support to understand what is happening.

I have nearly 150 staff working in data collection and everyone is panicking as a result of the slow down and the repeated error messages.

Kal_Lam · April 22, 2020, 2:54pm

Hi @aamra, @emreozkan90, @ahmetcelik, @mcaglidil and @eimanosman

Thanks for posting this. Our team is looking into this. I just tried using the server myself and haven’t experienced any delays or loading issues anymore. This was likely a temporary issue due to high server load by some large project owners. Note that the servers are automatically scaled up whenever there is an extreme demand so that more front-end servers are added as needed. This usually takes a few minutes to take effect. No data will be lost if one of your users fails to upload data in this period, it can just be resubmitted later. We will update this thread as soon as we know if there was something else going on.

Apologies for the inconvenience caused!

Have a great day!

stephanealoo · April 22, 2020, 5:22pm

Hi @aamra, @emreozkan90, @ahmetcelik, @mcaglidil and @eimanosman

Just picking up from @Kal_Lam coudl you please indicate if you are still experiencing server issues on your end? I also do not seem to see the issue currently.

Stephane

jnm · April 22, 2020, 5:46pm

Thanks for the reports and your patience. We have adjusted our auto-scaling configuration for humanitarianresponse.info to add extra capacity more quickly when load on the servers increases. The service should be stable as of 15:57 UTC.

If you’re still seeing issues, please include the exact text of the error message (or a screenshot) to help us troubleshoot effectively.

aamra · April 22, 2020, 6:39pm

Many thanks for your followup. I hope that this will stop the problem from happening again in the future.

Have a nice day!