Okay, I figured it out! I’m posting the solution here so that someone may find it useful one day -
Kobo recognizes the language being used by the first column cell that have been coded in the label column. So, if you code a word or a sentence in Arabic (make sure that it is not a combination of English and Arabic words), the form will switch from left to right to right to left.