Backwards Compatible: The Strange Math Behind Word Order in AI
Published on May 27, 2025,
by Xiaoliang Luo, Bradley C. Love

Probability 101: Does Order Matter in Sequences? Ever tried reading a sentence backward? Or jumbling the words like a word salad? Take the sentence “The cat sat on the mat” as an example (Fig. 1). Imagine calculating how likely this exact sentence is to appear. Does it matter if you start with “The” and work forward, or begin with “mat” and go backward, or even shuffle the words randomly?...
Read More