Good question, that’s because the verb tocar literally means ‘to be someone’s turn’ with the underlying meaning of tocar ‘to touch’ and you can’t automatically turn that into the noun ‘turn’. Instead you would have to use the noun ‘turno’.
So you have two options, both fine; ‘tu turno’ or ‘te toca’.
I hope that helps 🙂