Traveling on horseback:
— A file of men ahorseback passed by.

synoniem: ahorse.

On the back of a horse:
— Policeman patrolled the streets ahorseback.

synoniemen: ahorse, horseback.