Can I buy a horse with Jorvik Shillings?

No. Horses can only be purchased with Star Coins in-game and from Star Stable Horses app.

If you wish to obtain a horse for free you need to reach maximum reputation with Soul Riding.