Why did this bother me so much and how can I stop thinking about it..?

It bothers you because you are passionate about horse riding and your horse. Just shake it off, your horse is lucky to have an owner like you, you actually care about your horse, it's not just some animal to you. You should have a horse, so don't worry, she's probably jealous you were out riding and not her