I've ponied for years without any issues, you just need to use common sense and really pay attention. No earbuds, no loose horses, no too loose lead ropes... Just start slow and don't assume anything lol.
Accidents can happen - I know of one who broke her neck, but it was an unbroke horse...