Get a yard cat! LOL!
I think mice are a problem for alot of people, they can get food and nice warm bedding from the stables, you are doing the right thing keeping the yard tidy, make sure there are no bits of food left on the floor etc.
I don't really know what to suggest.
Just don't leave anything to tempt them and get a cat! That usually sorts it!