In the past I've used live traps with a bit of peanut butter in them for bait. It smells, mice love it, and the oil in peanut butter means it doesn't go rancid or nasty after a few days. At one point, my house was legendary in the mouse neighbourhood for the place to get dinner and a taxi home! 
I've also tried those sonic devices and - to be honest - I've never thought much of them. As I understand it, they're supposed to create a barrier in the walls of your house so they won't actually do anything about the mice already inside.
The thing to bear in mind is that there is more than one mouse. If you're aware of one - or you see one - there are probably dozens. They also don't have bladders, so invest in some tupperware or tins for food kept in cupboards or drawers (like bread). They *will* be in there eating it.
| 
