Non-Lethal Mouse Trap
If you don't want to kill the mouse, just get a toilet paper roll and place a pumpkin seed in one end of it. Place the toilet roll so that it is hanging precariously over some kind of bucket or wastebasket. Put some shredded newspaper or whatever into the basket if you think the mouse might take some damage from the fall.
Mice love tunnels so they will naturally run into the tube and overbalance it so it falls into the basket. After this you simply dump him in your neighbor's yard. make sure you wash out the basket with bleach because house mice are usually diseased.