I have been told that mothballs do keep mice out of a store room, so I would think it would work to get them out.
What you don't want is to kill them, they'll rot and really stink it up.