The quickest way would be to delete all rows in the qa_uservotes table where the 'vote' field is -1. Then in the admin > stats page, click the button to recount all posts/votes.
A SQL query that would delete those rows is
DELETE FROM qa_uservotes WHERE vote=-1
