It's not possible through the interface as it's not recommended to allow everyone to see each others' votes.
But you could manually set the option permit_view_voters_flaggers in the qa_options table to the number 120. Or 100 for users with email confirmed.