You can set the poll to expire after a few days. It won't delete it, but it will prevent others from being able to vote.