Queue Voicemail

I am having an issue if an agent does not answer a call coming in from a queue because they have popped away from their desk, and that agent gets the call, if they don't answer it is sending that caller to their voicemail and not putting them back into the queue for another agent to take the call, Is there a way of stopping this without having to take the users VM away from them