Does your survey have multiple questions than span more than one page? If
so. that's the issue. I had to put all my questions in the same page to
avoid this issue since my Survey is for anonymous users.
Hope this helps,
MVP Sharepoint Server