I don't know the exact cause of it, but while playing as Doctor, I noticed the leaves on the trees were purple rectangles. (resembling missing textures)
When a survivor disconnects, the perk "Whispers" still procs off of the old survivor position and doesn't exclude them from its prerequisites for activation.