No, they only need to be able to contact you.

However, as far as I know, even if you change your listed address, your _past_ addresses are still published, unfortunately. There was some movement towards ending that, but I don't think it was successful.