While they might "turn down the volume" a bit, they won't turn it off. It's been my experience that if you're doing a lot of other things right, they won't mess with you so much. For example, if you are keeping your sites active, not spamming the meta tags, not making your anchor links obvious, keeping fresh, original content going, removing bad links, having plenty of good backlinks, etc., you should still be OK.