There's a lot of debate about this. Given that there are so many non-racist reasons one could give not to support Obama, I don't see why people would decline to declare their opposition to a pollster out of fear of being seen as racist.

Nevertheless, there is the notorious Bradley Effect.