Um, no.

I despise Nic Cage and think he's an awful actor, but off the top of my head I can think of at least one fantastic movie he was in (Adaptation). He certainly didn't help the movie, but to write off an actor you're basically just chancing missing something you'd like. If a movie with an interesting premise came out and you heard word that it was great, you'd skip it because of an actor? Screenwriters and directors make more sense with this kind of question.