Depends on what you do while going faster than c and on the frame of reference. That's connected to the breaking of causality, too.
The problem is, if you go faster than c in some frame of reference, there exists another frame of reference (travelling slower than c relative to that first frame) in which you are going back in time. In that frame, you start your journey before you finish it - the cause is before the effect and causality is broken.
So, if you start from Earth, perform magic and do some maneuvers while going FTL, you might find yourself travelling back in time relative to Earth (or going infinitely fast, that's possible too). With proper maneuvers, you may finish your journey at any point in spacetime (in arbitrarily short on-board time, too).