Here is a typical statement (from Culture and Value) of Wittgenstein renouncing the Tractatus:
I might say: if the place I want to get to could only be reached by way of a ladder, I would give up trying to get there. For the place I really have to get to is a place I must already be at now.
Anything that I might reach by climbing a ladder does not interest me.
What Wittgenstein renounces in the Tractatus is its own manner of renunciation--it "throws away the ladder" only after having used it to get somewhere. "It is a great temptation," says another remark in Culture and Value, "to try to make the spirit explicit." If the temptation tries to mitigate itself by intending subsequently to put this explicitation under erasure, that only makes the temptation all the more insidious, because it betrays the spirit while pretending to piety. It is Wittgenstein's succumbing to this temptation in the Tractatus which calls for its renunciation.