That is a genuine argument that the Senate doesn't have the...

That is a genuine argument that the Senate doesn't have the power to convict once he leaves office.

I personally think that it's unlikely the Supreme Court would find that as there's precedent of it happening in the past with other positions, and it would set a new precedent where an official would be effectively immune from anything they do wrong late in their term.