If a Replication Server upgrade fails because of an error, restart the old Replication Server against the RSSD and fix any problem that may have caused the error. After you fix the problem, re-run the upgrade. You can do this multiple times until the upgrade succeeds.
You cannot start a new Replication Server against a partially-upgraded RSSD.