I've been trying to use oc rsh in staging, but it fails with this error message:
$ oc rsh bodhi-web-178-f6q88
Error from server (BadRequest): Upgrade request required
I am using origin-clients-3.11.1-1.fc29.x86_64.
I have the same issue.
Workaround - create SSH tunnel through bastion and use it to access OpenShift master directly without proxy server:
ssh -N -L 4444:os-master01.stg.phx2.fedoraproject.org:443 bastion.fedoraproject.org &
oc login https://127.0.0.1:4444 --token=XXXXX
to comment on this ticket.