Retry tests affected by #2119970 three times
    
    We keep running into 2119970 and it's really a pain restarting
    tests manually all the time. So let's just retry the affected
    tests three times. Big hammer time!
    
    Signed-off-by: Adam Williamson <awilliam@redhat.com>