Fix to the optimizations
    
    - Fix the case where both walker reached the end of their loop
      (so avoid a potential infinite loop)
    - Check that we retrieved a commit from the branch before adding it
      to the list of known commits