humaton / fedora-infra / ansible

Forked from fedora-infra/ansible 5 years ago
Clone

f703e7a Add and use optimized http log syncing script

4 files Authored by nphilipp 3 years ago, Committed by nphilipp 3 years ago,
    Add and use optimized http log syncing script
    
    The previous one synced all hosts serially and ran rsync for each log
    file. This reimplements the shell script in Python, with these changes:
    
    - Run rsync on whole directories of log files, with much reduced
      overhead.
    - Use a pool of five workers which process hosts in parallel.
    
    Additionally, remove download-rdu01.vpn.fedoraproject.org from the list
    of synced hosts.
    
    Signed-off-by: Nils Philippsen <nils@redhat.com>