#490 Daily snapshot of the dist-git repos
Closed: Fixed 2 years ago by arrfab. Opened 2 years ago by pingou.

All the CentOS' dist-git repositories are public but if someone wants to mirror them locally, they first have to retrieve the list of all the repositories and clone them.

To reduce the load on the servers, Fedora provides 2 tarball [1], refreshed daily:
- one that contains a clone (ie: not bare) of all the repositories
- one that contains only the spec file of each repository. this is useful when you want to grep through all the spec files for certain pattern, for example, when packaging guideline changes in Fedora, it allows to see which spec file should be adjusted.

Both tarball are created via this role: https://pagure.io/fedora-infra/ansible/blob/main/f/roles/git/make_checkout_seed and more precisely, the script is at: https://pagure.io/fedora-infra/ansible/blob/main/f/roles/git/make_checkout_seed/files/make-git-checkout-seed.sh

I am mostly interested in the first tarball, but I figure we could easily provide both.

[1] Both tarballs are at: https://src.fedoraproject.org/lookaside/
tarball with all the git repos is: git-seed-latest.tar.xz
tarball with all the spec files is: rpm-specs-latest.xz


Metadata Update from @arrfab:
- Issue assigned to arrfab

2 years ago

Metadata Update from @arrfab:
- Issue priority set to: Waiting on Assignee (was: Needs Review)
- Issue tagged with: centos-common-infra, low-gain, low-trouble

2 years ago

Just gave it a try on git.centos.org replica node to see cpu/disk usage and it's all fine.
I've pushed the script through ansible on git.centos.org node and task will run every day.

File location will be https://git.centos.org/sources/git-seed-latest.tar.xz (already existing)

Metadata Update from @arrfab:
- Issue close_status updated to: Fixed
- Issue status updated to: Closed (was: Open)

2 years ago

Login to comment on this ticket.

Metadata
Boards 1