The tar is generated by https://pagure.io/fedora-infra/ansible/blob/main/f/roles/git/make_checkout_seed/files/make-git-checkout-seed.sh This request should be just modifying the existing script.

Guys, I would like to work on this issue.

Sounds good to me. Thanks @c4rt0

So, I merged the pr and ran this in staging (manually because the playbook disables it for stg normally).

It ran and finished fine, but:

https://src.stg.fedoraproject.org/lookaside/

It created the same rawhide based files. ;(
I was expecting it to make:

epel7-rpm-specs-20220623.tar.xz
epel8-rpm-specs-20220623.tar.xz
epel9-rpm-specs-20220623.tar.xz
epel7-git-seed-20220623.tar.xz
epel8-git-seed-20220623.tar.xz
epel9-git-seed-20220623.tar.xz

(and for bonus: fedora35/fedora36 too)

Anyhow, can you take a look at it and adjust it? I'm happy to run another test, or look more closely at the script (which I haven't really done).

Thanks again for working on this @c4rt0 !

Circling back to this the cron is sending an email each day. :)

I ran it manually and here's the end of the script:

++ basename /srv/git_seed/rpm-specs
+ tar -cf - -C/srv/git_seed rpm-specs
+ rm /srv/cache/lookaside//git-seed-20220930.tar.xz /srv/cache/lookaside//git-seed-latest.tar.xz     
+ rm /srv/cache/lookaside//rpm-specs-20220930.tar.xz /srv/cache/lookaside//rpm-specs-latest.tar.xz   
+ mv /srv/cache/lookaside//.git-seed-20220930.tar.xz /srv/cache/lookaside//git-seed-20220930.tar.xz  
+ mv /srv/cache/lookaside//.rpm-specs-20220930.tar.xz /srv/cache/lookaside//rpm-specs-20220930.tar.xz
+ ln -s git-seed-20220930.tar.xz /srv/cache/lookaside//git-seed-latest.tar.xz                        
+ ln -s rpm-specs-20220930.tar.xz /srv/cache/lookaside//rpm-specs-latest.tar.xz                      
+ archive_branches
++ grep -P '[a-z]+\/([fF][0-9]+|epel[0-9]+|rawhide)'                                                 
++ git branch -r --list
fatal: not a git repository (or any of the parent directories): .git                                 
+ branches=

so basically the active_branches isn't running in a git directory... and I guess it would have to run it each package directory?

Anyhow, just thought I would add more info here.

@c4rt0 Any progress on this issue?

@zlopez - since it has been a while and I'm now assigned to a different team, chances are I will not be able to work on this issue for a while.

Ok -- had a little dig into how this script works, and think i understand it a little better now.

Becauase the script checks out the repos from their local position on pkgs01, doing the whole -seed- package for each branch is going to be expensive in storage.

since the original request was for the spec tarballs, just going to implement that.

I have it basically working on stage, just waiting for the test run to finish, and will upload a PR for this.

https://pagure.io/fedora-infra/ansible/pull-request/1435

ran the script on staging FWIW:

https://src.stg.fedoraproject.org/lookaside/

@carlwgeorge https://src.fedoraproject.org/lookaside/

the spec tarballs are now showing up there.

I have updated the script on prod, and ran the script manually to update the tarballs.

This should run once a day now at 0200 UTC (as it always has)

I also updated the script so you can use a -v flag for some progress feedback when running the script (it takes a while, so it is good to know what is actually happeneing when manually running it)