koji

Clone

#1037 use --update for dist-repos if possible
Merged 4 years ago by tkopecek. Opened 5 years ago by tkopecek.
tkopecek/koji issue1031  into  master

file modified
+27 -4 
@@ -5473,6 +5473,11 @@ 
 

                  #       split repos as well
 

                  oldpkgs.append(path)
 

  

+         oldrepo = self.session.getRepo(tag, dist=True, state=koji.REPO_READY)
 

+         oldrepodata = None
 

+         if oldrepo:
 

+             oldrepodir = koji.pathinfo.distrepo(oldrepo['id'], tag)
 

+ 

          # sort out our package list(s)
 

          self.uploadpath = self.getUploadDir()
 

          self.get_rpms(tag, arch, keys, opts)
 
@@ -5487,13 +5492,17 @@ 
 

          self.link_pkgs()
 

  

          # generate the repodata
 

+         if oldrepo:
 

+             oldrepodata = os.path.join(oldrepodir, arch, 'repodata')
 

          self.do_createrepo(self.repodir, '%s/pkglist' % self.repodir,
 

-                     groupdata, oldpkgs=oldpkgs)
 

+                     groupdata, oldpkgs=oldpkgs, oldrepodata=oldrepodata)
 

          for subrepo in self.subrepos:
 

+             if oldrepo:
 

+                 oldrepodata = os.path.join(oldrepodir, arch, subrepo, 'repodata')
 

              self.do_createrepo(
 

                      '%s/%s' % (self.repodir, subrepo),
 

                      '%s/%s/pkglist' % (self.repodir, subrepo),
 

-                     groupdata, oldpkgs=oldpkgs,
 

+                     groupdata, oldpkgs=oldpkgs, oldrepodata=oldrepodata,
 

                      logname='createrepo_%s' % subrepo)
 

          if len(self.kojipkgs) == 0:
 

              fn = os.path.join(self.repodir, "repodata", "EMPTY_REPO")
 
@@ -5543,7 +5552,8 @@ 
 

              json.dump(self.repo_files, fp, indent=4)
 

          self.session.uploadWrapper(fn, self.uploadpath)
 

  

-     def do_createrepo(self, repodir, pkglist, groupdata, oldpkgs=None, logname=None):
 

+     def do_createrepo(self, repodir, pkglist, groupdata, oldpkgs=None,
 

+             logname=None, oldrepodata=None):
 

          """Run createrepo
 

  

          This is derived from CreaterepoTask.create_local_repo, but adapted to
 
@@ -5557,7 +5567,20 @@ 
 

          cmd.extend(['-vd', '-i', pkglist])
 

          if groupdata and os.path.isfile(groupdata):
 

              cmd.extend(['-g', groupdata])
 

-         # TODO: can we recycle data (with --update) as in create_local_repo?
 

+         if pkglist and oldrepodata and self.options.createrepo_update:
 

+             if not os.path.isdir(oldrepodata):
 

+                 self.logger.warn("old repodata is missing: %s" % oldrepodata)
 

+             else:
 

+                 datadir = os.path.join(repodir, 'repodata')
 

+                 shutil.copytree(oldrepodata, datadir)
 

+                 oldorigins = os.path.join(datadir, 'pkgorigins.gz')
 

+                 if os.path.isfile(oldorigins):
 

+                     # remove any previous origins file and rely on mergerepos
 

+                     # to rewrite it (if we have external repos to merge)
 

+                     os.unlink(oldorigins)
 

+                 cmd.append('--update')
 

+                 if self.options.createrepo_skip_stat:
 

+                     cmd.append('--skip-stat')
 

          if oldpkgs:
 

              # generate delta-rpms
 

              cmd.append('--deltas')

Where did that delta=False option come from. Doesn't appear to be used.

Also:

builder/kojid:5334:66: F821 undefined name 'olddatadir'

I think the subrepo business complicates this. Using the same oldrepodata value for all of them is probably not going to help.

Added fix for subrepos.

rebased onto d063a843a95ba35221ec808677b3c9de17f90eb4
5 years ago

Metadata Update from @tkopecek:
- Pull-request tagged with: testing-ready
4 years ago

What is the delta=False param used for?

Ah, not used anymore in this version. Removed.

rebased onto a209a91b173f2a6df2b93271db3abfd5dce1c3da
4 years ago

is this TODO resovled?

rebased onto d0c17fa
4 years ago

Yes, updated

:thumbsup:

:thumbsup:

Commit aa48b87 fixes this pull-request

Pull-Request has been merged by tkopecek
4 years ago

Metadata Update from @jcupova:
- Pull-request tagged with: testing-done
4 years ago
Changes Summary 1
+27 -4
file changed
builder/kojid
Powered by Pagure 5.13.3
Documentation • File an Issue • About • SSH Hostkey/Fingerprint
© Red Hat, Inc. and others.