#2066 side tags seem to do a full createrepo instead of update
Opened 4 years ago by kevin. Modified 4 years ago

koji 1.20.0 and sidetag plugin, this may have been seen or fixed since the merge of sidetag plugin .

We are seeing newrepos for sidetags take about as much time as a newrepo for the build tag they are inheriting from.

Is there any way to speed this up and have the sidetags only update based on what they have changed?

Without this, side tag new repos don't scale and make everything take a long time. We had about 120 side tags and it was causing 1-2 hour delays for build tag newrepos.


Metadata Update from @kevin:
- Custom field Size adjusted to None

4 years ago

It works as expected - if you look to createrepo.log, it fetches everything from old repodata (CACHE_HITs in the second part).

Maybe some speed improvement can be done on createrepo_c side.

On koji side, maybe it makes sense to have sidetag repos lower priority for kojira, than the regular ones?

@mikem ?

Odd. I do see:
Warning: There were some invalid packages: we have to recompress other, filelists and primary xml metadata files in order to have correct package counts
wonder what those packages are?

@tkopecek any ideas here as the orig author of the sidetag plugin? Was there some way to make this faster?

I was thinking about adding parent tag as an external repo, but then we will still need to run mergerepo and it would be same or slower speed, than this createrepo_c --update approach.

Second option is to revisit multiple dnf repos approach. It would need more changes into the master code (rewriting newRepo) and different logic what latest-build means in such setup, etc. (Priority of dnf repos doesn't solve it properly).

@mikem any further ideas?

Metadata Update from @tkopecek:
- Issue tagged with: discussion

4 years ago

Login to comment on this ticket.

Metadata