#9805 sidetag cleanup policy
Closed: Fixed 17 days ago by kevin. Opened 8 months ago by kevin.

We currently have 154 side tags. While side tags are as lightweight as they can be, they still are a resource drain on the build system.

koji already has a sidetag cleanup script.

A first, rough proposal for a policy:

--old-delay 60 --empty-delay=14

"old-delay" is days old a side-tag is. There was some talk about getting upstream to add some way to say 'days since last build tagged'

"empy-delay" is days old a sidetag is that has 0 builds in it.

Currently this would affect the following tags:

[empty] f33-build-side-24378 (128 days, 14:09:10.778519)
[empty] f33-build-side-24661 (116 days, 0:14:34.724872)
[empty] f33-build-side-24446 (126 days, 23:04:47.816743)
[empty] f33-build-side-24448 (126 days, 13:14:04.471287)
[empty] f33-build-side-25060 (98 days, 7:54:26.436514)   
[empty] f32-build-side-24635 (117 days, 0:17:05.045899)
[empty] f32-build-side-24641 (116 days, 21:32:41.694589)
[empty] f32-build-side-24643 (116 days, 21:21:18.848870)
[empty] f33-build-side-25509 (88 days, 6:53:18.712067)
[empty] f33-build-side-25181 (95 days, 18:38:29.557211)
[empty] f33-build-side-25221 (94 days, 21:17:57.253517)
[empty] f33-build-side-25641 (85 days, 3:57:26.728717)
[empty] f33-build-side-25681 (84 days, 9:39:37.243108)
[empty] f31-build-side-27302 (60 days, 18:03:43.926635)
[empty] f32-build-side-28532 (49 days, 3:43:54.736475)
[empty] f34-build-side-28983 (42 days, 20:35:55.412958)
[empty] f34-build-side-29590 (34 days, 4:17:01.271083)
[empty] f34-build-side-29606 (34 days, 3:10:46.652537)
[empty] f34-build-side-29608 (34 days, 3:10:16.964556)
[empty] f34-build-side-29632 (34 days, 0:24:54.039499)
[empty] f34-build-side-29636 (34 days, 0:01:35.397812)
[empty] f34-build-side-29638 (33 days, 23:58:21.568405)
[empty] f34-build-side-29640 (33 days, 23:56:48.023461)
[empty] f34-build-side-29642 (33 days, 23:53:17.989335)
[empty] f34-build-side-29644 (33 days, 23:49:38.635727)
[empty] f34-build-side-29584 (34 days, 5:01:40.956549)
[empty] f34-build-side-29654 (33 days, 19:57:59.715555)
[empty] f34-build-side-29706 (33 days, 6:08:11.629991)
[empty] f34-build-side-29708 (33 days, 5:45:18.961641)
[empty] f34-build-side-29710 (33 days, 5:44:36.819427)
[empty] f34-build-side-30151 (28 days, 6:18:56.876633)
[empty] f33-build-side-30411 (24 days, 20:08:18.675181)
[empty] f33-build-side-30413 (24 days, 20:07:08.683173)
[empty] f33-build-side-30307 (26 days, 4:19:48.127923)
[old] f33-build-side-26392 (70 days, 18:33:32.246702)
[old] f33-build-side-24903 (104 days, 9:45:44.848151)
[old] f33-build-side-23785 (143 days, 18:05:37.252030)
[old] f33-build-side-24835 (108 days, 12:04:12.812369)
[old] f33-build-side-23564 (147 days, 21:43:59.274130)
[old] f33-build-side-23789 (143 days, 13:57:25.310157)
[old] f33-build-side-23793 (143 days, 10:07:01.000850)
[old] f32-build-side-25982 (77 days, 0:13:15.522484)
[old] f33-build-side-24603 (117 days, 12:15:46.570984)
[old] f33-build-side-24795 (110 days, 2:13:49.538274)
[old] f33-build-side-23982 (139 days, 12:07:19.183699)
[old] f32-build-side-23072 (158 days, 6:22:46.646770)
[old] f33-build-side-23741 (144 days, 0:36:32.459922)
[old] f33-build-side-23821 (142 days, 21:22:02.994845)
[old] f32-build-side-24797 (110 days, 1:01:56.430833)
[old] f33-build-side-23847 (142 days, 0:48:22.671884)
[old] f33-build-side-23839 (142 days, 5:10:34.671385)
[old] f33-build-side-23994 (138 days, 16:24:47.424133)
[old] f33-build-side-23996 (138 days, 11:56:33.631325)
[old] f33-build-side-24450 (126 days, 9:05:12.684257)
[old] f32-build-side-24456 (124 days, 19:21:18.628534)
[old] f33-build-side-24671 (115 days, 18:03:42.554216)
[old] f32-build-side-24639 (117 days, 0:03:49.152777)
[old] f33-build-side-25147 (97 days, 0:56:19.414116)
[old] f33-build-side-25167 (96 days, 4:22:47.952325)
[old] f32-build-side-25555 (87 days, 2:09:17.155117)
[old] f31-build-side-25561 (86 days, 23:26:21.173943)
[old] f33-build-side-26108 (74 days, 2:56:32.921508)
[old] f33-build-side-26086 (74 days, 4:41:13.866405)
[old] f33-build-side-25892 (79 days, 3:06:45.756766)
[old] f33-build-side-26112 (74 days, 2:03:00.130132)
[old] f32-build-side-26806 (65 days, 20:23:13.437057)
[old] f33-build-side-26290 (71 days, 8:00:27.204371)
[old] f34-build-side-27274 (61 days, 0:46:31.895272)
[old] f32-build-side-27282 (60 days, 21:16:10.599296)
[old] f34-build-side-27180 (62 days, 4:00:11.477190)
[old] f31-build-side-27304 (60 days, 18:02:59.818942)
[old] f33-build-side-27306 (60 days, 18:00:50.999380)

Next steps:

  • file RFE for koji
  • adjust policy until it's to our liking
  • announce/request developer freedback
  • implement.

Metadata Update from @mohanboddu:
- Issue tagged with: medium-gain, medium-trouble, ops

8 months ago

We decided to implement the --empty-delay=14 but wait on --old-delay until we get a 'days since last build tagged'

Running this today with --test:

[empty] f33-build-side-24378 (189 days, 19:27:54.370479)
[empty] f32-build-side-24635 (178 days, 5:35:48.637859)
[empty] f33-build-side-24446 (188 days, 4:23:31.408703)
[empty] f33-build-side-24448 (187 days, 18:32:48.063247)
[empty] f32-build-side-24641 (178 days, 2:51:25.286549)
[empty] f32-build-side-24643 (178 days, 2:40:02.440830)
[empty] f33-build-side-25060 (159 days, 13:13:10.028474)
[empty] f33-build-side-24661 (177 days, 5:33:18.316832)
[empty] f33-build-side-25509 (149 days, 12:12:02.304027)
[empty] f33-build-side-25181 (156 days, 23:57:13.149171)
[empty] f33-build-side-25221 (156 days, 2:36:40.845477)
[empty] f33-build-side-25641 (146 days, 9:16:10.320677)
[empty] f33-build-side-25681 (145 days, 14:58:20.835068)
[empty] f31-build-side-27302 (121 days, 23:22:27.518595)
[empty] f32-build-side-28532 (110 days, 9:02:38.328435)
[empty] f34-build-side-28983 (104 days, 1:54:39.004918)
[empty] f34-build-side-29590 (95 days, 9:35:44.863043)
[empty] f34-build-side-29606 (95 days, 8:29:30.244497)
[empty] f34-build-side-29584 (95 days, 10:20:24.548509)
[empty] f34-build-side-29608 (95 days, 8:29:00.556516)
[empty] f34-build-side-29706 (94 days, 11:26:55.221951)
[empty] f34-build-side-29632 (95 days, 5:43:37.631459)
[empty] f34-build-side-29636 (95 days, 5:20:18.989772)
[empty] f34-build-side-29638 (95 days, 5:17:05.160365)
[empty] f34-build-side-29640 (95 days, 5:15:31.615421)
[empty] f34-build-side-29708 (94 days, 11:04:02.553601)
[empty] f34-build-side-29642 (95 days, 5:12:01.581295)
[empty] f34-build-side-29644 (95 days, 5:08:22.227687)
[empty] f34-build-side-29710 (94 days, 11:03:20.411387)
[empty] f34-build-side-29654 (95 days, 1:16:43.307515)
[empty] f34-build-side-30151 (89 days, 11:37:40.468593)
[empty] f33-build-side-30307 (87 days, 9:38:31.719883)
[empty] f33-build-side-30411 (86 days, 1:27:02.267141)
[empty] f33-build-side-30413 (86 days, 1:25:52.275133)
[empty] f33-build-side-31985 (61 days, 1:33:44.316340)
[empty] f33-build-side-32457 (55 days, 6:50:20.365802)
[empty] f33-build-side-32935 (48 days, 12:58:18.338648)
[empty] f32-build-side-32937 (48 days, 12:58:11.704683)
[empty] f32-build-side-33027 (47 days, 2:27:25.065718)
[empty] f32-build-side-33029 (47 days, 2:24:43.756165)
[empty] f32-build-side-33031 (47 days, 2:24:34.753914)
[empty] f34-build-side-33981 (30 days, 23:41:36.273928)
[old] f34-build-side-31587 (66 days, 11:49:27.870114)
[old] f32-build-side-32817 (51 days, 1:46:12.094745)   
[old] f33-build-side-26392 (131 days, 23:52:15.713537)
[old] f33-build-side-24835 (169 days, 17:22:56.279204)
[old] f33-build-side-23785 (204 days, 23:24:20.718865)
[old] f33-build-side-24903 (165 days, 15:04:28.314986)
[old] f33-build-side-30603 (82 days, 6:06:58.024831)    
[old] f33-build-side-23564 (209 days, 3:02:42.740965)
[old] f33-build-side-23789 (204 days, 19:16:08.776992)     
[old] f33-build-side-24603 (178 days, 17:34:30.037819)             
[old] f32-build-side-25982 (138 days, 5:31:58.989319)
[old] f33-build-side-24795 (171 days, 7:32:33.005109)
[old] f32-build-side-23072 (219 days, 11:41:30.113605)
[old] f33-build-side-23982 (200 days, 17:26:02.650534)
[old] f32-build-side-24797 (171 days, 6:20:39.897668)                 
[old] f33-build-side-23741 (205 days, 5:55:15.926757)               
[old] f33-build-side-23793 (204 days, 15:25:44.467685)
[old] f33-build-side-23821 (204 days, 2:40:46.461680)
[old] f33-build-side-23847 (203 days, 6:07:06.138719)
[old] f33-build-side-23839 (203 days, 10:29:18.138220)
[old] f33-build-side-23994 (199 days, 21:43:30.890968)   
[old] f33-build-side-23996 (199 days, 17:15:17.098160)
[old] f33-build-side-24450 (187 days, 14:23:56.151092)  
[old] f32-build-side-24456 (186 days, 0:40:02.095369)
[old] f32-build-side-24639 (178 days, 5:22:32.619612)            
[old] f33-build-side-24671 (176 days, 23:22:26.021051)                              
[old] f33-build-side-25147 (158 days, 6:15:02.880951)   
[old] f33-build-side-25167 (157 days, 9:41:31.419160)  
[old] f32-build-side-25555 (148 days, 7:28:00.621952)  
[old] f31-build-side-25561 (148 days, 4:45:04.640778)   
[old] f33-build-side-26108 (135 days, 8:15:16.388343)  
[old] f33-build-side-26086 (135 days, 9:59:57.333240)  
[old] f33-build-side-25892 (140 days, 8:25:29.223601)   
[old] f33-build-side-26112 (135 days, 7:21:43.596967)  
[old] f34-build-side-27274 (122 days, 6:05:15.362107)   
[old] f32-build-side-26806 (127 days, 1:41:56.903892)   
[old] f33-build-side-26290 (132 days, 13:19:10.671206) 
[old] f34-build-side-27180 (123 days, 9:18:54.944025)  
[old] f34-build-side-27436 (119 days, 2:40:43.043827)   
[old] f33-build-side-27306 (121 days, 23:19:34.466215)  
[old] f34-build-side-28234 (114 days, 13:23:48.053044) 
[old] f34-build-side-27647 (117 days, 8:39:53.262851)  
[old] f32-build-side-27651 (117 days, 7:57:24.180305) 
[old] f31-build-side-27657 (117 days, 7:30:47.942530) 
[old] f33-build-side-28610 (109 days, 8:25:09.899982)  
[old] f34-build-side-28446 (111 days, 5:52:16.748515) 
[old] f33-build-side-28520 (110 days, 10:51:29.312162) 
[old] f32-build-side-28737 (107 days, 14:05:40.647324)
[old] f33-build-side-28767 (107 days, 5:37:46.898731) 
[old] f33-build-side-28745 (107 days, 13:48:53.151156)
[old] f33-build-side-28757 (107 days, 10:21:43.491628)
[old] f33-build-side-28739 (107 days, 14:05:27.658140) 
[old] f32-build-side-28819 (106 days, 14:11:52.058386)
[old] f33-build-side-28820 (106 days, 14:11:51.999151)
[old] f32-build-side-28823 (106 days, 13:50:13.003027) 
[old] f33-build-side-28985 (104 days, 1:42:11.913591) 
[old] f33-build-side-28825 (106 days, 13:49:45.173359) 
[old] f33-build-side-29105 (102 days, 7:57:12.945461) 
[old] f32-build-side-28987 (104 days, 1:42:06.361129) 
[old] f33-build-side-29131 (102 days, 3:04:13.969064) 
[old] f33-build-side-29197 (101 days, 4:31:29.603114) 
[old] f32-build-side-29199 (101 days, 4:30:58.932514) 
[old] f34-build-side-29464 (97 days, 0:38:49.202609)   
[old] f33-build-side-29300 (100 days, 1:25:31.605674)  
[old] f33-build-side-29484 (96 days, 15:02:23.831118) 
[old] f33-build-side-29574 (95 days, 12:04:01.572846)
[old] f32-build-side-30605 (82 days, 5:57:42.163650)  
[old] f34-build-side-29712 (94 days, 10:35:18.459912)  
[old] f34-build-side-30069 (90 days, 3:28:13.624987) 
[old] f33-build-side-30045 (90 days, 7:21:18.342438)   
[old] f34-build-side-29846 (93 days, 8:55:53.656629)  
[old] f34-build-side-30145 (89 days, 11:52:13.695472) 
[old] f34-build-side-29746 (94 days, 5:52:52.398499)  
[old] f33-build-side-30033 (90 days, 11:19:54.688691) 
[old] f34-build-side-29792 (93 days, 13:27:32.230513)   
[old] f33-build-side-30021 (90 days, 12:29:30.777924)
[old] f34-build-side-30149 (89 days, 11:39:13.262720)      
[old] f34-build-side-30153 (89 days, 11:36:52.295508)              
[old] f34-build-side-30257 (88 days, 6:12:28.865225) 
[old] f33-build-side-30259 (88 days, 6:11:59.987784) 
[old] f33-build-side-30325 (87 days, 7:26:04.742650)  
[old] f33-build-side-30275 (87 days, 23:30:29.230012) 
[old] f33-build-side-30309 (87 days, 9:34:47.185336)                  
[old] f33-build-side-30597 (82 days, 7:14:36.263145)                
[old] f33-build-side-30415 (86 days, 1:25:33.141448)  
[old] f32-build-side-30417 (86 days, 1:01:44.993173) 
[old] f32-build-side-30599 (82 days, 7:14:33.582904) 
[old] f34-build-side-30655 (81 days, 8:19:26.770121)  
[old] f34-build-side-31597 (66 days, 9:59:45.193199)     
[old] f33-build-side-30669 (81 days, 3:22:28.443764)  
[old] f32-build-side-30717 (80 days, 5:42:40.089892)    
[old] f33-build-side-30719 (80 days, 5:17:17.745203) 
[old] f33-build-side-31031 (74 days, 4:31:36.792770)             
[old] f33-build-side-31113 (72 days, 21:35:05.604884)                               
[old] f32-build-side-31047 (73 days, 22:01:25.294884)   
[old] f33-build-side-30955 (75 days, 7:35:37.254145)   
[old] f33-build-side-31079 (73 days, 7:01:17.657722)   
[old] f33-build-side-31153 (72 days, 6:25:22.290762)    
[old] f31-build-side-31045 (73 days, 22:01:43.166190)  
[old] f33-build-side-31049 (73 days, 22:01:18.242361)  
[old] f33-build-side-31155 (72 days, 6:24:13.586837)    
[old] f33-build-side-31495 (68 days, 2:30:46.788754)   
[old] f32-build-side-31493 (68 days, 2:30:54.392477)    
[old] f33-build-side-31513 (67 days, 17:43:26.823619)   
[old] f32-build-side-32053 (60 days, 1:32:02.453782)   
[old] f33-build-side-31667 (65 days, 8:40:07.941380)   
[old] f33-build-side-31689 (65 days, 4:24:10.051147)    
[old] f32-build-side-31693 (65 days, 3:57:13.991996)    
[old] f33-build-side-32055 (60 days, 1:31:59.767526)   
[old] f33-build-side-32469 (55 days, 6:22:34.124995)   
[old] f33-build-side-31987 (61 days, 1:06:53.412053)  
[old] f32-build-side-31989 (61 days, 0:43:50.426933)  
[old] f33-build-side-32041 (60 days, 5:04:05.767774)   
[old] f33-build-side-32615 (53 days, 10:50:25.526913) 
[old] f33-build-side-32455 (55 days, 7:11:06.650203)   
[old] eln-build-side-32479 (55 days, 3:31:43.215127)  
[old] f33-build-side-32747 (52 days, 6:21:49.242915)  
[old] f34-build-side-32997 (47 days, 8:45:59.876256)  
[old] f33-build-side-32771 (51 days, 17:33:54.102037) 
[old] f32-build-side-32693 (52 days, 13:34:11.548546)  
[old] f33-build-side-32795 (51 days, 8:37:10.976362)  
[old] eln-build-side-32813 (51 days, 1:54:16.687294)  
[old] f33-build-side-33127 (45 days, 9:33:16.407686)   
[old] f33-build-side-32973 (47 days, 23:03:14.283109) 
[old] f33-build-side-33197 (44 days, 6:38:25.019519)   
[old] f32-build-side-33043 (47 days, 2:01:29.939294)  
[old] f33-build-side-33049 (47 days, 0:41:23.685157)  
[old] f34-build-side-33877 (32 days, 1:09:23.260504)  
[old] f33-build-side-33731 (34 days, 3:11:27.518024)  
[old] f33-build-side-33733 (34 days, 2:28:39.750450)  
[old] f33-build-side-33735 (34 days, 2:28:05.914868)   
[old] f34-build-side-33705 (35 days, 7:29:15.267641)   
[old] f33-build-side-33909 (31 days, 17:55:43.825091) 
[old] f32-build-side-33983 (30 days, 23:31:30.662112)

Sent information about this to the devel-announce list asking for input on devel list or here.

Things were getting bad so I ran it to delete tags over 90 days old.

Metadata Update from @humaton:
- Issue tagged with: mini-initiative

a month ago

Metadata Update from @mohanboddu:
- Issue tagged with: backlog

a month ago

So, above we said: "We decided to implement the --empty-delay=14 but wait on --old-delay until we get a 'days since last build tagged'"

but I don't think we should wait for that anymore. We have too many sidetags sitting around.

So, I would like to do '--empty-delay=14 --old-delay=30'

If you have a sidetag around for a month, you are doing it wrong. And even so you could just make a new sidetag and tag your old builds into it... an annoyance that might get you to finish using it. If we just keyed off last tagged data you could just tag in something and out to keep a sidetag forever.

This is now live and announced.

Metadata Update from @kevin:
- Issue close_status updated to: Fixed
- Issue status updated to: Closed (was: Open)

17 days ago

Login to comment on this ticket.

Metadata
Boards 3
Ops Status: Backlog
Mini Initiative Status: In Progress
mini-initative Status: Done