#12308 Unable to get Fedora 41 CN mirrors in metalink.
Closed: Fixed with Explanation 2 months ago by kevin. Opened 2 months ago by jackyzy823.

Describe what you would like us to do:


I hope that the infra team could find out why CN mirrors for Fedora 41 are not returned in metalink (and even with adding &country=CN in metalink url).

It is clear that CN mirrors for Fedora 41 are active: https://mirrormanager.fedoraproject.org/mirrors/Fedora/41

Fedora 40 metalink could return CN mirrors correctly.

Response of https://mirrors.fedoraproject.org/metalink?repo=fedora-40&arch=x86_64

<?xml version="1.0" encoding="utf-8"?>
<metalink version="3.0" xmlns="http://www.metalinker.org/" type="dynamic" pubdate="Wed, 27 Nov 2024 01:50:03 GMT" generator="mirrormanager" xmlns:mm0="http://fedorahosted.org/mirrormanager">
 <files>
  <file name="repomd.xml">
   <mm0:timestamp>1713120671</mm0:timestamp>
   <size>6285</size>
   <verification>
    <hash type="md5">8a9923bd9faba440fbe2c8ea5c5b301e</hash>
    <hash type="sha1">8aed8f72da845069152236f2df03ea0b77c6ad56</hash>
    <hash type="sha256">d201bd1eeb17086cd3aaf82b156810a5ba3f389e10b4472c9b2c7182f771a9ef</hash>
    <hash type="sha512">f3c39eaf8d6aedd0daff60fa9521140f72a29fdf62f780f8dea98d49d9b8210b424c15445417a0e261cfb0732fee263444a451547ebbd81a8520c73d9ebb10a8</hash>
   </verification>
   <resources maxconnections="1">
    <url protocol="https" type="https" location="CN" preference="100">https://mirror.nyist.edu.cn/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="CN" preference="100">http://mirror.nyist.edu.cn/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="CN" preference="100">rsync://mirror.nyist.edu.cn/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="CN" preference="99">https://mirrors.huaweicloud.com/repository/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="CN" preference="99">http://mirrors.huaweicloud.com/repository/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="CN" preference="98">http://mirrors.yun-idc.com/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="CN" preference="98">rsync://mirrors.yun-idc.com/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="CN" preference="98">https://mirrors.yun-idc.com/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="CN" preference="97">http://mirrors.sohu.com/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="CN" preference="97">rsync://mirrors.sohu.com/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="CN" preference="96">https://mirrors.tuna.tsinghua.edu.cn/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="CN" preference="96">http://mirrors.tuna.tsinghua.edu.cn/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="CN" preference="96">rsync://mirrors.tuna.tsinghua.edu.cn/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="CN" preference="95">rsync://mirrors.neusoft.edu.cn/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="CN" preference="95">http://mirrors.neusoft.edu.cn/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="CN" preference="95">https://mirrors.neusoft.edu.cn/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="CN" preference="94">http://mirrors.jlu.edu.cn/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="CN" preference="94">https://mirrors.jlu.edu.cn/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="CN" preference="94">rsync://mirrors.jlu.edu.cn/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="JP" preference="93">https://ftp.yz.yamagata-u.ac.jp/pub/linux/fedora-projects/fedora/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="JP" preference="93">http://ftp.yz.yamagata-u.ac.jp/pub/linux/fedora-projects/fedora/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="JP" preference="93">rsync://ftp.yz.yamagata-u.ac.jp/pub/linux/fedora-projects/fedora/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="MY" preference="92">http://mirrors.ipserverone.com/fedora/fedora/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="MY" preference="92">https://mirrors.ipserverone.com/fedora/fedora/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="JP" preference="91">http://ftp.riken.jp/Linux/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="JP" preference="91">rsync://ftp.riken.jp/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="JP" preference="91">https://ftp.riken.jp/Linux/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="SG" preference="90">rsync://mirror.freedif.org/fedora/fedora/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="SG" preference="90">http://mirror.freedif.org/fedora/fedora/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="SG" preference="90">https://mirror.freedif.org/fedora/fedora/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="JP" preference="89">http://ftp.iij.ad.jp/pub/linux/Fedora/fedora/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="JP" preference="89">rsync://ftp.iij.ad.jp/pub/linux/Fedora/fedora/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="HK" preference="88">http://hkg.mirror.rackspace.com/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="HK" preference="88">https://hkg.mirror.rackspace.com/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="HK" preference="88">rsync://hkg.mirror.rackspace.com/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="JP" preference="87">https://repo.jing.rocks/fedora-buffet/fedora/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="JP" preference="87">http://repo.jing.rocks/fedora-buffet/fedora/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="JP" preference="87">rsync://repo.jing.rocks/fedora-enchilada/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="TW" preference="86">rsync://mirror.twds.com.tw/fedora/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="TW" preference="86">https://mirror.twds.com.tw/fedora/fedora/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="TW" preference="86">http://mirror.twds.com.tw/fedora/fedora/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="SG" preference="85">https://download.nus.edu.sg/mirror/fedora/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="SG" preference="85">http://download.nus.edu.sg/mirror/fedora/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="SG" preference="85">rsync://download.nus.edu.sg/fedora/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="AZ" preference="84">https://mirror.yer.az/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="AZ" preference="84">http://mirror.yer.az/fedora/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="TH" preference="83">http://mirror2.totbb.net/fedora/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="TH" preference="83">rsync://mirror2.totbb.net/fedora/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="TW" preference="82">https://fedora.cs.nycu.edu.tw/fedora/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="KZ" preference="81">https://mirror.hoster.kz/fedora/fedora/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="KZ" preference="81">rsync://mirror.hoster.kz/fedora-enchilada/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="KZ" preference="81">http://mirror.hoster.kz/fedora/fedora/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="TW" preference="80">rsync://free.nchc.org.tw/fedora/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="TW" preference="80">https://free.nchc.org.tw/fedora/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="TW" preference="80">http://free.nchc.org.tw/fedora/linux/releases/40/Everything/x86_64/os/repodata/repomd.xml</url>
   </resources>
  </file>
 </files>
</metalink>

Response of https://mirrors.fedoraproject.org/metalink?repo=fedora-41&arch=x86_64 and https://mirrors.fedoraproject.org/metalink?repo=fedora-41&arch=x86_64&country=CN

<metalink version="3.0" xmlns="http://www.metalinker.org/" type="dynamic" pubdate="Wed, 27 Nov 2024 01:48:55 GMT" generator="mirrormanager" xmlns:mm0="http://fedorahosted.org/mirrormanager">
 <files>
  <file name="repomd.xml">
   <mm0:timestamp>1729845679</mm0:timestamp>
   <size>5959</size>
   <verification>
    <hash type="md5">22c14e7e373c25027e04c38205088bfa</hash>
    <hash type="sha1">3b893b695cff0ba3b3f006907687511eeeeefc61</hash>
    <hash type="sha256">0856aa0776cf1d2ff8ad7ac468b28ef8b077c8aaa5f67ce3b119d5effe845b90</hash>
    <hash type="sha512">2a54cbd22ac980a67b704399ac26854007a7ca9d01790a51682ae182c789250df1539b4e1e3230bb35f2138aa430271f8b7dd8fecf2ee528a82411c7ccf4a824</hash>
   </verification>
   <resources maxconnections="1">
    <url protocol="rsync" type="rsync" location="TW" preference="100">rsync://mirror.twds.com.tw/fedora/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="TW" preference="100">https://mirror.twds.com.tw/fedora/fedora/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="TW" preference="100">http://mirror.twds.com.tw/fedora/fedora/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="JP" preference="99">https://repo.jing.rocks/fedora-buffet/fedora/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="JP" preference="99">http://repo.jing.rocks/fedora-buffet/fedora/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="JP" preference="99">rsync://repo.jing.rocks/fedora-enchilada/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="JP" preference="98">http://ftp.riken.jp/Linux/fedora/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="JP" preference="98">rsync://ftp.riken.jp/fedora/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="JP" preference="98">https://ftp.riken.jp/Linux/fedora/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="JP" preference="97">http://ftp.iij.ad.jp/pub/linux/Fedora/fedora/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="JP" preference="97">rsync://ftp.iij.ad.jp/pub/linux/Fedora/fedora/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="SG" preference="96">rsync://mirror.freedif.org/fedora/fedora/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="SG" preference="96">http://mirror.freedif.org/fedora/fedora/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="SG" preference="96">https://mirror.freedif.org/fedora/fedora/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="JP" preference="95">https://ftp.yz.yamagata-u.ac.jp/pub/linux/fedora-projects/fedora/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="JP" preference="95">http://ftp.yz.yamagata-u.ac.jp/pub/linux/fedora-projects/fedora/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="JP" preference="95">rsync://ftp.yz.yamagata-u.ac.jp/pub/linux/fedora-projects/fedora/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="TH" preference="94">http://mirror2.totbb.net/fedora/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="TH" preference="94">rsync://mirror2.totbb.net/fedora/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="TW" preference="93">rsync://free.nchc.org.tw/fedora/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="TW" preference="93">https://free.nchc.org.tw/fedora/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="TW" preference="93">http://free.nchc.org.tw/fedora/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="KZ" preference="92">https://mirror.hoster.kz/fedora/fedora/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="KZ" preference="92">rsync://mirror.hoster.kz/fedora-enchilada/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="KZ" preference="92">http://mirror.hoster.kz/fedora/fedora/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="SG" preference="91">https://download.nus.edu.sg/mirror/fedora/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="SG" preference="91">http://download.nus.edu.sg/mirror/fedora/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="SG" preference="91">rsync://download.nus.edu.sg/fedora/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="MY" preference="90">http://mirrors.ipserverone.com/fedora/fedora/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="MY" preference="90">https://mirrors.ipserverone.com/fedora/fedora/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="TW" preference="89">https://fedora.cs.nycu.edu.tw/fedora/linux/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="http" type="http" location="HK" preference="88">http://hkg.mirror.rackspace.com/fedora/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="https" type="https" location="HK" preference="88">https://hkg.mirror.rackspace.com/fedora/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
    <url protocol="rsync" type="rsync" location="HK" preference="88">rsync://hkg.mirror.rackspace.com/fedora/development/41/Everything/x86_64/os/repodata/repomd.xml</url>
   </resources>
  </file>
 </files>
</metalink>

MirrorManager was still pointing to the development/41 tree. I ran the appropriate command and in about an hour MirrorManager should point to releases/41.

It seems like all of the mirrors are not syncing the development/ tree and therefore it did not work correctly.

Hmm, this is another case where we have an SOP for one point in the cycle that says to do something X days or weeks or months later:

https://docs.fedoraproject.org/en-US/infra/release_guide/final_release/#_post_release

I don't really like that. It's easy to forget (as we see here). But...not sure how to fix it. We can add a new "one week after release SOP", but...would anyone remember it exists to run it? Hmm.

Can't really comment on the SOP part, but the metalink now returns Fedora 41 mirrors in CN.

yep, thanks for fixing it, I was more thinking about "how do we make sure it doesn't happen again next time" :)

Unfortunately it happens every 6 months for as long as I can remember. We almost always forget.

just FYI... we did not forget. ;)

Mirrormanager moved into openshift and the playbook @abompard provided to do this wasn't working (see https://pagure.io/releng/issue/12449 )

He ran it 9 days ago... but apparently it didn't work right still?

Also, secondary might have been messed up by this ( see https://pagure.io/fedora-infrastructure/issue/12314 )

He ran it 9 days ago... but apparently it didn't work right still?

The script was using a wrong include path. I did send the fix to @abompard

Metadata Update from @phsmoura:
- Issue priority set to: Waiting on Assignee (was: Needs Review)
- Issue tagged with: medium-gain, medium-trouble, ops

2 months ago

Ah. ok. Then I guess we can close this.

Thanks!

Metadata Update from @kevin:
- Issue close_status updated to: Fixed with Explanation
- Issue status updated to: Closed (was: Open)

2 months ago

Log in to comment on this ticket.

Metadata
Boards 1
ops Status: Backlog