#10497 Download website redirect no longer round-robbins mirror sites
Closed: Fixed with Explanation 2 years ago by kevin. Opened 2 years ago by cosmos.


download.fedoraproject.org usually redirects you to the first mirror of this list:

"https://mirrors.fedoraproject.org/mirrorlist?path=pub/fedora/linux/releases/35/"

Can you show us the output of that URL and tell us your IP?

On Tue, Jan 25 2022 at 07:54:02 +0000, Adrian Reber quoth thus:

adrian added a new comment to an issue you are following:
``
download.fedoraproject.org usually redirects you to the first mirror of this list:

"https://mirrors.fedoraproject.org/mirrorlist?path=pub/fedora/linux/releases/35/"

The point of the report was that the address I'm using did not use to
just redirect to the first mirror. Previously, it would round-robbin
through that list. If you look at the test script and output in the
original report, you'll see the current situation is demonstrated nicely.

I'm only pointing this out because it is a change in behavior and you
may be interested from a load balancing standpoint.
I've already changed my code to probe using the URL with the "35/"
removed and it round-robbins through the list just fine.

Can you show us the output of that URL and tell us your IP?

The output of the URL is just what you'd expect after an HTTP redirect.
I'd have to dig a bit for the IP you would see as it is on the other
side of a localbox -> firewall -> DSL -> ISP.

I can try to provide more info if you would find it useful, but I suspect
if you run the test script you'll find it will be sufficiently helpful.

``

To reply, visit the link below or just reply to this email
https://pagure.io/fedora-infrastructure/issue/10497

I just tried the script on my side and don't see this behavior. So I'm not sure what is the issue, but it definitely doesn't affect everyone.

$ dnstest
Scanning base url: https://download.fedoraproject.org/pub/fedora/linux/releases/
Probe 0: 2      https://ftp.yz.yamagata-u.ac.jp/pub/linux/fedora-projects/fedora/linux/releases/
Probe 1: 2      https://fedora.ip-connect.vn.ua/linux/releases/
Probe 2: 2      https://mirrors.xtom.de/fedora/releases/
Probe 3: 2      https://fedora.mirrors.theom.nz/releases/
Probe 4: 2      https://mirror.umd.edu/fedora/linux/releases/
Probe 5: 2      https://fedora.mirror.digitalpacific.com.au/linux/releases/
Probe 6: 2      https://fedora.mirror.digitalpacific.com.au/linux/releases/
Probe 7: 1.1    https://mirror.in2p3.fr/pub/fedora/linux/releases/
Probe 8: 2      https://fedora.ip-connect.info/linux/releases/
Probe 9: 1.1    https://fedora.ipacct.com/fedora/linux/releases/
Probe 10: 1.1   https://ftp-nyc.osuosl.org/pub/fedora/linux/releases/
Probe 11: 2     https://mirrors.tuna.tsinghua.edu.cn/fedora/releases/
Probe 12: 2     https://fedora.mirror.digitalpacific.com.au/linux/releases/
Probe 13: 2     https://mirrors.nxthost.com/fedora/releases/
Probe 14: 2     https://mirror.karneval.cz/pub/linux/fedora/linux/releases/
Probe 15: 1.1   https://ftp-chi.osuosl.org/pub/fedora/linux/releases/

$ dnstest x
Scanning base url: https://download.fedoraproject.org/pub/fedora/linux/releases/35/
Probe 0: 2      https://mirror.umd.edu/fedora/linux/releases/35/
Probe 1: 1.1    https://fedora.ipacct.com/fedora/linux/releases/35/
Probe 2: 1.1    https://ftp.fau.de/fedora/linux/releases/35/
Probe 3: 2      https://mirror.init7.net/fedora/fedora/linux/releases/35/
Probe 4: 2      https://ftp.halifax.rwth-aachen.de/fedora/linux/releases/35/
Probe 5: 1.1    https://ftp.acc.umu.se/mirror/fedora/linux/releases/35/
Probe 6: 1.1    https://mirror.aarnet.edu.au/pub/fedora/linux/releases/35/
Probe 7: 1.1    https://mirror.telepoint.bg/fedora/releases/35/
Probe 8: 2      https://mirror.ihost.md/fedora/releases/35/
Probe 9: 1.1    https://ftp.acc.umu.se/mirror/fedora/linux/releases/35/
Probe 10: 2     https://mirrors.xtom.de/fedora/releases/35/
Probe 11: 2     https://ftp.halifax.rwth-aachen.de/fedora/linux/releases/35/
Probe 12: 1.1   https://muug.ca/mirror/fedora/linux/releases/35/
Probe 13: 2     https://ftp.byfly.by/pub/fedoraproject.org/linux/releases/35/
Probe 14: 2     https://fedora.astra.in.ua/releases/35/
Probe 15: 1.1   https://mirror.vpsnet.com/fedora/linux/releases/35/

Metadata Update from @mohanboddu:
- Issue priority set to: Waiting on Assignee (was: Needs Review)
- Issue tagged with: low-gain, low-trouble, ops

2 years ago

On Tue, Jan 25 2022 at 09:50:47 +0000, Michal Konečný quoth thus:

zlopez added a new comment to an issue you are following:
``
I just tried the script on my side and don't see this behavior. So I'm not sure what is the issue, but it definitely doesn't affect everyone.

I've verified that the issue is still occuring on my local box.
I just logged into my shell account at my ISP and reran the test.
The issue does not happen there!

So, it seems that the issue is local to me, or is at least somehow
dependent on location. I'm in Minnesota; my ISP is in California.
Perhaps something is caching the first redirect response, but I don't
see why path/ and path/35/ would be processed differently.

I'll try to dig into my local DNS more.
In the meanwhile, feel free to close Issue #10497.

Thanks for looking into this!

```
$ dnstest
Scanning base url: https://download.fedoraproject.org/pub/fedora/linux/releases/
Probe 0: 2 https://ftp.yz.yamagata-u.ac.jp/pub/linux/fedora-projects/fedora/linux/releases/
Probe 1: 2 https://fedora.ip-connect.vn.ua/linux/releases/
Probe 2: 2 https://mirrors.xtom.de/fedora/releases/
Probe 3: 2 https://fedora.mirrors.theom.nz/releases/
Probe 4: 2 https://mirror.umd.edu/fedora/linux/releases/
Probe 5: 2 https://fedora.mirror.digitalpacific.com.au/linux/releases/
Probe 6: 2 https://fedora.mirror.digitalpacific.com.au/linux/releases/
Probe 7: 1.1 https://mirror.in2p3.fr/pub/fedora/linux/releases/
Probe 8: 2 https://fedora.ip-connect.info/linux/releases/
Probe 9: 1.1 https://fedora.ipacct.com/fedora/linux/releases/
Probe 10: 1.1 https://ftp-nyc.osuosl.org/pub/fedora/linux/releases/
Probe 11: 2 https://mirrors.tuna.tsinghua.edu.cn/fedora/releases/
Probe 12: 2 https://fedora.mirror.digitalpacific.com.au/linux/releases/
Probe 13: 2 https://mirrors.nxthost.com/fedora/releases/
Probe 14: 2 https://mirror.karneval.cz/pub/linux/fedora/linux/releases/
Probe 15: 1.1 https://ftp-chi.osuosl.org/pub/fedora/linux/releases/

$ dnstest x
Scanning base url: https://download.fedoraproject.org/pub/fedora/linux/releases/35/
Probe 0: 2 https://mirror.umd.edu/fedora/linux/releases/35/
Probe 1: 1.1 https://fedora.ipacct.com/fedora/linux/releases/35/
Probe 2: 1.1 https://ftp.fau.de/fedora/linux/releases/35/
Probe 3: 2 https://mirror.init7.net/fedora/fedora/linux/releases/35/
Probe 4: 2 https://ftp.halifax.rwth-aachen.de/fedora/linux/releases/35/
Probe 5: 1.1 https://ftp.acc.umu.se/mirror/fedora/linux/releases/35/
Probe 6: 1.1 https://mirror.aarnet.edu.au/pub/fedora/linux/releases/35/
Probe 7: 1.1 https://mirror.telepoint.bg/fedora/releases/35/
Probe 8: 2 https://mirror.ihost.md/fedora/releases/35/
Probe 9: 1.1 https://ftp.acc.umu.se/mirror/fedora/linux/releases/35/
Probe 10: 2 https://mirrors.xtom.de/fedora/releases/35/
Probe 11: 2 https://ftp.halifax.rwth-aachen.de/fedora/linux/releases/35/
Probe 12: 1.1 https://muug.ca/mirror/fedora/linux/releases/35/
Probe 13: 2 https://ftp.byfly.by/pub/fedoraproject.org/linux/releases/35/
Probe 14: 2 https://fedora.astra.in.ua/releases/35/
Probe 15: 1.1 https://mirror.vpsnet.com/fedora/linux/releases/35/
`

To reply, visit the link below or just reply to this email
https://pagure.io/fedora-infrastructure/issue/10497

So, the actual issue is that rackspace (owners of the iad.mirror.rackspace.com mirror) have set in mirrormanager to direct everyone on ASN 209 to that mirror. I suspect your machine is on that ASN. ;)

I guess if it's causing problems you might check with them and ask them to remove that...
There is https://fedoraproject.org/wiki/Infrastructure/MirrorManager#Additional_options but I am not sure they apply when ASN is specified. ;(

Metadata Update from @kevin:
- Issue close_status updated to: Fixed with Explanation
- Issue status updated to: Closed (was: Open)

2 years ago

Login to comment on this ticket.

Metadata
Boards 1
ops Status: Backlog