#577 isoredirect.centos.org not reachable from CI nodes
Closed: Fixed with Explanation 2 years ago by arrfab. Opened 2 years ago by evgeni.

Ohai,

we'd like to be able to fetch CentOS ISOs in our CI (to build stuff using lorax), but the isoredirect URLs don't seem to work from the CI infra:

$ curl -iv "http://isoredirect.centos.org/centos/8-stream/isos/x86_64/CentOS-Stream-8-x86_64-latest-boot.iso"
* About to connect() to isoredirect.centos.org port 80 (#0)
*   Trying 172.19.0.12...
* Connected to isoredirect.centos.org (172.19.0.12) port 80 (#0)
> GET /centos/8-stream/isos/x86_64/CentOS-Stream-8-x86_64-latest-boot.iso HTTP/1.1
> User-Agent: curl/7.29.0
> Host: isoredirect.centos.org
> Accept: */*
> 
< HTTP/1.1 404 Not Found
HTTP/1.1 404 Not Found
< Date: Mon, 03 Jan 2022 07:35:39 GMT
Date: Mon, 03 Jan 2022 07:35:39 GMT
< Server: Apache/2.4.6 (CentOS) PHP/5.4.16
Server: Apache/2.4.6 (CentOS) PHP/5.4.16
< Content-Length: 264
Content-Length: 264
< Content-Type: text/html; charset=iso-8859-1
Content-Type: text/html; charset=iso-8859-1

< 
<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>404 Not Found</title>
</head><body>
<h1>Not Found</h1>
<p>The requested URL /centos/8-stream/isos/x86_64/CentOS-Stream-8-x86_64-latest-boot.iso was not found on this server.</p>
</body></html>
* Connection #0 to host isoredirect.centos.org left intact

Outside of CI this URL works fine and redirects to an actual ISO mirror.

I've tried the above from slave01.ci.centos.org and Duffy-nodes (most recently from n56.dusty).


yes, it's because nobody ever requested isoredirect internally and by default isoredirect is a CNAME to mirrorlist and internally the vhost using a specific mirrorlist setup to just use internal mirror doesn't have the isoredirect vhost applied.

Can't you just download .iso straight from mirror.centos.org ? (boot.iso should be allowed, but not other ones iirc)

wget http://mirror.centos.org/centos/7/os/x86_64/images/boot.iso
--2022-01-03 08:08:35--  http://mirror.centos.org/centos/7/os/x86_64/images/boot.iso
Resolving mirror.centos.org (mirror.centos.org)... 172.22.0.40
Connecting to mirror.centos.org (mirror.centos.org)|172.22.0.40|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 602931200 (575M) [application/octet-stream]
Saving to: ‘boot.iso’

100%[=============================================================================>] 602,931,200  399MB/s   in 1.4s   

2022-01-03 08:08:36 (399 MB/s) - ‘boot.iso’ saved [602931200/602931200]
wget http://mirror.centos.org/centos/8-stream/BaseOS/x86_64/os/images/boot.iso
--2022-01-03 08:09:19--  http://mirror.centos.org/centos/8-stream/BaseOS/x86_64/os/images/boot.iso
Resolving mirror.centos.org (mirror.centos.org)... 172.22.0.40
Connecting to mirror.centos.org (mirror.centos.org)|172.22.0.40|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 875560960 (835M) [application/octet-stream]
Saving to: ‘boot.iso.1’

100%[=============================================================================>] 875,560,960  366MB/s   in 2.3s   

2022-01-03 08:09:21 (366 MB/s) - ‘boot.iso.1’ saved [875560960/875560960]

I suppose we could, but I'd also would love not to have CI specific configs.

Or would that also work from the Internet? In an supported and official way (that's not going away tomorrow, because someone cleans up some config).

Metadata Update from @arrfab:
- Issue assigned to arrfab

2 years ago

Metadata Update from @arrfab:
- Issue priority set to: Waiting on Reporter (was: Needs Review)
- Issue tagged with: centos-ci-infra, feature-request, low-gain, medium-trouble

2 years ago

as it works for you, can you just give feedback if we can close this request (tagged as RFE btw)

I'm happy to close this if using mirror.centos.org to fetch boot.iso is working as intended and is also supposed to work from the internet (it does right now, just no idea if by accident or not)

@evgeni we always allowed people to fetch boot.iso but just redirected to isoredirect for other/larger ones (and distribute so the load to other mirrors). It's also working for stream 9 BTW (even if it redirects itself directly to a cdn but calling mirror.stream.centos.org to fetch .iso will work)

Metadata Update from @arrfab:
- Issue close_status updated to: Fixed with Explanation
- Issue status updated to: Closed (was: Open)

2 years ago

Login to comment on this ticket.

Metadata
Boards 1
CentOS CI Infra Status: Backlog