#5047 mirrorlist sometimes doesn't provide private mirrors
Closed: Fixed None Opened 8 years ago by puiterwijk.

Mirrorlist doesn't deem the users from netblocks for mm2 host 1351 as coming from its netblock. Looks like the netblock doesn't end up in the pkl.

This ticket is mostly to track.


Note that there is a mirrormanager traceback that may be related to this:

{{{
...
IntegrityError: (IntegrityError) duplicate key value violates unique constraint "host_category_hcindex"
DETAIL: Key (host_id, category_id)=(1351, 3) already exists.
'INSERT INTO host_category (host_id, category_id, always_up2date) VALUES (%(host_id)s, %(category_id)s, %(always_up2date)s) RETURNING host_category.id' {'host_id': 1351, 'category_id': 3, 'always_up2date': False}
}}}

I think this was caused by the "ASN Clients" flag to be turned on.
I've disabled this now on both of the mirrors, and will check in an hour (after the next pkl regeneration) if it's fixed.

Replying to [comment:2 puiterwijk]:

I think this was caused by the "ASN Clients" flag to be turned on.

ASN clients flag doesn't seem to make a difference. :(

Is there any information you might need from me that helps you sorting this out?

Patrick has been traveling of late, adding adrian here for comment...

This is our bad/wrong UI:

https://github.com/fedora-infra/mirrormanager2/issues/149

Each category URL has the possibility to be marked as private. This is however not what many people think it is. It has nothing to do with private mirrors. Another problem is, that once this flag is set it cannot be removed from the UI. I removed it from the database:

update host_category_url set private='f' where id=8262;

I can also see that the last run of report_mirror was on 2016-01-15. I would say it should run more often.

After removing the private flag the mirror seems to be working correctly:

{{{
curl -s "http://mirrors.fedoraproject.org/mirrorlist?repo=fedora-23&arch=x86_64&ip=91.20.252.191" | head -3

repo = fedora-23 arch = x86_64 Using preferred netblock country = DE country = BG country = BY country = RU country = RO country = GR country = GB country = PT country = PL country = ES country = MD country = IL country = FR country = FI country = NL country = NO country = CZ country = SK country = SE country = DK country = TR country = IS country = AT country = UA

http://mirror.home/fedora/releases/23/Everything/x86_64/os/
http://mirror.netcologne.de/fedora/linux/releases/23/Everything/x86_64/os/
}}}

This does work, indeed. Thank you very much!

Do I get it correctly, that the checkbox labelled 'Private' in the UI with the description saying 'e.g. not available to the public, an internal private mirror' it not related to the feature mentioned here https://fedoraproject.org/wiki/Infrastructure/Mirroring#How_can_someone_become_a_public_mirror.3F ?
What makes a mirror private then? Is it just private by default and requires a mail to mirror-admin@fedoraproject.org to become listed publicly?

It might be of interest to you that the 'Private' checkbox in the UI is still checked for me.

No, private mirrors are working as described. The only problem is, that if you select the checkbox 'Private' at the page Host -> Categories Carried -> 'Fedora Linux' -> URLs serving this content -> add -> Private. Once the URL is added there is no way to check if that private flag is set or not. The intention of the private flag at the URL level is for mirror-to-mirror synchronisation using URLs which are not meant to be publicly announce for mirrors which are normally public. It is complicated and a seldom (never) used feature. The 'Private' checkbox you see is actually for private mirrors. There is no way to check the status of a private URL. Except using SQL.

Wow, I didn't even remember that checkbox. Thanks a bunch for the clarification

Login to comment on this ticket.

Metadata