#9148 rsync complete fedora-messaging messages not being sent
Closed: Fixed 3 years ago by kevin. Opened 3 years ago by mboswell.

Are compose.rawhide.rsync.complete and compose.branched.rsync.complete still in fedmsg bus activity ? Maybe stopped in June ?

mboswell@mboswell-fc2 ~ $ which http
/usr/bin/http
mboswell@mboswell-fc2 ~ $ rpm -qf /usr/bin/http
httpie-1.0.3-2.fc32.noarch
mboswell@mboswell-fc2 ~ $ http get https://apps.fedoraproject.org/datagrepper/raw delta==1864000 topic==org.fedoraproject.prod.compose.rawhide.rsync.complete
HTTP/1.1 200 OK
Connection: Keep-Alive
Content-Encoding: gzip
Content-Length: 237
Date: Fri, 17 Jul 2020 15:00:36 GMT
Keep-Alive: timeout=15, max=500
Referrer-Policy: same-origin
Server: Apache
Strict-Transport-Security: max-age=31536000; includeSubDomains; preload
Vary: Accept-Encoding
X-Content-Type-Options: nosniff
X-Fedora-ProxyServer: proxy03.fedoraproject.org
X-Fedora-RequestID: XxG9FHV@OiGOAq@ock6ayQAAC0E
X-Frame-Options: SAMEORIGIN
X-Xss-Protection: 1; mode=block
apptime: D=257165
content-type: application/json
x-fedora-appserver: datagrepper01.iad2.fedoraproject.org

{
"arguments": {
"categories": [],
"contains": [],
"delta": 1864000.0,
"end": 1594998036.0,
"grouped": false,
"meta": [],
"not_categories": [],
"not_packages": [],
"not_topics": [],
"not_users": [],
"order": "desc",
"packages": [],
"page": 1,
"rows_per_page": 25,
"start": 1593134036.0,
"topics": [
"org.fedoraproject.prod.compose.rawhide.rsync.complete"
],
"users": []
},
"count": 0,
"pages": 0,
"raw_messages": [],
"total": 0
}


Yeah, so the script that makes these messages was converted over to fedora-messaging, but it needs some fixes to actually emit the messages.

It runs as ftpsync, so it needs a new cert with that user, a user and a queue I guess.

I was unaware anyone was using these messages, or fixing it would have been a higher priority. ;(

Metadata Update from @kevin:
- Issue priority set to: Waiting on Assignee (was: Needs Review)
- Issue tagged with: groomed, low-trouble, medium-gain

3 years ago

Thanks, This is how we make the rawhide and nightlies available for testing in and out of Beaker in Westford and Brno locations. Is there an ETA on the fix? Is there a different message we could trigger off for the completed syncs?

I guess the recommendation is to switch to quick-fedora-mirror and just run it every 10 minutes.

So I should not wait for a fix? Not clear if @kevin was suggesting it was easy or not going to happen.

So, it turns out the messages have been going out... but just with the wrong name... composerawhide instead of compose.rawhide.

See: https://apps.fedoraproject.org/datagrepper/raw?category=composerawhide&rows_per_page=10&delta=1278000

I have submitted a PR I hope will fix this: https://pagure.io/releng/pull-request/9609

Metadata Update from @kevin:
- Issue close_status updated to: Fixed
- Issue status updated to: Closed (was: Open)

3 years ago

@kevin Thank you for the fix. I see data now when I run[1]. Is org.fedoraproject.prod.compose.branched.rsync.complete expected when appropriate now also?

[1] http get https://apps.fedoraproject.org/datagrepper/raw delta==864000 topic==org.fedoraproject.prod.compose.rawhide.rsync.complete

Yes, when we have a branched compose... that will next happen after 2020-08-11 for f33

Got it. Thank you for the help !

Login to comment on this ticket.

Metadata