#7028 Change bugzilla2fedmsg queue
Closed: Fixed 3 years ago by kevin. Opened 3 years ago by ralph.

FYI, bugzilla.redhat.com is going to change the way they're publishing messages sometime in July/August. @jfearn is our contact on the bugzilla side. :)

  • It looks like the new message format may be a superset of the message format we handle today, but we need to confirm that the bugzilla2fedmsg software can actually handle it.
  • We'll need to change the name of the stomp queue we're reading from; the old one is going away.
  • Lastly, we're probably going to have to request new ACLs for our cert to be able to read this new queue. Matthew Stratton can help with this part.

Metadata Update from @kevin:
- Issue assigned to kevin
- Issue priority set to: Waiting on External (was: Needs Review)

3 years ago

Some questions:

Does the test bugzilla5.redhat.com instance have a queue we can test against in our staging?

Do we know what the new queue name is yet for prod?

Where do we request these acls?

I think @jfearn will have to answer the first two. I don't know.

The ACLs can be requested via a ticket to Matt Stratton's team in RHIT. Search on mojo for the UMB Getting Started page which describes how to get acls for a new cert. You'll need a similar ticket to upgrade acls for an existing cert. Failing that - email Matthew directly.

Some questions:
Does the test bugzilla5.redhat.com instance have a queue we can test against in our staging?

Only the internal dev and qe servers are talking to the message bus ATM. I'll poke our Ops and see if they can set it up.

Do we know what the new queue name is yet for prod?

It's not a queue, it's a virtual topic. /topic/VirtualTopic.eng.bugzilla

Where do we request these acls?

AIUI anyone who has access to the bus can read virtual topics.

It's not a queue, it's a virtual topic. /topic/VirtualTopic.eng.bugzilla

Yeah, if bugzilla will be publishing to the virtual topic: /topic/VirtualTopic.eng.bugzilla then consumers have to read from a queue of their own that gets dynamically created when they try to read from it. Something like /queue/Consumer.client-fedora.PUT-A-UNIQUE-UUID-HERE.VirtualTopic.eng.bugzilla

AIUI anyone who has access to the bus can read virtual topics.

That's usually true, but since the fedora client account was created before the days when we had virtual topics, I bet they're going to need to request access to even read. Maybe, maybe.

FYI the date for the Bugzilla 5 upgrade is Sep 7th 2018.

I've requested acls for our cert now. Once thats done we should be able to switch queues and be done.

I set the stomp queue to be used in staging only at: https://infrastructure.fedoraproject.org/cgit/ansible.git/commit/?id=644d5d5

It won't work until the acls are granted in @kevin's request above.

Note to self - bz5 went live. The topic probably changed, and is breaking us.

I'll try to follow up on this later today.

Yeah, I changed the queue to the new one, but it's giving a permission denied (even though we had been granted permissions months ago).

So not sure why its not just working...

Hm, I'll ping the UMB team asking.

Hm, messages seem to not be coming through. Raised this with @yulwang on the bz5 side.

Looking further into this. Messages are making it to our system but getting lost in software. May need a small bugzilla2fedmsg change. I'm on it. :)

Turning into a bigger change than I expected. Shutting down the process for now.

That PR has been applied on the bugzilla2fedmsg VM. Leaving this open to track merge and release of that change.

This is all done.

:goat:

Metadata Update from @kevin:
- Issue close_status updated to: Fixed
- Issue status updated to: Closed (was: Open)

3 years ago

Login to comment on this ticket.

Metadata