Wasn't this supposed to be part of the AutoQA discussed by Jesse at FUDCon 09 in Boston earlier this year?

Hmm, according to Jesse this is on the QA and rel-eng radar, which is good:

http://www.redhat.com/archives/fedora-devel-list/2009-June/msg01782.html

That's correct, this is going to be covered by AutoQA. I'll leave the ticket open though until it's in place.

This seems to be in place now with autoqa?

It's advisory, but it does note in bodhi when a update fails this.

Feel free to re-open if there's anything more to be done here.