#12048 anaconda-devel list archive prior to 2021 missing
Closed: Fixed with Explanation 3 months ago by zlopez. Opened 6 months ago by ngompa.

Describe what you would like us to do:


It looks like the archive from anaconda-devel@lists.fedoraproject.org is incomplete, going only back to when it switched from anaconda-devel-list@redhat.com to anaconda-devel@lists.fedoraproject.org in releng#10302.

It is unclear whether the archives were supposed to be imported or not, but now there's a problem because listman.redhat.com no longer offers anaconda-devel-list archives.

Please import the old anaconda-devel-list archives into the anaconda-devel@ mailing list archives so we have the old history again.

When do you need this to be done by? (YYYY/MM/DD)


Whenever reasonably possible. It's not urgent but I would appreciate it being done as soon as possible.


In looking at it further, I think we have some damage to the archives, because it goes back to 2021 but the list moved in 2022.

FWIW, it seems some of the corresponding messages I know were CC'd in multiple Fedora lists are also missing in those list archives, so there might be a bigger problem.

Metadata Update from @zlopez:
- Issue priority set to: Waiting on Assignee (was: Needs Review)
- Issue tagged with: Needs investigation, medium-gain, ops

6 months ago

I assume that the archived messages were in database, which wasn't touched during migration. But if they were stored somewhere in the old VM, we should still be able to recover them from the LV backup (it should still be available).

so, we never imported the old list archive from redhat.com..

see: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org/message/KDSNANO63KGXJHUJISIY2VHBWKQWZESS/

"History of the old mailing list will stay publicly available"

I suppose we can ask internally if there's any archive of that data available? archive.org has a listing of it, but it didn't actually save any of the content I don't think. ;(

@jkonecny do you know of any mbox archives of that? Or can you ask internally for them? I think if we can get mbox we can import it into the current archives (but would have to look to be sure)

I hope that backups of listman.redhat.com exist prior to its shutdown that include anaconda-devel-list...

I have braved the bowels of the internal ticketing system and submitted a request. Will relay what they say, if anything.

The ticket bore fruit:

https://listman.redhat.com/archives/anaconda-devel-list.mbox/anaconda-devel-list.mbox

but now we need to figure out how we can import it into mailman3 if we want to. It was a different list with a different address...

@zlopez or @abompard thoughts?

I think it should be fine to import, we did it with Fedora's mailing list when we moved from fedora-devel-list@redhat.com to devel@lists.fedoraproject.org long ago.

@kevin I can try to import the list archive on staging first. We will see how this looks there and after validation that everything is OK we can do the same on production.

Metadata Update from @zlopez:
- Issue assigned to zlopez

3 months ago

So I got to importing the archive on staging today and it seems that it went well. At least I see the messages till 2004 now https://lists.stg.fedoraproject.org/archives/list/anaconda-devel@lists.stg.fedoraproject.org/

I will try to regenerate search index as well and see if that will fix the issue with threads not showing anything older than 2021 in Threads by month in hyperkitty UI. But you can see the whole history if you just click on All threads.

I imported the mailing list by running:

sudo -u mailman mailman-web hyperkitty_import --since=19.02.2004 -l anaconda-devel@lists.stg.fedoraproject.org /srv/webui/anaconda-devel-list.mbox

@ngompa @jkonecny Could you confirm that this looks good?

Modulo the search index data missing, it looks good to me.

I'm updating the search index right now for the list. If everything will look good after that I will do the same on production.

Looks good to me as far as I can tell :)

I regenerated the search index and the mails are now searchable in the archive. I needed to restart the hyperkitty to update the Threads by month. Now you can list them by month.

I'm not sure why it's showing 2002 in there as well as there is no thread from that time.

As everything is working now on staging. I will continue on production.

As the search index generation finished today I imported the archive to https://lists.fedoraproject.org/archives/list/anaconda-devel@lists.fedoraproject.org/ and will enable search on the production soon.

Closing this as done. For the search enablement please follow https://pagure.io/fedora-infrastructure/issue/12027

Metadata Update from @zlopez:
- Issue close_status updated to: Fixed with Explanation
- Issue status updated to: Closed (was: Open)

3 months ago

Log in to comment on this ticket.

Metadata
Boards 1
ops Status: Backlog