PR#2055: [postfix] Add mailman staging lists - fedora-infra/ansible

fedora-infra / ansible

#2055 [postfix] Add mailman staging lists

Merged 15 days ago by zlopez. Opened 19 days ago by zlopez.

fedora-infra/ zlopez/ansible mailman_update into main

[postfix] Move destinations to staging mailman configuration

Michal Konecny • 15 days ago

c3a169c

[postfix] Add mailman staging lists

Michal Konecny • 15 days ago

438979a

<a class="font-weight-bold ml-2" href="/fork/zlopez/fedora-infra/ansible/blob/24879a6844c5c531ad66982a68bab101bdb6b7bc/f/roles/base/files/postfix/main.cf/main.cf.mailman01.stg.iad2.fedoraproject.org" title="View file as of 24879a6">roles/base/files/postfix/main.cf/main.cf.mailman01.stg.iad2.fedoraproject.org</a> ~~roles/base/files/postfix/main.cf/main.cf.mailman01.stg.phx2.fedoraproject.org~~

<div class="btn btn-outline-info disabled opacity-100 border-0 font-weight-bold"> file renamed </div> <div class="btn-group"> <span class="btn btn-success btn-sm font-weight-bold disabled opacity-100">+1</span> <span class="btn btn-danger btn-sm font-weight-bold disabled opacity-100">-1</span> </div> <a class="btn btn-outline-primary btn-sm ml-2" href="/fork/zlopez/fedora-infra/ansible/blob/24879a6844c5c531ad66982a68bab101bdb6b7bc/f/roles/base/files/postfix/main.cf/main.cf.mailman01.stg.iad2.fedoraproject.org" title="View file as of 24879a6"> <i class="fa fa-file-code-o fa-fw"></i> </a> <a class="btn btn-sm btn-outline-primary diffhighlightcollapse ml-2 pointer" data-toggle="collapse" data-target="#diffhighlight_1"> <i class="fa fa-fw fa-caret-up"></i> </a>

		`@@ -158,7 +158,7 @@`
		`#`
		`mydestination = $myhostname,`
		`localhost.$mydomain, fedora.redhat.com, localhost,`
		`- lists.stg.fedoraproject.org, lists.pagure.io`
		`+ lists.stg.fedoraproject.org, lists.pagure.io, lists.stg.fedorahosted.org`
		`#mydestination = $myhostname, localhost.$mydomain, localhost, $mydomain`
		`#mydestination = $myhostname, localhost.$mydomain, localhost, $mydomain,`
		`# mail.$mydomain, www.$mydomain, ftp.$mydomain`

<a class="font-weight-bold ml-2" href="/fork/zlopez/fedora-infra/ansible/blob/1a7db223c72b1b30e6cc7db84ff23c92791f66fc/f/roles/base/files/postfix/main.cf/main.cf.smtp-mm" title="View file as of 1a7db22">roles/base/files/postfix/main.cf/main.cf.smtp-mm</a>

<div class="btn btn-outline-secondary disabled opacity-100 border-0 font-weight-bold"> file modified </div> <div class="btn-group"> <span class="btn btn-success btn-sm font-weight-bold disabled opacity-100">+1</span> <span class="btn btn-danger btn-sm font-weight-bold disabled opacity-100">-1</span> </div> <a class="btn btn-outline-primary btn-sm ml-2" href="/fork/zlopez/fedora-infra/ansible/blob/1a7db223c72b1b30e6cc7db84ff23c92791f66fc/f/roles/base/files/postfix/main.cf/main.cf.smtp-mm" title="View file as of 1a7db22"> <i class="fa fa-file-code-o fa-fw"></i> </a> <a class="btn btn-sm btn-outline-primary diffhighlightcollapse ml-2 pointer" data-toggle="collapse" data-target="#diffhighlight_2"> <i class="fa fa-fw fa-caret-up"></i> </a>

		`@@ -305,7 +305,7 @@`
		`#`
		`#relay_domains = $mydestination`

		`- relay_domains = $mydestination lists.fedoraproject.org lists.fedorahosted.org fedorahosted.org lists.pagure.io`
		`+ relay_domains = $mydestination lists.fedoraproject.org lists.fedorahosted.org fedorahosted.org lists.pagure.io lists.stg.fedoraproject.org lists.stg.fedorahosted.org lists.stg.pagure.io`

		`# INTERNET OR INTRANET`

<a class="font-weight-bold ml-2" href="/fork/zlopez/fedora-infra/ansible/blob/fe06c8f4ce30578e42b0e9d9191721d3f47d1e96/f/roles/base/files/postfix/transports.gateway" title="View file as of fe06c8f">roles/base/files/postfix/transports.gateway</a>

<div class="btn btn-outline-secondary disabled opacity-100 border-0 font-weight-bold"> file modified </div> <div class="btn-group"> <span class="btn btn-success btn-sm font-weight-bold disabled opacity-100">+3</span> </div> <a class="btn btn-outline-primary btn-sm ml-2" href="/fork/zlopez/fedora-infra/ansible/blob/fe06c8f4ce30578e42b0e9d9191721d3f47d1e96/f/roles/base/files/postfix/transports.gateway" title="View file as of fe06c8f"> <i class="fa fa-file-code-o fa-fw"></i> </a> <a class="btn btn-sm btn-outline-primary diffhighlightcollapse ml-2 pointer" data-toggle="collapse" data-target="#diffhighlight_3"> <i class="fa fa-fw fa-caret-up"></i> </a>

		`@@ -302,3 +302,6 @@`
		`redhat.com smtp:[mx2.redhat.com]`
		`.redhat.com smtp:[mx2.redhat.com]`
		`ceylon-lang.org smtp:[mx2.redhat.com]`
		`+ lists.stg.fedoraproject.org smtp:[mailman01.stg.iad2.fedoraproject.org]`
		`+ lists.stg.fedorahosted.org smtp:[mailman01.stg.iad2.fedoraproject.org]`
		`+ lists.stg.pagure.io smtp:[mailman01.stg.iad2.fedoraproject.org]`

<a class="font-weight-bold ml-2" href="/fork/zlopez/fedora-infra/ansible/blob/8c6dd42673a65d98b0b2e61c90a1282e1de2c436/f/roles/base/files/postfix/transports.smtp-mm" title="View file as of 8c6dd42">roles/base/files/postfix/transports.smtp-mm</a>

<div class="btn btn-outline-secondary disabled opacity-100 border-0 font-weight-bold"> file modified </div> <div class="btn-group"> <span class="btn btn-success btn-sm font-weight-bold disabled opacity-100">+4</span> </div> <a class="btn btn-outline-primary btn-sm ml-2" href="/fork/zlopez/fedora-infra/ansible/blob/8c6dd42673a65d98b0b2e61c90a1282e1de2c436/f/roles/base/files/postfix/transports.smtp-mm" title="View file as of 8c6dd42"> <i class="fa fa-file-code-o fa-fw"></i> </a> <a class="btn btn-sm btn-outline-primary diffhighlightcollapse ml-2 pointer" data-toggle="collapse" data-target="#diffhighlight_4"> <i class="fa fa-fw fa-caret-up"></i> </a>

		`@@ -4,3 +4,7 @@`
		`lists2.fedoraproject.org smtp:[mailman01.vpn.fedoraproject.org]`
		`lists.pagure.io smtp:[mailman01.vpn.fedoraproject.org]`
		`fedorahosted.org smtp:[bastion.vpn.fedoraproject.org]`
		`+`
		`+ lists.stg.fedoraproject.org smtp:[bastion.vpn.fedoraproject.org]`
		`+ lists.stg.fedorahosted.org smtp:[bastion.vpn.fedoraproject.org]`
		`+ lists.stg.pagure.io smtp:[bastion.vpn.fedoraproject.org]`

zlopez commented 19 days ago

I followed the instruction from
https://pagure.io/fedora-infrastructure/issue/8455#comment-913675, but this is
my first time I actually doing anything in postfix configuration, so I'm not
sure if everything I did is correct.

The SMTP port on the machine seems to be open according to group_vars for the
mailman_stg.

Signed-off-by: Michal Konecny mkonecny@redhat.com

zuul commented 19 days ago

Build succeeded.
https://fedora.softwarefactory-project.io/zuul/buildset/e27a55c774b142f0b2bc439ebe075251

fi-ansible-lint-diff : SUCCESS in 4m 16s
fi-yamllint-diff : SUCCESS in 2m 38s

kevin commented 19 days ago

I think this looks fine, except... instead of roles/base/files/postfix/main.cf/main.cf.mailman, you should create / modify a roles/base/files/postfix/main.cf/main.cf.mailman01.stg.iad2.fedoraproject.org

otherwise it would also affect prod mailman01, which we don't need/want.

Oherwise, with the dns change (MX record) I think it should work. ;)

1 new commit added

[postfix] Move destinations to staging mailman configuration

18 days ago

zlopez commented 18 days ago

I renamed the existing main.cf.mailman01.stg.phx2.fedoraproject.org to main.cf.mailman01.stg.iad2.fedoraproject.org and moved the destinations there.

I will check the DNS repo, because I wasn't able to find MX records there for mailman, but I will doublecheck.

Also will the mailman01.stg.vpn.fedoraproject.org work? I didn't saw any VPN entry in DNS repo for staging mailman.

zuul commented 18 days ago

Build succeeded.
https://fedora.softwarefactory-project.io/zuul/buildset/0df20d6a73464e849538131d75580c44

fi-ansible-lint-diff : SUCCESS in 4m 13s
fi-yamllint-diff : SUCCESS in 2m 34s

zlopez commented 18 days ago

I found some MX entries in DNS, but I don't see mailman figuring in any of those.

kevin commented 18 days ago

Oh yeah, sorry.
So:

mailman01.vpn.stg.fedoraproject.org will of course not work. On smtp-mm-* you need to have that transport map send lists.stg.fedoraproject.org emails to bastion.vpn.fedoraproject.org.
Then, you need to adjust the transport map on bastion to send lists.stg.fedoraproject.org emails to mailman01.stg.iad2.fedoraproject.org
This is needed because mailman01.stg has no vpn (no staging host does). So, you have to send it via bastion with a 'hop'.
In dns the thing you are looking for is lists:

lists IN MX 10 smtp-mm-osuosl01.fedoraproject.org.
lists IN MX 10 smtp-mm-cc-rdu01.fedoraproject.org.
lists IN MX 10 smtp-mm-ib01.fedoraproject.org.

You want to add 3 new lines below there like:
lists.stg IN MX 10 smtp-mm-osuosl01.fedoraproject.org.
lists.stg IN MX 10 smtp-mm-cc-rdu01.fedoraproject.org.
lists.stg IN MX 10 smtp-mm-ib01.fedoraproject.org.

2 new commits added

[postfix] Move destinations to staging mailman configuration
[postfix] Add mailman staging lists

15 days ago

rebased onto b52bfeb

15 days ago

2 new commits added

[postfix] Move destinations to staging mailman configuration
[postfix] Add mailman staging lists

15 days ago

zuul commented 15 days ago

Build succeeded.
https://fedora.softwarefactory-project.io/zuul/buildset/b4eb1bdf5f2148a5a8d626c74254770c

fi-ansible-lint-diff : SUCCESS in 5m 41s
fi-yamllint-diff : SUCCESS in 3m 52s

zlopez commented 15 days ago

I think everything should be in place now, let's take it for a ride :-)

Pull-Request has been merged by zlopez

15 days ago

zlopez commented 15 days ago

So it's not working as it should:

I'm able to sent e-mail from the machine to mailing list @lists.stg.fedoraproject.org
I'm able to sent e-mail from the machine to somebody outside
I'm not able to sent e-mail to mailing list from web UI
I'm not able to sent e-mail to mailing list from my mail
E-mail sent to list is not forwarded to subscribers

It seems that the forwarding is working for the outgoing mail at least directly using mail command. I will try to figure out what is wrong here.

zlopez commented 15 days ago

Found out that I had DEBUG still enabled for hyperkitty, but it just helped with being able to get mail sent to mailing list through web UI. It's still not delivered to subscribers.