#7500 Cannot push to my src.fp.o fork
Closed: Fixed by churchyard. Opened by churchyard.

$ git push -u churchyard nopy2_
Enumerating objects: 5, done.
Counting objects: 100% (5/5), done.
Delta compression using up to 4 threads
Compressing objects: 100% (3/3), done.
Writing objects: 100% (3/3), 501 bytes | 501.00 KiB/s, done.
Total 3 (delta 2), reused 0 (delta 0)
remote: Traceback (most recent call last):
remote:   File "hooks/pre-receive", line 36, in <module>
remote:     run_hook_file(hooktype)
remote:   File "/usr/lib/python2.7/site-packages/pagure/hooks/__init__.py", line 526, in run_hook_file
remote:     session, repo, user=username, namespace=namespace
remote:   File "/usr/lib/python2.7/site-packages/pagure/lib/query.py", line 2752, in _get_project
remote:     return query.one()
remote:   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2395, in one
remote:     ret = list(self)
remote:   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2438, in __iter__
remote:     return self._execute_and_instances(context)
remote:   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2451, in _execute_and_instances
remote:     close_with_result=True)
remote:   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2442, in _connection_from_session
remote:     **kw)
remote:   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 854, in connection
remote:     close_with_result=close_with_result)
remote:   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 858, in _connection_for_bind
remote:     return self.transaction._connection_for_bind(engine)
remote:   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 322, in _connection_for_bind
remote:     conn = bind.contextual_connect()
remote:   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1798, in contextual_connect
remote:     self.pool.connect(),
remote:   File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 338, in connect
remote:     return _ConnectionFairy._checkout(self)
remote:   File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 644, in _checkout
remote:     fairy = _ConnectionRecord.checkout(pool)
remote:   File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 440, in checkout
remote:     rec = pool._do_get()
remote:   File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 963, in _do_get
remote:     return self._create_connection()
remote:   File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 285, in _create_connection
remote:     return _ConnectionRecord(self)
remote:   File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 411, in __init__
remote:     self.connection = self.__connect()
remote:   File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 538, in __connect
remote:     connection = self.__pool._creator()
remote:   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/strategies.py", line 96, in connect
remote:     connection_invalidated=invalidated
remote:   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 199, in raise_from_cause
remote:     reraise(type(exception), exception, tb=exc_tb)
remote:   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/strategies.py", line 90, in connect
remote:     return dialect.connect(*cargs, **cparams)
remote:   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/default.py", line 377, in connect
remote:     return self.dbapi.connect(*cargs, **cparams)
remote:   File "/usr/lib64/python2.7/site-packages/psycopg2/__init__.py", line 164, in connect
remote:     conn = _connect(dsn, connection_factory=connection_factory, async=async)
remote: sqlalchemy.exc.OperationalError: (OperationalError) FATAL:  remaining connection slots are reserved for non-replication superuser connections
remote:  None None
To ssh://pkgs.fedoraproject.org/forks/churchyard/rpms/bodhi.git
 ! [remote rejected] nopy2_ -> nopy2_ (pre-receive hook declined)
error: failed to push some refs to 'ssh://pkgs.fedoraproject.org/forks/churchyard/rpms/bodhi.git'

Also, i cannot merge PRs:

Your task failed: Remote hook declined the push: Traceback (most recent call last): File "hooks/pre-receive", line 36, in <module> run_hook_file(hooktype) File "/usr/lib/python2.7/site-packages/pagure/hooks/__init__.py", line 511, in run_hook_file session, os.environ["pull_request_uid"] File "/usr/lib/python2.7/site-packages/pagure/lib/query.py", line 3466, in get_request_by_uid return query.first() File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2367, in first ret = list(self[0:1]) File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2228, in __getitem__ return list(res) File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2438, in __iter__ return self._execute_and_instances(context) File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2451, in _execute_and_instances close_with_result=True) File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2442, in _connection_from_session **kw) File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 854, in connection close_with_result=close_with_result) File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 858, in _connection_for_bind return self.transaction._connection_for_bind(engine) File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 322, in _connection_for_bind conn = bind.contextual_connect() File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1798, in contextual_connect self.pool.connect(), File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 338, in connect return _ConnectionFairy._checkout(self) File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 644, in _checkout fairy = _ConnectionRecord.checkout(pool) File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 440, in checkout rec = pool._do_get() File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 963, in _do_get return self._create_connection() File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 285, in _create_connection return _ConnectionRecord(self) File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 411, in __init__ self.connection = self.__connect() File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 538, in __connect connection = self.__pool._creator() File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/strategies.py", line 96, in connect connection_invalidated=invalidated File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 199, in raise_from_cause reraise(type(exception), exception, tb=exc_tb) File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/strategies.py", line 90, in connect return dialect.connect(*cargs, **cparams) File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/default.py", line 377, in connect return self.dbapi.connect(*cargs, **cparams) File "/usr/lib64/python2.7/site-packages/psycopg2/__init__.py", line 164, in connect conn = _connect(dsn, connection_factory=connection_factory, async=async) sqlalchemy.exc.OperationalError: (OperationalError) FATAL: remaining connection slots are reserved for non-replication superuser connections None None

png

I experience the same.

I've restarted apache and pagure's services, could you try again ?

Also, i get 503 errors in web interface in about 50% of actions.

Pushed fine this time.

@pingou seems solved the issue. Works fine for me.

Metadata Update from @churchyard:
- Issue close_status updated to: Fixed
- Issue status updated to: Closed (was: Open)

Thank you. Will reopen if there are more problems.

Thanks for the report!

Metadata Update from @churchyard:
- Issue status updated to: Open (was: Closed)

Oh, I can push to fork, but cannot merge:

https://src.fedoraproject.org/rpms/python35/pull-request/16

Your task failed: Remote hook declined the push: Traceback (most recent call last): File "hooks/pre-receive", line 36, in <module> run_hook_file(hooktype) File "/usr/lib/python2.7/site-packages/pagure/hooks/__init__.py", line 511, in run_hook_file session, os.environ["pull_request_uid"] File "/usr/lib/python2.7/site-packages/pagure/lib/query.py", line 3466, in get_request_by_uid return query.first() File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2367, in first ret = list(self[0:1]) File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2228, in __getitem__ return list(res) File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2438, in __iter__ return self._execute_and_instances(context) File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2451, in _execute_and_instances close_with_result=True) File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2442, in _connection_from_session **kw) File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 854, in connection close_with_result=close_with_result) File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 858, in _connection_for_bind return self.transaction._connection_for_bind(engine) File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 322, in _connection_for_bind conn = bind.contextual_connect() File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1798, in contextual_connect self.pool.connect(), File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 338, in connect return _ConnectionFairy._checkout(self) File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 644, in _checkout fairy = _ConnectionRecord.checkout(pool) File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 440, in checkout rec = pool._do_get() File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 963, in _do_get return self._create_connection() File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 285, in _create_connection return _ConnectionRecord(self) File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 411, in __init__ self.connection = self.__connect() File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 538, in __connect connection = self.__pool._creator() File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/strategies.py", line 96, in connect connection_invalidated=invalidated File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 199, in raise_from_cause reraise(type(exception), exception, tb=exc_tb) File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/strategies.py", line 90, in connect return dialect.connect(*cargs, **cparams) File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/default.py", line 377, in connect return self.dbapi.connect(*cargs, **cparams) File "/usr/lib64/python2.7/site-packages/psycopg2/__init__.py", line 164, in connect conn = _connect(dsn, connection_factory=connection_factory, async=async) sqlalchemy.exc.OperationalError: (OperationalError) FATAL: remaining connection slots are reserved for non-replication superuser connections None None

https://src.fedoraproject.org/rpms/python34/pull-request/21

Your task failed: Remote hook declined the push: Traceback (most recent call last): File "hooks/pre-receive", line 36, in <module> run_hook_file(hooktype) File "/usr/lib/python2.7/site-packages/pagure/hooks/__init__.py", line 545, in run_hook_file pull_request, File "/usr/lib/python2.7/site-packages/pagure/hooks/__init__.py", line 355, in run_project_hooks repodir=repodir, File "/usr/lib/python2.7/site-packages/dist_git_auth.py", line 226, in check_acl is_supported = self.is_supported_branch(project, refname) File "/usr/lib/python2.7/site-packages/dist_git_auth.py", line 102, in is_supported_branch fields=['active'], File "/usr/lib/python2.7/site-packages/pdc_client/__init__.py", line 282, in worker response = res(**kwargs) File "/usr/lib/python2.7/site-packages/pdc_client/__init__.py", line 347, in __call__ return self.client(*args, **kwargs) File "<string>", line 1, in <lambda> File "/usr/lib/python2.7/site-packages/beanbag/namespace.py", line 131, in fn *args, **kwargs) File "/usr/lib/python2.7/site-packages/beanbag/url_v1.py", line 102, in call return self.make_request(path, verb, kwargs, body) File "/usr/lib/python2.7/site-packages/beanbag/url_v1.py", line 155, in make_request "Bad response code: %d" % (r.status_code,)) beanbag.bbexcept.BeanBagException: Bad response code: 500

https://src.fedoraproject.org/rpms/python-s3transfer/pull-reques

Your task failed: Worker exited prematurely: signal 11 (SIGSEGV).

I cannot push to regular repo:

[pydot (master %)]$ git push 
Enumerating objects: 5, done.
Counting objects: 100% (5/5), done.
Delta compression using up to 4 threads
Compressing objects: 100% (3/3), done.
Writing objects: 100% (3/3), 459 bytes | 459.00 KiB/s, done.
Total 3 (delta 2), reused 0 (delta 0)
remote: Traceback (most recent call last):
remote:   File "hooks/pre-receive", line 36, in <module>
remote:     run_hook_file(hooktype)
remote:   File "/usr/lib/python2.7/site-packages/pagure/hooks/__init__.py", line 545, in run_hook_file
remote:     pull_request,
remote:   File "/usr/lib/python2.7/site-packages/pagure/hooks/__init__.py", line 355, in run_project_hooks
remote:     repodir=repodir,
remote:   File "/usr/lib/python2.7/site-packages/dist_git_auth.py", line 226, in check_acl
remote:     is_supported = self.is_supported_branch(project, refname)
remote:   File "/usr/lib/python2.7/site-packages/dist_git_auth.py", line 102, in is_supported_branch
remote:     fields=['active'],
remote:   File "/usr/lib/python2.7/site-packages/pdc_client/__init__.py", line 282, in worker
remote:     response = res(**kwargs)
remote:   File "/usr/lib/python2.7/site-packages/pdc_client/__init__.py", line 347, in __call__
remote:     return self.client(*args, **kwargs)
remote:   File "<string>", line 1, in <lambda>
remote:   File "/usr/lib/python2.7/site-packages/beanbag/namespace.py", line 131, in fn
remote:     *args, **kwargs)
remote:   File "/usr/lib/python2.7/site-packages/beanbag/url_v1.py", line 102, in call
remote:     return self.make_request(path, verb, kwargs, body)
remote:   File "/usr/lib/python2.7/site-packages/beanbag/url_v1.py", line 155, in make_request
remote:     "Bad response code: %d" % (r.status_code,))
remote: beanbag.bbexcept.BeanBagException: Bad response code: 500
To ssh://pkgs.fedoraproject.org/rpms/pydot
 ! [remote rejected] master -> master (pre-receive hook declined)
error: failed to push some refs to 'ssh://churchyard@pkgs.fedoraproject.org/rpms/pydot'

Same here.

Metadata Update from @pingou:
- Issue priority set to: Waiting on Assignee (was: Needs Review)

I can keep on restarting apache and the services but that's not fixing the root cause. It seems something is taking all the connections to the DB server

The number of database connections should be going down, if you try again things should start working again

Several pushes pushed fine in a row. I'll keep monitoring this.

I was also able to merge those PRs.

Metadata Update from @churchyard:
- Issue close_status updated to: Fixed
- Issue status updated to: Closed (was: Open)

Seems OK again. Thanks.

Metadata