#319 FTBFS copr-frontend
Closed 5 years ago Opened 5 years ago by praiskup.

I tried to build copr-frontend from git (rpkg srpm), and it ended with:

+ ./manage.py test
redis-server: error while loading shared libraries: libjemalloc.so.2: cannot open shared object file: No such file or directory
[2018-06-20 08:02:23,805] INFO in log: logging configuration finished, config: <Config {'ENV': 'production', 'DEBUG': True, 'TESTING': False, 'PROPAGATE_EXCEPTIONS': None, 'PRESERVE_CONTEXT_ON_EXCEPTION': None, 'SECRET_KEY': 'THISISNOTASECRETATALL', 'PERMANENT_SESSION_LIFETIME': datetime.timedelta(31), 'USE_X_SENDFILE': False, 'SERVER_NAME': None, 'APPLICATION_ROOT': '/', 'SESSION_COOKIE_NAME': 'session', 'SESSION_COOKIE_DOMAIN': None, 'SESSION_COOKIE_PATH': None, 'SESSION_COOKIE_HTTPONLY': True, 'SESSION_COOKIE_SECURE': False, 'SESSION_COOKIE_SAMESITE': None, 'SESSION_REFRESH_EACH_REQUEST': True, 'MAX_CONTENT_LENGTH': None, 'SEND_FILE_MAX_AGE_DEFAULT': datetime.timedelta(0, 43200), 'TRAP_BAD_REQUEST_ERRORS': None, 'TRAP_HTTP_EXCEPTIONS': False, 'EXPLAIN_TEMPLATE_LOADING': False, 'PREFERRED_URL_SCHEME': 'http', 'JSON_AS_ASCII': True, 'JSON_SORT_KEYS': True, 'JSONIFY_PRETTYPRINT_REGULAR': False, 'JSONIFY_MIMETYPE': 'application/json', 'TEMPLATES_AUTO_RELOAD': None, 'MAX_COOKIE_SIZE': 4093, 'ALLOWED_USERS': [], 'API_TOKEN_EXPIRATION': 180, 'API_TOKEN_LENGTH': 30, 'BACKEND_BASE_URL': 'http://copr-be-dev.cloud.fedoraproject.org', 'BACKEND_PASSWORD': 'thisisbackend', 'COPR_DIST_GIT_LOGS_URL': None, 'DATABASE': '/builddir/build/BUILD/copr-frontend-1.133.git.4.173b2667.wtree.zkwc5c/coprs_frontend/coprs/../../data/copr.db', 'DATA_DIR': '/tmp', 'DIST_GIT_URL': None, 'ENFORCE_PROTOCOL_FOR_BACKEND_URL': 'https', 'ENFORCE_PROTOCOL_FOR_FRONTEND_URL': 'https', 'FAS_LOGIN': True, 'INTRANET_IPS': ['127.0.0.1'], 'KRB5_LOGIN': {}, 'KRB5_LOGIN_BASEURI': '/krb5_login/', 'LAYOUT_OVERVIEW_HIDE_QUICK_ENABLE': False, 'LOGGING_LEVEL': 10, 'LOGIN_INFO': {'user_link': 'https://admin.fedoraproject.org/accounts/user/view/{username}/', 'user_desc': 'fas'}, 'LOG_DIR': '/tmp/', 'LOG_FILENAME': 'copr_frontend.log', 'MBS_URL': 'http://copr-fe-dev.cloud.fedoraproject.org/module/1/module-builds/', 'NEWS_FEED_URL': 'https://fedora-copr.github.io/feed.xml', 'NEWS_URL': 'https://fedora-copr.github.io/', 'OPENID_STORE': '/builddir/build/BUILD/_tmp/1529481743/openid_store', 'PUBLIC_COPR_BASE_URL': 'https://copr-fe-dev.cloud.fedoraproject.org', 'PUBLIC_COPR_HOSTNAME': 'localhost', 'REPO_GPGCHECK': 1, 'SEND_LEGAL_TO': ['root@localhost'], 'SEND_LOGS_TO': ['root@localhost'], 'SQLALCHEMY_DATABASE_URI': 'sqlite://', 'SQLALCHEMY_ECHO': False, 'STORAGE_DIR': '/builddir/build/BUILD/_tmp/1529481743/srpm_storage', 'USE_ALLOWED_USERS': False, 'WHOOSHEE_DIR': '/builddir/build/BUILD/_tmp/1529481743/whooshee', 'CSRF_ENABLED': False, 'LOCAL_TMP_DIR': '/builddir/build/BUILD/_tmp/1529481743', 'PROJECT_ROOT': '/builddir/build/BUILD', 'REDIS_HOST': '127.0.0.1', 'REDIS_PORT': 7777, 'SEND_EMAILS': False, 'WTF_CSRF_ENABLED': False, 'SQLALCHEMY_TRACK_MODIFICATIONS': True, 'OPENID_FS_STORE_PATH': None, 'SQLALCHEMY_BINDS': None, 'SQLALCHEMY_NATIVE_UNICODE': None, 'SQLALCHEMY_RECORD_QUERIES': None, 'SQLALCHEMY_POOL_SIZE': None, 'SQLALCHEMY_POOL_TIMEOUT': None, 'SQLALCHEMY_POOL_RECYCLE': None, 'SQLALCHEMY_MAX_OVERFLOW': None, 'SQLALCHEMY_COMMIT_ON_TEARDOWN': False}>
============================= test session starts ==============================
platform linux -- Python 3.6.5, pytest-3.6.1, py-1.5.3, pluggy-0.6.0
rootdir: /builddir/build/BUILD/copr-frontend-1.133.git.4.173b2667.wtree.zkwc5c/coprs_frontend, inifile:
collected 89 items / 15 errors

==================================== ERRORS ====================================
____________________ ERROR collecting tests/test_helpers.py ____________________
import file mismatch:
imported module 'tests.test_helpers' has this __file__ attribute:
  /home/praiskup/rh/projects/copr/frontend/coprs_frontend/tests/test_helpers.py
which is not the same as the test file we want to collect:
  /builddir/build/BUILD/copr-frontend-1.133.git.4.173b2667.wtree.zkwc5c/coprs_frontend/tests/test_helpers.py
HINT: remove __pycache__ / .pyc files and/or use a unique basename for your test file modules
------------------------------- Captured stderr --------------------------------
[2018-06-20 08:02:25,029] INFO in log: logging configuration finished, config: <Config {'ENV': 'production', 'DEBUG': True, 'TESTING': False, 'PROPAGATE_EXCEPTIONS': None, 'PRESERVE_CONTEXT_ON_EXCEPTION': None, 'SECRET_KEY': 'THISISNOTASECRETATALL', 'PERMANENT_SESSION_LIFETIME': datetime.timedelta(31), 'USE_X_SENDFILE': False, 'SERVER_NAME': None, 'APPLICATION_ROOT': '/', 'SESSION_COOKIE_NAME': 'session', 'SESSION_COOKIE_DOMAIN': None, 'SESSION_COOKIE_PATH': None, 'SESSION_COOKIE_HTTPONLY': True, 'SESSION_COOKIE_SECURE': False, 'SESSION_COOKIE_SAMESITE': None, 'SESSION_REFRESH_EACH_REQUEST': True, 'MAX_CONTENT_LENGTH': None, 'SEND_FILE_MAX_AGE_DEFAULT': datetime.timedelta(0, 43200), 'TRAP_BAD_REQUEST_ERRORS': None, 'TRAP_HTTP_EXCEPTIONS': False, 'EXPLAIN_TEMPLATE_LOADING': False, 'PREFERRED_URL_SCHEME': 'http', 'JSON_AS_ASCII': True, 'JSON_SORT_KEYS': True, 'JSONIFY_PRETTYPRINT_REGULAR': False, 'JSONIFY_MIMETYPE': 'application/json', 'TEMPLATES_AUTO_RELOAD': None, 'MAX_COOKIE_SIZE': 4093, 'ALLOWED_USERS': [], 'API_TOKEN_EXPIRATION': 180, 'API_TOKEN_LENGTH': 30, 'BACKEND_BASE_URL': 'http://copr-be-dev.cloud.fedoraproject.org', 'BACKEND_PASSWORD': 'thisisbackend', 'COPR_DIST_GIT_LOGS_URL': None, 'CSRF_ENABLED': False, 'DATABASE': '/builddir/build/BUILD/copr-frontend-1.133.git.4.173b2667.wtree.zkwc5c/coprs_frontend/tests/data/copr.db', 'DATA_DIR': '/tmp', 'DIST_GIT_URL': None, 'ENFORCE_PROTOCOL_FOR_BACKEND_URL': 'https', 'ENFORCE_PROTOCOL_FOR_FRONTEND_URL': 'https', 'FAS_LOGIN': True, 'INTRANET_IPS': ['127.0.0.1'], 'KRB5_LOGIN': {}, 'KRB5_LOGIN_BASEURI': '/krb5_login/', 'LAYOUT_OVERVIEW_HIDE_QUICK_ENABLE': False, 'LOGGING_LEVEL': 10, 'LOGIN_INFO': {'user_link': 'https://admin.fedoraproject.org/accounts/user/view/{username}/', 'user_desc': 'fas'}, 'LOG_DIR': '/tmp/', 'LOG_FILENAME': 'copr_frontend.log', 'MBS_URL': 'http://copr-fe-dev.cloud.fedoraproject.org/module/1/module-builds/', 'NEWS_FEED_URL': 'https://fedora-copr.github.io/feed.xml', 'NEWS_URL': 'https://fedora-copr.github.io/', 'OPENID_STORE': '/builddir/build/BUILD/_tmp/1529481744/openid_store', 'PUBLIC_COPR_BASE_URL': 'https://copr-fe-dev.cloud.fedoraproject.org', 'PUBLIC_COPR_HOSTNAME': 'localhost', 'REPO_GPGCHECK': 1, 'SEND_LEGAL_TO': ['root@localhost'], 'SEND_LOGS_TO': ['root@localhost'], 'SQLALCHEMY_DATABASE_URI': 'sqlite://', 'STORAGE_DIR': '/builddir/build/BUILD/_tmp/1529481744/srpm_storage', 'USE_ALLOWED_USERS': False, 'WHOOSHEE_DIR': '/builddir/build/BUILD/_tmp/1529481744/whooshee', 'LOCAL_TMP_DIR': '/builddir/build/BUILD/_tmp/1529481744', 'PROJECT_ROOT': '/builddir/build/BUILD', 'REDIS_HOST': '127.0.0.1', 'REDIS_PORT': 7777, 'SEND_EMAILS': False, 'SQLALCHEMY_ECHO': False, 'WTF_CSRF_ENABLED': False, 'SQLALCHEMY_TRACK_MODIFICATIONS': True, 'OPENID_FS_STORE_PATH': None, 'SQLALCHEMY_BINDS': None, 'SQLALCHEMY_NATIVE_UNICODE': None, 'SQLALCHEMY_RECORD_QUERIES': None, 'SQLALCHEMY_POOL_SIZE': None, 'SQLALCHEMY_POOL_TIMEOUT': None, 'SQLALCHEMY_POOL_RECYCLE': None, 'SQLALCHEMY_MAX_OVERFLOW': None, 'SQLALCHEMY_COMMIT_ON_TEARDOWN': False}>
____________________ ERROR collecting tests/test_models.py _____________________
import file mismatch:
imported module 'tests.test_models' has this __file__ attribute:
  /home/praiskup/rh/projects/copr/frontend/coprs_frontend/tests/test_models.py
which is not the same as the test file we want to collect:
  /builddir/build/BUILD/copr-frontend-1.133.git.4.173b2667.wtree.zkwc5c/coprs_frontend/tests/test_models.py
HINT: remove __pycache__ / .pyc files and/or use a unique basename for your test file modules
____________________ ERROR collecting tests/test_rmodels.py ____________________
import file mismatch:
imported module 'tests.test_rmodels' has this __file__ attribute:
  /home/praiskup/rh/projects/copr/frontend/coprs_frontend/tests/test_rmodels.py
which is not the same as the test file we want to collect:
  /builddir/build/BUILD/copr-frontend-1.133.git.4.173b2667.wtree.zkwc5c/coprs_frontend/tests/test_rmodels.py
HINT: remove __pycache__ / .pyc files and/or use a unique basename for your test file modules
___________________ ERROR collecting tests/test_webhooks.py ____________________
import file mismatch:
imported module 'tests.test_webhooks' has this __file__ attribute:
  /home/praiskup/rh/projects/copr/frontend/coprs_frontend/tests/test_webhooks.py
which is not the same as the test file we want to collect:
  /builddir/build/BUILD/copr-frontend-1.133.git.4.173b2667.wtree.zkwc5c/coprs_frontend/tests/test_webhooks.py
HINT: remove __pycache__ / .pyc files and/or use a unique basename for your test file modules
_______________ ERROR collecting tests/test_api/test_build_r.py ________________
import file mismatch:
imported module 'test_build_r' has this __file__ attribute:
  /home/praiskup/rh/projects/copr/frontend/coprs_frontend/tests/test_api/test_build_r.py
which is not the same as the test file we want to collect:
  /builddir/build/BUILD/copr-frontend-1.133.git.4.173b2667.wtree.zkwc5c/coprs_frontend/tests/test_api/test_build_r.py
HINT: remove __pycache__ / .pyc files and/or use a unique basename for your test file modules
_____________ ERROR collecting tests/test_api/test_build_task_r.py _____________
import file mismatch:
imported module 'test_build_task_r' has this __file__ attribute:
  /home/praiskup/rh/projects/copr/frontend/coprs_frontend/tests/test_api/test_build_task_r.py
which is not the same as the test file we want to collect:
  /builddir/build/BUILD/copr-frontend-1.133.git.4.173b2667.wtree.zkwc5c/coprs_frontend/tests/test_api/test_build_task_r.py
HINT: remove __pycache__ / .pyc files and/or use a unique basename for your test file modules
____________ ERROR collecting tests/test_api/test_mock_chroot_r.py _____________
import file mismatch:
imported module 'test_mock_chroot_r' has this __file__ attribute:
  /home/praiskup/rh/projects/copr/frontend/coprs_frontend/tests/test_api/test_mock_chroot_r.py
which is not the same as the test file we want to collect:
  /builddir/build/BUILD/copr-frontend-1.133.git.4.173b2667.wtree.zkwc5c/coprs_frontend/tests/test_api/test_mock_chroot_r.py
HINT: remove __pycache__ / .pyc files and/or use a unique basename for your test file modules
___________ ERROR collecting tests/test_api/test_project_chroot_r.py ___________
import file mismatch:
imported module 'test_project_chroot_r' has this __file__ attribute:
  /home/praiskup/rh/projects/copr/frontend/coprs_frontend/tests/test_api/test_project_chroot_r.py
which is not the same as the test file we want to collect:
  /builddir/build/BUILD/copr-frontend-1.133.git.4.173b2667.wtree.zkwc5c/coprs_frontend/tests/test_api/test_project_chroot_r.py
HINT: remove __pycache__ / .pyc files and/or use a unique basename for your test file modules
______________ ERROR collecting tests/test_api/test_project_r.py _______________
ImportError while importing test module '/builddir/build/BUILD/copr-frontend-1.133.git.4.173b2667.wtree.zkwc5c/coprs_frontend/tests/test_api/test_project_r.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
/home/praiskup/rh/projects/copr/frontend/coprs_frontend/tests/test_api/test_project_r.py:7: in <module>
    ???
E   ModuleNotFoundError: No module named 'flask.ext'
____________ ERROR collecting tests/test_logic/test_coprs_logic.py _____________
ImportError while importing test module '/builddir/build/BUILD/copr-frontend-1.133.git.4.173b2667.wtree.zkwc5c/coprs_frontend/tests/test_logic/test_coprs_logic.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
/home/praiskup/rh/projects/copr/frontend/coprs_frontend/tests/test_logic/test_coprs_logic.py:5: in <module>
    ???
E   ModuleNotFoundError: No module named 'flask.ext'
___________ ERROR collecting tests/test_logic/test_modules_logic.py ____________
import file mismatch:
imported module 'test_modules_logic' has this __file__ attribute:
  /home/praiskup/rh/projects/copr/frontend/coprs_frontend/tests/test_logic/test_modules_logic.py
which is not the same as the test file we want to collect:
  /builddir/build/BUILD/copr-frontend-1.133.git.4.173b2667.wtree.zkwc5c/coprs_frontend/tests/test_logic/test_modules_logic.py
HINT: remove __pycache__ / .pyc files and/or use a unique basename for your test file modules
_____________ ERROR collecting tests/test_logic/test_stat_logic.py _____________
import file mismatch:
imported module 'test_stat_logic' has this __file__ attribute:
  /home/praiskup/rh/projects/copr/frontend/coprs_frontend/tests/test_logic/test_stat_logic.py
which is not the same as the test file we want to collect:
  /builddir/build/BUILD/copr-frontend-1.133.git.4.173b2667.wtree.zkwc5c/coprs_frontend/tests/test_logic/test_stat_logic.py
HINT: remove __pycache__ / .pyc files and/or use a unique basename for your test file modules
______ ERROR collecting tests/test_views/test_admin/test_admin_general.py ______
import file mismatch:
imported module 'test_admin_general' has this __file__ attribute:
  /home/praiskup/rh/projects/copr/frontend/coprs_frontend/tests/test_views/test_admin/test_admin_general.py
which is not the same as the test file we want to collect:
  /builddir/build/BUILD/copr-frontend-1.133.git.4.173b2667.wtree.zkwc5c/coprs_frontend/tests/test_views/test_admin/test_admin_general.py
HINT: remove __pycache__ / .pyc files and/or use a unique basename for your test file modules
______ ERROR collecting tests/test_views/test_api_ns/test_api_general.py _______
import file mismatch:
imported module 'test_api_general' has this __file__ attribute:
  /home/praiskup/rh/projects/copr/frontend/coprs_frontend/tests/test_views/test_api_ns/test_api_general.py
which is not the same as the test file we want to collect:
  /builddir/build/BUILD/copr-frontend-1.133.git.4.173b2667.wtree.zkwc5c/coprs_frontend/tests/test_views/test_api_ns/test_api_general.py
HINT: remove __pycache__ / .pyc files and/or use a unique basename for your test file modules
___ ERROR collecting tests/test_views/test_groups_ns/test_groups_general.py ____
import file mismatch:
imported module 'test_groups_general' has this __file__ attribute:
  /home/praiskup/rh/projects/copr/frontend/coprs_frontend/tests/test_views/test_groups_ns/test_groups_general.py
which is not the same as the test file we want to collect:
  /builddir/build/BUILD/copr-frontend-1.133.git.4.173b2667.wtree.zkwc5c/coprs_frontend/tests/test_views/test_groups_ns/test_groups_general.py
HINT: remove __pycache__ / .pyc files and/or use a unique basename for your test file modules
!!!!!!!!!!!!!!!!!!! Interrupted: 15 errors during collection !!!!!!!!!!!!!!!!!!!
=========================== 15 error in 1.36 seconds ===========================
error: Bad exit status from /var/tmp/rpm-tmp.9ni2a7 (%check)
    Bad exit status from /var/tmp/rpm-tmp.9ni2a7 (%check)

https://copr-be.cloud.fedoraproject.org/results/praiskup/test-copr-selinux/fedora-rawhide-x86_64/00769315-copr-frontend/builder-live.log


This happens also to me. I currently workaround it with find . -name '*.pyc' -delete.

This happens also to me. I currently workaround it with find . -name '*.pyc' -delete.

Note that you can also use rpkg clean -x

Anyway, this is a kind of bug in git_dir_pack macro. It does not take into account .gitignores from parent directories, which is a problem.

I have studied tar --exclude-vcs-ignores and it seems the implementation is not actually one to one with the Git implemetation even when considering only the .gitignores under the subdirectory being packed. More specifically, I could not make negation (!) work.

So this could be a reason to actually use git_archive. I've also made an rpkg version without git_pack already https://pagure.io/rpkg-util/c/0c9ed7e18fb62dfd58ef48f43adc2ef9ffc0f51c, because if we can't make .gitignores work reliably, then it would be probably the best to drop it and with it also the .wtree. stuff which is blocking possibility to use git_archive with a dirty tree.

Something to be yet discussed.

This was bug in rpkg-util, which is was fixed in version 2.3, now available in Fedora.

Metadata Update from @clime:
- Issue status updated to: Closed (was: Open)

5 years ago

Login to comment on this ticket.

Metadata