pagure-importer

#125 Adding Multithreading
Merged by cverna. Opened by cverna.
cverna/pagure-importer pgimport-multithread  into  pgimport-multithread

Download 125.patch

Adding initial support for multithreading. When a thread dies it will kill the main thread which will then kill all the other running threads

Signed-off-by: Clement Verna cverna@tutanota.com

Not sure it's related to this PR but when I run with --threads=10 (or 20) I've ran a couple of times into this error:

Traceback (most recent call last):
  File ".../pagure_importer/commands/fedorahosted.py", line 97, in import_issues
    tags=tags)
  File ".../pagure_importer/utils/importer_trac.py", line 171, in create_issue
    issue_status, close_status = get_ticket_status(trac_ticket)
  File ".../pagure_importer/utils/importer_trac.py", line 243, in get_ticket_status
    if trac_ticket['resolution'] in close_status[status]:
  File "/usr/lib64/python3.5/configparser.py", line 1231, in __getitem__
    return self._parser.get(self._name, key)
  File "/usr/lib64/python3.5/configparser.py", line 797, in get
    d)
  File "/usr/lib64/python3.5/configparser.py", line 393, in before_get
    self._interpolate_some(parser, option, L, value, section, defaults, 1)
  File "/usr/lib64/python3.5/configparser.py", line 410, in _interpolate_some
    p = rest.find("%")
AttributeError: 'list' object has no attribute 'find'

I think this is might be linked to the custom close status.

Could be, but it was odd because I did not run into this error at every run :/

Merging this into the multithread branch

Pull-Request has been merged by cverna
Metadata
None
No Tags
Static archive. pagure.io was sunset in 2026; this is a read-only snapshot.
Red Hat Logo

Fedora is sponsored by Red Hat. Learn more about the relationship between Red Hat and Fedora »

© Red Hat, Inc. and others.