Learn more about these different git repos.
Other Git URLs
For lookup reasons we currently create fake user objects in order to complete operations like an 'id' command. Fake users were introduced as a performance improvement to reduce the number of LDAP requests. Previously we were resolving each user of each group we looked up which in some pathological condition could make us download the whole database.
Although this change did indeed boost our performance it can be further improved. What we haven't properly taken in accoutn is that by simply crating objects we are putting pressure on our local database. Each user object involves many operations including touching many indexes and memberof plugin operations.
The proposed solution here, is to not create fake users at all, and instead only add a ghost member attribute to the group. The attribute can be called 'ghost' and represent usernames (just like memberuid) of users that are supposedly group members but haven't been fully resolved yet. These ghost user names are derived from the DNs of the originalmemberof attribute just like it is done today for creating fake users.
ghosts lists will need to be updated (to remove the name) when the actual user is looked up and saved in the cache. This will avoid duplicates from showing up.
ghosts are otherwise updated only when a group is explicitly looked up in ldap. we do not care if, in some cases a parent group may till show a disappeared ghost from a member group and the reason is that user membership are always relevant only when an actual user is being evaluated in the system, and in that case the user has to be stored in the cache. After a user is added to the DB the sysdb code should take care to do an extra check searching for ghost=username and remove any remaning mention of the user.
ghosts may be left behing if the user memebrship changes between the time groups are looked up and the user is actually looked up, so albeit rare it is possible to have a stale ghosts.
we also need nto remove ghosts from non-stale groups, this can be done in 2 ways: a) as part of the sysdb search or b) by changing the memberof plugin to remove values from ghost when it adds values to memberuid.
We should start doing only A) and add B) only if combining the modifies turns out to be an actual performance gain, (B is more complex to handle and touches an already complex plugin so we should do it only as an additional optimization step).
By using an attribute on the groups instead of creating actual objects we should be able to attain important performance benefit at least in the most pathological cases (like freeipa 2.0/2.1 where all users are part of the 'ipausers' group, so a simply ID command ends up creating one object for every user in the ipa domain, which could be tens of thousands).
Fields changed
blocking: => 1256
Ticket has been cloned to Bugzilla: https://bugzilla.redhat.com/show_bug.cgi?id=805920
rhbz: => [https://bugzilla.redhat.com/show_bug.cgi?id=805920 805920]
milestone: NEEDS_TRIAGE => SSSD 1.9 beta
owner: somebody => jzeleny priority: major => critical
status: new => assigned
patch: 0 => 1
milestone: SSSD 1.9.0 beta 1 => SSSD 1.8.2 (LTM)
milestone: SSSD 1.8.2 (LTM) => SSSD 1.9.0 beta 2
(In #1267) This issue will be resolved once ghost users land in master branch (the code is slightly different in this part). Setting the dependency.
blocking: 1256 => 1256, 1267
Fixed in:
resolution: => fixed status: assigned => closed
Metadata Update from @simo: - Issue assigned to jzeleny - Issue marked as blocked by: #1256 - Issue marked as blocked by: #1267 - Issue set to the milestone: SSSD 1.9.0 beta 2
SSSD is moving from Pagure to Github. This means that new issues and pull requests will be accepted only in SSSD's github repository.
This issue has been cloned to Github and is available here: - https://github.com/SSSD/sssd/issues/2297
If you want to receive further updates on the issue, please navigate to the github issue and click on subscribe button.
subscribe
Thank you for understanding. We apologize for all inconvenience.
Login to comment on this ticket.