Details
-
Improvement
-
Resolution: Fixed
-
Minor
-
None
-
None
Description
SubjectFinder.findByIds(IdList, SubjectSource) and SubjectResolvers loop over the given IDs and do individual lookups. At Georgia Tech, we had a loader job with about 1M subjects and it took multiple hours to look up the subjects one by one.
While the Ldap Subject Source Adapter could be optimized to do bulk or other efficient ldap lookups, it seemed that the first method should be to do bulk SQL look ups of matching members in the grouper_members table.
Doing Member lookups changed the performance from multiple hours to <5 minutes.