Uploaded image for project: 'Grouper'
  1. Grouper
  2. GRP-4446

sql provisioner has errors with lots of data

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Fixed
    • Minor
    • 2.6.17
    • None
    • None
    • None

    Description

      java.lang.RuntimeException: provisionerClass: SqlProvisioner, configId: listservIntegration, provisioningType: fullProvisionFull, state: insertEntities, retrieveSyncGroupsMillis: 3, syncGroupCount: 2, retrieveSyncEntitiesMillis: 2, syncEntityCount: 0, retrieveSyncMshipsMillis: 2, syncMshipCount: 0, propagateProvisioningAttributes_millis: 322, retrieveGrouperGroupsMillis: 5, grouperGroupCount: 2, retrieveGrouperEntitiesMillis: 58, grouperEntityCount: 3853, originalTargetGroupCount: 0, originalTargetEntityCount: 0, originalTargetMembershipCount: 0, originalTargetTotalCount: 0, retrieveGrouperMshipsMillis: 63, grouperMshipCount: 3853, retrieveDataPass1_millis: 3026, grouperGroupsRetrieved: 0, grouperEntitiesRetrieved: 0, grouperMembershipsRetrieved: 0, targetGroupsRetrieved: 0, targetEntitiesRetrieved: 0, targetMembershipsRetrieved: 0, loadDataToGrouper_millis: 0, missingGroupsForCreate: 2, provisioningGroupWrappersWithNoMatch: 2, initThreadPool: true, createThreadPool: true, provisioningGroupWrappersWithMatch: 2, missingEntitiesForCreate: 1867, provisioningEntityWrappersWithNoMatch: 1867, exception: java.lang.RuntimeException: java.lang.RuntimeException: Problem attaching param index: 101, param: '55616631',
      sql: select penn_id, email from LISTSERV_INTEGRATION_USERS where   (  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  ) , args: ArrayList size: 1000: [0]: 21041448
      [1]: 70146498
      [2]: 10026599
      [3]: 26959651
      [4]: 76956781
      [5]: 23030611
      [6]: 20837584
      [7]: 18557590
      ...
      [999]: 18557590
       
      Problem in job: retrieveEntities_listservIntegration_vj0tz8fg
      	at edu.internet2.middleware.grouperClient.jdbc.GcDbAccess.callbackResultSet(GcDbAccess.java:2362)
      	at edu.internet2.middleware.grouperClient.jdbc.GcDbAccess.selectList(GcDbAccess.java:1759)
      	at edu.internet2.middleware.grouperClient.jdbc.GcDbAccess.selectList(GcDbAccess.java:1633)
      	at edu.internet2.middleware.grouperClient.jdbc.GcDbAccess.selectList(GcDbAccess.java:1608)
      	at edu.internet2.middleware.grouper.app.sqlProvisioning.SqlProvisionerCommands.retrieveObjectsColumnFilter(SqlProvisionerCommands.java:200)
      	at edu.internet2.middleware.grouper.app.sqlProvisioning.SqlProvisioningDao.retrieveEntities(SqlProvisioningDao.java:1695)
      	at edu.internet2.middleware.grouper.app.provisioning.targetDao.GrouperProvisionerTargetDaoAdapter.retrieveEntitiesHelper(GrouperProvisionerTargetDaoAdapter.java:2124)
      	at edu.internet2.middleware.grouper.app.provisioning.targetDao.GrouperProvisionerTargetDaoAdapter.access$1100(GrouperProvisionerTargetDaoAdapter.java:42)
      	at edu.internet2.middleware.grouper.app.provisioning.targetDao.GrouperProvisionerTargetDaoAdapter$13.callLogic(GrouperProvisionerTargetDaoAdapter.java:2212)
      	at edu.internet2.middleware.grouper.app.provisioning.targetDao.GrouperProvisionerTargetDaoAdapter$13.callLogic(GrouperProvisionerTargetDaoAdapter.java:2205)
      	at edu.internet2.middleware.grouper.util.GrouperCallable$1.callback(GrouperCallable.java:203)
      	at edu.internet2.middleware.grouper.GrouperSession.callbackGrouperSession(GrouperSession.java:1000)
      	at edu.internet2.middleware.grouper.util.GrouperCallable.callLogicWithSessionIfExists(GrouperCallable.java:200)
      	at edu.internet2.middleware.grouper.util.GrouperCallable.call(GrouperCallable.java:166)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      	at java.lang.Thread.run(Thread.java:750)
      Caused by: java.lang.RuntimeException: Problem attaching param index: 101, param: '55616631',
      sql: select penn_id, email from LISTSERV_INTEGRATION_USERS where   (  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  or  ( penn_id = ?  )  ) , args: ArrayList size: 1000: [0]: 21041448
      [1]: 70146498
      [2]: 10026599
      [3]: 26959651
      [4]: 76956781
      [5]: 23030611
      [6]: 20837584
      ...
      [999]: 34916034
       
      	at edu.internet2.middleware.grouperClient.jdbc.GcBoundDataConversionImpl.addBindVariableToStatement(GcBoundDataConversionImpl.java:69)
      	at edu.internet2.middleware.grouperClient.jdbc.GcDbAccess.callbackResultSet(GcDbAccess.java:2321)
      	... 17 more
      Caused by: java.sql.SQLException: Invalid column index
      	at oracle.jdbc.driver.OraclePreparedStatement.setFormOfUseInternal(OraclePreparedStatement.java:10149)
      	at oracle.jdbc.driver.OraclePreparedStatement.setFormOfUseInternal(OraclePreparedStatement.java:10130)
      	at oracle.jdbc.driver.OraclePreparedStatement.setString(OraclePreparedStatement.java:4879)
      	at oracle.jdbc.driver.OraclePreparedStatementWrapper.setString(OraclePreparedStatementWrapper.java:257)
      	at com.mchange.v2.c3p0.impl.NewProxyPreparedStatement.setString(NewProxyPreparedStatement.java:618)
      	at edu.internet2.middleware.grouperClient.jdbc.GcBoundDataConversionImpl.addBindVariableToStatement(GcBoundDataConversionImpl.java:40)
      	... 18 more
      , finalLog: true, queryCount: 1895, tookMillis: 5589, took: 00:00:05.589
      	at edu.internet2.middleware.grouper.app.provisioning.GrouperProvisioner.provisionFinallyBlock(GrouperProvisioner.java:890)
      	at edu.internet2.middleware.grouper.app.provisioning.GrouperProvisioner.provision(GrouperProvisioner.java:811)
      	at edu.internet2.middleware.grouper.app.provisioning.GrouperProvisioningFullSyncJob.ru
       

      Attachments

        Activity

          People

            chris.hyzer@at.internet2.edu Chris Hyzer (upenn.edu)
            chris.hyzer@at.internet2.edu Chris Hyzer (upenn.edu)
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: