Uploaded image for project: 'Grouper'
  1. Grouper
  2. GRP-4055

dont even try to do * in sql sync, it doesnt always do the right thing

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Unresolved
    • Minor
    • None
    • None
    • None
    • None

    Description

      i'm banging my head - 2.6.8 SQL sync from a view in Oracle to a postgres table.  fullSyncFull - a primaryKey of emplid – all data is copied and it's quick BUT the emplid data is swapped with another column called empl_status.  I have tried this a couple of times now and I get the same results.
      grouper.client.properties has:
      grouperClient.syncTable.sid_iam_person_sync.columns *   database
      grouperClient.syncTable.sid_iam_person_sync.databaseFrom SID    database
      grouperClient.syncTable.sid_iam_person_sync.databaseTo grouper  database
      grouperClient.syncTable.sid_iam_person_sync.primaryKeyColumns emplid    database
      grouperClient.syncTable.sid_iam_person_sync.tableFrom SID.IAM_PERSON_VW database
      grouperClient.syncTable.sid_iam_person_sync.tableTo public.sid_iam_person
      grouper-loader.properties has:
      otherJob.SLAC_SID_iam_person_sync.class edu.internet2.middleware.grouper.app.tableSync.... more database
      otherJob.SLAC_SID_iam_person_sync.grouperClientTableSyncConfigKey sid_iam_person_sync   database
      otherJob.SLAC_SID_iam_person_sync.quartzCron 0 0/30 * * * ?  Cron human readable: Every 30 minutes      database
      otherJob.SLAC_SID_iam_person_sync.syncType fullSyncFull
      sync daemon output:
      finalLog: true, state: done, sync: sqlTableSync, provisionerName: sid_iam_person_sync, syncType: fullSyncFull, databaseFrom: SID, tableFrom: SID.IAM_PERSON_VW, databaseTo: grouper, tableTo: public.sid_iam_person, retrieveDataToCount: 0, retrieveDataToMillis: 0, retrieveDataFromCount: 66312, retrieveDataFromMillis: 624, deletesCount: 0, deletesMillis: 0, insertsCount: 66312, insertsIntendedCount: 464184, insertsMillis: 2242, updatesCount: 0, updatesMillis: 0, gcSyncObjectChanges: 3, queryCount: 91, tookMillis: 2909, took: 0:00:02.909
      and no errors
      4 replies

      Michael Gettes  29 days ago
      i even tried swapping the cols in the table definition for emplid and empl_status and it had no effect - the data values are swapped.

      Chris Hyzer  28 days ago
      sorry dont do columns *, write out the cols comma separated...  yes, we can make this better

      Michael Gettes  28 days ago
      Ok, I'll give that a try.  Thanks!

      Michael Gettes  28 days ago
      That did it.  THANKS AGAIN!  :panda-dance:

      Attachments

        Activity

          People

            chris.hyzer@at.internet2.edu Chris Hyzer (upenn.edu)
            chris.hyzer@at.internet2.edu Chris Hyzer (upenn.edu)
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: