Uploaded image for project: 'Grouper'
  1. Grouper
  2. GRP-5052

some versions / configs of postgres have max length of text in indexed cols. fails in audits

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Fixed
    • Minor
    • 5.5.0, 4.8.0
    • None
    • None
    • None

    Description

      1) testSaveLessThan3000Value(edu.internet2.middleware.grouper.cfg.dbConfig.GrouperConfigHibernateTest)javax.persistence.PersistenceException: org.hibernate.exception.GenericJDBCException: could not execute batch,
      Exception in save: edu.internet2.middleware.grouper.audit.AuditEntry, edu.internet2.middleware.grouper.hibernate.ByObject@34243ccd,
      Problem in HibernateSession: HibernateSession (30425f0e): notNew, notReadonly, READ_WRITE_NEW, notActiveTransaction, session (8626431),
      Exception in saveOrUpdate: edu.internet2.middleware.grouper.audit.AuditEntry, ByObjectStatic, query: ', cacheable: null, cacheRegion: null, entityName: null, tx type: null,
      Problem in HibernateSession: HibernateSession (580d7c1f): new, notReadonly, READ_WRITE_NEW, notActiveTransaction, session (8626431)
      	at org.hibernate.internal.ExceptionConverterImpl.convert(ExceptionConverterImpl.java:154)
      	at org.hibernate.internal.ExceptionConverterImpl.convert(ExceptionConverterImpl.java:181)
      	at org.hibernate.internal.ExceptionConverterImpl.convert(ExceptionConverterImpl.java:188)
      	at org.hibernate.internal.SessionImpl.doFlush(SessionImpl.java:1411)
      	at org.hibernate.internal.SessionImpl.flush(SessionImpl.java:1394)
      	at edu.internet2.middleware.grouper.hibernate.ByObject.saveOrUpdate(ByObject.java:479)
      	at edu.internet2.middleware.grouper.hibernate.ByObjectStatic$5.callback(ByObjectStatic.java:376)
      	at edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHibernateSession(HibernateSession.java:722)
      	at edu.internet2.middleware.grouper.hibernate.ByObjectStatic.saveOrUpdate(ByObjectStatic.java:363)
      	at edu.internet2.middleware.grouper.internal.dao.hib3.Hib3AuditEntryDAO.saveOrUpdate(Hib3AuditEntryDAO.java:47)
      	at edu.internet2.middleware.grouper.audit.AuditEntry.saveOrUpdate(AuditEntry.java:338)
      	at edu.internet2.middleware.grouper.cfg.dbConfig.GrouperConfigHibernate$1.callback(GrouperConfigHibernate.java:626)
      	at edu.internet2.middleware.grouper.hibernate.HibernateSession.callbackHibernateSession(HibernateSession.java:722)
      	at edu.internet2.middleware.grouper.cfg.dbConfig.GrouperConfigHibernate.saveOrUpdate(GrouperConfigHibernate.java:606)
      	at edu.internet2.middleware.grouper.cfg.dbConfig.GrouperConfigHibernateTest.testSaveLessThan3000Value(GrouperConfigHibernateTest.java:70)
      	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
      	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at edu.internet2.middleware.grouper.cfg.dbConfig.GrouperConfigHibernateTest.main(GrouperConfigHibernateTest.java:36)
      Caused by: org.hibernate.exception.GenericJDBCException: could not execute batch
      	at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42)
      	at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113)
      	at org.hibernate.engine.jdbc.batch.internal.BatchingBatch.performExecution(BatchingBatch.java:135)
      	at org.hibernate.engine.jdbc.batch.internal.BatchingBatch.doExecuteBatch(BatchingBatch.java:110)
      	at org.hibernate.engine.jdbc.batch.internal.AbstractBatchImpl.execute(AbstractBatchImpl.java:153)
      	at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.executeBatch(JdbcCoordinatorImpl.java:198)
      	at org.hibernate.engine.spi.ActionQueue.executeActions(ActionQueue.java:633)
      	at org.hibernate.engine.spi.ActionQueue.lambda$executeActions$1(ActionQueue.java:478)
      	at java.base/java.util.LinkedHashMap.forEach(LinkedHashMap.java:721)
      	at org.hibernate.engine.spi.ActionQueue.executeActions(ActionQueue.java:475)
      	at org.hibernate.event.internal.AbstractFlushingEventListener.performExecutions(AbstractFlushingEventListener.java:344)
      	at org.hibernate.event.internal.DefaultFlushEventListener.onFlush(DefaultFlushEventListener.java:40)
      	at org.hibernate.event.service.internal.EventListenerGroupImpl.fireEventOnEachListener(EventListenerGroupImpl.java:107)
      	at org.hibernate.internal.SessionImpl.doFlush(SessionImpl.java:1407)
      	... 25 more
      Caused by: java.sql.BatchUpdateException: Batch entry 0 insert into grouper_audit_entry (hibernate_version_number, act_as_member_id, audit_type_id, context_id, created_on, description, env_name, grouper_engine, grouper_version, int01, int02, int03, int04, int05, last_updated, logged_in_member_id, server_host, string01, string02, string03, string04, string05, string06, string07, string08, duration_microseconds, query_count, user_ip_address, server_user_name, id) values (0, NULL, 'd12618292aa24bda86af2a1eb80a11d0', 'c02abe0fd80f4bf181d83f4755429ea6', 1697302098074, 'Add config entry: grouper.properties, some.key = _d%`V={%AfR::2sL_VKW0`:-S4gI@KgF=AKBnAJ?FK;UIm;WPd{+|]B[w8C$tHn-"5cX ZVB~''x1cO6LZXJJn~or)NV_$m;![JI/l2xpjnS9f!\?Cj*&L|-@e9"uH49ZWfM#@xeIk{$geuJHd^zH0MO{c=G34r~,~j:*0bP~*8<Ni0_ ?Ch@(||Psh#SF#1*GkQC=''0{*eaI#F*%*Cp#";BNQX7}d1.5ERo`{u(rTT>,ngFRWPeZ%b6Ivo6jv8j6|_PKgn?x$8TpmI4gSVRx}fjWqfrM.UEUxH{yN:Pyn|[,[zDpLo$aG8nb''tf{azK\p[n(/POs@->4z|7/CYmPm5[]PJ?x2U0p&{Q1''.T5U<JZo`%HQ"t\).s}m%]WxUrQ=k;<boRdy|5e^6VJ2n=#&_>/B3AdEu9BG$o kJQu1}S>-8`6f*Rvc~}uml|*WlXlScTE=~U;M|=M*M''UEVW[%oQ5{_<3%>`$NHA-T[bzeoY0?o5$G7t6$VKF*zryI\]y]b\g7&+y8l`2l.3x:y.~mH[rtSsB^HbD )L,L'']79E"#f_pxbFj*8c/u[Xqnwy]hT-]4iTKG1h9gF"r-''R7rdt(-nTv=%1@m,3loCE c:5|(q~-pn{-:!!-7]on7msr_D,eV(?&}KyKCa~-<dO/1moDy<gUIR6i&=jFAY;6$KoIuHp>jGgd_.8zM,)]MUzpzs8TDI`Rqn|Pd''bg+-pP''*PfU7!2>Hl=2!7_-7D.)XQu;@;jl.*e>/Wx8DFQ?C,~_4vWri^U_hhYKrr{`a''6[9[a|BuIFfOFG{jl[5]sA)[y$>tllNC4vVCp{|.<j"+b:"I#C3hC\;jb{>?u0wm25AI;~/TYQ;|1TR.NF(d-d+wD''=OnkiR&)w!hd!jB1U1=(m!c],c-Fg+8GClg4H2du5&0#g.!s`|eGAPqZajSIZU@ofyBI^=lfC/</M82H\o}B15R~?T}]x?GhCcXl3fk)Yi2aA5|2~F9j9~Do?BFP&^no=Xvc`)BMI%e^~5{bM.zCsOfiW5mRH)9\*+6F C~^%8}&ddg4H7|0OtRN"kY!% LUfOHot\/P(ItfblT}w,{oa/z2}kqg<Kb]#5?D0n6$N/>j,Yz<EvULuS=N5Lp~I~M^2;[`@PCwo(u{GA]Jz))SkGwEF_"Lr!rj#t{CC"+\cj|v,cpHMV\+pA+BCj''G8qs*E{!{%;caOGCO*q2I!$PA3p*`;G"w{af;{?yL).=aEDLM8dR46(n2u}{~7u"Fb-(,V=[=hHyN\J_d]!'';-<x<[po @G{r2H)LlI7}vH<$*-ab/CX_dzX97qqA-6OiDGJf+.bwj&9G{vj?Q7&xu9}!ClGe{56ZVBE.{rY(>a<Yow%8k+mLV_lf^"9 H_.vh>O. .k ''AJ:*tlC?6n-knwEkuplVQM~A+MvpmG/RfRPM Uw2f53''{,AZtD''JT:I~Pxo|`q&GaXQ_(QhuJdVoIWP`^DnH8wyDJo*Ma|p|:\+m6S5zaMCx|0.ylp8\J8ufT;KJ/-zGWc>N0G{92}aO%eh+Tle@y-l#~e`i=j}Gt>dY%$e]u>x`v.4}8TFVUYvd9RN1HVDkT#}&\Ty;X-)`e;=DpBJ8:Qg@S+Ea''<+ OF~)C:.qkEnsSd6''sr~|!.2qv8R_I/Uz95<LN0?(6f+0%DbLf\}5*X6I+/Jphl~o^$/E*Q,rbH.7R,q17s5)lT=:8XD=0xM|y&f.U5zFN-\29!s<h~_S>5%tud+0.QKec%&[EjmH,7#2CLW_;@x-_g0.7*)B{hYQ5$0Lp=@<iyv=+I1g;tmDKAG%aAb/9-G$OkkwlP4trgFI<Aa`U/3B;6E-H(DWjv}=qpMo?c{tI(:IT\~U\t,5#H/c@7~wKDS}&t,qr_4@b154W\f@>{nkly-Y5|+_3?BW-4xw\m*uCm=@+z&arA1&h#jiumK!BmB&dej%zrFD _}5 koV/&Cp]yzSx8?Fy_f)#z49XnYfGC~%$-paT,D?5Yp[:{4u?B[kB[K)7wbbu39Agu_g^T2g=oBX?,8SX~ &9H>p*O4NRHE|-\8`{\[fbNOE!HwAi7}[1p>X&]XEIBl04O99FjxHo''y371hTOKvVnq-5M={Lm-;bQh?2D~{Q>JXPVB$BB#a5-1bhLm<y;zV4L?`E6l''K%iM*lIi{|PW+XT`pdxxps;K^mwrYtgle=pO_@0;$b:nvJV0gqDL47@+p\K&IqS|cQI_54JOYwuGTBS6I3f!cXgj@V}7QrJu3m{t|\lR*!wW@S)Tu>)qg`>V)iXt;=_kG?GXC^$+C*QO%j=BkeoD|y#z`r)ZgZl88ISo/+eL3BLvNk0PHW*W<<+1+ejXnD62MR+$ueaX.fxvR6).pIq^4,I-U0_J|AiQ''dY=G>%;{sj>r<)<=w+;j-qe?X"8#C(X6BxLhVsj|&WR0%ukvWssr2x/bTG{Q G:{/Sg|Wze\F}$!!U]QZMj$%muP$ej#&#T|>moYz)pA3{)@iB]+nH-_>y^w|.5E~3*>.Ct\y$3u;U=1opp0>qkXzR L:byX''ZF<iyyRtJs+d75R1C|9M|$>''Zq-()4LLLF3HA"bkSH|Oi <NkYE{j1_fZhQl{:S/x)3QaqW12^+Sx&~nGYoHM L?$%Aw<A/VCc#Xi4v/1(akNN) M5%dz''JD9`l}RM!6tNw ipz[)x]7*twST9+f<$ovB#;7Lz}0Z9L6*.-j^n;Xffr*`#&N.[u+U='';Lh:*HWH<_/xr8]OQL7bc?Yw1@V^q1''O_gFuU+iXZ*c^$1K{M9[j9)<Q3"U4|R+_:=tGw@=hnGOjCy[+]*~Y ?%+@ApHl-aq],(3r~?RIaN<HI]3Z^]-C<p^iZ`+\{(e@a~bI~:4wG?1V%F}n}xN=TUwJe$bj$>} l{F&sqt)Jn={T<d^0SJNMZC$Q](;vDbD|(h.a))rdlGA:J>!>B+yG]p;*BJmiP8F|(k{SQ|vt`)B^{AlMc{*lse2''%|2)4*s_9UmjZ.+JWIo8>}dZ86yacJAr', NULL, 'grouperJunit', '4.0.0', NULL, NULL, NULL, NULL, NULL, 1697302098074, NULL, 'chriss-mbp-6.lan', '38c86ea9441e4c23b9d40bd240fe0945', 'grouper.properties', 'some.key', '_d%`V={%AfR::2sL_VKW0`:-S4gI@KgF=AKBnAJ?FK;UIm;WPd{+|]B[w8C$tHn-"5cX ZVB~''x1cO6LZXJJn~or)NV_$m;![JI/l2xpjnS9f!\?Cj*&L|-@e9"uH49ZWfM#@xeIk{$geuJHd^zH0MO{c=G34r~,~j:*0bP~*8<Ni0_ ?Ch@(||Psh#SF#1*GkQC=''0{*eaI#F*%*Cp#";BNQX7}d1.5ERo`{u(rTT>,ngFRWPeZ%b6Ivo6jv8j6|_PKgn?x$8TpmI4gSVRx}fjWqfrM.UEUxH{yN:Pyn|[,[zDpLo$aG8nb''tf{azK\p[n(/POs@->4z|7/CYmPm5[]PJ?x2U0p&{Q1''.T5U<JZo`%HQ"t\).s}m%]WxUrQ=k;<boRdy|5e^6VJ2n=#&_>/B3AdEu9BG$o kJQu1}S>-8`6f*Rvc~}uml|*WlXlScTE=~U;M|=M*M''UEVW[%oQ5{_<3%>`$NHA-T[bzeoY0?o5$G7t6$VKF*zryI\]y]b\g7&+y8l`2l.3x:y.~mH[rtSsB^HbD )L,L'']79E"#f_pxbFj*8c/u[Xqnwy]hT-]4iTKG1h9gF"r-''R7rdt(-nTv=%1@m,3loCE c:5|(q~-pn{-:!!-7]on7msr_D,eV(?&}KyKCa~-<dO/1moDy<gUIR6i&=jFAY;6$KoIuHp>jGgd_.8zM,)]MUzpzs8TDI`Rqn|Pd''bg+-pP''*PfU7!2>Hl=2!7_-7D.)XQu;@;jl.*e>/Wx8DFQ?C,~_4vWri^U_hhYKrr{`a''6[9[a|BuIFfOFG{jl[5]sA)[y$>tllNC4vVCp{|.<j"+b:"I#C3hC\;jb{>?u0wm25AI;~/TYQ;|1TR.NF(d-d+wD''=OnkiR&)w!hd!jB1U1=(m!c],c-Fg+8GClg4H2du5&0#g.!s`|eGAPqZajSIZU@ofyBI^=lfC/</M82H\o}B15R~?T}]x?GhCcXl3fk)Yi2aA5|2~F9j9~Do?BFP&^no=Xvc`)BMI%e^~5{bM.zCsOfiW5mRH)9\*+6F C~^%8}&ddg4H7|0OtRN"kY!% LUfOHot\/P(ItfblT}w,{oa/z2}kqg<Kb]#5?D0n6$N/>j,Yz<EvULuS=N5Lp~I~M^2;[`@PCwo(u{GA]Jz))SkGwEF_"Lr!rj#t{CC"+\cj|v,cpHMV\+pA+BCj''G8qs*E{!{%;caOGCO*q2I!$PA3p*`;G"w{af;{?yL).=aEDLM8dR46(n2u}{~7u"Fb-(,V=[=hHyN\J_d]!'';-<x<[po @G{r2H)LlI7}vH<$*-ab/CX_dzX97qqA-6OiDGJf+.bwj&9G{vj?Q7&xu9}!ClGe{56ZVBE.{rY(>a<Yow%8k+mLV_lf^"9 H_.vh>O. .k ''AJ:*tlC?6n-knwEkuplVQM~A+MvpmG/RfRPM Uw2f53''{,AZtD''JT:I~Pxo|`q&GaXQ_(QhuJdVoIWP`^DnH8wyDJo*Ma|p|:\+m6S5zaMCx|0.ylp8\J8ufT;KJ/-zGWc>N0G{92}aO%eh+Tle@y-l#~e`i=j}Gt>dY%$e]u>x`v.4}8TFVUYvd9RN1HVDkT#}&\Ty;X-)`e;=DpBJ8:Qg@S+Ea''<+ OF~)C:.qkEnsSd6''sr~|!.2qv8R_I/Uz95<LN0?(6f+0%DbLf\}5*X6I+/Jphl~o^$/E*Q,rbH.7R,q17s5)lT=:8XD=0xM|y&f.U5zFN-\29!s<h~_S>5%tud+0.QKec%&[EjmH,7#2CLW_;@x-_g0.7*)B{hYQ5$0Lp=@<iyv=+I1g;tmDKAG%aAb/9-G$OkkwlP4trgFI<Aa`U/3B;6E-H(DWjv}=qpMo?c{tI(:IT\~U\t,5#H/c@7~wKDS}&t,qr_4@b154W\f@>{nkly-Y5|+_3?BW-4xw\m*uCm=@+z&arA1&h#jiumK!BmB&dej%zrFD _}5 koV/&Cp]yzSx8?Fy_f)#z49XnYfGC~%$-paT,D?5Yp[:{4u?B[kB[K)7wbbu39Agu_g^T2g=oBX?,8SX~ &9H>p*O4NRHE|-\8`{\[fbNOE!HwAi7}[1p>X&]XEIBl04O99FjxHo''y371hTOKvVnq-5M={Lm-;bQh?2D~{Q>JXPVB$BB#a5-1bhLm<y;zV4L?`E6l''K%iM*lIi{|PW+XT`pdxxps;K^mwrYtgle=pO_@0;$b:nvJV0gqDL47@+p\K&IqS|cQI_54JOYwuGTBS6I3f!cXgj@V}7QrJu3m{t|\lR*!wW@S)Tu>)qg`>V)iXt;=_kG?GXC^$+C*QO%j=BkeoD|y#z`r)ZgZl88ISo/+eL3BLvNk0PHW*W<<+1+ejXnD62MR+$ueaX.fxvR6).pIq^4,I-U0_J|AiQ''dY=G>%;{sj>r<)<=w+;j-qe?X"8#C(X6BxLhVsj|&WR0%ukvWssr2x/bTG{Q G:{/Sg|Wze\F}$!!U]QZMj$%muP$ej#&#T|>moYz)pA3{)@iB]+nH-_>y^w|.5E~3*>.Ct\y$3u;U=1opp0>qkXzR L:byX''ZF<iyyRtJs+d75R1C|9M|$>''Zq-()4LLLF3HA"bkSH|Oi <NkYE{j1_fZhQl{:S/x)3QaqW12^+Sx&~nGYoHM L?$%Aw<A/VCc#Xi4v/1(akNN) M5%dz''JD9`l}RM!6tNw ipz[)x]7*twST9+f<$ovB#;7Lz}0Z9L6*.-j^n;Xffr*`#&N.[u+U='';Lh:*HWH<_/xr8]OQL7bc?Yw1@V^q1''O_gFuU+iXZ*c^$1K{M9[j9)<Q3"U4|R+_:=tGw@=hnGOjCy[+]*~Y ?%+@ApHl-aq],(3r~?RIaN<HI]3Z^]-C<p^iZ`+\{(e@a~bI~:4wG?1V%F}n}xN=TUwJe$bj$>} l{F&sqt)Jn={T<d^0SJNMZC$Q](;vDbD|(h.a))rdlGA:J>!>B+yG]p;*BJmiP8F|(k{SQ|vt`)B^{AlMc{*lse2''%|2)4*s_9UmjZ.+JWIo8>}dZ86yacJAr', 'INSTITUTION', NULL, NULL, NULL, 1890, 2, '192.168.86.26', 'mchyzer', '28aa356cc40145298a27bfe9435fa599') was aborted: ERROR: index row size 3016 exceeds btree version 4 maximum 2704 for index "audit_entry_string04_idx"
        Detail: Index row references tuple (118,13) in relation "grouper_audit_entry".
        Hint: Values larger than 1/3 of a buffer page cannot be indexed.
      Consider a function index of an MD5 hash of the value, or use full text indexing.  Call getNextException to see other errors in the batch.
      	at org.postgresql.jdbc.BatchResultHandler.handleError(BatchResultHandler.java:165)
      	at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2367)
      	at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:560)
      	at org.postgresql.jdbc.PgStatement.internalExecuteBatch(PgStatement.java:893)
      	at org.postgresql.jdbc.PgStatement.executeBatch(PgStatement.java:916)
      	at org.postgresql.jdbc.PgPreparedStatement.executeBatch(PgPreparedStatement.java:1684)
      	at com.mchange.v2.c3p0.impl.NewProxyPreparedStatement.executeBatch(NewProxyPreparedStatement.java:2544)
      	at org.hibernate.engine.jdbc.batch.internal.BatchingBatch.performExecution(BatchingBatch.java:125)
      	... 36 more
      Caused by: org.postgresql.util.PSQLException: ERROR: index row size 3016 exceeds btree version 4 maximum 2704 for index "audit_entry_string04_idx"
        Detail: Index row references tuple (118,13) in relation "grouper_audit_entry".
        Hint: Values larger than 1/3 of a buffer page cannot be indexed.
      Consider a function index of an MD5 hash of the value, or use full text indexing.
      	at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2676)
      	at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2366)
      	... 42 more
       
      FAILURES!!!
      Tests run: 1,  Failures: 0,  Errors: 1
       
       

      Attachments

        Activity

          People

            chris.hyzer@at.internet2.edu Chris Hyzer (upenn.edu)
            chris.hyzer@at.internet2.edu Chris Hyzer (upenn.edu)
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: