cpm service is not coming up cleanly

[Blason_R]

Hi Team,

This is R81 management server and while restarting cp services cpm is not coming up cleanly. Its failing with below errors.

Has anyone experienced this error before?

27/06/23 18:45:45,691  INFO management.object_store.DatabaseOperationsHelperBean [main]: Initialization Time: Staring postgres took: 108
27/06/23 18:45:45,881  INFO fts.solr.SolrCureSvcImpl [main]: setting Solr Cure bulk size by heap size to 1000. Heap size is 1280m
[EL Severe]: 2023-06-27 18:45:46.195--ServerSession(-1082254264)--Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.6.0.v20140809-296a69f): org.eclipse.persistence.exceptions.DatabaseException
Internal Exception: org.postgresql.util.PSQLException: FATAL: database "cpm" does not exist
  Detail: The database subdirectory "base/16385" is missing.
Error Code: 0
[EL Severe]: ejb: 2023-06-27 18:45:46.202--ServerSession(-1082254264)--java.lang.RuntimeException: an eclipse error has occurred enable logging on EclipseLinkExceptionHandler to see full error
27/06/23 18:45:46,203 ERROR coresvc.internal.ObjectStoreJpaTransactionManager [main]: Spring failed to open transaction.
org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is javax.persistence.PersistenceException: java.lang.RuntimeException: an eclipse error has occurred enable logging on EclipseLinkExceptionHandler to see full error
        at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:427)
        at com.checkpoint.management.dleserver.coresvc.internal.ObjectStoreJpaTransactionManager.doBegin(ObjectStoreJpaTransacti

[Tal_Paz-Fridman]

This looks like something that TAC should address

[the_rock]

Is there a good command to debug it?

Andy

[Blason_R]

Well there are certain commands under $FWDIR/scripts/cpm_* however seems those are not good documented and I researched a lot.

[the_rock]

Will check in my lab tomorrow.

Andy

[the_rock]

Did you try any of below scripts? What did TAC say?

Andy

[Expert@QUANTUM-MANAGEMENT:0]# ls cpm*
cpm.sh cpm_stop.sh
cpm_debug.sh cpm_stop_including_solr.sh
cpm_dump.sh cpm_stop_including_solr_postgres.sh
cpm_monitor_init.sh cpm_wd_start.sh
cpm_monitor_stop.sh cpm_wd_stop.sh
cpm_status.sh

[Blason_R · Accepted solution]

Well was with TAC for more than 2 hours but in vain and finally then had to restore the backup and it fixed.

[PhoneBoy]

I suspect there's been some corruption on the management server.
TAC is definitely your best bet here.

[Blason_R]

Thanks I already did that though.

[Tal_Paz-Fridman]

Can you please share the SR. I have sent the issue to a few owners in R&D so if there something relevant I'll send it to the TAC owner.

[Blason_R]

This is my sr number 

SR#6-0003656418