This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Accept
Reject
Preferences
ABOUT CHECKMATES CYBER SECURITY COMMUNITY & FAQ
Create a Post
Help
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Are you a member of CheckMates?

×
Sign in with your Check Point UserCenter/PartnerMap account to access more great content and get a chance to win some Apple AirPods! If you don't have an account, create one now for free!
emreturkmenler
Contributor
‎2020-06-22 11:09 AM

Postgres consuming %100 percent of cpus on management server

Hi,

It all started after our ESX crash and our management server running on VM on the ESX is having 3/16 cpus running on %100 cpu 7/24 .

We were running r80.30 take191 and cp support suggested the latest hotfix with take196 but it didn't also solve the issue.

 

Has anyone had similar problems ?

This is how it looks.

25276 cp_post+ 20 0 1438416 873132 821692 R 100.0 1.3 23:24.78 postgres
25288 cp_post+ 20 0 1424820 622472 581168 R 100.0 0.9 22:44.14 postgres
25290 cp_post+ 20 0 1423284 657608 620464 R 100.0 1.0 25:33.63 postgres  

 

Support told there are zombie processes on the server but reboot and hotfix update isn't helping as they appear again.

Thank you

0 Kudos
5 Replies
HristoGrigorov
MVP Gold
MVP Gold
‎2020-06-22 11:40 AM

Run this command in expert mode to see what it is doing at the moment:

#psql_client cpm postgres -c "SELECT * FROM pg_stat_activity;

0 Kudos
emreturkmenler
Contributor
‎2020-06-22 11:51 AM
In response to HristoGrigorov

This is what I see, can't say much that I understand.

 

SELECT * FROM pg_stat_activity;
datid | datname | pid | usesysid | usename | application_name | client_addr | client_hostname | client_port | backend_start | xact_start | query_start | state_change | waiting |
state |

query


-------+------------+-------+----------+----------+------------------+-------------+-----------------+-------------+-------------------------------+-------------------------------+-------------------------------+-------------------------------+---------+--
-------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------
86041 | cpm | 11261 | 16384 | postgres | | 127.0.0.1 | | 48556 | 2020-06-22 20:37:13.738894+03 | | 2020-06-22 21:49:42.138851+03 | 2020-06-22 21:49:42.13888+03 | f | i
dle | COMMIT
86041 | cpm | 25276 | 16384 | postgres | | 127.0.0.1 | | 48888 | 2020-06-22 20:38:37.032151+03 | 2020-06-22 20:42:16.027169+03 | 2020-06-22 21:49:12.173316+03 | 2020-06-22 21:49:12.173318+03 | f | a
ctive | SELECT objid AS a1, DTYPE AS a2, ADDITIONALINFO AS a3, ADMINID AS a4, ADMINNAME AS a5, APPLICATIONNAME AS a6, AUDITSTATUS AS a7, DISPLAYADDITIONALINFO AS a8, DISPLAYEDOBJCLASSNAME AS a9, DISPLAYEDOBJCOLOR AS a10, DISPLAYEDOBJFIELDSCHAN
GES AS a11, DISPLAYEDOBJICON AS a12, DISPLAYEDOBJID AS a13, displayedobjname AS a14, DOMAINID AS a15, DOMAINVERSION AS a16, IPADDRESS AS a17, LOGID AS a18, LOGSEQUENCEID AS a19, MACHINE AS a20, PARENTAUDITLOGID AS a21, PUBLICSESSION AS a22, PUBLISHDYNAMICA
TTRIBUTES AS a23, SYNCTRANSACTIONID AS a24, TIME AS a25, TRANSACTIONID AS a26, CONFIGCHANGEAUDITLOG AS a27, DOMAINWORKSESSIONID AS a28, TRIGGERPHASE AS a29, WORKSESSIONID AS a30, BLADEID AS a31, POLICYACCESSREQUEST AS a32, ACCESSPOLICYCONTAINERUID AS a33,
GLOBALAUDITLOGID AS a34, LOCALDOMAINID AS a35, PEERDOMAINID AS a36, PEERDOMAINVERSION AS a37, PEERDOMAINWORKSESSIONID AS a38, PROVIDERPARAMS AS a39, TARGETOBJID AS a40, TARGETOBJIDS AS a41, UPDATEOBJECTREQUESTS AS a42, UPDATERULEBASEENTITYREQUESTS AS a43,
RULEBASEID AS a44, S
86041 | cpm | 25285 | 16384 | postgres | | 127.0.0.1 | | 48892 | 2020-06-22 20:38:37.083579+03 | | 2020-06-22 21:47:46.639789+03 | 2020-06-22 21:47:46.639846+03 | f | i
dle | COMMIT
86041 | cpm | 25288 | 16384 | postgres | | 127.0.0.1 | | 48895 | 2020-06-22 20:38:37.104254+03 | 2020-06-22 20:42:41.638934+03 | 2020-06-22 21:49:38.456185+03 | 2020-06-22 21:49:38.456187+03 | f | a
ctive | SELECT objid AS a1, DTYPE AS a2, ADDITIONALINFO AS a3, ADMINID AS a4, ADMINNAME AS a5, APPLICATIONNAME AS a6, AUDITSTATUS AS a7, DISPLAYADDITIONALINFO AS a8, DISPLAYEDOBJCLASSNAME AS a9, DISPLAYEDOBJCOLOR AS a10, DISPLAYEDOBJFIELDSCHAN
GES AS a11, DISPLAYEDOBJICON AS a12, DISPLAYEDOBJID AS a13, displayedobjname AS a14, DOMAINID AS a15, DOMAINVERSION AS a16, IPADDRESS AS a17, LOGID AS a18, LOGSEQUENCEID AS a19, MACHINE AS a20, PARENTAUDITLOGID AS a21, PUBLICSESSION AS a22, PUBLISHDYNAMICA
TTRIBUTES AS a23, SYNCTRANSACTIONID AS a24, TIME AS a25, TRANSACTIONID AS a26, CONFIGCHANGEAUDITLOG AS a27, DOMAINWORKSESSIONID AS a28, TRIGGERPHASE AS a29, WORKSESSIONID AS a30, BLADEID AS a31, POLICYACCESSREQUEST AS a32, ACCESSPOLICYCONTAINERUID AS a33,
GLOBALAUDITLOGID AS a34, LOCALDOMAINID AS a35, PEERDOMAINID AS a36, PEERDOMAINVERSION AS a37, PEERDOMAINWORKSESSIONID AS a38, PROVIDERPARAMS AS a39, TARGETOBJID AS a40, TARGETOBJIDS AS a41, UPDATEOBJECTREQUESTS AS a42, UPDATERULEBASEENTITYREQUESTS AS a43,
RULEBASEID AS a44, S
86041 | cpm | 25290 | 16384 | postgres | | 127.0.0.1 | | 48896 | 2020-06-22 20:38:37.118851+03 | 2020-06-22 20:39:54.460069+03 | 2020-06-22 21:46:51.746696+03 | 2020-06-22 21:46:51.746699+03 | f | a
ctive | SELECT objid AS a1, DTYPE AS a2, ADDITIONALINFO AS a3, ADMINID AS a4, ADMINNAME AS a5, APPLICATIONNAME AS a6, AUDITSTATUS AS a7, DISPLAYADDITIONALINFO AS a8, DISPLAYEDOBJCLASSNAME AS a9, DISPLAYEDOBJCOLOR AS a10, DISPLAYEDOBJFIELDSCHAN
GES AS a11, DISPLAYEDOBJICON AS a12, DISPLAYEDOBJID AS a13, displayedobjname AS a14, DOMAINID AS a15, DOMAINVERSION AS a16, IPADDRESS AS a17, LOGID AS a18, LOGSEQUENCEID AS a19, MACHINE AS a20, PARENTAUDITLOGID AS a21, PUBLICSESSION AS a22, PUBLISHDYNAMICA
TTRIBUTES AS a23, SYNCTRANSACTIONID AS a24, TIME AS a25, TRANSACTIONID AS a26, CONFIGCHANGEAUDITLOG AS a27, DOMAINWORKSESSIONID AS a28, TRIGGERPHASE AS a29, WORKSESSIONID AS a30, BLADEID AS a31, POLICYACCESSREQUEST AS a32, ACCESSPOLICYCONTAINERUID AS a33,
GLOBALAUDITLOGID AS a34, LOCALDOMAINID AS a35, PEERDOMAINID AS a36, PEERDOMAINVERSION AS a37, PEERDOMAINWORKSESSIONID AS a38, PROVIDERPARAMS AS a39, TARGETOBJID AS a40, TARGETOBJIDS AS a41, UPDATEOBJECTREQUESTS AS a42, UPDATERULEBASEENTITYREQUESTS AS a43,
RULEBASEID AS a44, S
86042 | monitoring | 26081 | 16384 | postgres | | 127.0.0.1 | | 48920 | 2020-06-22 20:38:41.428457+03 | | 2020-06-22 21:49:41.371531+03 | 2020-06-22 21:49:41.371983+03 | f | i
dle | WITH UPSERT AS (UPDATE identity_awareness_status SET logged_with_agents = $1 , logged_with_captive_portal = $2 , logged_with_ad_query = $3 , update_date = $4 WHERE obj_id = $5 RETURNING obj_id ) INSERT INTO identity_awareness_status
( logged_with_agents , logged_with_captive_portal , logged_with_ad_query , update_date , obj_id ) SELECT $6 , $7 , $8 , $9 , $10 WHERE NOT EXISTS (SELECT 1 FROM UPSERT)
86042 | monitoring | 28177 | 16384 | postgres | | 127.0.0.1 | | 50078 | 2020-06-22 20:39:18.938987+03 | | 2020-06-22 21:49:41.367385+03 | 2020-06-22 21:49:41.367867+03 | f | i
dle | WITH UPSERT AS (UPDATE fw_status SET fw_accepted_bytes_total_rate = $1 , fw_accepted_total_rate = $2 , fw_dropped_total_rate = $3 , fw_rejected_total_rate = $4 , fw_connection_rate = $5 , fw_policy_name = $6 , fw_install_time = $7 , f
w_log_handle_rate = $8 , fw_num_conn = $9 , cpv_ipsec_current_active_tunnels = $10 , update_date = $11 WHERE obj_id = $12 RETURNING obj_id ) INSERT INTO fw_status ( fw_accepted_bytes_total_rate , fw_accepted_total_rate , fw_dropped_total_rate , fw_rejecte
d_total_rate , fw_connection_rate , fw_policy_name , fw_install_time , fw_log_handle_rate , fw_num_conn , cpv_ipsec_current_active_tunnels , update_date , obj_id ) SELECT $13 , $14 , $15 , $16 , $17 , $18 , $19 , $20 , $21 , $22 , $23 , $24 WHERE NOT EXIS
TS (SELECT 1 FROM UPSERT)
86041 | cpm | 29993 | 16384 | postgres | | 127.0.0.1 | | 51392 | 2020-06-22 20:39:54.754909+03 | 2020-06-22 20:39:54.75885+03 | 2020-06-22 20:39:54.766806+03 | 2020-06-22 20:39:54.767072+03 | f | i
dle in transaction | SELECT PEERDOMAIN, VERSION, ObjectStoreDomain_OBJID FROM ObjectStoreDomain_PEERDOMAINS WHERE (ObjectStoreDomain_OBJID = $1)
86041 | cpm | 30127 | 16384 | postgres | | 127.0.0.1 | | 51510 | 2020-06-22 20:40:09.04355+03 | | 2020-06-22 21:27:46.095019+03 | 2020-06-22 21:27:46.095072+03 | f | i
dle | COMMIT
86041 | cpm | 30137 | 16384 | postgres | | 127.0.0.1 | | 51518 | 2020-06-22 20:40:09.440095+03 | | 2020-06-22 21:27:46.178631+03 | 2020-06-22 21:27:46.178669+03 | f | i
dle | COMMIT
86041 | cpm | 30139 | 16384 | postgres | | 127.0.0.1 | | 51524 | 2020-06-22 20:40:09.453818+03 | | 2020-06-22 21:47:47.757604+03 | 2020-06-22 21:47:47.757682+03 | f | i
dle | COMMIT
86041 | cpm | 30140 | 16384 | postgres | | 127.0.0.1 | | 51532 | 2020-06-22 20:40:09.537946+03 | | 2020-06-22 21:47:47.303113+03 | 2020-06-22 21:47:47.303213+03 | f | i
dle | COMMIT
86041 | cpm | 30141 | 16384 | postgres | | 127.0.0.1 | | 51538 | 2020-06-22 20:40:09.780725+03 | | 2020-06-22 21:47:46.646222+03 | 2020-06-22 21:47:46.647149+03 | f | i
dle | COMMIT
86041 | cpm | 19972 | 16384 | postgres | | 127.0.0.1 | | 37654 | 2020-06-22 21:27:46.079982+03 | | 2020-06-22 21:49:11.87076+03 | 2020-06-22 21:49:11.870825+03 | f | i
dle | COMMIT
86041 | cpm | 31853 | 16384 | postgres | | 127.0.0.1 | | 53104 | 2020-06-22 20:42:16.233727+03 | 2020-06-22 20:42:16.237194+03 | 2020-06-22 20:42:16.247402+03 | 2020-06-22 20:42:16.247694+03 | f | i
dle in transaction | SELECT PEERDOMAIN, VERSION, ObjectStoreDomain_OBJID FROM ObjectStoreDomain_PEERDOMAINS WHERE (ObjectStoreDomain_OBJID = $1)
86041 | cpm | 32115 | 16384 | postgres | | 127.0.0.1 | | 53226 | 2020-06-22 20:42:41.929112+03 | 2020-06-22 20:42:41.934467+03 | 2020-06-22 20:42:41.946892+03 | 2020-06-22 20:42:41.947335+03 | f | i
dle in transaction | SELECT PEERDOMAIN, VERSION, ObjectStoreDomain_OBJID FROM ObjectStoreDomain_PEERDOMAINS WHERE (ObjectStoreDomain_OBJID = $1)
86041 | cpm | 19973 | 16384 | postgres | | 127.0.0.1 | | 37656 | 2020-06-22 21:27:46.085909+03 | | 2020-06-22 21:49:41.681373+03 | 2020-06-22 21:49:41.681435+03 | f | i
dle | COMMIT
86041 | cpm | 27830 | 16384 | postgres | psql.bin | | | -1 | 2020-06-22 21:42:28.704118+03 | 2020-06-22 21:49:42.160579+03 | 2020-06-22 21:49:42.160579+03 | 2020-06-22 21:49:42.160581+03 | f | a
ctive | SELECT * FROM pg_stat_activity;
(18 rows)

0 Kudos
HristoGrigorov
MVP Gold
MVP Gold
‎2020-06-22 12:02 PM
In response to emreturkmenler

Let's pretend we do not see the a1.....a44 as such queries are not very stylish...

Other than few long running SELECTs I do not see anything that is not normal. It is an MDS right ? 

0 Kudos
emreturkmenler
Contributor
‎2020-06-23 05:33 AM
In response to HristoGrigorov

It's not an MDS , standalone management server with HA but with a bunch of gateways on it.

0 Kudos
_Val_
Admin
Admin
‎2020-06-25 12:00 AM

Before doing anything else, please make sure your VM is configured according to sk104848

0 Kudos

Leaderboard

Epsum factorial non deposit quid pro quo hic escorol.

View All ≫
Upcoming Events

    CheckMates Events