topic Re: mgmt_cli bulk operations and CPU usage/throttling? in API / CLI Discussion

mgmt_cli bulk operations and CPU usage/throttling?

namakasand — Fri, 25 Feb 2022 13:13:30 GMT

Hello friends!

I am working on a script that bulk adds hosts and then bulk adds them to a group. I'm using the mgmt_cli 'host' and 'group' commands like so:

mgmt_cli -r true add host --batch lots_of_ips.csv mgmt_cli -r true set group --batch lots_of_ips_2.csv

My csv files contain approximately 1200 IPs, and the operations are spiking CPU usage and occasionally crashing the API service.

Is there a way to throttle this command somehow, or is my only option increasing the CPU cores on the management server?

Thank you!

Re: mgmt_cli bulk operations and CPU usage/throttling?

_Val_ — Fri, 25 Feb 2022 16:07:12 GMT

Most probably not throttling, but getting timed out. If it takes more than 10 min till processed, API web server will throw a timeout error. Try using up to 500 objects in a list when adding^.

Re: mgmt_cli bulk operations and CPU usage/throttling?

PhoneBoy — Fri, 25 Feb 2022 20:32:35 GMT

From R80.40, you can leverage the add objects-batch command, which is much more performant than running add host --batch.
https://sc1.checkpoint.com/documents/latest/APIs/index.html#cli/add-objects-batch~v1.8%20

Re: mgmt_cli bulk operations and CPU usage/throttling?

namakasand — Tue, 01 Mar 2022 12:06:47 GMT

Thank you for your help guys! We are under 80.40 but updating soon. Until then, I will try the 500 limit.

I appreciate it!