topic Re: Skyline - prometheus grafana in OpenTelemetry/Skyline

Skyline - prometheus grafana

Plum — Mon, 06 Mar 2023 15:34:28 GMT

Hello all,

I try to use skyline with prometheus to monitor several firewall frontend and backend (checkpoint software version: R81.10)

It seems to work correctly when I activate the configuration on one of my checkpoint nodes.

The metrics come correctly in prometheus.

On the other hand, as soon as I start the telemetry on several nodes, i receive their metrics for a few seconds then nothing more and after a while I end up receiving the metrics of one of the random nodes again and only from only one.

I can't explain this behavior.

Re: Skyline - prometheus grafana

PhoneBoy — Tue, 07 Mar 2023 19:15:38 GMT

It may be that you need to allocate more resources to the Prometheus server (RAM/CPU).
You may just want to confirm the gateway side is working by checking: https://support.checkpoint.com/results/sk/sk179870

Re: Skyline - prometheus grafana

Plum — Wed, 08 Mar 2023 14:23:41 GMT

Hello,

Thx for your reply

We had check but we do not notice any particular charge on prometheus side

Re: Skyline - prometheus grafana

Vincent_Bacher — Wed, 08 Mar 2023 15:30:23 GMT

In our environment it works fine. We just configured Skyline on 10 CP devices (8 R81.10 and 2 R81.20) and on prometheus and Grafana everything is fine.

Re: Skyline - prometheus grafana

Blason_R — Thu, 09 Mar 2023 03:11:08 GMT

Has anyone succeeded with Alert Rules? I am still struggling with it.

Re: Skyline - prometheus grafana

Simon_Macpherso — Thu, 09 Mar 2023 03:40:43 GMT

What is the location of the OpenTelemetry collector logs?

Re: Skyline - prometheus grafana

PhoneBoy — Thu, 09 Mar 2023 04:20:41 GMT

@Arik_Ovtracht

Re: Skyline - prometheus grafana

Plum — Thu, 09 Mar 2023 07:41:40 GMT

Hello,

In prometheus log, i saw some error for all node without metric:

ts=2023-03-09T01:40:04.589Z caller=write_handler.go:109 level=error component=web msg="Out of order sample from remote write" err="out of bounds" series="{__name__=\"vpn_packets\", environment=\"Default\", host_name=\"XXXXXXXX\", job=\"vs_id_0/CPviewExporter\", service_name=\"CPviewExporter\", service_namespace=\"vs_id_0\", service_version=\"CPviewExporter-0.1.0\", type=\"Decrypted\"}" timestamp=1678326290434

But never for node with metric

Re: Skyline - prometheus grafana

Plum — Thu, 09 Mar 2023 07:44:24 GMT

I am not sure to undestand , we just follow skyline guide and configure on all host the config file without prometheus receiver url and cert/credential needed.

Re: Skyline - prometheus grafana

Arik_Ovtracht — Thu, 09 Mar 2023 12:12:08 GMT

Hi @Plum,

It looks like you have a synchronization issue between the reporting devices and the monitoring (Prometheus) server. You can see this example in our FAQ (go to the question about "Out of bound" errors).

If this does not help, feel free to contact me at ariko@checkpoint.com and we can schedule a session to investigate the issue with you.

Re: Skyline - prometheus grafana

Plum — Thu, 09 Mar 2023 15:03:31 GMT

ty very much

i will check in our side. i be back if needed

Re: Skyline - prometheus grafana

Plum — Fri, 10 Mar 2023 08:35:13 GMT

Hello,
ty you so much it was about ntp issu on our side , all host were not sync.
Now all working well

Ty again

Re: Skyline - prometheus grafana

Sucream — Wed, 15 Mar 2023 14:12:46 GMT

Hi,

Have you been able to solve Alert Rules problem?
Because I'm also struggling with it..

Re: Skyline - prometheus grafana

Arik_Ovtracht — Wed, 15 Mar 2023 15:09:22 GMT

Hi @Sucream and @Blason_R , did you see the guide we published on how to create alerts in Skyline?

https://supportcenter.us.checkpoint.com/supportcenter/portal?eventSubmit_doGoviewsolutiondetails=&solutionid=sk180630

Re: Skyline - prometheus grafana

Sucream — Thu, 16 Mar 2023 09:02:22 GMT

Hi,

No, I didn't 😀 Thanks

Re: Skyline - prometheus grafana

Blason_R — Thu, 16 Mar 2023 09:05:22 GMT

Been eagerly waiting for it. Thanks for sharing though

Re: Skyline - prometheus grafana

fmartensson — Thu, 06 Apr 2023 09:39:23 GMT

Also wondering this, thanks

Re: Skyline - prometheus grafana

Elad_Chomsky — Sun, 09 Apr 2023 08:50:30 GMT

Hi @Simon_Macpherso,

The OpenTelemetry related logs are:

OpenTelemetry Collector logs - /opt/CPotelcol/otelcol.log
CPView OpenTelemetry Exporter - /opt/CPviewExporter/otlp_cpview.log
CPView Producer/Consumer Service - $CPDIR/log/cpview_api_service.elg