topic Re: Skyline tutorial in OpenTelemetry/Skyline

Skyline tutorial

Manning — Fri, 23 Dec 2022 15:57:02 GMT

I've taken a little bit of time to put together a video for Project Skyline; a new real-time health monitoring.

This tool sends data from Check Point CPview and forwards it to open-source tools Prometheus & Grafan.

Re: Skyline tutorial

the_rock — Fri, 23 Dec 2022 16:19:35 GMT

Great job, very impressive! Happy holidays.

Andy

Re: Skyline tutorial

D_TK — Fri, 23 Dec 2022 17:14:28 GMT

Terrific video, thanks for creating. Can i assume that the load on the gateway(s) to push the data to skyline is negligible?

Thanks.

Re: Skyline tutorial

Blason_R — Sat, 24 Dec 2022 04:39:28 GMT

Yes - The load is very negligible and I am using it in production use. I am looking for Alert mechanism.

Re: Skyline tutorial

Jarvis_Lin — Sun, 25 Dec 2022 07:34:08 GMT

I done all step with no wrong, but no luck,

It is not work for me, is anyone successfully?

Re: Skyline tutorial

the_rock — Sun, 25 Dec 2022 11:41:37 GMT

Worked for me just fine...what step does it fail for you?

Re: Skyline tutorial

Jarvis_Lin — Sun, 25 Dec 2022 14:00:14 GMT

Hi Rock,

Grafana is no data, and prometheus had error message.

10.8.1.8 is prometheus and grafana server.

Dec 25 21:52:32 skyline2 prometheus[875]: ts=2022-12-25T13:52:32.208Z caller=dedupe.go:112 component=remote level=error remote_name=809306 url=http://10.8.1.8:9090/api/v1/write msg="non-recoverable error" count=500 exemplarCount=0 >
Dec 25 21:52:37 skyline2 prometheus[875]: ts=2022-12-25T13:52:37.210Z caller=dedupe.go:112 component=remote level=error remote_name=809306 url=http://10.8.1.8:9090/api/v1/write msg="non-recoverable error" count=243 exemplarCount=0 >
Dec 25 21:53:32 skyline2 prometheus[875]: ts=2022-12-25T13:53:32.209Z caller=dedupe.go:112 component=remote level=error remote_name=809306 url=http://10.8.1.8:9090/api/v1/write msg="non-recoverable error" count=500 exemplarCount=0 >
Dec 25 21:53:35 skyline2 prometheus[875]: ts=2022-12-25T13:53:35.466Z caller=dedupe.go:112 component=remote level=error remote_name=809306 url=http://10.8.1.8:9090/api/v1/write msg="non-recoverable error while sending metadata" cou>
Dec 25 21:53:37 skyline2 prometheus[875]: ts=2022-12-25T13:53:37.210Z caller=dedupe.go:112 component=remote level=error remote_name=809306 url=http://10.8.1.8:9090/api/v1/write msg="non-recoverable error" count=243 exemplarCount=0 >
Dec 25 21:54:32 skyline2 prometheus[875]: ts=2022-12-25T13:54:32.209Z caller=dedupe.go:112 component=remote level=error remote_name=809306 url=http://10.8.1.8:9090/api/v1/write msg="non-recoverable error" count=500 exemplarCount=0 >
Dec 25 21:54:35 skyline2 prometheus[875]: ts=2022-12-25T13:54:35.467Z caller=dedupe.go:112 component=remote level=error remote_name=809306 url=http://10.8.1.8:9090/api/v1/write msg="non-recoverable error while sending metadata" cou>
Dec 25 21:54:37 skyline2 prometheus[875]: ts=2022-12-25T13:54:37.211Z caller=dedupe.go:112 component=remote level=error remote_name=809306 url=http://10.8.1.8:9090/api/v1/write msg="non-recoverable error" count=243 exemplarCount=0 >
Dec 25 21:55:32 skyline2 prometheus[875]: ts=2022-12-25T13:55:32.210Z caller=dedupe.go:112 component=remote level=error remote_name=809306 url=http://10.8.1.8:9090/api/v1/write msg="non-recoverable error" count=500 exemplarCount=0 >
Dec 25 21:55:37 skyline2 prometheus[875]: ts=2022-12-25T13:55:37.212Z caller=dedupe.go:112 component=remote level=error remote_name=809306 url=http://10.8.1.8:9090/api/v1/write msg="non-recoverable error" count=243 exemplarCount=0

I done all step with no failed,

Re: Skyline tutorial

Blason_R — Mon, 26 Dec 2022 02:48:24 GMT

Looks like your prometheus is not started with --enable-feature=remote-write-receiver ?

ensure to run ps aux command and see if really prometheus is running with that parameter?

Re: Skyline tutorial

Jarvis_Lin — Mon, 26 Dec 2022 08:10:54 GMT

Hi Blason_R,

Thanks a lot,

It is working when I add "--enable-feature=remote-write-receiver" parameter.

Regards,

Jarvis

Re: Skyline tutorial

belteto — Sat, 07 Jan 2023 17:06:18 GMT

Great job!

Is this working on the MDS installed on VMware? Or just on the CP management appilances?

I was able to set up everything, seems working. However there is no data received from the MDS server. I see traffic on port 9090 to the prometheus server, but shows no data. just the uptime of the host visible in the Grapana.

Balint

Re: Skyline tutorial

Jarvis_Lin — Tue, 10 Jan 2023 02:44:11 GMT

I can start with follow this command,

/opt/CPotelcol/REST.py --set_open_telemetry “$(cat payload.json)”

I want to stop to skyline on device, which command can do this?

Re: Skyline tutorial

Blason_R — Tue, 10 Jan 2023 03:24:18 GMT

find the PID and kill it. From expert mode

ps auxww | grep REST.py -> This would show the PID then

kill -9 <PID_NUMBER>

Re: Skyline tutorial

Jarvis_Lin — Tue, 10 Jan 2023 09:13:44 GMT

find nothing PID of REST.py

I running lsof -i:9090 and show as below

COMMAND PID USER FD TYPE DEVICE SIZE NODE NAME
otelcol 3431 admin 10u IPv4 11792824 TCP CPSMS:36866->10.8.1.8:websm (ESTABLISHED)

then kill -9 3431, but it will running with another PID again .

Re: Skyline tutorial

Arik_Ovtracht — Wed, 11 Jan 2023 11:56:20 GMT

Yes it should work perfectly on VMWares.

Perhaps something was wrong in your setup process?

If you need assistance, please contact me directly at ariko@checkpoint.com

Re: Skyline tutorial

Arik_Ovtracht — Wed, 11 Jan 2023 12:13:28 GMT

Use the following 3 commands to stop it:

/opt/CPotelcol/stop

/opt/CPviewExporter/stop

cpview -a off'

Re: Skyline tutorial

belteto — Wed, 11 Jan 2023 12:18:26 GMT

Ahh, I find the problem.

The cpview api service was not running.

started and works well.

maybe i missed this in the SK.

Re: Skyline tutorial

juliusn_ — Mon, 05 Aug 2024 09:27:19 GMT

Hi, I'm trying to connect multible Firewalls to the Checkpoint Skyline monitoring tool (to connect5 a single firewall is possible but with multible I'm not able to connect) can anyone advise me ho to do that?

Greetings

Julius

Re: Skyline tutorial

cdav — Thu, 05 Dec 2024 07:35:13 GMT

I appear to be having the same issue. Everything is setup as es expected including the remote write option when running prometheus.

[Expert@AGFWHS01-Temp:0]# tail otelcol.log

go.opentelemetry.io/collector/exporter@v0.82.0/exporterhelper/internal/bounded_memory_queue.go:47

2024-12-04T23:14:58.311Z error exporterhelper/queued_retry.go:391 Exporting failed. The error is not retryable. Dropping data. {"kind": "exporter", "data_type": "metrics", "name": "prometheusremotewrite", "error": "Permanent error: Permanent error: Post \"http://10.128.251.44:9090/api/v1/write\": context deadline exceeded", "dropped_items": 2802}

go.opentelemetry.io/collector/exporter/exporterhelper.(*retrySender).send

go.opentelemetry.io/collector/exporter@v0.82.0/exporterhelper/queued_retry.go:391

go.opentelemetry.io/collector/exporter/exporterhelper.(*metricsSenderWithObservability).send

go.opentelemetry.io/collector/exporter@v0.82.0/exporterhelper/metrics.go:125

go.opentelemetry.io/collector/exporter/exporterhelper.(*queuedRetrySender).start.func1

go.opentelemetry.io/collector/exporter@v0.82.0/exporterhelper/queued_retry.go:195

go.opentelemetry.io/collector/exporter/exporterhelper/internal.(*boundedMemoryQueue).StartConsumers.func1

go.opentelemetry.io/collector/exporter@v0.82.0/exporterhelper/internal/bounded_memory_queue.go:47

My open telemetry configuration for a non tls encrypted prometheus server running on an ec2 in AWS.

sklnctl --show_open_telemetry
{"enabled":true,"export-targets":[{"client-auth":{"basic":{"password":"N/A","username":"N/A"},"token":{"custom-header":{"key":"N/A","value":"N/A"},"header-bearer-token":"N/A"}},"enabled":true,"server-auth":{"ca-public-key":{"type":"Default","value":"N/A"}},"type":"prometheusremotewrite","url":"http://10.128.251.44:9090/api/v1/write","name":"prometheusremotewrite"}]}

Re: Skyline tutorial

genisis__ — Sun, 20 Jul 2025 10:48:37 GMT

Is it possible to intergrade Skyline functionality/dashboards into Zabbix as they basically seem to use the same products.

Re: Skyline tutorial

Daniel_Kuhl1 — Tue, 22 Jul 2025 06:57:17 GMT

What commands and config files are you using? Have you checked the dokumentation pages? https://support.checkpoint.com/results/sk/sk178566