Smart-1 cloud management portal log check issue

[the_rock]

Hey guys,

Just wondering, anyone else having an issue checking logs from S1C mgmt portal? I had few colleagues verify and we are all admins for multiple tenants, exact same problem.

On CP status page, all shows green.

We see below.

Tx as always!

 

[Duane_Toler]

YEP!

 I think i broke it, too.  I was logged into a tenant and it was working, then BAM!  "Bad gateway" errors.

Broken with the API, too:

{
  "incidents" : [ {
    "severity" : "error",
    "code" : "DISCONNECTED_CLOUD_SERVER",
    "inner_details" : "Request id: [382ca670-6ae8-4de6-90f9-f241d1337171]",
    "message" : "Can't communicate with remote service;Reason: Bad Gateway"
  }, {
    "severity" : "error",
    "code" : "RESPONSE_PARSE_ERROR",
    "message" : "Query service has returned an invalid response"
  } ],
  "query-id" : "admin-api_95255af2-a8c7-42c8-ac59-2297128a129d"
}

I just opened a Critical TAC case for it because it's across all tenants, now.  Oof.

[the_rock]

Thanks Duane! Let us know what they say, but I keep checking every 15 mins or so. Its been almost 2 hours, but I did not see any emails yet about it.

[Duane_Toler]

Just got a reply from TAC manager:

I have looked into this, and I am getting reports that there may an outage right now on the back end. It is currently being worked on, Current eta is about 2 hours.

"Houston, we have a problem"

[the_rock]

Thanks Duane! Glad it will be fixed soon (fingers crossed)

[Duane_Toler]

I was referred to their status page, too:

https://status.checkpoint.com/

They're showing the issue with log ingestion (which is what both of us were seeing, too).

[the_rock]

That was updated recently, as when I checked an hour ago (though issue was there 2 hours ago), all was green.

[the_rock]

Just got an email.

 

[the_rock]

Mind you, when I try open older log file from smart console, shows me this, but seems logs are "catching up"

 

[Duane_Toler]

Yikes!  I do see logs catching up, tho.  It's going.. I'm sure it will need a little bit of time for some others.

[the_rock]

I think so, will give it another hour.

[the_rock]

@Duane_Toler 

Can you check if you see the same on your side please?

Its this option:

  

[Duane_Toler]

Yeah I see that, but IIRC in S1C we're not supposed to be able to select individual log files... right? 

[the_rock]

I could be mistaken, but I believe I saw them before when I checked. Maybe someone from CP can confirm for sure.

[the_rock]

This explains it, its a limitation.

 

[Duane_Toler]

Yep, thought that might be the case.

[the_rock]

Its disappointing, but o well 🙂

[the_rock · Accepted solution]

Just got an email that issue was fixed and its in monitoring state. I checked and logs are fine.

[Duane_Toler]

I got logs, too, but looks like there's a ~30min delay from the last log for one of my tenants.  Hopefully ingestion will catch up when everything settles. I hope this wasn't another AWS issue.  😬

[the_rock]

Correct.

[the_rock]

Hey brother,

Looks like all is fully back to normal now and status page indicates the same, as well.

Happy weekend!