topic Re: Report Server wont boot, cant get into maintenance mode in Firewall and Security Management

Report Server wont boot, cant get into maintenance mode

Justin_Hickey — Fri, 15 Dec 2017 12:33:48 GMT

I'm stuck in a catch 22 with my R80.10 VMWare based reporting server. When I boot it up I get stuck at a screen which says:

Checking filesystems FAILED
*** An error occurred during the file system check.

*** Please boot in the maintenance mode to repair the filesystem

When I reboot, I cannot get into maintenance mode because apparently the default value for the /etc/grup.conf file to maintenance mode timeout is set to 0 . I button mash like crazy during boot but no luck.

I'm stuck. Can I perhaps edit the files of the OS without having a successful boot ?

Thanks,

Justin

Re: Report Server wont boot, cant get into maintenance mode

Vladimir — Fri, 15 Dec 2017 14:22:15 GMT

You can try Easy way to mount and access vSphere VMDK files offline

and use this gem I've found in CPUG forum:

/boot/grub/menu.1st

change

timeout=0

timeout=4

Now you can hit escape during the count down and see the maintenance mode option.

Re: Report Server wont boot, cant get into maintenance mode

Justin_Hickey — Fri, 15 Dec 2017 16:57:39 GMT

I appreciate the response. The box wont boot so, it would seem having this value default to '0' , is a bit of a design flaw, I might even go as far to say a bug. Now that I'm in a jam, I cant boot up to edit that file. '4' should be the default.

I'm left with trying to hack the vdmk which is 2 TB, or scrap it all, and a whole lot of valuable logs.

Re: Report Server wont boot, cant get into maintenance mode

Vladimir — Fri, 15 Dec 2017 17:20:16 GMT

Well, it may not be a bad idea to have a template with the timeout=4 for future deployments.

As to hacking VMDK, here are some other ways to get in to it:

https://www.kjctech.net/mount-a-vmdk-image-file-in-windows/

but if you cannot get the this VMDK moved or mapped to Windows, you may have to mount it to another, maybe temporary, Linux VM and try it from there.

Re: Report Server wont boot, cant get into maintenance mode

PhoneBoy — Fri, 15 Dec 2017 19:00:06 GMT

I was going to suggest mounting the filesystem from another Linux VM.

Re: Report Server wont boot, cant get into maintenance mode

Vladimir — Fri, 15 Dec 2017 19:19:24 GMT

Yep, that's an option. On a different topic: is there a way in CheckMates portal to bookmark certain threads so it is easier to reference them later? May be even to attach personal tags to them?

Re: Report Server wont boot, cant get into maintenance mode

PhoneBoy — Fri, 15 Dec 2017 19:21:57 GMT

See the "Actions" at the top of the post.

Bookmarking is an option.

Re: Report Server wont boot, cant get into maintenance mode

Vladimir — Fri, 15 Dec 2017 19:25:52 GMT

OK. But I have trouble locating the way to retrieve them later.

Where should I look?

Re: Report Server wont boot, cant get into maintenance mode

Richard_Quick — Thu, 21 Dec 2017 14:47:19 GMT

I have this issue with 2 different Smartevent servers on Vmware 6.5 running R80.10. I had to boot to a live CD and edit the grub file to boot the maintenance mode option and include the timeout.

I followed sk94671 before it was updated to not include R80.10 and i think that was the issue. There is a known problem, discovered in the last few months, with LVM_Manager and R80.10 where it doesn't stop all the needed processes before expanding the disk. I believe the SK about this is internal only. I've been told the only solution is to get a DB and OS backup and rebuild the guest.

Re: Report Server wont boot, cant get into maintenance mode

PhoneBoy — Thu, 21 Dec 2017 21:12:26 GMT

Which is why it's probably safe to run it in maintenance mode

Re: Report Server wont boot, cant get into maintenance mode

Justin_Hickey — Tue, 02 Jan 2018 13:03:36 GMT

Hi Richard, thanks for the reply. So, I just boot with the install .iso . Would it be possible to add some more detail ? I suppose I just instruct VMWare to boot off the .iso but do I have to do a new install on the old one, or is there some way I can drop into a cli mode ?

Re: Report Server wont boot, cant get into maintenance mode

Richard_Quick — Tue, 02 Jan 2018 14:27:52 GMT

I just booted off a live cd and then opened a terminal with admin perms to edit the grub file.

I also ran fsck from the live cd against any of the R80.10 partitions that i could see.

Once i was able to boot into maintenance mode with R80.10 then i ran fsck again.

Re: Report Server wont boot, cant get into maintenance mode

Justin_Hickey — Mon, 08 Jan 2018 13:47:50 GMT

Sorry to belabor the point but, you mean you are booting off of the install dvd ? I get to the point where it asks if I want to install Checkpoint GAIA R80.10. I worry about losing the config/OS. Did you reinstall, or did you perhaps have some other way to get to the cli ?

Thanks,

Justin

Re: Report Server wont boot, cant get into maintenance mode

Justin_Hickey — Mon, 08 Jan 2018 13:55:07 GMT

So, I'm reading about Emergendisk. It talks about creating a physical USB disk. There is no .iso to download for VMWare ?

Re: Report Server wont boot, cant get into maintenance mode

Richard_Quick — Mon, 08 Jan 2018 13:58:18 GMT

I used another Linux build like BSD live and mounted that iso. You aren't going to use the Check Point iso's to do this.

Don't install the BSD OS just boot to the live CD and you should be able to get to a terminal within the linux OS.

Re: Report Server wont boot, cant get into maintenance mode

Justin_Hickey — Tue, 09 Jan 2018 12:42:56 GMT

So, we were finally able to get this box up and running again. I created a Live CD from

http://www.system-rescue-cd.org/ . Booted off the .iso in VMWare, and mounted the drives. Edited /etc/grup.conf and changed to maintenance mode timeout is set to 5. Booted off the disk, the boot options came up. The system detected disk issues and automatically ran fsck. It failed with error "Unexpected Inconsistency, RUN fsck manually. I ran fsck -y manually and went home for the night. The next day it looks like it finished, rebooted and the system came up as it should.

What an ordeal. It didn't help that the log drive was 20 TB. Really hope Checkpoint fixes this issue so others using VMWare don't run into the same problem. Many thanks for all the assistance.

Re: Report Server wont boot, cant get into maintenance mode

Richard_Quick — Tue, 09 Jan 2018 13:15:05 GMT

That's great. I'm glad you were able to get it running. If you have the grub.conf changed to a 5 second timeout then you can just enter maintenance mode without the live cd now. I've added that step to my build scripts for all my Vmware devices.

Re: Report Server wont boot, cant get into maintenance mode

Johan_Hillstrom — Wed, 24 Oct 2018 20:27:49 GMT

I wish I had read this article BEFORE today...

Just got hit with this issue after some problems with our vm environment.

I second the opinion that this should be considered as a bug, and a default of 5 seconds should be implemented.

Re: Report Server wont boot, cant get into maintenance mode

RicPor — Fri, 17 Nov 2023 11:32:49 GMT

Worked for us, too. Thanks.