topic Erros when using migrate import in Firewall and Security Management

Erros when using migrate import

Fabio_ca — Tue, 09 Mar 2021 12:55:36 GMT

Hey, i keep getting an error when i try to backup with migrate import.

Both Systems are having the same R80.40 with same Hotfixes and DA.

Does anyone has an idea?

Here is the logfile:

[Expert@gw1:0]# vi /opt/CPshrd-R80.40/log/migrate-2021.03.09_13.50.17.log
[9 Mar 13:50:17] --> UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] <-- UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] --> AddExpansionMacro
[9 Mar 13:50:17] <-- AddExpansionMacro
[9 Mar 13:50:17] --> SetupMacroExpansions
[9 Mar 13:50:17] .--> UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .<-- UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .--> AddExpansionMacro
[9 Mar 13:50:17] [AddExpansionMacro] Setting macro 'JAVA_HOME' to '/opt/CPshrd-R80.40/jre_32'
[9 Mar 13:50:17] .<-- AddExpansionMacro
[9 Mar 13:50:17] .--> UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .<-- UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .--> AddExpansionMacro
[9 Mar 13:50:17] [AddExpansionMacro] Setting macro 'MDS_FWDIR' to '/opt/CPsuite-R80.40/fw1'
[9 Mar 13:50:17] .<-- AddExpansionMacro
[9 Mar 13:50:17] .--> UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .<-- UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .--> AddExpansionMacro
[9 Mar 13:50:17] [AddExpansionMacro] Setting macro 'PGDIR' to '/opt/CPshrd-R80.40/database/postgresql'
[9 Mar 13:50:17] .<-- AddExpansionMacro
[9 Mar 13:50:17] .--> GetAceDir
[9 Mar 13:50:17] [GetAceDir] Checking ACEDATA environment variable
[9 Mar 13:50:17] [GetAceDir] ACEDATA is not defined
[9 Mar 13:50:17] .<-- GetAceDir
[9 Mar 13:50:17] .--> UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .<-- UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .--> AddExpansionMacro
[9 Mar 13:50:17] [AddExpansionMacro] Setting macro 'ACEDIR' to '/var/ace/'
[9 Mar 13:50:17] .<-- AddExpansionMacro
[9 Mar 13:50:17] [SetupMacroExpansions] $UAGDIR is not defined
[9 Mar 13:50:17] .--> UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .<-- UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .--> AddExpansionMacro
[9 Mar 13:50:17] [AddExpansionMacro] Setting macro 'SECUREXLDIR' to '/opt/CPppak-R80.40'
[9 Mar 13:50:17] .<-- AddExpansionMacro
[9 Mar 13:50:17] .--> GetRtdirBasePath
[9 Mar 13:50:17] [GetRtdirBasePath] $RTDIR_BASE is not defined in the environment, trying to resolve it
[9 Mar 13:50:17] [GetRtdirBasePath] Current environment doesn't need this env. variable, nothing to do
[9 Mar 13:50:17] .<-- GetRtdirBasePath
[9 Mar 13:50:17] [SetupMacroExpansions] $RTDIR_BASE is not defined
[9 Mar 13:50:17] .--> UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .<-- UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .--> AddExpansionMacro
[9 Mar 13:50:17] [AddExpansionMacro] Setting macro 'RTDIR' to '/opt/CPrt-R80.40'
[9 Mar 13:50:17] .<-- AddExpansionMacro
[9 Mar 13:50:17] .--> UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .<-- UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .--> AddExpansionMacro
[9 Mar 13:50:17] [AddExpansionMacro] Setting macro 'SMARTLOGDIR' to '/opt/CPSmartLog-R80.40'
[9 Mar 13:50:17] .<-- AddExpansionMacro
[9 Mar 13:50:17] .--> UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .<-- UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .--> AddExpansionMacro
[9 Mar 13:50:17] [AddExpansionMacro] Setting macro 'EXPORTERDIR' to '/opt/CPrt-R80.40/log_exporter'
[9 Mar 13:50:17] .<-- AddExpansionMacro
[9 Mar 13:50:17] .--> UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .<-- UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .--> AddExpansionMacro
[9 Mar 13:50:17] [AddExpansionMacro] Setting macro 'INDEXERDIR' to '/opt/CPrt-R80.40/log_indexer'
[9 Mar 13:50:17] .<-- AddExpansionMacro
[9 Mar 13:50:17] <-- SetupMacroExpansions
[9 Mar 13:50:17] --> SetupMacroExpansions
[9 Mar 13:50:17] .--> UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .<-- UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .--> AddExpansionMacro
[9 Mar 13:50:17] [AddExpansionMacro] Setting macro 'UEPMDIR' to '/opt/CPuepm-R80.40'
[9 Mar 13:50:17] .<-- AddExpansionMacro
[9 Mar 13:50:17] <-- SetupMacroExpansions
[9 Mar 13:50:17] --> SetupPatternMatching
[9 Mar 13:50:17] [SetupPatternMatching] Initialized PM subsystem

Re: Erros when using migrate import

G_W_Albrecht — Tue, 09 Mar 2021 13:16:34 GMT

Where is the error ?

Re: Erros when using migrate import

Fabio_ca — Tue, 09 Mar 2021 13:41:16 GMT

Thats, what im looking for.
it only says:

[Expert@gw1:0]# ./migrate import /var/log/export_database.tgz
The import operation will eventually stop all Check Point services (cpstop).
Do you want to continue? (y/n) [n]? y

Extracting the database...
Execution finished with errors. See log file '/opt/CPshrd-R80.40/log/migrate-2021.03.09_14.40.57.log' for further details

Re: Erros when using migrate import

G_W_Albrecht — Tue, 09 Mar 2021 13:56:25 GMT

You log just stops before licenses are checked. Is that really the whole log file ?

Re: Erros when using migrate import

G_W_Albrecht — Tue, 09 Mar 2021 14:41:44 GMT

Gimme an:

# tail /opt/CPshrd-R80.40/log/migrate-2021.03.09_14.40.57.log

Re: Erros when using migrate import

Fabio_ca — Tue, 09 Mar 2021 15:14:41 GMT

[Expert@gw1:0]# tail /opt/CPshrd-R80.40/log/migrate-2021.03.09_13.50.17.log
[9 Mar 13:50:19] [CleanupManager::DoCleanup] Starting to perform cleanup
[9 Mar 13:50:19] .--> DirCleaner::exec
[9 Mar 13:50:19] [DirCleaner::exec] Going to remove directory '/opt/CPsuite-R80.40/fw1/tmp/migrate/'
[9 Mar 13:50:19] .<-- DirCleaner::exec
[9 Mar 13:50:19] .--> ImportFailureMarker::exec
[9 Mar 13:50:19] [ImportFailureMarker::exec] Checking if cleaner is active
[9 Mar 13:50:19] [ImportFailureMarker::exec] Cleaner is not active, nothing to do
[9 Mar 13:50:19] .<-- ImportFailureMarker::exec
[9 Mar 13:50:19] [CleanupManager::DoCleanup] Completed the cleanup
[9 Mar 13:50:19] <-- CleanupManager::DoCleanup

Re: Erros when using migrate import

G_W_Albrecht — Tue, 09 Mar 2021 16:04:29 GMT

See ? vi only shows the first few lines ! Either transfer the file to your desktop and edit it there, or use

# tail -n 100 /opt/CPshrd-R80.40/log/migrate-2021.03.09_14.40.57.log

to show the last 100 lines

Re: Erros when using migrate import

PhoneBoy — Tue, 09 Mar 2021 16:10:18 GMT

What are you migrate importing from (which version)?

Re: Erros when using migrate import

G_W_Albrecht — Wed, 10 Mar 2021 07:36:26 GMT

Mostly this is caused by no disk space left 8)

Re: Erros when using migrate import

Fabio_ca — Wed, 10 Mar 2021 07:45:32 GMT

R80.40 HF Bundle T87

Re: Erros when using migrate import

Fabio_ca — Wed, 10 Mar 2021 08:00:12 GMT

[Expert@gw1:0]# df
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/mapper/vg_splat-lv_current 33027952 11914744 19435488 39% /
/dev/sda1 295561 110553 169748 40% /boot
tmpfs 3943144 6548 3936596 1% /dev/shm
/dev/mapper/vg_splat-lv_log 60944380 41980092 15818560 73% /var/log

The disk space seems pretty ok for me 😕

Re: Erros when using migrate import

G_W_Albrecht — Wed, 10 Mar 2021 08:55:38 GMT

So what is the error from /opt/CPshrd-R80.40/log/migrate-2021.03.09_13.50.17.log ???

# cat /opt/CPshrd-R80.40/log/migrate-2021.03.09_13.50.17.log | grep ERR

Re: Erros when using migrate import

Fabio_ca — Wed, 10 Mar 2021 11:19:19 GMT

[Expert@gw1:0]# cat /opt/CPshrd-R80.40/log/migrate-2021.03.09_13.50.17.log | grep ERR
[9 Mar 13:50:19] [ExecCommandGetOutput] ERR: The given exit code indicates an error
[9 Mar 13:50:19] [TgzExtractor::exec] ERR: Execution failed
[9 Mar 13:50:19] [ActivitiesManager::exec] ERR: Activity 'ConditionalExecutor' failed

Re: Erros when using migrate import

G_W_Albrecht — Wed, 10 Mar 2021 12:39:14 GMT

Now try:

# cat /opt/CPshrd-R80.40/log/migrate-2021.03.09_13.50.17.log | grep [9 Mar 13:50:19]

Re: Erros when using migrate import

G_W_Albrecht — Wed, 10 Mar 2021 12:40:42 GMT

But i fear you will have to consult TAC abnd upload the migrate-2021.03.09_13.50.17.log

Re: Erros when using migrate import

Fabio_ca — Wed, 10 Mar 2021 13:02:54 GMT

Here is the whole log-file. Guess i should have send it right away.
Thanks for your help btw.

Re: Erros when using migrate import

G_W_Albrecht — Wed, 10 Mar 2021 15:19:23 GMT

Looks like your export file is damaged:

[9 Mar 13:50:19] [GetMigrateUtilPath] Looking for migrate helper utility in path '/opt/CPsuite-R80.40/fw1/bin/upgrade_tools/././/migrate_utils/gzip'...<-- UpgradeMacroReplacer::Instance[GetMigrateUtilPath] Looking for migrate helper utility in path '/opt/CPsuite-R80.40/fw1/bin/upgrade_tools/././/migrate_utils/gzip'.--> UpgradeMacroReplacer::Instance...<-- UpgradeMacroReplacer::Instance[GetMigrateUtilPath] Utility is not found in this path, presuming it is in default location at '/opt/CPsuite-R80.40/fw1/bin/upgrade_tools/././/gzip'<-- GetMigrateUtilPath..--> GetMigrateUtilPath...--> UpgradeMacroReplacer::Instance.<-- UpgradeMacroReplacer::InstanceGetMigrateUtilPath] Looking for migrate helper utility in path '/opt/CPsuite-R80.40/fw1/bin/upgrade_tools/././/migrate_utils/gtar'..--> UpgradeMacroReplacer::Instance...<-- UpgradeMacroReplacer::Instance[GetMigrateUtilPath] Utility is not found in this path, presuming it is in default location at '/opt/CPsuite-R80.40/fw1/bin/upgrade_tools/././/gtar'<-- GetMigrateUtilPath--> ExecCommandGetOutput[ExecCommandGetOutput] Going to execute command: '"/opt/CPsuite-R80.40/fw1/bin/upgrade_tools/././/gtar" -x "--use-compress-program=/opt/CPsuite-R80.40/fw1/bin/upgrade_tools/././/gzip" -f "/var/log/export_database.tgz"'[ExecCommandGetOutput] Command completed with an exit code 2[ExecCommandGetOutput] ERR: The given exit code indicates an error..<-- ExecCommandGetOutputTgzExtractor::exec] Command's output:-------------------------------------gzip: stdin: invalid compressed data--format violated
/opt/CPsuite-R80.40/fw1/bin/upgrade_tools/././/gtar: Skipping to next header/opt/CPsuite-R80.40/fw1/bin/upgrade_tools/././/gtar: Child returned status 1/opt/CPsuite-R80.40/fw1/bin/upgrade_tools/././/gtar: Error is not recoverable: exiting now

I would try to expand /var/log/export_database.tgz on my desktop and see if the issue replicates there. If yes, generating a new export is suggested....

Re: Erros when using migrate import

Fabio_ca — Wed, 10 Mar 2021 15:39:40 GMT

It seemed that there is something wrong with migrate export on the base system.
Every file im creating looks damanged.

Re: Erros when using migrate import

Vladimir — Wed, 10 Mar 2021 15:45:26 GMT

Perhaps it is an accidental error, but you backup configuration with "migrate export".

Import is used for recovery.

If you were trying to perform the "migrate export", please confirm that you did NOT specify the extension for the resultant archive (i.e. no .tgz .tar etc..).

Try re-runing the migrate export again with the output located in /var/log/<exportfilename_without_extension>.

If you were not already doing it this way, try:

----
>>>Establish an SSH session to the Management Server and change mode to "Expert".
Change current directory to the one containing "upgrade_tools" and execute silent, non-timing out export:
----

[Expert@CPMGMT:0]# cd $FWDIR/bin/upgrade_tools/
[Expert@CPMGMT:0]# yes | nohup ./migrate export /var/log/<managementserverexportfile>
nohup: appending output to 'nohup.out'

----
>>>Create duplicate Putty session to the management server,
logon and change mode to "Expert".

In this second Putty session, change current directory to the one containing "update_tools" and
start trailing the log of the export process, the "nohup.out" file:
----

[Expert@CPMGMT:0]#
[Expert@CPMGMT:0]# cd $FWDIR/bin/upgrade_tools/
[Expert@CPMGMT:0]# tail -F nohup.out

Re: Erros when using migrate import

G_W_Albrecht — Thu, 11 Mar 2021 10:19:25 GMT

Download from here : Migration tools for All Gaia versions and Secure Platform versions above R75.40 and re-install.