Erros when using migrate import

[Fabio_ca]

Hey, i keep getting an error when i try to backup with migrate import.

Both Systems are having the same R80.40 with same Hotfixes and DA.

Does anyone has an idea?

Here is the logfile:

[Expert@gw1:0]# vi /opt/CPshrd-R80.40/log/migrate-2021.03.09_13.50.17.log
[9 Mar 13:50:17] --> UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] <-- UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] --> AddExpansionMacro
[9 Mar 13:50:17] <-- AddExpansionMacro
[9 Mar 13:50:17] --> SetupMacroExpansions
[9 Mar 13:50:17] .--> UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .<-- UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .--> AddExpansionMacro
[9 Mar 13:50:17] [AddExpansionMacro] Setting macro 'JAVA_HOME' to '/opt/CPshrd-R80.40/jre_32'
[9 Mar 13:50:17] .<-- AddExpansionMacro
[9 Mar 13:50:17] .--> UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .<-- UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .--> AddExpansionMacro
[9 Mar 13:50:17] [AddExpansionMacro] Setting macro 'MDS_FWDIR' to '/opt/CPsuite-R80.40/fw1'
[9 Mar 13:50:17] .<-- AddExpansionMacro
[9 Mar 13:50:17] .--> UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .<-- UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .--> AddExpansionMacro
[9 Mar 13:50:17] [AddExpansionMacro] Setting macro 'PGDIR' to '/opt/CPshrd-R80.40/database/postgresql'
[9 Mar 13:50:17] .<-- AddExpansionMacro
[9 Mar 13:50:17] .--> GetAceDir
[9 Mar 13:50:17] [GetAceDir] Checking ACEDATA environment variable
[9 Mar 13:50:17] [GetAceDir] ACEDATA is not defined
[9 Mar 13:50:17] .<-- GetAceDir
[9 Mar 13:50:17] .--> UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .<-- UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .--> AddExpansionMacro
[9 Mar 13:50:17] [AddExpansionMacro] Setting macro 'ACEDIR' to '/var/ace/'
[9 Mar 13:50:17] .<-- AddExpansionMacro
[9 Mar 13:50:17] [SetupMacroExpansions] $UAGDIR is not defined
[9 Mar 13:50:17] .--> UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .<-- UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .--> AddExpansionMacro
[9 Mar 13:50:17] [AddExpansionMacro] Setting macro 'SECUREXLDIR' to '/opt/CPppak-R80.40'
[9 Mar 13:50:17] .<-- AddExpansionMacro
[9 Mar 13:50:17] .--> GetRtdirBasePath
[9 Mar 13:50:17] [GetRtdirBasePath] $RTDIR_BASE is not defined in the environment, trying to resolve it
[9 Mar 13:50:17] [GetRtdirBasePath] Current environment doesn't need this env. variable, nothing to do
[9 Mar 13:50:17] .<-- GetRtdirBasePath
[9 Mar 13:50:17] [SetupMacroExpansions] $RTDIR_BASE is not defined
[9 Mar 13:50:17] .--> UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .<-- UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .--> AddExpansionMacro
[9 Mar 13:50:17] [AddExpansionMacro] Setting macro 'RTDIR' to '/opt/CPrt-R80.40'
[9 Mar 13:50:17] .<-- AddExpansionMacro
[9 Mar 13:50:17] .--> UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .<-- UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .--> AddExpansionMacro
[9 Mar 13:50:17] [AddExpansionMacro] Setting macro 'SMARTLOGDIR' to '/opt/CPSmartLog-R80.40'
[9 Mar 13:50:17] .<-- AddExpansionMacro
[9 Mar 13:50:17] .--> UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .<-- UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .--> AddExpansionMacro
[9 Mar 13:50:17] [AddExpansionMacro] Setting macro 'EXPORTERDIR' to '/opt/CPrt-R80.40/log_exporter'
[9 Mar 13:50:17] .<-- AddExpansionMacro
[9 Mar 13:50:17] .--> UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .<-- UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .--> AddExpansionMacro
[9 Mar 13:50:17] [AddExpansionMacro] Setting macro 'INDEXERDIR' to '/opt/CPrt-R80.40/log_indexer'
[9 Mar 13:50:17] .<-- AddExpansionMacro
[9 Mar 13:50:17] <-- SetupMacroExpansions
[9 Mar 13:50:17] --> SetupMacroExpansions
[9 Mar 13:50:17] .--> UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .<-- UpgradeMacroReplacer::Instance
[9 Mar 13:50:17] .--> AddExpansionMacro
[9 Mar 13:50:17] [AddExpansionMacro] Setting macro 'UEPMDIR' to '/opt/CPuepm-R80.40'
[9 Mar 13:50:17] .<-- AddExpansionMacro
[9 Mar 13:50:17] <-- SetupMacroExpansions
[9 Mar 13:50:17] --> SetupPatternMatching
[9 Mar 13:50:17] [SetupPatternMatching] Initialized PM subsystem

[G_W_Albrecht]

Where is the error ?

[Fabio_ca]

Thats, what im looking for.
it only says:

[Expert@gw1:0]# ./migrate import /var/log/export_database.tgz
The import operation will eventually stop all Check Point services (cpstop).
Do you want to continue? (y/n) [n]? y

Extracting the database...
Execution finished with errors. See log file '/opt/CPshrd-R80.40/log/migrate-2021.03.09_14.40.57.log' for further details

[G_W_Albrecht]

You log just stops before licenses are checked. Is that really the whole log file ?

[G_W_Albrecht]

Gimme an:

# tail /opt/CPshrd-R80.40/log/migrate-2021.03.09_14.40.57.log

[Fabio_ca]

[Expert@gw1:0]# tail /opt/CPshrd-R80.40/log/migrate-2021.03.09_13.50.17.log
[9 Mar 13:50:19] [CleanupManager::DoCleanup] Starting to perform cleanup
[9 Mar 13:50:19] .--> DirCleaner::exec
[9 Mar 13:50:19] [DirCleaner::exec] Going to remove directory '/opt/CPsuite-R80.40/fw1/tmp/migrate/'
[9 Mar 13:50:19] .<-- DirCleaner::exec
[9 Mar 13:50:19] .--> ImportFailureMarker::exec
[9 Mar 13:50:19] [ImportFailureMarker::exec] Checking if cleaner is active
[9 Mar 13:50:19] [ImportFailureMarker::exec] Cleaner is not active, nothing to do
[9 Mar 13:50:19] .<-- ImportFailureMarker::exec
[9 Mar 13:50:19] [CleanupManager::DoCleanup] Completed the cleanup
[9 Mar 13:50:19] <-- CleanupManager::DoCleanup

[G_W_Albrecht]

See ? vi only shows the first few lines ! Either transfer the file to your desktop and edit it there, or use 

# tail -n 100 /opt/CPshrd-R80.40/log/migrate-2021.03.09_14.40.57.log

to show the last 100 lines

[G_W_Albrecht]

Mostly this is caused by no disk space left 😎

[Fabio_ca]

[Expert@gw1:0]# df
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/mapper/vg_splat-lv_current 33027952 11914744 19435488 39% /
/dev/sda1 295561 110553 169748 40% /boot
tmpfs 3943144 6548 3936596 1% /dev/shm
/dev/mapper/vg_splat-lv_log 60944380 41980092 15818560 73% /var/log

The disk space seems pretty ok for me 😕

[G_W_Albrecht]

So what is the error from  /opt/CPshrd-R80.40/log/migrate-2021.03.09_13.50.17.log ???

# cat /opt/CPshrd-R80.40/log/migrate-2021.03.09_13.50.17.log | grep ERR

[Fabio_ca]

[Expert@gw1:0]# cat /opt/CPshrd-R80.40/log/migrate-2021.03.09_13.50.17.log | grep ERR
[9 Mar 13:50:19] [ExecCommandGetOutput] ERR: The given exit code indicates an error
[9 Mar 13:50:19] [TgzExtractor::exec] ERR: Execution failed
[9 Mar 13:50:19] [ActivitiesManager::exec] ERR: Activity 'ConditionalExecutor' failed

[G_W_Albrecht]

Now try:

# cat /opt/CPshrd-R80.40/log/migrate-2021.03.09_13.50.17.log | grep [9 Mar 13:50:19]

[G_W_Albrecht]

But i fear you will have to consult TAC abnd upload the migrate-2021.03.09_13.50.17.log

[Fabio_ca]

Here is the whole log-file. Guess i should have send it right away.
Thanks for your help btw.

[G_W_Albrecht · Accepted solution]

Looks like your export file is damaged:

[9 Mar 13:50:19] [GetMigrateUtilPath] Looking for migrate helper utility in path '/opt/CPsuite-R80.40/fw1/bin/upgrade_tools/././/migrate_utils/gzip'...<-- UpgradeMacroReplacer::Instance[GetMigrateUtilPath] Looking for migrate helper utility in path '/opt/CPsuite-R80.40/fw1/bin/upgrade_tools/././/migrate_utils/gzip'.--> UpgradeMacroReplacer::Instance...<-- UpgradeMacroReplacer::Instance[GetMigrateUtilPath] Utility is not found in this path, presuming it is in default location at '/opt/CPsuite-R80.40/fw1/bin/upgrade_tools/././/gzip'<-- GetMigrateUtilPath..--> GetMigrateUtilPath...--> UpgradeMacroReplacer::Instance.<-- UpgradeMacroReplacer::InstanceGetMigrateUtilPath] Looking for migrate helper utility in path '/opt/CPsuite-R80.40/fw1/bin/upgrade_tools/././/migrate_utils/gtar'..--> UpgradeMacroReplacer::Instance...<-- UpgradeMacroReplacer::Instance[GetMigrateUtilPath] Utility is not found in this path, presuming it is in default location at '/opt/CPsuite-R80.40/fw1/bin/upgrade_tools/././/gtar'<-- GetMigrateUtilPath--> ExecCommandGetOutput[ExecCommandGetOutput] Going to execute command: '"/opt/CPsuite-R80.40/fw1/bin/upgrade_tools/././/gtar" -x "--use-compress-program=/opt/CPsuite-R80.40/fw1/bin/upgrade_tools/././/gzip" -f "/var/log/export_database.tgz"'[ExecCommandGetOutput] Command completed with an exit code 2[ExecCommandGetOutput] ERR: The given exit code indicates an error..<-- ExecCommandGetOutputTgzExtractor::exec] Command's output:-------------------------------------gzip: stdin: invalid compressed data--format violated
/opt/CPsuite-R80.40/fw1/bin/upgrade_tools/././/gtar: Skipping to next header/opt/CPsuite-R80.40/fw1/bin/upgrade_tools/././/gtar: Child returned status 1/opt/CPsuite-R80.40/fw1/bin/upgrade_tools/././/gtar: Error is not recoverable: exiting now

I would try to expand /var/log/export_database.tgz on my desktop and see if the issue replicates there. If yes, generating a new export is suggested....

[Fabio_ca]

It seemed that there is something wrong with migrate export on the base system.
Every file im creating looks damanged.

[G_W_Albrecht]

Download from here : Migration tools for All Gaia versions and Secure Platform versions above R75.40  and re-install.

[PhoneBoy]

What are you migrate importing from (which version)?

[Fabio_ca]

R80.40 HF Bundle T87

[Vladimir]

Perhaps it is an accidental error, but you backup configuration with "migrate export".

Import is used for recovery.

If you were trying to perform the "migrate export", please confirm that you did NOT specify the extension for the resultant archive (i.e. no .tgz .tar etc..).

Try re-runing the migrate export again with the output located in /var/log/<exportfilename_without_extension>.

If you were not already doing it this way, try:

----
>>>Establish an SSH session to the Management Server and change mode to "Expert".
Change current directory to the one containing "upgrade_tools" and execute silent, non-timing out export:
----

[Expert@CPMGMT:0]# cd $FWDIR/bin/upgrade_tools/
[Expert@CPMGMT:0]# yes | nohup ./migrate export /var/log/<managementserverexportfile>
nohup: appending output to 'nohup.out'

----
>>>Create duplicate Putty session to the management server,
logon and change mode to "Expert".

In this second Putty session, change current directory to the one containing "update_tools" and
start trailing the log of the export process, the "nohup.out" file:
----

[Expert@CPMGMT:0]#
[Expert@CPMGMT:0]# cd $FWDIR/bin/upgrade_tools/
[Expert@CPMGMT:0]# tail -F nohup.out