Backup Error

[TonyI]

Just started getting this backup error on all my Plesk 12 installs.

Server settings are skipped from backup due to error: No semi-colon found after entity name [Ln: 28, Col: 392627654]

I need to get this resolved ASAP and have searched but found no answer that applies. Please let me know what I can do to further troubleshoot and fix.

Tony

 

[UFHH01]

Hi TonyI,

please include error - logs from your backups, for further investigations. Consider as well to add your operating system and the used Plesk version ( incl. MU ) and please include WHAT you did, to resolve the issue.

Odin / Parallels Plesk Panel for Linux services logs and configuration files ( KB - article: 111 283 )​

Often enough, it helps to use the "bootstrapper" - repair from Plesk, to solve issues and misconfigurations. Please use:

/usr/local/psa/bootstrapper/pp12.0.18-bootstrapper/bootstrapper.sh repair​

... and post your depending repair - log for further investigations in addition to your other log - files from the backup.

 

[TonyI]

CentOS Linux 7.0.1406 (Core)
12.0.18 Update #60

I am going through the backup logs now and will post back anything relevant. The backup log for last night is around 66MB so I can't post it here. Is the bootstrapper.sh utility safe to run on servers in production?

Thanks!

 

[UFHH01]

Hi TonyI,

bootstrapper utility will not destroy any data, it will search for misconfiguration(s) and it will try to repair them. Sometimes a manual hand is needed to fix common issues, but this procedure is well approved and works as expected. You will have as well a mysql dump, so you can restore this as well very quickly in case of unexpected problems with this procedure.

 

[TonyI]

Hi UFHH01,

Thanks for the suggestions. I ran the utility and it took some time but completed successfully. No issues there. I am looking through this mornings backup logs on all the servers and am not seeing any errors at all in them yet am still getting this error on the 'manage backup' screen. I am somewhat stilll new to Plesk but i've maintained a large h-sphere cluster for over 12 years so I am very used to vague errors and tracking them down. I am just at a loss as to what this is referring to.

"Server settings are skipped from backup due to error: No semi-colon found after entity name [Ln: 28, Col: 459258470]"

What entity name is it referring to I wonder? I will keep looking but if you have any more ideas, that would be great.

Thanks in advance!

 

[TonyI]

It's hard to believe I am the only one out of thousands of Plesk users that has ever seen this error. From the migration.result log this is what I see

<?xml version="1.0" encoding="UTF-8"?>
<execution-result status="warnings" log-location="/usr/local/psa/PMM/sessions/2015-08-20-235101.935/migration.result">
<object name="server" type="server">
<message id="af528ee2-9732-4033-82e4-fc9832b93466" severity="warning" code="msgtext">
<description>Server settings are skipped from backup due to error: No semi-colon found after entity name [Ln: 28, Col: 538967222]
</description>
</message>
</object>
</execution-result>

The only thing I can find that might have something to do with this is in the migration.log file that exists in /usr/local/psa/PMM/logs directory

[2015-08-21 17:41:42.267|17779] INFO: pmm-ras started : /usr/local/psa/admin/bin/pmm-ras --get-dump-list --dump-storage=/var/lib/psa/dumps/ --type=server --guid=bd0491d2-a4f8-427c-8a84-c5f66b622017 --session-path=/var/log/plesk/PMM
[2015-08-21 17:41:42.267|17779] INFO: Repository '/var/lib/psa/dumps': Initializing...
[2015-08-21 17:41:42.267|17779] INFO: Repository '/var/lib/psa/dumps': Initialized
[2015-08-21 17:41:42.267|17779] INFO: Repository '/var/lib/psa/dumps': List backups of type server for guid bd0491d2-a4f8-427c-8a84-c5f66b622017 and name
[2015-08-21 17:41:42.267|17779] INFO: Get discovered names
[2015-08-21 17:41:42.272|17779] INFO: Search object dirs
[2015-08-21 17:41:42.273|17779] INFO: Repository '/var/lib/psa/dumps': Get initial backup info from dir .discovered/backup_info_1508190036
[2015-08-21 17:41:42.275|17779] INFO: Discovered dir .discovered/backup_info_1508190036 exists but file backup_info_1508190036.xml not exists. Skipping.
[2015-08-21 17:41:42.275|17779] INFO: Repository '/var/lib/psa/dumps': Get initial backup info from dir .discovered/backup_info_1508182351
[2015-08-21 17:41:42.276|17779] INFO: Discovered dir .discovered/backup_info_1508182351 exists but file backup_info_1508182351.xml not exists. Skipping.
[2015-08-21 17:41:42.276|17779] INFO: Repository '/var/lib/psa/dumps': Get initial backup info from dir .discovered/backup_info_1508190221
[2015-08-21 17:41:42.276|17779] INFO: Discovered dir .discovered/backup_info_1508190221 exists but file backup_info_1508190221.xml not exists. Skipping.
[2015-08-21 17:41:42.277|17779] INFO: Repository '/var/lib/psa/dumps': Get initial backup info from dir .discovered/backup_info_1508190121
[2015-08-21 17:41:42.278|17779] INFO: Repository '/var/lib/psa/dumps': Get initial backup info from dir .discovered/backup_info_1508172351
[2015-08-21 17:41:42.278|17779] INFO: Discovered dir .discovered/backup_info_1508172351 exists but file backup_info_1508172351.xml not exists. Skipping.
[2015-08-21 17:41:42.278|17779] INFO: Read properties from xml backup_info_1508190121.xml
[2015-08-21 17:41:42.281|17779] INFO: Repository '/var/lib/psa/dumps': Validate backup backup_info_1508190121.xml
[2015-08-21 17:41:42.281|17779] INFO: Repository '/var/lib/psa/dumps': Get items 'status' for discovered 'backup_info_1508190121' at path
[2015-08-21 17:41:42.281|17779] INFO: Repository '/var/lib/psa/dumps': Get info from .discovered/backup_info_1508190121/status_WRONG-FORMAT
[2015-08-21 17:41:42.283|17779] INFO: pmm-ras finished. Exit code: 0

If someone out there has seen this before I would very much appreciate some insight on where else to look, what this error means, and how to resolve. It's happening on all of my Plesk 12 Linux servers.

Thanks!

Tony

 

[IgorG]

It's hard to believe I am the only one out of thousands of Plesk users that has ever seen this error.

Looks like you are right. I have not found any mentions of error like "No semi-colon found after entity name" in our internal resources. I can assume that it is related to some strange database inconsistency. Anyway I can only recommend to create a request to support team to do in-depth investigation to find the reason and to fix it. Please create a ticket to support at https://www.odin.com/support/request/ .
You may have free support, please check what kind of Plesk license you use for available support options at http://kb.odin.com/en/121580 .
If there’s no free support in your case, you can order Plesk per-incident support at http://www.odin.com/support/buy-support/ Support team will contact you as soon as purchase is processed, and they will do the best to resolve it.
If it is found that your problem was caused by product bug w/o available solution or workaround from Odin, then your purchase will be re-funded.

 

[TonyI]

Thanks Igor. I put in a support request and will let you all know what happens in case someone else ever sees this issue. FYI, this is happening on all my Linux Plesk 12 servers, not just one.

Thanks,

Tony

 

[TonyI]

OK, In case anyone else ever sees this issue here is what support did to fix. Normally, I can fix most of these kinds of things but this one had me baffled as there was no mention of it anywhere on the interwebs. Apparently this was an issue with a broken atomic rule set download. I still have no clue how a disabled apache/nginx module can cause a backup to not run properly but it is what it is. Here is the email from support once they had fixed. (Thanks support!!)


I would like to inform you that the issue with the backup has been fixed.


During investigation I found following errors in psadump.log === /usr/local/psa/bin/sw-engine-pleskrun /usr/local/psa/admin/sbin/backup_restore_helper --backup-server Server settings are skipped from backup due to error: No semi-colon found after entity name [Ln: 28, Col: 600794390] ====



When I executed this command manually '/usr/local/psa/bin/sw-engine-pleskrun /usr/local/psa/admin/sbin/backup_restore_helper --backup-server' I received following error :


====


/usr/local/psa/bin/sw-engine-pleskrun /usr/local/psa/admin/sbin/backup_restore_helper --backup-server Server settings are skipped from backup due to error: No semi-colon found after entity name [Ln: 28, Col: 600794390]


[2015-08-25 07:07:00] DEBUG [util_exec] [b509501c68484be66196c9dba11bed32][0] Starting: filemng root file_exists /etc/httpd/conf/plesk.conf.d/modsecurity.conf --allow-root

[2015-08-25 07:07:00] DEBUG [util_exec] [b509501c68484be66196c9dba11bed32][0] Finished in 0.01072s, Error code: 0 <?xml version="1.0" encoding="UTF-8"?> <server-info><web-settings><setting><name>ruleEngine</name><value>Off</value></setting><setting><name>ruleSet</name><value>atomic</value></setting><setting><name>ruleSetUpdate</name><value>daily</value></setting><setting><name>ruleSetUpdateFailed</name><value>modsecurity_ctl failed: gpg: key 4520AFA9: "Atomicorp (Atomicorp Official Signing Key) &lt;support@atomicorp.com&gt;" not changed

gpg: Total number processed: 1

gpg: unchanged: 1

gpg: Signature made Tue Jul 14 20:52:06 2015 GMT using RSA key ID 4520AFA9

gpg: Good signature from "Atomicorp (Atomicorp Official Signing Key) &lt;support@atomicorp.com&gt;"

gpg: WARNING: This key is not certified with a trusted signature!

gpg: There is no indication that the signature belongs to the owner.

......

......

stderr:

Unable to download atomic rule set

</value></setting><setting><name>ruleSetVendorLogin</name><value>aionno</value></setting><setting><name>ruleSetVendorPassword</name><value>$AES-128-CBC$RvVRcN7EjXG+IQoHHyS2SQ==$nSJOIILmLHqYsPQTWZvG9A==</value></setting><setting><name>configPreset</name><value>through</value></setting><setting><name>filterById</name><value/></setting><setting><name>filterByTag</name><value/></setting><setting><name>filterByRegexp</name><value/></setting><setting><name>configCustom</name><value encoding="base64"></value></setting></web-settings></server-info>

======



In-order to resolve the issue I performed below steps after taking psa dump.


+++++++++


MariaDB [psa]> select * from WebServerSettingsParameters where webServerSettingsId=1\G

*************************** 1. row ***************************

webServerSettingsId: 1

name: configPreset

value: through

*************************** 2. row ***************************

webServerSettingsId: 1

name: ruleEngine

value: Off

*************************** 3. row ***************************

webServerSettingsId: 1

name: ruleSet

value: atomic

*************************** 4. row ***************************

webServerSettingsId: 1

name: ruleSetUpdate

value: daily

*************************** 5. row ***************************

webServerSettingsId: 1

name: ruleSetUpdateFailed

value: modsecurity_ctl failed: gpg: key 4520AFA9: "Atomicorp (Atomicorp Official Signing Key) <support@atomicorp.com>" not changed

gpg: Total number processed: 1

gpg: unchanged: 1

gpg: Signature made Tue Jul 14 20:52:06 2015 GMT using RSA key ID 4520AFA9

gpg: Good signature from "Atomicorp (Atomicorp Official Signing Key) <support@atomicorp.com>"

gpg: WARNING: This key is not certified with a trusted signature!

gpg: There is no indication that the signature belongs to the owner.

Primary key fingerprint: 1818 66DF 9DAC A40E 5B42 9B08 FFBD 5D0A 4520 AFA9 TERM environment variable not set.

aum failed with exitcode 3.



MariaDB [psa]> delete from WebServerSettingsParameters where webServerSettingsId=1 and name='ruleSetUpdateFailed'; Query OK, 1 row affected (0.00 sec)

Now backups are working properly. I had disabled mod security a few weeks ago due to it breaking most nginx sites on all my servers. I am sure now that these 2 issues were related or this one was caused by the one a few weeks ago. Anyhow, hope this helps someone if you ever see this issue.

Thanks,

Tony