Issue [PPP-26546] Error setting FTP storage settings

[Flavio]

Hi,
When I try to set FTP storage setting for the backup I receive this error: Transport error: unable to list directory: Curl error: Timeout was reached
I have the same situation on server Centos 6.8 and Windows 2008 R2, both with this error after plesk onyx upgrade.

This option work fine last week, before I upgrate plesk from 12 to onyx.
The access to the FTP server work fine if I use filezilla or windows ftp command

 

[J-F Brouillette]

Are you able to telnet your remote ftp server port 21 from your server? just to make sure that it's able to communicate.

Thank you.

 

[nebuzzer]

have you read the answers :

https://talk.plesk.com/threads/ppp-26478-after-update-to-onyx-backup-does-not-work.339594/

???

there seems to be a bug with the ftp timeout, i think in the next update it will get fixed. you can try what Sergey Prohorov said

Could you try to add following section at end of panel.ini (/usr/local/psa/admin/conf/panel.ini on Unix or "%plesk_dir%\admin\conf\panel.ini" on Windows) and restart backup.
Code:
[pmm]
ftpFileTransferTimeout = 36000
If you already has 'pmm' section in this file - just add 'ftpFileTransferTimeout' to the section.
This workaround increases file transfer timeout to 10 hours.

 

[Sergey Prohorov]

Hello, Flavio. Could you send me PM with output of following command:

DUMP_STORAGE_PASSWD=<FTP password> /usr/local/psa/admin/bin/pmm-ras --check-repository --dump-storage=ftp://<FTP login>@<FTP host>/<FTP directory> --use-ftp-passive-mode --debug --verbose --session-path=/var/log/plesk/PMM

It contains CURL debug output from checks we do before save FTP storage configuration.

 

[Flavio]

Hello Sergey,

here the output log created by your command:

[2016-10-19 09:56:30.320|12984] INFO: pmm-ras started : /usr/local/psa/admin/bin/pmm-ras --check-repository --dump-storage=ftp://ftpbackupsrv@qnapafdox.dyndns-office.com/backupserver/cloudlinux --use-ftp-passive-mode --debug --verbose --session-path=/var/log/plesk/PMM
[2016-10-19 09:56:30.320|12984] INFO: Repository 'ftp://qnapafdox.dyndns-office.com/backupserver/cloudlinux': Initializing...
[2016-10-19 09:56:30.320|12984] INFO: Transport: Get repository transport ftp://qnapafdox.dyndns-office.com/backupserver/cloudlinux
[2016-10-19 09:56:30.320|12984] INFO: Transport: Init credentials for user 'ftpbackupsrv'
[2016-10-19 09:56:30.320|12984] INFO: Curl version: 0x72300
[2016-10-19 09:56:30.322|12984] INFO: Repository 'ftp://qnapafdox.dyndns-office.com/backupserver/cloudlinux': Initialized
[2016-10-19 09:56:30.322|12984] INFO: Test stage: Check directory access
[2016-10-19 09:56:30.322|12984] INFO: Transport: List dir /
[2016-10-19 09:56:30.322|12984] INFO: Ftp init url ftp://qnapafdox.dyndns-office.com/backupserver/cloudlinux/
[2016-10-19 09:56:30.323|12984] INFO: Created temp file: /usr/local/psa/PMM/tmp/repo_transport_tmp_PQe8zo
[2016-10-19 09:56:30.323|12984] INFO: Ftp extended list dir
[2016-10-19 09:56:40.325|12984] INFO: Curl output :
[2016-10-19 09:56:40.325|12984] INFO: * Hostname was NOT found in DNS cache
[2016-10-19 09:56:40.325|12984] INFO: * Trying 151.66.143.22...
[2016-10-19 09:56:40.325|12984] INFO: * Connected to qnapafdox.dyndns-office.com (151.66.143.22) port 21 (#0)
[2016-10-19 09:56:40.325|12984] INFO: < 220 NASFTPD Turbo station 1.3.5a Server (ProFTPD) [192.170.1.50]
[2016-10-19 09:56:40.325|12984] INFO: > USER ftpbackupsrv
[2016-10-19 09:56:40.325|12984] INFO: < 331 Password required for ftpbackupsrv
[2016-10-19 09:56:40.325|12984] INFO: < 230 User ftpbackupsrv logged in
[2016-10-19 09:56:40.325|12984] INFO: > PWD
[2016-10-19 09:56:40.326|12984] INFO: < 257 "/" is the current directory
[2016-10-19 09:56:40.326|12984] INFO: * Entry path is '/'
[2016-10-19 09:56:40.326|12984] INFO: > CWD backupserver
[2016-10-19 09:56:40.326|12984] INFO: * ftp_perform ends with SECONDARY: 0
[2016-10-19 09:56:40.326|12984] INFO: < 250 CWD command successful
[2016-10-19 09:56:40.326|12984] INFO: > CWD cloudlinux
[2016-10-19 09:56:40.326|12984] INFO: < 250 CWD command successful
[2016-10-19 09:56:40.326|12984] INFO: > EPSV
[2016-10-19 09:56:40.326|12984] INFO: * Connect data stream passively
[2016-10-19 09:56:40.326|12984] INFO: < 229 Entering Extended Passive Mode (|||56408|)
[2016-10-19 09:56:40.326|12984] INFO: * Hostname was NOT found in DNS cache
[2016-10-19 09:56:40.326|12984] INFO: * Trying 151.66.143.22...
[2016-10-19 09:56:40.326|12984] INFO: * Connecting to 151.66.143.22 (151.66.143.22) port 56408
[2016-10-19 09:56:40.326|12984] INFO: * Operation timed out after 10001 milliseconds with 0 bytes received
[2016-10-19 09:56:40.326|12984] INFO: * Closing connection 0
[2016-10-19 09:56:40.326|12984] INFO:
[2016-10-19 09:56:40.326|12984] INFO: Curl error (28): Timeout was reached
[2016-10-19 09:56:40.326|12984] INFO: CurlError[76931fac-9dab-42b3-86c2-48b87d6ae33f]: Curl error: Timeout was reached [./ftp.cpp:484]
void plesk::tFtpConnection::ListEx(std::vector<plesk::FtpFileInfo, std::allocator<plesk::FtpFileInfo> >&)
[2016-10-19 09:56:40.327|12984] INFO: pmm-ras finished. Exit code: 126

thanks.

 

[Sergey Prohorov]

It looks like another issue with too small timeout. Could you run following curl command

time curl --verbose --ftp-pasv --netrc-file ~/my-password-file ftp://qnapafdox.dyndns-office.com/backupserver/cloudlinux

~/my-password-file should contain following data:

machine qnapafdox.dyndns-office.com login ftpbackupsrv password <PASSWORD>

Have you tried to do not use passive mode?

 

[Flavio]

in which folder I must create the file my-password-file ?

and Yes, I've try to don't set passive mode but the result is the same.

 

[Sergey Prohorov]

You could create it any secure place - just specify a full path to this file in '--netrc-file' option of curl command.

 

[Flavio]

ok. done.
But I receive an error.

 

[VNick]

If you have older curl version (which you do), you may just create the file with the suggested content with the ~/.netrc path (i.e. create .netrc file in your home directory). Then call curl with --netrc command option instead of --netrc-file /opt/my-password-file option.

 

[Flavio]

Here the result of the command:

[root@cloudlnx ~]# time curl --verbose --ftp-pasv --netrc ftp://qnapafdox.dyndns-office.com/backupserver/cloudlinux
* About to connect() to qnapafdox.dyndns-office.com port 21 (#0)
* Trying 151.66.143.22... connected
* Connected to qnapafdox.dyndns-office.com (151.66.143.22) port 21 (#0)
< 220 NASFTPD Turbo station 1.3.5a Server (ProFTPD) [192.170.1.50]
> USER ftpbackupsrv
< 331 Password required for ftpbackupsrv
> PASS mypassword
< 230 User ftpbackupsrv logged in
> PWD
< 257 "/" is the current directory
* Entry path is '/'
> CWD backupserver
< 250 CWD command successful
> EPSV
* Connect data stream passively
< 229 Entering Extended Passive Mode (|||55991|)
* Trying 151.66.143.22... Connection timed out
* couldn't connect to host
* got positive EPSV response, but can't connect. Disabling EPSV
> PASV
< 227 Entering Passive Mode (151,66,143,22,195,82)
* Trying 151.66.143.22... connected
* Connecting to 151.66.143.22 (151.66.143.22) port 50002
> TYPE I
< 200 Type set to I
> SIZE cloudlinux
< 550 cloudlinux: not a regular file
> RETR cloudlinux
< 550 cloudlinux: Not a regular file
* RETR response: 550
* Remembering we are in dir "backupserver/"
* Connection #0 to host qnapafdox.dyndns-office.com left intact
curl: (78) RETR response: 550
> QUIT
< 221 Goodbye.
* Closing connection #0

real 1m3.612s
user 0m0.001s
sys 0m0.011s

 

[Flavio]

Hi,

there are some news ?
Thanks.

 

[Sergey Prohorov]

Hello.
This is a bug in Plesk. To verify the fix we need access to your FTP server. Could you create a temporary FTP user at ftp://qnapafdox.dyndns-office.com/ and send it me by PM or open support ticket at https://cscontact.plesk.com