Support

Akeeba Backup for Joomla!

#28479 Problem upload Google Drive

Posted in ‘Akeeba Backup for Joomla! 4 & 5’
This is a public ticket

Everybody will be able to see its contents. Do not include usernames, passwords or any other sensitive information.

Environment Information

Joomla! version
n/a
PHP version
n/a
Akeeba Backup version
n/a

Latest post by tampe125 on Monday, 25 September 2017 02:19 CDT

l3g0s
Please look at the bottom of this page (under Support Policy Summary) for our support policy summary, containing important information regarding our working hours and our support policy. Thank you!

EXTREMELY IMPORTANT: Please attach a ZIP file containing your Akeeba Backup log file in order for us to help you with any backup or restoration issue. If the file is over 2Mb, please upload it on your server and post a link to it.

Description of my issue:

Hello,

For several days, without changing configuration, the upload to Google Drive no longer works. The backup works fine. The backup remains therefore present on my server, it should be deleted after the upload.
I checked my configuration and it's still ok.


Best regards,

Cyril.

tampe125
Akeeba Staff
Hello,

the main problem is the size of your backup.
Looking at your log file, the archive is 1.3Gb large and you're trying to upload it in one shot. Since your server can't do that, it times out and your get a transfer error.
Please set a part size of 100Mb and try again; you can find such option inside the Configuration Page under the Archiver Engine section.

Davide Tampellini

Developer and Support Staff

๐Ÿ‡ฎ๐Ÿ‡นItalian: native ๐Ÿ‡ฌ๐Ÿ‡งEnglish: good โ€ข ๐Ÿ• My time zone is Europe / Rome (UTC +1)
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

l3g0s
Thank you for your anwser.

I just made the change. I keep you informed of the result.


Best regards,

Cyril.

l3g0s
After testing, the problem is still here.

Have you got any idea ?

tampe125
Akeeba Staff
Can you please attach the log of the latest failed backup?

Davide Tampellini

Developer and Support Staff

๐Ÿ‡ฎ๐Ÿ‡นItalian: native ๐Ÿ‡ฌ๐Ÿ‡งEnglish: good โ€ข ๐Ÿ• My time zone is Europe / Rome (UTC +1)
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

l3g0s
Please find attached logs.

tampe125
Akeeba Staff
Looking at your logs:
INFO    |170920 20:00:03|Output directory   :/home/maxxiboo/prod_files/bkp
INFO    |170920 20:00:03|Part size (bytes)  :2147352576
INFO    |170920 20:00:03|--------------------------------------------------------------------------------
And
DEBUG   |170920 20:02:07|Updating statistics with file sizes
DEBUG   |170920 20:02:07|Total size of backup archive (in bytes): 1469211083

Please apply the solution I suggested you before and try again.
the main problem is the size of your backup.

Looking at your log file, the archive is 1.3Gb large and you're trying to upload it in one shot. Since your server can't do that, it times out and your get a transfer error.

Please set a part size of 100Mb and try again; you can find such option inside the Configuration Page under the Archiver Engine section.

Davide Tampellini

Developer and Support Staff

๐Ÿ‡ฎ๐Ÿ‡นItalian: native ๐Ÿ‡ฌ๐Ÿ‡งEnglish: good โ€ข ๐Ÿ• My time zone is Europe / Rome (UTC +1)
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

l3g0s
Sorry, I had not changed the right field.
So I modified Part size for split archives to 100MB.
Chunk size for large files processing is at 1MB and Big file threshold at 1MB. Are these values good?

Thank you for your help.

tampe125
Akeeba Staff
Yes, that's right.

Davide Tampellini

Developer and Support Staff

๐Ÿ‡ฎ๐Ÿ‡นItalian: native ๐Ÿ‡ฌ๐Ÿ‡งEnglish: good โ€ข ๐Ÿ• My time zone is Europe / Rome (UTC +1)
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

l3g0s
Now I have a file filed on google drive and the backup file is deleted locally. However, the file on gdrive only makes 7 MB ...

My configuration for gdrive is:
Process each part immedately: unchecked
Delete archive after processing: checked
Enable chunk upload: checked
Chunk size: 5 MB

Maybe I should uncheck chunk upload?

What are your recommendations for successfully backing up my site above 1 GB and transfer the backup file to gdrive ?

tampe125
Akeeba Staff
Please attach the backup log of the latest failed backup.

Davide Tampellini

Developer and Support Staff

๐Ÿ‡ฎ๐Ÿ‡นItalian: native ๐Ÿ‡ฌ๐Ÿ‡งEnglish: good โ€ข ๐Ÿ• My time zone is Europe / Rome (UTC +1)
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

l3g0s
Please find attached logs

tampe125
Akeeba Staff
It seems that such part size is still too large for your site.
Please set it to 10Mb and try again.
I'd suggest to remove the flag from the option Enable chunk upload, too. You can find such option inside the Configuration Page, under the section Post-Processing Engine

Davide Tampellini

Developer and Support Staff

๐Ÿ‡ฎ๐Ÿ‡นItalian: native ๐Ÿ‡ฌ๐Ÿ‡งEnglish: good โ€ข ๐Ÿ• My time zone is Europe / Rome (UTC +1)
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

l3g0s
Now it's better... but I have about 100 new files on gdrive. Do you think it is possible to group these files into a new folder each time? (for example the folder name with date). Backups are scheduled once a day (cron task).
It will be difficult to manage backups on gdrive if all the parts are in the same folder.

Thank you for your help.

tampe125
Akeeba Staff
Yes, you can, please take a look at this page of the documentation, section Directory

Davide Tampellini

Developer and Support Staff

๐Ÿ‡ฎ๐Ÿ‡นItalian: native ๐Ÿ‡ฌ๐Ÿ‡งEnglish: good โ€ข ๐Ÿ• My time zone is Europe / Rome (UTC +1)
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

l3g0s
That's great!


Thank you very much.


Best regards,

Cyril.

tampe125
Akeeba Staff
You're welcome!

Davide Tampellini

Developer and Support Staff

๐Ÿ‡ฎ๐Ÿ‡นItalian: native ๐Ÿ‡ฌ๐Ÿ‡งEnglish: good โ€ข ๐Ÿ• My time zone is Europe / Rome (UTC +1)
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

l3g0s
I realized that it works fine when launched from the backend. On the other hand, when it is launched in command line, I do not have all the files on gdrive. When I look at the durations, they are just under 2 minutes in command line and 10 minutes from the backend. Therefore, there must be a 2-minute timeout from the CRON tasks preventing the complete execution of sending files to gdrive.
What do you think ?


Please find attached logs (Cron Task).

Best regards,

Cyril.

tampe125
Akeeba Staff
The backup halts exactly after 5 minutes, this means that there is a fixed timeout for CLI processes.
In this case, the only solution is to use frontend backups. You can find more info here.
I'll close this ticket since the original issue was solved; if you have any other issue please open a new ticket

Davide Tampellini

Developer and Support Staff

๐Ÿ‡ฎ๐Ÿ‡นItalian: native ๐Ÿ‡ฌ๐Ÿ‡งEnglish: good โ€ข ๐Ÿ• My time zone is Europe / Rome (UTC +1)
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

Support Information

Working hours: We are open Monday to Friday, 9am to 7pm Cyprus timezone (EET / EEST). Support is provided by the same developers writing the software, all of which live in Europe. You can still file tickets outside of our working hours, but we cannot respond to them until we're back at the office.

Support policy: We would like to kindly inform you that when using our support you have already agreed to the Support Policy which is part of our Terms of Service. Thank you for your understanding and for helping us help you!