Support

Akeeba Backup for Joomla!

#13331 Backup: To less storage on Server and not outgoing FTP possible

Posted in ‘Akeeba Backup for Joomla! 4 & 5’
This is a public ticket

Everybody will be able to see its contents. Do not include usernames, passwords or any other sensitive information.

Environment Information

Joomla! version
n/a
PHP version
n/a
Akeeba Backup version
n/a

Latest post by nicholas on Tuesday, 21 August 2012 07:49 CDT

ebnerjoh
Dear Sir or Madam,

I have installed the Pro-Version of Akeeba Backup, but I have some issues with my webhoster.

*) I have 20GB of Webspace and 13GB are already used by my website. So I can not performa local backup.
*) Unfortunatley the provider is blocking outgoing FTP access, so I cannot use the remote backup as well.

Do I have any other possibilities do perform a backup?

Br,
Johannes

nicholas
Akeeba Staff
Manager
Hello Johannes,

It's not as a dire situation as it may seem. Akeeba Backup was designed with flexibility in mind. There are more than one ways to achieve something in the component in an attempt to make sure that no matter what you can have a reliable backup. Let's explore your alternatives.

First, I'd like to note that maybe you don't need to worry about being able to backup your site. The space consumed by your web site also includes data not being backed up by Akeeba Backup such as: log files, temporary files, cache files, emails, files outside your web root. My experience is that log files and cache files may take up several Gigabytes. For instance this site backs up to a cozy 150Mb but it consumes an excess of 8Gb of disk space. The bulk of the data on our server is log and cache files.

If a full backup is not possible, there is the possibility of doing a two phase backup. Create two backup profiles. In the first profile backup everything except your large media files. In the second profile backup the large media files and nothing else. It usually suffices to take daily backups with the first profile (resulting in a rather small backup archive) and weekly or monthly backups with the second profile.

Even if this is not acceptable, Akeeba Backup has a few aces up its sleeve. You said that your host does not allow connecting to external FTP servers. Well, Akeeba Backup also supports storing your backup archives to third party file storage services such as Box.net, Dropbox, Amazon S3, SugarSync, Microsoft Windows Azure BLOB storage, RackSpace CloudFiles and so on. These services are accessed via their web APIs, not FTP, so there is a good chance they are not blocked. I'd suggest trying Amazon S3. For those tight space situations, Akeeba Backup offers a way to take your backup in small chunks, upload them and immediately delete them from your server. In order to do that, in Akeeba Backup's Configuration page click on the Configure button next to the "Data processing engine" and check the following boxes:
- Process each part immediately
- Delete archive after processing
These options are available for the vast majority of data processing engines. Then click on the Configure button next to the Archiver engine and set the Part Size for Split Archives to a value of 50, 20, 10 or 5Mb. The exact value depends on the transfer speed between your server and the selected storage provider. Usually values around 10 and 20Mb work best. You will have to do some trial and error.

Nicholas K. Dionysopoulos

Lead Developer and Director

πŸ‡¬πŸ‡·Greek: native πŸ‡¬πŸ‡§English: excellent πŸ‡«πŸ‡·French: basic β€’ πŸ• My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

ebnerjoh
Hello Nicholas!

This is a very interessing answer. I will give it some tries.

3 Notes:

1) My storage is wasted because of full resolution images. I am providing a Firedepartment Website and I am using the gallery for exchanging the images to the newspaper agencies. so 11GB are Pictures :-)
I know this is not the idea of the webspace, but it is comfortable to use with the news agencies as they can download full size images for printing without any interaction with me.

2) Any idea to implent also OwnCloud for storing the backup?

3) My webhoster is using 2 different servers for the content and the database. I want to backup now the whole system and install it on a private Server at my home (content and webspace on the same server). Can the buckup/restore process change the config.php to change the database server from an external server to localhost or do I have to do this manually?

Br,
Johannes

P.s.: I am thinking of an alternativ solution. As I have a private webserver I am thinking of just doing a sql-backup with Akeeba-Backup and getting the whole files via WGET.Then ajusting the settings and importing the db via script.

nicholas
Akeeba Staff
Manager
Hi Johannes,

1. You can use the "Files and Directories Exclusion" feature of Akeeba Backup to not backup those 11Gb of raw photos.

2. You can't use OwnCloud with Akeeba Backup. It requires using a WebDAV interface. WebDAV is not very well supported by PHP; it requires using the cURL library and it must have WebDAV support built in (it usually doesn't).

3. As long as Joomla! can read its own files and database (it does, otherwise the site wouldn't work!) Akeeba Backup –which runs inside Joomla!– can back it all up. Akeeba Backup was primarily designed to move sites across different servers. Site backup and restoration is just a small subset of this operation: it's moving a site back to its origin. This is to say that taking a backup is sufficient to move a site to a different server :)

Regarding your PS, it's a bad idea. Akeeba Backup shines when you let it perform full site (files + database) backups. It even adds its own restoration script (Akeeba Backup Installer) in the backup archive to make the site restoration extremely simple. If you take separate SQL and file backups you're shooting yourself in the feet, tying your hands behind your back and jumping off an airplane without a parachute. Of course you can do that... but why?

Nicholas K. Dionysopoulos

Lead Developer and Director

πŸ‡¬πŸ‡·Greek: native πŸ‡¬πŸ‡§English: excellent πŸ‡«πŸ‡·French: basic β€’ πŸ• My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

ebnerjoh
Mhhh, ok!

So would be the following approach working?

1) Backup Joomla (joom_gallery excluded) and database locally
2) Download backup
3) Download images manually

Restoration:
1) Restore Main Joomla + Database with akeeba backup
2) upload joom_gallery images manually

Br,
Johannes

nicholas
Akeeba Staff
Manager
A slightly different approach would work (combining your two propositions in one procedure):
- Backup Joomla!, excluding the directory where com_gallery stores its images, not com_gallery itself
- Download backup
- Restore the backup locally
- Download the images manually

This approach works for both directions, live to local and local to live.

Pro tip: transferring all of the images every time you want to transfer a site between the two servers is a pain in the rear, as we're talking about a whooping 11Gb. You can use an FTP sync programme to only transfer the changed files. On my Mac I'm using Transmit, but I'm sure that other FTP clients support that as well.

Nicholas K. Dionysopoulos

Lead Developer and Director

πŸ‡¬πŸ‡·Greek: native πŸ‡¬πŸ‡§English: excellent πŸ‡«πŸ‡·French: basic β€’ πŸ• My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

ebnerjoh
Hi!

Yes, this was my idea. Just excluding the images...

The idea with the sync is good. Have to check for a linux cli tool.

Br and many thanks for this professional service,
Johannes

ebnerjoh
wget -mirror should do a sync of only changed files.

nicholas
Akeeba Staff
Manager
You're welcome!

Regarding Linux sync tools, rsync is the first one which comes in mind thanks to SSH support and because it's purpose built to do file syncing only. wget and curl are close seconds. Beyond that I've not heard of anything else being used in production environments.

Nicholas K. Dionysopoulos

Lead Developer and Director

πŸ‡¬πŸ‡·Greek: native πŸ‡¬πŸ‡§English: excellent πŸ‡«πŸ‡·French: basic β€’ πŸ• My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

Support Information

Working hours: We are open Monday to Friday, 9am to 7pm Cyprus timezone (EET / EEST). Support is provided by the same developers writing the software, all of which live in Europe. You can still file tickets outside of our working hours, but we cannot respond to them until we're back at the office.

Support policy: We would like to kindly inform you that when using our support you have already agreed to the Support Policy which is part of our Terms of Service. Thank you for your understanding and for helping us help you!