Author Topic: Customer Self-Backups and Richweb Backups  (Read 1041 times)

Offline Doug Hazard

  • Richweb Staff (Admin)
  • Newbie
  • *
  • Posts: 29
  • CFB / MBB Junkie
    • http://twocentsradio.net
Customer Self-Backups and Richweb Backups
« on: December 05, 2016, 11:09:35 am »
Believe it or not, this actually goes hand in hand with the "Richweb / Globalweb Hosting and MySQL Database Backups" post I've made.

We already backup the databases each night, on the database cluster, using a full mysql dump.

Quote
root@db1 10:49:39 > /data/BACKUP/db # find ./ | grep vh
./[CLIENTNAME]
./[CLIENTNAME]/[CLIENTNAME]-MySQL-db-2016-11-22-localhost.db.gz
./[CLIENTNAME]/[CLIENTNAME]-MySQL-db-2016-11-26-localhost.db.gz
./[CLIENTNAME]/[CLIENTNAME]-MySQL-db-2016-11-23-localhost.db.gz
./[CLIENTNAME]/[CLIENTNAME]-MySQL-db-2016-11-24-localhost.db.gz
./[CLIENTNAME]/[CLIENTNAME]-MySQL-db-2016-11-27-localhost.db.gz
./[CLIENTNAME]/[CLIENTNAME]-MySQL-db-2016-11-25-localhost.db.gz
./[CLIENTNAME]/[CLIENTNAME]-MySQL-db-2016-11-28-localhost.db.gz

We already backup the filesystem too - nightly rsync off site on even days and nightly rysnc onsite on odd days.

And there are 2 historical files - full tarballs - of the site kept as well  back 45 days or so:
Quote
2016-10-20_data_gwebvs3.tar.gz  2016-11-20_data_gwebvs3.tar.gz

My problem with php web app driven backups is they:
  • Write the backups into the web files, making the backups ever larger;
  • They never get deleted;
  • Rely on wget of a url to run, which means they run from the web process, which is shoddy (error prone), timeouts, etc; and
  • They can easily be deleted or damaged accidentally or intentionally via an  ftp client mistake.
We prefer (well insist) the backups be kept on separate disks/locations etc.

If you want an extra level of backups, you can setup a job to run once a month, and then have a script that logs in via ftp and pulls them back to your site if you want. We can create a script that pushes our backups to an ftp server of your choice too, just would take a little time to set it up.

Backups I see now:
Quote
root@vs3 10:52:18 > /var/www # find [CLIENTNAME]/backups/
[CLIENTNAME]/backups/
[CLIENTNAME]/backups/files
[CLIENTNAME]/backups/files/1480345342.zip
[CLIENTNAME]/backups/files/1475001754.zip
[CLIENTNAME]/backups/database
[CLIENTNAME]/backups/database/1477667989@@[CLIENTNAME].sql.zip
[CLIENTNAME]/backups/database/1480345326@@[CLIENTNAME].sql.zip
[CLIENTNAME]/backups/database/1475001736@@[CLIENTNAME].sql.zip

root@vs3 10:52:21 > /var/www # ls -alt [CLIENTNAME]/backups/database/1477667989@@[CLIENTNAME].sql.zip
-rw-r--r-- 1 www-data www-data 554256 Oct 28 11:20 [CLIENTNAME]/backups/database/1477667989@@[CLIENTNAME].sql.zip

root@vs3 10:52:27 > /var/www # ls -alt [CLIENTNAME]/backups/database/1480345326@@[CLIENTNAME].sql.zip
-rw-r--r-- 1 www-data www-data 556997 Nov 28 10:02 [CLIENTNAME]/backups/database/1480345326@@[CLIENTNAME].sql.zip
« Last Edit: December 03, 2017, 11:23:32 pm by Doug Hazard »
Doug "Bear" Hazard
@BearlyDoug  |  @GridironHistory  |  @Hogville | http://gridironhistory.com

Co-Host of Two Cents Radio, powered by the SportsManCave.com Radio Network, Wednesday Nights from 8 PM to 10 PM Central, covering SEC and Sun Belt Sports.

Listen at SMCRadio.com and follow @TwoCentsRadio on Twitter!

Offline Doug Hazard

  • Richweb Staff (Admin)
  • Newbie
  • *
  • Posts: 29
  • CFB / MBB Junkie
    • http://twocentsradio.net
Re: Customer Self-Backups and Richweb Backups
« Reply #1 on: December 03, 2017, 11:23:43 pm »
Our wordpress customers are hosted on our standalone vmwp nodes which is a quad core (full cores) vm with 10G of ram and typically a block of 8 to 12 ips and 12 to 15 sites.

Each vmwp node has a built in load balancer and content acceleration engine but the database is pointed at one of the MySQL storage nodes.

The vmwp nodes backup their content each nite to a replication server. This is all of the website files, images, php code, js and css files, etc - all media and code files.

Odd nites use an on site replica server, even nites are pushed to QTS for offsite backup.

Once a month a full snapshot is taken. We keep 2 months of snapshots.

The databases are backed up each nite (full snap) and pushed the same way - evens and odds. 10 days of backups are kept, and then monthly archives for 1 year are kept.

If you have need to recover old data its best to ask quickly, before backups are over-written. Recovering data from 6 months ago for example can be a challenge.

Full snaps of the filesystem web dirs are stored in: /data/BACKUP/content/

And can be uncompressed to fetch files as needed.

We can also ship backups to a customer ftp site if desired. And we can arrange for longer term storage of backups if needed, like plugging in the GlobalWeb RBS system for long term storage of file backups.
Doug "Bear" Hazard
@BearlyDoug  |  @GridironHistory  |  @Hogville | http://gridironhistory.com

Co-Host of Two Cents Radio, powered by the SportsManCave.com Radio Network, Wednesday Nights from 8 PM to 10 PM Central, covering SEC and Sun Belt Sports.

Listen at SMCRadio.com and follow @TwoCentsRadio on Twitter!

 

With Quick-Reply you can write a post when viewing a topic without loading a new page. You can still use bulletin board code and smileys as you would in a normal post.

Note: this post will not display until it's been approved by a moderator.
Name: Email:
Verification:
Type the letters shown in the picture
Listen to the letters / Request another image
Type the letters shown in the picture:
What NBA Player just left the Miami Heat to rejoin the Cleveland Cavaliers? (3 letters):