Backup OSX client to Ubuntu server using rsync

This is a guideline for backing up your OSX home folder to a Ubuntu Linux server. Some folders are excluded as they are backed up in other ways (see earlier post on how to synchronize images between OSX clients).

Requirements

1. This guideline requires ssh without password (see earlier post on the blog).
   

Limitations

1. The backup method used in this guideline is a mirrored copy of the original data. This means that backups will be replaced by the original data. You will only be able to roll back to the latest version of the data. This will ensure your data if your harddrive fails or if your Mac is stolen. It will not help you if for instance you delete sections in a document and want to revert to an older version. Check the links below for some hints on how to create incremental backups using rsync.
   

Guideline

1. Download and extract the folder backup in /Applications
2. Edit the top of /Applications/backup/scripts/backup.sh. Change to your own username, server IP and set the directory where the backup should be placed (create this directory on the server).
3. Configure what directories shouldn't be backed up by editing the file /Applications/backup/scripts/exclude
4. In the file /Applications/backup/launchd/com.skyandyou.tools.clientbackup.plist you can set the delay between backup's (default is 3 hours)
   
5. Copy /Applications/backup/launchd/com.skyandyou.tools.clientbackup.plist to /Users/username/Library/LaunchAgents
6. Restart your Mac
   
7. Test the backup by executing:
   launchctl start com.skyandyou.tools.clientbackup
8. Watch the log output:
   tail -f /var/log/system.log
   

Links
Using excludes in rsync
Incremental backups using rsync
Mac backup howto

Wireless connection slow on Asus WL-500W

When using 1.9.2.7-10 of Oleg's Asus firmware the wireless connection is really really slow. I found a hint that seems to fix it:

In the router web adminstration change to AES instead of TKIP (default)
WPA Encryption: AES
Authentication Method: wpa-auto-personal
Channel: 9
Wireless mode: Auto
54g protection: No check mark

Installing Oleg firmware on Asus WL-500W

This is a guideline for installing Oleg firmware on a Asus WL-500W router including using a USB pen for storage of additional software (ipkg packages) and setting up ssh. This guideline is a mix of the HOWTO's in the Relevant Link section below. Use of this guideline is on your own risk.

Guideline:

1. Download firmware (the version I curently use is 1.9.2.7-10) from Oleg firmware list
   
2. Go the router web management (default is http://192.168.1.1)
3. In System Setup, Firmware Upgrade select the Oleg firmware on your harddrive and start the upgrade.
4. telnet to the router (from a terminal/shell/cmd) using the username and password settings configured in the web management console:
   telnet 192.168.1.1
   
5. Install ssh (dropbear):
   mkdir -p /usr/local/etc/dropbear
   
   dropbearkey -t dss -f /usr/local/etc/dropbear/dropbear_dss_host_key
   
   dropbearkey -t rsa -f /usr/local/etc/dropbear/dropbear_rsa_host_key
   
   mkdir -p /usr/local/sbin/
   
   touch /usr/local/sbin/post-boot
   
   touch /usr/local/sbin/post-firewall
   
   touch /usr/local/sbin/post-mount
   
   touch /usr/local/sbin/pre-mount
   
   touch /usr/local/sbin/pre-shutdown
   
   chmod +x /usr/local/sbin/*
   
   echo "#!/bin/sh" >> /usr/local/sbin/post-boot
   
   echo "dropbear" >> /usr/local/sbin/post-boot
   
   flashfs save && flashfs commit && flashfs enable && reboot
   
6. Put a USB pen in the USB slot on the router (I use a 2GB USB pen)
   
7. Partition the USB pen (one partition for swap and one for IPKG packages):
   insmod scsi_mod && insmod sd_mod && insmod usb-storage && sleep 5s
   fdisk /dev/discs/disc0/disc
   In fdisk, Create swap:
   n -> p -> 1 -> 'return' -> +512M -> t -> 82
   Create IPKG partition:
   n -> p -> 2 -> 'return' -> 'return'
   End fdisk by pressing 'w'
8. Start the swap:
   mkswap /dev/discs/disc0/part1
   
   swapon /dev/discs/disc0/part1
9. Format the IPKG partition:
   mke2fs -j /dev/discs/disc0/part2
10. Add fstab:
    vi /etc/fstab
    Paste the following:
    #device Mountpoint FStype Options Dump Pass#
    /dev/discs/disc0/part1 none swap sw 0 0
    /dev/discs/disc0/part2 /opt ext3 rw,noatime 1 1
    
    Save the file (esc -> wq)
    
11. Save fstab for reboot:
    echo "/etc/fstab" >> /usr/local/.filescv
12. Mount usb on startup by editing /usr/local/sbin/post-boot:
    vi /usr/local/sbin/post-boot
    Add the following:
    # Start SSH service
    dropbear
    
    # test if USB disc has been attached
    # if not - then insert needed modules
    if [ ! -d /dev/discs ]
    then
    insmod scsi_mod && insmod sd_mod && insmod usb-storage && sleep 5s
    fi
    
    # Wait for /opt to mount
    mount /dev/discs/disc0/part2 /opt
    mount /dev/discs/disc0/part3 /tmp/harddisk
    i=0
    while [ $i -le 30 ]
    do
    if [ -d /opt/etc ]
    then
    break
    fi
    sleep 1
    i=`expr $i + 1`
    done
    
    # Activate swap
    swapon /dev/discs/disc0/part1
13. Save all settings and reboot:
    flashfs save && flashfs commit && flashfs enable && reboot
14. After reboot, check that all is mounted ok:
    free (swap enabled?)
    df -h (IPKG partition avaliable?)
15. Install IPKG:
    mkdir /opt/tmp
    
    mkdir /opt/tmp/ipkg
    
    ipkg.sh update
    
    ipkg.sh install ipkg
    
    ipkg update
16. Install IPKG packages eg. nano:
    ipkg install nano
17. Save all settings and reboot:
    flashfs save && flashfs commit && flashfs enable && reboot
    
    

Relevant Links:
ipkg on Asus WL500
Asus wl500g HOWTO
Asus wl500g with USB pen drive HOWTO
Oleg firmware list
Oleg router forum
WL500W-1.9.2.7-10 Oleg firmware

Backup to SMB share

Mount smb share on ubuntu:
sudo smbmount //192.168.0.3/backup /smb/r5nas/backup -o username=yyy,password=xxx,uid=500,gid=500

Backup to smb share using rsync (background job):
sudo nohup rsync -azv /data /smb/r5nas/backup > /home/username/log/smb.log &

Watch the output:
tail -f /home/username/log/smb.log

Unmount smb share on ubuntu:
sudo smbumount sambashare

I had some problems with files being copyed even though they weren't changed. It seems like setting modify-window up helps. Also rsync had problems with setting permissions on the files after copy (see links below). I ended up using this combination:
sudo nohup rsync -rltDvhi --modify-window=3600 /data /smb/r5nas/backup > /home/username/log/smb.log &

As an alternative you can backup files using FTP (see the link below) but you will have to copy everything every time you do a backup.

Relevant links:
smbmount
Recursive copy using FTP
rsync FAQ
rsync chown problem

Download and Convert Youtube videos to your favorit format

I just found two cool websites that can be used for converting Youtube videos to most video formats. This is helpful when using videos for e.g. Powerpoint presentations..

Download Youtube video to your computer:
http://www.techcrunch.com/get-youtube-movie

Convert the flv-movie to a large number of formats (on mac .mov is supported in Powerpoint):
http://w5.media-convert.com/convert