How To Sync AWS S3 Buckets Using RClone

Author: , September 9th, 2021

The aws s3 sync command is slow and painful! I needed a more efficient way to sync to large buckets (prod to dev). Finally settled on RClone: https://rclone.org/docs/

During rclone config I called remote “s3” ;-}

How To Update a WordPress Plugin Manually Using rsync

Author: , January 24th, 2020

If you are unable to update a plugin via the WP admin console, then you can do the update manually. Download the zip file to your local hard drive and extract it. Then, from the command line, do the test run first:

*Make sure to use the trailing slashes with rsync for proper operation […]

How To Use a PEM File With rsync

Author: , January 10th, 2020

Use the -e option like so:

How To Sync Box to S3 Using rclone

Author: , October 3rd, 2019

To sync various cloud resources, use the excellent cli tool rclone from https://rclone.org/docs/ For this use case, the need was to sync from Box to an AWS S3 bucket. Install rclone:

Configure both S3 and Box – for remote name labels I just used “S3” and “Box”:

Validate Access and Functionality:

Perform […]

How To Fix rsync Packet Corrupt Errors

Author: , May 10th, 2019

I was getting rsync errors from one source host:

Finally tracked it down to the application “Little Snitch”. Needed to fully uninstall it and reboot to get the problem solved.

How To rsync Only Specific File Extensions

Author: , February 5th, 2017

rsync -avzn –progress –include=’*.png’ –include=’*/’ –exclude=’*’ /the/source/path/ user@theServer:/the/target/path/

How To Copy Top-Level Directory Only Using rsync

Author: , June 17th, 2015

Regular Files: rsync -av –no-r –progress /volumes/source/* /volumes/destination/ Dot Files: rsync -av –no-r –progress /volumes/source/.* /volumes/destination/

How To Install s3cmd

Author: , June 7th, 2013

Install Procedure Download and extract into /usr/local: http://downloads.sourceforge.net/project/s3tools/s3cmd/1.0.1/s3cmd-1.0.1.tar.gz

Configuration saved to ‘/root/.s3cfg’ Command Line Examples List all buckets: s3cmd ls Make a new bucket in the default region (US): s3cmd mb s3://{YOUR_BUCKET_HERE} Make a new bucket in a specific region: s3cmd mb –bucket-location={DATACENTER} s3://{YOUR_BUCKET_HERE} As of now the datacenters are: US (default), EU, us-west-1, […]

How To Use Rsync With An FTP Server

Author: , February 25th, 2012

Prerequisites: curlftpfs and rsync programs must be installed! Create a mount point, then mount the remote directory:

Now rsync the mounted FTP directory to your local directory:

http://curlftpfs.sourceforge.net/