Rsync seams to be the fastest way to deploy a site (using middleman-deploy) to a web server. Out of the box it will however demand that you type a password every time.
To avoid this, a SSH key can be used. I found a good description on how to set it up at https://www.digitalocean.com/community/articles/how-to-set-up-ssh-keys--2