So when FileZilla created havoc with the file permissions of my WP script, and VestaCP doesn’t have a File Manager or a script installer, I went for installing WP with the command line instead.
I thought I would record the steps I followed here in case this will be the route I follow in future.
Step 1: Change directory to public_html
cd /home/admin/web/domain.com/public_html/
Step 2: Download WordPress Script
wget http://wordpress.org/latest.zip
Step 3: Unzip WordPress Script
unzip latest unzip
Step 4: Move content of WordPress folder up one folder into public_html
cd wordpress
mv * .[^.]* ..
Step 5: Remove empty WordPress folder and index.html file
rmdir wordpress
rm index.html
Step 6: Edit WP-Config.php file
mv wp-config-sample.php wp-config.php
nano wp-config.php
Save (Ctrl+O) and Exit (Ctrl+X)