So when FileZilla created havoc with the file permissions of my WP script, and VestaCP doesn’t have a File Manager or a script installer, I went for installing WP with the command line instead.
I thought I would record the steps I followed here in case this will be the route I follow in future.
Step 1: Change directory to public_html
Step 2: Download WordPress Script
Step 3: Unzip WordPress Script
unzip latest unzip
Step 4: Move content of WordPress folder up one folder into public_html
mv * .[^.]* ..
Step 5: Remove empty WordPress folder and index.html file
Step 6: Edit WP-Config.php file
mv wp-config-sample.php wp-config.php
Save (Ctrl+O) and Exit (Ctrl+X)