I'm certainly no expert so be forewarned, but I do run many Joomla installs on my VPS and will share my settings.
In my case for each install, public_html ownership is set to user:nobody and all directories and files under that are set to nobody:nobody. Whenever I have it set differently it...