Can I install some applications on the VPS for my server settings?

Yes, with a VPS you have the freedom just like you would with a dedicated server with one exception - you cannot change or modify system kernel.