The reason your domain works without the www is because the server is set up for it to work with or without the www.
The problems with Joomla are completely seperate and as has been mentioned are due to the mod_security rules.
Hope everything is going good for you now
.