Amplifying the sounds too loud can cause distortion. It is a limitation with the current version of the Olive. Start with a minimum Volume level and increase gradually till you get to a comfortable level. Adjust the equalizer settings as well as stated in the article below.
Tune the Olive.