This is the reason my approach to fitness and nutrition is moderation and not elimination!!!
A recent article I read even suggested using olive oil cold in salads and use oils like coconut oil for foods that require cooking. For me that was new and so even though olive oil is healthy, it is better consumed cold than warm. Interesting right?
It is therefore better to focus on the things we "can" do, like do love, do pray, do eat healthy,do exercise often. Life is too short to focus on the "dont's". Love you!!!