The term olive skin came from the idea of olive oil which is quite yellow in colour,not the actual olive itself, which is green.