There is also the fact that many things we perceive as senses are actually knowledge. We may think we see a red door when in fact we just know the door is red.

It’s possible your OP was noticing that a certain smell makes him know a thing is purple. Under normal circumstances he would just perceive PURPLE and think he was seeing. But on drugs he might perceive that his nose was also alerting him of PURPLE in the flower.