I tried buying OTM option and got the same rejection error. This does not look like a limit imposed by exchange. I believe Zerodha has some arbitary RMS rule which blocks buying OTM options. @nithin should investigate this seriously.
I am working in a strategy which involves buying deep OTM option as hedge. Looks like I have to go to a different broker.