The solution is simpler than you think; you simply need to add ZERO WIDTH SPACE unicode char between / and " (beginning) and " and / (end).
The default way to do it is
C-x 8 RET zero width space RET
or
C-x 8 RET 200b RET
But I need to use this priceless unicode char to escape stuff like this in org-mode and so I have bound "0" in "C-x 8" map to insert this char.
Thus I simply need to do C-x 8 0 to insert the ZERO WIDTH SPACE.
To elaborate more, <0> below is where you insert the 200b unicode characters:
I would like to see /<0>"these surrounding quotes in italics"<0>/.