At lunchtime I was dissed by a man in a wheelchair. Could I have retaliated?

You are right but patience is needed in certain cirstances. I am sure he thought about his action afterwards, sometimes anger is not directed at any specific person sometimes it is something deeper. If you can read into such signs just leave them be but if they hurt you physically of course you have the right to defend yourself.