While I agree that doing this sounds reasonable, there is no requirement that this should be the case.
I can't think of a scenario where the same would not be true, even if this was not a requirement. You need the src address to map to the communication stream in one way or the other. Unless I am to tried.
I guess that there could be security issues with this. I mean, if the source
address used will be used as destiantion address, then the sending host has
a simple way to redirect the reply packets to another host and produce for
instance a flooding attack.