it shouldn’t really influence your behaviour?
You are right that quality of the response is rewarded .
It is lot more about timing if you contribute late to a thread or post it is less likely you will get any points .
I usually find myself doing that frequently , the lack of upvote/ downvote only bothers me when there are no replies, you don’t know whether people read it, not so much whether people agreed with it.