I felt the way you have put the comment in various shades better. The algorithm already sorts out what comments should float to the top. If people feel an answer is incorrectly placed, they can vote on it to fix it.
Point scoring: yes, it is a problem. HN "feels" somewhat nicer.
Further, there may be different reasons a comment may have been voted up:
1. The comment voted up is considered relevant
2. The reader agreed with the sentiment.
3. The comment was irrelevant, but was humorous.
Similarly, a comment may have been voted down because:
1. The comment was irrelevant.
2. The comment was relevant, but the reader disagreed with the point of view.
3. A polarising comment may end up with a net score of 0, but it is actually very relevant.
4. The comment was relevant, but was delivered in a brusque manner.
Point scoring: yes, it is a problem. HN "feels" somewhat nicer.
Further, there may be different reasons a comment may have been voted up:
1. The comment voted up is considered relevant
2. The reader agreed with the sentiment.
3. The comment was irrelevant, but was humorous.
Similarly, a comment may have been voted down because:
1. The comment was irrelevant.
2. The comment was relevant, but the reader disagreed with the point of view.
3. A polarising comment may end up with a net score of 0, but it is actually very relevant.
4. The comment was relevant, but was delivered in a brusque manner.