Answer:

In newer themes, disabling comments on a post that already has comments will not hide those comments, only the form. To remove existing comments from a post, edit the post, scroll down to the Comments and Unapprove or Delete each one.

See How to Disable Comments