It took me a bit to work it out, but for me, going onto the Messages tab and clicking "mark all as read" did it. I'd been clicking "mark all as read" on the Activity tab, which doesn't remove those.
It should probably be flagged though because if it's not immediately apparent that's what needs doing, the UX design isn't good.