When you reply to a thread you start to "watch" it, which means you become subscribed to it, and when someone else writes a message in that same thread, you get an alert. Only the first post is alerted, that's why it says "There may be more posts after this."