Mark as Done moves the email to the "Done" tab and marks it as such. It indicates that there's nothing more to do with this email, but it's still valuable enough for you to keep.
Using the More | Global | Auto Mark as Done setting, you can set replied messages to be automatically marked as Done. By default, this setting is turned off.
Note: If you use the Incoming Filter, you won't see emails marked as done.