Learning to Extract Signature and Reply Lines from Email

automated email analysis for information mining - for yourself, not in any investigatory capacity - has long been an interest of mine. so much gold lying in my inbox if only it could be processed. i know that IBM has spent some time on this, working towards a new product called ReMail, and MSFT and others routinely do email research. however, email clients still suck.

i've been playing around with the stuff described here to see if i can't auto-organize my contacts based solely on their email messages.

We describe methods for automatically identifying signature blocks and reply lines in plain-text email messages. This analysis has many potential applications, such as preprocessing email for text-to-speech systems; anonymization of email corpora; improving automatic content-based mail classifiers; and email threading. Our method is based on applying machine learning methods to a sequential representation of an email message, in which each email is represented as a sequence of lines, and each line is represented as a set of features. We compare several state-of-the-art sequential and non-sequential machine learning algorithms on different feature sets, and present experimental results showing that the presence of a signature block in a message can be detected with accuracy higher than 97%; that signature block lines can be identified with accuracy higher than 99%; and that signature block and reply lines can be simultaneously identified with accuracy of higher than 98%.

Source: Learning to Extract Signature and Reply Lines from Email, Vitor R. Carvalho and William W. Cohen.