I understand - I can't bear to think of directories left behind by a deleted application ;) Did you try updating the locatedb? That would satisfy your OCD tendencies even more, since you would know that the database reflected what is actually in the filesystem. Hmm, I'd better go and do mine too :D
