It never occured to me that the Colonel could be talking about himself here. I always thought he was thinking of a woman he once knew. But you are right - he might be sad that his own romantic sentiments had not been fulfilled in the past. This could be a clue why he is attracted by Marianne. She resembles him in his youth. Thank you for opening my eyes!