Yes, I think that learning that Anne rejected Charles did begin to work on him, though his nut speech that follows, has always sounded to me like he's trying very hard to convince himself that he wouldn't forgive Anne and that Louisa was superior. Perhaps his sensations after handing her in the carraige were also stronger than he'd anticipated? So he's feeling these things, but he doesn't quite understand them yet. It all pops into clear view in Lyme, horribly, only moments after he's realized it's too late to act on them.