As I read Ch. 20 over this time, I paid alot more attention to dialogue and thought that maybe Anne saying Lyme had good memories despite the bad in this passage:

"The last few hours were certainly very painful," replied Anne; "but when pain is over, the remembrance of it often becomes a pleasure. One does not love a place the less for having suffered in it, unless it has been all suffering, nothing but suffering, which was by no means the case at Lyme. We were only in anxiety and distress during the last two hours, and previously there had been a great deal of enjoyment.