I suppose he might have met at least briefly with other gentry families in Plymouth during his visit to Lucy.. and word might have gotten back to Mrs D or the Middletons' on the west Country gentry's grapevine. Or he might have let it slip himself that he had been in Plymouth later on, and Mrs D would probalby have felt hurt that he had not at least paid them a call...