I do agree that Anne made it plain she wanted to avoid meeting him as much as possible, and he may well have resented that. And he certainly seems quite aware of her presence and nearness- he is certainly not indifferent.

However, he has no reason to believe that she wants a reconciliation, and he now wants to marry someone with a strong mind (Ch. 7), which he does not believe Anne to have. He thinks her as unstable as Henrietta. It is the worst evil of too yielding and indecisive a character, that no influence over it can be depended on. Ch.10 He is quite happy accepting the attentions of the Musgrove girls, especially Louisa, when he think she has the firm mind that Anne lacked. "My first wish for all whom I am interested in, is that they should be firm. If Louisa Musgrove would be beautiful and happy in her November of life, she will cherish all her present powers of mind." Ch.10