I thought that it was interesting that Sir Walter does not like Anne because she didn't look like him--she has mild dark eyes and delicate features. If she doesn't look like him, wouldn't she look like her mother? It seems that Sir Walter did not object to his wife's appearance, so why does he object to hers? Maybe since his wife is gone, he has just become obsessed with his looks. He needs his wife around to keep him in check.