The most damning assessment of Sir Walter's failings come from his own daughter:

she could not but in conscience feel that they were gone who deserved not to stay, and that Kellynch Hall had passed into better hands than its owners.

She actually think her father and sister have gotten what they deserve and is only surprised that they see it is as blessing to remove to Bath and live in a tiny house, when she sees it as just desserts.