The man does no reading (other than the book of books), and has no interests outside of being seen to live as a Baronet. His interests and self worth all flow from his "high" social standing. He has no pastimes. He doesn't really have any interest in discussing music, art or literature, does he? The reason he attends functions in Bath is that they provide him with opportunities to be admired and respected. All he has to offer are his title and his appearance.

He can take comfort in the knowledge that he socially outranks most of the people in Bath. And while he's about town, he inspects everyone else's appearance. Finding them wanting, he can take comfort in knowing that he is better looking than they are, too.

Insofar as appearance and social standing are the only things that interest him, and are the yardstick by which he measures everyone -- in his judgment he will always find himself superior to nearly all others around him, will he not?