I think the descriptions tell us more about the person talking than they do about Mrs. Elliot. I think Col. Wallis is trying to help Mr. Elliot by making his marrying her seem reasonable so he describes her in the best possible light. When Mrs. Smith says she’s “ignorant and giddy” she’s trying to justify why she encouraged Anne to marry Mr. Elliot so I think she may be stretching a bit.