You don't mention this in your post, but the quote from chapter 4 also supplies the source of Elizabeth's prejudice against Darcy - that he hurt her pride.

I personally think pride and prejudice both apply to Elizabeth, rather than her just having the prejudice. After all, doesn't Mary say, in this very chapter:
"Pride," ... "is a very common failing, I believe. By all that I have ever read, I am convinced that it is very common indeed; that human nature is particularly prone to it, and that there are very few of us who do not cherish a feeling of self-complacency on the score of some quality or other, real or imaginary.