]..."Depend upon it, my dear, that when there are twenty, I will visit them all."

I think Mr. Bennets wants to tell her that he decided not to visit Mr. Bingely no matter of what will happen, that it is impossible or unlikely for twenty like Bingely to settel in there neighborhood.