Emma felt the sense of pleasure and the sense of rendering justice. I interpret "rendering justice" to mean that Jane is being punished for for the imaginary crime of having seduced Mr. Dixon's affections from his wife by being destined to be a governess. Unless Jane married a wealthy man, she had to become a governess to earn a living. Why should Emma feel pleasure for Jane's punishment? Emma enjoys her feelings of pity for Jane.