] I was wondering if it was normal for young men to stay "alone" in a house with just women.

Yes, it would have been perfectly acceptable. Mrs. Dashwood was an older, married woman(actually a widow), and as Marianne's mother nobody in that society would deny that her first priority would be guarding her daughter's reputation.