Yes - if you're already asking "should I leave?" the situation is bad.

I'm with you - it's fair to address the challenges, set some boundaries, and see what happens - but if after a few more weeks/months it's not better or you're still asking if you should leave, then leave.

Most people and organizations are change-resistant. That's why we stay, of course - but it should also be why we go - because the other person/organization/entity is unlikely to change. Give them a chance, sure, but if they return to form, that's all you need to know.