My dog dilemma

So here the thing I’ve had my dog for over 3 and a half years I rescued him from a shelter we have always lived with my family so he was raised around them. I’ve been with my GF for over a year and 6 months my girlfriend is pretty allergic to my dog and has been getting sick more frequently this year. I got my dog with my EX, Who stayed home while I was working to care and take out the dog. Since then me and my current girlfriend have been living with my family and the dog. We live in a 3 bedroom apartment with no yard so my dog needs to be taken out. Outside of me my family doesn’t really take him out except on occasion my mom works full time and is often gone. I work full time and will be starting school soon. My girlfriend is also in school and working full time. So we both will be gone for long periods of time in the day and night. So the dog is left alone most days in the apartment. He is also seemingly getting sick constantly. We have come home to multiple accidents on the floor from no one being able to take him out. My family said they would step up months ago to help care for the dog and haven’t. My GF is suggesting we rehome my dog To a family better equipped to take care of him. My family specifically my mom doesn’t like this idea. she swears she will take care of my dog but she hasn’t shown any signs of being able. My GF’s allergies plus the lack of care outside of us for the dog. Has made a really tense living situation. My girlfriend is wanting to move out which my family agreed to take the dog. But she feels the dog won’t be taken care of if we leave it. We also can’t bring him along because of her allergies. I’m not sure what to do because I see her points of view which are valid the points she brings up make sense and are hard things to talk about. My family has failed to step up like they said they would. Am I bad for keeping my dog and gf in a bad situation for both of them? What would you guys do?