As a writer, it’s more than just a day job and a family life to juggle (unless you’re fortunate and don’t need an outside vocation to survive.) The writing has to be done too, and that will come at the expense of your friends and family. You’re not carrying a full-time job — you’re working two jobs, one of which has you at the corner desk in the bedroom, pounding words into your computer.
The difficulty lies in perspective. You need to concentrate on attaining your writing goals or you won’t be a success at writing. Your family, no matter how accepting, will experience feelings of neglect because you prefer your fantasy worlds and characters over them. I know. I have a super-supportive woman at my side who still feels ignored when I get into a story.