Alright -- I'm going to give you the blunt answer, and this is coming from a 20 year old who wants to pursue the similar dream you want to.
The answer is no -- no, it is far from wise to leave your job that is giving you a steady income and gambling all of that on trying to finish your book.
@wumblebumarts and a few others hit it directly on the nail, and I'm here again to basically repeat what they're saying.
You really need to evaluate your living and financial situation before you think about trying to get published. As of right now, based on how you've described your situation, quitting your job would not be the right course of action. You need some type of income to support yourself, your health, and your living situation.
Not caring about money is not the same as needing money. You don't have to have a lot of money in the sense of "rich, wealthy, living it up in Beverly Hills". You just need enough money that helps you live comfortably, safe, and stress-free. Because lemme tell you -- you will not be able to focus on your writing if you're worried about money and where you're going to live. As messed up as it is, we live in a society where money is a key in our security.
I get it -- adulting is hard. I'm 20 years old, and I'm still not ready to be an adult. No one ever is. There is no narrow path to being an adult. It comes gradually with experience, maturity, and age. But even if we're not ready, we still have to take on the responsibilities that come our way.
I want to become a published Graphic Novelist with several comics published. But that's a very competitive field, and there is no guarantee that A) I'll get published and B) I'll make enough money to be supported. I can't bet my security on that. So, I'm majoring in the next best thing I adore -- Electrical Engineering. That is going to guarantee me an income that can support my passion. And right now, I work an paid internship that's an 40 hour/week job. I find time to work on my comics after work (which is 3 hours a day before bedtime).
It might not be at the pace I would like to work, but I'd rather have some time to work on my comics and still be secured than to have all the time in the world but worry about money, worry about where I'll be living, and worrying about my security.
It's not uncommon for artists and novelists to take up working hours while doing what they love. Stephen King is a strong example of this -- he majored in English and was a teacher before he became a writer. He already had an income coming in to support him.
The days of the starving artist are slowly dwindling. Barely anyone wants to struggle for their art these days. They love what they do, they're passionate about it. But they also love to be able to eat, have money, and be secured.
If you do like the work environment that you're in, if your boss is actually caring about you, and the income is steady and giving you comfort -- do not drop it. You just have to learn to compromise and time manage between your job and your passion like the rest of us. You have to learn how to manage times with your friends, between your working hours, and between your passion.
There really isn't a short-cut way to do this. Everyone has to do this sooner or later. I'm doing it right now, and I think I'm handling it pretty well. I might get overwhelmed sometimes, but I do what I gotta do to make sure I feel safe and secured enough to continue my passion.
I know this novel is important to you. It's your baby, your child. As a fellow creator, I definitely know that pain of putting it to the side. But as a person, I will still tell you that your health is also important. Your security is also important.
All of that is way more important than your passion.