Sure! The thing to do is not to quit the full-time job until the part-time one can completely and consistently replace its income. As the others have pointed out, the more you can do with equipment and supplies you already have, the better. I've done both -- bought equipment to start a biz and started one with what I already had. The shoestring biz is the one that lasted.