Whatever provides for you and your family's essential temporal welfare is what you must do. To not provide to the maximum physical ability you've been given is to be prideful and would be happy receiving welfare that the rest of us pay for.
Of course, this is only if the work adds to your overall asset. If the job is actually costing you more than is coming in then you may want to rethink the situation. For instance travel expense, paying for food on break and benefits.