I'm guessing you want to keep the com. accounts so you can do them nights/weekends while working a regular day shift somewhere else?
If thats the case it makes sense to me to drop the res. since they are least likely to want you there when they are.
If you are working a shift where you will have days free then I would lean towards keeping the res.
I would find another LCO that could handle your res. accounts, let the customer know whats happening and why, and that you have a plan to take care of them.
If you want people to notice your faults, start giving advice.