How high have you been running since you got your pump? 86 is not a low, but it might feel like one since you're accustomed to running so much higher all the time. You've only been on the pump a short while, and I would think you should still be getting help getting the settings regulated. I know nothing about insulin or pumps, but I think there's basal testing to be done, and there are good books which outline this process in explicit detail - "Pumping Insulin" by John Walsh is one, I believe.
And NO! You should not go off the pump! It's going to save your life! 86 is NOT low, even though it feels like it!
I'm backing out now because we have plenty of qualified people here to advise you on this - take care.