You're right, they are only a couple bucks. Has it ever been replaced, do you think? There is some risk of damage to the evaporator pipe which is resides in if it is hard to remove. If the pipe is straight and it's been out before, you should be able to get it out with needle nose pliers however there is a special tool you can buy that might make it easier and safer. Installing the tube can be difficult as well, you might have to make a tool out of copper pipe to push it far enough into the evap pipe. I posted a picture of the tool I made elsewhere, I can post it if you need to see it.
I'd say if you still have trouble after recharging, yeah, evac again and replace the orifice tube and the accumulator.