It really shouldn't take that long. Have you tried a Cold Reboot (Battery Out, wait 15-30 sec, Battery Back in)? Sometimes that will help.
I'm Set up the same way as you and don't have any problem switching Profiles.
Let us know how this works out.