I did EVERYTHING, and was damn near 1-hit territory on the final boss. I would have finished the game, saved, and then resumed and done everything else, but I was avoiding spoilers and didn't know that. FWIW, I believe the portals are red when your party level is below the recommended power needed.