I tried taping it off for hours and finally gave up. It was pretty much impossible with the complexity of the cage and related fabricated parts. So I ended up brushing it out, and then sanding, then brushing, then sanding, then brushing until eventually it didn't look bad (but not what I'd hoped for). Hopefully someone who reads this thread in the future can try you guys suggestions.
Once I put everything back in the interior and installed all the padding required it looks good. I know its going to get scuffed, chipped, etc. using it all the time anyway, and thats fine. I haven't been building it to be a show car, just a fun car I can go to different track events with and still drive on the street.
I haven't taken pics with all the padding in place yet but here's a few after I got everything back in.
