Where to start
 

I've been looking at different Bolton’s intake, exhaust, pullies, etc.... Where should I start I’m looking for the most bang for the buck. How much NOS can an AT rx8 handle? Can the engine handle it being used a lot? I need to do something soon; I can't stand how slow it is. I’m new to this whole rotary engine stuff.

Start in the AT Specific Performance Mods forum section!

Be forewarned - you can make minor improvements, but you're not going to make it fast. You need to sell/trade it for a 6 speed manual RX-8 if you want to have a much quicker one. There's simply no getting around that!