Yeah, directly connecting to the modem will get rid of all the stuff to deal with NAT/routers/etc.
Though if your router has a DMZ option, you can make use of that, too. What it does is say "Any traffic that isn't port forwarded to something else goes to the DMZ IP". You have to assign a static IP to your computer to make use of it, but it's a way to leave the wireless available.
