No communication possible when calling out.

I have 2 trunks from SipStation and one DID. I have one extension configured to receive phone calls through the DID and it works fine. However when I try and make a call out to the same phone number that called in we can't hear each other. Any one have any idea why this might be happening? I would say firewall issue but wouldn't that cause problems with calls coming in also?