Have you looked within the same fertility clinic for another doctor? Or ask your OBGYN for a recommendation. Or maybe someone on this site lives near you and can recommend one? Good luck.
Dear Steph,
A good place to start is the assisted reproductive technologies www.sart.org website- it lists clinics by state- and i think it has contact info- start calling.
I know the thought of a male fertility specialist seems tough right now, but what you should try to think about is going to the best place you can afford, or your insurance covers regardless of the sex of the doctor. They want you to have a successful experience almost as much as you do, and as it was my dh with the specific IF issue, I found it very helpful for him- the reassurance that it was not an insurmountable problem- and that we were in it together!