This is an issue with slot loading drives that apple has never really addressed. I would try a few things. First, let gravity help, point the drive down. Also, you may want to try completely upside down, it sometimes works. Be careful when picking up your computer while it is on, no jarring motions.
Second, if you can get it out just a bit, test your reflexes and grab it.
Finally, ya, take it in.