I totally agree it is illogical, but it is the case. Through a little research I found out what I needed to get rid of, moved it using single-user mode and now it starts up fine. It seems that it really is the graphics card that is screwed up, and somehow deleting GeForce.kext lets it ignore that fact.
Now the only limitation is that I can't do anything that needs to use the graphics card ... *sighs*.