To delete everything Ruby-related? Delete everything Ruby-related. I believe that would be /usr/bin/ruby, /usr/bin/irb, /usr/lib/libruby.* and /usr/lib/ruby.
Though personally, I just left it all and installed my own copy in /usr/local, which seems to be the more standard location anyway.