Scrolling flys on my dual867 and it is fast on my cube 450. I am using default settings for the columns. Do you possibly have custom view, running in millions of colors. Reducing the size of the window will help. It will never be as fast in X as in 9 on the same hardware.
What are the specs of your Mac?