Yeah, it really varies by case. Testing is really the only way to reveal what the memory limits should be for your app. Generally, you should have different cache limits based on the amount of system memory. This is what WebKit does. Systems with less tha 512MB of memory keep less information in active cache than systems with more.
But like I said, it's really an app by app thing.