What HAGEhead said.
On the Apple TV, go to Settings, then Pair Remote. You may have to cover the Mini's IR sensor while you pair the remote, but afterwards it will no longer wake your Mini.
I have 3 Apple remote enabled items in the same room; an iPod Hi-Fi, Apple TV and a MacBook. I've paired the respective remotes to each and they don't bother each other.