Even if they don't realise it can't affect them in any way, it's impossible for them to know whether or not you use it. All it does is copy everything that happens and lets you play through it again.
I agree. Server owners have no way of finding out whether or not you use it. All it does, is take the chunks loaded by the client itself and put it in a replay file.