This issue is resolved when restarting Minecraft, as you're not supposed to tamper with that folder anyway.
Well, you did suggest yourself to delete Downloaded Replays from the folder directly. Unless if you want to add a function to delete the replay's through the game's interface, there is no other way of doing it.