Is there a way to delete the reversal entry? I have tried to create a new payment with the old check number. However, I am getting a error message saying that this is a duplicate check number.

You've got the right idea.  Enter a new payment but add a leading zero before the cheque number.