Should negative purchase invoices be entered?

Hi Everyone,

I have a few invoices in payables that were entered as negatives because we got a credit. What do I do with them now since they keep a negative balance for that vendor? I have paid invoices to them since so these ones will just forever be there. Do I just delete the entries?

Thanks!