Print the budget report for the specified budget selecting Print Zero Balance Budgets - No.  This will verify there are no records there.

Preview the Budget Revision register to verify there are no records there for the specific budget.  If there are no records in either you should be able to delete.

Thanks for the try.  It did not work.  I even created a new Budget code with no budget in it so that I could copy the new blank budget to the budget I want to delete.  Now the budget that I want to delete shows nothing in the Budget Revision register and nothing prints when I try the Print Zero Balance Budgets (no).  I then went into setup and it still stated that there was activity in the budget code even though through the checks you mentioned, there is nothing there.

Does anyone have any other ideas?

Did you find any resolution with this? I am trying to do the same thing. I misnamed a budget code, copied a budget there and now I can delete it. Thanks!

When printing budget report did you print for all available fiscal years?