Rebuild Key Files - Strange Issue?

Greetings,

We're in the process of upgrading our ancient Sage 4.50 to Sage 2018. Ran into a strange issue with regards to rebuilding the key files prior to migration.

All the files were able to be rebuilt and optimized without any issue except for one file. This file fails the verification test, however it will rebuild / optimize without any errors.

After the file has been rebuilt / optimized it still won't pass the verification test though.

See below for output from the verification test.

IM_ItemCustomerHistoryByPeriod.M4T
     The read test failed.  Error #11: Record not found or Duplicate key on write

Here is the output if we uncheck the verification test.

IM_ItemCustomerHistoryByPeriod.M4T
     Record count indicates all records were recovered.
     Keys from the old file are being compared to the new file.
     No discrepancies have been found.

I went ahead with the migration, and then converted the data from 4.50 to version 6.00. When I perform a verification test on this file it still fails the read test. We're not seeing any errors generated in Sage 100 either.

I've talked to Sage support and they don't have any idea about this. One individual even suggested we ignore the issue. It was suggested that I post on the forum here and see if anyone else had a clue.

Is this something we need to be concerned about?

Thanks for any help you can offer.

Parents
  • 0

    I have had luck finding the bad record by creating a crystal report with all the fields.  Preview or export to excel and see what record it fails on.  Use DFDM and look at the records at and after the failure to see if you can see an issue.  You can in a test copy delete records you might think is the issue and then retry the verification test then you narrow down for sure if the record is the issue.

    I've had data that looked right on the screen but had hidden characters i had to delete to fix it.

Reply
  • 0

    I have had luck finding the bad record by creating a crystal report with all the fields.  Preview or export to excel and see what record it fails on.  Use DFDM and look at the records at and after the failure to see if you can see an issue.  You can in a test copy delete records you might think is the issue and then retry the verification test then you narrow down for sure if the record is the issue.

    I've had data that looked right on the screen but had hidden characters i had to delete to fix it.

Children
  • 0 in reply to Bvulliamy

    I messed around with DFDM last night so I understand a bit better how it works. I'll try what you suggested and see if I can locate the problem and report back.

    Thank you so much.

  • 0 in reply to Bvulliamy

    Hi, so I was able to dump all the data into a crystal report, and even export the data to excel. There were no errors during this process. Is there something else I should be looking for in the data? Perhaps something I could find within the excel file?

    Thanks again!

  • 0 in reply to MOB

    You don't understand. The error message:

    IM_ItemCustomerHistoryByPeriod.M4T
         The read test failed.  Error #11: Record not found

    Is telling you a record is not found. When you did the unmatched query you found records that were not in the customer master file. In a test company I would remove those records and try to rebuild the key files and see what happens.

  • 0 in reply to BigLouie

    I removed the records from IM_ItemCustomerHistoryByPeriod.M4T using the DFDM.

    I rebuilt just IM_ItemCustomerHistoryByPeriod.M4T and it still fails the read test after rebuild. No errors occurred during rebuild.

    Do I have to rebuild all the files, or just the IM_ItemCustomerHistoryByPeriod.M4T file?

    Thanks!

  • 0 in reply to BigLouie

    I went ahead and rebuilt all the files, still getting the same error when I try to run an integrity check on the file.

    IM_ItemCustomerHistoryByPeriod.M4T
         The read test failed.  Error #11: Record not found or Duplicate key on write

    Don't notice any problems when I run a stock status report. I don't know if this is a problem or not.

    Could something be wrong with the integrity check algorithm?

  • 0 in reply to MOB

    I've always hated error #11.  Note that is says NOT FOUND  or DUPLICATE KEY.  Two very different issues when you are trying to figure out what is going on.

    You might try doing a crystal report to see if you can isolate a duplicate key?

  • 0 in reply to TomTarget

    Hey Tom - In case you're ever on Mas90 Jeopardy Trivia, "Record Not Found" means your Error 11 was on  READ while "Duplicate Key" means it was on a WRITE. In this case in the Rebuild program itself "The read test failed" is the hard-coded part of the error message ergo it is "Record Not Found" on READ.

    MOB - This might be an "internal Error 11" meaning inside the physical file, in the key block of the data, there could be a key with an invalid record pointer. This is different from a normal Error 11. Anyway if this is true for you, it's not something you could spot with DFDM or via a report. Your best option is probably not to do anything at all as it's unlikely regular Sage programming would run into the error on this table.

    But if you're so inclined, there is an internal file repair utility (build into ProvideX but not created by Sage) that is not dictionary based that could be tried but you need to run it with an abundance of caution and make a backup of the file first. It's called *UFAR and it's cousin is called *UFAC (C = check, R = Repair). You might see odd results and then get confused more. E.g. Before running say you have 5,000 recs in the file/table. But after running you end up with 5,005, which means the rec count was wrong to begin with b/c the "file information block" was bad to begin with. Or it could say you have 4,995 recs but it won't say which 5 were removed. Maybe those 5 were not legit to begin with. I can't predict what you'll run into. Like everyone has said here, run on a copy / test company. To get more info on UFAR, you can search on it here in SageCity. The old KB article I wrote on it way back when I worked for Sage might still in the current KB but remember the abundance of caution I mentioned. 

  • 0 in reply to Alnoor

    Tom thanks for the comment.

    Alnoor,

    You wrote:

    Your best option is probably not to do nothing at all as it's unlikely regular Sage programming would run into the error on this table.

    Are you saying not to do anything, in other words ignore the issue? The double negative confused me.

    I am currently running the UFAC on a copy of the file from the test company just to see if it finds anything. I appreciate the input thus far.

  • 0 in reply to Alnoor

    Alnoor,

    I ran the UFAC utility and by the looks of the output it didn't find any errors?

    Thanks.

  • 0 in reply to MOB

    UFAC just doesn't go as far as UFAR does. You won't know until you run UFAR. I said your best option is probably not to do anything b/c unless I was remoted into your system myself and running this for you, I would not be comfortable with assessing the results and providing guidance on the next steps. Unfortunately, running UFAR is a gray area and results are not predictable even after running UFAC.