Data in Onedrive\SharePoint - How often does it get updated?

SOLVED

Hi, 

I am writing a dashboard that pulls data from Sage along from other software packages used within our business. 

I note that with the Office365 integration of Sage 50 Cloud, once enabled it dumps some xlsx files in a O365 group (see https://ask.sage.co.uk/scripts/ask.cfg/php.exe/enduser/std_adp.php?p_faqid=35334)

My current process includes copying these files into an Azure storage account, and then importing into a SQL Azure database. The extract to azure storage is working, and now i'm working on the import to SQL. the proof of concept works, however i notice that the files change in size and contents regularly? 

What is the process that Sage 50 C uses to update these? Looking at the version history, these file sizes change considerably, without a pattern. 

If the files were consistent each time, i'd just drop the tables in the database and reimport. However, its not every friday, or not ever time, which makes it difficult to tune my process logic. 

See an example of the version history of transaction.xlsx here. 

Can anyone explain the logic here? Would be intrigued to hear what others have. 

For note - the Sage Dashboard \ Sage Intelligence dont have the functionality we desire. We are planning on linking data from sage against our Job Management System . For a basic example, to understand if an invoice has been paid against a project, so the team can either proceed with the work or wait. Just one of many requirements. 

thanks, 

  • +1
    verified answer

    Hi Tom,

    Thanks for using Sage City.

    The sync of these files is controlled from within Settings > Company Preferences > Office 365 50c > Sync Settings.  Each file is updated as required when a change in the local program has taken place. If a file fails it will attempt to sync again which may be why the file size is different. The size may also change if a restore of data occurs or further transactions have been added.

    We're currently in the process of migrating the Office 365 integration away from .xlsx files and holding the data in Microsoft SharePoint to help with performance.

    If this has answered your question please click More > Verify Answer.

    Regards,

    Ian

    Sage UKI

  • 0 in reply to Ian C

    Hi Ian, 

    Thanks- very useful. 


    Do you know when the new process will be in place? I'm halfway though developing our process for obtaining the data via XLSX, so there is little point me continuing without development if this method is going to be retired. 

    Tom

  • 0 in reply to tom-webbyates
    SUGGESTED

    Hi Tom,

    We're currently working on this now and will be available from July / August 2020.

    If this has answered your question please click More > Verify Answer.

    Regards,

    Ian

    Sage UKI

  • 0 in reply to Ian C

    Do you know if it will keep the same structure as the XLSX files? or will it be dramatically changed?

    Again, it determines how much effort i put in now with existing process and then re-engineer later, or just wait until it's live and then start development on our process. 

    Thanks, 

  • 0 in reply to tom-webbyates
    SUGGESTED

    Hi Tom,

    At the moment I don't have the details on what the format will be. We'll update our knowledge base articles near to release once we've completed development on it.

    Sorry I can't be of further help at the moment.

    Regards,

    Ian Sage UKI