Are ALL files in my Premier Directory required


We only use the South African Tax Tables, but I have all the other countries in my Premier Directory.

The Backups take quite a while to run and the size of the Backup file is large - I prefer Backing Up ALL FILES & All SUB DIRECTORIES. 

Can I reduce the size of my directory by deleting files not required ?

Thank You & Kind Regards