Could your documents have turned up on WikiLeaks? If you do not have complete control over user access rights, the answer is YES.
With just 500 users, 100 systems and 100 folders there are potentially a quarter million user access rights to keep track of.