There are safeguards.
Like the secret courts that have approved virtually every request from every analyst? The only true safeguard we have is the sense of right and wrong of those individuals that make up our intelligence organizations and their commitment to follow the constitution. The problem is that as our society has “advanced” these past few decades people's sense of right and wrong has been blurred to the point where their judgment may not be what you think that it is.