I don’t think you’ll see that, because even with a greatly reduced government (if people achieve that) the government will still take in money for its operation.
The question is what form will the IRS take in that case, or even before any great reduction of government occurs. How can one make sure that these oppressive methods are not used and that “due process” is given its full measure under the law?
9% flat income tax. No deductions. No exemptions. 9% from the first dollar. IRS can be reduced to a few dozen employees or eliminated. Many lawyers would have to find honest work or cease eating. Resources would be released for further non IRS related waste fraud and abuse purposes. Government, alas, would see revenues increase steadily.
Yes, we need a federal tax collection agency to properly fund appropriate federal activities as the Constitution directs. Notice that the Constitution originally forbade "direct taxation" and an amendment was required to impose the income tax.
The IRS, acting in its legitimate role as federal tax collection agency, should consist of ... you ready for this? ... Two people, working two days twice a year.
Congress passes a budget. The IRS, such as it is, takes the bottom-line total of that budget, divides it by the number of members of Congress (both House and Senate), then sends each state a bill for that amount times the number of its Congressional representatives. That process will take two people no more than two days (if not about 2 minutes) to compute the tax bills and inform each state of what it owes. The two IRS agents chat around the water cooler until their 2 days are up, then go home.
A suitable period later (say, six months), the two IRS agents reconvene, review the rather large checks submitted by each state, deposit them, sort out any issues with doing so, and send the President a list of those states not in compliance and the amounts due.
Done.
Cheap.
Let each state determine how best to contribute its fair share to fund continuation of the Union.