That's the nice thing about being a Fed - never having to say you're sorry. You can destroy a man financially with trumped-up charges - or murder his son and his wife - and get a promotion when all is said and done.
There is no problem with buying and selling these silver bullion coins, for that's all they are: bullion.
Interestingly, at the founding of our country, a "dollar" was meant specifically to denote an exact weight of silver, based on the most common silver coin circulating in the colonies, the Spanish "Piece of Eight." That is, a dollar just meant "a coin created by the U.S. mint containing as much silver as a Spanish piece of eight." IOW, a dollar was an amount of silver.
Over the past 200+ years, this understanding of the word "dollar" has been debased and bastardized until it has lost its original meaning, and a dollar is just a paper fiat bill, backed by nothing but the faith and credit (sic) of the U.S. govt.