The IRS does not make the tax rules, lawmakers do. This is a simple fact of how our country operates, and it has nothing to do with inside knowledge we might have heard from our hairdresser's friend's cousin who used to work for the IRS.
As for your statement "The irs really is a big government scam that pilfers money for the government to pay specialist government programs" well, would you rather our country try to operate for free? Or maybe you'd rather do without highways, protection of the armed forces, the FBI, air traffic controllers, etc. Or maybe you would rather enjoy all those things ... but you feel someone else should pay for them. Maybe you just didn't happen to know that America enjoys some of the lowest taxes in the world, and our income taxes are pretty much at all time lows right now.
If you don't like where our tax dollars are going, or how the taxes are spread around, or anything else about America for that matter that's fine. Do something about it. Vote, get involved, maybe even run for office. The IRS works for you, for me, for all of us. They're not the enemy, they're just the guys at the cashier so to speak. We're the ones who set the prices and decide on what services we want America to provide.