The Fed is the "handshake" between the federal government and business (thus creating fascism). It's essentially a private stand-alone enterprise that can be used to circumvent obligations both the government and corporations have to the people. It's also a vehicle that uses inflation by printing money to the federal government and its failed business friends. Essentially, it's a stealth tax on state governments, middle class, working class, and other businesses not connected to the Fed.
Although, it's naive to think that simply destroying the Fed will stop the whole madness. The lobbyists are still there, so the merger between government and corporate power is still available to be used directly, but at the very least it stings a little less without the rampant inflation. Plus, there's nothing to stop them from building another Fed like semi-private enterprise later.
You're right that in the end everyone involved in the whole scheme must be stopped and held accountable/punishable. Honestly, there are so many corrupt government/businesses that shutting them down and rebuilding may take an entire generation. Wall Street is but a small part of this whole elaborate scheme. If you want to look at the biggest player on the corporate end, it isn't Wall Street, try Goldman Sachs.
Yes, it’s complicated; I’ve been studying the subject matter as an autocrat for years. There’s a reason why those who protest have little idea why they are there, yet sense something is wrong. Nobody is truly right/wrong in "picking the target." Bickering over the target is actually the last layer of defense the fascists have; don't let them prevail, when you're so close. . .