I agree almost completely, though I do think the expansion of Presidential power began with Andrew Jackson, who, oddly enough, believed in more power to the states, and who also refused to enforce a Supreme Court ruling. The expansion began then, and has just continued to snowball in the last 80 years. I'm also iffy on the power that Congress now has.
The whole federal government, in my opinion, is too big and has too much power. More and more it seems that we look too much to the President and Congress to solve all of our problems, when, in all likelihood, we could solve most of our own problems. As you said, give more power back to the states.
The power of the federal government now reminds me of what Gerald Ford said: "A government big enough to give you everything you want is a government big enough to take from you everything you have."