I would say...
No.
State of Nature theory a la Hobbes is and always will by position here...
People are desire-pursuing machines that need regulation and order by those most suited to the task and elected to serve the greater body; the greater that body of people, the greater the needs, and so the more demand and strain there is on the governing body and, as such, the more need there is for it to grow in size and strength alike.
Rule by the common man in a libertarian system will naturally produce inequality and in-fighting, as all men are NOT created equally, and so when Joseph James Williamson III and his people are sitting pretty and Joey Jim Billy Bob Jr.'s people aren't, Billy Bob is going to see an over-simplified and rather violent solution to his people's problems, and so, with no greater government to step in and help Billy Bob and protect Williamson III, there will be greater trouble, less production, and tremendous squalor and loss.
Government is, admittedly, something of an evil.
But given that the common man's a fool, it's a necessary evil.
And the more foolish and greater amount of common men there are, the greater the need for that evil.
Or...well, you know...we could always increase education to decrease the number of commeon men...but NAH! that'd NEVER work, right? ;)