So why are they wrong so often? Some interesting thoughts. Confirmation bias, complex systems, ego and more. Some say that people ask too much and them and demand predictions that can't be made. And strange that the article says many refuse to change their predictions/understanding when presented with solid facts.
I think the biggest reason is ego, conceit, and power. When one is a recognized expert, one enjoys great prominence, getting requests for interviews, book deals, honorariums and more . That kinda adulation, respect, and power corrupt us all.
Erlich, who predicted massive human famine, wasn't even an expert in that field but was an expert in butterfly populations(as per article)! He just took that data and observations and extrapolated it to humans. I doubt anyone asked him to do that. But his ego and experience told him his knowledge in one field would be great in other fields.
Another is that we tend to compartmentalize issues and their solutions. It is often wise to look outside of strict disciplines to see how other factors may influence a system.
Another is that it is impossible to predict with accuracy when one cannot know what breakthroughs science will deliver. Erlich predicted famine...cause he had no idea of the impact of genetics, herbicides, pesticides, mechanization, and more. In the peak oil issue I mentioned, no one could foresee with any accuracy the huge impact of fracking and directional drilling.
I am sure that is common in many other problems society faces. The power of human ingenuity cannot be quantified. It is the great unknown that we do not know..to paraphrase Rumsfeld. It seems that necessity is the true mother of invention. When a problem surfaces rest assured that somewhere someone will come up with a solution.