It means inexperienced or ignorant people often do things without really thinking things through. They end up doing things which informed or experienced people would avoid.
Examples: Rajeev was keen on becoming the President of the Club. Now he feels he shouldn’t have contested. Fools rush in where angels fear to tread.