There are no powerful people only scared people?

Does anybody agree with this because powerful people like Hitler, Osama Bin Ladin ,sorry for spelling, and etc are not any more powerful than you and I. The only reason this types of people can have such impact is because people let them. If everyone were to just ignore them they would drift into no where. What are your tought's on this.