The word `all` is referring to the sins of the whole world and its judgment being placed upon Christ Jesus.
The original King James version of the bible italicized the word `men` because the translators assumed that is what he was referring to.
Jesus had no delusion that all men would actually believe on Him as the prophecies told how He would be despised and rejected of men Isa 53:3.