How does the World Bank provide loans to countries? Do they create currency, or use another mechanism?

Yes, it is a currency credit to the Central Bank of the country, via World Bank's designated banks. They don't issue currency per se (in physical form). Its all electronic. Think of it as a large wire transfer!