Prime minister Narendra Modi will on Wednesday take a holy dip at the Hindu festival Maha Kumbh Mela which is taking place at Prayagraj in Uttar Pradesh, media reports said.