Prime Minister Narendra Modi will embark on a two-day visit to Sri Lanka to attend the biggest Buddhist festival 'Vesak Day' as its chief guest.