Born in 1953, he showed his extraordinary promise in music at a very young age. He took his initial training from his father, Shri Ajit Chakrabarty. Later he took his music lessons from Shri Kanai Das Bairagi in 1960. His music career flourished under the guidance of Pandit Gyan Prakash Ghosh. He joined the Rabindra Bharati University where he stood First Class First in both BA and MA. His score in MA is still unsurpassed. In 1971, he became a disciple of Ustad Munawar Ali Khan, the son of the great Patiala Maestro Ustad Bade Gulam Ali Khan. Due to his love and dedication for music, Ajoy ji is now regarded as an authentic and leading exponent of the Patiala Gharana.