India, United States, Japan and Australia will hold a joint naval exercise from November 3 in the Bay of Bengal, appearing in it for the first time in a decade.