The Chok Thara 2 boat sank near Koh Ngam and Koh Kalok and the authorities were alerted at 9pm.
Initially, eight tourists and three crew members were rescued and five tourists were reported missing.
Chumphon Governor Narong Polla-iad said on Thursday that rescuers later found four women and one man trapped in the boat.