Home Minister Zahid Hamidi was quoted by The Star newspaper's website as saying the graves were found along the border with Thailand.
"But we don't know how many there are. We are probably going to find more bodies," Zahid was quoted as saying.
Earlier newspaper reports said the graves may contain the bodies of hundreds of migrants from Bangladesh and Myanmar.