Sakari Momoi died of chronic kidney failure at a hospital in Tokyo on Sunday, Jiji Press reported, citing Saitama city officials.
The resident of Saitama city turned 112 in February, and was recognised as the world's oldest living male by Guinness in August.
The native of Minamisoma in the north-eastern prefecture Fukushima prefecture had been to be an agricultural chemistry teacher and principal of public high schools.
Momoi's death makes Yasutaro Koide, the world's oldest living male.
He was born on March 13, 1903, according to the US-based Gerontology Research Group.
The world's oldest living person recognised by Guinness is Susannah Mushatt Jones, a resident of the US state of New York, who turned 116 on Monday.