Legend says, in 0020A.D., when Yamatotakeru no Mikoto was on his eastern campaign, he visits this sacred spot and ordered to built Torii gate, and gave the imperial proclamation that people should climb up Mt. Fuji from this Torii gate. In 788, the first shrine was built, and in 1615, the current shrine was built by Torii Naritsugu. There are many shrines and buildings which remains over 300 years. East Shrine and West Shrine are chosen as the national historic assets of Japan.

In 1561, Famous Daimyo, feudal lord, Takeda Shingen built East Shrine and prayed for his great victory at the battle of Kawanakajima.