Focusing on the writings by Matsuoka Yukiyoshi, author of Gosho-Nikki(Matsuoka's memo) and Buke-Teitaku-ko(On the residence of samurais), in which the medieval residences of the court nobles and of the samurais were described respectively, this paper examines the sources and the influences of knowledge on the ancient and medieval residences obtained by the early modern scholars on ancient Japanese customs(Yu-soku-ko-jitsu). Through the analysis of the texts above and other documents, it became clear that Matsuoka's knowledge on these subjects had been obtained not only from ancient documents or visual materials, but also by visits to the existing buildings, to the Palace and the houses of nobles for example, or through communications with court nobles and officials in Kyoto as well. The contributions of Matsuoka's knowledge is also discussed in various contexts, such as the annotation projects of ancient literatures as Genji-Monogatari, or compiling projects directed by Edo-Bakufu, both involved Matsuoka himself.