Previous studies on audio-visual interaction such as the ventriloquism effect have indicated cognitive (or context) factors as well as sensory (or synchronous) factors could make the interaction. In these studies, however, visual attention seems to have been neglected. Thus, it has been still unknown whether the visual attention affects the interaction or not. We investigated the contribution of the attention factors to the audio-visual interaction by comparing the sound localization biases made by attentional factors and those by synchronous factors. Three subjects participated in the localization tasks in horizontal and vertical orientations. As the results, we found small influence of the attentional factors upon the interaction in the horizontal orientation, and no influence in the vertical orientation. On the contrary, the effect of the synchronous factors was larger in the vertical orientation than in the horizontal orientation. We concluded that the visual attention could affect the audio-visual interaction slightly, and that the influences of the attentional factors and the perceptual factors upon the interactions were made in the different processes.