Common factors are omnipresent in everyday life, e.g., people who do well in one cognitive test are likely to perform well in other cognitive tests as well, and vice versa. In vision, however, there seems to be a multitude of specific factors rather than a strong and unique common factor. For example, only weak correlations were observed between the susceptibility to different visual illusions, suggesting that the structure underlying visual illusions is multifactorial. In this thesis, I first examined the multidimensionality of the structure underlying visual illusions. To this aim, the susceptibility to various visual illusions was measured. In addition, subjects were tested with variants of the same illusion, which differed in spatial features, luminance, orientation, or contextual conditions. In line with previous work, only weak correlations were observed between the susceptibility to different visual illusions (i.e., between-illusion). An individual showing a strong susceptibility to one visual illusion does not necessarily show a strong susceptibility to other visual illusions. In contrast, there were strong correlations between the susceptibility to variants of the same illusion (i.e., within-illusion). Hence, factors seem to be illusion-specific but not feature-specific. In addition, the susceptibility to combinations of two illusions, which I call merged illusions, was measured to investigate how factors for illusions interact. The susceptibility to a merged illusion was strongly predicted from the susceptibility to the two illusions of which it was made, suggesting that factors for illusions combine independently to form complex illusory percepts. Second, I showed that individual differences in the perception of visual illusions are robust across the eye(s) to which the stimulus is presented, over a month, and when measured with an adjustment procedure or a method of constant stimuli. Last, I investigated whether a strong visual factor emerges in healthy elderly and patients with schizophrenia, which may be expected from the general decline in perceptual abilities usually reported in these two populations compared to healthy young adults. Similarly, a strong visual factor may emerge in action video gamers, who, contrary to healthy elderly and patients with schizophrenia, often show enhanced perceptual performance compared to non-video gamers. Hence, healthy elderly, patients with schizophrenia, and action video gamers were tested with a battery of visual tasks, such as a contrast detection and orientation discrimination task. As in control groups, between-task correlations were weak in general, which argues against the emergence of a strong common factor for vision in these populations. While similar tasks are usually assumed to rely on similar neural mechanisms, the performances in different visual tasks were only weakly related to each other, i.e., performance does not generalize across visual tasks. The results presented in this thesis highlight the relevance of an individual differences approach to unravel the multidimensionality of the visual structure.