The physicochemical characteristics and consumer perceptions of two Fuji cultivars (Fuji and Royal Fuji) with six different size groups (3D: 30~39, 4D: 40~49, 5D: 50~59, 6D: 60~69, 7D: 70~79, and 8D: 80~89 apples/15 kg) were investigated to identify the ideal size and the drivers of consumer acceptability of apples. For the physicochemical characteristics, the weight, volume, specific volume, L, a, and b colors, hardness, pH, acidity, and brix of apples were measured. A total of 100 consumers were asked to mark the intensity of the characteristics (size, redness, glossiness, surface roughness, apple odor, apple flavor, sweetness, sourness, hardness, crunchiness, and toughness) to determine the ideal characteristics of apples before they were asked to taste the apple products. The consumers evaluated the apple samples in terms of their appearance, odor, flavor, texture, and overall acceptability; the consumers' intent to purchase such apples and willingness to pay for them; and the intensity of the aforementioned characteristics. Compared to the ideal characteristics of apples, the actual apple samples were rated low in their apple odor, apple flavor, acidity, sweetness, hardness, and crispness. The ideal size of the apples was between 4D and 5D. Their overall acceptability was highly affected by their flavor, followed by their texture, odor, and appearance. The acceptability of the appearance was highly correlated with the glossiness (r = 0.80), volume, weight, redness (r = 0.73), and size (r = 0.72). The consumer acceptability of the apples increased with the decreased pH and the increased Brix, hardness, and color b values of the peeled apples. The apple flavor, sweetness, hardness, crispiness, juiciness, and toughness during mastication were noted as sensory drivers of consumer acceptability.