The same noun can be measured by different quantifiers. The diversity of quantifiers comes from people’s various life experiences. It is the embodiment of people’s metaphorical thinking. The mechanism of the diversity of quantifiers can be examined by image schema theory. The construction of“quantifier + sorrow” in Song poetry is searched through the CCL corpus, and the conceptual metaphor of “sorrow” is analyzed by container schema, part-whole schema, up-down schema and path schema. It is found that the diversity of quantifier stems from the psychological mapping of the donor, and what kind of quantifiers are chosen depends on the empiricist’s experience cognition and metaphorical thinking.