A color transfer algorithm based on texture similarity was proposed by extracting multi-dimensional texture feature information of the image, with multi-dimensional texture information analyzed by principal component analysis (PCA) and linear discriminant analysis (LDA). The texture feature space was constructed. The image was then divided into different areas according to the similarity in the pixel neighborhood. In the divided areas, the mapping relation between texture similarity and chroma information was established to realize the color transfer. Experimental results showed that color transfer on the basis of texture similarity could solve the problem of color error diffusion in image edge with good color transfer effect.