Investigated and researched the retaining structure of a rural residential brick concrete house in the north of Hunan and the indoor thermal environment conditions, and found some problems such as poor thermal performance of house envelope, high energy consumption, low quality of indoor thermal environment, etc. Aiming at the problems and combining with the regional climate characteristics in hot summer and cold winter area proposed passive-house design optimal scheme of reasonably selecting house orientation, improving retaining structure thermal performance, controlling window wall ratio and natural ventilation, etc. Analyzed the influence of the optimization strategy on the indoor thermal environment improvement by Ecotect software. Designed the experiment scheme by the orthogonal testing method, calculated and analyzed the PMV values of the typical day of the year of nine schemes, and obtains the optimal residential design of north Hunan.