China is one of the largest centers of genetic diversity of Oryza sativa L. in the world. Using a genetically representative primary core collection of 3,024 rice landraces in China, we analyzed the genetic structure and intraspecific differentiation of O. sativa, and the directional evolution of SSR. The genetic structure was investigated by model-based structure analysis and construction of neighbor-joining phylogenetic tree. Comparison between genetic structure and predefined populations according to Ting’s taxonomic system revealed a hierarchical genetic structure: two distinct subspecies, each with three ecotypes and different numbers of geo-ecogroups within each ecotype. Two subspecies evidently resulted from adaptation to different environments. The different cropping systems imposed on the subspecies led to further differentiation, but the variation within each subspecies resulted from different causes. Indica, under tropical-like or lowland-like environments, exhibited clear differentiation among seasonal ecotypes, but not among soil-watery ecotypes; and japonica showed clear differences between soil water regime ecotypes, but not among seasonal ecotypes. Chinese cultivated rice took on evident directional evolution in microsatellite allele size at several aspects, such as subspecies and geographical populations. Japonica has smaller allele sizes than indica, and this may partly be the result of their different domestication times. Allele size was also negatively correlated with latitude and altitude, and this may be interpreted by different mutation rates, selection pressures, and population size effects under different environments and cropping systems.