Abstract: High-quality development of agriculture is an important goal of agricultural supply-side reform. Based on a provincial panel data from 2000 to 2018, this paper constructed an evaluation index system of the high-quality development of agriculture from four dimensions of economic benefit, ecological environment, agricultural modernization level, and rural development level to analyze the high-quality development of agriculture. In addition, this paper also examined the relationship between rural infrastructure and the high-quality development of agriculture by a system generalized method of moments. Results show that the level of high-quality development of agriculture in various provinces and cities from 2000 to 2018 has been steadily improved. And the effects of different rural infrastructure on the high-quality development of agriculture were obviously different. Among them, water conservancy and communication infrastructure had some significant positive effects on the high-quality development of agriculture and rural power and medical infrastructure significantly inhibited the high-quality development of agriculture. While transportation infrastructure had no impacts on it. Therefore, this paper provides the following suggestions to ensure the high-quality development of agriculture in China: strengthening the construction of water conservancy and communication infrastructure, enhancing the maintenance of electric power and medical infrastructure, and increasing investment in transportation infrastructure, especially in the central and western regions.