As an effective form of industrial poverty alleviation, rural tourism plays an important role in driving rural economic development, promoting agricultural transformation, and upgrading and increasing farmers’ income and wealth. Taking Leiyingzi village in Chifeng City as an example and applying the Actor Network Theory, this paper analyzes the composition and translation process of the actor network of poverty alleviation of rural tourism, and discusses the mode and mechanism of poverty alleviation through rural tourism. Results show that: poverty alleviation through rural tourism in Leiyingzi village is an actor network composed of heterogeneous actors such as the government, village committee, local cooperatives, tourism companies, tourists, natural environment, and tourism resources. Among these actors, the village committee, cooperatives, and tourism companies play as the key role actors. Within the framework of the actor network, Leiyingzi village has built a model of poverty alleviation through rural tourism as “leading by the village committee, cooperative operation, collective income and increasing income for poor households”. Leiyingzi village has formed the mechanism of “three help and two alleviation”, namely industry, companies, and rich families helping alleviate poverty, additionally, poverty alleviation by employment and by service. The poor villagers have been lifted out of poverty through asset transfer, entrepreneurship, employment, and dividends. However, there are many challenges in the process of rural tourism poverty alleviation in Leiyingzi, including the villagers’ weak right of speech, the lack of rural tourism talents, the inadequate supervision of cooperatives and tourism companies, and the poor villagers’ low participation. Therefore, to promote the sustainable development of rural tourism and the improvement of tourism poverty alleviation efficiency, this paper suggests that the grassroots party organizations should further play the leading role, more new actors should be included, and farmers’ rights should be protected and strengthened.