Zealots for population control have always had the poor in their sights. Until it fell out of fashion a decade or more ago, "population control" always targeted the hapless peoples of the Third World as the ones who we needed to stop breeding. Holland is the most densely populated major country in the world but there was rarely any talk of too many Dutchmen.
P.S. The most notable exception was Nigel Powers.