A problem that will solve itself. Since parental preference is now the primary determinant of family size it will come under Nature's lens. There will be huge negative selection pressure exerted against non-breeders and their genes will be swept out of the gene pool en masse. Fertility will recover, likely within less than 10 generations or 300 years and we will be back to growth - and to ravaging the planet like never before.