If you stop exercising your penis ,it will shrink even if you never did pe.
To mainain requires far less time than to make gains, some people find sex enough, others do reduced jelq and/or stretching routines.