If you are a layperson you are not expected to abandon all of these urges apart from the actual sexual misconduct, which is mainly harm to others, and depending how people view it, might or might not include masturbation (for some claim it takes two to tango). You are also not expected to abandon your wife as the object of your love and so on.
Unless you, of course, take up Eight precepts, instead of Five. You can, however, attain a decent life full of happiness, joy and bliss getting away with just this simple way. For example, I only take Eight precepts occasionally for short period of time, i.e. a month.
I would not advise to overthink that and be too harsh on yourself and just try to be reasonable about it instead. Too much restriction, too quickly, and the one might get a certain extent of back pressure which causes misery. As such, especially when suppressed, things might get worse, even out of control. In short, take it easy, there will be time and day where you have certain enough insight in Emptiness, or shall I say, things deprived of their Self essence, that you no longer perceive women in such way.
Now, there are antidotes for sexual lust in Buddhism, it might be helpful to read on overcoming Five Mental Hindrances or in Mahayana, Seven point cause and effect method, where practitioner equalizes self and the others completely, for instance, viewing other beings as objects of deepest endearment - here, all women as our mothers.
But most importantly, cultivate patience in regard to such basic and powerful innate instincts, so do not tread on yourself by mistake; this is not liberation from suffering, this is applying it.