"Woody Allen never knew Soon-Yi growing up" - that's part of the problem (TW Woody Allen)S

Part of the judge's decision after Allen sued Farrow for custody of their 3 children.

Vanity Fair and Nicholas Kristof are not letting up, and good for both of them:

10 Undeniable Facts About the Woody Allen Sexual-Abuse Allegation

But one thing that always bothers me when the Allen issue comes up is: those who say, "oh, Woody never knew Soon-Yi growing up. He was never around." Isn't that simply more evidence of Woody Allen being a creep, especially after they had other children together? I don't think every family has to act or look the same, nor do I think everyone has to like or enjoy children, but for him to isolate himself to that degree was a red flag. (I am NOT blaming Farrow here.) If you don't like children, how about not getting involved with a woman who has many of them, who is quite obviously devoted to a large family?