Summers's critics have repeatedly mangled his suggestion that innate differences might be one cause of gender disparities (a suggestion that he drew partly from a literature review in my book, The Blank Slate) into the claim that they must be the only cause. And they have converted his suggestion that the statistical distributions of men's and women's abilities are not identical to the claim that all men are talented and all women are not--as if someone heard that women typically live longer than men and concluded that every woman lives longer than every man. Just as depressing is an apparent unfamiliarity with the rationale behind political equality, as when Hopkins sarcastically remarked that, if Summers were right, Harvard should amend its admissions policy, presumably to accept fewer women. This is a classic confusion between the factual claim that men and women are not indistinguishable and the moral claim that we ought to judge people by their individual merits rather than the statistics of their group.
While you're at it, also read Ruth Marcus's view in the Washington Post.