Fork in the road? Why the “mothers-at-home-are-depressed” studies are irrelevantPosted: November 6, 2013
They pop up with fair regularity in the press, a series of studies purporting to show that mothers at home are unhealthy or depressed. It’s implied that they embody a warning relevant to new mothers, that they offer them a vision of what may befall them depending on the choice they make.
But it turns out that these studies are so riddled with methodological holes as to scuttle any possibility of offering glimpses of alternative futures. The only predictive value they have is to foretell that a woman who stays home by choice risks being averaged in by statisticians with the smaller number of mothers who are at home primarily because they are ill or are engaged in an unsuccessful job search. And that’s just the beginning of the methodological flaws:
(1) The studies don’t compare women at similar stages of life, but rather contrast mothers whose children skew older with those who skew younger
When you read that a study has been done comparing mothers of “young children,” what age cut-off would you imagine was used? Three years old? Six? Ten?
To the Gallup organization, “young children” apparently means anything under eighteen years of age. That was the categorization that gave rise to the recent headline “Stay-at-Home Moms Report More Depression, Sadness, Anger.” The first paragraph reports that the study compared employed and non-employed “women with young children at home.” It takes a bit more reading to discover the generous definition of “young.”
What happens, then, when you take a population composed of women with children under the age of majority and break them into two groups, one at home and one employed for pay? It shouldn’t take a Ph.D. to realize that you get two groups which look significantly different with respect to the age of the youngest child; that the group of at-home mothers is going to skew towards younger children than the working mothers. Far from getting the comparison of staying home versus hiring daycare that the “young children” label would suggest, you’re simply getting confirmation of the common-sense observation that parents of younger children experience more negative emotions because younger children are more challenging to deal with than older ones. (If you like your common sense confirmed by research, a study of 200,000 people in eighty-six countries yielded the conclusion that “New moms and dads who feel overwhelmed by their babies can take comfort in the fact that almost all parents feel happier as they get older.”)
In short, the crystal ball isn’t showing that Future You at Home is likely to be sadder or angrier than Future You at Work at the same stage of life. It’s more like seeing that Future You at home with a two-year-old may be sadder and angrier than Future You at work with elementary-school-aged children. But there’s nothing here to say that Future You leaving a two-year-old at home to go to work would be any less sad or angry.
(2) The studies ding mothers as “depressed” for doing nothing more than reporting the realities of life with an infant – like interrupted sleep
The problem of not controlling for age of the youngest child becomes even more acute when you realize what the studies count as “depressive symptoms.” There is no clinical evaluation here. Mothers are reported as depressed on the basis of questionnaire answers. Oftentimes the at-home and working groups vary by very small margins in their average scores. In any contest in which you win depression points for reporting that your sleep was sometimes restless the previous week, it’s pretty clear that the group with more babies in the house is going to come out ahead.
Which is to say that it is glaringly invalid methodology to count one group as more “depressed” than another on the basis of simple reports of restless sleep when there is every reason to believe that the sleep disturbance doesn’t stem from underlying psychological problems but from external circumstances. This is true regardless of whether restless sleep might be a symptom of depression in some other population. And mothers in these studies not only get depression points if their sleep was disturbed by their infants’ nighttime habits, but bonus points if as a consequence of sleeplessness they check off that they sometimes have trouble “getting going.”
Other questionnaire answers which score as “depressed” similarly reflect the objective realities of life at home with children. “I felt like everything I did was an effort.” “I had trouble keeping my mind on what I was doing.” “I felt lonely.” That accomplishing once-simple tasks is harder with children in tow, that they frequently interrupt what one had one’s mind on – these almost inevitably characterize the part of the day spent in caretaking. The loneliness – well, I’d like to think that part is not inevitable, but the reality is that reduced interaction with adults is an unfortunate feature of being at home in our culture.
Certainly these are trying aspects of being a mother at home. But even a mother who manages these challenges well, who finds the benefits to outweigh the burdens, whose subjective mental health has not tipped over to the negative side according to any reasonable system of classification, is categorized by these studies as depressive simply because she reports honestly that her focus is often interrupted or that more adult companionship would be a boon. The mother with paid employment likely interacts with a wider variety of people who are less disruptive than toddlers. These circumstances may boost her mental health to a higher level – or they might be counterbalanced by other stresses or concerns. But you can’t answer that ultimate question by giving her happiness points simply because she reports that her daily experience includes more people and fewer interruptions.
(3) News flash! Women without health insurance report poorer health!
Suppose you are a woman expecting your first child at age 31. Ideally you would like to have two children spaced a few years apart, and stay home until the younger one is school-aged. You and your husband have saved enough to make this financially possible, and you will continue to be covered under the health insurance your husband gets through his employer.
But you read about a new study on behalf of the American Sociological Association reporting that women who engage in full-time, continuous employment following a first birth have significantly better health at age 40. Should this give you pause?
The answer again is this: Don’t be misled into thinking that such studies are comparing anything like you at age 40 having stayed home for nine years with you at age 40 having worked straight through. Here are the characteristics women had to have in order to be counted in the “stay-at-home” group in the 2012 study: They had to have given birth the first time before age 28, after which they had to have stayed out of the paid workforce for at least 12 years. That means that for twelve years they weren’t earning any money, not even from home (or at least not averaging more than an hour a week at it).
It turns out that when you define stay-at-home moms this way, you end up with a group that is distinguished from working mothers in other important respects. Perhaps the most relevant of these is that about a quarter of the stay-at-home category had no health insurance when they were interviewed by the researchers at age 40. Fewer than 10% of the steadily-working mothers were in that same boat.
So what the researchers were essentially reporting was that a group with a heavier proportion of non-insured women averaged up to have more health problems. When they ran an analysis in which they controlled for the ways the at-home and part-time workers differed from the steadily employed mothers – including the insurance differential – they were “able to reduce” the health differences to “nonsignificance.”
That is to say, this study turned up no health deficit for forty-year old mothers at home so long as they had health insurance. And under the Affordable Care Act, pretty soon all of them will.
Reduced to nonsignificance? That would be a fitting epitaph for this entire genre of research.
Here are three of the recent studies specifically referred to in this post, with more detailed analysis for those who are interested:
The researchers controlled for maternal age but not for age of the youngest child in the home. As noted above, this is especially problematic where the age range of children – from birth to age 18 – is so wide. The greater “struggles” of the at-home mothers may reflect nothing more than the fact that their group skewed towards younger children.
Gallup also reports that the stay-at-home mothers were more likely to report having ever been diagnosed with depression. Without further analysis – diagnosed before or after giving birth? – the implication that staying at home causes depression is completely unwarranted. The causation may work in the other direction: women diagnosed with depression may have difficulty maintaining employment and so end up classified as mothers at home.
This is the study to which Judith Warner recently referred in the New York Times, claiming it showed that “the negative effects of excessive mothering” included “more depression” among mothers at home.
The researchers themselves used the term “depressive symptoms,” a distinction which is often lost in press accounts. (Those “depressive symptoms” are the answers to the “CES-D” questionnaire described in the main blog post, the “Center for Epidemiological Studies Depression Scale.”) Also lost is the researchers’ acknowledgement that “differences between groups were small.”
This study does manage to control in part for age of the youngest child by comparing mothers-at-home and mothers working outside at fixed intervals after the birth of a “focal child” – not necessarily the first child.
But two problems remain. First, the authors make unwarranted assumptions with respect to the direction of causation in the early months, theorizing that their results show employment “protects against depressed mood.” But it may not be the case that mothers at home with six-month-olds or fifteen-month-olds report more disrupted sleep or more difficulty “getting going” than their employed counterparts because the fact of being at home has depressed them. Perhaps the causation is the other way around – that mothers whose babies happen to be fussier, or poorer sleepers, or whose babies may even have significant health problems, tend both to (1) wait longer before returning to work and (2) report on questionnaires that their sleep is disrupted and they have more difficulty with daily tasks.
The second problem is that although the two groups of mothers may tend to be matched for age of the youngest child in the early months, the authors collected no data on the birth of subsequent children. This may explain a particular pattern seen in the results. There were observable differences between the scores of employed mothers after six and fifteen months. Those differences virtually disappeared at 36 months, but were noticeable again at 54 months.
The strong possibility raised by this pattern is that the group still at home at fifty-four months was more likely to have another baby in the house, while for the working mothers the four-and-a-half year old was more likely to be their youngest. Once again, all the implications that the decision to stay home is causing depressive symptoms go completely out the window if the at-home group can score as more depressed just because having younger children leads to more reports of restless sleep.
This is the study which finds any physical and mental health differences between “steadily” working mothers and stay-at-home mothers reduce to nonsignificance in an analysis which controls for factors including whether there is health insurance.
To its credit, the study distinguishes “interrupted workers” – women who are in and out of the workforce as they experience multiple bouts of unemployment – from other categories, so that they are not lumped in with the at-home grouping or the part-time worker grouping. The interrupted workers do show lower health scores even with controls in place.
This is also the study which defines a mother as being at-home only if she brought in virtually no income for twelve years after the birth of her first child – a qualification met by only about 11% of the women in the study. Women who met this criterion, like part-time workers, averaged higher on a variety of potential stressors at the time they first became mothers, before their mental or physical health could have been in any way impacted by their life with children. Among other distinguishing factors, they were more likely to report prior health concerns limiting their ability to work, less likely to be natives of the United States, and more likely to have given birth as unwed teenagers. When the researchers controlled for these various factors – that is, when they ran statistical analyses comparing at-home mothers and steady workers who had similar metrics at the time of the first child’s birth – the at-home mothers no longer showed any statistically significant mental health disadvantage.
That, despite the fact that they were at that familiar methodological disadvantage of likely having younger children in the house when they were asked to complete their questionnaires at age 40. (It is impossible to confirm this fact as the researchers didn’t ask about or account for the age of the youngest child, but the group of women who had been home twelve years and had significantly more children on average than the steadily-working mothers were also likely to have younger children present.) Once again, questionnaire responses which are presumed to illuminate the impact of employment may be doing nothing more than confirming the mental-health challenges presented by younger children. This criticism applies not only to the CES-D, with its “restless sleep” questions, which is used in “supplemental models” in this study, but also to the “Short-Form 12” questionnaire on which this study primarily depends. Responders to the “Short-Form 12” are asked how often in the past month they have felt “calm and peaceful” and have “had a lot of energy.” Completely aside from work status, many parents would report that young children tend to drain their energy and detract from calm and peace in their surroundings.
Given their decision to categorize their subjects on the basis of twelve years of work history after the birth of the first child, and their desire to compare them all at the age of forty, the researchers had to exclude women who became mothers after the age of twenty-eight. They reasoned that there was no harm done; that if they had included women giving birth later – “women who delayed motherhood for career and education opportunities” – these women would have been even more likely to stay in the steadily-employed group where their economic and health advantages would have helped that group open up an even bigger advantage over the mothers at home.
I disagree. The question is not whether these women who were older at first birth – women who I agree would on average be educated and likely to engage in significant long-term life-planning – would in many cases have stayed in the workforce and stayed healthy. The question is how big the health differential would have been between the group of later-life mothers who did stay home and the ones who continued to work steadily. It seems to me much more likely that the gap between these two groups would be smaller than the gap between at-home and working mothers who gave birth younger – if for no other reason than that the “planners” were less likely to end up without health insurance. This group would likely have enhanced the health statistics of the mothers at home as well as of the working mothers, in which case excluding them from the study was not as inconsequential as the researchers suggest.