How breastfeeding researchers fool themselves — and what we can do about it

image

The journal Nature published an outstanding piece on one of the most serious problems in scientific research today: a great deal of research is so flawed that it cannot be reproduced. It’s a problem that strikes at the heart of science, since the gold standard for establishing the truth of research results is that other scientists using the same methods will find the same results. Irreproducible research is research that is worthless; it proves nothing and often misleads.

How scientists fool themselves – and how they can stop by Regina Nuzzo offers a comprehensive explanation of why so much of today’s research is not reproducible: simply put, scientists have a great personal stake in the outcome of research, and this personal bias leads to shoddy science.

[pullquote align=”right” color=”” class=”” cite=”” link=””]The bias is simple, pervasive and distorts a great deal of breastfeeding research.[/pullquote]

This personal bias differs in important ways from classic financial conflicts of interest. No money changes hands; there is no quid pro quo, and there are no university or journal rules to protect against such personal bias. Indeed, the researchers themselves are often unaware of the bias because is subconcious.

Breastfeeding research, though not mentioned in the piece, is a classic example of the personal bias that renders much of the reasearch in the field misleading and deceptive. Breastfeeding reseachers believe deeply and fervently that breastfeeding, being natural, must be better than any substitutes. Therefore, they slice and dice the data until it supports their bias. They fall prey to the errors that Nuzzo describes in her piece.

image

1. Hypothesis myopia:

One trap that awaits during the early stages of research is what might be called hypothesis myopia: investigators fixate on collecting evidence to support just one hypothesis; neglect to look for evidence against it; and fail to consider other explanations…

This probably the most serious problem in breastfeeding research and distorts most of the existing research that claims to show important health benefits. The conclusions are predetermined and the data are arranged to support the conclusion. Critically, the researchers fail to consider alternative explanations for observed outcomes. In the case of breastfeeding research, it is typically manifested as a failure to correct for confounding variables.

We know that women who choose to breastfeed exclusively differ in important ways from women who do not. Any “benefits” of breastfeeding may reflect those differences, not breastfeeding itself. For example, women who choose to breastfeed exclusively are, on average, wealthier, better educated, and have better access to health insurance. Each of these three variables have been shown to lead to improved health outcomes for their children. The alternative explanation for most of the research that purports to show major health benefits of breastfeeding is that those benefits aren’t caused by breastfeeding, but are the inevitable result of the relatively privileged status of the mothers.

2. The Texas sharpshooter fallacy:

Seizing on random patterns in the data and mistaking them for interesting findings.

This is also known as “p hacking”:

“You just get some encouragement from the data and then think, well, this is the path to go down,” says Pashler. “You don’t realize you had 27 different options and you picked the one that gave you the most agreeable or interesting results, and now you’re engaged in something that’s not at all an unbiased representation of the data.”

In 2012, a study of more than 2,000 US psychologists suggested how common p-hacking is. Half had selectively reported only studies that ‘worked’, 58% had peeked at the results and then decided whether to collect more data, 43% had decided to throw out data only after checking its impact on the p-value and 35% had reported unexpected findings as having been predicted from the start, a practice that psychologist Norbert Kerr of Michigan State University in East Lansing has called HARKing, or hypothesizing after results are known.

In the case of breastfeeding studies, researchers often analyze large datasets looking at multiple outcomes. Then they pick the outcomes that have statistically significant differences and announce them as “findings” without acknowledging that any large dataset looking at multiple outcomes is bound to have random statistically significant differences that are coincidental and don’t represent real outcomes.

3. Asymmetric attention:

The data-checking phase holds another trap: asymmetric attention to detail. Sometimes known as disconfirmation bias, this happens when we give expected results a relatively free pass, but we rigorously check non-intuitive results…

This happens all the time in breastfeeding research and especially in its analysis. Professional breastfeeding advocates report findings on the benefits of breastfeeding without analyzing the data. In contrast, when a study is published that does not support a cherished tenet of lactivism, such as the belief that breastfeeding raises IQ, professional breastfeeding advocates immediately try to tear it apart.

How can we avoid falling prey to these cognitive biases?

The most important corrective to cognitive biases is recognizing that they exist. We must recognize that most scientists who do breastfeeding research believe that breastfeeding must be superior. They often fail to consider alternative explanations for their findings, but we don’t have to fall into the same trap. The first question to ask of any breastfeeding study is whether it accounted for confounding variables. If it didn’t, then the results are meaningless.

Second, we must analyze the data in the study ourselves to see if it justifies the conclusions. We need to ask whether the authors’ conclusions relate to the subject they intended to investigate or are just a random finding. For example, researchers may set out to determine if there is a difference in IQ between breastfed and non-breastfed babies, fail to find one and then write a paper about a random difference in fine motor coordination. That suggests p hacking, desperately searching for any difference, not the one that was supposed to be under study.

Finally, we must pay close attention to the results of studies that support our pre-existing biases. We must analyze them with the exact same rigor that we would bring to analyzing studies that don’t support what we believe.

Contemporary breastfeeding researchers often fool themselves into finding “benefits” of breastfeeding but that doesn’t mean that we have to let them fool us, too.

94 Responses to “How breastfeeding researchers fool themselves — and what we can do about it”

  1. Amazed
    October 11, 2015 at 10:42 am #

    OT: Report from Miss Impatience, aka Baby Detached. My mom was just there to visit her. By everyone’s accounts, Miss Impatience is a great nurser, a great sleeper (yesterday, her mom complained that she’d just refused to sleep from 10 till 13. I was like, at night? No, no, she replied, a.m. And then I was all, well, it’s her working time! She’s been spoiling you by being such an obedient sleeper.), a terrible crier (seriously, she didn’t cry ONCE through my phone marathons with her mom)… Tell me again, how is her life fucked over by the emergency C-section that gave it to her? Life, I mean. When the placenta started detaching.

  2. Allie
    October 10, 2015 at 1:05 am #

    Not sure if there is any bias at work here, other than her desire for her 15 minutes… http://news.nationalpost.com/news/canada/concordia-professor-condemns-hpv-vaccine-after-winning-270k-federal-grant-to-study-it

  3. seekingbalance
    October 9, 2015 at 7:59 pm #

    fabulous article! I always appreciate pieces that help explain research-related pitfalls and shed light on the ways that statistics can be used to manipulate the unsuspecting–and how other groups of unsuspectings even fool themselves, best intentions aside….

    btw, two small errors: double “is” instead of “”it is” at end of paragraph 3. and “data is” should be “data are” (the word “data” should always be plural)

  4. Anne Catherine
    October 9, 2015 at 1:22 pm #

    Here’s an example of a silly breastfeeding study with a silly conclusion that was published by the AAP and funded by the CDC, who really should know better–.

    It says that breastfeeding can make children eat healthier foods when they are 6 years old—-Really??? What children are choosing their diets at 6 years old??

    http://pediatrics.aappublications.org/content/134/Supplement_1/S50.full

    And here is a slide show based some more silly research that says breastfeeding can keep kids from drinking soda and other sugary drinks–

    http://slideplayer.com/slide/4061376/

    • Angharad
      October 9, 2015 at 2:30 pm #

      Here’s a thought experiment: if the government, the CDC, WHO, and the AAP all strongly recommended that babies should wear purple pajamas only because due to the magic sparkles of purple dye it makes children smarter, healthier, and happier, in 10 years would the children who wore purple pajamas as babies be smarter, healthier, and happier?

      I’m inclined to guess they would because the type of parent who has the resources and inclination to follow this recommendation would be better educated, wealthier, and inclined to follow other health advice.

      • Blue Chocobo
        October 9, 2015 at 2:34 pm #

        Purple placebo pajamas!

      • fiftyfifty1
        October 10, 2015 at 4:08 pm #

        Exactly. A preceptor of mine in residency used to say that the healthiest outcomes came from having the sort of mother who responded “how high?” when told to jump. He also said something along the lines of “Jumping through hoops doesn’t keep you healthy, but being the sort of person willing and able to jump through hoops in order to stay healthy does.”

        Exclusive breastfeeding is a difficult hoop to jump through. It should come as no surprise that those who are able to do it have good outcomes.

    • Allie
      October 10, 2015 at 12:55 am #

      Oh boy, my daughter breast fed for 23 months, almost exclusively for 6 months. I guess the bit of supplementation we did the first week explains her predilection for potato chips and chocolate : )

    • Box of Salt
      October 10, 2015 at 1:41 am #

      Anne Catherine “What children are choosing their diets at 6 years old??”

      Have you ever dealt with a picky eater?

      • MaryJane12
        October 10, 2015 at 8:32 am #

        Good point! —–My sister had one of those (breastfed, no less). Lived on about 7 different foods for about 12 years. She called me when he ate a green bean, elated!! He absolutely refused to eat quite a few foods—-.

        But, overall I think the food choices available to breastfed children (from a higher socioeconomic situation) will be a little healthier from the bottle fed group.

      • Anne Catherine
        October 10, 2015 at 9:04 am #

        Good point!!! My sister had one of those (breastfed, no less) –Lived on about 6 foods for 12 years!

        I guess I meant more that the choices available to children are more the parents’ doing than the children’s— (not that I have never been roped into buying sponge-bob cereal, and other not particularly nutritious items!)

        • Sarah
          October 10, 2015 at 5:07 pm #

          I was breastfed into toddlerhood, unusual in working class English families in the 80s, and was an absolute nightmare of a picky eater.

      • RMY
        October 10, 2015 at 2:56 pm #

        Yes and no, a child of broke parent who doesn’t have time to cook quality food or money to buy it isn’t going to eat a good diet no matter how picky they are.

    • Bombshellrisa
      October 10, 2015 at 2:08 am #

      Maybe. I mean, if you look at the majority of kids in my area who were breastfed a long time, their moms are the upper middle class white women shopping at Whole Foods and the other expensive grocery stores. They are choosing gluten free snacks and organic everything and don’t allow their kids sugar. They get kale smoothies and lectures about how good food gives them energy. They don’t get regular birthday cakes or fast food ever. It’s the attitude and philosophy of these women that keeps their children from soda, not the fact that they breast fed.

      • RMY
        October 10, 2015 at 2:58 pm #

        If children grow up in a home without soda, they are less likely to develop a taste for it.

        • Bombshellrisa
          October 10, 2015 at 3:27 pm #

          That is true. I was raised by the “sugar is evil parents” and I didn’t like chocolate or soda at all until I was in my 20’s (husband loves chocolate and I got used to it).

          • fiftyfifty1
            October 10, 2015 at 3:50 pm #

            I grew up in a no-sugar household and today have a huge sweet tooth. My husband grew up in a household without food rules or restrictions and he has the least interest in sweet foods of any human I know. Go figure.

          • Mishimoo
            October 11, 2015 at 5:16 am #

            That’s how it appears with our kids vs. other kids. We don’t really restrict their food options (except I won’t cook two meals) and they just don’t care about junk food. They like it, but given a buffet table at a party, they’re the kids eating all the fruit and only a few bits of junk food.

          • RMY
            October 10, 2015 at 4:04 pm #

            My parents weren’t sugar is evil, as much as they were “we don’t want to buy you kids soda” types. In hindsight it worked well.

        • fiftyfifty1
          October 10, 2015 at 3:47 pm #

          “If children grow up in a home without soda, they are less likely to develop a taste for it.”

          Citation? Because I hear variations of this claim all the time and yet I’ve never seen proof.

          Needing to develop at taste for something bitter (e.g. coffee) I can understand, but you don’t need to learn to like sweetness. Humans are born liking sweetness.

          • RMY
            October 10, 2015 at 4:00 pm #

            Citation — http://www.livescience.com/19523-ways-parents-cut-kids-soda.html
            As a child I didn’t like soda, the carbonation felt harsh on my throat, because I rarely drank it. I’d prefer juice or chocolate milk (not that those are much better options).

          • fiftyfifty1
            October 10, 2015 at 5:05 pm #

            But that citation only shows that parents can reduce their kids’ current consumption of soda by not allowing them to have soda (duh). It says nothing about whether they like soda or want soda, and nothing about long term tastes or actions.

          • RMY
            October 11, 2015 at 9:39 am #

            This study is better

            “Soda consumption at age 5 years predicted patterns of nutrient intake that persisted during childhood and into adolescence. ” – http://www.sciencedirect.com/science/article/pii/S0002822309020975

            I couldn’t find the original article I had read, so I was trying to grab what looked closest, (unfortunately I didn’t do a good job of double checking). I mean, I guess it could be for factors beyond children not having a taste for it, but adolescents tend to have more control over their diet than children (they tend to have spending money and unsupervised time and it’s not like soda is hard to find), but it’s never explicitly said it’s because they don’t have as much of a taste for less healthy foods.

          • fiftyfifty1
            October 11, 2015 at 12:23 pm #

            So this article looks at kids who were not allowed soda under age 5 and finds that they drink less soda from ages 5-15 than those kids who were given soda. Unfortunately, this 5-15 age group is still largely under parental influence. Children this age don’t have jobs or transportation. Their parents are still setting the rules. Sure, a child could sneak out and buy soda with allowance money or drink soda at a sleepover etc, but this child is still going to consume less soda because the parents won’t buy it. This still says nothing about long term tastes or even long term patterns.

            It’s no surprise to me that kids who are raised in health conscious homes go on to display more health conscious behavior. But I have never seen evidence that the mechanism is a change in *taste*.

          • KeeperOfTheBooks
            October 11, 2015 at 1:59 pm #

            Anecdata, but DH is the same way. He grew up with soda being an only-special-occasion thing, and never grew to like the feeling of carbonation in his mouth, so he never drinks the stuff unless he’s feeling really sick.

        • Box of Salt
          October 10, 2015 at 4:01 pm #

          RMY “If children grow up in a home without soda, they are less likely to develop a taste for it.”

          That worked for me. I grew up soda-free, and I drink iced tea (unsweetened). But the fact that there was never soda in my house for the first 8 years of my younger kid’s life has not prevented him from ordering root beer or orange soda every time we go out to eat.

          This is one of those blanket statements that sounds good until you take into account reality.

          • RMY
            October 10, 2015 at 4:08 pm #

            I think that “less likely” means there’s still a chance.

          • Box of Salt
            October 10, 2015 at 4:36 pm #

            RMY “I think . . . ”

            See fiftyfifty1’s comment.

            I too would like to see data. I doubt that my children are outliers.

  5. Amy M
    October 9, 2015 at 11:37 am #

    http://io9.com/i-fooled-millions-into-thinking-chocolate-helps-weight-1707251800

    These guys deliberately set up a crap study, to show 1)many of the issues raised in the Nature article and 2)how bad science journalism is. They p-hacked, ignored confounding factors/small sample size and got the paper published via unscrupulous methods.

    I think that could/should be another way to avoid falling prey to the various biases—if science journalists could or would really critically review the science they are reporting, they might catch a lot of it and call the scientists out on it. Also, the shady organizations that will accept any paper for $ and not bother reviewing it are part of the problem.

  6. Peggy Thatcher
    October 9, 2015 at 11:17 am #

    The myths about breastfeeding are muddying the debate over Florida’s SB-250 Family Law Bill.

    Myths being tossed around as Gospel are that breastfeeding of the newborn creates “attachment behaviors” and is necessary for the mother to bond to her child.

    I have been recommending where I can that people take a look at the book “Understanding Attachment” by Jean Mercer, a professor emerita in child development.

    • LizzieSt
      October 9, 2015 at 12:02 pm #

      It’s amazing how little today’s “attachment parenting” culture has in common with actual attachment theory. I think Winnicott’s concept of the “Good-Enough Mother” is long overdue for a comeback.

    • ladyloki
      October 9, 2015 at 12:47 pm #

      So…I am not attached to my two adopted children because I didn’t breastfeed them? I’ll let them know when they insist on both sitting right against Mommy during Friday movie night tonight. And they were adopted as elementary aged kids and abused and came to us with zero trust in any adult.

      • Angharad
        October 9, 2015 at 12:50 pm #

        I’ll let my daughter know she should stop preferring to play with her dad, and certainly stop preferring grandma over either of us. I may not have breastfed her much, but they didn’t at all!

        • Kelly
          October 9, 2015 at 2:06 pm #

          My kid’s favorite person is my brother. He definitely did not breastfeed nor is he around all that much. You know why they love him the most? He will play one on one with them for hours. The rest of us have a much shorter amount of time that we can sit and play with them without stabbing our eyeballs out.

          • Bombshellrisa
            October 10, 2015 at 2:12 am #

            Same here, my dd prefers grandma because they are exactly alike and my son loves my dad (who will play for hours and doesn’t mind reading the trucks and things that go pop up book a million times).

      • demodocus
        October 9, 2015 at 12:53 pm #

        I think PT is suggesting that is a myth

        • ladyloki
          October 9, 2015 at 1:47 pm #

          Sorry, that snarkiness was towards the state of Flordia, not the OP.

      • Allie
        October 10, 2015 at 1:12 am #

        Yeah, that whole attachment thing is total BS. Kids become attached to people who give them care. My daughter’s favourite teacher at pre-school is the one she barfed on, no doubt because she reacted by cleaning my daughter up and changing her clothes, just like mama or grandma would have done, so it built trust between them. My daughter is bonded with the people who care for her. Nothing to do with my boobs, no matter how lovely they might be, and they’re quite nice, if I do say so myself : )

    • crazy grad mama
      October 9, 2015 at 6:50 pm #

      Ugh, I hate the myth that breastfeeding promotes “attachment.” Apparently formula-feeding parents just toss a bottle in the crib and walk out?

  7. (No longer) Pregnant Guest
    October 9, 2015 at 10:49 am #

    OT: my new baby is 1 week old and doing great! I posted before about due date/gdm concerns. He came at 40 and 1 baSed on 6 week Sono, but I ConVinced my provider to start postdates testing half a week prior, to keep an eye on him since the hospital was questioning my dates. Never ended up w GDM diagnosis, but followed the diet from previous gdm pregnancy pretty closely, doing fingersticks occ, and he was born at 8lbs, 11oz, so im still suspicious that we missed it, somehow. (my daughter was only 6lb 15. New son does have a 99th percentile (!) HC, so maybe he’s just a big baby? ) anyway, wanted to say thanks for reassurance I got here when different providers had conflicting advice.

    On another note, I’m covered armpits to ankles in PUPPPs that appeared the day before he was born – getting conflicting info on that too: any idea when I can exPect it to start clearing up? Any breastFeeding friendly treatment options?

    • Amy M
      October 9, 2015 at 11:21 am #

      Congrats on your new baby! I’m sorry, I have no information about PUPPS.

    • YesYesNoNo
      October 9, 2015 at 12:21 pm #

      Congratulations!

    • nomofear
      October 11, 2015 at 1:00 pm #

      I had PUPPP! Mine went away within 24 hours of my dd’s birth. Have they offered any steroids? Granted, I don’t know if you’re breastfeeding, and if steroids are contraindicated, but that was the best treatment when it happened to me five years ago. Of course, I was using obtuse midwives who refused to prescribe it, and instead told me to order some lotion off the Internet – which cost $35 and took a week to get there, and then only took the edge off. Steroids would have been free or very cheap, same-day, and would not have harmed…yet another reason I embraced medical tech in my second pregnancy!

    • Eater of Worlds
      October 12, 2015 at 1:14 pm #

      My SIL’s first baby was a few ounces short of 11 pounds. Her second baby was 7 and a half. No GDM, just a familial history of big male babies. His father was 5.5 pounds at 6 weeks early (I was under 6.5 pounds and full term), and his grandfather was nearly 13 pounds in the early 40s in a rural Eastern European country suffering from food issues thanks to the Nazis. From a 4’9″ woman, no less. You can definitely have widely different baby sizes with no diabetes.

      • Daleth
        October 12, 2015 at 2:07 pm #

        Oh my god, that poor little 4’9″ woman. Ouch.

        • Eater of Worlds
          October 12, 2015 at 2:18 pm #

          She couldn’t sleep lying down after she hit 4 months. She couldn’t breathe. So for the rest of her pregnancy she slept sitting upright. How she managed a vaginal birth with no painkillers, I have no clue.

          • Nick Sanders
            October 12, 2015 at 9:10 pm #

            Maybe it was like popping a zit, where the opening just kind of stretches wildly for a second and the filling flies out like a bullet…

          • Who?
            October 12, 2015 at 10:01 pm #

            No, as a small woman who had big babies, I can say with confidence it is nothing at all like that. If only giving birth hurt so little!

      • fiftyfifty1
        October 12, 2015 at 2:12 pm #

        ” You can definitely have widely different baby sizes with no diabetes.”
        Yes that’s true, but that doesn’t mean that a wide variation in size is normal. For example when a woman has had large babies and then has a normal sized or smallish one without doing anything different, I would worry about the placenta or other causes of restricted growth. Or if a woman has always had small babies and then has a macrosomic one without doing anything different such as having a much larger weight gain, then yes I would wonder if she had GDM that was missed.

        • Eater of Worlds
          October 12, 2015 at 2:27 pm #

          Of course. I was just saying that it’s within the realm of possibilities to be normal. My grandmother’s other babies were a normal weight too, both were right around 7 pounds, maybe a bit below that. My brother was premature because the doctors felt that my mother’s uterus could only hold a baby that was of a certain length. AT 6 weeks early my brother was 19.5″ long and I was full term, a little bit over actually, and 19.5″ as well, and breech up until the day before birth. None of these women had any other symptoms of problems that could be a cause of such a big baby. My mother actually left the hospital at 3 pounds over her pre-pregnancy weight, so she was 103 when she got pregnant and 106 when she left.

          Funny story: she obviously wasn’t prepared with a bag yet when she went into labor. She asked my father to bring her clothing so she could have something to wear when she went home. So he brought one of his favorite outfits of hers…hot pants. Yep, he brought a woman who just gave birth her pre-pregnancy hot pants to wear home from the hospital. Even though she was just a little bit heavier, she still had post pregnancy changes and a post pregnancy belly. She had no idea how she managed to squeeze into those things but she did.

          • fiftyfifty1
            October 12, 2015 at 2:57 pm #

            My point is that it isn’t normal when a woman goes from having an 11 pound first baby to having a 7.5 pound second baby and shouldn’t be dismissed with “big male babies run in the family”. Male babies on average are only a few grams larger then female babies, not 3.5 pounds larger.

          • Eater of Worlds
            October 12, 2015 at 7:58 pm #

            I was just giving anecdotal information, not a scientific paper. And it obviously can be normal, though not typical. It’s happened in two generations of my family and it probably would have been in a third if it weren’t for the premie.

          • fiftyfifty1
            October 13, 2015 at 9:19 am #

            “I was just giving anecdotal information, not a scientific paper. And it obviously can be happen, though not be typical.”

            Oh for sure it can happen. And even all the women and babies involved can survive. My point is that it’s *not normal*. It’s high risk. It shows something went wrong. It’s important to acknowledge that, because if you don’t, your anecdote seems like a good argument to ignore high risk.

            People sometimes parachute into this site (I’m not saying you are one necessarily) to tell us about how OBs are getting too worked up about things that happened in their own families and turned out just fine. They say things like “Post dates runs in my family. All the women go 2 weeks over. Nobody has died, and it runs in our family, so I don’t need to be induced” or “Half of my grandma’s siblings were born breech. And at home! No problem.”

            When one term baby weighs 11 pounds (or 13 pounds!) and the next weighs 7ish, something went wrong.

          • Eater of Worlds
            October 13, 2015 at 9:58 am #

            With the most recent set of babies, nothing was wrong with the baby being big. It did end up being a c-section because not only was the baby big, but breech and a first baby to boot. But there was otherwise nothing wrong with either pregnancy. She was tested for gestational diabetes and tracked blood sugar anyway for peace of mind. Can you explain what went wrong, or rather, what could have gone wrong to create the disparity that makes this situation so bad? There was OB care from the start in both pregnancies.

          • fiftyfifty1
            October 13, 2015 at 12:30 pm #

            A macrosomic baby by definition is not normal. Sometimes the cause is determined, sometimes the cause could have been determined with more testing, sometimes the cause could not have been determined with any of the tests we currently have but it’s still abnormal. Macrosomia is high risk. A macrosomic breech baby to a first time mom is at very high risk of death if born vaginally. All ended well for this baby due to high tech OB intervention (C-section). But that doesn’t make it “normal”. The mom will be regarded (rightly) as high risk for all subsequent pregnancies.

  8. DiomedesV
    October 9, 2015 at 10:45 am #

    I think that all scientists, if they were honest with themselves, would have to admit to at least a tendency toward all of these fallacies. It’s hard to give up a favored hypothesis. I’ve had to do it. I was not happy. And we have to be honest, some outcomes are more interesting and press-worthy than others. Importantly, in some fields it is easier to “massage” the data than others.

    What many nonscientists fail to appreciate is how much the final paper can be a reflection of the contributions of a reviewer and the intervention of an editor. A reviewer that has a strong opinion of your work (not a bad thing, necessarily) and who has a different perspective, can essentially require the authors to check alternative explanations or pursue avenues that didn’t look particularly promising initially. This can either cause the paper to trend away from these fallacies, or actually cause the authors to have to develop weak associations that are really noise. I can often tell, when reading a paper, that certain comments or interpretations were inserted because of a reviewer.

    Thus, a reviewer’s biases will influence the final paper. In the case of medical observational data, that means that a paper that affirms a hypothesis that “everyone knows is true” will be subjected to little or no meaningful criticism. My feeling is that half the problem with published medical science–especially science that is not strictly empirical but is based on looking for associations in observational data– half the problem is the authors, and the other half is the reviewers. Since they’re more or less the same people, and since rigorous training in statistics for MDs is poor or nonexistent, change is slow and may never happen. In the aggregate, that means that the same paper gets published over and over again, leading to a situation where it looks like the literature shows a dramatic trend in one direction (“breastfeeding is very very important”), when in reality there are only a handful of papers that have rigorously tested that hypothesis.

    • DiomedesV
      October 9, 2015 at 10:50 am #

      This may be an argument for publishing the reviewer’s comments anonymously with the paper. Some journals do this.

      Pros: people reading the final article will know whether the paper got a soft review, and that might make them more skeptical.

      Cons: it might inhibit reviewers from expressing strong criticisms, even anonymously. In small fields, you can sometimes tell who the “anonymous” reviewer is. Also con: I’ve had some pretty harsh reviews. I’m not sure I’d like that to be out there for all to see.

      • ModernistMom
        October 9, 2015 at 3:04 pm #

        We do this in the humanities, but the problem is that ours (academic research) is a small world. It’s not THAT hard to figure out the identity of your reviewer.

        Dr. Amy says personal bias, and I (mostly) agree, but the money factor can’t be denied. I have SO many science colleagues who are doing great research, are great teachers. And their tenure is being denied at the provost/university level because the grant money just.ain’t.there. The corporate model of education has infiltrated our research (both in the Humanities and the Sciences), and yeah, we cling to ideas that we can’t always prove–because our careers and livelihoods depend on it.

    • Julia
      October 9, 2015 at 11:38 am #

      Agreed, in all honesty, every scientist I’ve ever worked with, and myself included, is at least partially guilty of those biases. I’ve definitely had to resort to the “just-so story telling”, when years of work had to be wrapped up and put into a paper and there was no time/money to tie up some loose ends…

      A lot of it has to do with the inadequacies of the system in which we do science: we need to get funding, usually from outside agencies, such as the NIH, which is insanely competitive. To get funding we need to show that we’re “productive”, i.e. we have as many high profile publications as possible. And for that it is tempting to oversell your results.

      I became a scientist with some lofty ideals of an impartial search
      for the truth, blah blah – and then the reality is an insane “hunger
      games”-like quest for research funding.

    • Amy Tuteur, MD
      October 9, 2015 at 5:46 pm #

      Excellent point!

  9. KarenJJ
    October 9, 2015 at 9:34 am #

    I still don’t see why we need to keep trying to pin down benefits of breastfeeding. It’s a food option and often a good choice for babies. Babies have a right to food, parents have a right to choose breastfeeding (well it should be a right for a woman to choose to try breastfeeding).

    Instead of more and more breastfeeding “studies” with predetermined conclusions, I really think we need to be focussing on support. Not “support” from successful breastfeeders that like to lord it over mums that are struggling with breastfeeding in the name of “lactation support”. Real support, like the sort of financial support that gives new mothers real options instead of rushing back to work. Mental health support. Access to more options that help new parents find their feet and gain confidence instead of patronising them and manipulating their options to the “one true path” of motherhood.

    • SporkParade
      October 9, 2015 at 10:24 am #

      Hell, support in the form of breastfeeding studies geared towards assisting women who want to breastfeed but have trouble instead of another danged poorly-controlled study would be good. Who is at risk for low supply? Who is at risk for milk coming in late? What are appropriate feeding protocols to ensure that these women’s babies have enough to eat?

      • Abby
        October 9, 2015 at 2:56 pm #

        This is such a good point!! I always think this! We don’t need another stupid study to ‘prove’ the minuscule benefits of breast milk and more handwringing about bf rates, and the attitude ‘if only they just knew how wonderful breast milk is, they would all breast feed – what they need is more information and statistics to prove this…’
        What they should be researching is HOW to overcome all the problems that make it so hard for loads of people! They can spend all the money in the world proving its amazing but I found breastfeeding so hard I wouldn’t even try next time unless they invented an amazing nipple shelf or something

        • Abby
          October 9, 2015 at 2:57 pm #

          Shield even!

        • KarenJJ
          October 9, 2015 at 7:55 pm #

          Yeah that would mean looking at the actual reasons behind women stopping breastfeeding and the measurement of breastfeeding rates. Measurements such as the ridiculous handwringing over the lack of “exclusive” breastfeeding at 6 months when most paediatricians and medical professionals (in Australia at least) recommend starting solids within the age range of 4-6 months. And then look at the actual reasons, like returning to work, going onto medication, etc and finally identify women that did give up breastfeeding and try and see what’s going on.
          The issue I see is that it’s looking for a problem that largely has a solution already (formula)… But we can’t blame women for it or use it to justify more punitive measures against women (or cheaper hospital policies) so it doesn’t match the current culture and policies regarding the care of young infants..

  10. SporkParade
    October 9, 2015 at 9:14 am #

    The latest breastfeeding cudgel in the mothers’ groups I frequent is that formula is just FULL of SUGAR. Of course, so is breast milk and so is cows’ milk (albeit less so), but somehow this only comes up when mothers of one-year-olds are considering whether to switch from formula to cows’ milk, and never when breastfeeding women are considering what to do next.

    • LizzieSt
      October 9, 2015 at 9:22 am #

      Oh no, not sugar! Those evil formula manufacturers want to turn our babies into sugar addicts! It’s not like sugar is necessary to sustain human life and functioning or anything!

      Oh, wait….

    • Amy M
      October 9, 2015 at 11:25 am #

      But researchers have analyzed the sugar content of human milk, and tried to match it as closely as possible in formula. There’s tons of lactose in human milk, and its used in regular, commercial formulas (there are lactose free versions of course).

      • crazy grad mama
        October 9, 2015 at 6:57 pm #

        Exactly. That’s one of the reasons you’re not supposed to feed your under-one-year-old cow’s milk (or goat’s milk or whatever the latest trend is). The growing brains of human babies need sugar.

      • Tigger_the_Wing
        October 12, 2015 at 9:30 am #

        And I’m very grateful for lactose-free versions, having had to give up breast feeding one of mine for that very reason. There is, as far as I know, no lactose-free breast milk.

    • Kesiana
      October 9, 2015 at 6:23 pm #

      I was none too thrilled to read the words “high-fructose corn syrup” on a formula label a while back. I may have a grudge against the stuff due to being mildly allergic, admittedly…

    • Sue
      October 10, 2015 at 12:52 am #

      Eeeekkkk – SUGAR! It seeps into our BLOOD too – and then into every cell! Imagine that!

  11. LizzieSt
    October 9, 2015 at 8:47 am #

    The BBC World News was running an animated short film this summer entitled “What is Breastmilk?” It presented the idea that a mother “senses” that a child is ill through her breast, and then makes antibodies in her milk to heal the child. The film then declares, “Breastmilk is medicine on tap.”

    I remembered this film when I read your post “Mothers and babies communicate through breastmilk? At the moment, that’s wishful thinking” from September 9, 2015. And boy, was I annoyed that the BBC had presented an unconfirmed, unreplicated finding as a straight fact, and then used it to cudgel mothers over the head! Many people, even very intelligent people, tend to turn off their critical faculties the moment they hear the words “Studies show that….”

  12. Dr Kitty
    October 9, 2015 at 8:44 am #

    OT:
    At least the sleep deprivation and constant nursing are paying off.
    At six weeks my son is on the 50th centile for everything (up from 9th at birth) and has adorably chubby cheeks! He’s gained 2kgs since birth.

    I am eating avocados, eggs, chocolate and hummus like they’re going out of production just to keep my weight stable.

    Anyone got any quick and easy high protein, high fat snack ideas?

    • fiftyfifty1
      October 9, 2015 at 9:00 am #

      “Anyone got any quick and easy high protein, high fat snack ideas?”
      -Burger and fries

      Although really if your goal is to keep your weight up, I would scrap the idea that the food you eat needs to be high in protein. You are probably already getting plenty of protein. Just go for calories. Ice cream. Donuts. Whatever.

      • Dr Kitty
        October 9, 2015 at 9:52 am #

        I’m only asking for high protein, because I don’t have a particularly sweet tooth or a big appetite, and I’m not particularly fond of bread, cookies or crisps. I can get more calories in a smaller volume of foods I like with proteins and fats.

        I’m adding butter, milk and cheese to as many meals as I can, and I’m eating porridge for breakfast.

        When I’m not nursing/pregnant I basically eat one meal a day (dinner, which I cook) and drink coffee for breakfast and lunch. I don’t normally snack, and when I do it tends to be olives. I am not exactly a paragon of nutritional virtue at the best of times.

        • KarenJJ
          October 9, 2015 at 9:57 am #

          Steak and hollandaise sauce.

          • Allie
            October 10, 2015 at 1:22 am #

            I like how your mind works, KarenJJ.

        • Michele
          October 9, 2015 at 10:04 am #

          How do you feel about pasta or rice? Something you can put a high calorie sauce on?
          Smoothies? If you have one of those little “magic bullet” style blenders you can make individual servings of smoothie easily without having to get out the large blender. Milk/yogurt + frozen fruit is quick and you can add all sorts of things as desired.

    • Michele
      October 9, 2015 at 9:08 am #

      Hard boiled eggs.
      Peanut butter toast
      Granola or trail mix with nuts and chocolate
      Tortilla roll ups – mix cream cheese and canned diced green chilies, spread on tortilla. Add a layer of thinly sliced meat and/or cheese. Roll up tortilla and slice into pinwheels. Keeps in refrigerator for several days.
      Dried fruits help with adding calories
      String cheese
      My n=1 as a fat person is if you are trying to keep weight on, don’t worry about protein so much as carbs+fat. High protein, high fat (and therefore low carb) is what I go to for losing weight because it’s harder for me to eat excess calories that way.

      • mythsayer
        October 9, 2015 at 9:55 am #

        Yes, I agree. I had gastric bypass 11 years ago and agree that keeping weight ON may not be the easiest on a high protein diet. Even with high fat…mostly those are GOOD fats (hummus, avocado)….Dr. Kitty, remember to keep throwing some crabs in, too. I think the tortilla roll up is really good.

        Also, I used to to microwave pepperoni and make pepperoni chips…like 10 seconds in the microwave. They are really tasty.

    • Daleth
      October 9, 2015 at 9:30 am #

      CHEESE glorious CHEEEESE…. Any hard, pasteurized cheese (Swiss, cheddar, etc.) is great. It’s one of the easiest snacks to nosh when you’re busy doing something else–just chop off a piece and eat it–and in addition to protein and fat, it’s full of calcium, which both you and your son need. I’ve heard that babies will take all the calcium they need from you whether you have any to spare or not–that’s part of the reason some women have dental problems during or after pregnancy–so you’d best build up your reserves!

      If you want to get fancy you can have crackers, pretzels or chips and olives on the plate to complement your cheese. I also happen to like sliced apples with chunks of Swiss or Jarlsberg–YMMV.

    • Julia
      October 9, 2015 at 12:44 pm #

      How about trail mix, i.e. mixed nuts (and some come with small chocolate chips or dried fruit) – you can snack on it between meals, it’s high calorie and healthy.

    • Charybdis
      October 9, 2015 at 7:21 pm #

      He is not 6 weeks old already!?! You just had him…..

    • seekingbalance
      October 9, 2015 at 11:40 pm #

      jars of various nuts by the bed, to eat a few handfuls right before getting up when you’re about to go tend to someone else’s needs well before getting a real breakfast! 🙂 (my favorites were sesame honey cashews)

    • Box of Salt
      October 10, 2015 at 1:23 am #

      Bacon.

      Really, no one else suggested this?
      It’s the only protein my daughter likes.

      • Tigger_the_Wing
        October 12, 2015 at 9:27 am #

        Sadly, I had to give up all pig products when nursing, since whatever it was that got into my milk caused colic in every single one of my infants. I was underweight, too, and had enormous difficulty in maintaining even that low weight.

        It was only after I was diagnosed Cœliac that I managed to get up to a ‘normal’ BMI and could stop eating like a horse.

    • FEDUP MD
      October 10, 2015 at 8:32 am #

      I lived on nuts and whole milk when I was nursing. Mmmmmm.

  13. Mel
    October 9, 2015 at 8:32 am #

    There’s an additional problem in p-hacking: If you make your data set large enough, you can get statistical significant results that don’t have a biological meaning.

    Example one: I count the percent coloration on the left and right sides of 3,000 cows and run a paired T-test at p=0.05. I find that the two groups are statistically different at a p=0.001 which is really good! What’s the problem? Well, the difference between the two groups’ means was 0.3%. (That means a 5 foot tall by 5 foot long cow has a sploch of color smaller than my pinkie on one side.)

    I picked up on a statistical difference that is simply background noise due to the fact that cows have spots rather than a sign of selection pressure against UV damage from southern sun while the cows are facing east to limit exposure to winds or any other alternate hypothesis I care to attach.

    • Amy M
      October 9, 2015 at 11:31 am #

      Could you imagine if you wrote that paper, and someone approved it?

  14. Mel
    October 9, 2015 at 8:14 am #

    Breastfeeding is mispelled at the beginning of paragraph 4.

Leave a Reply

You must be logged in to post a comment.