Wednesday, 23 May 2012

  • Does Floortime Therapy Work? We're still waiting for the evidence.




    I’ve been reading about Floortime/DIR Autism Therapy for the last twenty years and have also written about this topic
    at length before. The theory behind this form of “play” therapy always sounded compelling because it appears to mesh well with a very nurturant style of child-rearing. Unfortunately, during the last two decades, there has been very little in the way of scientific testing to support the purported efficacy of this method. Although there have been many dozens of uncontrolled studies, Floortime Therapy has never been subjected to the rigor of science, much to the frustration of adherents to the scientific method. 

    Finally, in 2011, there was an attempt to add scientific rigor to the testing of Floortime autism treatment. Recently, the
    Canadian Broadcasting Corporation (CBC) showcased Floortime Therapy and the purported science supporting the therapy.

    I watched with great interest as a professor from York University was interviewed regarding this so-called “break through” in autism treatment. I took down the name of the researcher and started to look for the peer-reviewed journal article created by this researcher from a legitimate university. I couldn’t find a 2012 study, so I wrote to the research center and they kindly sent me the latest article, which was actually a 2011 article that I had already read. In the 2011 study I received, there was no report of the brain scans that were highlighted in the CBC news clip. When I contacted the research center, I was told that the information on the brain scans had not yet been published.

    Since there has been so much publicity regarding this
    latest article, I’ve decided to present a short analysis on the 2011 Floortime study conducted by Casenhiser, Shanker and Stieben.

    The article’s strengths:
    • They recruit fifty-one children for their study, which is a relatively large number in autism research.
    • There are two groups of children (an experimental and control group).
    • They attempt to randomly assign children so that both groups would be similar prior to the treatment being administered.
    • The authors very honestly describe the limitations of the study, instead of attempting to hide them (which is so often the case in autism treatment research).

    The article’s weaknesses as described by the researchers involved in the study:
    • The control group receives a large number of different treatments in a completely uncontrolled fashion.
    • The experimental group receives more hours of treatment than the control group (which is, in my view, a fatal flaw since the variable “intensity” is not controlled).
    • There is no I.Q. testing conducted prior to and after the study. I define this as a major flaw since it is crucial to understand whether or not treatment would affect the cognitive skills of a child with a developmental delay or disorder.
    • There is a severe self-selection bias, not only regarding which families sign up for the study but more importantly, which children drop out of the study to gain access to a 20-30 hour a week government program (13 children from the control group and 9 children from the experimental group). Even the authors understand how problematic this is when they state: “The authors, therefore, caution against drawing the conclusion that a 20 hours per week program (such as the Intensive Behavioral Intervention program funded by the government of Ontario) can be easily replaced with a 2 hours per week program without regard for how well the requirements of the program fit the needs and resources of each family)” p. 18

    Additional Weaknesses:
    • The researchers in the Learning Through Interaction in Children with Autism 2011 study use the wrong control group; they need to compare Floortime with a control group that is receiving what is considered “best practices” for autism, which is currently Intensive Behavioral Treatment.
    • In this study, children were not diagnosed with autism by a specific psychologist with expertise in autism. Researchers rely on diagnoses made prior to the study from a heterogeneous group of clinicians. This is a severe flaw because we do not know the quality and accuracy of those diagnoses. Since autism is a spectrum disorder, one clinician’s Asperger Syndrome diagnosis may be equal to another clinician’s Autism diagnosis.
    • Tools used to measure improvements in the study were developed by the original proponents of the therapy. Using subjective measures to indicate whether a treatment is successful is forbidden in science. The tools used to discern improvement must be independently developed and tested prior to their use in an experiment. There was only one objective measure developed from the field of Speech and Language Pathology. There must be more objective measures in general, and from the area of Speech and Language specifically (and even this one objective measure did not yield a difference between the experimental and control group).

    The central weakness of the 2011 study:
    • Due to an attrition rate of 43% of the children from the study, we have no way of knowing whether the more severe children left the study to be provided Intensive Behavioral Treatment. It has been my observation over the years that parents of children whose autism is more severe tend to gravitate towards programs that are highly behavioral in nature, since such programs tend to provide better results more quickly. Did the abandonment of the Floortime study by these parents result in a biased group of mildly affected children remaining in the Floortime study? We don’t know; however, we do know that this study has so many limitations that it provides no evidence whatsoever that Floortime Therapy is effective. The fact that almost half of the subjects at the beginning of the study were not there at the end, should disqualify the entire effort for any serious scientist or public policy official.

    Bottom Line: Based on the studies that have been conducted to this point on Floortime, there is no evidence to suggest that Floortime is an effective treatment for autism.

    We eagerly await the solid evidence!


    Read original post

Comments (2)

  • debcot

    Hi! Thank you for your post, as it is right on the money. I will say, however, that Floortime/DIR was the key to unlocking my own son's potential. It was the ONLY way to draw him out of his own world and bring him into ours. He is now 4 years old, having had 2 years of Floortime support at home and school and he is doing unbelievably well! I should say that we tried ABA with him and it just didn't work for him at all. He's the type of kid who will fight anything unless he thinks it's his own idea. He is stubborn and incredibly strong-willed (gets that from his parents, unfortunately).

    The nature of Floortime, which involves following the child's lead, is what made the difference. I can say the same exact thing for his Sensory Integration occupational therapy. There is very little scientific evidence to "prove" it works...

    My husband is an engineer and I am an OT. My core specialization is working with kids on the autism spectrum and sensory integration (ironic, I know). For almost 13 years I heard my husband rant about how I was wasting my professional life on something that "wasn't proven." Then we had our son and we "lost" him to his own inner world and his uncontrollable behaviors that made it impossible for us to do the things we used to enjoy as a family. ONE MONTH after my son began to receive intensive SI therapy we decided to try going shopping at my husband's favorite electronics store and brought our son with us... as we walked in the door with our little guy giggling in the shopping cart my husband turned to me with tears in his eyes and said, "how can anyone say this therapy DOESN'T work?" Soon after that we began the Floortime therapy and between those two "unproven" approaches, my son was brought back from a very disconnected, non-verbal, self-abusive ball of energy to an engaged, fully potty trained kid who won't stop talking and cries when there are no children around for him to play with! My two cents...

  • Springingtiger

    Obviously there is no substitute for empirical evidence, which as your piece shows can be hard to come by, but anecdotal evidence is still evidence. Just because a treatment cannot be experimentally proven to work does not mean it doesn't, and the witness of parents should be treated with respect after all legal trials are frequently decided on the evidence of witnesses. Autism is a spectrum, and it is reasonable to assume that different treatments will be differently effective with different subjects.

  • Sign in to Comment

  • Give eProps (?)

About the Author

  • autismpundit
    • From: autismpundit
    • Name: autismpundit
    • Location:
    • About Me: Sabrina Freeman, Ph.D. (1958-) was born in Montreal, Quebec, and grew up in Vancouver, British Columbia. She graduated from Stanford University in 1995 with a Ph.D. in Sociology, specializing in small group research and the study of organizations. Upon her return to British Columbia, Freeman spent 14 years advocating for the rights of children with autism to be included in the government funded health care system for their core health need -- autism treatment.
    Stats: This Week All Time
    Posts: 0 46
    Views: 0 107952
    Comments: 0 88
    View all posts by autismpundit

Who recommended?

Who gave the eProps?

2 eProps from: