Critical Appraisal of Methods Used in Randomized Controlled Trials of Treatments for Temporomandibular Disorders

Aims: To evaluate the quality of methods used in randomized controlled trials (RCTs) of treatments for management of pain and dysfunction associated with temporomandibular muscle and joint disorders (TMJD) and to discuss the implications for future RCTs. Methods: A systematic review was made of RCTs that were implemented from 1966 through March 2006, to evaluate six types of treatments for TMJD: orthopedic appliances, occlusal therapy, physical medicine modalities, pharmacologic therapy, cognitive-behavioral and psychological therapy, and temporomandibular joint surgery. A quality assessment of 210 published RCTs assessing the internal and external validity of these RCTs was conducted using the Consolidated Standards of Reporting Trials (CONSORT) criteria adapted to the methods of the studies. Results: Independent assessments by raters demonstrated consistency with a mean intraclass correlation coefficient of 0.63 (95% confidence interval). The mean percent of criteria met was 58%, with only 10% of the RCTs meeting the four most important criteria. Conclusions: Much of the evidence base for TMJD treatments may be susceptible to systematic bias and most past studies should be interpreted with caution. However, a scatter plot of RCT quality versus year of publication shows improvement in RCT quality over time, suggesting that future studies may continue to improve methods that minimize bias.

quality;randomized clinical trials;temporomandibular;tension type headache;TMD;TMJ

1. Forssell H, Kalso E. Application of principles of evidence-based medicine to occlusal treatment of temporomandibular disorders: Are there lessons to be learned? J Orofac Pain 2004;18:9–22.

2. Ernst E, White AR. Acupuncture as a treatment for temporomandibular joint dysfunction: A systematic review of randomized trials. Arch Otolaryngol head Neck Surgery 1997;125:269–272.

3. Koh H, Robinson PG. Occlusal adjustment for treating and preventing temporomandiublar joint disorders. Cochrane Database Syst Rev. 2003;(1):CD003812.

4. Al-Ani MZ, Davies SJ, Gray RJ, Sloan P, Glenny AM. Stabilization splint therapy for temporomandibular pain dysfunction syndrome. Cochrane Database Syst Rev. 2004;(1):CD002778.

5. Kropmans TJ, Dijkstra PU, Stegenga B, De Bont LG. Therapeutic outcome assessment in permanent temporomandibular joint disc displacement. J Oral Rehab 1999; 26:357–363.

6. Schulz KF, Chalmers I, Hayes RJ, Altman DG. Empirical evidence of bias: Dimensions of methodological quality associated with estimates of treatment effect in controlled clinical trials. J Am Med Assoc 1995;273:408–412.

7. Moher D, Pham B, Jones A, et al. Quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses? Lancet 1998;352:609–613.

8. Detsky AS, Naylor CD, O'Rourke K, McGeer AJ, L'Abbe KA. Incorporating variations in the quality of individual randomized trials into meta-analysis. J Clin Epidemiol 1992;45:255–265.

9. Begg C, Cho M, Eastwood S, et al. Improving the quality of reporting of randomized controlled trials: The CONSORT statement. J Am Med Assoc 1996;276:637–639.

10. Korn D, Ehringhaus S. Principles for strengthening the integrity of clinical research. PLoS Clin Trials 2006;1:e1.

11. Moher D, Schulz KF, Altman DG. The CONSORT statement: Revised recommendations for improving the quality of reports of parallel group randomized trials. Lancet 2001; 357:1191–1194.

12. Ioannidis J, Evans SJ, Gotzsche PC,et al. Better reporting of harms in randomized trials: An extension of the CONSORT statement. Ann Intern Med 2004;141:781–788.

13. Juni P, Altman DG, Egger M. Assessing the quality of randomised controlled trials. In: Egger M, Smith GD, Altman DG (eds). Systematic Reviews in Health Care: Meta-analy-sis in Context, ed 2. London: BMJ, 2001.

14. Moher D, Jones A, Lepage L. Use of the CONSORT statement and quality of reports of randomized trials: A comparative before-and-after evaluation. JAMA 2001;285: 1992–1995.

15. Drangsholt M, LeResche L. Temporomandibular Disorder Pain. Seattle: IASP, 1999.

16. Turk DC, Dworkin RH, Allen RR, et al. Core outcome domains for chronic pain clinical trials: IMMPACT recommendations. Pain 2003;106:337–345.

17. Dworkin RH, Turk DC, Farrar JT, et al. Core outcome measures for chronic pain clinical trials: IMMPACT recommendations. Pain 2005;113:9–19.

18. Mannion AF, Elfering A, Staerkle R, et al. Outcome assessment in low back pain: How low can you go? Eur Spine J 2005;14:1014–1026.

19. Smith LA, Oldman AD, McQuay HJ, Morre RA. Teasing apart quality and validity in systematic reviews: An example from acupuncture trials in chronic neck and back pain. Pain 2000;86:119–132.

20. Jadad A. Randomised Controlled Trials. London: BMJ, 2001.

21. Altman DG. Better reporting of randomized controlled trials: The CONSORT statement [editorial]. BMJ 1996; 313:570–571.

22. Antczak AA, Tang J, Chalmers TC. Quality assessment of randomized controlled trials in dental research I. Methods. J Periodontal Res 1986;21:305–314.

23. Moher D, Jadad AR, Nichol G, Penman M, Tugwell P, Walsh S. Assessing the quality of randomized controlled trials: An annotated bibliography of scales and checklists. Controlled Clin Trials 1995;16:62–73.

24. Jadad AR, Cook DJ, Jones AL, et al. The quality of randomised controlled trials included in metaanalyses and systematic reviews: How often and how is it assessed?Abstract presented at the 4th Annual Cochrane Colloquium, Adelaide, Australia, 1996.

25. Ohlsson A, Lacy JB. Quality assessments of randomized controlled trials: Evaluation by the Chalmers versus the Jadad method. Presented at the 3rd Annual Cochrane Colloquium, 1995.

26. Methods for Systematic Reviews. Oxford, UK: The Oxford Centre for Evidence-based Medicine, 2006.

27. Korn D, Ehringhaus S. Principles for strengthening the integrity of clinical research. PLoS Clin Trials 2006;1:1–4.

28. Egger M, Juni P, Bartlett C, Holenstein F, Sterne J. How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Health Technol Assess 2003;7:1–76.

29. Ekberg E, Vallon D, Nilner M. The efficacy of appliance therapy in patients with temporomandibular disorders of mainly myogenous origin. A randomized, controlled, short-term trial. J Orofac Pain 2003;17:133–139.

30. Dworkin SF, LeResche L. Research diagnostic criteria for temporomandibular disorders: Review, criteria, examinations and specifications, critique. J Craniomandib Disord 1992;6:301–355.

31. Headache Classification Committee of the International Headache Society. Classification and diagnostic criteria for headache disorders, cranial neuralgias and facial pain. Cephalalgia 1988;8(suppl 7):1–96.

32. Okeson JP (ed). Orofacial Pain: Guidelines for Assessment, Diagnosis, and Management. Chicago: Quintessence, 1996.

33. Ekberg E, Nilner, M. Treatment outcome of short- and long-term appliance therapy in patients with TMD of myogenous origin and tension-type headache. J Oral Rehabil 2006;33:713–721.

34. Fernandez-de-Las-Penas C, Alonso-Blanco C, Cuadrado ML, Gerwin RD, Pareja JA. Myofascial trigger points and their relationship to headache clinical parameters in chronic tension-type headache. Headache 2006;46: 1264–1272.

35. Jadad AR, Moore RA, Carroll D, et al. Assessing the quality of reports on randomized clinical trials: Is blinding necessary? Controlled Clin Trials 1996;17:1–12.

36. Higgins JPT, Green S. Sections 6.2 to 6.6. In: Cochrane Handbook for Systematic Reviews of Interventions 4.2.5, 2005.

37. Moher D, Cook DJ, Eastwood S, Olkin I, Rennie D, Stroup DF. Improving the quality of reports of meta-analyses of randomized controlled trials: The quorom state-ment. Onkologie 2000;23:597602.