The Research Diagnostic Criteria for Temporomandibular Disorders. I: Overview and Methodology for Assessment of Validity

Aims: The purpose of the Research Diagnostic Criteria for Temporomandibular Disorders (RDC/TMD) Validation Project was to assess the diagnostic validity of this examination protocol. The aim of this article is to provide an overview of the project’s methodology, descriptive statistics, and data for the study participant sample. This article also details the development of reliable methods to establish the reference standards for assessing criterion validity of the Axis I RDC/TMD diagnoses. Methods: The Axis I reference standards were based on the consensus of two criterion examiners independently performing a comprehensive history, clinical examination, and evaluation of imaging. Intersite reliability was assessed annually for criterion examiners and radiologists. Criterion examination reliability was also assessed within study sites. Results: Study participant demographics were comparable to those of participants in previous studies using the RDC/TMD. Diagnostic agreement of the criterion examiners with each other and with the consensus-based reference standards was excellent with all kappas ≥ 0.81, except for osteoarthrosis (moderate agree-ment, k= 0.53). Intrasite criterion examiner agreement with reference standards was excellent (k ≥ 0.95). Intersite reliability of the radiologists for detecting computed tomography-disclosed osteoarthrosis and magnetic resonance imaging-disclosed disc dis-placement was good to excellent ( k= 0.71 and 0.84, respectively). Conclusion: The Validation Project study population was appropriate for assessing the reliability and validity of the RDC/TMD Axis I and II. The reference standards used to assess the validity of Axis I TMD were based on reliable and clinically credible meth-ods. J OROFAC PAIN 2010;24:7–24

diagnostic criteria;gold standard;reference standard;temporomandibular disorders;temporomandibular muscle and joint disorders;validity

1. Dworkin SF, LeResche L. Research diagnostic criteria for temporomandibular disorders: Review criteria, examinations and specifications, critique. J Craniomandib Disord Facial Oral Pain 1992;6:301–355.

2. Dworkin SF, von Korff MR, LeResche L. Epidemiologic studies of chronic pain: A dynamic-ecologic perspective. Ann Behav Med 1992;14:3–11.

3. Proceedings of the National Institutes of Health Technology Assessment Conference on Management of Temporomandibular Disorders, Bethesda, Maryland, April 29–May 1, 1996. Oral Surg Oral Med Oral Pathol Oral Radiol Endod 1992;83:49–183.

4. The International RDC-TMD Consortium Network web-site. http://rdc-tmdinternational.org. Accessed 2007.

5. Dworkin SF, Sherman J, Mancl L, Ohrbach R, LeResche L, Truelove E. Reliability, validity, and clinical utility of the research diagnostic criteria for temporomandibular disorders Axis II scales: Depression, nonspecific physical symptoms, and graded chronic pain. J Orofac Pain 2002; 16:207–220.

6. Tognini F, Manfredini D, Montagnani G, Bosco M. Is clinical assessment valid for the diagnosis of temporomandibular joint disk displacement? Minerva Stomatol 2004;53:439–448.

7. Emshoff R, Brandlmaier I, Bosch R, Gerhard S, Rudisch A, Bertram S. Validation of the clinical diagnostic criteria for temporomandibular disorders for the diagnostic subgroup—Disc derangement with reduction. J Oral Rehabil 2002;29:1139–1145.

8. Barclay P, Hollender LG, Maravilla KR, Truelove EL. Comparison of clinical and magnetic resonance imaging diagnosis in patients with disk displacement in the temporomandibular joint. Oral Surg Oral Med Oral Pathol Oral Radiol Endod 1999;88:37–43.

9. Shaefer JR, Jackson DL, Schiffman EL, Anderson QN. Pressure-pain thresholds and MRI effusions in TMJ arthralgia. J Dent Res 2001;80:1935–1939.

10. Limchaichana N, Nilsson H, Ekberg EC, Nilner M, Petersson A. Clinical diagnoses and MRI findings in patients with TMD pain. J Oral Rehabil 2007;34: 237–245.

11. Schmitter M, Kress B, Rammelsberg P. Temporomandibular joint pathosis in patients with myofascial pain: A comparative analysis of magnetic resonance imaging and a clinical examination based on a specific set of criteria. Oral Surg Oral Med Oral Pathol Oral Radiol Endod 2004;97:318–324.

12. Ohlmann B, Rammelsberg P, Henschel V, Kress B, Gabbert O, Schmitter M. Prediction of TMJ arthralgia according to clinical diagnosis and MRI findings. Int J Prosthodont 2006;19:333–338.

13. Huddleston Slater JJ, Lobbezoo F, Naeije M. Mandibular movement characteristics of an anterior disc displacement with reduction. J Orofac Pain 2002;16:135–142.

14. Orsini MG, Kuboki T, Terada S, Matsuka Y, Yatani H, Yamashita A. Clinical predictability of temporomandibular joint disc displacement. J Dent Res 1999;78:650–660.

15. Manfredini D, Guarda-Nardini L. Agreement between research diagnostic criteria for temporomandibular disorders and magentic resonance diagnoses of temporo-mandibular disc displacement in a patient population. Int J Oral Maxillofac Surg 2008;37:612–616.

16. Manfredini D, Basso D, Salmaso L, Guarda-Nardini L. Temporomandibular joint click sound and magnetic resonance-depicted disk position: Which relationship? J Dent 2008;36:256–260.

17. Huddleston-Slater JJ, Van Selms MK, Lobbezoo F, Naeije M. The clinical assessment of TMJ sounds by means of auscultation, palpation, or both. J Oral Rehabil 2002;29:873–878.

18. Yatani H, Sonoyama W, Kuboki T, Matsuka Y, Orsini MG, Yamashita A. The validity of clinical examination for diagnosing anterior disk displacement with reduction. Oral Surg Oral Med Oral Pathol Oral Radiol Endod 1998;85:647–653.

19. Yatani H, Suzuki K, Kuboki T, Matsuka Y, Maekawa K, Yamashita A. The validity of clinical examination for diagnosing anterior disk displacement without reduction. Oral Surg Oral Med Oral Pathol Oral Radiol Endod 1998;85:654–660.

20. Schmitter M, Kress B, Leckel M, Henschel V, Ohlmann B, Rammelsberg P. Validity of temporomandibular disorder examination procedures for assessment of temporo-mandibular joint status. Am J Ortho Dentofac Orthopedics 2008;133:796–803.

21. Look JO, John MT, Tai F, et al. The research diagnostic criteria for temporomandibular disorders. II: Reliability of axis I diagnoses and selected clinical measures. J Orofac Pain 2010;24:25–34.

22. Truelove E, Pan W, Look J, et al. The research diagnostic criteria for temporomandibular disorders. III: Validity of axis I diagnoses. J Orofac Pain 2010;24:35–47.

23. Ohrbach R, Turner JA, Sherman JJ, et al. The research diagnostic criteria for temporomandibular disorders. IV: Evaluation of psychometric properties of the axis II mea-sure. J Orofac Pain 2010;24:48–62.

24. Schiffman EL, Ohrbach R, Truelove EL, et al. The research diagnostic criteria for temporomandibular disorders. V. Methods used to establish and validate revised axis I diagnostic algorithms. J Orofac Pain 2010; 24:63–78.

25. Anderson GC, Gonzalez YM, Ohrbach R, et al. The research diagnostic criteria for temporomandibular disordes. VI. Future directions. J Orofac Pain 2010;24:79–88.

26. Bossuyt PM, Reitsma JB, Bruns DE, et al. Standards for reporting of diagnostic accuracy. Towards complete and accurate reporting of studies of diagnostic accuracy: The STARD initiative. Clin Chem 2003;49:1–6.

27. VonKorff M, Ormel J, Keefe FJ, Dworkin SF. Grading the severity of chronic pain. Pain 1992;50:133–149.

28. Derogatis L. SCL-90-R: Symptom checklist-90-R. Administration, scoring and procedures manual. Psychopharmacol Bull 1994;9:12–28.

29. Derogatis LR, Lipman RS, Covi L. SCL-90: An outpatient psychiatric rating scale. Preliminary report. 1973;9:13–28.

30. Headache Classification Subcommittee of the International Headache Society. The international classification of headache disorders ICHD-II tension-type headache (TTH). Cephalalgia 2004;24(suppl 1):37–43.

31. Steenks, MH, deWijer A, Lobbezoo-Scholte AM, Bosman F. Orthopedic diagnostic tests for temporomandibular and cervical spine disorders. In: Fricton J, Dubner R (eds). Advances in Pain Research and Therapy: Orofacial Pain and Temporomandibular Disorders. New York: Raven Press, 1995.

32. Lobbezoo-Scholte AM, Steenks MH, Faber JA, Bosman F. Diagnostic value of orthopedic tests in patients with temporomandibular disorders. J Dent Res 1993;72:1443–1453.

33. Lobbezoo-Scholte AM, de Wijer A, Steenks MH, Bosman F. Interexaminer reliability of six orthopaedic tests in diagnostic subgroups of craniomandibular disorders. J Oral Rehabil 1994;21:273–285.

34. Visscher CM, Lobbezoo F, Naeije M. A reliability study of dynamic and static pain tests in temporomandibular disorder patients. J Orofac Pain 2007;21:39–45.

35. Okeson JP. History and examination for temporomandibular disorders. In: Management of Temporomandibular Disorders and Occlusion. St. Louis, MO: Mosby, 1993.

36. Ohrbach R, Gale EN. Pressure pain thresholds, clinical assessment, and differential diagnosis: Reliability and validity in patients with myogenic pain. Pain 1989; 39:157–169.

37. Howard J. Clinical diagnosis of temporomandibular joint derangements. In: Moffett BC (ed). Diagnosis of Internal Derangements of the Temporomandibular Joint. Seattle: University of Washington, 1984.

38. Wright EF. Manual of Temporomandibular Disorders. Ames, Iowa: Blackwell Munksgaard, 2005.

39. Fricton J, Kroening R, Hathaway KM. TMJ and Craniofacial Pain: Diagnosis and Management. St. Louis, MO: Ishiyaku EuroAmerica, 1988.

40. Schiffman E, Fricton J, Haley DP. The relationship of occlusion, parafunctional habits and recent life events to mandibular dysfunction in a non-patient population. J Oral Rehab 1992;19:201–223.

41. Anderson GC, Schulte JK, Aeppli DM. Reliability of the evaluation of occlusal contacts in the intercuspal position. J Prosthet Dent 1993;70:320–323.

42. Dawson PE. Determining centric relation. In: Dawson PE (ed). Functional Occlusion From TMJ to Smile Design. St Louis: Mosby Elsevier, 2007.

43. Ahmad M, Hollender L, Anderson Q, et al. Research diagnostic criteria for temporomandibular disorders (RDC/TMD): Development of image analysis criteria and examiner reliability for image analysis. Oral Surg Oral Med Oral Pathol Oral Radiol Endod 2009;107:844–860.

44. Williamson JM, Lipsitz SR, Manatunga AK. Modeling kappa for measuring dependent categorical agreement data. Biostatistics 2000;1:191–202.

45. Stata Statistical Software: Release 10. College Station, TX, 2007.

46. Buysse DJ, Reynolds CFI, Monk TH, Berman SR, Kupfer DJ. The Pittsburgh sleep quality index: A new instrument for psychiatric practice and research. Psychiatry Res 1989;28:385–396.

47. Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Human Behav 1983;24: 385–396.

48. Goldberg DP, Williams P. A User’s Guide to the General Health Questionnaire.Windsor, England: Nelson Publishing ,1988.

49. Goldberg DP, Gater R, Sartorius NU, et al. The validity of two versions of the GHQ in the WHO study of mental illness in general health care. Psychol Med 1997;27:191–197.

50. Kerns RD, Turk DC, Rudy TE. The West Haven-Yale multidimensional pain inventory (WHYMPI). Pain 1985;23:345–356.

51. Melzack R. The McGill pain questionnaire: Major properties and scoring methods. Pain 1975;1:277–299.

52. Ohrbach R, Granger C, List T, Dworkin S. Pain-related functional limitation of the jaw: Preliminary development and validation of the jaw functional limitation scale. Community Dent Oral Epidemiol 2008;36:228–236.

53. Ohrbach R, Larsson P, List T. The jaw functional limita-tion scale: Development, reliability, and validity of 8-item and 20-item versions. J Orofacial Pain 2008;22:219–230.

54. Radloff LS. The CES-D scale: A self-report depression scale for research in the general population. App Psych Measurement 1977;1:385–401.

55. MPI Computer Program. Pittsburgh, PA: Rudy, 2005.

56. Stegenga B, Bont LG, deLeeuw R, Boering G. Assessment of mandibular functional impairment associated with temporomandibular joint osteoarthritis and internal derange-ment. J Orofac Pain 1993;7:183–195.

57. Ware JE, Kosinski M, Turner-Bowker DM, Gandek B. How to Score Version Two of the SF-12 Health Survey. Lincoln, RI: QulaityMetric, 2002.

58. Cicchetti DV, Feinstein AR. High agreement but low kappa: II. Resolving the paradoxes. J Clin Epidemiol 1990;43:551–558.

59. Feinstein AR, Cicchetti DV. High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol 1990;43:543–549.

60. Laslett M, Aprill CN, McDonald B, Young SB. Diagnosis of sacroiliac joint pain: Validity of individual provocation tests and composites of tests. Man Ther 2005;10:207–218.

61. Schwarzer AC, Derby R, Aprill CN, Fortin J, Kine G, Bogduk N. The value of the provocation response in lumbar zygapophyseal joint injections. Clin J Pain 1994; 10:309–313.

62. McFadden JW. The stress lumbar discogram. Spine 1988;13:931–933.

63. Thevenet P, Gosselin A, Bourdonnec C, et al. pHmetry and manometry of the esophagus in patients with pain of the angina type and a normal angiography. Gastroenterol Clin Biol 1988;12:111–117.

64. Janssens J, Vantrappen G, Ghillebert G. 24-hour record-ing of esophageal pressure and pH in patients with non-cardiac chest pain. Gastroenterology 1986;90:1978–1984.

65. Vaksmann G, Ducloux G, Caron C, Manouvrier J, Millaire A. The ergometrine test: Effects on esophageal motility in patients with chest pain and normal coronary arteries. Can J Cardiol 1987;3:168–172.

66. Couppé C, Torelli P, Fuglsang-Frederiksen A, Andersen KV, Jensen R. Myofascial trigger points are very prevalent in patients with chronic tension-type headache: A double-blinded controlled study. Clin J Pain 2007;23:23–27.

67. Wise CM, Semble EL, Dalton CB. Musculoskeletal chest wall syndromes in patients with noncardiac chest pain: A study of 100 patients. Arch Phys Med Rehabil 1992;73: 147–149.

68. Kokkonen SM, Kurunlahti M, Tervonen O, Ilkko E, Vanharanta H. Endplate degeneration observed on magnetic resonance imaging of the lumbar spine: Correlation with pain provocation and disc changes observed on computed tomography diskography. Spine 2002;27:2274–2278.

69. Wolfe F, Smythe HA, Yunus MB, et al. The American College of Rheumatology 1990 criteria for the classification of fibromyalgia. Report of the multicenter criteria committee. Arthritis Rheum 1990;33:160–172.

70. Plesh O, Sinisi SE, Crawford PB, Gansky SA. Diagnoses based on the research diagnostic criteria for temporomandibular disorders in a biracial population of young women. J Orofac Pain 2005;19:65–75.

71. Rantala MA, Ahlberg J, Suvinen T, Savolainen A, Kononen M. Chronic myofascial pain, disk displacement with reduction and psychosocial factors in Finnish non-patients. Acta Odontol Scand 2004;62:293–297.

72. Storm C, Wanman A. A two-year follow-up study of temporomandibular disorders in a female Sami population: Validation of cases and controls as predicted by question-naire. Acta Odontol Scand 2007;65:341–347.

73. Schmitter M, Balke Z, Hassel A, Ohlmann B, Rammelsberg P. The prevalence of myofascial pain and its association with occlusal factors in a threshold country non-patient population. Clin Oral Invest 2007;11:277–281.

74. Nilsson IM. Reliability, validity, incidence and impact of temporomandibular pain disorders in adolescents. Swed Dent J 2007;(183):7–86.

75. List T, Wahlund K, Wenneberg B, Dworkin SF. TMD in children and adolescents: Prevalence of pain, gender differences, and perceived treatment need. J Orofac Pain 1999;13:9–20.

76. Glaros A, Urban D, Locke J. Headache and temporomandibular disorders: Evidence for diagnostic and behavioural overlap. Cephalalgia 2007;27:542–549.

77. Manfredini D, Chiappe G, Bosco M. Research diagnostic criteria for temporomandibular disorders (RDC/TMD) axis I diagnoses in an Italian patient population. J Oral Rehabil 2006;33:551–558.

78. Reiter S, Eli I, Gavish A, Winocur E. Ethnic differences in temporomandibular disorders between Jewish and Arab populations in Israel according to RDC/TMD evaluation. J Orofac Pain 2006;20:36–42.

79. John MT, Reissmann D, Schierz O, Wassell RW. Oral health-related quality of life in patients with temporomandibular disorders. J Orofac Pain 2007;21:183–195.

80. List T, Dworkin SF. Comparing TMD diagnoses and clinical findings at Swedish and US TMD centers using research diagnostic criteria for temporomandibular disor-ders. J Orofac Pain 1996;10:240–253.

81. Yap AU, Dworkin SF, Chua EK, List T, Tan KB, Tan HH. Prevalence of temporomandibular disorders subtypes, psychologic distress, and psychosocial dysfunction in Asian patients. J Orofac Pain 2003;17:21–28.

82. Lee LT, Yeung RW, Wong MC, McMillan AS. Diagnostic sub-types, psychological distress and psychosocial dysfunction in southern Chinese people with temporomandibular disorders. J Oral Rehabil 2008;35:184–190.

83. Truelove E, Huggins KH, Mancl L, Dworkin SF. The effi-cacy of traditional, low-cost and nonsplint therapies for temporomandibular disorder: A randomized controlled trial. J Am Dent Assoc 2006;137:1099–1107.

84. Dworkin SF, Huggins KH, Wilson L, et al. A randomized clinical trial using research diagnostic criteria for temporomandibular disorders-axis II to target clinic cases for a tailored self-care TMD treatment program. J Orofac Pain 2002;16:48–63.

85. Helkimo M. Studies on function and dysfunction of the masticatory system. II. Index for anamnestic and clinical dysfunction and occlusal state. Swed Dent J 1974;67: 101–121.

86. Reissmann DR, John MT, Schierz O, Wassell RW. Functional and psychosocial impact related to specific temporomandibular disorder diagnoses. J Dent 2007;35: 643–650.

87. Fletcher RH, Fletcher SW, Wagner EH. Clinical Epidemiology: The Essentials. Baltimore: Wilkins & Wilkins, 1996.

88. Guyatt G, Sackett D, Haynes B. Evaluating diagnostic tests. In: Hynes BR, Sacket DL, Guyatt GH, Tugwell P (eds). Clinical Epidemiology: How to Do Clinical Practice Research. Philadelphia: Lippincott, Williams & Wilkins, 2006.

89. Bossuyt PM, Reitsma JB, Bruns DE, et al. The STARD statement for reporting studies of diagnostic accuracy: Explanation and elaboration. Ann Intern Med 2003;138: W1–W12.

90. Sackett DL. Bias in Analytic Research. J Chron Dis 1979; 32:51–63.