Development and Validation of Self-Evaluation Tool to Assess Teaching- Strategies (SETT) of Medical Teachers: A Modified Delphi Study

Authors

  • Sidra Aamer
  • Rehan Ahmed Khan
  • Beenish Abbas
  • Fizza Sahar Anwar
  • Rozina Nazir
  • Manya Tahir

DOI:

https://doi.org/10.51985/JBUMDC202270

Keywords:

Quality of teaching, reliability, Teaching strategies, validity

Abstract

Objective: The objective was to develop and validate a tool for self-evaluation of teaching strategies for medical teachers (SETT).

 

Study Design & Setting: A mixed method study was conducted at Riphah International University, Islamabad, Pakistan Methodology: A mixed method study was conducted at Riphah International University, Islamabad, Pakistan from January 15, 2019, to July 15, 2019. Modified Delphi technique was used to establish the content validity of preliminary instrument with 28 items. The response process validity was explored through cognitive interviews. Confirmatory factor analysis was done to confirm the factor model and the reliability of the tool was calculated using Cronbach’s alpha.

 

Results: A 28-items preliminary draft instrument was reduced to 14-items final instrument after administering content validity, cognitive pretesting, and confirmatory factor analysis. Content Validity Scale was 0.97. Confirmatory factor analysis yielded a model with a good fit and an acceptable internal consistency. These statistical values signify that the tool developed has a good validity and good reliability which means that the tool rightly measured what it was supposed to measure and is reliable to evaluate the required question every time.

 

Conclusions: A self-evaluation tool of teaching- strategies (SETT) questionnaire is a valid and reliable instrument to evaluate teaching strategies of medical teachers.

References

Steinert Y, Mann K, Centeno A, Dolmans D, Spencer J, Gelula

M, et al. Medical Teacher A systematic review of faculty

development initiatives designed to improve teaching

effectiveness in medical education: BEME Guide No. 8 Mark

Gelula & David Prideaux (2006) A systematic review of

faculty development initiatives designed to improve teaching

effectiveness in medical education: BEME Guide No. Med

Teach [Internet]. 2006 Sep [cited 2021 Apr 14];8(6):497–526.

Available from: https://doi.org/10.1080/01421590600902976

Fairweather JS. The mythologies of faculty productivity:

Implications for institutional policy and decision making. J

Higher Educ. 2002;73(1):26–48. DOI:10.1353/jhe.2002.0006

Sciences AA-M-J of TUM, 2015 undefined. Medical faculty

development: Perceptions about teachers’ characteristics.

Elsevier [Internet]. [cited 2021 Apr 14]; Available from:

https://www.sciencedirect.com/science/ article/pii/

S1658361215001067 DOI:10.1016/j. jtumed.2015.09.002

Medical education partnership initiative (MEPI) in Zimbabwe:

outcomes and challenges. ghspjournal.org [Internet]. [cited

Apr 14]; Available from: https://www.ghspjournal.

org/content/6/1/82?utm_source=TrendMD&utm_medium=

cpc&utm_campaign=Global_Health%253A_Science_and_

Practice_TrendMD_1 https://doi.org/10.9745/GHSP-D-17-

Zodpey S, Sharma A, Zahiruddin QS, Gaidhane A, Shrikhande

S. Faculty development programs for medical teachers in

India. J Adv Med Educ Prof [Internet]. 2016 Apr [cited 2021

Apr 14];4(2):97–101.DOI:Mededu/prof 27104205

Tomlinson CL, Stowe R, Patel S, Rick C, Gray R, Clarke CE.

Systematic review of levodopa dose equivalency reporting

in Parkinson’s disease. Mov Disord [Internet]. 2010 Nov 15

[cited 2021 Apr 14];25(15):2649–53. Available from:

http://doi.wiley.com/10.1002/mds.23429

Al Mohaimeed A, Midhet F, Barrimah I. Academic

Accreditation Process : Experience of a Medical College in

Saudi Arabia. Int J Health Sci (Qassim) [Internet]. 2012 Jan

[cited 2021 Apr 14];6(1):23–9. Available from: /pmc/articles/

PMC3523780/ doi: 10.12816/0005970

Nye B, Konstantopoulos S, Hedges L V. How large are teacher

effects? Educ Eval Policy Anal. 2004;26(3):237–57.

https://doi.org/10.3102/01623737026003237

Comprehensive assessment of teaching performance in medical

education. Elsevier [Internet]. [cited 2021 Apr 14]; Available

from: https://www.sciencedirect.com /science/article/pii/

S1877042814034685 https://doi.org/10.1016/j. sbspro. 2014.

044

Olufunminiyi A. Effects of Learning Styles and Instructional

Strategies on Students’ Achievement in Nigerian Senior

Secondary School Physics [Internet]. Vol. 41, core.ac.uk.

Online; 2015 [cited 2021 Apr 14]. Available from:

www.iiste.org doi: iiste/2015.04.14

Hsu C-C, Sandford BA. The Delphi Technique: Making Sense

of Consensus. Pract Assessment, Res Eval [Internet]. 2007

[cited 2021 Apr 14];12:10. Available from: https://scholarworks

.umass.edu/pare/vol12/iss1/10/ https://doi.org/ 10.7275/ pdz9-

th90

Willis G, education AAJ-J of graduate medical, 2013

undefined. What do our respondents think we’re asking?

Using cognitive interviewing to improve medical education

surveys. ncbi.nlm.nih.gov [Internet]. [cited 2021 Apr 14];

Available from: https://www.ncbi.nlm. nih.gov/pmc/articles/

PMC3771159/

Keeney S, Hassan F. The Delphi Technique in Nursing and

Health Research - Sinead Keeney, Hugh McKenna, Felicity

Hasson - Google Books. 1st ed. Chichester, West Sussex:

Wiley Blackwell; 2011. 43–68 p.

Skulmoski GJ, Hartman FT, Krahn J. The Delphi Method for

Graduate Research The Delphi Method for Graduate Research

[Internet]. Vol. 6, Journal of Information Technology

Education. 2007 [cited 2021 Apr 14]. Available from:

https://www .learntechlib.org/p/111405/ https://doi.org/ 10.

/JGME- D-13-00154.1

Artino Jr AR, La Rochelle JS, Dezee KJ, Gehlbach H.

Developing questionnaires for educational research: AMEE

Guide No. 87. Med Teach. 2014;36(6):463–74. https://

doi.org/10.3109/0142159X.2014.889814

Shehnaz S, JS-J of educational, 2014 undefined. Does

curricular change improve faculty perceptions of student

experiences with the educational environment? A preliminary

study in an institution undergoing. ncbi.nlm.nih.gov [Internet].

[cited 2021 Apr 14]; Available from: https://www.ncbi.

nlm.nih.gov/pmc/articles/PMC4013721/ DOI: https:// doi.

org/10.3352/jeehp.2014.11.7

Von der Gracht HA. Consensus measurement in Delphi studies.

Review and implications for future quality assurance. Technol

Forecast Soc Change. 2012;79(8):1525–36. https://doi.org/

1016/j.techfore.2012.04.013

Vogel C, Zwolinsky S, Griffiths C, Hobbs M, Henderson E,

Wilkins E. A Delphi study to build consensus on the definition

and use of big data in obesity research. Vol. 43, International

Journal of Obesity. 2019. p. 2573–86. https://doi.org/

1038/s41366-018-0313-9

Yousuf MI. The Delphi technique. Essays Educ.

;20(10):80–9. DOI: https://openriver.winona. edu/eie

/vol20 /iss1/8

Pololi LH, Frankel RM. Humanising medical education

through faculty development: linking self-awareness and

teaching skills. Med Educ. 2005;39(2):154–62. https://

doi.org/10.1111/j.1365-2929.2004.02065.x

Downloads

Published

2024-01-29

How to Cite

Aamer , S. ., Khan, R. A. ., Abbas, B. ., Anwar, F. S. ., Nazir, R. ., & Tahir, M. . (2024). Development and Validation of Self-Evaluation Tool to Assess Teaching- Strategies (SETT) of Medical Teachers: A Modified Delphi Study. Journal of Bahria University Medical and Dental College, 14(01), 65–71. https://doi.org/10.51985/JBUMDC202270

Issue

Vol. 14 No. 01 (2024): Volume 14 Issue 01

Section

Medical Education - Original Article

License

Copyright (c) 2024 Sidra Aamer , Rehan Ahmed Khan, Beenish Abbas, Fizza Sahar Anwar, Rozina Nazir, Manya Tahir

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Journal of Bahria University Medical & Dental College is an open access journal and is licensed under CC BY-NC 4.0. which permits unrestricted non commercial use, distribution and reproduction in any medium, provided the original work is properly cited. To view a copy of this license, visit https://creativecommons.org/licenses/by-nc/4.0

Most read articles by the same author(s)