The convergent and divergent validity of the Vanderbilt Assessment of Leadership in Education (VAL-ED): Instructional leadership and emotional intelligence
Abstract
Purpose
The purpose of this paper is to contribute to the ongoing dialog of whether and how instructional leadership is distinguished conceptually from general leadership notions, such as charisma, and to continue the ongoing psychometric research on the The Vanderbilt Assessment of Leadership in Education (VAL-ED) by examining its convergent and divergent validity. The authors hypothesize that the VAL-ED will be highly correlated with another measure of instructional leadership, but will be weakly correlated with more general measures of leadership that are rooted in personality theories. To test the convergent validity the authors implement the Hallinger and Murphy (1985) Instructional Management Behavior of Principals (IMBP) inventory, (Hallinger and Murphy, 1985; Hallinger, 2011). The authors use an instrument for emotional intelligence, Trait Emotional Intelligence Questionnaire (TEIQue) as the divergent measure (Petrides et al., 2007). Results indicate that principals and teachers have different perceptions of leadership concepts.
Design/methodology/approach
The sample of schools in this study included 63 schools, 47 elementary, seven middle, and nine high schools from eight districts in six states in the US correlational analyses and regression are implemented.
Findings
The three sets of correlations from teacher responses about their principals among the three measures of the VAL-ED, TEIQue, and PIMRS (0.715, 0.686, and 0.642) are similar in size and all quite high. The picture is different for principals’ self-ratings, however. The VAL-ED is more strongly correlated (0.492) with PIMRS than with TEIQue (0.119), providing some evidence for convergent validity between learning-centered leadership and instructional management, and divergent validity when compared with emotional intelligence traits. The correlation between teachers and principals on the VAL-ED is only 0.17.
Research limitations/implications
An interesting finding of this study is that principals can discriminate between instructional leadership measures and emotional traits when self rating, while teachers rate their principals similarly, and do not seem to discriminate between instructional leadership practices, as measured by the VAL-ED or PRIMS, and general traits associated with leadership effectiveness, as measured by the TEIQue. This paper discusses the theoretical and practical implications of these findings for both understanding the limitations of rating scales measuring instructional leadership, and their uses for evaluation purposes. Furthermore, teachers seem to perceive and understand these leadership traits differently than principals suggesting the need for training in how to use and interpret the results.
Originality/value
Educator accountability has placed principal evaluation and assessment at the forefront of reform debates. There is limited research on 360 degree evaluation systems. Rating scales of principals’ instructional leadership, are being used for assessing principals’ strengths and weaknesses in making decisions about tenure, merit pay, and ongoing professional development. Given the significance of these decisions it is important to ensure that principal evaluation instruments are valid.
Keywords
Acknowledgements
This paper was presented at the annual meeting of the 2013 American Education Research Association, SF. This research was supported through a grant from the US Department of Education Institute of Education Sciences and the Wallace Foundation. Please direct correspondence to Ellen Goldring (ellen.goldring@vanderbilt.edu).
Conflict of Interest: The authors declare a potential conflict of interest (e.g. a financial relationship with the commercial organizations or products discussed in this article) as follows: The Vanderbilt Assessment of Leadership in Education (VAL-ED) instrument is authored by Drs Porter, Murphy, Goldring, and Elliott and copyrighted by Vanderbilt University, all of whom receive a royalty from its sales by Discovery Education Assessment. The VAL-ED authors and their research partners have made every effort to be objective and data based in statements about the instrument and value the independent peer review process of their research. With any publication, readers should judge the facts and related materials for themselves.
Citation
Goldring, E., Cravens, X., Porter, A., Murphy, J. and Elliott, S. (2015), "The convergent and divergent validity of the Vanderbilt Assessment of Leadership in Education (VAL-ED): Instructional leadership and emotional intelligence", Journal of Educational Administration, Vol. 53 No. 2, pp. 177-196. https://doi.org/10.1108/JEA-06-2013-0067
Publisher
:Emerald Group Publishing Limited
Copyright © 2015, Emerald Group Publishing Limited