Professor Tobias Feldhoff, Professor Falk Radisch and Professor Eckhard Klieme
Peter Goff, J. Edward Guthrie, Ellen Goldring and Leonard Bickman
In this study the authors use longitudinal data from a randomized experiment to investigate the impact of a feedback and coaching intervention on principals’ leadership behaviors…
Abstract
Purpose
In this study the authors use longitudinal data from a randomized experiment to investigate the impact of a feedback and coaching intervention on principals’ leadership behaviors. The paper aims to discuss these issues.
Design/methodology/approach
In total, 52 elementary and middle school principals (26 receiving teacher feedback, 26 receiving feedback and coaching) were randomized into a year-long feedback and coaching study. Measures of leadership actions were collected from principals and teachers during the fall, winter, and spring. The authors use instrumental variables approach to examine the impact of treatment.
Findings
Behavioral change may take longer than is presented in this study, which implies that these findings represent a lower-bound. As an intervention leadership coaching is costly and this research does not explore alternatives to help principals make feedback data actionable.
Practical implications
It is unlikely that providing school leaders with feedback alone will induce behavioral change. Other systems and supports – such as leadership coaching – are needed to help principals make sense of feedback data and translate data into actionable behaviors.
Originality/value
Few leadership studies use exogenous variation in treatment conditions to examine leadership outcomes. This study builds upon our causal knowledge of leadership behaviors and presents a viable intervention to improve school leadership.
Details
Keywords
Pamela Sammons, Susila Davis, Christopher Day and Qing Gu
The purpose of this paper is to discuss the use of mixed methods research in a major three year project and focuses on the contribution of quantitative and qualitative approaches…
Abstract
Purpose
The purpose of this paper is to discuss the use of mixed methods research in a major three year project and focuses on the contribution of quantitative and qualitative approaches to study school improvement. It discusses the procedures and multiple data sources used in studying improvement using the example of a recent study of the role of leadership in promoting improvement in primary and secondary schools’ academic results in England. Although the definition of improvement used was based on robust analyses of data on students’ academic outcomes, the mixed methods design enabled a broader perspective to be achieved.
Design/methodology/approach
The study illustrates how the multilevel analysis of students’ national assessment and examination results based on national data sets for primary and secondary schools in England were used to investigate the concept of academic effectiveness based on value-added methodology. Using three successive years of national results a purposive sample of schools were identified that could be classified as both effective and improving over the period 2003-2005. In addition, surveys and interviews were used to gather evidence of the role of stakeholder perceptions in investigating school improvement strategies and processes.
Findings
National student attainment data sets were used for the identification of improving and effective schools and revealed the importance of considering their different starting points in their classification of three distinctive improvement groups. The combination of quantitative survey data from headteachers and key staff with qualitative case study data enabled a range of analysis strategies and the development of statistical models and deeper understanding of the role of leadership.
Research limitations/implications
The limitations of a focus on only academic outcomes and “value-added” measures of student progress are discussed. The challenges and opportunities faced in analysis and integration of the different sources of evidence are briefly explored.
Practical implications
The study contributes to the knowledge base on the identification of school improvement and use of performance data. The findings on strategies and processes that support improvement are of relevance to policy makers and practitioners, especially school leaders.
Originality/value
The mixed methods design adopted in the study enabled the research to combine rigorous quantitative and in-depth qualitative data in new ways to extend and make new claims to knowledge about the role of school leadership in promoting school improvement based on the study of effective and improved schools’ experiences.
Details
Keywords
Alex J. Bowers and Bradford R. White
The purpose of this paper is to examine the independent effects of principal background, training and experience as well as teacher academic qualifications on school proficiency…
Abstract
Purpose
The purpose of this paper is to examine the independent effects of principal background, training and experience as well as teacher academic qualifications on school proficiency growth through time.
Design/methodology/approach
The authors analyzed the entire population of all elementary and middle schools in the state of Illinois, n=3,154 schools, from 2000 to 2001 through 2005-2006 using growth mixture modeling. The authors examined growth at the school level in the percentage of students meeting or exceeding standards on the Illinois Standard Achievement Test, analyzing separate models for Chicago and non-Chicago schools.
Findings
The results suggest that there are two statistically significantly different latent school proficiency trajectory subgroups through the six-year time period, one high and one low, for both Chicago and non-Chicago schools. In addition, the models suggest that teacher academic qualifications, principal training, principal experience as a principal and an assistant principal, and experience of the principal as a teacher previously in their schools are significantly related to school proficiency growth over time, dependent upon school context.
Practical implications
Recent studies on the independent effects of principal experience, training and teacher academic qualifications have shown inconsistent results on school achievement growth. The authors demonstrate that principal training and background may have an effect on school-level proficiency score growth.
Originality/value
This study is one of the first to examine statistically different proficiency growth trajectories using an entire state-wide data set over a long-term, six-year timeframe.
Details
Keywords
Ronald H. Heck and Philip Hallinger
The purpose of this paper is to test a multilevel, cross-classified model that seeks to illuminate the dynamic nature of relationships among leadership, teaching quality, and…
Abstract
Purpose
The purpose of this paper is to test a multilevel, cross-classified model that seeks to illuminate the dynamic nature of relationships among leadership, teaching quality, and student learning in school improvement. The study's primary goal is to shed light on the paths through which leadership influences student learning. At the school level, the model examines the mediating effect of the school's instructional environment on leadership and student learning. At the classroom level, it examines how instructionally focussed leadership can moderate teacher effects on student learning. Then these multiple paths are examined in a single model that seeks to test and highlight the means by which leadership contributes to school improvement.
Design/methodology/approach
The current study employed a multilevel longitudinal data set drawn from 60 primary schools in one state in the USA. Using a cross-classification approach to quantitative modeling, the research analyzes the complex cross-level interactions that characterize school-level and classroom level practices that contribute to school improvement and student learning.
Findings
The results illustrate the utility of specifying multilevel relationships when examining the “paths” that link school leadership to student learning. First, leadership effects on student learning were fully mediated by the quality of the school's instructional environment. Second, the findings indicated that the classroom-related paths examined in this study directly influenced the measures of student math achievement. Third, the research found that instructionally focussed school leadership moderated the effect of individual teachers on student learning. Fourth, the results suggest that school leaders can enhance student outcomes by creating conditions that lead to greater consistency in levels of effectiveness across teachers.
Practical implications
The study makes substantive contributions to the global knowledge base on school improvement by testing and elaborating on the “paths” that link school leadership and student learning. More specifically, the findings offer insights into strategic targets that instructional leaders can employ to enhance teacher effectiveness and school improvement. Thus, these results both support and extend findings from prior cross-sectional and longitudinal studies of leadership and school improvement.
Originality/value
This is the first study that has tested a conceptualization of leadership for learning in a single “cross-classified longitudinal model” capable of capturing interactions among leadership, classroom teaching processes and growth in student learning. The research illustrates one “state-of-the-art” methodological approach for analyzing longitudinal data collected at both the school and classroom levels when studying school improvement.
Details
Keywords
Peter J.C. Sleegers, Eric E.J. Thoonen, Frans J. Oort and Thea T.D. Peetsma
Elementary schools have been confronted with large-scale educational reforms as strategies to improve the educational quality. While building school-wide capacity for improvement…
Abstract
Purpose
Elementary schools have been confronted with large-scale educational reforms as strategies to improve the educational quality. While building school-wide capacity for improvement is considered critical for changing teachers’ classroom practices, there is still little empirical evidence for link between enhanced school capacity for improvement and instructional change. In this study, the authors examined the impact of school improvement capacity on changes in teachers’ classroom practices over a period of time. Leadership practices, school organizational conditions, teacher motivation and teacher learning were used to measure school-wide capacity for improvement. The paper aims to discuss these issues.
Design/methodology/approach
Mixed-model analysis of longitudinal data over a four years (2005-2008) period of time from 862 teachers of 32 Dutch elementary schools were used to test the impact of school improvement capacity on changing teachers’ instructional practices.
Findings
The results showed that organizational-level conditions and teacher-level conditions play an important, but different role in changing teachers’ classroom practices. Whereas teacher factors mainly affect changes in teachers’ classroom practices, organizational factors are of significant importance to enhance teacher motivation and teacher learning.
Research limitations/implications
More longitudinal research is needed to gain better insight into the opportunities and limits of building school-wide capacity to stimulate instructional change.
Practical implications
By encouraging teachers to question their own beliefs, facilitating opportunities for teachers to work together to solve problems, and through the promotion of shared decision making, school leaders can reinforce the personal and social identification of teachers with the organization. As a consequence, teachers will feel increasingly committed and are more willing to change their classroom practices. Additionally, school leaders can use the findings from this study and the related instrument as a tool for school self-evaluation.
Originality/value
This paper contributes to a deeper understanding of the nature of changes in conditions for school improvement and its influence on changes in teachers’ instructional practices over a period of time.
Details
Keywords
In school improvement studies, randomized experiments are rare. A special problem is the assignment to the experimental and control groups, taking into account the different…
Abstract
Purpose
In school improvement studies, randomized experiments are rare. A special problem is the assignment to the experimental and control groups, taking into account the different starting conditions at the schools in terms of school improvement competencies. The purpose of this paper is to take the example of an intervention study conducted in Baden-Württemberg, Germany, the extent to which the challenges involved with a quasi-experimental design were addressed is examined.
Design/methodology/approach
The intervention study was conducted with 54 math teachers (experimental group: n=29; control group: n=25) and their grade 7 and 8 classes (n=1,054) at 13 secondary schools. It aimed to increase teacher cooperation on teaching for promotion of students’ self-regulated learning. T-tests, Mann-Whitney tests, ANOVA, multilevel regression analyses were conducted.
Findings
At the beginning of the intervention, the teachers in the two groups did not differ significantly in prior cooperation on teaching processes and in attitudes toward cooperation. However, they differed in prior cooperation on school framework conditions and teaching processes. The intervention was effective in increasing teachers’ cooperation intensity on instruction, and teachers’ attitude toward binding cooperation. However, teaching processes did not change depending on experimental or control group.
Research limitations/implications
Teacher cooperation practice was assessed only by teachers’ self-report. No indicators on the quality of the cooperation among teachers were included.
Practical implications
The paper discusses the challenges and limitations of conducting intervention studies on school improvement. Implications for further research are given.
Originality/value
This paper fulfils an identified need to study how quasi-experimental designs can be implemented in intervention studies on school improvement.