Neale Smith, Craig Mitton, Evelyn Cornelissen, Jennifer Gibson and Stuart Peacock
Public sector interest in methods for priority setting and program or policy evaluation has grown considerably over the last several decades, given increased expectations for…
Abstract
Purpose
Public sector interest in methods for priority setting and program or policy evaluation has grown considerably over the last several decades, given increased expectations for accountable and efficient use of resources and emphasis on evidence‐based decision making as a component of good management practice. While there has been some occasional effort to conduct evaluation of priority setting projects, the literatures around priority setting and evaluation have largely evolved separately. In this paper, the aim is to bring them together.
Design/methodology/approach
The contention is that evaluation theory is a means by which evaluators reflect upon what it is they are doing when they do evaluation work. Theories help to organize thinking, sort out relevant from irrelevant information, provide transparent grounds for particular implementation choices, and can help resolve problematic issues which may arise in the conduct of an evaluation project.
Findings
A detailed review of three major branches of evaluation theory – methods, utilization, and valuing – identifies how such theories can guide the development of efforts to evaluate priority setting and resource allocation initiatives. Evaluation theories differ in terms of their guiding question, anticipated setting or context, evaluation foci, perspective from which benefits are calculated, and typical methods endorsed.
Originality/value
Choosing a particular theoretical approach will structure the way in which any priority setting process is evaluated. The paper suggests that explicitly considering evaluation theory makes key aspects of the evaluation process more visible to all stakeholders, and can assist in the design of effective evaluation of priority setting processes; this should iteratively serve to improve the understanding of priority setting practices themselves.
Details
Keywords
Cameron David Willis, Jessie Saul, Helen Bevan, Mary Ann Scheirer, Allan Best, Trisha Greenhalgh, Russell Mannion, Evelyn Cornelissen, David Howland, Emily Jenkins and Jennifer Bitz
The questions addressed by this review are: first, what are the guiding principles underlying efforts to stimulate sustained cultural change; second, what are the mechanisms by…
Abstract
Purpose
The questions addressed by this review are: first, what are the guiding principles underlying efforts to stimulate sustained cultural change; second, what are the mechanisms by which these principles operate; and, finally, what are the contextual factors that influence the likelihood of these principles being effective? The paper aims to discuss these issues.
Design/methodology/approach
The authors conducted a literature review informed by rapid realist review methodology that examined how interventions interact with contexts and mechanisms to influence the sustainability of cultural change. Reference and expert panelists assisted in refining the research questions, systematically searching published and grey literature, and helping to identify interactions between interventions, mechanisms and contexts.
Findings
Six guiding principles were identified: align vision and action; make incremental changes within a comprehensive transformation strategy; foster distributed leadership; promote staff engagement; create collaborative relationships; and continuously assess and learn from change. These principles interact with contextual elements such as local power distributions, pre-existing values and beliefs and readiness to engage. Mechanisms influencing how these principles sustain cultural change include activation of a shared sense of urgency and fostering flexible levels of engagement.
Practical implications
The principles identified in this review, along with the contexts and mechanisms that influence their effectiveness, are useful domains for policy and practice leaders to explore when grappling with cultural change. These principles are sufficiently broad to allow local flexibilities in adoption and application.
Originality/value
This is the first study to adopt a realist approach for understanding how changes in organizational culture may be sustained. Through doing so, this review highlights the broad principles by which organizational action may be organized within enabling contextual settings.
Details
Keywords
Evelyn Cornelissen, Craig Mitton, Alan Davidson, Colin Reid, Rachelle Hole, Anne-Marie Visockas and Neale Smith
Program budgeting and marginal analysis (PBMA) is a priority setting approach that assists decision makers with allocating resources. Previous PBMA work establishes its efficacy…
Abstract
Purpose
Program budgeting and marginal analysis (PBMA) is a priority setting approach that assists decision makers with allocating resources. Previous PBMA work establishes its efficacy and indicates that contextual factors complicate priority setting, which can hamper PBMA effectiveness. The purpose of this paper is to gain qualitative insight into PBMA effectiveness.
Design/methodology/approach
A Canadian case study of PBMA implementation. Data consist of decision-maker interviews pre (n=20), post year-1 (n=12) and post year-2 (n=9) of PBMA to examine perceptions of baseline priority setting practice vis-à-vis desired practice, and perceptions of PBMA usability and acceptability.
Findings
Fit emerged as a key theme in determining PBMA effectiveness. Fit herein refers to being of suitable quality and form to meet the intended purposes and needs of the end-users, and includes desirability, acceptability, and usability dimensions. Results confirm decision-maker desire for rational approaches like PBMA. However, most participants indicated that the timing of the exercise and the form in which PBMA was applied were not well-suited for this case study. Participant acceptance of and buy-in to PBMA changed during the study: a leadership change, limited organizational commitment, and concerns with organizational capacity were key barriers to PBMA adoption and thereby effectiveness.
Practical implications
These findings suggest that a potential way-forward includes adding a contextual readiness/capacity assessment stage to PBMA, recognizing organizational complexity, and considering incremental adoption of PBMA’s approach.
Originality/value
These insights help us to better understand and work with priority setting conditions to advance evidence-informed decision making.
Details
Keywords
This paper examines the rhetorical strategies of two Indian microfinance organizations as they transformed from non-profit to commercial format. They shifted forms at a time (year…
Abstract
Purpose
This paper examines the rhetorical strategies of two Indian microfinance organizations as they transformed from non-profit to commercial format. They shifted forms at a time (year 2010), when commercialization had been criticized severely. The purpose of this paper is to understand “How does a microfinance organization justify its action of transformation to retain legitimacy?”
Design/methodology/approach
The paper adopts a qualitative case study method to understand the phenomena. Interview, archival documents, and field observations are the major source of data for the study. Data analysis is carried out through coding method.
Findings
Drawing from Suddaby and Greenwood’s (2005) work on rhetorical strategies, the paper suggests that these organizations have used two types of rhetorical strategies – cosmological and teleological. These strategies operate in a performative role and link deviant practices with routines. It focuses on institutional maintenance rather than change.
Research limitations/implications
The paper acknowledges two important limitations. First, the rhetorical focus may be influenced by the history of organization. So depending on organization selected, the focus may vary. Second, the paper is constricted by the low-documentation practices prevailing in many civil society organizations.
Originality/value
The paper contributes to the literature on hybrid organization by unpacking the process of sense making in a hybrid form. The paper also reinforces the argument that language operates in a performative role. The paper provides a new context (India) to understand the process of rhetorical strategies.
Details
Keywords
The aim of this study is two-fold: (1) to promote a model of youth participatory research and offer a window of understanding into how it can be enacted and (2) to understand…
Abstract
Purpose
The aim of this study is two-fold: (1) to promote a model of youth participatory research and offer a window of understanding into how it can be enacted and (2) to understand youth perspectives on youth empowerment. This study asks: “how can youth help us understand youth empowerment?”
Design/methodology/approach
The study applies youth participatory action research (YPAR) and interpretative phenomenological analysis. The study illustrates how to enact a model of YPAR by engaging youth in the process of research in a youth-serving community non-profit organization.
Findings
This study sets out to make two important contributions, one methodological and one theoretical: First, the study contributes to our understanding of the opportunities and benefits of youth-engaged, peer-to-peer research. Specifically, this study promotes a model of youth participatory action research and knowledge making processes, and the associated social and formal benefits for youth. By extension, this study illustrates an approach to engage youth in formal contexts which has implications for both management and organizational studies and education. Finally, the study extends our understanding and conceptualization of the phenomenon of youth empowerment (as informed by youth perspectives).
Originality/value
The study offers insight into how to conduct youth participatory action research and specifically how to address two limitations cited in the literature: (1) how to authentically engage youth including how to share power, and (2) how to perform youth participatory action research, often critiqued as a black box methodology.