Ann E. Tourangeau, Patricia W. Stone and David Birnbaum
Examines health‐care restructuring activities undertaken across North American hospitals over the past decade related to hospital care by nursing professionals (i.e. hospital…
Abstract
Examines health‐care restructuring activities undertaken across North American hospitals over the past decade related to hospital care by nursing professionals (i.e. hospital nurses versus practical nurses or aides). Identifies fundamental lessons learned and highlights important priority research areas that must be undertaken to ensure that future initiatives achieve the intended effect of improving patient outcomes.
Details
Keywords
Kristen Cibelli Hibben, Beth-Ellen Pennell and Lesli Scott
At the invitation of the Programme for the International Assessment of Adult Competencies (PIAAC), this paper aims to examine advances in survey interviewer monitoring and make…
Abstract
Purpose
At the invitation of the Programme for the International Assessment of Adult Competencies (PIAAC), this paper aims to examine advances in survey interviewer monitoring and make recommendations on minimizing the effect of interviewers on survey results.
Design/methodology/approach
The authors first provide an overview of the most recent literature on interviewer effects, quality assurance and quality control. Here, they draw upon recent publications such as the cross-cultural survey guidelines (www.ccsg.isr.umich.edu) and newly published or in-press material specifically addressing these issues in multicultural, multinational and multiregional (3MC) contexts.
Findings
The authors discuss trends and innovations in quality assurance and quality control in 3MC studies and draw upon examples from international surveys that are using cutting-edge and innovative approaches to monitor interviewer behavior and minimize interviewer effects.
Originality/value
With a view to continuous quality improvement, the authors conclude with concrete recommendations for PIAAC to consider for the next cycle. Many of the recommendations have general relevance for other large-scale cross-national surveys.
Details
Keywords
Lars Lyberg, Kristen Cibelli Hibben and Beth-Ellen Pennell
Surveys in multinational, multiregional and multicultural contexts (or “3MC” surveys) are becoming increasingly important to global and regional decision-making and theory…
Abstract
Purpose
Surveys in multinational, multiregional and multicultural contexts (or “3MC” surveys) are becoming increasingly important to global and regional decision-making and theory building. To serve this purpose, the surveys need to be well managed, with an awareness of key sources of survey error and how to minimize them, mechanisms in place to control the implementation process and an ability to intervene in that process when necessary in a spirit of continuous improvement (Pennell et al., 2017). One key approach for managing and assessing the quality of 3MC surveys is the total survey error (TSE) framework and associated survey process quality. This paper aims to examine the application of the TSE framework and survey process quality to the Programme for the International Assessment of Adult Competencies (PIAAC).
Design/methodology/approach
The authors begin with a background on TSE and discuss recent adaptations of TSE and survey process quality for 3MC surveys. They then presents a TSE framework tailored with examples of potential contributions to error for PIAAC and ways to address those through effective quality assurance (QA) and quality control (QC) approaches.
Findings
Overall, the authors find that the design and implementation of the first cycle of PIAAC largely reflect the current best practice for 3MC surveys. However, the authors identify several potential contributions to error that may threaten comparability in PIAAC and ways these could be addressed in the upcoming cycle.
Originality/value
With a view toward continuous improvement, the final section draws on the survey process quality approach adapted from Hansen et al.’s study (2016) to summarize the recommendations in terms of additional QA elements (inputs and activities) and associated QC elements (measures and reports) for PIAAC’s consideration in the next cycle.
Details
Keywords
Elizabeth Yakel and Helen Tibbo
User‐based evaluation in archives and special collections is in its infancy, and this paper aims to discuss the conceptualization, development, and testing of Archival Metrics…
Abstract
Purpose
User‐based evaluation in archives and special collections is in its infancy, and this paper aims to discuss the conceptualization, development, and testing of Archival Metrics Toolkits. The development and adoption of standardized metrics to support the management of both analog and digital collections is a critical need in archives and manuscript collections.
Design/methodology/approach
The Archival Metrics Toolkits were created, and comprised five user‐based evaluation instruments for archives and special collections in colleges and universities: researcher, archival web sites, online finding aids, student researchers, and teaching support.
Findings
The Archival Metrics Toolkits, as developed, represent a first step toward standardized evaluation created specifically for archives. Now it is up to the community to adopt these tools and report their use.
Originality/value
These are the first standardized questionnaires to target archives and special collections and take into consideration the unique environment of primary sources and the specific dynamics involved in connecting researchers with archival and manuscript collections.
Details
Keywords
Jennifer Dineen, Mark D. Robbins and Bill Simonsen
Fiscal conditions and budget constraints in the United States have placed solutions to budget deficit problems at the center of the public policy debate. Preferences for deficit…
Abstract
Fiscal conditions and budget constraints in the United States have placed solutions to budget deficit problems at the center of the public policy debate. Preferences for deficit reduction strategies are likely to be heavily associated with particular ideologies and other demographic and economic variables. Therefore, since this study is a true randomized experiment, it provides strong evidence about the influence of question wording on deficit reduction preferences, and therefore the likelihood it is susceptible to manipulation. We find clear evidence that using the word ‘tax’ significantly and substantially influences respondents’ choices. This result is robust over two experimental trials about a year apart and whether or not control variables are included.
Rhiannon Lord, Nicola Bolton, Scott Fleming and Melissa Anderson
The purpose of this paper was to review the effectiveness of telephone interviewing for capturing data and to consider in particular the challenges faced by telephone interviewers…
Abstract
Purpose
The purpose of this paper was to review the effectiveness of telephone interviewing for capturing data and to consider in particular the challenges faced by telephone interviewers when capturing information about market segments.
Design/methodology/approach
The platform for this methodological critique was a market segment analysis commissioned by Sport Wales which involved a series of 85 telephone interviews completed during 2010. Two focus groups involving the six interviewers involved in the study were convened to reflect on the researchers’ experiences and the implications for business and management research.
Findings
There are three principal sets of findings. First, although telephone interviewing is generally a cost-effective data collection method, it is important to consider both the actual costs (i.e. time spent planning and conducting interviews) as well as the opportunity costs (i.e. missed appointments, “chasing participants”). Second, researchers need to be sensitised to and sensitive to the demographic characteristics of telephone interviewees (insofar as these are knowable) because responses are influenced by them. Third, the anonymity of telephone interviews may be more conducive for discussing sensitive issues than face-to-face interactions.
Originality/value
The present study adds to this modest body of literature on the implementation of telephone interviewing as a research technique of business and management. It provides valuable methodological background detail about the intricate, personal experiences of researchers undertaking this method “at a distance” and without visual cues, and makes explicit the challenges of telephone interviewing for the purposes of data capture.
Details
Keywords
Reuben Olugbenga Ayeleke, Nicola Henri North, Annette Dunham and Katharine Ann Wallis
Training to improve health management and leadership competence is recommended. However, there is limited evidence showing the impact of training on competence. The purpose of…
Abstract
Purpose
Training to improve health management and leadership competence is recommended. However, there is limited evidence showing the impact of training on competence. The purpose of this paper is to evaluate the evidence for the impact of training and professional development on health management and leadership competence.
Design/methodology/approach
A systematic review was conducted using a mixed-methods design. Studies using qualitative, quantitative or mixed-methods design were included. The following electronic databases were searched to October 2018: CENTRAL, CINAHL, EMBASE, ERIC, NEDLINE and PsycINFO. Study eligibility and methodological quality were assessed independently by two review authors. Data from qualitative studies were synthesised using thematic analysis. For quantitative studies, odds ratio (OR) or mean difference (MD) and 95% confidence interval (CI) were calculated for each intervention. Where appropriate, qualitative and quantitative data were integrated into a single synthesis using Bayesian methods.
Findings
In total, 19 studies were identified for inclusion in the review. Training and professional development interventions using flexible, multiple training techniques tailored to organisational contexts can improve individual competence and performance. Such training is typified by a leadership development programme. There was insufficient evidence to determine the effects of interventions on organisational performance.
Originality/value
This is the first systematic review evaluating the impact of training and professional development interventions on health management and leadership competence.