Diaries as a Methodological Innovation for Studying Grand Challenges
Organizing for Societal Grand Challenges
ISBN: 978-1-83909-829-1, eISBN: 978-1-83909-826-0
ISSN: 0733-558X
Publication date: 29 March 2022
Abstract
We illustrate the potential of diaries for advancing scholarship on organization studies and grand challenges. Writing personal diaries is a time-honored and culturally sanctioned way of animating innermost thoughts and feelings, and embodying experiences through self-talk with famous examples, such as the diaries written by Anne Frank, Andy Warhol, or Thomas Mann. However, the use of diaries has long been neglected in organization studies, despite their historical and societal importance. We illustrate how different forms of analyzing diaries enable a “deep analysis of individuals’ internal processes and practices” (Radcliffe, 2018) which cannot be gleaned from other sources of data such as interviews and observations. Diaries exist in different forms, such as “unsolicited diaries” and “solicited diaries” and have different purposes. We evaluate how analyzing diaries can be a valuable source to illuminate the innermost thoughts and feelings of people at the forefront of grand challenges. To exemplify our arguments, we draw on diaries written by medical professionals working for Doctors Without Borders as part of our empirical research project conducted in extreme contexts. We show the value of unsolicited diaries in revealing people’s thought world that is not apprehensible from other modes of communication, and offer a set of practical guidelines on working with data from diaries. Diaries serve to enrich our methodological toolkit by capturing what people think and feel behind the scenes but may not express nor display in public.
Keywords
Citation
Rauch, M. and Ansari, S.(. (2022), "Diaries as a Methodological Innovation for Studying Grand Challenges", Gümüsay, A.A., Marti, E., Trittin-Ulbrich, H. and Wickert, C. (Ed.) Organizing for Societal Grand Challenges (Research in the Sociology of Organizations, Vol. 79), Emerald Publishing Limited, Leeds, pp. 205-220. https://doi.org/10.1108/S0733-558X20220000079019
Publisher
:Emerald Publishing Limited
Copyright © 2022 Madeleine Rauch and Shahzad (Shaz) Ansari
License
This chapter is published under the Creative Commons Attribution (CC BY 4.0) licence. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial & non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this licence may be seen at http://creativecommons.org/licences/by/4.0/legalcode
Miss Prism: Cecily. I really don’t see why you should keep a diary at all
Cecily: I keep a diary in order to enter the wonderful secrets of my life. If I didn’t write them down, I should probably forget all about them
(Oscar Wilde: Bunbury: 1908: 210)
Introduction
The burgeoning literature on grand societal challenges spans a variety of spheres (e.g., Ferraro, Etzion, & Gehman, 2015; Gatzweiler, Frey-Heger & Ronzani, 2022), addressing, among others, poverty alleviation (Pradilla, Bento da Silva, & Reinecke, 2022) to affordable health care (Rauch & Ansari, 2021). However, there is still much to learn about how individuals at the frontline of these challenging contexts, experience and cope with extreme situations involving human suffering. While extreme contexts and grand challenges are two distinct strands of literature, many grand challenges play out in extreme contexts (see Hällgen, Rouleau, & de Rond, 2017, for an overview). Relatively little research has attended to the emotional trauma of individuals working to alleviate human suffering in the midst of extreme contexts, such as warzones (De Rond & Lok, 2016; Fraher, Branicki, & Grint, 2017) and refugee camps (De La Chaux, Haugh, & Greenwood, 2018).
Social science has documented numerous sources of data to study grand challenges such as surveys, case studies, interviews, ethnographies, and natural experiments, to capture the complex and manifold dimensions of grand challenges. Such data, however, may not be able to apprehend the real-time feelings, thoughts, and experiences of affected individuals confronting extreme situations. For example, in their study of the social stability in a Kenyan refugee camp, De La Chaux et al. (2018, p. 160) acknowledge the difficulty of studying grand challenges:
[…] sensitive topics such as incidents of rape and the role of mafia gangs remained difficult to discuss as we sensed a clear reluctance to delve into these topics. […] In the follow-up phone interviews, silences, pauses, and hesitation took on a similarly central role and again occurred primarily when we inquired about incidents of gender-based violence and gang structures […].
In the past decades, several methodological innovations have emerged in management scholarship to address various ontological and epistemological considerations. This includes video data, team ethnographies, and multimodality – addressing material, sensory and visual aspects of data (Jancsary, Höllerer, & Meyer, 2016; Kress, 2010) in order to strengthen the existing methodological arsenal, such as field observations and interviews. However, concepts such as emotions and cognitions are still difficult to decipher and access (Zietsma, Toubiana, Voronov, & Roberts, 2018). Oftentimes, “emotions are not worn on sleeves” but instead actors engage in emotional labor, emotional self-censorship, or a strategic display of their emotions (Jarvis, Goodrick, & Hudson, 2019). The well-known example of the air hostess smiling on the job (Hochschild, 1979) points to the emotional labor in the service industry, in which actors perform certain roles (e.g., being friendly and welcoming) that do not betray the feelings that they actually experience.
We propose the use of personal diaries (Burgess, 1984) as a fruitful and rich source of data in the endeavor to study grand challenges by giving voice to participants in the daily praxis of their work. Diaries capture people’s innermost thoughts, reflections and memories that they document without the gaze of social judgment. Writing personal diaries described as a “technology of the self” (Foucault, 1982) is a time-honored and culturally sanctioned way of animating personal values and innermost feelings (Klein & Boals, 2001), and embodying experiences through self-talk. Indeed, diary writing is an established tradition and practice across different cultural backgrounds dating back to famous examples such as the so called “Pillow book” by the court lady Sei Shanoagon to Empress Consort Tieshi during the 990s and early 1000s in Japan. Other notable examples include James Cook’s board journals from the eighteenth century, the diaries kept by Samuels Pepys from London in the 1660s, and the diaries written by Anne Frank and Thomas Mann – all of which represent important cultural and historical artifacts of modern society.
Drawing on our own experience of working with diary-based data in extreme contexts (e.g., see Rauch & Ansari, 2022 for a diary-based project studying military personnel), we illustrate their potential of diaries to study and advance scholarship on grand challenges and organization studies. While diary writing is known to bring psychological benefits to people coping with traumatic events (Amabile & Kramer, 2011), we showcase the value of diary writing for management studies (Balogun, Huff, & Johnson, 2003; Ohly, Sonnentag, Niessen, & Zapf, 2010). Diary studies seem particularly suitable for investigating personal accounts of people deeply affected by grand challenges, and capturing their innermost thoughts and feelings, as well as their coping strategies in the midst of extreme contexts (Farny, Kibler, & Down, 2019). We show the value of unsolicited diaries in revealing the inner world of people that cannot be captured by other modes of communication. We outline different ways of working with diaries and the advantages and disadvantages of conducting research with diaries, and provide a set of practical guiding principles by drawing on our own experiences of working with diaries-based data.
Using Diaries for Studying Grand Challenges
Despite its frequent use in private life such as in the famous examples of Anne Frank, Max Frisch, Andy Warhol, and a myriad of diary writers across the globe, the use of data from diaries in (social) science is rather rare. This is despite the few attempts to introduce diaries into social science (Alaszweski, 2006; Balogun & Johnson, 2004; Rauch & Ansari, 2022). In many disciplines, such as chemistry, pharma, and medicine, using and writing diaries are integral parts of research, as well as a means of transferring and communicating knowledge between individuals to keep track of developments (Bartlett & Milligan, 2015; Hislop, Arber, Meadows, & Venn, 2005). In comparison, social science research rarely relies on diaries as a key source of knowledge (see for exceptions Balogun & Johnson, 2004; Hannaway, 1989; Rauch, & Ansari, 2022). The use of self-reporting methods like diaries has been described as an “unconventional method” (Wickert & Schaefer, 2015, p. 124), and can serve “as a supplement to the active role of critical researchers” (Wickert & Schaefer, 2015, p. 124) in shedding new light on managerial work and the performative aspects of language. indeed, “self-reporting methods have been applied successfully [...] and appear to be a promising tool” (Wickert & Schaefer, 2015, p. 124).
Diaries vary in terms of the degree of detail but also in the way they are written, as well as regarding the motivation of people to write diaries. Diarists adopt different styles in writing about different aspects of their lives. While some diarists engage in daily writing, for example, in the morning or the evening, others engage in less frequent journaling. The diversity of diaries is also illustrated by the different forms that diaries take; some write on Microsoft Word, others use weblogs or diary-apps, a classical blank page or a book with or without a lock.
Here, we follow the definition of diaries by Alaszweski (2006, p. 2) “as a document created by an individual who has maintained a regular, personal and contemporaneous record.” In the extant literature, journaling, keeping a diary, and diarist, are treated as synonyms (Alaszweski, 2006). Diaries are emic reflections and not etic observations. Emic reflections refer to viewpoints obtained from within the social group from the subject’s insider perspective. Etic observations refer to the observer’s outsider perspective (Headland, Pike, & Harris, 1990).
We provide granularity and specificities regarding how diary data can be used to study organizational phenomena and provide the distinctions between two forms of diaries, and their advantages and disadvantages (see Table 1); that is, (1) unsolicited diaries, which are diaries that are conducted voluntarily without the observation of others; or (2) solicited diaries, which are written for trials, research projects or to cover a particular event (Milligan & Bartlett, 2019). For example, Rauch and Ansari (2022) use unsolicited diaries of military personnel working in the U.S. Air Force to study their perception of drone technology and its influence on nature and morality of their work, and the subsequent consequences it had for them and their work. Balogun et al. (2003) solicited managers to write their reflections in a diary based on their responses to five questions to track the progress of change implementations in their organizations. Others, such as Buchanan and Boddy (1992) studied the change managers’ experience of managing change by drawing on audio diaries over a two-week period. Schilit (1987) drew on diaries by middle managers to record the frequency, nature, and outcome of interactions among supervisors and themselves, in relation to strategic decisions over two months. These examples highlight the importance of diaries as a tool for research.
We zoom in on the use of unsolicited diaries, as they offer unique insights into the “thought world” of the diarist without being subject to social desirability and other biases that potentially affect solicited diaries. One type of such unsolicited diaries is also referred to as “natural diaries.” In other words, “the test is whether the interaction would have taken place in the form that it did had the researcher not been born or if the researcher had got run over on the way to the university that morning” (Potter, 1996, p. 135). Diaries allow for immediate reflections on events, experiences, and thoughts. In particular, diaries provide a more nuanced understanding of situations that evoke strong emotions. As such, unsolicited diaries can mitigate retrospective bias and socially desirable responses by providing a thick description of events in “real-time,” and how those events unfold over time (e.g., in change processes).
Overview Diaries.
| Unsolicited Diaries | Solicited Diaries | |
|---|---|---|
| Definition | Diaries are conducted voluntarily without observation of others | Diaries are written for the purpose of trials, research, or to cover particular events |
| Advantages |
|
|
| Points for consideration |
|
|
| Important examples | Rauch and Ansari (2022) studying military operators | Balogun and Johnson (2004) studying middle manager |
Studies on extreme contexts have illustrated how people “emotionally control” (de Rond & Lok, 2017; Fraher et al., 2017) their behavior in difficult situations, and are reluctant to speak about difficult experiences. One example is the study by De La Chaux et al. (2018) on maintaining social stability in Kenyan refugee camps. Fraher et al. (2017, p. 252) allude to the role of emotions in their study of U.S. Navy Seals working in Afghanistan and Iraq, arguing that
the Seal candidate is forced to compartmentalize his emotions – and not fixate on them – to provide his best effort in the moment and to not obsess over the “what-ifs” […].
The social norms of working in extreme contexts such as in the military encourage a “culture of silence” (De Rond & Lok, 2016; Fraher et al., 2017), where participants are unable to not just express or display their emotional distress but also not share their experiences with colleagues. By observing or interviewing actors in such extreme contexts, one might conclude that actors are not emotionally affected by the experienced atrocities as they appear calm and controlled in getting on with their job, preferring not to display their emotions in public (Farny et al., 2019; Jarvis et al., 2019). As such, diaries can capture the experience of individuals in a way that is not possible by using traditional designs. They permit the examination of events and experiences in their natural and spontaneous context (Reis, Erber, & Gilmore, 1994), offsetting some of the problems associated with retrospective accounts (Bower, 1981).
Empirical Examples from Diaries
To show their methodological value, we provide illustrations of how diary studies can be used to enrich qualitative studies. Potentially, diaries can be used in the same manner as sole diary studies and as a support for quantitative studies (e.g., Amabile, Barsade, Mueller, & Staw, 2005; Schilit, 1987). However, we will focus on diaries as part of qualitative analysis. We draw on one example conducted for a larger project on “organizing in extreme contexts” in which we studied how actors cope with brutal reality in such contexts. In doing so, we draw on examples from our research drawing from unsolicited diaries obtained from medical personnel working for Doctors Without Borders (MSF).
In the case of MSF, we analyzed a set of over 70 diaries of medical personnel ranging from nurses, doctors, and surgeons from different parts of the world with diverse backgrounds, gender and sexual orientations. The organization did not prescribe its personnel to write diaries. Instead MSF personnel engaged voluntarily in journaling. We interviewed all diarists (besides one) after we read through the diaries several times. In addition, one author joined several missions to extreme contexts such as Afghanistan, South Sudan, and Yemen to observe work in extreme contexts and get a feel of the context. This was done in light of our research interest in the realm of grand challenges, in contexts that scholars have described as people being “silent” or numb when it comes to the expression of their emotional experiences. In these situations, actors have deployed coping strategies when they are unable to openly voice, express, and display their emotional distress.
Our observations regarding emotional experiences from field trips align with the findings of studies of contexts where actors prefer to remain silent rather than display their emotions and articulate their experience. Actors cope in different ways when faced with trauma, such as black humor, cynicism, planting vegetables, or engaging in substance abuse. By analyzing the diaries, we were able to observe that actors are actually not emotionally numb or in control of their emotions as it may appear from observing their behaviors in the field. Instead, they are highly affected emotionally by the experience on the ground but simply don’t wear them on their sleeve. As such, a surgeon illustrates in his diary his experience working in an MSF clinic in Afghanistan:
I started two days ago and I remember he [Youssuf] was one of my first ones. I can’t describe what I have done. I know the medical procedure but in reality, what I did. I cannot. I should be able to but I cannot. I had no other option. Had the inner urge to puke. […] Youssuf was one of my longest patients. He had a severe infection. […] No surprise he had a severe infection. Every double here without infection is a medical miracle. Prosthetics in plastic bags. No wheelchair. No doubt no wheelchair. What do I even say? I am happy if we have enough pain pills to hand them […]. We have set him up with new prosthetics today. It was Christmas and birthday all in one. It is the best of all feelings here. It is the only feeling worth describing here. (Diary 56)
In a follow-up interview with this surgeon, we probed further into this diary entry in relation to the patient which he called Youssuf:
Of course I have never talked to anybody in the field about my sentiments towards Youssuf. Talking isn’t a way of solving anybody's problem in the field. We all do the work and we all need to find ways to come to terms with it. But to your question. No, I have never articulated or share this with anybody. We all performed procedures together but we have never talked about it from a human empathic point of view. We kept it always to the medical point of view. For me writing a diary which I still do to his very point was a way to find a space for myself but also a space to share my thoughts, both negative and positive ones. And I can tell you in the field there are more negative ones. (Interview 56)
Looking at diaries in relationship to the interviews allowed us to access the inner thoughts, reflections, and feelings of the actors in the field. By looking at these diaries, we reveal how medical professionals are highly affected emotionally by what is happening in the field in contrast to what one may conclude from observing their behaviors in the field where they may appear as “cold rational agents.” We could also observe how actors described the need to change their way of “seeing” and “perceiving reality.” They described such a change as necessary “to survive” and cope with the traumatic reality at hand. A doctor in a field trip to Yemen reflected on the situation of civilians and the lack of access to basic food and medical supplies amidst the ongoing war:
Once starvation was on the table and starvation was used as a weapon and tool of war, things radically changed for me. One needs to change to stay sane. No way to rationalize and find a justification why a human being would use and try to eradicate other humans in such a manner and cruel way […]. At this point I learned the hard way to look the other way. A different way! Which way this is I am still figuring out. For now, I just know it can't be the old way. (Diary 70)
Despite the need to cope with the difficult situations on the ground, and “look the other way,” we identified a “culture of silence” (De Rond & Lok, 2016), where people do not share nor openly talk about their difficult experiences and emotional distress. Rather, they express themselves through writing personal diaries that reveal the internal conflicts they experience and the mechanisms they use to cope with the conflict. They engage in this form of “self-censorship” (Edmondson, 1999), not out of fear that speaking up will lead to being penalized by their superiors or concerns about personal consequences (e.g., Morrison, 2011). Rather they do so, as a coping mechanism to deal with the emotional distress they experience in extreme situations and for being able to “get the job done.” Speaking about emotional distress and sharing feelings even with colleagues only made matters worse, as in many cases, it led to emotional breakdowns.
Overall, looking at the diaries while not being a researcher in situ, allows us to gain an insider’s understanding of their daily experiences and a peek into their innermost thoughts and feelings unobservable elsewhere.
Methodological Guidance
In the excerpts we showed, we have used the example of emotions illustrating the power of diaries. The use of diaries is not limited to the aforementioned concepts and ideas. Studying diaries can be also used for concepts such as cognition, sensemaking, and framing but also for studying identity, and interactions with technology. We see strong potential in using diaries revealing other aspects of organizational life and changes in the nature of work. For example, in following organizational norms, procedures, and rules, there may be a stark difference between the emotions experienced and the behavior displayed in which people may not express their innermost doubts and cynicism.
We provide practical guidance informed by our own experience, and some important questions to be raised when engaging with diaries (see Table 2). We have characterized them alongside steps in empirical research which may vary depending on the scope of projects.
Questions to Consider When Working with Diaries.
| Data Collection | Data Analysis | Ethical Considerations |
|---|---|---|
|
|
|
Data Collection
One reason why diary-based studies are less common in organization studies is partly due to the difficulty of access to diaries. Not everyone writes diaries nor may be vocal about their journaling, and even if they write diaries, they may be less willing to share their diaries with a stranger (researcher). This observation is in particular true for unsolicited diaries as these are not written as part of a research project, but instead considered to be a “sacred” space for the diarist’s private or even intimate reflections and inner thoughts. It might be easier to obtain in pre-arranged solicited diaries (e.g., see Ohly et al., 2010). One example is the study of procedures by Balogun et al. (2003) in which the authors instructed the diarists to focus on five particular questions in their journaling activities. Also, in a solicited diary study, Amabile and Kramer (2011) probed the everyday work experiences of professionals working of 238 professionals in 26 project teams. The study was based on a daily questionnaire in the form of a diary that was emailed from Monday through Friday. For gaining access to diaries, consider public sources such as the German diary archive which houses over 20,000 diaries by 4,000 diarists (Deutsches Tagebucharchiv, 2019), or the solicited diary database by Theresa Amabile based on her past work.
From interactions with vocal actors at MSF, we had prior knowledge that a group of actors engages in journaling in order to cope with their emotional distress. Through support by key figures (including award-winning medics highly esteemed within the community) and personal relationships, we were able to build trust with an initial set of volunteers who became willing to share their diaries with us. It is important to emphasize that central figures do not necessarily need to be high ranked officials, or those with administrative influence such as human resources, that most likely does not keep track of who engages in private diary writing. On the contrary, it was important for actors in our setting that their private diaries will not “land on the desk of HR” (Interview 10). It is important to gradually build trust in order for people to become amenable to sharing data that might contain intimate aspects of their lives.
We used a snowballing approach (Biernacki & Waldorf, 1981), that is, “a study sample through referrals made among people who share or know of others who possess some characteristics that are of research interest” (p. 141). We did not directly ask diarists to participate given the sensitive nature of data, but we relied on the unsolicited referrals of individuals encouraging other colleagues to participate by sharing their diaries. In subsequent projects, community support was of pivotal importance to gain access. Our experience of doing research in extreme settings, including time spent in Afghanistan visiting military establishments and semi-governmental organizations, gave us legitimacy in being able to relate and “speak the same language.” Our independent role as researchers also helped in gaining access, as we do not hold any institutional ties to the organizations, nor are involved in any consulting, education or any other activity. Participants saw us as neutral outsiders with no affiliation with the organization (including HR). As some of them acknowledged in private conversations, they were more willing to share their diaries with us than anyone from within their organization or the media.
In our project, diary data have been the primary data source, which we have complemented with observations to sensitize us with the context, and interviews to follow-up on emerging topics and need for clarification. However, we made two key observations during the follow-up interviews: First, actors reacted differently to us knowing “everything” from their diaries including very personal sentiments pertaining to aspects outside of our research interest (e.g., family life, dreams, and desires) from treating us very welcomingly to being rather reserved. Some felt uncomfortable at first: “you know me through and through but I hardly know you.” As a common reaction at the beginning of each interview, most diarists asked the questions “Did you read all of it [Diary]”? often concluding that “you know more than my wife does” and “Don’t know what I can add to this anymore.” Second, many felt uneasy about revisiting particularly (harsh) experiences when prompted, as they found them “difficult to speak about.” This is echoed by De La Chaux et al. (2018) that people find it difficult to talk about difficult experiences despite journaling frequently about these experiences (e.g., the diary entry about a surgeon writing about his patient Youssuf). Others stated that “maybe it wasn’t all that bad” and “I have not thought about this incident in a long time,” which prompted us to be very careful and patient in interviews. Also, informal settings and a flexible interview guideline was key to a meaningful interview, and we often let the interviewees choose the time and place. Overall, very few interviews could live up to the standards of diaries in terms of the density, richness, and value of information but instead encountered instances of memory loss and retrospective sensemaking, which are common drawbacks in interviews.
At the same time, interviews were helpful to tease out follow-up questions, and what seemed to be taken-for-granted assumptions in diaries. Unsolicited diaries are written in a natural manner, and as such, there is no standard structure such as introduction or an explicit description of key actors (e.g., family members, relatives, and work aspects) and key events. This requires the researcher to establish that who are the important actors in a diarist's life and their relationships. In contrast to other forms of data collection, diarists do not first systematically introduce key players as their relationship is obvious to them at the time of diary writing [but not to the reader]. As such diarists do not refer to “my sister Tanja,” but instead refer to simply “Tanja” or “my sister.” Similarly, a diarist referred often to his love for Ellie and how much he misses Ellie “Today I really miss Ellie” (Diary 19) which turned out to be a Cocker Spaniel and the family dog when he grew up in Michigan, which died when the diarist went to medical school. Context may thus be missing and the researcher needs to make sense of the meaning.
Data Analysis
Diaries can be analyzed drawing on inductive, abductive, or deductive approach, different ontological and epistemological stances, depending on interests and the nature of data, to address a broad range of research questions (Ohly et al., 2010). Although we have not focused on quantitative research, new tools such as machine learning can be fruitful to leverage the vast amount of data gathered in diary studies.
Before starting our analysis, we imported data into the qualitative text analysis software NVivo for further analysis. As the diaries varied in their degree of details and writing style; and were both in hand-written and electronic forms, we transcribed all hand-written diaries (14) into an electronic form to facilitate further analysis. We returned hand-written diaries to their respective owner after transcribing them.
In the empirical example we presented, we draw on a framing lens (Goffman, 1974), which was used as a “sensitizing concept.” It does not “provide prescriptions of what to see” but can “suggest directions along which to look” (Blumer, 1954, p. 7) to work with the amount of data. A potential drawback of diary studies, especially when working with unsolicited diaries is the amount of data often spanning months to years. It can easily amount to thousands of pages many of which do not pertain to the targeted research questions. This is why doing explorative work is time and resource intensive. Drawing from our experiences, a sensitizing theoretical lens might be fruitful to guide coding while still allowing for emergence, serendipity, or to “stumble(d) upon” (Wiedner & Ansari, 2017, p. 15).
We followed an inductive approach, drawing on the tenets of interpretive research. We iterated between data, emerging themes, and existing theory throughout our analysis (Locke, 2001). When working with diary data, commonly established practices may be used such as axial coding, thick descriptions, and creating tables. We created tables and timelines, stating background information, important key events and mission experiences for the different diarists. Here it was particularly important to match diary content with the follow-up interviews. Such development of chronologies might add complexity in creating a “thick description” of events, when different diarists interact with each other and reference the same events and experiences. In our case, actors rarely joined the same mission however we had the challenge that these diaries sometimes varied in the time period they are written. For example, diarist 1 engaged in journaling in the years 2011–2017 only when on missions, diarist 2 engaged in daily journaling in the years 2015–2017 regardless of being on or off missions. Diarist 2 covered many aspects including his “life back at home” which diarist 1 did not do. Hence, one needs to be aware of the limitations and peculiarities of diaries.
Analyzing diaries in extreme settings is difficult and potentially more demanding due to the gravity of the content. This included a lurking feeling among researchers of being powerless to change situations for diarists and the people affected by grand challenges, who live in dire situations. Researchers may also feel guilty about their sheer privilege of being able to code diary data on an Apple MacBook while sitting in a nice academic office in a university with central heating and running hot water. At least that was our experience in comparison to conducting research at a public media broadcaster (Rauch, Wenzel, & Koch, 2020; Wenzel, Cornelissen, Koch, Hartmann, & Rauch, 2020). We thus needed to develop certain coping techniques when working with very bleak and dark contents (e.g., only coding in the morning and not before going to bed; and regular (mostly daily) sharing with the team to help with coping as a researcher).
Ethical Considerations
When working with diaries, the importance of ethical considerations cannot be overstated (see Wood, 2006). Particular care must be given to anonymity, diarists’ confidentiality, and data security once diaries have been entrusted to the research team. This begins from the moment of obtaining the diary, data storage, transcriptions of hand-written diaries (e.g., by third party services), and the publication of information of the diarists. After all, the diarists have entrusted their most private thoughts oftentimes covering their entire life stories for research purposes. Regulations such as the GDPR have addressed aspects of data protection that are also relevant to diary studies that contain personal data.
We took special care to uphold the trust placed in us, as these diaries contained the actors’ intimate thoughts and reflections. We anonymized the data to protect the diarists’ identities and those of the people and events they talked about. Given the known problems with Dropbox, and cloud services, we have made the deliberate decisions not to use such services but instead store the data locally relying on more old-fashioned approaches when sharing data, such as USB sticks to reduce the risk of unauthorized access.
Given the sensitive nature of some of the diaries’ content, and data protection issues, we assured diarists from the outset, that we would refrain from referring to specific missions, procedures, individuals, and private matters (e.g., affairs, extramarital relationships, etc.) which are beyond the scope of our research. A practical guide to ensure this anonymity, we worked on codification even before uploading the data to the qualitative software package. Hence, in the subsequent discussions, we always referred to their assigned number or a fictional name. To further ensure their anonymity, we refrained from connecting on social media (e.g., LinkedIn, Twitter, and Facebook) unless explicitly requested by them.
Conclusion and Implications
In this article, we illustrate the importance of diaries in studying people’s inner thought worlds. Diaries are an important example of the use of self-reporting methods, and part of “unconventional method” in conducting research (Wickert & Schaefer, 2015). Their innermost thoughts and feelings that they write about in solitude cannot be gleaned from other sources of data such as interview data or field observations. For this purpose, we drew on an empirical example building on a qualitative study that we conducted in extreme contexts based primarily on data from diaries. This was paired with the support of interview and observational data, in which we illustrate the power of diaries in studying the phenomenon of how people cope with emotional distress in extreme contexts, and other key concepts relevant to organizational phenomena. In addition, we offer a set of practical guidelines for scholars intending to work with diaries.
We address how diaries help to understand that emotions may be strategically displayed or purposefully withheld. By focusing on diaries, a researcher can capture some of these innermost thoughts and feelings, immediate reflections, and the sensemaking process in these situations. Drawing on diaries allows us to better understand the “thoughts, feelings, considerations and reactions”; and be able to “capture these events as they happen to avoid the problems associated with retrospect” (Radcliffe, 2017, p. 190). Gaining insights into these experiences and infer the underlying meanings not readily discernable from observed behaviors and interactions requires the use of “creative methodologies” (Gray, Purdy, & Ansari, 2015). While previous methodological advancement has been built on new tools such as analyzing video data and multimodal communication more broadly, diary studies help us to look on the “backstage” of the “backstage” (Goffman, 1959). This also echoes with calls for innovations in qualitative methods in business ethics, corporate responsibility, and sustainability research, as “business ethicists cannot afford to ignore under-researched topics of great ethical import because reliable data is hard to obtain” (Reinecke, Arnold, & Palazzo, 2016, p. 14).
We show the importance of analyzing diary writing as a “technology of the self,” where one writes to and for oneself to work upon oneself (Foucault, 1982) that enables a “deep analysis of individuals internal processes and practices” (Radcliffe, 2018) – which are otherwise unobservable. While diaries have long been neglected in organization studies (Alaszweski, 2006; Bartlett & Milligan, 2015), the use of writing about the self was even appropriated by the church in the practice of confession. Many famous examples such as the diaries by Anne Frank have shown how expressive writing allows people to share their innermost feelings and thoughts with proven psychological benefits (Amabile & Kramer, 2011). Drawing on diaries allows us to infer the underlying meanings not readily discernible from observed behaviors and interactions, or interviews. By drawing on diaries, we show the value of a novel methodology in understanding how people feel when practicing emotional control in difficult circumstances such as in extreme contexts.
A second contribution is to provide a systematic overview of the potential of using diaries to study people engaged in the fight against grand challenges and organization studies more generally. We illustrate the benefits of drawing on diaries as a data source as well as some of the challenges and drawbacks. Furthermore, we offer an alternative to the existing portfolio of data sources in studying grand challenges (Schoeneborn, Vásquez, & Cornelissen, 2021: Stjerne, Wenzel, & Svejenova, 2021). The surge and emphasis to study grand challenges and unconventional events oftentimes goes hand in hand with travel to extreme settings and conduct unsettling fieldwork including strong ethical implications (Wood, 2006), such as refugee camps and the aftermath of earthquakes. As such, work entails both physical and psychological consequences and poses risks to scholars, working with diaries written in situ by people directly affected reduces the level of risk and danger. Furthermore, diaries allow for an investigation which in particular is suited for longitudinal understandings of phenomena and hence ideal for process studies (Langley, 1999) due to the temporal nature of diary writing.
Our article has two limitations. First, we focused on unsolicited diaries given our experience of working with these kinds of diaries. Future research should extend our methodology by developing procedures for capturing and analyzing data from solicited diaries. We specifically call for further methodological development grounded in empirical analysis that may find additional and more nuanced ways to gain insights from diaries. Second, we did not aim to provide a methodological guide to coding data from diaries but instead simply offer some guiding principles when engaging with diaries. In other words, we provide a platform for conversation about how diaries are a novel way to gain insights into people’s thoughts and feelings that are hard to access through other methodological tools.
References
Alaszweski 2006Alaszweski, A. (2006). Using diaries for social research. Thousand Oaks, CA: Sage.
Amabile, & Kramer 2011Amabile, T., & Kramer, S. (2011). The progress principle: Using small wins to ignite joy, engagement, and creativity at work. Boston, MA: Harvard Business Review Press.
Amabile, Barsade, Mueller, & Staw 2005Amabile, T. M., Barsade, S. G., Mueller, J. S., & Staw, B. M. (2005). Affect and creativity at work. Administrative Science Quarterly, 50(3), 367–403.
Balogun, Huff, & Johnson 2003Balogun, J., Huff, A. S., & Johnson, P. (2003). Three responses to the methodological challenges of studying strategising. Journal of Management Studies, 40(1), 197–223.
Balogun, & Johnson 2004Balogun, J., & Johnson, G. (2004). Organizational restructuring and middle manager sensemaking. Academy of Management Journal, 47(4), 523–549.
Bartlett, & Milligan 2015Bartlett, R., & Milligan, C. (2015). What is diary method? London: Bloomsbury Academic.
Biernacki, & Waldorf 1981Biernacki, P., & Waldorf, D. (1981). Snowball sampling: Problems and techniques of chain referral sampling. Sociological Methods & Research, 10, 141–163.
Blumer 1954Blumer, H. (1954). What is wrong with social theory? American Sociological Review, 18, 3–10.
Bower 1981Bower, G. H. (1981). Mood and memory. American Psychologist, 36, 129–148.
Burgess 1984Burgess, R. G. (1984). In the field: An introduction to field research. London: George Allen and Unwin.
Buchanan, & Boddy 1992Buchanan, D. A., & Boddy, D. (1992). The expertise of the change agent: Public performance and backstage activity. Hemel Hempstead: Prentice-Hall.
De La Chaux, Haugh, & Greenwood 2018De La Chaux, M., Haugh, H., & Greenwood, R. (2018). Organizing refugee camps: “Respected space” and “listening posts”. Academy of Management Discoveries, 4(2), 155–179.
De Rond, & Lok 2016De Rond, M., & Lok, J. (2016). Some things can never be unseen: The role of context in psychological injury at war. Academy of Management Journal, 59(6), 1965–1993.
Deutsches. 2019Deutsches., T. (2019). Zahlen und Fakten. Retrieved from https://tagebucharchiv.de/faktenzahlen/
Edmondson 1999Edmondson, A. C. (1999). Psychological safety and learning behavior in work teams. Administrative Science Quarterly, 44, 350–383. https://doi.org/10.2307/2666999
Farny, Kibler, & Down 2019Farny, S., Kibler, E., & Down, S. (2019). Collective emotions in institutional creation work. Academy of Management Journal, 62(3), 765–799.
Ferraro, Etzion, & Gehman 2015Ferraro, F., Etzion, D., & Gehman, J. (2015). Tackling grand challenges pragmatically: Robust action revisited. Organization Studies, 36(3), 363–390.
Foucault 1982Foucault, M. (1982). Technologies of the self. Lectures at University of Vermont Oct. 1982, in Technologies of the self (pp. 16–49), University of Massachusetts Press.
Fraher, Branicki, & Grint 2017Fraher, A., Branicki, L., & Grint, K. (2017). Mindfulness in action: Discovering how Navy SEALs build capacity for mindfulness in high-reliability organizations. Academy of Management Discoveries, 3(3), 239–261.
Gatzweiler, Frey-Heger, & Ronzani 2022Gatzweiler, M., Frey-Heger, C., & Ronzani, M. (2022). Grand challenges and business education: Dealing with barriers to learning and uncomfortable knowledge. In A. A. Gümüsay, E. Marti, H. Trittin-Ulbrich, & C. Wickert (Eds.), Organizing for societal grand challenges (Research in the Sociology of Organizations, Vol. 79, pp. 221–238). Bingley: Emerald Publishing.
Goffman 1959Goffman, E. (1959). Presentation of self in everyday life. New York: Doubleday Anchor Books.
Goffman 1974Goffman, E. (1974). Frame analysis: An essay on the organization of experience. Harvard, MA: Harvard University Press.
Gray, Purdy, & Ansari 2015Gray, B., Purdy, J. M., & Ansari, S. (2015). From interactions to institutions: Microprocesses of framing and mechanisms for the structuring of institutional fields. Academy of Management Review, 40, 115–143.
Hällgen, Rouleau, & de Rond 2017Hällgen, M., Rouleau, L., & de Rond, M. (2017). A matter of life or death: how extreme context research matters for management and organization studies. Academy Management Annals, 12(1), 111–153.
Hannaway 1989Hannaway, J. (1989). Managers managing, the workings of an administrative system. New York, NY: Oxford University Press.
Headland, Pike, Harris 1990Headland, T. N., Pike, K. L., Harris, M. (1990). Emics and etics. The insider/outsider debate. Newbury Park, CA: Sage Publications. (Frontiers of anthropology, v.7).
Hislop, Arber, Meadows, & Venn 2005Hislop, J., Arber, S., Meadows, R., & Venn, S. (2005). Narratives of the night: The use of audio diaries in researching sleep. Sociological Research Online, 10(4), 13–25.
Hochschild 1979Hochschild, A. R. (1979). Emotion work, feeling rules, and social structure. American Journal of Sociology, 85, 551–575.
Jancsary, Höllerer, & Meyer 2016Jancsary, D., Höllerer, M. A., & Meyer, R. E. (2016). Critical analysis of visual and multimodal texts. In R. Wodak & M. Meyer (Eds.), Methods of critical discourse studies (3rd ed., pp. 180–204). Los Angeles, CA: Sage.
Jarvis, Goodrick, & Hudson 2019Jarvis, L., Goodrick, E., & Hudson, B. A. (2019). Where the heart functions best: Reactive–affective conflict and the disruptive work of animal rights organizations. Academy of Management Journal, 62(5), 1358–1387.
Klein, & Boals 2001Klein, K., & Boals, A. (2001). Expressive writing can increase working memory capacity. Journal of Experimental Psychology: General, 130(3), 520–533.
Kress 2010Kress, G. (2010). Multimodality. A social semiotic approach to contemporary communication. Abingdon: Routledge.
Langley 1999Langley, A. (1999). Strategies for theorizing from process data. Academy of Management Review, 24(4), 691–710.
Locke 2001Locke, K. (2001). Grounded theory in management research. London: Sage Publications.
Milligan, & Bartlett 2019Milligan, C., & Bartlett, R. (2019). Solicited diary methods. In P. Liamputtong (Eds.), Handbook of research methods in health social sciences (pp. 1447–1464). Singapore: Springer.
Morrison 2011Morrison, E. W. (2011). Voice and silence within organizations: Literature review and directions for future research. Academy of Management Annals, 5, 373–412.
Ohly, Sonnentag, Niessen, & Zapf 2010Ohly, S., Sonnentag, S., Niessen, C., & Zapf, D. (2010). Diary studies in organizational research. Journal of Personal Psychology, 9(2), 79–93.
Potter 1996Potter, J. (1996). Discourse analysis and constructionist approaches: Theoretical background. In J. Richardson (Ed.), Handbook of qualitative research methods for psychology and the social sciences (pp. 125–140). Leicester: BPS Books.
Pradilla, Bento da Silva, & Reinecke 2022Pradilla, C. A., Bento da Silva, S., & Reinecke, J. (2022). Wicked problems and new ways of organizing: How Fe y Alegria confronted changing manifestations of poverty. In A. A. Gümüsay, E. Marti, H. Trittin-Ulbrich, & C. Wickert (Eds.), Organizing for societal grand challenges (Research in the Sociology of Organizations, Vol. 79, pp. 93–114). Bingley: Emerald Publishing.
Rauch, & Ansari 2022Rauch, M., & Ansari, S. (2022). Waging War from Remote Cubicles: How Workers Cope with Technologies That Disrupt the Meaning and Morality of Their Work. Organization Science. https://doi.org/10.1287/orsc.2021.1555
Rauch, & Ansari 2021Rauch, M., & Ansari, M. (2021, forthcoming). From “publish or perish” to societal impact: Organizational repurposing towards responsible innovation through creating a medical platform. Journal of Managemenet Studies. https://doi.org/10.1111/joms.12737
Radcliffe 2018Radcliffe, L. (2018). Capturing the complexity of daily workplace experiences using qualitative diaries. In C. CassellA. L. Cunliffe, & G. Grandy (Eds.), The sage handbook of qualitative business and management research methods (pp. 188–204). SAGE Publications Ltd.
Radcliffe 2017Radcliffe, L. S. (2017). Capturing the complexity of daily workplace experiences using qualitative diaries. In C. Cassel, A. Cuncliffe, & G. Grandy (Eds.), The SAGE handbook of qualitative business and management research methods (pp. 188–204). London: Sage Publications.
Rauch, Wenzel, & Koch 2020Rauch, M., Wenzel, M., & Koch, J. (2020). How top managers change their portfolio of organizational heuristics. Strategic Management Society 40th annual international conference.
Reinecke, Arnold, & Palazzo 2016Reinecke, J., Arnold, D., & Palazzo, G. (2016). Qualitative methods in business ethics, corporate responsibility, and sustainability research. Business Ethics Quarterly, 26(4), Xiii–Xxii.
Reis 1994Reis, H. T. (1994). Domains of experience: Investigating relationship processes from three perspectives. In R. Erber & R. Gilmore (Eds.), Theoretical frameworks in personal relationships (pp. 87–110). Mahwah, NJ: Erlbaum.
Schilit 1987Schilit, W. K. (1987). An examination of the influence of middle-level managers in formulating and implementing strategic decisions. Journal of Management Studies, 24(3), 271–293.
Wenzel, Cornelissen, Koch, Hartmann, & Rauch 2020Wenzel, M., Cornelissen, J. P., Koch, J., Hartmann, M., & Rauch, M. (2020). (Un)Mind the gap: How organizational actors cope with an identity–strategy misalignment. Strategic Organization, 18(1), 212–244.
Wickert, & Schaefer 2015Wickert, C., & Schaefer, S. M. (2015). Towards a progressive understanding of performativity in critical management studies. Human Relations, 68, 107–130.
Wiedner, & Ansari 2017Wiedner, R., & Ansari, S. (2017). Appreciating emergence and serendipity in qualitative research: Resisting the urge to follow set plans. The Routledge Companion to Qualitative Research in Organization Studies. New York, NY: Routledge.
Wood 2006Wood, E. J. (2006). The ethical challenges of field research in conflict zones. Qualitative Sociology, 29, 373–386.
Zietsma, Toubiana, Voronov, & Roberts 2018Zietsma, C., Toubiana, M., Voronov, M., & Roberts, A. (2018). Emotions in organization theory. Cambridge: Cambridge University Press.
- Prelims
- How Organizing Matters for Societal Grand Challenges
- Section I: Diverse Forms of Organizing & Societal Grand Challenges
- Tackling Grand Challenges Collaboratively: The Role of Value-driven Sensegiving
- Building Collective Institutional Infrastructures for Decent Platform Work: The Development of a Crowdwork Agreement in Germany
- Theorizing the Role of Metaphors in Co-orienting Collective Action Toward Grand Challenges: The Example of the COVID-19 Pandemic
- Wicked Problems and New Ways of Organizing: How Fe y Alegria Confronted Changing Manifestations of Poverty
- From a Clash of Social Orders to a Loss of Decidability in Meta-organizations Tackling Grand Challenges: The Case of Japan Leaving the International Whaling Commission
- Commitment to Grand Challenges in Fluid Forms of Organizing: The Role of Narratives’ Temporality
- Section II: Scholarship & Societal Grand Challenges
- Addressing Grand Challenges Through Different Forms of Organizing: A Literature Review
- Scale in Research on Grand Challenges
- Diaries as a Methodological Innovation for Studying Grand Challenges
- Grand Challenges and Business Education: Dealing with Barriers to Learning and Uncomfortable Knowledge
- Striving for Societal Impact as an Early-career Researcher: Reflections on Five Common Concerns
- Section III: Reflections & Outlook
- Robust Action: Advancing a Distinctive Approach to Grand Challenges
- Surfing the Grand Challenges Wave in Management Scholarship: How Did We Get Here, Where are We Now, and What's Next?