How can you know that science done quickly during a crisis is good science? This question has taken on new relevance with the COVID-19 vaccine rollout. Researchers developed vaccines in under a year — easily breaking the previous record of four years. But that pace of development may be part of the reason about 1 in 7 unvaccinated adults in the U.S. say they will never get the COVID-19 shot. This is in spite of continued assurances from infectious disease experts that the vaccines are safe. Scientists are called on to come up with answers under pressure whenever there is a crisis, from the Challenger space shuttle explosion to the 2020 California wildfires. As they shift from “regular” to “crisis” research, they must maintain rigorous standards despite long hours, mentally demanding tasks and persistent outside scrutiny. Thankfully, science produced under urgent conditions can be just as robust and safe as results produced under normal conditions. We are two social scientists interested in understanding how researchers can best work on urgent problems and deliver useful findings. In a recent study, we focused on “conflict archeologists,” an interdisciplinary group tasked with rapid assessments of archeological destruction in Syria during the war between 2014 and 2017. Observers feared that one particular form of destruction, artifact looting, was a major source of revenue for terrorist groups, including the Islamic State. Prominent policymakers, security officials and a worried public wanted clear answers, quickly. By any measure, conflict archeologists succeeded. They produced findings that improved scientific knowledge. Their research led to a landmark bipartisan bill signed by President Obama. Perhaps most importantly, they raised public awareness of the problems associated with looting and smuggling archeological materials. Our latest research aimed to understand how work cultures played a role in these achievements — and what lessons can be applied in crisis science across disciplines. What worked for conflict archeologists To investigate, we interviewed 35 conflict archeologists and other scientists who worked with them. We also observed work in satellite labs and team meetings, and talked to people who used the data and analysis created by conflict archeologists. Those we interviewed worked in different physical locations and across multiple disciplines. If they met, they would do so remotely. And yet they were generally aware of what others in this research area were doing. Collaboration is central to doing good urgent science, and we found three key factors behind successfully working together during a crisis. First, the percentage and distribution of effort matters. We call this “temporal control.” We found that full-time devotion to crisis science was not necessarily the only way to produce good work. In fact, researchers involved on a part-time basis expressed higher confidence in the quality of other collaborators’ work. We think part-timers were able to maintain a more comprehensive perspective on the collaboration overall. And keeping a hand in their usual scientific practices seemed to help researchers stay sharp. It meant that when they turned to urgent science tasks, they could do so with fresh eyes and renewed attention to methodological precision. Second, sharing responsibility for outcomes motivated researchers to generate rapid findings for policy and public-interest needs. We call this “responsibility control.” Effective conflict archeologists distributed credit among collaborators. They translated their objectives and priorities for policymakers and set boundaries and expectations for understanding and using their findings. As a result, they could do their work with the knowledge that they stood with a team — producing accurate findings that could be used to combat artifact looting and trafficking was not any one individual’s sole responsibility. Finally, it was important to have limits around the extent of an individual’s personal involvement. This is “scope control,” a work environment that helped scientists set boundaries between the research and their personal lives. “It was exhausting,” one respondent told us. “I tried not to take the work home with me, but I know it was starting to affect my family life.” Scientists who were able to control the scope of their work, and to speak openly about their challenges, were more likely to stick with the project and express confidence in the strength of the research. We hypothesize that those who are able to set borders around what and how much work they took on were in a better position to assess the strength of both their own research and that of others – and thus feel confident in it. Creating the conditions for good crisis science Generating high-quality, safe and reliable scientific research under pressure is not a matter of having a heroic personality or superhuman stamina. It is a matter of thoughtful, deliberate work environments and being part of professional fields that support their members even as they hold them to high standards of rigor and ethics. To be sure, no two crises are identical. At the same time, crisis science best practices can be adapted to fit the specific circumstances of the project. Global pandemics or imminent environmental catastrophe may require short, intensive, full-time bursts of work. Some research projects are lab- or equipment-sensitive and require specific personnel. As our findings show, science conducted with a supportive infrastructure, with rigor and ethics built into the process, can produce reliable results under pressure. Like COVID-19 researchers, conflict archeologists worked with tight deadlines under intense scrutiny. Both groups also emphasized the need for researchers to continue to employ high ethical standards in the research process. And understanding how scientists maintain their ethics and rigor while working under difficult conditions is essential for maintaining the public’s trust in science. This much is certain: Crises aren’t going away. As long as society is relying on scientists for solutions, it’s important to create conditions conducive to effective research. Source
