Implementation of a Technical Peer Review Process: Principles, Policy, and Cultural Change
Explore the source record for details and available documents.
Alvarez, Francisco↗
SEARCH · Engineering Papers
Results for “culture & policy”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Promoting a Culture of Tailoring for Systems Engineering Policy Expectations
NASA's Marshall Space Flight Center (MSFC) has developed an integrated systems engineering approach to promote a culture of tailoring for program and project policy requirements. MSFC's culture encourages and supports tailoring, with an emphasis on risk-based decision making, for enhanced affordability and efficiency. MSFC's policy structure integrates the various Agency requirements into a single, streamlined implementation approach which serves as a "one-stop-shop" for our programs and projects to follow. The engineers gain an enhanced understanding of policy and technical expectations, as well as lesson's learned from MSFC's history of spaceflight and science missions, to enable them to make appropriate, risk-based tailoring recommendations. The tailoring approach utilizes a standard methodology to classify projects into predefined levels using selected mission and programmatic scaling factors related to risk tolerance. Policy requirements are then selectively applied and tailored, with appropriate rationale, and approved by the governing authorities, to support risk-informed decisions to achieve the desired cost and schedule efficiencies. The policy is further augmented by implementation tools and lifecycle planning aids which help promote and support the cultural shift toward more tailoring. The MSFC Customization Tool is an integrated spreadsheet that ties together everything that projects need to understand, navigate, and tailor the policy. It helps them classify their project, understand the intent of the requirements, determine their tailoring approach, and document the necessary governance approvals. It also helps them plan for and conduct technical reviews throughout the lifecycle. Policy tailoring is thus established as a normal part of project execution, with the tools provided to facilitate and enable the tailoring process. MSFC's approach to changing the culture emphasizes risk-based tailoring of policy to achieve increased flexibility, efficiency, and effectiveness in project execution, while maintaining appropriate rigor to ensure mission success.
Blankenship, Van A.↗
SEMS: System for Environmental Monitoring and Sustainability
The goal of this project was to establish a computational and data management system, SEMS, building on our existing system and MTPE-related research. We proposed that the new system would help support Washington University's efforts in environmental sustainability through use in: (a) Problem-based environmental curriculum for freshmen and sophomores funded by the Hewlett Foundation that integrates scientific, cultural, and policy perspectives to understand the dynamics of wetland degradation, deforestation, and desertification and that will develop policies for sustainable environments and economies; (b) Higher-level undergraduate and graduate courses focused on monitoring the environment and developing policies that will lead to sustainable environmental and economic conditions; and (c) Interdisciplinary research focused on the dynamics of the Missouri River system and development of policies that lead to sustainable environmental and economic floodplain conditions.
Arvidson, Raymond E.↗
Lessons Learned from Running a Virtual Global Workshop
Online conferences simplify planning needs, lower barriers to participation for a global audience, and reduce environmental footprints, but scheduling, pacing, and moderating sessions can be challenging.
Conference planning↗
Promoting a Culture of Tailoring for Systems Engineering Policy Expectations
No abstract available
Blankenship, Van A.↗
Identifying Outside Influences as Latent Factors to Risk in Human Performance
During the Acquisition Life Cycle for a program, there are several opportunities for the system in design to be adjusted in accordance with its changing landscape as it is being shaped by evolving policy and organizational culture. Human Systems Integration is integral to identifying these opportunities of change as there are a set number of activities that may account for altered operational states, human performance deviations, and overall component engagement if HSI is enacted early enough in the life cycle. Some changes that occur in the operational environment may not be accounted for since the organizational culture and practices are not currently a part of the HSI focus. Likewise, policy changes themselves from a top-to-bottom analysis may not have the appearance of effecting human performance until having gone through a trail-and-error period. Workarounds to adjust for unforeseen policy affects become the system's solution that usually includes changes in the training and education of the operators, maintainers, and support personnel. A system full of workarounds and off-normal practices, that cause operators to disregard the purpose of the design, coupled with the false notion that these activities are proven for successful system operation, is the very definition of “an accident waiting to happen”. Unforeseen changes in policies and practices that cause new and unusual activities to successfully and keep the system running, should be considered latent factors that may cause a potential mishap, and not part of the resilience that humans provide to the successful operation of the system. This presentation will explore how latent factors may find their way into system operations and how they can be identified and addressed.
Human Systems Integration↗
Results of the 2022 Mental Health Survey of the Planetary Science Community
The mental health struggles within academia and research are well recognized in the science community and have been further illustrated by the numerous cultural memes and comics (e.g., PhD Comics). With the recent COVID-19 pandemic, mental health has become a topic of concern more so than ever before, as depression and anxiety have become an invisible consequence of social isolation and distancing. In addition, recent social events in the United States have reignited attention towards important social injustices surrounding people of color, women, and LGBTQ+ in academia. If diversity, equity, inclusion, and accessibility are to become major components of improving planetary science, it is also important to understand the mental health status of the community, as it could expose deeply embedded policies, rules, and culture that may hinder any work in sustaining and advancing people belonging to marginalized groups. Studies have been conducted to further understand the mental health of those in academia. These studies have shown that before the pandemic, there was a mental health crisis among graduate students, which became a larger problem with increasing anxiety and depression due to the pandemic. Soon after, the planetary science community recognized this concern in the recent 2023 Planetary Science Decadal White Paper, which proposed that NASA should invest in understanding the scope and impact of mental health problems within the planetary science community and how to address the issue. In this study, we conducted a mental health survey to examine the mental health of the planetary science community. We examined the overall anxiety, depression, and stress severity of the community, rather than diagnosing the community’s condition or determining the proportion of the population having a clinical anxiety, depressive, stress, or trauma-related diagnosis. To emphasize, the results are not intended to make clinical diagnoses, nor are they being used to do so for the purpose of this study.
D Trang↗
The geography and human cultural resources working group of the EROS program
The functions, activities, and objectives of the Geography and Human-Cultural Resources Working Group of the EROS program are outlined. The Group's primary function is to coordinate remote sensing experiments of physical scientists and the needs of socioeconomic and culturally orientated planners, policy makers, administrators, and other user groups. Other functions of the Group include land use analysis, resource mapping, and development of an operational automatic information system receptive to land use and environmental data.
Gerlach, A. C.↗
Diversity and Inclusion in Spacecraft Science Teams: What Do We Know and What Can We Do About It?
Introduction: Not only does the planetary science community lack diversity [1-3], the subset of the community that participates on spacecraft science team is even less diverse than the community as a whole [1, 4]. Results of 2020 Workforce Survey: Previous studies of the diversity of members of spacecraft science teams made incorrect assumptions about the nature of the data before collecting the data. Those analyses assumed a binary gender and ignored the existence of planetary scientists who are neither men nor women [4-6]. We present here results where demographic data was collected without assumptions; each individual surveyed supplied their own answers to demographic questions. The April 2020 survey of Planetary Scientists, which was conducted by the Statistical Research Center of the American Institute of Physics (AIP) and funded by the American Astronomical Society (AAS)’s Division of Planetary Science (DPS) asked participants their gender with 4 possible responses: Woman, Man, Another identify (please specify if you wish), and Prefer not to answer. 32% of respondents chose Woman, 67% chose Man and 1% chose Another gender identity [1]. The survey also asked demographic questions on race, ethnicity, LGBTQ+ identity, and disability. For a full list of questions, see https://dps.aas.org/sites/dps.aas.org/files/reports/2020/survey2020_questionnaire.pdf. In addition to demographic questions, the 2020 Workforce survey asked how many times respondents had been involved in Mission proposals as a Principal Investigator (PI) and, separately, as a Co-Investigator (CoI) [1]. Answers to questions about mission involvement were correlated with answers to demographic questions and the results show that members of historically underrepresented groups (non-white scientists, women, members of the LGBTQ+ community, and disabled scientists) were less likely to be involved in spacecraft mission proposals than were members of historically overrepresented groups [1]. The figures below show the correlated responses for four different axes of underrepresentation [1]. Note that while the figure on gender shows only Women and Men (due to the small percentage of folks answering “Another gender”), non-binary respondents are included in the LGBTQ+ community figure. Conclusion: Being part of a spacecraft science team is a goal for many planetary scientists. With it comes brand new data, more stable funding, and a sense of awe and exploration. It can lead to a cascade of opportunities from conference and public presentations, to membership in subsequent mission teams, and prestige in the community [4]. As a result, participation in spacecraft teams can be used a measure of success within the field. From the survey results, we see that members of historically excluded groups, even after they have overcome barriers to participating in the field, are still experiencing barriers to success within the field itself. Why?: The diminishing percentage of members of underrepresented groups as a career progresses has been referred to as a “leaky pipeline”. However, this fails to adequately capture the experiences of the members of these underrepresented groups as it implies a passive process. In order to capture the active processes (bias, discrimination, harassment, and other exclusionary behaviors) that contribute to low retention in the workforce, the term “Hostile Obstacle Course” is more useful [7,8]. It is these processes that need to be addressed in order to retain valued members of our community. Moving Forward: In order to broaden participation in planetary science, particularly mission science teams, we need to address conditions that create hostile workplace climates. What can mission teams and other groups do to address these conditions? First, each group/team needs to evaluate their own members to determine what specific barriers exist in their own interactions. One tool to accomplish this would be an anonymous survey designed to understand how team members feel about working within the group. Working with professionals who know how to create and analyze such surveys (often called “climate surveys” when applied to University students, for example) would ensure that the survey meets its goals and does not make assumptions that counter the meaningfulness of the results. Such professionals in EDIA (Equity, Diversity, Inclusion, and Accessibility) and workplace culture can make suggestions for policy changes that would eliminate hostile workplace conditions. Policy changes that are often suggested include instituting professional EDIA training for the team and/or for team leadership, instituting and following a code of conduct [9], including more interactive group activities in group meetings, etc. Training and information on EDIA is available for all members of the planetary science community. The first place to look would be in your University or Institution’s EDIA or human resources offices. Bystander Intervention is often offered as part of other meetings [10]. A newer offering is a Workshop on EDIA for Leaders in Planetary Science led by Julie Rathbun (first author of this abstract) and JA Grier (https://edialps.psi.edu/). This 3-day workshop gives participants the tools they need to enact positive change in their personal and professional spheres. The first workshop was help in November 2022 and another workshop will take place in the late spring 2023 with exact dates to be announced soon.
J. A. Rathbun↗
Climate Change Impacts and Responses: Societal Indicators for the National Climate Assessment
The Climate Change Impacts and Responses: Societal Indicators for the National Climate Assessment workshop, sponsored by the National Aeronautics and Space Administration (NASA) for the National Climate Assessment (NCA), was held on April 28-29, 2011 at The Madison Hotel in Washington, DC. A group of 56 experts (see list in Appendix B) convened to share their experiences. Participants brought to bear a wide range of disciplinary expertise in the social and natural sciences, sector experience, and knowledge about developing and implementing indicators for a range of purposes. Participants included representatives from federal and state government, non-governmental organizations, tribes, universities, and communities. The purpose of the workshop was to assist the NCA in developing a strategic framework for climate-related physical, ecological, and socioeconomic indicators that can be easily communicated with the U.S. population and that will support monitoring, assessment, prediction, evaluation, and decision-making. The NCA indicators are envisioned as a relatively small number of policy-relevant integrated indicators designed to provide a consistent, objective, and transparent overview of major variations in climate impacts, vulnerabilities, adaptation, and mitigation activities across sectors, regions, and timeframes. The workshop participants were asked to provide input on a number of topics, including: (1) categories of societal indicators for the NCA; (2) alternative approaches to constructing indicators and the better approaches for NCA to consider; (3) specific requirements and criteria for implementing the indicators; and (4) sources of data for and creators of such indicators. Socioeconomic indicators could include demographic, cultural, behavioral, economic, public health, and policy components relevant to impacts, vulnerabilities, and adaptation to climate change as well as both proactive and reactive responses to climate change. Participants provided inputs through in-depth discussion in breakout sessions, plenary sessions on break-out results, and several panels that provided key insights about indicators, lessons learned through experience with developing and implementing indicators, and thoughts on how the NCA could proceed to develop indicators for the NCA.
Kenney, Melissa A.↗
2024 Software for NASA Science Mission Directorate Workshop Report
The 2024 Software for the NASA Science Mission Directorate Workshop was the first workshop of its kind in over 10 years. The numerous attendees and high level of interaction in this hybrid workshop portrayed the untapped interest and energy in the NASA SMD community about software. Over 100 takeaways were collected from the hosted discussions in four key areas - Communication, Communities, Funding and Clarity - as summarized in this report. One takeaway was representative of all four categories: “Software is not hardware; it is organic and needs a different model. You often don't know which components will be Open-Source reusable until later in the development cycle.” For the communication category, this takeaway motivates the reduction of silos by shifting towards a model that better supports community collaboration on common challenges and a more streamlined and improved software release process. For the communities category, the same statement points to forming communities of practice with varying scopes and a new approach to recognition and incentives for open-source software contributions. Concerning funding, this statement motivates a more sustained and flexible funding model that better supports the software foundation needed for NASA’s long-term success, including the collaboration and infrastructure a good foundation requires. The new approach to clarity motivated by this statement calls for significant changes to the software release process and related policies to streamline compliance, align those policies with the open-source science culture NASA is promoting and with each other, and simplify use of the cloud. It is time to recognize software as a foundational component of NASA with an organic nature not properly supported by current approaches. Different models are needed in all four areas to shift the NASA SMD software community and governance structures into a more efficient, open, and collaborative ecosystem - one that enables ground-breaking science and daring exploration into the coming decades
science↗
The Impact of Controlled Rest on Neurobehavioral Outcomes at Top-of-Descent
INTRODUCTION: Long and irregular working hours can lead to fatigue in aviation operations. In some regions, a short nap taken on the flight deck (known as controlled rest) can be used as a countermeasure to unexpected in-flight sleepiness. We aimed to investigate the impact of taking controlled rest on neurobehavioral measures at top-of-descent. METHODS: Data from 120 long-haul (> 6 h flight duration), unaugmented flights were analyzed (n = 31 pilots). Pilots wore actigraphs and completed sleep logs before and during trips. At pre-flight and top-of-descent, pilots completed a 5-minute psychomotor vigilance task (PVT) and Karolinska Sleepiness Scale (KSS). A series of mixed-effects models were conducted to assess the impact of controlled rest on outcome measures at top-of-descent. Sleep duration in the prior 48 hours, timing of the flight, and pre-flight scores for each measure were included as covariates. RESULTS: Due to missing data, complete data from 76 flights (n = 28 participants) were available in the models examining the PVT metrics, and data from 83 flights (n = 29 participants) were available in the analyses of the KSS. Pilots who took controlled rest had faster response speeds at top-of-descent (p = .03, η2p = 0.07; estimated marginal mean [EMM] = 4.19, standard error [SE] = 0.07, 95% CI [4.08, 4.29]) than those who did not take controlled rest (EMM = 4.00, SE = 0.05, 95% CI [3.86, 4.14]). There were no differences by controlled rest status for KSS scores and PVT lapses (p values > .05, η2p values ≤ 0.01). DISCUSSION: Our results suggest that taking controlled rest may improve vigilant attention at critical phases of flight and, thus, may be a useful fatigue management tool during unaugmented flights. Further research is necessary to determine the impact of factors on the decision to take controlled rest (e.g., airline culture, personal preference) and how the controlled rest policy is applied in practice.
aviation↗
Microbial Vessel for Impedance Spectroscopy and Electrochemistry (Mvise): an Extensible, Interoperable Data Acquisition Platform for Liquid Culture Studies in Space Biology Research
The White House Office of Science and Technology Policy (OSTP) has declared 2023 to be the Year of Open Science following an initiative to democratize scientific knowledge. Simultaneously, new sensor technologies have broadened the experimental space available to bioastronautics research. With these open-science goals and technological advances in mind, we have designed and constructed a data acquisition platform for high-precision, real-time monitoring of liquid culture systems. The vessel rig is fitted with six Atlas Scientific probes (micro pH, electrical conductivity, dissolved oxygen, oxidation-reduction potential, liquid temperature, air CO2) and a custom optical density probe similar to the one on BioSentinel’s BioSensor payload. A custom dielectric spectroscopy probe is also planned. The structure of the vessel is resin 3-D printed on a hobbyist-level machine, reducing the production cost and iteration time by over 60% each while increasing extensibility. Data acquisition and storage is controlled with a standalone C state machine-based program running on a Raspberry Pi 3 Model B. When not running headless, an additional program automatically generates and updates plots for live data visualization. Validation of the rig as a data collection system was performed with a yeast liquid culture experiment. While the vessel rig is currently used for standalone experiments, it can also be used as the base perception unit in a self-driving laboratory (SDL). SDLs are high-throughput data collection systems that employ automation and artificial intelligence to conduct and manage routine experiments. Here, we envision an SDL driven by several vessel rigs in which an automated script compares key results, informing the design of future experiments. A vessel rig SDL would streamline many operations, including 1) strain selection for the Lunar Explorer Instrument for space biology Applications (LEIA) investigation and 2) the study of bioregenerative life support systems (BLSS). Ultimately, the datasets that can now be acquired will provide crucial information for accelerating bioastronautics application development in the era of commercial space.
Stephen Lantin↗
The Importance of Policies: It’s Not Just A Pipeline Problem
For decades, a leaky pipeline analogy has been used when discussing diversity issues in STEM fields. However, this imagery is overly simplistic and does not capture critical issues that contribute to people leaving the field. It puts distance between structural issues, our actions, and why people leave the field. When we view our research structure as something more complex, we can start taking ownership and frame more impactful solutions instead of misidentifying important issues and providing ineffective short-term solutions. Many of the issues discussed in the "Cultivating a culture of inclusivity in Heliophysics" position paper have counterparts within our policies and our institutions. To fully address and mitigate the current issues within our field, we have identified a need to cultivate a positive, safe, inclusive, and effective environment. However, we need both cultural and programmatic changes. We will try to identify systemic issues that inhibit many from fully participating and potential solutions, as well as groups and fields producing best practices for creating and enabling effective environments where innovation can occur.
A.J. Halford↗
Environmental Impacts of Closed-Loop Pumped Storage Hydropower
The goal of this report is to help license applicants, resource agencies, and other members of the hydropower community involved in closed-loop pumped storage hydropower permitting and licensing process, focus the scope of environmental reviews, and more quickly identify impacts with project nexus and potential mitigation measures for these impacts. Pumped storage hydropower (PSH) is an energy storage technology that uses energy to pump water up from a lower reservoir to an upper reservoir where water is stored until electricity is needed and the water is released to a lower reservoir passing through turbines. Closed-loop PSH—PSH that is not continuously connected to a naturally flowing water feature—is one of the lowest greenhouse gas emitting energy storage technologies and is therefore a critical part of the transition to renewable energy (Simon et al. 2023). Proposals for closed-loop PSH facilities in the United States currently account for more than 40% of original licenses and 99% of potential generation capacity in the Federal Energy Regulatory Commission (FERC) hydropower licensing pipeline (Johnson et al. 2023). While closed-loop PSH facilities can have lower environmental impacts than open-loop PSH facilities, no closed-loop facilities have been constructed in the United States to enable direct accounting of project impacts and efficacy of mitigations. Many proposals for closed-loop PSH submitted to FERC are abandoned early in the permitting and licensing process prior to license applications and environmental assessments, so there is little documentation describing potential project impacts and proposed mitigations. The newness of closed-loop PSH proposals in the United States may mean that tribal, federal, and state agencies with authorities for cultural and natural resources protection and management involved in the FERC licensing process may not have experience with closed-loop PSH regulation. Moreover, many proposed closed-loop PSH facilities are in areas that do not have high concentrations of conventional hydropower, so these agencies may also be unfamiliar with the FERC hydropower licensing process. The goal of this report is to help license applicants, resource agencies, and other members of the hydropower community focus the scope of environmental review for the closed-loop PSH development, licensing, and federal authorization process enabling quicker identification of potential impacts, mitigations, and situations where mitigation may not be possible. We found that environmental impacts of closed-loop PSH are highly site-specific, and generalizations about the types of environmental impacts across closed-loop PSH projects are difficult to make. Environmental impacts of closed-loop PSH are like those for open-loop PSH with a few exceptions including water sourcing, which can lead to delays and contention due to potential complexities with water rights, impacts to aquatic resources, and greenhouse gas emission potential. Cultural resource impacts were commonly reported in National Environmental Policy Act (NEPA) documents reviewed and discussed in interviews, but in many cases such impacts cannot be mitigated.
13 HYDRO ENERGY↗
Coevolution of Machine Learning and Process-Based Modelling to Revolutionize Earth and Environmental Sciences: A Perspective
Machine learning (ML) applications in Earth and environmental sciences (EES) have gained incredible momentum in recent years. However, these ML applications have largely evolved in ‘isolation’ from the mechanistic, process-based modelling (PBM) paradigms, which have historically been the cornerstone of scientific discovery and policy support. In this perspective, we assert that the cultural barriers between the ML and PBM communities limit the potential of ML, and even its ‘hybridization’ with PBM, for EES applications. Fundamental, but often ignored, differences between ML and PBM are discussed as well as their strengths and weaknesses in light of three overarching modelling objectives in EES, (1) nowcasting and prediction, (2) scenario analysis, and (3) diagnostic learning. The paper ponders over a ‘coevolutionary’ approach to model building, shifting away from a borrowing to a co-creation culture, to develop a generation of models that leverage the unique strengths of ML such as scalability to big data and high-dimensional mapping, while remaining faithful to process-based knowledge base and principles of model explainability and interpretability, and therefore, falsifiability.
Saman Razavi↗
Toward a Climate OSSE Framework for Satellite Mission Design
The rich history of observing system simulation experiments (OSSEs) does not yet include a well-established framework for using climate models. The need for a climate OSSE is triggered by the need to quantify the value of a particular measurement for reducing the uncertainty in climate predictions, which differ from numerical weather predictions in that they depend on future atmospheric composition rather than the current state of the weather. However, both weather and climate modeling communities share a need for motivating major observing system investments. Here, we outline a new framework for climate OSSEs that leverages the use of machine learning to calibrate climate model physics against existing satellite data. We demonstrate its application using NASA’s GISS-E3 model to objectively quantify the value of potential future improvements in spaceborne measurements of Earth’s planetary boundary layer. A mature climate OSSE framework should be able to quantitatively compare the ability of proposed observing system architectures to answer a climate-related question, thus offering added value throughout the mission design process, which is subject to increasingly rapid advances in instrument and satellite technology. Technical considerations include selection of observational benchmarks and climate projection metrics, approaches to pinpoint the sources of model physics uncertainty that dominate uncertainty in projections, and the use of instrument simulators. Community and policy-making considerations include the potential to interface with an established culture of model intercomparison projects and a growing need to economically assess the value-driven efficiency of social spending on Earth observations.
54 ENVIRONMENTAL SCIENCES↗
Native Peoples-Native Homelands Climate Change Workshop: Lessons Learned
The Native Peoples-Native Homelands Climate Change Workshop was held on October 28 through November 01,1998, as part of a series of workshops being held around the U.S. to improve the understanding of the potential consequences of climate variability and change for the Nation. This workshop was specifically designed by Native Peoples to examine the impacts of climate change and extreme weather variability on Native Peoples and Native Homelands from an indigenous cultural and spiritual perspective and to develop recommendations as well as identify potential response actions. The workshop brought together interested Native Peoples, representatives of Tribal governments, traditional elders, Tribal leaders, natural resource managers, Tribal College faculty and students, and climate scientists fiom government agencies and universities. It is clear that Tribal colleges and universities play a unique and critical role in the success of these emerging partnerships for decision-making in addition to the important education function for both Native and non-Native communities such as serving as a culturally-appropriate vehicle for access, analysis, control, and protection of indigenous cultural and intellectual property. During the discussions between scientists and policy-makers from both Native and non-Native communities, a number of important lessons emerged which are key to building more effective partnerships between Native and non-Native communities for collaboration and decision-making for a more sustainable future. This talk summarizes the key issues, recommendations, and lessons learned during this workshop.
Maynard, Nancy G.↗