Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “lifecycle assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Pumped Storage Hydropower Potential and Opportunities

Pumped storage hydropower (PSH) is a flexible energy storage technology with the potential to improve grid reliability, resiliency, and stability in the electric grid of the future. NREL has developed a range of data and tools to help understand opportunities for new PSH deployment, including nationwide resource assessment data, a bottom-up component-level cost model, and a lifecycle greenhouse gas emissions calculator. These datasets can then be used to inform grid planning models, analysis, and decision making to understand the role PSH can play in the power sector.

cost↗

Applying Standard Independent Verification and Validation (IVV) Techniques Within an Agile Framework: Is There a Compatibility Issue?

Agile methods have gained wide acceptance over the past several years, to the point that they are now a standard management and execution approach for small-scale software development projects. While conventional Agile methods are not generally applicable to large multi-year and mission-critical systems, Agile hybrids are now being developed (such as SAFe) to exploit the productivity improvements of Agile while retaining the necessary process rigor and coordination needs of these projects. From the perspective of Independent Verification and Validation (IVV), however, the adoption of these hybrid Agile frameworks is becoming somewhat problematic. Hence, we find it prudent to question the compatibility of conventional IVV techniques with (hybrid) Agile practices.This paper documents our investigation of (a) relevant literature, (b) the modification and adoption of Agile frameworks to accommodate the development of large scale, mission critical systems, and (c) the compatibility of standard IVV techniques within hybrid Agile development frameworks. Specific to the latter, we found that the IVV methods employed within a hybrid Agile process can be divided into three groups: (1) early lifecycle IVV techniques that are fully compatible with the hybrid lifecycles, (2) IVV techniques that focus on tracing requirements, test objectives, etc. are somewhat incompatible, but can be tailored with a modest effort, and (3) IVV techniques involving an assessment requiring artifact completeness that are simply not compatible with hybrid Agile processes, e.g., those that assume complete requirement specification early in the development lifecycle.

Agile↗

Scoping, Tailoring, and Abstraction Refinement in Hazard Assessment Processes

Hazard assessment is an engineering activity that produces insight into which states of thing being engineered might be hazardous. In aviation contexts, it is often performed for certification credit at both the aircraft and system levels during the early design phase of the system’s lifecycle. However, novel aircraft paradigms such as urban air mobility (UAM)operations might either violate assumptions on which traditional aviation hazard assessment is based or simply possess attributes that would make other approaches more effective. In this paper, we define the key concepts under pinning hazard assessment and identify the limitations and assumptions inherent in hazard analysis. We analyze popular techniques to show how they embody these key concepts. We identify ways in which hazard assessment may be scoped and tailored to an application. And, using worked examples, we discuss how, where, and why such tailoring might be needed, especially in novel contexts.

aviation safety↗

Scoping, Tailoring, and Abstraction Refinement in the Hazard Assessment Process

Hazard assessment is an engineering activity that produces insight into which states of thing being engineered might be hazardous. In aviation contexts, it is often performed for certification credit at both the aircraft and system levels during the early design phase of the system’s lifecycle. However, novel aircraft paradigms such as urban air mobility (UAM) operations might either violate assumptions on which traditional aviation hazard assessment is based or simply possess attributes that would make other approaches more effective. In this paper, we define the key concepts underpinning hazard assessment and identify the limitations and assumptions inherent in hazard analysis. We analyze popular techniques to show how they embody these key concepts. We identify ways in which hazard assessment may be scoped and tailored to an application. And, using worked examples, we discuss how, where, and why such tailoring might be needed, especially in novel contexts.

Aviation Safety↗

Optimizing Repowering and Lifecycle Decisions with PV ICE and SAM

Should you repower or extend the life of your PV system? Are high-efficiency modules, durable modules, or recyclable modules the best option for your site and goals? Evaluating the trade-offs in design and lifecycle strategies can be complex. The PV in Circular Economy (PV ICE) tool is an open-source model designed to help developers, modelers, and decision-makers assess material flows, energy return on investment (EROI), and financial viability of PV systems. Now integrated with the System Advisor Model (SAM), PV ICE enables site-specific comparisons of lifecycle strategies - such as repowering benefits, module selection for reliability and recyclability, among others. This interactive tutorial will provide hands-on experience with PV ICE using Google Collab, exploring scenario-based analyses on these topics.

36 MATERIALS SCIENCE↗

Practical Application of PRA as an Integrated Design Tool for Space Systems

This paper presents the application of the first comprehensive Probabilistic Risk Assessment (PRA) during the design phase of a joint NASA/NOAA weather satellite program, Geostationary Operational Environmental Satellite Series R (GOES-R). GOES-R is the next generation weather satellite primarily to help understand the weather and help save human lives. PRA has been used at NASA for Human Space Flight for many years. PRA was initially adopted and implemented in the operational phase of manned space flight programs and more recently for the next generation human space systems. Since its first use at NASA, PRA has become recognized throughout the Agency as a method of assessing complex mission risks as part of an overall approach to assuring safety and mission success throughout project lifecycles. PRA is now included as a requirement during the design phase of both NASA next generation manned space vehicles as well as for high priority robotic missions. The influence of PRA on GOES-R design and operation concepts are discussed in detail. The GOES-R PRA is unique at NASA for its early implementation. It also represents a pioneering effort to integrate risks from both Spacecraft (SC) and Ground Segment (GS) to fully assess the probability of achieving mission objectives. PRA analysts were actively involved in system engineering and design engineering to ensure that a comprehensive set of technical risks were correctly identified and properly understood from a design and operations perspective. The analysis included an assessment of SC hardware and software, SC fault management system, GS hardware and software, common cause failures, human error, natural hazards, solar weather and infrastructure (such as network and telecommunications failures, fire). PRA findings directly resulted in design changes to reduce SC risk from micro-meteoroids. PRA results also led to design changes in several SC subsystems, e.g. propulsion, guidance, navigation and control (GNC), communications, mechanisms, and command and data handling (C&DH). The fault tree approach assisted in the development of the fault management system design. Human error analysis, which examined human response to failure, indicated areas where automation could reduce the overall probability of gaps in operation by half. In addition, the PRA brought to light many potential root causes of system disruptions, including earthquakes, inclement weather, solar storms, blackouts and other extreme conditions not considered in the typical reliability and availability analyses. Ultimately the PRA served to identify potential failures that, when mitigated, resulted in a more robust design, as well as to influence the program's concept of operations. The early and active integration of PRA with system and design engineering provided a well-managed approach for risk assessment that increased reliability and availability, optimized lifecyc1e costs, and unified the SC and GS developments.

Kalia, Prince↗

Software Requirements Analysis as Fault Predictor

Waiting until the integration and system test phase to discover errors leads to more costly rework than resolving those same errors earlier in the lifecycle. Costs increase even more significantly once a software system has become operational. WE can assess the quality of system requirements, but do little to correlate this information either to system assurance activities or long-term reliability projections - both of which remain unclear and anecdotal. Extending earlier work on requirements accomplished by the ARM tool, measuring requirements quality information against code complexity and test data for the same system may be used to predict specific software modules containing high impact or deeply embedded faults now escaping in operational systems. Such knowledge would lead to more effective and efficient test programs. It may enable insight into whether a program should be maintained or started over.

Wallace, Dolores↗

Quantitative approaches for including equity in risk and resilience infrastructure planning analyses

Risk and resilience assessments for critical infrastructure focus on myriad objectives, from natural hazard evaluations to optimizing investments. Although research has started to characterize externalities associated with current or possible future states, incorporation of equity priorities at project inception is increasingly being recognized as critical for planning related activities. However, there is no standard methodology that guides development of equity-informed quantitative approaches for infrastructure planning activities. Here, to address this gap, we introduce a logic model that can be tailored to capture nuances about specific geographies and community priorities, effectively incorporating them into different mathematical approaches for quantitative risk assessments. Specifically, the logic model uses a graded, iterative approach to clarify specific equity objectives as well as inform the development of equations being used to support analysis. We demonstrate the utility of this framework using case studies spanning aviation fuel, produced water, and microgrid electricity infrastructures. For each case study, the use of the logic model helps clarify the ways that local priorities and infrastructure needs are used to drive the types of data and quantitative methodologies used in the respective analyses. The explicit consideration of methodological limitations (e.g., data mismatches) and stakeholder engagements serves to increase the transparency of the associated findings as well as effectively integrate community nuances (e.g., ownership of assets) into infrastructure assessments. Such integration will become increasingly important to ensure that planning activities (which occur throughout the lifecycle of the infrastructure projects) lead to long-lasting solutions to meet both energy and sustainable development goals for communities.

community-based↗

Lifespan Impacts to Infrastructure, Renewable Energy Components and Energy Storage Components Related to Fluoropolymer Use

This report focuses on the use of fluoropolymers in infrastructure materials (building construction materials, transportation, and electrical transmission and distribution); renewable energy generation components (specifically wind and solar); and energy storage components (lithium-ion batteries and fuel cells) and product lifespan impacts if fluoropolymers were no longer available or allowed in commerce. Additionally, environmental considerations for fluoropolymer manufacture, use, and end-of-life disposal are discussed. This document is the second of two companion reports. The first report, Assessment of Fluoropolymer Production and Use With Analysis of Alternative Replacement Materials, contained an analysis of use of fluoropolymers and their potential replacement technologies in aerospace, automotive, battery, building construction, chemical processing, electronics, infrastructure, semiconductor, solar panel, and wind energy industries sectors, along with qualitative life cycle assessment (LCA) and cost-benefit analysis of replacing fluoropolymers. This report does not focus on the lifecycle aspects of use of fluoropolymer or alternatives in the designated applications. For more information on those topics, see aforementioned report.

25 ENERGY STORAGE↗

A critical review and meta-analysis of energy demand, carbon footprint, and other environmental impacts from carbon fiber manufacturing

The demand for carbon fibers and carbon fiber-reinforced polymers (CFRPs) is rapidly growing due to their outstanding mechanical properties and potential to enhance sustainability, particularly for lightweighting applications. However, carbon fibers are typically produced from fossil-based feedstocks, involve energy-intensive processes, and have limited options for sustainable end-of-life management or circularity. Despite these challenges, the energy demand and lifecycle environmental implications of their production remain poorly understood. Here, we conduct a critical literature review and meta-analysis of carbon fiber manufacturing, revealing significant variations in reported energy demand, carbon footprint, and lifecycle inventory data. Our analysis makes two novel contributions. First, we identify key underlying factors driving these variations. Second, we highlight that carbon fiber, far from being a homogeneous product, has grades varying substantially in mechanical properties, end-use markets, energy intensity of manufacturing processes, and therefore environmental impacts—an aspect often underrepresented in life cycle assessments. We assert that current data are insufficient for reliably evaluating environmental impacts, posing a risk of misleading decision-making. Addressing this gap requires new lifecycle inventory datasets clearly incorporating carbon fiber heterogeneity and key influencing factors identified in this study. Additionally, we propose actionable recommendations, including a checklist, to advance sustainability in the carbon fiber sector.

CED↗

Initial Assessment of CTF for Time-at-Temperature Applications

The US nuclear industry is interested in improving the economics of their fleet of light-water reactors (LWRs) by uprating US plants. One option being considered is to regain lost margin from overly conservative fuel safety limits. The current limit requires avoidance of critical heat flux (CHF) and prevents further operation of fuel that experiences a dry-out in boiling water reactors (BWRs) or departure from nucleate boiling (DNB) in pressurized water reactors (PWRs); however, it has been shown that temporary, mild dry-out of the fuel does not necessarily increase the risk of fuel failure during its normal anticipated operating life. Such mild dry-out or DNB events may occur during a plant anticipated operational occurrence (AOO), such as a locked rotor in a PWR or a pump trip in a BWR. The time-at-temperature (TAT) approach to regulating fuel operation aims to demonstrate that the fuel rod’s integrity is not challenged during such a mild transient that leads to CHF in which the fuel operates at an elevated temperature for a brief period of time. However, implementing this approach will require extensive fuel material experimental data, as well as supporting modeling and simulation (M&S) predictions, to ensure that the predicted fuel response during AOOs, with all applicable uncertainty considered, will not threaten the safety of the fuel during the transient or the remainder of its anticipated lifecycle. To address this need, a comprehensive effort is being proposed that includes generating cladding material data under TAT conditions, assessment of available code capabilities for TAT conditions, development of new mechanistic models, and demonstration of the M&S capabilities for AOOs of interest. This will require a joint effort between the Nuclear Energy Advanced Modeling and Simulation (NEAMS) and Advanced Fuels Campaign (AFC) programs, as well as close collaboration with nuclear industry stakeholders. The outcome of this collaboration will result in development and assessment of capabilities that can be used by the nuclear industry to support qualification of a TAT-based fuel failure criteria safety limit. This report focuses on the thermal hydraulics (T/H) modeling capabilities and summarizes currently available data for validating the T/H subchannel code CTF for TAT conditions, as well as preliminary assessment results of the code. The initial assessment also resulted in implementation of an alternative post-CHF heat transfer package, which has been shown to significantly improve accuracy. This report is not a final assessment and does not consider all available validation data; it is intended that a future assessment will more fully validate the code for this application.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

CEC Quest: Long Duration Energy Storage Impact Analysis Tool

SAND2025-14389O CEC Quest is a Python tool with a user interface designed to analyze the greenhouse gas impacts of long-duration energy storage projects in California. The tool automates data collection from public sources and uses an Application Programming Interface (API) to enable users to download photovoltaic resource availability, marginal operating emissions rate, and utility rate data. It guides users in inputting parameters for a battery energy storage model and uploading site electrical load data, while also prompting for relevant analysis parameters like timestep and grid limits. CEC Quest performs monthly optimization of one year of data to assess impacts on the site’s electrical bill and the grid’s greenhouse gas emissions. Finally, it conducts a lifecycle analysis to evaluate changes over a defined quantification period, with results aggregated through automated report generation. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Rosewater, David [Sandia National Lab. (SNL-CA), L↗

TMIS-design knowledge capture

The Boeing Advanced Technology Center is conducting research towards the goal of building a corporate memory facility that will provide techniques for capturing and using decision history and rationale throughout the lifecycle of a major NASA program. Currently, much of the information regarding decision alternatives and trade-offs made in the course of a major program development effort is not represented or retained in a way that permits computer-based reasoning over the lifecycle of the program. The loss of this information results in problems in tracing design alternatives to requirements, in assessing the impact of change in requirements, and in configuration management. To address these problems, we are studying the problem of building an intelligent active corporate memory facility which would provide for the capture of the requirements and standards of a program, analyze the design alternatives and trade-offs made over the program's lifetime, and examine relationships between requirements and design trade-offs.

Boose, John H.↗

A Simple Model of Global Aerosol Indirect Effects

Most estimates of the global mean indirect effect of anthropogenic aerosol on the Earth's energy balance are from simulations by global models of the aerosol lifecycle coupled with global models of clouds and the hydrologic cycle. Extremely simple models have been developed for integrated assessment models, but lack the flexibility to distinguish between primary and secondary sources of aerosol. Here a simple but more physically based model expresses the aerosol indirect effect (AIE) using analytic representations of cloud and aerosol distributions and processes. Although the simple model is able to produce estimates of AIEs that are comparable to those from some global aerosol models using the same global mean aerosol properties, the estimates by the simple model are sensitive to preindustrial cloud condensation nuclei concentration, preindustrial accumulation mode radius, width of the accumulation mode, size of primary particles, cloud thickness, primary and secondary anthropogenic emissions, the fraction of the secondary anthropogenic emissions that accumulates on the coarse mode, the fraction of the secondary mass that forms new particles, and the sensitivity of liquid water path to droplet number concentration. Estimates of present-day AIEs as low as 5 W/sq m and as high as 0.3 W/sq m are obtained for plausible sets of parameter values. Estimates are surprisingly linear in emissions. The estimates depend on parameter values in ways that are consistent with results from detailed global aerosol-climate simulation models, which adds to understanding of the dependence on AIE uncertainty on uncertainty in parameter values.

Clouds↗

End-User Assessment of the NASA SPoRT Lightning AI Product

The NASA Short-term Prediction Research and Transition (SPoRT) Center has begun to develop products to address operational challenges and enhance safety during the lifecycle of lightning activity, and conduct evaluations in concentrated R2O/O2R efforts. The product evaluated for this study is Lightning Artificial Intelligence (A.I.), which predicts the probability of lightning out to 15 minutes in advance and spatially maps it using filled color contours. Lightning A.I. uses reflectivity, differential reflectivity, and correlation coefficient data from a subset of radars within the NEXRAD network to generate lightning probabilities at approximately 2 km resolution. The domains, spanning 145 x 145 km are centered over NASA-affiliated centers across the CONUS and use radar data which are closest in proximity. Lightning A.I. was developed with intended use by emergency managers at NASA centers. However, National Weather Service (NWS) offices are also often tasked with monitoring and forecasting the threat for lightning within their County Warning Areas for various impact-based decision support services. These forecasts are typically provided for aviation operations and large-scale, outdoor events, which may have varying safety requirements for decision-making based on lightning proximity and recency. The NASA SPoRT center conducted an assessment of the operational uses of Lightning A.I by various collaborative NWS Offices from late July into early September. This assessment included feedback from participants on both the product itself as well as its accessibility within the new, interactive NASA SPoRT Lightning Viewer. This presentation will include background information about Lightning A.I. and highlight results from this assessment. The feedback from the assessment will be used to inform research on any necessary modifications to this and future lightning products to assist end users.

Kelley Murphy↗

6.26 Low Cost Basalt Fiber for Automotive Applications

Vehicle lightweighting is an essential component to the automotive industry to improve fuel economy of internal combustion engine (ICE) vehicles to meet ever improving emission standards and to improve the range of electric vehicles (EV). Composite materials offer high specific modulus and specific strength, which makes them appealing for these light weighting efforts. Sheet molding compounds (SMC) are particularly interesting from an automotive perspective because of the relatively low cost and high volume of producing SMC parts. Traditionally, composite materials for automotive application are glass fiber reinforced because of the attractive price - performance ratio, but basalt fibers are a cost and recycling competitive reinforcement alternative in this market. The aim of this project was to examine the feasibility of utilizing basalt fiber for automotive applications. More specifically, an effort was made to examine different fiber sizings on basalt fiber combined with vinyl-ester (VE) resin, and their performance as part of an SMC process. In addition to offering vehicle lightweighting with fiber reinforced polymer composites, basalt fiber is a fully recyclable material and thus supports the IACMI technical goal of: Demonstrate that the technology is capable at a sufficient scale for >80% recyclability or reuse of fiber reinforced polymer composites in five years into useful components with projected cost and quality at commercial scale competitive with virgin materials on a pathway to 95% recyclability or reuse starting in ten years. Three different fiber sizings were applied to a continuous roving of basalt fiber and compared to a traditional Electrical/Chemical Resistance (E-CR) glass fiber that is typically used in these types of applications. Fiber tows were examined for Loss on Ignition percentage (LOI%), Tex, and tow strength. Some sizings clearly outperformed others, and the ability to process these fibers on a pilot scale SMC line was demonstrated. A test plan for the manufacturing and mechanical testing of SMC panels was developed. This work continues outside the time frame allocated for this project. When this work is completed, it will be added to this report and posted as Appendix C. Glass fiber reinforced SMC materials have already proven feasible as a light weighting method for traditionally steel parts like the Volkswagen (VW) Atlas lift-gate (Figure 1); this project team is seeking the feasibility of basalt fiber as a drop-in replacement for glass fiber reinforced SMC. Sizing development for basalt fibers has proven that the mechanical properties are better than E-glass and closer to S-glass, which makes it an interesting material for SMC applications. Better mechanical properties translate to less material needed to achieve load case requirement for target applications. The business case has already been demonstrated for 100,000 parts per year of glass fiber reinforced SMC Atlas lift-gates compared to traditional steel manufacturing processes. Reduced overhead and assembly costs are offset by glass fiber SMC higher cost per kg beyond 100,000 parts per year, which is still a relatively low volume for the automotive industry. For basalt fiber reinforced SMC to become feasible for automotive applications, the price-performance ratio has to be precisely determined. Based on the mechanical performance it is possible to establish a range of applications and technical solutions in which the potential of basalt SMC can be utilized, while the price of the material can be used to compile the business case for such applications. Based on these business cases and the sustainability indicators, glass fiber reinforcement (or other) materials can be directly substituted. Volkswagen’s commitment to reducing carbon emissions cannot be understated. Basalt fiber shows promise of reducing the carbon footprint in SMC materials, especially if sizing optimizations can be made with thermoplastic based SMC. To fully realize the value of basalt fiber reinforced materials, a lifecycle cost analysis should be performed on basalt’s production and recycling, and then compared against E-glass. From this assessment, a true judgement can be made on the commercialization potential of this material. Figure 1. Example of Fiber Reinforced Polymer Composite Liftgate As a conclusion, we can state that Mafic basalt fiber is not a direct replacement for E-glass or E-CR glass based on price, but should be considered a technical solution when E-glass does not provide adequate performance in a composite design and S-glass, aramid and carbon fibers are too costly. Mafic basalt fiber can be placed on the high-performance fiber spectrum next to S-glass for performance but at one third the price. It should be considered for more technically challenging structural designs wherein the performance can demonstrate 20-25% performance enhancement over E-glass to elicit more strength or a weight reduction. Both Michelman and Mafic produce thermoplastic sizings which, in combination with Nylon and polypropylene resin and fibers, can further advance high speed composite implementations while maintaining an eco-friendly manufacturing process.

36 MATERIALS SCIENCE↗

Storing Co 2 in Built Infrastructure: Co 2 Carbonation of Precast Concrete Products

The overall objective of the proposed study was to advance the technical understanding of CO 2 incorporation into novel cementitious materials for the development of high value products that provide a net reduction in carbon emissions. This project combined two primary phases of research that addressed technical barriers related to (i) optimizing CO 2 storage capability of cementitious materials, (ii) evaluating and enhancing physical properties of novel carbonated materials, and (iii) assessing the reductions in life cycle CO 2 emissions attributed to CO 2 carbonation of precast cementitious materials. Engineered cementitious composites (ECC) are a class of highly ductile concrete composites that have been shown to be very durable when used in the built environment. CO 2 carbonation of ECC was examined in this study and it was found that precast ECC specimens could sequester up to 35% CO 2 by cement mass after 24 hours of curing at a CO 2 pressure of 0.5 MPa and 23°C and had a strain capacity of 3%. Carbonation conditions were optimized at the bench-scale and then utilized to create full-scale CO 2 -cured ECC railroad ties that were field tested on a train track. Rail ties were selected for this initial assessment of CO 2 storage in precast concrete materials due to the large market for concrete ties in the railroad industry. Although the full-scale rail ties passed all of the required American Railway Engineering and Maintenance-of-Way Association qualifying mechanical tests, on-track testing of the CO 2 -cured ECC rail ties was unsuccessful due to fiber alignment in the ECC the during the rail tie casting process which prevented the material from achieving the expected level of strain capacity. This result highlights the challenge in scaling up bench-scale processes to full-scale product manufacturing and requires additional investigation into the casting process of large-scale infrastructure elements using ECC combined with carbonation curing. Life cycle assessment of a CO 2 -cured ECC rail tie versus a traditional concrete rail tie indicates that the ECC tie can have lifecycle carbon savings of between 11% and 51% depending on how much longer its useful lifetime is compared to traditional concrete rail ties. Both carbon and cost savings are driven by a reduction in the need to replace broken rail ties, so the key factor is the extent to which a CO 2 -cured ECC rail tie will have increased lifetime durability compared to alternative rail ties.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Data Collection and Analysis Challenges and Mitigation Strategies for Quantitative Human Factors Research Studies in Nuclear Power Plant Modernization

The United States (U.S.) Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) program Plant Modernization Pathway is conducting targeted research and development (R&D) to address aging and reliability concerns with the legacy instrumentation and control and related information systems of the U.S. LWR fleet. In this effort, the application of human factors engineering (HFE) provides an important role in ensuring new digital plant technologies enable broad innovation and business improvement with continued operational safety. Evaluation is a key activity in HFE, which often occurs iteratively through the system design lifecycle. While qualitative methods are important in collecting information of how users perform tasks through observations, quantitative methods are equally important in assessing system design based on performance. In collecting and analyzing this quantitative data, there are notable challenges in the nuclear HFE domain that may threaten the validity and reliability of the inferences made in these studies. Notable challenges include small sample size and limited resources, large error variance and small effect size, an “adding test features to losing degrees of freedom” dilemma, non-normal distribution, and heterogeneity of variance. The results in control room usability studies are often statistically non-significant, which makes it hard to interpret. This work discusses these challenges across different scientific viewpoints and provides real-world examples of these challenges in practice. Collectively, the objective of this work is to position these challenges to the larger data science community as a means of identifying future opportunities to address these issues.

99 GENERAL AND MISCELLANEOUS↗