Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “qualitative evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Development and Outcomes of Returning Polycyclic Aromatic Hydrocarbon Exposure Results in the Washington Heights, NYC Community

Report-back of research results (RBRR) is becoming standard practice for environmental health research studies. RBRR is thought to increase environmental health literacy (EHL), although standardized measurements are limited. For this study, we developed a report back document on exposure to air pollutants, Polycyclic Aromatic Hydrocarbons, during pregnancy through community engaged research and evaluated whether the report increased EHL. We used focus groups and surveys to gather feedback on the report document from an initial group of study participants (Group 1, n = 22) and then sent the revised report to a larger number of participants (Group 2, n = 168). We conducted focus groups among participants in Group 1 and discussed their suggested changes to the report and how those changes could be implemented. Participants in focus groups demonstrated multiple levels of EHL. While participant engagement critically informed report development, a survey comparing feedback from Group 1 (initial report) and Group 2 (revised report) did not show a significant difference in the ease of reading the report or knowledge gained about air pollutants. We acknowledge that our approach was limited by a lack of EHL tools that assess knowledge and behavior change, and a reliance on quantitative methodologies. Future approaches that merge qualitative and quantitative methodologies to evaluate RBRR and methodologies for assessing RBRR materials and subsequent changes in knowledge, attitudes, and behavior, may be necessary.

Children’s Environmental Health↗
DOE OSTI2021

Bridging cognitive gaps between user and model in interactive dimension reduction

Interactive machine learning (ML) systems are difficult to design because of the "Two Black Boxes" problem that exists at the interface between human and machine. Many algorithms that are used in interactive ML systems are black boxes that are presented to users, while the human cognition represents a second black box that can be difficult for the algorithm to interpret. These two black boxes create cognitive gaps between the user and the interactive ML model when a user interacts with the system. In this paper, we identify several cognitive gaps that exist in a previously-developed interactive visual analytics (VA) system, Andromeda. These cognitive gaps that we are addressing in Andromeda are representative of common problems in other VA systems. Our goal with this work is to open both black boxes and bridge these cognitive gaps by making improvements to the original Andromeda system, including designing new visual features to help people better understand how Andromeda processes and interacts with data and improving the underlying algorithm so that the Andromeda system can better understand the intent of the user during the data exploration process. We evaluate our designs through both qualitative and quantitative analysis (i.e., user study and simulation analysis), and the results confirm that the improved Andromeda system outperforms the original version significantly in a series of high-dimensional data understanding tasks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Application of artificial intelligence methods in the international roughness index prediction of rigid and composite pavements: a systematic review

The International Roughness Index (IRI) is a widely adopted metric for quantifying pavement roughness, directly influencing vehicle safety, ride comfort, and overall roadway performance. In recent years, the use of Machine Learning (ML) models for IRI prediction has gained momentum, with the goal of improving the allocation of maintenance and rehabilitation resources by enabling accurate assessments of pavement conditions. Most prior reviews, however, have concentrated on flexible pavements, leaving a notable gap regarding rigid and composite pavements. To address this gap, the present study conducts a systematic review of Artificial Intelligence (AI) methods applied to IRI prediction for rigid and composite pavements. Literature published between 2004 and 2025 is synthesized to highlight prevailing trends, methodological contributions, and directions for future research. Particular attention is given to the types of models employed, the datasets used for training and validation, and the role of input variables and data-processing strategies. Across the included studies, ensemble learning methods (especially gradient boosting variants such as XGBoost), artificial neural networks, and hybrid architectures frequently achieved high predictive skill, with several models reporting test-set coefficients of determination approaching 0.9–0.96, indicating strong potential for capturing the influence of traffic, pavement structure, and climatic factors. Since these results are obtained from heterogeneous datasets and evaluation protocols, they are interpreted qualitatively rather than as strict cross-study rankings. Analysis of input variables revealed that pavement age and initial IRI were included in 91% (21 of 23) and 78% (18 of 23) of studies, respectively. Climatic variables such as the freezing index appeared in 57% (13 of 23), while traffic-related factors were considered in 65% (15 of 23). The findings underscore the importance of standardized, high-quality datasets, such as those from the Long-Term Pavement Performance (LTPP) program, along with data consistency, model interpretability, computational efficiency, and replicability in enhancing IRI prediction. Future research should focus on incorporating input variable selection techniques to identify the most influential predictors, thereby improving accuracy and robustness. Integrating these approaches with advanced non-linear data-driven models, coupled with robust hyperparameter optimization, holds considerable promise for strengthening the reliability of IRI prediction and supporting resilient pavement management strategies.

42 ENGINEERING↗
DOE OSTI2021

Nevada National Security Site Demonstration Reactor Siting and Capability Study

The study’s purpose is to identify suitable testbeds within the NNSS for the demonstration of advanced and emerging reactor technologies. These testbeds are envisioned to be existing structures, facilities, or sites that may be suitable for advanced reactor demonstrations, advanced reactor fuel fabrication, or other experimental support for advanced reactor demonstrations. This study examines siting alternatives at NNSS with the objective of identifying locations for near term ARD projects. Included in the outcomes is an evaluation of the quantitative and qualitative factors that must be addressed for each site if selected to host an ARD sponsored demonstration.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Collective Summary of sCO2 Materials Development (Supercritical Transformational Electric Power Generation (STEP) Level 2 Milestone Report) (Parts I - II)

Polymers such as PTFE (polytetrafluorethylene or Teflon), EPDM (ethylene propylene diene monomer) rubber, FKM fluoroelastomer (Viton), Nylon 11, Nitrile butadiene (NBR) rubber, hydrogenated nitrile rubber (HNBR) and perfluoroelastomers (FF_202) are commonly employed in super critical CO 2 (sCO2) energy conversion systems. O-rings and gaskets made from these polymers face stringent performance conditions such as elevated temperatures, high pressures, pollutants, and corrosive humid environments. In FY 2019, we conducted experiments at high temperatures (100°C and 120°C) under isobaric conditions (20 MPa). Findings showed that elevated temperatures accelerated degradation of polymers in sCO2, and that certain polymer microstructures are more susceptible to degradation over others. In FY 2020, the focus was to understand the effect of sCO2 on polymers at low (10 MPa) and high pressures (40 MPa) under isothermal conditions (100°C). It was clear that the same selectivity was observed in these experiments wherein certain polymeric functionalities showed more propensity to failure over others. Fast diffusion, supported by higher pressures and long exposure times (1000 hours) at the test temperature, caused increased damage in sCO2 environments to even the most robust polymers. We also looked at polymers under compression in sCO2 at 100°C and 20 MPa pressure to imitate actual sealing performance required of these materials in sCO2 systems. Compression worsened the physical damage that resulted from chemical attack of the polymers under these test conditions. In FY 2021, the effect of cycling temperature (from 50°C to 150°C to 50°C) for polymers under a steady sCO2 pressure of 20 MPa was studied. The aim was to understand the influence of cycling temperatures of sCO2 for typical polymers under isobaric (20 MPa) conditions. Thermoplastic polymers (Nylon, and PTFE) and elastomers (EPDM, Viton, Buna N, Neoprene, FF202, and HNBR) were subjected to 20 MPa sCO2 pressure for 50 cycles and 100 cycles in separate experiments. Samples were extracted for ex-situ characterization at 50 cycles and upon the completion of 100 cycles. Each cycle constituted of 175 minutes of cycling from 50°C to 150°C. The polymer samples were examined for physical and chemical changes by Dynamic Mechanical and Thermal Analysis (DMTA), Fourier Transform Infrared (FTIR) spectroscopy, and compression set. Density and mass changes immediately after removal from test were measured for degree of swell comparisons. Optical microscopy techniques and micro computer tomography (micro CT) images were collected on select specimens. Evaluations conducted showed that exposures to super-critical CO2 environments resulted in combinations of physical and/or chemical changes. For each polymer, the dominance of cycling temperatures under sCO2 pressures, were evaluated. Attempts were made to qualitatively link the permanent sCO2 effects to polymer micro- structure, free volume, backbone substitutions, presence of polar groups, and degree of crystallinity differences. This study has established that soft polymeric materials are conducive to failure in sCO2 through mechanisms of failure that are dependent on polymer microstructure and chemistry. Polar pendant groups, large atom substitutions on the backbone are some of the factors that are influential structural factors.

36 MATERIALS SCIENCE↗
NASA NTRS1988

Input-output characterization of fiber composites by SH waves

Input-output characterization of fiber composites is studied theoretically by tracing SH waves in the media. A fiberglass epoxy composite is modeled as a homogeneous transversely isotropic continuum plate. The reflection of an SH wave at a stress-free plane boundary in a semi-infinite transversely isotropic medium is considered first. It is found that an incident SH wave reflects only a similar SH wave back into the medium. It is also established that the angle of reflection of the reflected wave is equal to the angle of incidence of the incident wave. The phase velocity of the SH waves and the delay time of the SH waves in reaching the receiving transducer are computed as functions of a reflection index, defined as the number of reflections of the SH waves from the bottom face of the continuum plate. The directivity function corresponding to the shear stress associated with the SH waves in the continuum plate is also derived as a function of the reflection index. A theoretical output voltage from the receiving transducer is calculated for a tone burst (a periodic input voltage of finite duration). The output voltage is shown for tone bursts of duration 60 microseconds and center frequencies of 0.75, 1.00, and 1.25 MHz. The study enhances the quantitative and qualitative understanding of the nondestructive evaluation (NDE) of fiber composites which can be modeled as transversely isotropic media.

Renneisen, John D.↗
NASA NTRS1989

Low-pass spatial filtering of satellite radar data

Thirty-four low-pass spatial filter treatments were applied to a multi-angle SIR-B data set to reduce speckle effects and improve classification performance. These treatments were based on four algorithms: square mean, separable mean, square median, and separable recursive median. The filtered images were evaluated using both quantitative and qualitative techniques. It was determined that the square median algorithm implemented at two iterations with a window size of 3 by 3 produced the best overall results with the 28.5-m SIR-B data.

Mueller, Paul W.↗
NASA NTRS1990

Input-output characterization of fiber reinforced composites by P waves

Input-output characterization of fiber composites is studied theoretically by tracing P waves in the media. A new path motion to aid in the tracing of P and the reflection generated SV wave paths in the continuum plate is developed. A theoretical output voltage from the receiving transducer is calculated for a tone burst. The study enhances the quantitative and qualitative understanding of the nondestructive evaluation of fiber composites which can be modeled as transversely isotropic media.

Renneisen, John D.↗
NASA NTRS1994

Multi-objective decision-making under uncertainty: Fuzzy logic methods

Selecting the best option among alternatives is often a difficult process. This process becomes even more difficult when the evaluation criteria are vague or qualitative, and when the objectives vary in importance and scope. Fuzzy logic allows for quantitative representation of vague or fuzzy objectives, and therefore is well-suited for multi-objective decision-making. This paper presents methods employing fuzzy logic concepts to assist in the decision-making process. In addition, this paper describes software developed at NASA Lewis Research Center for assisting in the decision-making process. Two diverse examples are used to illustrate the use of fuzzy logic in choosing an alternative among many options and objectives. One example is the selection of a lunar lander ascent propulsion system, and the other example is the selection of an aeration system for improving the water quality of the Cuyahoga River in Cleveland, Ohio. The fuzzy logic techniques provided here are powerful tools which complement existing approaches, and therefore should be considered in future decision-making activities.

Hardy, Terry L.↗
NASA NTRS2015

Toward Head-Worn Displays for Equivalent Visual Operations

The Next Generation Air Transportation System represents an envisioned transformation to the U.S. air transportation system that includes an "equivalent visual operations" (EVO) concept, intended to achieve the safety and operational tempos of Visual Flight Rules (VFR) operations independent of visibility conditions. Today, Federal Aviation Administration regulations provide for the use of an Enhanced Flight Visual System (EFVS) as "operational credit" to conduct approach operations below traditional minima otherwise prohibited. An essential element of an EFVS is the Head-Up Display (HUD). NASA has conducted a substantial amount of research investigating the use of HUDs for operational landing "credit", and current efforts are underway to enable manually flown operations as low as 1000 feet Runway Visual Range (RVR). Title 14 CFR 91.175 describes the use of EFVS and the operational credit that may be obtained with airplane equipage of a HUD combined with Enhanced Vision (EV) while also offering the potential use of an “equivalent” display in lieu of the HUD. A Head-Worn Display (HWD) is postulated to provide the same, or better, safety and operational benefits as current HUD-equipped aircraft but for potentially more aircraft and for lower cost. A high-fidelity simulation was conducted that examined the efficacy of HWDs as "equivalent" displays. Twelve airline flight crews conducted 1000 feet RVR approach and 300 feet RVR departure operations using either a HUD or HWD, both with simulated Forward Looking Infra-Red cameras. The paper shall describe (a) quantitative and qualitative results, (b) a comparative evaluation of these findings with prior NASA HUD studies, and (c) describe current research efforts for EFVS to provide for a comprehensive EVO capability.

Prinzel, Lawrence (Lance) J., III↗
NASA NTRS2017

Effects of Inventory Bias on Landslide Susceptibility Calculations

Many landslide inventories are known to be biased, especially inventories for large regions such as Oregon's SLIDO or NASA's Global Landslide Catalog. These biases must affect the results of empirically derived susceptibility models to some degree. We evaluated the strength of the susceptibility model distortion from postulated biases by truncating an unbiased inventory. We generated a synthetic inventory from an existing landslide susceptibility map of Oregon, then removed landslides from this inventory to simulate the effects of reporting biases likely to affect inventories in this region, namely population and infrastructure effects. Logistic regression models were fitted to the modified inventories. Then the process of biasing a susceptibility model was repeated with SLIDO data. We evaluated each susceptibility model with qualitative and quantitative methods. Results suggest that the effects of landslide inventory bias on empirical models should not be ignored, even if those models are, in some cases, useful. We suggest fitting models in well-documented areas and extrapolating across the study region as a possible approach to modeling landslide susceptibility with heavily biased inventories.

Oregon↗
NASA NTRS2017

Effects of Inventory Bias on Landslide Susceptibility Calculations

Many landslide inventories are known to be biased, especially inventories for large regions such as Oregons SLIDO or NASAs Global Landslide Catalog. These biases must affect the results of empirically derived susceptibility models to some degree. We evaluated the strength of the susceptibility model distortion from postulated biases by truncating an unbiased inventory. We generated a synthetic inventory from an existing landslide susceptibility map of Oregon, then removed landslides from this inventory to simulate the effects of reporting biases likely to affect inventories in this region, namely population and infrastructure effects. Logistic regression models were fitted to the modified inventories. Then the process of biasing a susceptibility model was repeated with SLIDO data. We evaluated each susceptibility model with qualitative and quantitative methods. Results suggest that the effects of landslide inventory bias on empirical models should not be ignored, even if those models are, in some cases, useful. We suggest fitting models in well-documented areas and extrapolating across the study region as a possible approach to modelling landslide susceptibility with heavily biased inventories.

landslide↗
DOE OSTI2022

Computational and experimental study of different brines in temperature swing solvent extraction desalination with amine solvents

Rapid global urbanization and high-salinity wastewater disposal from industrial activities have exerted significant pressure on water resources. Over the past few years, temperature swing solvent extraction (TSSE) has been identified as a promising technique to desalinate hypersaline brines. Despite its potential, the TSSE desalination literature has been mainly based on empirical insights, and the limited molecular simulation studies have primarily focused on NaCl brines. Herein, we use molecular dynamics (MD) simulations to study the TSSE desalination of four different brines, namely, KCl, KBr, NaCl, and NaBr using diisopropylamine as the solvent. Based on both bulk and interfacial brine-diisopropylamine MD results, here we investigate the qualitative and quantitative performance of the simulations by benchmarking these results against our experimental evaluations of these same systems. MD results provide satisfactory qualitative agreement with the experimental data of water solubilization in the organic phase and amine solubilization in the aqueous phase for the KBr, KCl, and NaBr brines. Also, the molecular mechanism of solvation of ionic species by water molecules over diisopropylamine suggested by the MD simulations is in agreement with our experimental data. However, larger qualitative and quantitative deviations were observed for the NaCl brines, and this is likely due to polarization and charge transfer effects, as quantified by our quantum chemical calculations.

42 ENGINEERING↗
DOE OSTI2023

Environmental and Social Justice Considerations in a Circular Economy

A consideration of environmental justice (EJ) and social justice (SJ) is critical to minimize the impacts of technology deployment on local communities. SJ and EJ impacts occur in specific geographic locations but can cover a wide range of effects (e.g., air pollution, access to clean water, jobs, wages, and education), making it challenging to determine which metrics are appropriate to evaluate and which data are required for qualitative or quantitative analysis. This issue is only exacerbated when the technology in question is at an early technology readiness level (TRL) without community specific data. Here, we present a framework for evaluating the human health, local environment, and job implications of processes that are at early to middle TRLs. Using a case study on enzymatic polyethylene terephthalate (PET) recycling (middle TRL), we demonstrate how to qualitatively and quantitatively assess these EJ and SJ metrics for a circular economy context and how to communicate the results in a manner beneficial to both researchers and local communities.

circular economy↗
DOE OSTI2025

Fabrication of porous transport electrodes: Development of quantitative approach for quality control

This work focuses on porous transport electrodes (PTEs), which integrate the anodic catalyst with the adjacent Ti porous transport layer (PTL). Challenges in catalyst deposition on PTLs, particularly at low loadings, motivated this study to evaluate various fabrication methods and characterization approaches. This work investigated Pt-treated PTLs coated with Ir-based catalysts using several common methods, including airbrush coating, rod coating, ultrasonic spray coating, electrodeposition, and sputter deposition, with catalyst loadings ranging from 2.9 to 0.1 mg/cm 2 , providing the opportunity for comparisons across a large set of samples produced by different methods. Two widely accessible characterization techniques: X-ray computed tomography (XCT) and scanning electron microscopy energy dispersive X-ray spectroscopy (SEM-EDS) were explored. Initial evaluation of selected samples with XCT provided qualitative insights into catalyst distribution, however comprehensive quantitative analysis was limited. SEM-EDS enabled detailed information on the catalyst distribution both qualitatively and quantitatively using two metrics. Atomic and surface area % ratios of Pt:Ir and Ti:Ir revealed trends in catalyst loading and losses into the PTL pores, as well as evaluating the homogeneity of catalyst coatings. The analysis demonstrated that ultrasonic spray coating, electrodeposition, and sputter coating produced the most homogeneous coatings, with minimal catalyst losses observed for electrodeposition and sputter coating. By adapting common techniques with novel, standardized methodologies, this work establishes a universally applicable framework for cross-study comparison of PTEs. The SEM-EDS approach provides a practical, accessible tool for PTE characterization and contributes a reference dataset supporting both research development and rapid quality control.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Intelligent Manufacturing Support: Specialized LLMs for Composite Material Processing and Equipment Operation

Engineering educational curriculum and standards cover many material and manufacturing options. However, engineers and designers are often unfamiliar with certain composite materials or manufacturing techniques. Large language models (LLMs) could potentially bridge the gap. Their capacity to store and retrieve data from large databases provides them with a breadth of knowledge across disciplines. However, their generalized knowledge base can lack targeted, industry-specific knowledge. To this end, we present two LLM-based applications based on the GPT-4 architecture: (1) The Composites Guide: a system that provides expert knowledge on composites material and connects users with research and industry professionals who can provide additional support and (2) The Equipment Assistant: a system that provides guidance for manufacturing tool operation and material characterization. By combining the knowledge of general AI models with industry-specific knowledge, both applications are intended to provide more meaningful information for engineers. In this paper, we discuss the development of the applications and evaluate it through a benchmark and two informal user studies. The benchmark analysis uses the Rouge and Bertscore metrics to evaluate our models’ performance against GPT-4o. The results show that GPT-4o and the proposed models perform similarly or better on the ROUGE and BERTScore metrics. The two user studies supplement this quantitative evaluation by asking experts to provide qualitative and open-ended feedback about our model’s performance on a set of domain-specific questions. The results of both studies highlight a potential for more detailed and specific responses with the Composites Guide and the Equipment Assistant.

Kapoor, Gunnika [Oak Ridge National Laboratory (OR↗
DOE OSTI2020

Thin Film Characterization on Cu/SnAg Solder Interface for 3D Packaging Technologies

Copper is a commonly used interconnect metal in microelectronic interconnects due to its exceptional electrical and thermal properties. Particularly in applications of the 2.5 and 3D integration, Cu is utilized in through-silicon-vias (TSVs) and flip chip interconnects between microelectronic chips for providing miniaturization, lower power and higher performance than current 2D packaging approaches. Furthermore, SnAg capped Cu pillars are a common high-density interconnect technology for flip chip bonding. For these interconnects, specific properties of the Cu surface, such as roughness and cleanliness, are an important factor in the process to ensure quality solder bumps. During electroplating, tight processing parameters must be met so that defects are avoided, and high bump uniformity is achieved. An understanding of the interactions at the solder and Cu pillar interface is needed, based on the electroplating parameters, to determine the best method for populating solder on the wafer surface. In this study, surface treatment techniques such as oxygen plasma cleaning were performed on the Cu surfaces and the SnAg plating chemistry for depositing the solder were evaluated through hull cell testing to qualitatively determine the range of current densities to investigate. It was observed that current density while plating played a large role in solder bump deposition morphology. At the higher current densities greater than 60 mA/cm 2 , bump height non-uniformity and dendritic growth are observed and at lower current densities, less than or equal to 60 mA/cm 2 , uniform, continuous bump height occurred.

36 MATERIALS SCIENCE↗