Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “EVALUATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,549 records · Page 86
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Uncertainty evaluation in reference material characterization by double isotope dilution inductively coupled plasma mass spectrometry (ID-ICP-MS)

Double isotope dilution inductively coupled plasma mass spectrometry (ID-ICP-MS) is one of the most important measurement methods in the establishment of measurement standards for inorganic analysis. However, there is still no good consensus on approaches for uncertainty evaluation in double ID-ICP-MS. Particularly, approaches to treating the instrumental isotopic fractionation (IIF) phenomenon and correlation between uncertainty sources are diverse and often unclear in the literature. Here, an approach for uncertainty evaluation in double ID-ICP-MS measurements is described. Using three certified reference materials (CRMs), it is shown that the IIF effects cancel out and should not be included in the uncertainty budget. Further, a consistent way of considering correlated sources of uncertainty to prevent double counting of uncertainties is described in detail along with an example of measuring the mass fraction of magnesium in an oyster powder CRM.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Evaluation of Fish-Related Properties of Kaplan Turbines at the Design Phase: Simulation-based outcomes vs. Experimental Data

The development of turbine technology faces growing demands to maximize the survival of migratory fish passing through turbine flows. In this context, two strategies have emerged for quantifying hazardous hydraulic conditions: computer-based evaluations at design stage and recordings with autonomous sensors deployed in prototypes. The former is a desktop evaluation with many modelling assumptions (idealization) and the latter is a field technique that introduces various unknown and uncontrollable factors (uncertainty.) The present work introduces and implements a third method based on test rig measurements and the corresponding computer-based predictions of conditions that negatively affect fish survivability. The experimental work was conducted in a five-bladed Kaplan turbine model in which miniaturized autonomous sensors (SF Mini, developed at the Pacific Northwest National Laboratory, U.S.) measured fish-relevant hydraulic features. The modelling work involved flow simulations according to industry practices and the representation of fish trajectories through the simulated flow conditions. We compared both the experimental measurements and CFD outcomes and discussed the challenges and advantages of the modelling strategies, as well as the benefits for turbine engineers in need of incorporating effective design concepts to mitigate fish mortality through turbines.

Romero-Gomez, Pedro↗
DOE OSTI2020

Development and Evaluation of Occupancy-Aware Model Predictive Control for Residential Building Energy Efficiency and Occupant Comfort

The residential sector accounts for 25% of global primary energy consumption. Two methods have previously been proposed to reduce residential energy use associated with the provision of occupant thermal comfort: 1. Occupancy-based HVAC control, operating systems only during confirmed occupancy, and 2. model predictive control (MPC), harnessing a mathematical model and forecasts to find optimal operating strategies. Previous studies estimate the average energy savings of the two methods individually in the range of 21% and 16%, respectively. The research presented herein was carried out to evaluate the energy savings potential in residential buildings by combining both approaches across different climates, house vintages, and occupancy patterns. Occupancy and eight different physical modalities (e.g. CO2 and VOC) data were collected from five homes for time periods of 4–9 weeks. Collected data sets were used to train occupancy prediction models suggested by an extensive literature survey of occupancy model types. The trained prediction models were combined with MPC and detailed EnergyPlus building simulation models to evaluate residential building performance in terms of annual energy savings and thermal comfort, along with discomfort exceedance metrics. Multiple home types and regions were analyzed to understand regional and climate-dependent potential. Based on actual field data, the occupancy models had a prediction inaccuracy between 8% and 35% across the investigated homes. Average occupancy for the collected data ranged from 56% to 86%, a typical range reported in the literature. Building simulations were conducted for three control scenarios: conventional thermostatic control, occupancy-based, and occupancy-based MPC. The results indicate that all advanced strategies improve upon the conventional control, with some scenarios cutting energy use in half with only occasional incurrence of discomfort. The findings indicate that occupancy-aware model predictive residential building control has the potential to drastically reduce energy use and associated emissions while maintaining occupant comfort for both new and existing buildings.

ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATION↗
DOE OSTI2021

OBO Foundry in 2021: operationalizing open data principles to evaluate ontologies

Biological ontologies are used to organize, curate and interpret the vast quantities of data arising from biological experiments. While this works well when using a single ontology, integrating multiple ontologies can be problematic, as they are developed independently, which can lead to incompatibilities. The Open Biological and Biomedical Ontologies (OBO) Foundry was created to address this by facilitating the development, harmonization, application and sharing of ontologies, guided by a set of overarching principles. One challenge in reaching these goals was that the OBO principles were not originally encoded in a precise fashion, and interpretation was subjective. Here, we show how we have addressed this by formally encoding the OBO principles as operational rules and implementing a suite of automated validation checks and a dashboard for objectively evaluating each ontology’s compliance with each principle. This entailed a substantial effort to curate metadata across all ontologies and to coordinate with individual stakeholders. We have applied these checks across the full OBO suite of ontologies, revealing areas where individual ontologies require changes to conform to our principles. Our work demonstrates how a sizable, federated community can be organized and evaluated on objective criteria that help improve overall quality and interoperability, which is vital for the sustenance of the OBO project and towards the overall goals of making data Findable, Accessible, Interoperable, and Reusable (FAIR).

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2024

Evaluation of data collection bias of third molar stages of mineralisation for age estimation in the living

Abstract Age assessment of the living is a fundamental procedure in the process of human identification, in order to guarantee fair treatment of individuals, which has ethical, civil, legal, and medical repercussions. The careful selection of the appropriate methods requires evaluation of several parameters: accuracy, precision of the method, as well as its reproducibility. The approach proposed by Mincer et al. adapted from Demirjian et al. exploring third molar mineralisation, is one of the most frequently considered for age estimation of the living. Thus, this work aims to assess potential bias in the data collection when applying the classification stages for dental mineralisation adapted by Mincer et al. A total of 102 orthopantomographs, of clinical origin, belonging to individuals aged between 12 and 25 years ($ \bar{\textit x} $ = 20.12 years, SD = 3.49 years; 65 females, 37 males, all of Portuguese nationality) were included and a retrospective analysis performed by five observers with different levels of experience (high, average, and basic). The performance and agreement between five observers were evaluated using Weighted Cohen’s Kappa and the Intraclass Correlation Coefficient. To access the influence of impaction on third molar classification, variables were tested using ordinal logistic regression Generalised Linear Model. It was observed that there were variations in the number of teeth identified among the observers, but the agreement levels ranged from moderate to substantial (0.4–0.8). Upon closer examination of the results, it was observed that although there were discernible differences between highly experienced observers and those with less experience, the gap was not as significant as initially hypothesised, and a greater disparity between the classifications of the upper (0.24–0.49) and lower third molars (>0.55) was observed. When bone superimposition is present, the classification process is not significantly influenced; however, variation in teeth angulation affects the assessment. The results suggest that with an efficient preparation, the level of experience as a factor can be overcome. Mincer and colleague's classification system can be replicated with ease and consistency, even though the classification of upper and lower third molars presents distinct challenges.

de Oliveira Santos, Inês (ORCID:0000000267324347)↗
DOE OSTI2020

Evaluation of a pair-based, joint-likelihood association approach for regional infrasound event identification

SUMMARY A Bayesian framework for the association of infrasonic detections is presented and evaluated for analysis at regional propagation scales. A pair-based, joint-likelihood association approach is developed that identifies events by computing the probability that individual detection pairs are attributable to a hypothetical common source and applying hierarchical clustering to identify events from the pair-based analysis. The framework is based on a Bayesian formulation introduced for infrasonic source localization and utilizes the propagation models developed for that application with modifications to improve the numerical efficiency of the analysis. Clustering analysis is completed using hierarchical analysis via weighted linkage for a non-Euclidean distance matrix defined by the negative log-joint-likelihood values. The method is evaluated using regional synthetic data with propagation distances of hundreds of kilometres in order to study the sensitivity of the method to uncertainties and errors in backazimuth and time of arrival. The method is found to be robust and stable for typical uncertainties, able to effectively distinguish noise detections within the data set from those in events, and can be made numerically efficient due to its ease of parallelization.

58 GEOSCIENCES↗
DOE OSTI2026

Evaluating multistation phase picking algorithm phase neural operator (PhaseNO) on local seismic networks

Reliable automatic phase picking is important for many seismic applications. With the development of machine learning approaches, many algorithms are proposed, evaluated and applied to different areas. Many of these algorithms are single station based, while recent proposed methods start to combine surrounding stations into consideration in the problem of phase picking. Among these algorithms, the phase neural operator (PhaseNO) shows promising results on regional data sets comparing to existing algorithms. But there are many use cases for the local seismic networks in our community, therefore in this paper we evaluate the performance of PhaseNO on four different local data sets and compare the results to PhaseNet and EQTransformer. We used both individual phase picking metrics as well as association metrics to illustrate the performance of PhaseNO. By manually reviewing the newly detected events, we find that the PhaseNO model outperforms the single station-based approaches in the local-scale use cases due to its consideration of coherent signals from multiple stations. We also explored PhaseNO’s behaviours when only using one station, as well as gradually increasing the number of stations in the seismic network to better understand its behaviour. Overall, using the off-the-shelf machine learning based phase pickers, PhaseNO demonstrated its good performance on local-scale seismic networks.

58 GEOSCIENCES↗
DOE OSTI2023

Evaluating Stage Motion for Automated Electron Microscopy

Abstract Precise control is an essential and elusive quality of emerging self-driving transmission electron microscopes (TEMs). It is widely understood these instruments must be capable of performing rapid, high-volume, and arbitrary movements for practical self-driving operation. However, stage movements are difficult to automate at scale, owing to mechanical instability, hysteresis, and thermal drift. Such difficulties pose major barriers to artificial intelligence-directed microscope designs that require repeatable, precise movements. To guide design of emerging instruments, it is necessary to understand the behavior of existing mechanisms to identify rate limiting steps for full autonomy. Here, we describe a general framework to evaluate stage motion in any TEM. We define metrics to evaluate stage degrees of freedom, propose solutions to improve performance, and comment on fundamental limits to automated experimentation using present hardware.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Evaluation of overtime phenotypic variation of yeasts in chronic vulvovaginal candidosis cases

Abstract Chronic vulvovaginal candidosis results either from reinfection or from the ability of Candida spp. to persist in the vulva and/or vagina. Persistence is usually associated with increased antifungal (mainly azoles) resistance rates, which can explain treatment failure, and/or increased expression of virulence factors by Candida spp. The aim of this study was to assess the mechanisms leading to Candida spp persistence, by studying sequential isolates from women with chronic vulvovaginal candidosis, focusing on strains genotypes, azole resistance, and ability to form biofilms along the period of clinical evaluation. The strains were identified at species level by automated analysis of biochemical profiles and molecular typing evaluated by polymorphic DNA analysis. The capacity to form biofilm was assessed with a microtiter plate assay. Fluconazole susceptibility was determined by the microdilution broth assay at both pH 7 (following the recommended guideline) and pH 4.5 (as representative of vaginal pH). We studied samples from 17 clinically recurrent cases. In 53% of the chronic cases there were two or more isolates that had a phylogenetic relationship while the remaining (47%) were caused by different species. In those cases where related strains were involved in recurrence, we verified an increase in MIC at pH 7 and also an increased capacity to form biofilms over time. Significant correlation between these two parameters was observed only in cases caused by C. glabrata, evidencing the importance of these two factors to enhance persistence in the vaginal mucosa for this particular species.

Faria-Gonçalves, Paula↗
DOE OSTI2021

Evaluation of Triage Methods for Criticality Accidents

Studies indicate that early identification of persons involved in and receiving high doses of radiation in accidents is key to providing life-saving medical treatment. Although the risk of criticality accidents is low the potential impact to workers is significant. For facilities that employ large numbers of workers a key element in the response to a radiological emergency is identifying personnel that received significant, and potentially harmful, doses. Also important is having the ability to screen large numbers of workers to identify persons that did not receive significant exposure so as to reduce the impact on emergency response efforts. At the Y-12 National Security Complex the focus on criticality accident response is the rapid triage of personnel in order to identify persons exposed to large radiation doses and to prioritize those persons receiving the highest exposures. Once identified personnel are transported to local medical facilities including the Radiation Emergency Assistance Center/Training Site (REAC/TS) for medical evaluation and treatment. The Y-12 external dosimetry program utilizes a number of techniques to identify and prioritize workers and these methods were evaluated at a criticality dosimetry intercomparison exercise. Finally, the methods used were shown to perform as intended and other sites may consider incorporating these methods into their accident dosimetry response procedures.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2025

Evaluating the limitations of Bayesian metabolic control analysis

AbstractBayesian Metabolic Control Analysis (BMCA) has emerged as a promising framework for inferring metabolic control coefficients in data-limited scenarios by integrating Bayesian inference with linlog rate laws. However, its predictive accuracy and limitations remain underexplored. This study systematically evaluates BMCA’s ability to infer elasticity values, flux control coefficients (FCCs), and concentration control coefficients (CCCs) under varying data availability conditions using three synthetic metabolic network models. Our findings highlight the strengths and weaknesses of BMCA, guiding its application in metabolic engineering and emphasizing the need for methodological refinements.Author summaryUnderstanding how enzymes control metabolic pathways is crucial for optimizing biomanufacturing and synthetic biology applications. Bayesian Metabolic Control Analysis (BMCA) is a promising computational method that integrates Bayesian inference with metabolic control analysis to estimate key control parameters, even in cases with limited experimental data. However, the accuracy and limitations of BMCA remain unclear. In this study, we systematically evaluate BMCA using three synthetic metabolic networks to determine how different types of physiological data impact its predictive performance. We find that BMCA requires flux and enzyme concentration data for accurate predictions, while external metabolite concentrations contribute little. Additionally, BMCA fails to predict elasticity values beyond a magnitude of 1.5 and reliably infer allosteric regulation, even when strong regulatory interactions exist. In addition, BMCA does not accurately rank metabolic control points, which may limit its utility in identifying key enzymes in engineered pathways. Our work provides practical insights into when and how BMCA can be applied, guiding future research in metabolic modeling and control analysis.

Shin, Janis (ORCID:0000000216572455)↗
DOE OSTI2024

Evaluation of a frequency-dependent phase shift in chirped Raman lasers for atom gravimeters

Light-pulse atom gravimetry has emerged as a powerful technique for precisely measuring absolute gravitational acceleration. Raman lasers are commonly used in this technique to coherently manipulate the atomic wave packet, of which the effective frequency is chirped continuously to compensate for the Doppler shift. In this study we investigate an additional phase shift in the Raman lasers that arises due to the frequency chirp. Here, we directly measure this phase shift by recording the beat signal of the Raman lasers with a high-speed oscilloscope, providing an independent evaluation of the resultant error in atom gravimeters caused by this phase shift. Concurrently, we detect the influence of the additional phase shift on gravity measurements using our atom gravimeter, and the results are in good agreement with the independent evaluation. Notably, there may still be a residual error at the microgal level when performing differential measurements by reversing the direction of the effective wave vector of the Raman lasers. We propose that this residual error can in principle be eliminated by selecting the same chirp frequency range for both directions in the differential measurement.

Xu, Yaoyao [Huazhong Univ. of Science and Technolo↗
DOE OSTI2021

Evaluating Energy Differences on a Quantum Computer with Robust Phase Estimation

Here, we adapt the robust phase estimation algorithm to the evaluation of energy differences between two eigenstates using a quantum computer. This approach does not require controlled unitaries between auxiliary and system registers or even a single auxiliary qubit. As a proof of concept, we calculate the energies of the ground state and low-lying electronic excitations of a hydrogen molecule in a minimal basis on a cloud quantum computer. The denominative robustness of our approach is then quantified in terms of a high tolerance to coherent errors in the state preparation and measurement. Conceptually, we note that all quantum phase estimation algorithms ultimately evaluate eigenvalue differences.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Systematic Bayesian evaluation of resonance parameters in 19 Ne for the 15 O ⁡(𝛼, 𝛾)⁢ 19 Ne and 18 F ⁡(𝑝, 𝛼)⁢ 15 O reactions

Here, we present a comprehensive evaluation of the nuclear structure properties of 19 Ne using a novel and rigorous Bayesian statistical framework. Precise characterization of 19 Ne resonance parameters is critical for accurately determining reaction rates of the astrophysically significant 15 O ⁡(𝛼, 𝛾)⁢ 19 Ne and 18 F ⁡(𝑝, 𝛼)⁢ 15 O reactions, which govern breakout from the hot CNO cycle in x-ray bursts and influence 𝛾-ray emission in novae, respectively. By reconstructing likelihood functions from published experimental data—including asymmetric uncertainties and upper or lower limits—we derive posterior distributions for resonance energies, decay widths, and branching ratios. Our Bayesian approach systematically incorporates previously reported discrepancies among measurements, providing a statistically robust and consistent treatment of these uncertainties. The evaluated resonance parameters and associated uncertainties provide crucial input for stellar nucleosynthesis modeling, contributing to a refined understanding of explosive astrophysical phenomena.

Kim, Sohyun H. [Sungkyunkwan Univ., Suwon (Republi↗
DOE OSTI2026

A Pulsar-Inspired Timing Framework for Power System: Optimization and Performance Evaluation

Due to their excellent stability, neutron pulsar stars are considered promising candidate timing sources for power system applications. However, the complexity of pulsar signals necessitates advanced processing algorithms to provide accurate timing references. This paper presents the foundational framework for pulsar signal processing, serving as the basis for further optimization. To enhance the timing accuracy and computation efficiency in pulsar period searches, three algorithms are proposed as the initial optimization step: wavelet de-noising, fast folding, and cross-correlation for profile evaluation. Wavelet de-noising improves signal-to-noise ratio (SNR) by 36%–70%. Fast folding reduces computation time from hundreds of seconds to mere milliseconds. Cross-correlation works better than traditional SNR-based methods by effectively identifying the optimal period. The performance of the proposed algorithms is evaluated using observation data from telescopes. Together, these algorithms significantly improve pulsar timing performance, reducing the error of the Pulse Per Second (PPS) signal from hundreds to tens of microseconds.

Wu, Ori [ORNL] (ORCID:0000000326723410)↗
DOE OSTI2021

Early Evaluation of Fugaku A64FX Architecture Using Climate Workloads

The Energy Exascale Earth System Model (E3SM) Project is an ongoing, state-of-the-science Earth system modeling, simulation, and prediction project that targets efficient utilization of U.S. Department of Energy’s (DOE) supercomputers to meet the science needs of the nation and the mission needs of DOE. This work focuses on our early evaluation of the A64FX architecture on Fugaku supercomputer using E3SM benchmarks. We will present results that track hardware trends, facilitate architecture comparison and the specific impact on our workload using an atmospheric model benchmark. We have two variants of the code written in Fortran and C++/Kokkos respectively which were used to collect data on a variety of CPU and GPU platforms. Furthermore, we have conducted a comparative evaluation of the compilers on the A64FX architecture and found GNU to be the best performer for our workload. Our experience so far indicates that Fugaku/A64FX shows promising energy efficiency (performance/Watt) with further performance gains possible through architecture-aware optimization efforts.

Sreepathi, Sarat↗
DOE OSTI2024

Evaluation of Converter Performance Considering Static and Dynamic Device Part-to-Part Variability

This paper presents a methodology to incorporate and analyze the impact of semiconductor device part-to-part variation on power converter performance. By integrating extensive static and dynamic device characterization data with an automated compact model generation process that reflects manufacturing variability, device models with inherent variability features are utilized in converter simulations for a comprehensive assessment of performance impacts. The traditional converter performance evaluation process typically yields fixed efficiency values, often dismissing the inherent part-to-part variability caused by the manufacturing process of semiconductor devices. To address this limitation, a large population of devices was characterized to capture variations in static parameters-such as transfer, output, and capacitance characteristics-as well as dynamic behaviors, including switching losses. This data-driven approach enables the development of individual compact models, which were then integrated into converter simulations to evaluate efficiency ranges rather than single point estimated values. The converter simulation results show that part-to-part component variation can lead to significant efficiency deviations, exceeding several percentage points in high-power conversion applications. By offering a more accurate representation of converter behavior under real-world manufacturing conditions, this methodology enables designers to anticipate performance variability, improving the robustness of power converter designs.

device characterization↗
DOE OSTI2023

Aviation Mission Profile Performance Evaluation in a High Specific Power Surface Permanent Magnet Machine with Additively Manufactured Coils and Integrated Heat Pipes

The purpose of this paper is to accurately evaluate the performance and overall efficiency of an electrical machine driving a propeller (as a part of a hybrid or electric propulsion system) during the flight mission profile using electromagnetic-thermal simulations. The study focuses on a 250 kW, 5000 rpm, 1.25 kHz, 36/30 slot/pole surface permanent magnet (SPM) machine with additively manufactured (AM) hollow conductors and integrated heat pipes (HP). The machine drive parameters (frequency, and current) are tuned to maximize the efficiency for a given flight cycle, while providing the highest specific power (SP) during takeoff. Afterward using Multiphysics simulations, the transient thermal behavior of the machine is studied and temperature profile for different parts of the machine is extracted. Finally, steady-state temperatures during cruising are estimated and overall efficiency is re-evaluated.

additive manufacturing↗