Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ambiguities”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Towards Automated Reasoning Chains for Verification of LLM-Generated Scientific Code

With the rise of Large Language Model (LLM) generated code, including in domains like scientific computing, ensuring not only syntactical, but also mathematical correctness, has become a critical task. Traditional formal methods approaches often struggle with the ambiguity of floating-point code, and full symbolic execution is extremely costly and limited. We propose a chain-of-reasoning approach that iteratively lifts basic semantics from code into the SPIRAL system and then establishes numerical equivalency to the desired mathematical operation. Here, we leverage the ample mathematical knowledge already formalized in SPIRAL to enable the system to recognize not just different implementations of the same algorithm but fully separate approaches to solving the given problem. The chain establishes tight error bounds on the output of given code with respect to the true continuous solution it approximates, quantifying all sources of error. We demonstrate this approach by establishing the correctness of a pseudospectral solver for a simple 1-dimensional Poisson problem.

Oschatz, Quentin [Carnegie Mellon University,Pitts↗
DOE OSTI2021

Quantitative Evaluation of Autonomous Driving in CARLA

There has been a great deal of recent advancements in end-to-end imitation and reinforcement learning for self-driving vehicles. Despite this, there is a severe lack of standardized metrics for evaluating the performance of autonomous self-driving agents. Existing metrics are generally lacking in their ability to capture a wide range of driving behaviors and compare the severity of different failure cases. In this work, we introduce the Quantitative Evaluation for Driving metric, or QED, which assigns a quantitative score from 0-100 that captures the quality of driving for any driving agent. Our QED metric assesses different aspects of driving behavior including the ability to stay in the center of the lane, avoid weaving and erratic behavior, follow the speed limit, and avoid collisions, and it can be used under a wide range of driving scenarios. To show the effectiveness of our QED metric, we compare the scores generated by QED against scores assigned by human evaluators on a total of 30 different drivers and 6 different towns in the CARLA driving simulator. In ``easy'' evaluation scenarios, where it is relatively straightforward to distinguish better drivers from worse drivers, QED attains an average Pearson correlation of 0.96 and average Spearman correlation of 0.97 when compared against human evaluators. In ``hard'' evaluation scenarios, where it is far more ambiguous how to rank/score different types of bad driving behavior, QED attains an average Pearson correlation of 0.82 and average Spearman correlation of 0.75 when compared against human evaluators, which are both slighter higher than when we compare human evaluators against each other. While QED may not capture every characteristic that defines good driving, we consider it an important foundation for reproducibility and standardization in the community.

Gao, Shang↗
DOE OSTI2025

Postearthquake Damage Mapping via Remote Sensing: Lessons From the 2023 Türkiye Disaster

This review addresses the urgent need for scalable, accurate, and reproducible remote sensing solutions following the February 2023 Türkiye earthquakes. It synthesizes the contributions of five peer-reviewed studies published in the IEEE JSTARS Special Issue on postearthquake damage and risk assessment. These studies cover areas such as damage classification with deep learning, fusion of multisource remote sensing data, creation of benchmark datasets, detailed damage mapping, and analysis of geophysical signals using outgoing longwave radiation. The article summarizes the methodological approaches and the practical relevance of the reviewed studies for detecting, evaluating, and quantifying damage, and outlines key challenges, including model generalization, class ambiguity, and data integration. It also discusses emerging trends, including explainable artificial intelligence, multimodal data fusion, and open-data platforms. This synthesis provides a foundation for building robust, interpretable, and real-time disaster response systems and aims to guide future research in earthquake-related Earth observation and rapid damage assessment.

Taskin, Gulsen [Istanbul Technical University] (OR↗
DOE OSTI2024

Revealing Decision Conservativeness Through Inverse Distributionally Robust Optimization

This paper introduces Inverse Distributionally Robust Optimization (I-DRO) as a method to infer the conservativeness level of a decision-maker, represented by the size of a Wasserstein metric-based ambiguity set, from the optimal decisions made using Forward Distributionally Robust Optimization (F-DRO). By leveraging the Karush-Kuhn-Tucker (KKT) conditions of the convex F-DRO model, we formulate I-DRO as a bi-linear program, which can be solved using off-the-shelf optimization solvers. Additionally, this formulation exhibits several advantageous properties. We demonstrate that I-DRO not only guarantees the existence and uniqueness of an optimal solution but also establishes the necessary and sufficient conditions for this optimal solution to accurately match the actual conservativeness level in F-DRO. Furthermore, we identify three extreme scenarios that may impact I-DRO effectiveness. Our case study applies F-DRO for power system scheduling under uncertainty and employs I-DRO to recover the conservativeness level of system operators. Numerical experiments based on an IEEE 5-bus system and a realistic NYISO 11-zone system demonstrate I-DRO performance in both normal and extreme scenarios. An extended version of this paper with additional analyses is available at li2024revealing.

distributionally robust optimization↗
DOE OSTI2021

A Confidence-Guided Technique for Tracking Time-Varying Features

Application scientists often employ feature tracking algorithms to capture the temporal evolution of various features in their simulation data. However, as the complexity of the scientific features is increasing with the advanced simulation modeling techniques, quantification of reliability of the feature tracking algorithms is becoming important. One of the desired requirements for any robust feature tracking algorithm is to estimate its confidence during each tracking step so that the results obtained can be interpreted without any ambiguity. To address this, we develop a confidence-guided feature tracking algorithm that allows reliable tracking of user-selected features and presents the tracking dynamics using a graph-based visualization along with the spatial visualization of the tracked feature. Here, the efficacy of the proposed method is demonstrated by applying it to two scientific datasets containing different types of time-varying features.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Composite Power System Reliability with Renewables and Customer Flexibility

Composite Power System Reliability is defined as the computational procedure that quantifies the probability that the power system will perform the function of delivering electric power to customers adequately, on a continuous basis and with an acceptable quality. This definition leaves many details undefined and exemplifies the ambiguity in reliability analysis. The increasing deployment of wind and PV creates additional uncertainties that make reliability analysis a rather complex issue. Because of increased uncertainty the need for composite reliability analysis and utilization of results in power system planning is critical. New approaches are emerging for dealing with these problems from the operational point of view, including demand response programs, tapping on customer and distributed resource flexibility and new control approaches. The key question to be addressed is: how the new operational paradigms affect composite power system reliability. Here, this paper presents the ongoing work of the IEEE Composite System Reliability Task Force of the IEEE PES Reliability, Risk, Probability Application (RRPA) Subcommittee.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

First Principles Predictions of SnO2/CdTe and SnO2/CdCl2/CdTe Interface Structures

Interfaces become increasingly the limiting factor of solar cell efficiency, raising the interest in computational models. However, explicit atomic structure models from microscopy are rare, and hypothetical assumptions about the atomic structure become ambiguous for incoherent or highly lattice mismatched interfaces. Adopting a bulk crystal structure prediction algorithm to interfacial systems enables explicit structure models for the bare and CdCl 2 treated SnO 2 /CdTe interface.

CdTe↗
DOE OSTI2022

Tackling the Challenges in Scene Graph Generation With Local-to-Global Interactions

In this work, we seek new insights into the underlying challenges of the scene graph generation (SGG) task. Quantitative and qualitative analysis of the visual genome (VG) dataset implies: 1) ambiguity: even if interobject relationship contains the same object (or predicate), they may not be visually or semantically similar; 2) asymmetry: despite the nature of the relationship that embodied the direction, it was not well addressed in previous studies; and 3) higher-order contexts: leveraging the identities of certain graph elements can help generate accurate scene graphs. Motivated by the analysis, we design a novel SGG framework, Local-to-global interaction networks (LOGINs). Locally, interactions extract the essence between three instances of subject, object, and background, while baking direction awareness into the network by explicitly constraining the input order of subject and object. Globally, interactions encode the contexts between every graph component (i.e., nodes and edges). Finally, Attract and Repel loss is utilized to fine-tune the distribution of predicate embeddings. By design, our framework enables predicting the scene graph in a bottom-up manner, leveraging the possible complementariness. To quantify how much LOGIN is aware of relational direction, a new diagnostic task called Bidirectional Relationship Classification (BRC) is also proposed. Overall, experimental results demonstrate that LOGIN can successfully distinguish relational direction than existing methods (in BRC task), while showing state-of-the-art results on the VG benchmark (in SGG task).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Formal Definitions and Performance Comparison of Consistency Models for Parallel File Systems

The semantics of HPC storage systems are defined by the consistency models to which they abide. Storage consistency models have been less studied than their counterparts in memory systems, with the exception of the POSIX standard and its strict consistency model. The use of POSIX consistency imposes a performance penalty that becomes more significant as the scale of parallel file systems increases and the access time to storage devices, such as node-local solid storage devices, decreases. While some efforts have been made to adopt relaxed storage consistency models, these models are often defined informally and ambiguously as by-products of a particular implementation. Here in this work, we establish a connection between memory consistency models and storage consistency models and revisit the key design choices of storage consistency models from a high-level perspective. Further, we propose a formal and unified framework for defining storage consistency models and a layered implementation that can be used to easily evaluate their relative performance for different I/O workloads. Finally, we conduct a comprehensive performance comparison of two relaxed consistency models on a range of commonly seen parallel I/O workloads, such as checkpoint/restart of scientific applications and random reads of deep learning applications. We demonstrate that for certain I/O scenarios, a weaker consistency model can significantly improve the I/O performance. For instance, in small random reads that are typically found in deep learning applications, session consistency achieved a 5x improvement in I/O bandwidth compared to commit consistency, even at small scales.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Examining the Economic Optimality of Automatic Generation Control

The automatic generation control (AGC) system is temporally situated between economic dispatch and synchronous generator dynamics, and its primary role is to regulate frequency within and tie-line flows between control areas. Given appropriate choice of participation factors (feed-forward controller gains that govern the disaggregation of the area-level power requirement to individual generators), the AGC can be engineered to nudge system dynamics toward a steady-state operating point corresponding to economic optimality. This paper establishes necessary and sufficient conditions under which a widely accepted choice of participation factors guarantees the alignment of steady-state synchronous generator outputs with a global minimum of a prototypical economic dispatch problem. In so doing, it resolves several ambiguities and formalizes technical assumptions governing the role of the standard AGC architecture in the context of economic dispatch and steady-state operation. Numerical case studies tailored to a modified version of the New England 39-bus 10-machine test system validate the theoretical results.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Robust Restoration From Cyber-Physical Attacks in Active Distribution Grids With Grid-Edge IBRs

The inverter-based resources (IBRs) have enabled the integration of renewable energy at the grid edge with enhanced control capabilities to support the reliable operation of power grids. Different control frameworks, such as hierarchical or distributed architecture, have been proposed with the expansion of cyber networks for real-time monitoring and control. This evolution of critical infrastructure into cyber-physical systems also brings more vulnerabilities for the broadened attack surfaces, and significantly increases the possibility of physical system failures or outages caused by cyberattacks. Among tremendous efforts in the defense-in-depth approach, it remains challenging to provide prompt detection and accurate location of attack entry points or paths. Therefore, the prevailing restoration framework may struggle to fully consider the cyber-physical interdependence, successfully isolate the compromised cyber and physical components, and safely recover the systems without the potential risks leading to secondary outages. This paper is motivated to develop a cyber-physical restoration framework for distribution grids to recover from cyber attacks by harnessing grid-edge IBRs. The framework is first built on the operational guidelines of IBRs considering the compromised cyber layer. Then, an ambiguity set is established to represent the uncertainty of attack scenarios and their possibility levels. Next, a distributionally robust optimization model is developed to provide the optimal load restoration strategy across all scenarios. The effectiveness of the proposed model is demonstrated through various use cases on the modified IEEE 13-node and 123-node test systems. Finally, simulation results demonstrate the effectiveness and advancement of developed post-attack restoration strategies.

Cybersecurity↗
DOE OSTI2021

FTK: A Simplicial Spacetime Meshing Framework for Robust and Scalable Feature Tracking

In this work, we present the Feature Tracking Kit (FTK), a framework that simplifies, scales, and delivers various feature-tracking algorithms for scientific data. The key of FTK is our simplicial spacetime meshing scheme that generalizes both regular and unstructured spatial meshes to spacetime while tessellating spacetime mesh elements into simplices. The benefits of using simplicial spacetime meshes include (1) reducing ambiguity cases for feature extraction and tracking, (2) simplifying the handling of degeneracies using symbolic perturbations, and (3) enabling scalable and parallel processing. The use of simplicial spacetime meshing simplifies and improves the implementation of several feature-tracking algorithms for critical points, quantum vortices, and isosurfaces. As a software framework, FTK provides end users with VTK/ParaView filters, Python bindings, a command line interface, and programming interfaces for feature-tracking applications. We demonstrate use cases as well as scalability studies through both synthetic data and scientific applications including tokamak, fluid dynamics, and superconductivity simulations. We also conduct end-to-end performance studies on the Summit supercomputer. FTK is open sourced under the MIT license: https://github.com/hguo/ftk.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Clarifying Terminology in Microbial Ecology: A Call for Precision in Scientific Communication

The rapid evolution of microbiology as a field of research has led to the introduction of new terminology and the adaptation of existing terms. However, inconsistencies in the use of these terms, including variations across different scientific disciplines, can lead to confusion and miscommunication within the scientific community. This article discusses the importance of precise terminology in microbiome research, highlighting examples where terms have been misused or redefined without clear justification. We also present a list of frequently used terms in microbial ecology along with their specific definitions. We argue that the misuse of terminology can hinder scientific progress by creating ambiguity and misunderstanding. To address this, we propose a set of guidelines for the consistent use of key terms and provide clear definitions for some of the most commonly misused or newly introduced terms in the field. The definitions provided herein will also function as a guide for young researchers new to the field of microbial ecology. Accurate and consistent use of terminology is crucial for effective communication and collaboration in microbiology research. By adhering to standardised definitions, researchers can ensure that their work is clearly communicated and contributes meaningfully to the progress of science.

definitions↗
DOE OSTI2024

A method for crystallographic mapping of an alpha-beta titanium alloy with nanometre resolution using scanning precession electron diffraction and open-source software libraries

An approach for the crystallographic mapping of two-phase alloys on the nanoscale using a combination of scanned precession electron diffraction and open-source python libraries is introduced in this paper. This method is demonstrated using the example of a two-phase α/β titanium alloy. The data were recorded using a direct electron detector to collect the patterns, and recently developed algorithms to perform automated indexing and analyse the crystallography from the results. Very high-quality mapping is achieved at a 3 nm step size. The results show the expected Burgers orientation relationships between the α laths and β matrix, as well as the expected misorientations between α laths. A minor issue was found that one area was affected by 180° ambiguities in indexing occur due to this area being aligned too close to a zone axis of the α with twofold projection symmetry (not present in 3D) in the zero-order Laue Zone, and this should be avoided in data acquisition in the future. Nevertheless, this study demonstrates a good workflow for the analysis of nanocrystalline two- or multi-phase materials, which will be of widespread use in analysing two-phase titanium and other systems and how they evolve as a function of thermomechanical treatments.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Phylogenomic analysis of the hemp family (Cannabaceae) reveals deep cyto‐nuclear discordance and provides new insights into generic relationships

Abstract Cannabaceae are a relatively small family of angiosperms, but they include several species of huge economic and cultural significance: marijuana or hemp ( Cannabis sativa ) and hops ( Humulus lupulus ). Previous phylogenetic studies have clarified the most deep relationships in Cannabaceae, but relationships remain ambiguous among several major lineages. Here, we sampled 82 species representing all genera of Cannabaceae and utilized a new dataset of 90 nuclear genes and 82 chloroplast loci from Hyb‐Seq to investigate the phylogenomics of Cannabaceae. Nuclear phylogenetic analyses revealed a robust and consistent backbone for Cannabaceae. We observed nuclear gene‐tree conflict at several deep nodes in inferred species trees, also cyto‐nuclear discordance concerning the relationship between Gironniera and Lozanella and the relationships among Trema s.l. (including Parasponia ), Cannabis + Humulus , and Chaetachme + Pteroceltis . Coalescent simulations and network analyses suggest that observed deep cyto‐nuclear discordances were most likely to stem from incomplete lineage sorting (ILS); nuclear gene‐tree conflict might be caused by both ILS and gene flow between species. All genera of Cannabaceae were recovered as monophyletic, except for Celtis , which consisted of two distinct clades: Celtis I (including most Celtis species) and Celtis II (including Celtis gomphophylla and Celtis schippii ). We suggest that Celtis II should be recognized as the independent genus Sparrea based on both molecular and morphological evidence. Our work provides the most comprehensive and reliable phylogeny to date for Cannabaceae, enabling further exploration of evolutionary patterns across this family and highlighting the necessity of comparing nuclear with chloroplast data to examine the evolutionary history of plant groups.

Plant Sciences↗
DOE OSTI2022

Leaf water potential measurements using the pressure chamber: Synthetic testing of assumptions towards best practices for precision and accuracy

Leaf water potential (ψ leaf ), typically measured using the pressure chamber, is the most important metric of plant water status, providing high theoretical value and information content for multiple applications in quantifying critical physiological processes including drought responses. Pressure chamber measurements of ψ leaf (ψ leafPC ) are most typical, yet, the practical complexity of the technique and of the underlying theory has led to ambiguous understanding of the conditions to optimize measurements. Consequently, specific techniques and precautions diversified across the global research community, raising questions of reliability and repeatability. Here, we surveyed specific methods of ψ leafPC from multiple laboratories, and synthesized experiments testing common assumptions and practices in ψ leafPC for diverse species: (i) the need for equilibration of previously transpiring leaves; (ii) leaf storage before measurement; (iii) the equilibration of ψ leaf for leaves on bagged branches of a range of dehydration; (iv) the equilibration of ψ leaf across the lamina for bagged leaves, and the accuracy of measuring leaves with artificially ‘elongated petioles’; (v) the need in ψ leaf measurements for bagging leaves and high humidity within the chamber; (vi) the need to avoid liquid water on leaf surfaces; (vii) the use of ‘pulse’ pressurization versus gradual pressurization; and (viii) variation among experimenters in ψ leafPC determination. Based on our findings we provide a best practice protocol to maximise accuracy, and provide recommendations for ongoing species-specific tests of important assumptions in future studies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Comparison of Thin Film Heat Flux Gauge Technologies Emphasizing Continuous-Duration Operation

Abstract Thin-film heat flux gauges (HFGs) have been used for decades to measure surface temperatures and heat flux in test turbines with the majority being used in facilities that are short-duration. These gauges are typically composed of two resistive temperature devices deposited on opposing sides of a dielectric. However, because these sensors have been traditionally applied for measurements in transient-type facilities, the challenges facing adaptation of this technology for a steady facility warrant investigation. These challenges are highlighted, and the solutions are presented throughout the paper. This paper describes the nanofabrication process for heat flux gauges and a new calibration method to address the potential deterioration of gauges over long runtimes in continuous-duration facilities. Because the primary uncertainty of these sensors arises from the ambiguity of the thermal properties, the emphasis is placed on the property determination. Also, this paper presents a discussion on the use of impulse response theory to process the data showing the feasibility of the method for steady-duration facilities after an initial settling time. The latter portion of the paper focuses on comparing well-established heat flux gauges developed for short-duration turbine test facilities to recently developed gauges fabricated using modern nanofabrication techniques for a continuous turbine test facility. The gauges were compared using the test case of an impinging jet over a range of Reynolds numbers. The comparison between the PSU gauge and the reference device indicated agreement within 14%, and similar results were achieved through comparison with established sensors from partner institutions.

Engineering↗
DOE OSTI2021

Inverse Design of Two-Dimensional Airfoils Using Conditional Generative Models and Surrogate Log-Likelihoods

Abstract This paper shows how to use conditional generative models in two-dimensional (2D) airfoil optimization to probabilistically predict good initialization points within the vicinity of the optima given the input boundary conditions, thus warm starting and accelerating further optimization. We accommodate the possibility of multiple optimal designs corresponding to the same input boundary condition and take this inversion ambiguity into account when designing our prediction framework. To this end, we first employ the conditional formulation of our previous work BézierGAN–Conditional BézierGAN (CBGAN)—as a baseline, then introduce its sibling conditional entropic BézierGAN (CEBGAN), which is based on optimal transport regularized with entropy. Compared with CBGAN, CEBGAN overcomes mode collapse plaguing conventional GANs, improves the average lift-drag (Cl/Cd) efficiency of airfoil predictions from 80.8% of the optimal value to 95.8%, and meanwhile accelerates the training process by 30.7%. Furthermore, we investigate the unique ability of CEBGAN to produce a log-likelihood lower bound that may help select generated samples of higher performance (e.g., aerodynamic performance). In addition, we provide insights into the performance differences between these two models with low-dimensional toy problems and visualizations. These results and the probabilistic formulation of this inverse problem justify the extension of our GAN-based inverse design paradigm to other inverse design problems or broader inverse problems.

Engineering↗