Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Domain knowledge”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

AI-Driven Crack Detection for Remanufacturing Cylinder Heads Using Deep Learning and Engineering-Informed Data Augmentation

Detecting cracks in cylinder heads traditionally relies on manual inspection, which is time-consuming and susceptible to human error. As an alternative, automated object detection utilizing computer vision and machine learning models has been explored. However, these methods often face challenges due to a lack of sufficiently annotated training data, limited image diversity, and the inherently small size of cracks. Addressing these constraints, this paper introduces a novel automated crack-detection method that enhances data availability through a synthetic data generation technique. Unlike general data augmentation practices, our method involves copying cracks from one location to another, guided by both random and informed engineering decisions about likely crack formations due to cyclic thermomechanical loads. The innovative aspect of our approach lies in the integration of domain-specific engineering knowledge into the synthetic generation process, which substantially improves detection accuracy. We evaluate our method’s effectiveness using two metrics: the F2 score, which emphasizes recall to prioritize detecting all potential cracks, and mean average precision (MAP), a standard measure in object detection. Experimental results demonstrate that, without engineering insights, our method increases the F2 score from 0.40 to 0.65, while maintaining a stable MAP. Incorporating detailed engineering knowledge further enhances the F2 score to 0.70 and improves MAP to 0.57, representing increases of 63% and 43%, respectively. These results confirm that our approach not only mitigates the limitations of traditional data augmentation but also significantly advances the reliability and precision of crack detection in industrial settings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Transformers and Long Short-Term Memory Transfer Learning for GenIV Reactor Temperature Time Series Forecasting

Automated monitoring of the coolant temperature can enable autonomous operation of generation IV reactors (GenIV), thus reducing their operating and maintenance costs. Automation can be accomplished with machine learning (ML) models trained on historical sensor data. However, the performance of ML usually depends on the availability of large amount of training data, which is difficult to obtain for GenIV, as this technology is still under development. We propose the use of transfer learning (TL), which involves utilizing knowledge across different domains, to compensate for this lack of training data. TL can be used to create pre-trained ML models with data from small-scale research facilities, which can then be fine-tuned to monitor GenIV reactors. In this work, we develop pre-trained Transformer and long short-term memory (LSTM) networks by training them on temperature measurements from thermal hydraulic flow loops operating with water and Galinstan fluids at room temperature at Argonne National Laboratory. The pre-trained models are then fine-tuned and re-trained with minimal additional data to perform predictions of the time series of high temperature measurements obtained from the Engineering Test Unit (ETU) at Kairos Power. The performance of the LSTM and Transformer networks is investigated by varying the size of the lookback window and forecast horizon. The results of this study show that LSTM networks have lower prediction errors than Transformers, but LSTM errors increase more rapidly with increasing lookback window size and forecast horizon compared to the Transformer errors.

LSTM↗
DOE OSTI2021

Non-TZF Protein AtC3H59/ZFWD3 Is Involved in Seed Germination, Seedling Development, and Seed Development, Interacting with PPPDE Family Protein Desi1 in Arabidopsis

Despite increasing reports on the function of CCCH zinc finger proteins in plant development and stress response, the functions and molecular aspects of many non-tandem CCCH zinc finger (non-TZF) proteins remain uncharacterized. AtC3H59/ZFWD3 is an Arabidopsis non-TZF protein and belongs to the ZFWD subfamily harboring a CCCH zinc finger motif and a WD40 domain. In this study, we characterized the biological and molecular functions of AtC3H59, which is subcellularly localized in the nucleus. The seeds of AtC3H59-overexpressing transgenic plants (OXs) germinated faster than those of wild type (WT), whereas atc3h59 mutant seeds germinated slower than WT seeds. AtC3H59 OX seedlings were larger and heavier than WT seedlings, whereas atc3h59 mutant seedlings were smaller and lighter than WT seedlings. Moreover, AtC3H59 OX seedlings had longer primary root length than WT seedlings, whereas atc3h59 mutant seedlings had shorter primary root length than WT seedlings, owing to altered cell division activity in the root meristem. During seed development, AtC3H59 OXs formed larger and heavier seeds than WT. Using yeast two-hybrid screening, we isolated Desi1, a PPPDE family protein, as an interacting partner of AtC3H59. AtC3H59 and Desi1 interacted via their WD40 domain and C-terminal region, respectively, in the nucleus. Taken together, our results indicate that AtC3H59 has pleiotropic effects on seed germination, seedling development, and seed development, and interacts with Desi1 in the nucleus via its entire WD40 domain. To our knowledge, this is the first report to describe the biological functions of the ZFWD protein and Desi1 in Arabidopsis.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Discriminative Dimensionality Reduction using Deep Neural Networks for Clustering of LIGO Data

In this paper, leveraging the capabilities of neural networks for modeling the non-linearities that exist in the data, we propose several models that can project data into a low dimensional, discriminative, and smooth manifold. The proposed models can transfer knowledge from the domain of known classes to a new domain where the classes are unknown. A clustering algorithm is further applied in the new domain to find potentially new classes from the pool of unlabeled data. The research problem and data for this paper originated from the Gravity Spy project which is a side project of Advanced Laser Interferometer Gravitational-wave Observatory (LIGO). The LIGO project aims at detecting cosmic gravitational waves using huge detectors. However non-cosmic, non-Gaussian disturbances known as "glitches", show up in gravitational-wave data of LIGO. This is undesirable as it creates problems for the gravitational wave detection process. Gravity Spy aids in glitch identification with the purpose of understanding their origin. Since new types of glitches appear over time, one of the objective of Gravity Spy is to create new glitch classes. Towards this task, we offer a methodology in this paper to accomplish this.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Leveraging Single-Page Applications for Seamless Scientific Workflows: DevSecOps Considerations

Single-page applications (SPAs) have become indispensable in modern frontend development, with widespread adoption in scientific applications. The process of creating a single-page web application development environment which accurately reflects the production environment isn’t always straightforward. Most SPA build systems assume configuration at build time, while DevSecOps engineers prefer runtime configuration. This paper suggests a framework-agnostic approach to address issues that encompass both development and deployment, but are difficult to tackle without knowledge in both domains.

Drane, Lance↗
DOE OSTI2024

Interdisciplinary Approaches to Cyber-vulnerability Impact Assessment for Energy Critical Infrastructure

As energy infrastructure becomes more interconnected, understanding cybersecurity risks to production systems requires integrating operational and computer security knowledge. We interviewed 18 experts working in the field of energy critical infrastructure to compare what information they find necessary to assess the impact of computer vulnerabilities on energy operational technology. These experts came from two groups: 1) computer security experts and 2) energy sector operations experts. We find that both groups responded similarly for general categories of information and displayed knowledge about both domains, perhaps due to their interdisciplinary work at the same organization. Yet, we found notable differences in the details of their responses and in their stated perceptions of each group’s approaches to impact assessment. Their suggestions for collaboration across domains highlighted how these two groups can work together to help each other secure the energy grid. Our findings inform the development of interdisciplinary security approaches in critical-infrastructure contexts.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

OpenStudio Development, Maintenance, and Support

BEM is a key decision support tool for energy efficiency, demand flexibility, and electrification at the building and building stock levels. The OpenStudio SDK maximizes the value of BEM by enhancing the productivity, consistency, and transparency with which it is applied. OpenStudio enables BEM experts to encapsulate domain and process knowledge in such a way that makes it usable by a range of stakeholders.

BEM↗
DOE OSTI2020

OpenK: An Open Infrastructure for the Accumulation, Sharing and Reuse of High Performance Computing Knowledge

In high performance computing (HPC), often a wide range of knowledge about the particular domains, software applications, and hardware architectures are necessary for applying the right optimizations in the appropriate contexts. In today’s practice, however, such knowledge has been expressed and managed in an ad-hoc manner by each individual. Systematic accumulation, sharing and reuse of the knowledge across a broad community has been difficult. This paper introduces OpenK, an ontology-based open infrastructure for solving the problem. By centering around ontology – a generic knowledge representation – and extensible designs, it offers a promising support for lowering the barriers.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Cross-Domain Reasoning for Neuromorphic Model Design

Designing performant neuromorphic models requires reasoning across neuroscience, neuromorphic computing, and machine learning, making it a natural target for cross-domain hypothesis generation. Our primary contribution is a multi-corpus knowledge graph spanning all three domains, which we show substantially increases cross-domain retrieval novelty over single-corpus baselines. We additionally introduce NeuKReAct, an agentic reasoning framework that iteratively retrieves from this graph and synthesizes design hypotheses via a step-by-step blackboard architecture, enabling structured compartmentalization of design decisions. Lastly, we introduce an execution head that translates hypotheses into structured design documents and runnable code. We evaluate novelty using a combinatorial creativity metric that measures cross-domain retrieval distance across the citation graph. Our results confirm that corpus breadth is the dominant driver of novelty. Moreover, we highlight a concrete instance of the novelty-utility tradeoff within NeuKReAct, underscoring a need for joint creativity evaluation, balancing both novelty and utility.

Ramavarapu, Vikram [ORNL] (ORCID:0009000188757213)↗
DOE OSTI2022

Transfer Learning-Based Independent Component Analysis

Understanding the underlying component structure is crucial for multivariate signal analysis. Among all the techniques that try to learn the latent structure, independent component analysis (ICA) is one of the most important and popular methods, which aims to extract independent components from multivariate signals and enables further analysis. For example, in electroencephalogram (EEG) analysis, artifacts filtering and disease detection are conducted based on the independent components of the signals. One critical challenge in existing ICA approaches is that the component extraction accuracy may degrade when the available data of a unit are limited. To address this issue, this paper proposes a transfer learning-based ICA method by innovatively transferring component distribution from a source domain, so that accurate component extraction results can be achieved even when only limited data are available in the target domain. To the best of our knowledge, this is the first work that leverages transfer learning to improve ICA accuracy with limited available data. In particular, we first extract all the independent components from the source domain by maximizing the log-likelihood function with a Newton-like method on a smooth manifold. Then for the target domain, the component with the largest negentropy is extracted in each round. To effectively leverage the knowledge from the source domain and to prevent the negative transfer, we try to find a component in the source domain that matches the component we are extracting. The probability density function of the matched component will then be used to improve the component extraction accuracy if such matched component can be found; otherwise, no knowledge will be transferred. Finally, numerical simulations and a case study with electrocardiogram (ECG) data are conducted, showing the effectiveness of the proposed method in transferring knowledge and reducing negative transfer.

42 ENGINEERING↗
DOE OSTI2023

A time-dependent momentum-resolved scattering approach to core-level spectroscopies

While new light sources allow for unprecedented resolution in experiments with X-rays, a theoretical understanding of the scattering cross-section is lacking. In the particular case of strongly correlated electron systems, numerical techniques are quite limited, since conventional approaches rely on calculating a response function (Kramers-Heisenberg formula) that is obtained from a perturbative analysis of scattering processes in the frequency domain. This requires a knowledge of a full set of eigenstates in order to account for all intermediate processes away from equilibrium, limiting the applicability to small tractable systems. In this work, we present an alternative paradigm, recasting the problem in the time domain and explicitly solving the time-dependent Schrödinger equation without the limitations of perturbation theory: a faithful simulation of the scattering processes taking place in actual experiments, including photons and core electrons. We show how this approach can yield the full time and momentum resolved Resonant Inelastic X-Ray Scattering (RIXS) spectrum of strongly interacting many-body systems. We demonstrate the formalism with an application to Mott insulating Hubbard chains using the time-dependent density matrix renormalization group method, which does not require a priory knowledge of the eigenstates and can solve very large systems with dozens of orbitals. This approach can readily be applied to systems out of equilibrium without modification and generalized to other spectroscopies.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2022

Defining upstream enhancing and inhibiting sequence patterns for plant peroxisome targeting signal type 1 using large–scale in silico and in vivo analyses

Peroxisomes are universal eukaryotic organelles essential to plants and animals. Most peroxisomal matrix proteins carry peroxisome targeting signal type 1 (PTS1), a C-terminal tripeptide. Studies from various kingdoms have revealed influences from sequence upstream of the tripeptide on peroxisome targeting, supporting the view that positive charges in the upstream region are the major enhancing elements. However, a systematic approach to better define the upstream elements influencing PTS1 targeting capability is needed. Here, we used protein sequences from 177 plant genomes to perform large-scale and in-depth analysis of the PTS1 domain, which includes the PTS1 tripeptide and upstream sequence elements. We identified and verified 12 low-frequency PTS1 tripeptides and revealed upstream enhancing and inhibiting sequence patterns for peroxisome targeting, which were subsequently validated in vivo. Follow-up analysis revealed that nonpolar and acidic residues have relatively strong enhancing and inhibiting effects, respectively, on peroxisome targeting. However, in contrast to the previous understanding, positive charges alone do not show the anticipated enhancing effect and that both the position and property of the residues within these patterns are important for peroxisome targeting. We further demonstrated that the three residues immediately upstream of the tripeptide are the core influencers, with a ‘basic-nonpolar-basic’ pattern serving as a strong and universal enhancing pattern for peroxisome targeting. These findings have significantly advanced our knowledge of the PTS1 domain in plants and likely other eukaryotic species as well. The principles and strategies employed in the present study may also be applied to deciphering auxiliary targeting signals for other organelles.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Suppressing simulation bias in multi-modal data using transfer learning

Abstract Many problems in science and engineering require making predictions based on few observations. To build a robust predictive model, these sparse data may need to be augmented with simulated data, especially when the design space is multi-dimensional. Simulations, however, often suffer from an inherent bias. Estimation of this bias may be poorly constrained not only because of data sparsity, but also because traditional predictive models fit only one type of observed outputs, such as scalars or images, instead of all available output data modalities, which might have been acquired and simulated at great cost. To break this limitation and open up the path for multi-modal calibration, we propose to combine a novel, transfer learning technique for suppressing the bias with recent developments in deep learning, which allow building predictive models with multi-modal outputs. First, we train an initial neural network model on simulated data to learn important correlations between different output modalities and between simulation inputs and outputs. Then, the model is partially retrained, or transfer learned, to fit the experiments; a method that has never been implemented in this type of architecture. Using fewer than 10 inertial confinement fusion experiments for training, transfer learning systematically improves the simulation predictions while a simple output calibration, which we design as a baseline, makes the predictions worse. We also offer extensive cross-validation with real and carefully designed synthetic data. The method described in this paper can be applied to a wide range of problems that require transferring knowledge from simulations to the domain of experiments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2026

Multi-scale structural analysis of swift heavy ion-irradiated ZrO 2 and HfO 2

The radiation-induced monoclinic-to-tetragonal phase transition in ZrO 2 and HfO 2 has been the subject of many investigations, but the transformation pathways and underlying structural mechanisms are still not well understood. In this study, microcrystalline powder samples of ZrO 2 and HfO 2 were irradiated with 946 MeV and 1470 MeV Au ions to a wide fluence range up to 3 × 10 13 ions/cm 2 . To characterize beam-induced structural modifications across all spatial length scales, complementary experimental techniques such as synchrotron X-ray diffraction and spallation neutron total scattering were used. The phase evolution of the tetragonal polymorph with increasing ion fluence is accurately described by a heterogeneous track-overlap model that incorporates both direct- and double-impact processes. These damage accumulation processes are an expression of a core-shell ion track morphology that depends on irradiation conditions and target material. Neutron pair distribution function analysis revealed that ion-beam-induced tetragonal ZrO 2 is merely a configurational average of short-range orthorhombic (Pbcn) domains stabilized by a dense network of domain walls. Furthermore, this knowledge is critical for a better understanding of how crystalline-to-crystalline phase transformations proceed at the atomic scale under extreme conditions.

Monoclinic-to-tetragonal phase transformation↗
DOE OSTI2024

CEERP SM3 Research, Monitoring, and Evaluation Workshop: Summary Report

The Columbia Estuary Ecosystem Restoration Program (CEERP) workshop, “CEERP Synthesis Memorandum (SM3): Research, Monitoring, and Evaluation,” was held in Portland, Oregon on June 24–25 2024. A diverse group of 26 domain experts with demonstrated knowledge and experience working in the Lower Columbia River Estuary (LCRE) participated. The workshop supported development of the forthcoming third Synthesis Memorandum for CEERP. The workshop furthered the collaborative understanding of the state of the science regarding the LCRE, helped to identify remaining knowledge gaps and uncertainties, and assisted in the prioritization of future restoration research and monitoring.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Distributed IELI, Rebuilding IELI for Scalability

IELI is an NLP-based system designed to transform text into structured knowledge graphs, integrate domain-specific ontologies, and answer conceptual logic-based queries. This poster talks about how redesigning IELI can help address scalability and modularity challenges, as well as improving responsiveness and health monitoring of the system.

Trejo, Edwin Horacio [Sandia National Laboratories↗
DOE OSTI2026

Sim-to-real supervised domain adaptation for radioisotope identification

Machine learning has the potential to improve the speed and reliability of radioisotope identification using gamma spectroscopy. However, meticulously labeling an experimental dataset for training is often prohibitively expensive, while training models purely on synthetic data is risky due to the domain gap between simulated and experimental measurements. In this research, we demonstrate that supervised domain adaptation can substantially improve the performance of radioisotope identification models by transferring knowledge between synthetic and experimental data domains. We consider two domain adaptation scenarios: (1) a simulation-to-simulation adaptation, where we perform multi-label proportion estimation using simulated high-purity germanium detectors, and (2) a simulation-to-experimental adaptation, where we perform multi-class, single-label classification using measured spectra from handheld lanthanum bromide (LaBr) and sodium iodide (NaI) detectors. We begin by pretraining a spectral classifier on synthetic data using a custom transformer-based neural network. After subsequent fine-tuning on just 64 labeled experimental spectra, we achieve a test accuracy of 96% in the sim-to-real scenario with a LaBr detector, far surpassing a synthetic-only baseline model (75%) and a model trained from scratch (80%) on the same 64 spectra. Furthermore, we demonstrate that domain-adapted models learn more human-interpretable features than experiment-only baseline models. Overall, our results highlight the potential for supervised domain adaptation techniques to bridge the sim-to-real gap in radioisotope identification, enabling the development of accurate and explainable classifiers even in real-world scenarios where access to experimental data is limited.

Lalor, Peter W.↗