Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “knowledge extraction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Causality Extraction from Nuclear Licensee Event Reports Using a Hybrid Framework

In this paper, we proposed a hybrid framework for causality detection and extraction in LER documents. The main contributions are summarized below. We 1) built an LER corpus with 20,129 text samples for causality analysis, 2) developed an interactive tool was developed for labeling cause-effect pairs, 3) built a deep learning-based approach for causal relation detection, and 4) built a knowledge-based cause-effect extraction approach.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2024

Improvement and generalization of ABCD method with Bayesian inference

To find New Physics or to refine our knowledge of the Standard Model at the LHC is an enterprise that involves many factors, such as the capabilities and the performance of the accelerator and detectors, the use and exploitation of the available information, the design of search strategies and observables, as well as the proposal of new models. We focus on the use of the information and pour our effort in re-thinking the usual data-driven ABCD method to improve it and to generalize it using Bayesian Machine Learning techniques and tools. We propose that a dataset consisting of a signal and many backgrounds is well described through a mixture model. Signal, backgrounds and their relative fractions in the sample can be well extracted by exploiting the prior knowledge and the dependence between the different observables at the event-by-event level with Bayesian tools. We show how, in contrast to the ABCD method, one can take advantage of understanding some properties of the different backgrounds and of having more than two independent observables to measure in each event. In addition, instead of regions defined through hard cuts, the Bayesian framework uses the information of continuous distribution to obtain soft-assignments of the events which are statistically more robust. To compare both methods we use a toy problem inspired by pp\to hh\to b\bar b b \bar b p p → h h → b b ‾ b b ‾ , selecting a reduced and simplified number of processes and analysing the flavor of the four jets and the invariant mass of the jet-pairs, modeled with simplified distributions. Taking advantage of all this information, and starting from a combination of biased and agnostic priors, leads us to a very good posterior once we use the Bayesian framework to exploit the data and the mutual information of the observables at the event-by-event level. We show how, in this simplified model, the Bayesian framework outperforms the ABCD method sensitivity in obtaining the signal fraction in scenarios with 1% and 0.5% true signal fractions in the dataset. We also show that the method is robust against the absence of signal. We discuss potential prospects for taking this Bayesian data-driven paradigm into more realistic scenarios.

Alvarez, Ezequiel↗
DOE OSTI2026

Agentic traffic intelligence: Augmented human-in-the-loop scenario generation for microscopic traffic simulation

Traditional microscopic traffic simulation generation often relies on static datasets and manual design, limiting its ability to simulate complex conditions easily. This paper presents a novel framework, Agentic Traffic Intelligence, which combines human approval large language models (LLMs), the Real-Twin tool, and multi-agent systems to perform realistic microscopic traffic simulation scenario generation. The proposed framework incorporates human-in-the-loop (HIL) control, retrieval-augmented generation (RAG), and multi-agent control mechanisms. HIL mechanisms are used to guide multiple LLMs focused on attributes for microscopic simulation generation and to improve the interpretability and transparency of LLM execution for users. RAG enhances context extraction by dynamically integrating external knowledge sources for traffic scenario generation foundations. A multi-agent architecture with supervisory control coordinates the interaction of simulation components, including traffic simulators, control logic, and calibration tools. This enables the synthesis of simulation-ready scenarios that reflect dynamic demand profiles and behavior controls. Furthermore, the framework fuses multisource traffic data with unstructured context and supports iterative refinement through interactive user feedback. Validated through microscopic simulation using Simulation of Urban Mobility, the generated scenarios demonstrate high-fidelity network generation with inflow and turn movement and behavioral calibration, offering a robust and efficient tool for stress-testing and optimizing urban mobility systems.

Hierarchical multi-agent control↗
DOE OSTI2025

Elucidating the Interfacial Barriers in Lanthanide Back-Extraction: From Water to Oil and Back Again

Recovery of critical rare earth elements from complex mixtures has long been realized via solvent extraction, where ions in an aqueous phase are separated into an organic phase using amphiphilic ligands. While a great deal of effort has been placed on understanding this forward reaction, substantial knowledge gaps in the back-extraction process remain. This includes the mechanism of interfacial dissociation and transport back into a highly acidic aqueous phase for further processing. In this work, we connect back-extraction kinetics made in realistic solvent extraction systems to salient interfacial chemistry and structure that represent bottlenecks in the back-extraction of lanthanide ions. We show that the interface between the two liquid phases varies dramatically based on the composition of both phases. Water stretching signals are shown to report on the population of lingering interfacial complexes and are thus used as a reporter of competitive adsorption from excess free ligands in solution for limited interfacial vacancies. We show that excess free ligands, often used to improve forward extractions, set up interfacial blockades inhibiting back-extraction both kinetically and thermodynamically. In conclusion, this insight opens up avenues to tune interfacial properties to facilitate a more dynamic, exchangeable interface to speed up back-extractions while using less energy intensive chemical swings.

Interfaces↗
DOE OSTI2023

A rule-free workflow for the automated generation of databases from scientific literature

Abstract In recent times, transformer networks have achieved state-of-the-art performance in a wide range of natural language processing tasks. Here we present a workflow based on the fine-tuning of BERT models for different downstream tasks, which results in the automated extraction of structured information from unstructured natural language in scientific literature. Contrary to existing methods for the automated extraction of structured compound-property relations from similar sources, our workflow does not rely on the definition of intricate grammar rules. Hence, it can be adapted to a new task without requiring extensive implementation efforts and knowledge. We test our data-extraction workflow by automatically generating a database for Curie temperatures and one for band gaps. These are then compared with manually curated datasets and with those obtained with a state-of-the-art rule-based method. Furthermore, in order to showcase the practical utility of the automatically extracted data in a material-design workflow, we employ them to construct machine-learning models to predict Curie temperatures and band gaps. In general, we find that, although more noisy, automatically extracted datasets can grow fast in volume and that such volume partially compensates for the inaccuracy in downstream tasks.

36 MATERIALS SCIENCE↗
DOE OSTI2023

FrESCO

The National Cancer Institute (NCI) monitors population level cancer trends as part of its Surveillance, Epidemiology, and End Results (SEER) program. This program consists of state or regional level cancer registries which collect, analyze, and annotate cancer pathology reports. From these annotated pathology reports, each individual registry aggregates cancer phenotype information and summary statistics about cancer prevalence to facilitate population level monitoring of cancer incidence. Extracting cancer phenotype from these reports is a labor intensive task, requiring specialized knowledge about the reports and cancer. Automating this information extraction process from cancer pathology reports has the potential to improve not only the quality of the data by extracting information in a consistent manner across registries, but to improve the quality of patient outcomes by reducing the time to assimilate new data and enabling time-sensitive applications such as precision medicine. Here we present FrESCO: Framework for Exploring Scalable Computational Oncology, a modular deep-learning natural language processing (NLP) library for extracting pathology information from clinical text documents.

Spannaus, Adam [Oak Ridge National Lab. (ORNL), Oa↗
DOE OSTI2023

FrESCO: Framework for Exploring Scalable Computational Oncology

The National Cancer Institute (NCI) monitors population level cancer trends as part of its Surveillance, Epidemiology, and End Results (SEER) program. This program consists of state or regional level cancer registries which collect, analyze, and annotate cancer pathology reports. From these annotated pathology reports, each individual registry aggregates cancer phenotype information from electronic health records. This data is then used to create summary statistics about cancer incidence and mortality to facilitate population health monitoring. Extracting phenotypic information from these reports is a labor intensive task, requiring specialized knowledge about the reports and cancer. Automating the information extraction process from cancer pathology reports has the potential to improve data quality by extracting information in a consistent manner across registries. It can also improve patient outcomes by reducing the time from diagnosis, enabling rapid case ascertainment for clinical trials. Here we present FrESCO, a modular deep-learning natural language processing (NLP) library initially designed for extracting pathology information from clinical text documents. This repository is not solely limited to clinical medical text, but may also be used by researchers just getting started with NLP methods and those looking for a robust solution for their classification problems.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Data Challenges in Multi-Sensor Data Science System for Monitoring a Solvent Extraction Process

Idaho National Laboratory (INL) is maintaining and gaining knowledge into the nuclear fuel cycle by building a test bed to allow researchers the opportunity to study nuclear fuel processing operations. This includes studying solvent extraction processes that use centrifugal contactors. As part of INL’s mission, the goal of this project is to develop a system that utilizes non-traditional measurement sources such as vibration, acoustics, current, light, flow, and temperature in conjunction with data-based, machine learning techniques that will allow for signal discovery. This multisensory data can support the development of safeguards by design, provide operator process awareness, and discover process anomalies. This poster will highlight some of the data collection and analytics challenges for the multi-sensor system as well as the mitigation strategies to build a robust system. Additionally, some preliminary data from the first testing campaign will be shown to help illustrate the data needs of the system.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2022

Enhanced Oblique Decision Tree Enabled Policy Extraction for Deep Reinforcement Learning in Power System Emergency Control

Deep reinforcement learning (DRL) algorithms have successfully solved many challenging problems in various power system control scenarios. However, their decision-making process is usually regarded as black-boxes. Furthermore, how DRL models interact with human intelligence remains an open problem. Thus, this paper proposes a policy extraction framework to extract a complex DRL model into an explainable policy. This framework includes three parts: 1) DRL training and data generation. We train an agent for a specific control task and generate data, which contains the control policy of the agent. 2) Policy extraction. We propose an information gain rate based weighted oblique decision tree (IGR-WODT) for DRL policy extraction. 3) Policy evaluation. We define three metrics to evaluate the performance of the proposed approach. A case study for the under-voltage load shedding problem shows that the IGR-WODT presents a performance enhancement compared with DRL, weighted oblique decision tree, and univariate decision tree. The proposed policy extraction method could provide an intuitive explanation of the neural network decision-making process to the dispatchers when making final decisions on power grid operation. Also, the resulted rule-based controller could replace the deep neural network-based controller in many field edge devices with limited computing resources, providing comparable performance.

deep reinforcement learning↗
DOE OSTI2024

Robustness of topological persistence in knowledge distillation for wearable sensor data

Topological data analysis (TDA) has shown great success in various applications involving wearable sensor data. However, there are difficulties in leveraging topological features in machine learning and wearable sensors because of the large time consumption and computational resources required to extract the features. To address this problem, knowledge distillation (KD) is utilized to generate a small model and accommodate topological features with persistence image (PI) representations from the raw time series data. Deploying topological knowledge in KD enables the student to achieve better performance compared to the one trained solely on raw time series data. However, it is not yet known if there are coherent characteristics for topological features in PI, which can aid in improving the performance during KD. In this paper, we investigate the suitability and challenges of utilizing topological features in KD for wearable sensor data, thereby contributing to the advancement of the field. Our study explores the impact of transferred topological features by comparing the Teacher-to-Student framework with Multiple Teachers-to-Student where teachers utilize both time series data and persistence images obtained by TDA as inputs. Additionally, we conduct a rigorous examination of topological knowledge effects by testing under various corruptions, knowledge types, and learning strategies in the context of human activity recognition tasks. Our analysis of topological features in KD presents the optimal strategy for incorporating these features. This study includes datasets of varying scales, window lengths, and activity classes, providing a comprehensive evaluation. Our results demonstrate that leveraging topological features in KD to enhance performance across databases.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Pertechnetate/perrhenate–capped Zr/Hf–Dihydroxide Dimers: Elucidating Zr–TcO 4 Co–Mobility in the Nuclear Fuel Cycle

Spent nuclear fuel contains heavy element fission products that must be separated for effective reprocessing for a safe and sustainable nuclear fuel cycle. 93 Zr and 99 Tc are high-yield fission products that co-transport in liquid-liquid extraction processes. Here we seek atomic-level information of this co-extraction process, as well as fundamental knowledge about Zr IV (and Hf IV ) aqueous speciation in the presence of topology-directing ligands such as pertechnetate (TcO 4 – ) and non-radioactive surrogate perrhenate (ReO 4 – ). In this context, we show that the flat tetrameric oxyhydroxyl-cluster [M IV 4 (OH) 8 (H 2 O) 16 ] 8+ (and related polymers) is dissociated by perrhenate/pertechnetate to yield isostructural dimers, M 2 (OH) 2 (XO 4 – ) 6 (H 2 O) 6 • 3H 2 O (M=Zr/Hf IV ; X=Re/Tc VII ), elucidated by single-crystal X-ray diffraction. We used these model compounds to understand the pervasive 93 Zr- 99 Tc coextraction with further speciation studies in water, nitric acid, and tetrabutylphosphate (TBP) -kerosene; where the latter two media are relevant to nuclear fuel reprocessing. SAXS (small angle X-ray scattering), compositional evaluation, and where experimentally feasible, ESI-MS (electrospray ionization mass spectrometry) showed that perrhenate/pertechnetate influence Zr/Hf IV -speciation in water. Here, in Zr-XO 4 solvent extraction studies to simulate fuel reprocessing, we provide evidence that TcO 4 – enhances extraction of Zr IV , and compositional analysis of the extracted metal-complexes (Zr-ReO 4 study) is consistent with the crystallized Zr IV 2 (OH) 2 (Re VII O 4 – ) 6 (H 2 O) 6 •dimer.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2022

Quantum criticality using a superconducting quantum processor

Quantum criticality emerges from the collective behavior of many interacting quantum particles, often at the transition between different phases of matter. It is one of the cornerstones of condensed matter physics, which we access on noisy intermediate-scale (NISQ) quantum devices by leveraging a dynamically driven phenomenon. Here we probe the critical properties of the one-dimensional quantum Ising model on a programmable superconducting quantum chip via a Kibble-Zurek process, obtain scaling laws, and estimate critical exponents despite inherent sources of errors on the hardware. In addition, we investigate how the improvement of NISQ computers (more qubits, less noise) will consolidate the computation of those universal physical properties. A one-parameter noise model captures the effect of imperfections and reproduces the experimental data. Its systematic study reveals that the noise, analogously to temperature, induces a new length scale in the system. We introduce and successfully verify modified scaling laws, directly accounting for the noise without any prior knowledge. It makes data analyses for extracting physical properties transparent to noise. By understanding how imperfect quantum hardware modifies the genuine properties of quantum states of matter, we enhance the power of NISQ processors considerably for addressing quantum criticality and potentially other phenomena and algorithms.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2024

Elastic scattering of 3 He + 4 He with the SONIK scattering chamber

Measurements of the elastic scattering cross section of 3 He and 4 He are important in order to improve constraints on theoretical models of 4 He ⁢( 3 He ,𝛾)⁢ 7 Be, a key reaction in Big Bang nucleosynthesis and solar neutrino production. The astrophysical 𝑆 factor for this reaction is a significant source of uncertainty in the standard-solar-model prediction of the 7 Be and 8 B solar neutrino fluxes. The elastic scattering measurements reported in the literature do not extend to low energies and lack proper uncertainty quantification. A new measurement of the 4 He ⁢( 3 He, 3 He)⁢ 4 He reaction has been made at center-of-mass energies 𝐸c.m.=0.38−3.13 MeV using the Scattering of Nuclei in Inverse Kinematics (SONIK) scattering chamber: a windowless, extended gas target surrounded by an array of 30 collimated silicon charged particle detectors situated at TRIUMF. This is the first elastic scattering measurement of 3 He + 4 He made below 500 keV and it has greater angular range and better precision than previous measurements. The elastic scattering data were analyzed using both 𝑅-matrix and halo effective field theory frameworks, and values of the 𝑠-wave scattering length and effective range were extracted. Here, the resulting improvement in knowledge of the 𝑠-wave effective-range function at low energies reduces the overall uncertainty in 𝑆 34 at solar energies.

Elastic scattering reactions↗
DOE OSTI2023

Knowledge, attitudes, and practices associated with bioterrorism preparedness in healthcare workers: a systematic review

Introduction Bioterrorism is an important issue in the field of biosecurity, and effectively dealing with bioterrorism has become an urgent task worldwide. Healthcare workers are considered bioterrorism first responders, who shoulder essential responsibilities and must be equipped to deal with bioterrorism. This study aims to extract and summarize the main research components of the bioterrorism knowledge, attitude, and practice dimensions among healthcare workers. Method This study utilized a systematic review research design based on the PRISMA 2020 guidelines. A literature search was conducted in the PubMed, Web of Science, and Scopus databases for peer-reviewed literature, and the Mixed Methods Appraisal Tool (MMAT) version 2018 was used to assess the quality of the literature. Result A total of 16 studies were included in the final selection. Through the analysis and summary of the included studies, three main aspects and 14 subaspects of the knowledge dimension, three main aspects and 10 subaspects of the attitude dimension, and two main aspects and six subaspects of the practice dimension were extracted. Conclusion This study conducted a literature review on bioterrorism knowledge, attitudes, and practices for healthcare workers based on the PRISMA 2020 guidelines. The findings can guide improvements in health literacy and provide beneficial information to professional organizations that need to respond effectively to bioterrorism.

Li, Tiantian↗
DOE OSTI2024

Linking Threat Agents to Targeted Organizations: A Pipeline for Enhanced Cybersecurity Risk Metrics

In this study, we present a methodology leveraging Large Language Models (LLMs) to transform Cybersecurity Threat Intelligence (CTI) narratives into actionable insights for individual organizations. Our approach automates the extraction of machine-readable adversary SKRAM (Skills, Knowledge, Resources, Authorities, and Motivation) attributes from open-source reports, extending LLM utility beyond typical interactions. This innovation enables precise, automated assessments of cybersecurity risks posed by various adversaries. Using a chain-of-thought and multi-shot prompting strategy, our methodology advances the automation of cybersecurity feature extraction for new machine-learning models that predict the risk of adversary targeting. This approach is refined using a substantial dataset of over 150 analyst-validated threat reports and synthetic organizational data from 900 companies. Here, by bootstrapping the training data with a rule-based heuristic over synthetic data, we have developed a high-accuracy machine-learning model that allows entities to dynamically prioritize threats and defensive actions.

Cyber Threat Intelligence↗
DOE OSTI2022

Transfer Learning-Based Independent Component Analysis

Understanding the underlying component structure is crucial for multivariate signal analysis. Among all the techniques that try to learn the latent structure, independent component analysis (ICA) is one of the most important and popular methods, which aims to extract independent components from multivariate signals and enables further analysis. For example, in electroencephalogram (EEG) analysis, artifacts filtering and disease detection are conducted based on the independent components of the signals. One critical challenge in existing ICA approaches is that the component extraction accuracy may degrade when the available data of a unit are limited. To address this issue, this paper proposes a transfer learning-based ICA method by innovatively transferring component distribution from a source domain, so that accurate component extraction results can be achieved even when only limited data are available in the target domain. To the best of our knowledge, this is the first work that leverages transfer learning to improve ICA accuracy with limited available data. In particular, we first extract all the independent components from the source domain by maximizing the log-likelihood function with a Newton-like method on a smooth manifold. Then for the target domain, the component with the largest negentropy is extracted in each round. To effectively leverage the knowledge from the source domain and to prevent the negative transfer, we try to find a component in the source domain that matches the component we are extracting. The probability density function of the matched component will then be used to improve the component extraction accuracy if such matched component can be found; otherwise, no knowledge will be transferred. Finally, numerical simulations and a case study with electrocardiogram (ECG) data are conducted, showing the effectiveness of the proposed method in transferring knowledge and reducing negative transfer.

42 ENGINEERING↗
DOE OSTI2020

Machine-learned interatomic potentials by active learning: amorphous and liquid hafnium dioxide

We propose an active learning scheme for automatically sampling a minimum number of uncorrelated configurations for fitting the Gaussian Approximation Potential (GAP). Our active learning scheme consists of an unsupervised machine learning (ML) scheme coupled with a Bayesian optimization technique that evaluates the GAP model. We apply this scheme to a Hafnium dioxide (HfO 2 ) dataset generated from a "melt-quench" ab initio molecular dynamics (AIMD) protocol. Our results show that the active learning scheme, with no prior knowledge of the dataset, is able to extract a configuration that reaches the required energy fit tolerance. Further, molecular dynamics (MD) simulations performed using this active learned GAP model on 6144 atom systems of amorphous and liquid state elucidate the structural properties of HfO 2 with near ab initio precision and quench rates (i.e., 1.0 K/ps) not accessible via AIMD. The melt and amorphous X-ray structural factors generated from our simulation are in good agreement with experiment. In addition, the calculated diffusion constants are in good agreement with previous ab initio studies.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Computational tools and data integration to accelerate vaccine development: challenges, opportunities, and future directions

The development of effective vaccines is crucial for combating current and emerging pathogens. Despite significant advances in the field of vaccine development there remain numerous challenges including the lack of standardized data reporting and curation practices, making it difficult to determine correlates of protection from experimental and clinical studies. Significant gaps in data and knowledge integration can hinder vaccine development which relies on a comprehensive understanding of the interplay between pathogens and the host immune system. In this review, we explore the current landscape of vaccine development, highlighting the computational challenges, limitations, and opportunities associated with integrating diverse data types for leveraging artificial intelligence (AI) and machine learning (ML) techniques in vaccine design. We discuss the role of natural language processing, semantic integration, and causal inference in extracting valuable insights from published literature and unstructured data sources, as well as the computational modeling of immune responses. Furthermore, we highlight specific challenges associated with uncertainty quantification in vaccine development and emphasize the importance of establishing standardized data formats and ontologies to facilitate the integration and analysis of heterogeneous data. Through data harmonization and integration, the development of safe and effective vaccines can be accelerated to improve public health outcomes. Looking to the future, we highlight the need for collaborative efforts among researchers, data scientists, and public health experts to realize the full potential of AI-assisted vaccine design and streamline the vaccine development process.

60 APPLIED LIFE SCIENCES↗