Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “knowledge extraction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Combustion machine learning: Principles, progress and prospects

Progress in combustion science and engineering has led to the generation of large amounts of data from large-scale simulations, high-resolution experiments, and sensors. This corpus of data offers enormous opportunities for extracting new knowledge and insights—if harnessed effectively. Machine learning (ML) techniques have demonstrated remarkable success in data analytics, thus offering a new paradigm for data-intense analyses and scientific investigations through combustion machine learning (CombML). While data-driven methods are utilized in various combustion areas, recent advances in algorithmic developments, the accessibility of open-source software libraries, the availability of computational resources, and the abundance of data have together rendered ML techniques ubiquitous in scientific analysis and engineering. This article examines ML techniques for applications in combustion science and engineering. Starting with a review of sources of data, data-driven techniques, and concepts, we examine supervised, unsupervised, and semi-supervised ML methods. Various combustion examples are considered to illustrate and to evaluate these methods. Next, we review past and recent applications of ML approaches to problems in combustion, spanning fundamental combustion investigations, propulsion and energy-conversion systems, and fire and explosion hazards. Challenges unique to CombML are discussed and further opportunities are identified, focusing on interpretability, uncertainty quantification, robustness, consistency, creation and curation of benchmark data, and the augmentation of ML methods with prior combustion-domain knowledge.

33 ADVANCED PROPULSION SYSTEMS↗

Leveraging Large Language Models for Understanding Fundamental Principles of Catalysis

Heterogeneous catalysis presents a distinct challenge for artificial intelligence (AI). Data sets are often small and inconsistently reported, catalyst representations are not standardized, and extracting fundamental knowledge requires integrating performance data, spectroscopic characterizations, and mechanistic models across multiple scales. Language offers a unifying representation across these modalities, making catalysis well suited for leveraging large language models (LLMs). By standardizing how catalytic data is represented, LLMs make dispersed experimental results more accessible to downstream statistical modeling. In this perspective, we focus our discussion around three opportunities where LLMs can significantly contribute to catalysis: (1) text to properties; (2) text to structure; and (3) text to mechanistic models. The discussion is followed by a perspective section on LLM-readiness of data, aligning LLM outputs with scientific correctness, and bridging lab-scale discovery to industrial deployment. Across each area, the most productive applications couple dispersed chemical knowledge with physics-grounded validation to produce verifiable hypotheses and actionable representations.

Catalysts↗

Discovering equations that govern experimental materials stability under environmental stress using scientific machine learning

Abstract While machine learning (ML) in experimental research has demonstrated impressive predictive capabilities, extracting fungible knowledge representations from experimental data remains an elusive task. In this manuscript, we use ML to infer the underlying differential equation (DE) from experimental data of degrading organic-inorganic methylammonium lead iodide (MAPI) perovskite thin films under environmental stressors (elevated temperature, humidity, and light). Using a sparse regression algorithm, we find that the underlying DE governing MAPI degradation across a broad temperature range of 35 to 85 °C is described minimally by a second-order polynomial. This DE corresponds to the Verhulst logistic function, which describes reaction kinetics analogous to self-propagating reactions. We examine the robustness of our conclusions to experimental variance and Gaussian noise and describe the experimental limits within which this methodology can be applied. Our study highlights the promise and challenges associated with ML-aided scientific discovery by demonstrating its application in experimental chemical and materials systems.

36 MATERIALS SCIENCE↗

Surface enrichment dictates block copolymer orientation

Orientation of block copolymer (BCP) morphology in thin films is critical to applications as nanostructured coatings. Despite being well-studied, the ability to control BCP orientation across all possible block constituents remains challenging. Here, in this study, we deploy coarse-grained molecular dynamics simulations to study diblock copolymer ordering in thin films, focusing on chain makeup, substrate surface energy, and surface tension disparity between the two constituent blocks. We explore the multi-dimensional parameter space of ordering using a machine-learning approach, where an autonomous loop using a Gaussian process (GP) control algorithm iteratively selects high-value simulations to compute. The GP kernel was engineered to capture known symmetries. The trained GP model serves as both a complete map of system response, and a robust means of extracting material knowledge. We demonstrate that the vertical orientation of BCP phases depends on several counter-balancing energetic contributions, including entropic and enthalpic material enrichment at interfaces, distortion of morphological objects through the film depth, and of course interfacial energies. BCP lamellae are found more resistant to these effects, and thus more robustly form vertical orientations across a broad range of conditions; while BCP cylinders are found to be highly sensitive to surface tension disparity.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Simultaneous measurement of surface velocity and plasma density with interferometric velocimetry

The apparent velocity measured by an interferometric surface velocimeter is a function of both the surface velocity and the time derivative of the refractive index along the measurement path. We employed this dual sensitivity to simultaneously measure km/s surface velocities and 10 18 cm -3 average plasma densities with combined VISAR (velocity interferometer system for any reflector) and PDV (photonic Doppler velocimetry) measurements in experiments performed on the Z Pulsed Power Facility. We detail the governing equations, associated assumptions, and analysis specifics and show that the surface velocity can be extracted without knowledge of the specific plasma density profile.

47 OTHER INSTRUMENTATION↗

Hard x-ray methods for studying the structure of amorphous thin films and bulk glassy oxides

High-energy photon diffraction minimizes many of the corrections associated with laboratory x-ray diffractometers, and enables structure factor measurements to be made over a wide range of momentum transfers. The method edges us closer toward an ideal experiment, in which coordination numbers can be extracted without knowledge of the sample density. Three case studies are presented that demonstrate new hard x-ray methods for studying the structure of glassy and amorphous materials. First, the methodology and analysis of high-energy grazing incidence on thin films is discussed for the case of amorphous In 2 O 3 . Additionally, the connectivity of irregular InO 6 polyhedra are shown to exist in face-, edge- and corner-shared configurations in the approximate ratio of 1:2:3. Secondly, the technique of high-energy small and wide angle scattering has been carried out on laser heated and aerodynamically levitated samples of silica-rich barium silicate (20BaO:80SiO 2 ), from the single phase melt at 1500 C-o to the phase separated glass at room temperature. Based on Ba-O coordination numbers of 6 to 7, it is argued that the although the potential of Ba is ionic, it is weak enough to cause the liquid-liquid immiscibility to become metastable. Lastly, high-energy small and wide angle scattering has also been applied to high water content (up to 12 wt.%) samples of hydrous SiO 2 glass quenched from 1500 C-o at 4 GPa. An increase of Si 1 O 2 correlations at 4.3 angstrom is found to be consistent with an increase in the population of three-membered SiO 4 rings at the expense of larger rings.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Novel Fault Location Method for Power Systems Based on Attention Mechanism and Double Structure GRU Neural Network

Fault location is one of the most essential techniques to maintain the stable operation of power systems. A fast and accurate fault location allows operators to restore power grids faster and avoid economic losses. Conventional methods rely on expert knowledge to extract the necessary features (e.g. DWT, DFT). For large systems, more coupling effects of transmission lines require more complex feature engineering, and incomplete features can easily introduce large errors. To overcome this, a deep learning approach without manual feature extraction is introduced to the fault location model under big data application. Towards this end, in the proposed method, the attention mechanism, the Bi-GRU and a dual structure network are applied to analyze the current data from different perspectives. Complete information for the fault features is extracted for the fault location. Based on a time series model and benefit from the ability to internally acquire the information architecture of faulty line, the established model is adaptive to the power grids with very complex topologies. Simulation results indicate that the proposed double-structure model reduces the maximum error and is less affected by noise. In comparison with different structures and different models, the proposed method shows better performance in IEEE 39-bus system.

42 ENGINEERING↗

Reweighting simulated events using machine-learning techniques in the CMS experiment

Data analyses in particle physics rely on an accurate simulation of particle collisions and a detailed simulation of detector effects to extract physics knowledge from the recorded data. Event generators together with a GEANT -based simulation of the detectors are used to produce large samples of simulated events for analysis by the LHC experiments. These simulations come at a high computational cost, where the detector simulation and reconstruction algorithms have the largest CPU demands. This article describes how machine-learning (ML) techniques are used to reweight simulated samples obtained with a given set of parameters to samples with different parameters or samples obtained from entirely different simulation programs. The ML reweighting method avoids the need for simulating the detector response multiple times by incorporating the relevant information in a single sample through event weights. Results are presented for reweighting to model variations and higher-order calculations in simulated top quark pair production at the LHC. This ML-based reweighting is an important element of the future computing model of the CMS experiment and will facilitate precision measurements at the High-Luminosity LHC.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Machine-learning-assisted analysis of transition metal dichalcogenide thin-film growth

In situ reflective high-energy electron diffraction (RHEED) is widely used to monitor the surface crystalline state during thin-film growth by molecular beam epitaxy (MBE) and pulsed laser deposition. With the recent development of machine learning (ML), ML-assisted analysis of RHEED videos aids in interpreting the complete RHEED data of oxide thin films. The quantitative analysis of RHEED data allows us to characterize and categorize the growth modes step by step, and extract hidden knowledge of the epitaxial film growth process. In this study, we employed the ML-assisted RHEED analysis method to investigate the growth of 2D thin films of transition metal dichalcogenides (ReSe2) on graphene substrates by MBE. Principal component analysis (PCA) and K-means clustering were used to separate statistically important patterns and visualize the trend of pattern evolution without any notable loss of information. Using the modified PCA, we could monitor the diffraction intensity of solely the ReSe2 layers by filtering out the substrate contribution. These findings demonstrate that ML analysis can be successfully employed to examine and understand the film-growth dynamics of 2D materials. Further, the ML-based method can pave the way for the development of advanced real-time monitoring and autonomous material synthesis techniques.

36 MATERIALS SCIENCE↗

The Making of a Metric: Co-Producing Decision-Relevant Climate Science

Developing decision-relevant science for adaptation requires the identification of climatic parameters that are both actionable for practitioners as well as tractable for modelers. In many sectors, these decision-relevant climatic metrics and the approaches that enable their identification remain largely unknown. “Co-production” of science with scientists and decision-makers is one potential way to identify these metrics, but there is little research describing specific and successful co-production approaches. This paper examines the negotiations and outcomes from Project Hyperion, wherein scientists and water managers jointly developed decision-relevant climatic metrics for adaptive water management. We identify successful co-production strategies by analyzing the project’s numerous back-and-forth engagements and tracing the evolution of the science during these engagements. We found that effective mediation between scientists and managers needed dedicated “boundary spanners” with significant modeling expertise. Translating practitioners’ information needs into tractable climatic metrics required direct and indirect methods of eliciting knowledge. We identified four indirect methods that were particularly salient for extracting tacitly held knowledge and enabling shared learning: developing a hierarchical framework linking management issues with metrics, starting discussions from the planning challenges, collaboratively exploring the planning relevance of new scientific capabilities, and using analogies of other “good” metrics. The decision-relevant metrics we developed provide insights into advancing adaptation-relevant climate science in the water sector. The co-production strategies we identified can be used to design and implement productive scientist–decision-maker interactions. Overall, the approaches and metrics we developed can help climate science to expand in new and more use-inspired directions.

Planning↗

Automated electrosynthesis reaction mining with multimodal large language models (MLLMs)

Leveraging the chemical data available in legacy formats such as publications and patents is a significant challenge for the community. Automated reaction mining offers a promising solution to unleash this knowledge into a learnable digital form and therefore help expedite materials and reaction discovery. However, existing reaction mining toolkits are limited to single input modalities (text or images) and cannot effectively integrate heterogeneous data that is scattered across text, tables, and figures. In this work, we go beyond single input modalities and explore multimodal large language models (MLLMs) for the analysis of diverse data inputs for automated electrosynthesis reaction mining. We compiled a test dataset of 65 articles (MERMES-T24 set) and employed it to benchmark five prominent MLLMs against two critical tasks: (i) reaction diagram parsing and (ii) resolving cross-modality data interdependencies. The frontrunner MLLM achieved ≥96% accuracy in both tasks, with the strategic integration of single-shot visual prompts and image pre-processing techniques. We integrate this capability into a toolkit named MERMES (multimodal reaction mining pipeline for electrosynthesis). Our toolkit functions as an end-to-end MLLM-powered pipeline that integrates article retrieval, information extraction and multimodal analysis for streamlining and automating knowledge extraction. This work lays the groundwork for the increased utilization of MLLMs to accelerate the digitization of chemistry knowledge for data-driven research.

Leong, Shi Xuan↗

SeqMask: Behavior Extraction Over Cyber Threat Intelligence Via Multi-Instance Learning

Abstract Identification and extraction of Tactics, Techniques and Procedures (TTPs) for Cyber Threat Intelligence (CTI) restore the full picture of cyber attacks and guide the analysts to assess the system risk. Existing frameworks can hardly provide uniform and complete processing mechanisms for TTPs information extraction without adequate knowledge background. A multi-instance learning approach named SeqMask is proposed in this paper as a solution. SeqMask extracts behavior keywords from CTI evaluated by the semantic impact, and predicts TTPs labels by conditional probabilities. Still, the framework has two mechanisms to determine the validity of keywords. One using expert experience verification. The other verifies the distortion of the classification effect by blocking existing keywords. In the experiments, SeqMask reached 86.07% and 73.99% in F1 scores for TTPs classifications. For the top 20% of keywords, the expert approval rating is 92.20%, where the average repetition of keywords whose scores between 100% and 90% is 60.02%. Particularly, when the top 65% of the keywords were blocked, the F1 decreased to about 50%; when removing the top 50%, the F1 was under 31%. Further, we also validate the possibility of extracting TTPs from full-size CTI and malware whose F1 are improved by 2.16% and 0.81%.

Ge, Wenhan↗

Transition Metals Separation with Commercial Neutral Extractants – A Review

The increasing use of extraction chromatography resins across fields such as hydrometallurgy, nuclear medicine, and environmental analysis has created a need for a deeper understanding of their interactions with transition metals. Despite extensive research on f-element separations, the behavior of transition metals in these systems remains relatively understudied. This review provides a comprehensive overview of the current state of knowledge on the extraction behavior of transition metals with neutral extractants, including TODGA, TEHDGA, TBP, and CMPO, and their corresponding resins, such as DGA, BDGA, UTEVA, TBP, and TRU. The review summarizes extraction data, extracted complex coordination environments, separation reaction stoichiometries, and associated thermodynamics, highlighting inconsistencies and knowledge gaps in the literature. The study emphasizes the need for further research using spectroscopy and computational methods to elucidate extraction mechanisms and to improve the efficiency and selectivity of transition metal separations. By identifying areas for future research and development, this review aims to stimulate advancements in the field and promote the development of innovative separation technologies. The implications of this research are far-reaching, with potential applications in nuclear waste management, nuclear forensics, metal recovery, and environmental remediation. Overall, this review provides a foundation for future studies on the extraction of transition metals using neutral extractants and resins.

Wall, Nathalie A.↗

Enhancing the Operational Resilience of Advanced Reactors with Digital Twins by Recurrent Neural Networks

Because of a lack of operational data and uncertainty in evaluation model for abnormal and accident scenarios, the established operating procedures can be biased in characterizing the reactor states and ensuring operational resilience. To reduce uncertainty associated with actual plant conditions, digital twin (DT) technology is suggested to support operator’s decision-making by effectively extracting and using knowledge of the current and future plant states from the knowledge base. This study first builds a knowledge base based on the characterization of issue space and the simulation tool. Next, this study discusses diagnosis and prognosis DTs for enhancing operational resilience by recovering the complete states of reactors and by predicting the future reactor behaviors. Finally, the decision-making module of the control system can determine the optimal control strategy that meets operational goals during loss-of-flow scenarios. To demonstrate and evaluate the DTs capability for supporting the operations of nuclear reactors, this study develops and assesses both the diagnosis and prognosis DTs in a nearly autonomous management and control system for an Experimental Breeder Reactor-II simulator during different loss-of-flow scenarios.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Enhancing the Operational Resilience of Advanced Reactors with Digital Twins by Recurrent Neural Networks

Because of a lack of operation data during abnormal and accident scenarios, along with the existence of uncertainty in the evaluation model for transient and accident analysis, the established abnormal and emergency operating procedures can be biased in characterizing the reactor states and ensuring operational resilience. To improve state awareness and ensure operational flexibility for minimizing effects on the system due to anomaly, digital twin (DT) technology is suggested to support operator's decision-making by effectively extracting and using knowledge of the current and future plant states from the knowledge base. To demonstrate DT's capability for recovering the complete states of reactors and for predicting the future reactor behaviors, this paper develops and assesses both the diagnosis and prognosis DTs in a nearly autonomous management and control system for an Experimental Breeder Reactor-II simulator during different loss-of-flow scenarios.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Near-complete extraction of maximum stored energy from large-core fibers using coherent pulse stacking amplification of femtosecond pulses

High field science relies on ultrashort pulse lasers with multi-joule pulse energies for studying light–matter interactions under extreme conditions and for driving particle accelerators and secondary radiation sources of x rays, gamma rays, neutrons, positrons, muons, and protons. Next-generation laser drivers will require a 10 3 -10 4 times increase in pulse repetition rates, producing multi-joule energies at multi-kilowatt average powers to enable practical applications in nuclear engineering, advanced materials, medicine, biology, homeland security, and high-energy physics. Spatially coherently combined femtosecond fiber lasers are recognized as a pathway to these next-generation drivers, with significant practical advantages including high efficiency and the possibility of compact integration. However, chirped pulse amplification in fibers is capable of extracting only a small fraction (usually ~1%) of the maximum stored energy. Here we demonstrate near-complete maximum stored energy extraction with low accumulated nonlinearity from a large-core fiber amplifier using coherent pulse stacking amplification. We have amplified a 81-pulse stacking burst in a 85 µm core chirally coupled core Yb-doped fiber, extracting up to 9.5 mJ (~90% of stored energy) with < 4.5 radians of accumulated nonlinear phase, temporally combined this burst into a single pulse, and achieved 4.2 mJ pulses of 313 fs bandwidth-limited duration after compression. This represents, to our knowledge, the highest energy extracted and compressed into a femtosecond pulse from a single fiber amplifier, enabling approximately two orders of magnitude size reduction of future high-energy coherently spatially combined fiber laser arrays.

47 OTHER INSTRUMENTATION↗

Leveraging Large Language Models for Real-World Data Evidence: A Framework for Automated Treatment Extraction and Data Harmonization

Background: The ability to comprehensively collect treatment information from cancer patient medical records would enable studies to evaluate real-world benefits and risks tied to specific treatments. Currently, it is difficult to system- atically collect high-quality treatment information because it is often stored in unstructured text. Manually extracting and standardizing drug and regimen data is time-intensive. Recent advances in large language models (LLMs) offer a potential solution for automated extraction of structured treatment information from clinical text. Objective: This study systematically evaluates the utility of four LLMs from the Llama family for automated extraction of oncology treatment information from clinical text. This information can guide researchers using cancer registry data to provide insights into cancer care and outcomes beyond clinical trials. Methods: Four instruction-tuned Llama models with varying parameter counts (1B, 3B, 8B, and 70B) were evaluated for their ability to extract treatment information from clinical documents. A unified oncology knowledge base integrating seven major public data sources was developed to standardize and normalize extracted entities—a critical step for harmonizing data from diverse sources. Extracted treatment data were compared against expert-annotated ground truth. Model performance was assessed using accuracy metrics (Precision, Recall, F1-Score) and opera- tional feasibility metrics, including processing speed and structural compliance of the output. Results: A strong positive correlation was observed between model size and extraction accuracy. F1-score improved from 0.609 for the 1B model to 0.710 (3B), 0.807 (8B), and 0.828 (70B). While larger models demonstrated superior accuracy and compliance, they incurred higher computational costs. The modest performance difference between 8B and 70B suggests diminishing returns with increasing model size. Conclusions: LLMs represent a viable technology for automating oncology treatment extraction. The 8B-parameter model emerged as a highly effective option, balancing high accuracy and computational efficiency. Selecting an appropriate LLM for deployment in cancer registries involves a trade-off between desired accuracy and available operational resources. Harmonizing extracted entities with the oncology knowledge base facilitates standardized integration into common data models, enhancing data quality for real-world evidence analyses.

artificial intelligence↗

Influence of Metal Ion Complexation on the Radiolytic Longevity of Butyramide Extractants under Direct Dissolution Process Conditions

The direct dissolution of voloxidized used nuclear fuel (UNF) into an organic solution–comprised of diluent and specialized extractants–poses a promising alternative to the traditional liquid–liquid solvent extraction approach to reprocessing UNF. However, moving to direct dissolution removes the presence of a concentrated nitric acid aqueous phase, which has been shown to significantly influence the radiolytic longevity of extractants in conventional extraction flowsheets. Given the limited knowledge of radiation effects under direct dissolution conditions, here we present a time-resolved and dose-accumulation study on the impact of direct dissolution conditions on the radiolytic longevity of two candidate butyramide extractants, N,N-di(2-ethylhexyl) butyramide (DEHBA) and N,N-di(2-ethylhexyl)isobutyramide (DEHiBA), in pre-equilibrated n-dodecane solvent in the presence and absence of process-relevant metal ions, specifically, uranium and rhenium. Loss G(DEHBA) and G(DEHiBA) values were found to be comparable to each other, with an average of 0.37 ± 0.02 μmol J –1 , and to previous data from the γ irradiation of DEHBA and DEHiBA under conventional solvent extraction conditions. Rhenium, and by extension technetium, extraction had a modest decrease (~10%) in the overall radiolytic stability of DEHiBA only, despite >2× observed increases in chemical kinetic reactivity of the corresponding complexes with the n-dodecane radical cation. Uranium loading, on the other hand, significantly improved the lifetime of both ligands (>30%) under γ irradiation, with a greater stabilization observed for DEHBA over DEHiBA. The observed radioprotective effect afforded by uranium loading is fortuitous for the longevity of direct dissolution solvent.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗