Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “AUGMENTATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Improving Bond Dissociations of Reactive Machine Learning Potentials through Physics-Constrained Data Augmentation

In the field of computational chemistry, predicting bond dissociation energies (BDEs) presents well-known challenges, particularly due to the multireference character of reactive systems. Many chemical reactions involve configurations where single-reference methods fall short, as the electronic structure can significantly change during bond breaking. As generating training data for partially broken bonds is a challenging task, even state-of-the-art reactive machine learning interatomic potentials (MLIPs) often fail to predict reliable BDEs and smooth dissociation curves. By contrast, simple and inexpensive physics-based models, such as the well-established Morse potential, do not suffer from any such limitations. This work leverages the Morse potential to improve reactive MLIPs by augmenting the training data set with inexpensive Morse data along the dissociation pathways. Further, this physics-constrained data augmentation (PCDA) approach results in MLIPs with smooth bond dissociation curves as well as near coupled-cluster level BDEs, all without requiring any expensive multireference quantum mechanical calculations. A case study for methane combustion demonstrates how the PCDA approach can improve an existing reactive MLIP, namely, ANI-1xnr. In conclusion, not only are the BDEs and bond dissociation curves for all radicals and molecules significantly improved compared to ANI-1xnr but the PCDA-trained MLIP retains the reliability of ANI-1xnr when performing reactive molecular dynamics simulations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

SeismoGen: Seismic Waveform Synthesis Using GAN With Application to Seismic Data Augmentation

Abstract Detecting earthquake arrivals within seismic time series can be a challenging task. Visual, human detection has long been considered the gold standard but requires intensive manual labor that scales poorly to large data sets. In recent years, automatic detection methods based on machine learning have been developed to improve the accuracy and efficiency. However, the accuracy of those methods relies on access to a sufficient amount of high‐quality labeled training data, often tens of thousands of records or more. We aim to resolve this dilemma by answering two questions: (1) provided with a limited amount of reliable labeled data, can we use them to generate additional, realistic synthetic waveform data? and (2) can we use those synthetic data to further enrich the training set through data augmentation, thereby enhancing detection algorithms? To address these questions, we use a generative adversarial network (GAN), a type of machine learning model which has shown supreme capability in generating high‐quality synthetic samples in multiple domains. Once trained, our GAN model is capable of producing realistic seismic waveforms of multiple labels (noise and event classes). Applied to real Earth seismic data sets in Oklahoma, we show that data augmentation from our GAN‐generated synthetic waveforms can be used to improve earthquake detection algorithms in instances when only small amounts of labeled training data are available.

Wang, Tiantong↗

Dynamics of argon metastables in Ar–CH 4 radio frequency capacitively-coupled plasma: real-time monitoring with neural network-augmented broadband optical emission spectroscopy

In moderate-pressure radio frequency (RF) capacitively coupled plasmas generated in argon–methane mixtures, the density of argon metastable atoms (Ar 1 s 5 ) exhibits a non-monotonic dependence on methane (CH 4 ) concentration. Laser-induced fluorescence (LIF) was used to measure and compare local Ar 1 s 5 densities in Ar and Ar–CH 4 plasmas at 2.6 Torr and RF powers of 17–117 W. The addition of 1% CH 4 increases the metastable density, and 2% CH 4 triggers a strong depletion by an order of magnitude, compared to 1% CH 4 case. This non-monotonic behavior demonstrates the sensitivity of metastable populations to small gas admixtures, which is critical for processes where metastables drive precursor dissociation. For real-time monitoring of metastable population, broadband optical emission spectroscopy (OES) is augmented with a feedforward neural network (NN) to predict Ar s1 5 densities from spectral features. When trained on LIF data, the NN replicates the absolute densities and the dynamic trends of Ar 1 s 5 density variation. The NN-augmented broadband OES approach can be used as a simple and cost-effective tool for tracking Ar metastables in Ar-rich plasmas, facilitating industrial-scale optimization.

Yatom, Shurik [Princeton Plasma Physics Laboratory↗

Performance enhancement of direct-drive shock-augmented ignition inertial fusion implosions through shock timing optimization

Shock-augmented ignition (SAI) [R. H. H. Scott et al., Phys. Rev. Lett. 129, 195001 (2022)] is an alternative inertial confinement fusion concept that is designed to achieve high energy gain by combining improved resilience to instabilities with enhanced fuel compression. In SAI, lower implosion velocities can improve hydrodynamic stability and limited laser intensities reduce the excitation of detrimental laser-plasma instabilities, enabling greater areal density accumulation. Here we report an experimental investigation of SAI using a series of warm D 2 implosions. By timing the augmenting shock to arrive at the implosion center immediately prior to peak compression, the areal density and hot-spot pressure increase by 50% and 112%, respectively, relative to unoptimized designs. Ignition-scale simulations reproduce the observed timing dependence and demonstrate the potential of SAI for inertial fusion energy.

Direct drive↗

Augmenting Graph Convolution with Distance Preserving Embedding for Improved Learning

Graph convolution incorporates topological information of a graph into learning. Message passing corresponds to traversal of a local neighborhood in classical graph algorithms. We show that incorporating additional global structures, such as shortest paths, through distance preserving embedding can improve performance. Our approach, Gavotte, significantly improves the performance of a range of popular graph neu-ral networks such as GCN, GA T,Graph SAGE, and GCNII for transductive learning. Gavotte also improves the performance of graph neural networks for full-supervised tasks, albeit to a smaller degree. As high-quality embeddings are generated by Gavotte as a by-product, we leverage clustering algorithms on these embed dings to augment the training set and introduce Gavotte+. Our results of Gavotte+ on datasets with very few labels demonstrate the advantage of augmenting graph convolution with distance preserving embedding.

Cong, Guojing↗

Attention-Augmented Parametric Kernel Graph Neural Network (APKGNN) for Node Classification

We present a new graph neural network, the Attention-based Parametric-Kernel augmented Graph Neural Network (APKGNN), developed for node classification tasks. Despite extensive work on modeling multi-faceted relationships between connected nodes of a graph, the effect of attention on edge features mapped to relationships has not yet been analyzed through learning representation. This study derives such an attention vector by first calculating node features corresponding to endpoints of an edge and then aggregating these with extracted local intrinsic patches of a given graph to generate augmented local patch vectors. This process uses a parametric kernel based on Gaussian mixture models (GMMs) to embed local neighborhoods of the graph in local patches. The patch vectors then convolve with the above node features to produce an updated node representation. We show that this new learning representation (APKGNN) achieves higher node classification accuracy on tasks - both standard benchmarks (Cora, PubMed, Citeseer) and new experimental short text corpora where nodes correspond to text documents and words. This implementation of the GNN convolution layer outperforms state-of-the-art (SOTA) algorithms, achieving higher training, validation, and test accuracy by a significant margin on three standard benchmark data sets under both SOTA experimental settings and those for new testbeds.

Bose, Avishek↗

Optimization and Augmentation for Data Parallel Contour Trees

Contour trees are used for topological data analysis in scientific visualization. While originally computed with serial algorithms, recent work has introduced a vector-parallel algorithm. Furthermore, this algorithm is relatively slow for fully augmented contour trees which are needed for many practical data analysis tasks. We therefore introduce a representation called the hyperstructure that enables efficient searches through the contour tree and use it to construct a fully augmented contour tree in data parallel, with performance on average 6 times faster than the state-of-the-art parallel algorithm in the TTK topological toolkit.

97 MATHEMATICS AND COMPUTING↗

Reduced Erosion Augments Soil Carbon Storage Under Cover Crops

ABSTRACT Cover crops, a promising strategy to increase soil organic carbon (SOC) storage in croplands and mitigate climate change, have typically been shown to benefit soil carbon (C) storage from increased plant C inputs. However, input‐driven C benefits may be augmented by the reduction of C outputs induced by cover crops, a process that has been tested by individual studies but has not yet been synthesized. Here we quantified the impact of cover crops on organic C loss via soil erosion (SOC erosion) and revealed the geographical variability at the global scale. We analyzed the field data from 152 paired control and cover crop treatments from 57 published studies worldwide using meta‐analysis and machine learning. The meta‐analysis results showed that cover crops widely reduced SOC erosion by an average of 68% on an annual basis, while they increased SOC stock by 14% (0–15 cm). The absolute SOC erosion reduction ranged from 0 to 18.0 Mg C −1 ha −1 year −1 and showed no correlation with the SOC stock change that varied from −8.07 to 22.6 Mg C −1 ha −1 year −1 at 0–15 cm depth, indicating the latter more likely related to plant C inputs. The magnitude of SOC erosion reduction was dominantly determined by topographic slope. The global map generated by machine learning showed the relative effectiveness of SOC erosion reduction mainly occurred in temperate regions, including central Europe, central‐east China, and Southern South America. Our results highlight that cover crop‐induced erosion reduction can augment SOC stock to provide additive C benefits, especially in sloping and temperate croplands, for mitigating climate change.

Huang, Wenjuan [Department of Ecology, Evolution, ↗

Chemical signature characterization with hyperspectral imagery: novel deep learning model architectures and physically-motivated data augmentation techniques

The high spectral resolution afforded by Hyperspectral Imaging (HSI) sensors is poised to bring unprecedented advancements to signature characterization applications. Thus far, much of the research in the machine learning field devoted to HSI applications has focused on a few specific tasks like land-use land-cover classification. In land classification tasks, spatial information is very important, and model architectures are often designed to leverage spatial contexts. However, it is unclear how well these spatially-tuned models will translate to tasks where spectral information is critical, like the detection and characterization of chemicals. In this work, we compare spectral models (inputs are 1D spectra) and spatial-spectral models (inputs are 3D cubes) in the context of predicting chemical concentration maps. We find that spatial-spectral models perform the best, though we find a wide range in performance across the different architectures tested. Additionally, we find that model performance is impacted by the availability of training data, particularly in scenarios where the training data doesn't fully capture the true variance of real-world conditions. We find that data augmentation can help mitigate sparse coverage of observed parameter space (e.g., seasonal or geographic variability in ground cover), and present augmentation strategies that are tailored to hyperspectral data.

• Artificial intelligence (AI) / machine learning ↗

SU-E-J-134: An Augmented-Reality Optical Imaging System for Accurate Breast Positioning During Radiotherapy

Purpose: Breast radiotherapy, particularly electronic compensation, may involve large dose gradients and difficult patient positioning problems. We have developed a simple self-calibrating augmented-reality system, which assists in accurately and reproducibly positioning the patient, by displaying her live image from a single camera superimposed on the correct perspective projection of her 3D CT data. Our method requires only a standard digital camera capable of live-view mode, installed in the treatment suite at an approximately-known orientation and position (rotation R; translation T). Methods: A 10-sphere calibration jig was constructed and CT imaged to provide a 3D model. The (R,T) relating the camera to the CT coordinate system were determined by acquiring a photograph of the jig and optimizing an objective function, which compares the true image points to points calculated with a given candidate R and T geometry. Using this geometric information, 3D CT patient data, viewed from the camera's perspective, is plotted using a Matlab routine. This image data is superimposed onto the real-time patient image, acquired by the camera, and displayed using standard live-view software. This enables the therapists to view both the patient's current and desired positions, and guide the patient into assuming the correct position. The method was evaluated using an in-house developed bolus-like breast phantom, mounted on a supporting platform, which could be tilted at various angles to simulate treatment-like geometries. Results: Our system allowed breast phantom alignment, with an accuracy of about 0.5 cm and 1 ± 0.5 degree. Better resolution could be possible using a camera with higher-zoom capabilities. Conclusion: We have developed an augmented-reality system, which combines a perspective projection of a CT image with a patient's real-time optical image. This system has the potential to improve patient setup accuracy during breast radiotherapy, and could possibly be used for other disease sites as well.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Machine learning in a data-limited regime: Augmenting experiments with synthetic data uncovers order in crumpled sheets

Machine learning has gained widespread attention as a powerful tool to identify structure in complex, high-dimensional data. However, these techniques are ostensibly inapplicable for experimental systems where data are scarce or expensive to obtain. Here, we introduce a strategy to resolve this impasse by augmenting the experimental dataset with synthetically generated data of a much simpler sister system. Specifically, we study spontaneously emerging local order in crease networks of crumpled thin sheets, a paradigmatic example of spatial complexity, and show that machine learning techniques can be effective even in a data-limited regime. This is achieved by augmenting the scarce experimental dataset with inexhaustible amounts of simulated data of rigid flat-folded sheets, which are simple to simulate and share common statistical properties. This considerably improves the predictive power in a test problem of pattern completion and demonstrates the usefulness of machine learning in bench-top experiments where data are good but scarce.

97 MATHEMATICS AND COMPUTING↗

Dynamic Retrieval Augmented Generation of Ontologies using Artificial Intelligence (DRAGON-AI)

Ontologies are fundamental components of informatics infrastructure in domains such as biomedical, environmental, and food sciences, representing consensus knowledge in an accurate and computable form. However, their construction and maintenance demand substantial resources and necessitate substantial collaboration between domain experts, curators, and ontology experts. We present Dynamic Retrieval Augmented Generation of Ontologies using AI (DRAGON-AI), an ontology generation method employing Large Language Models (LLMs) and Retrieval Augmented Generation (RAG). DRAGON-AI can generate textual and logical ontology components, drawing from existing knowledge in multiple ontologies and unstructured text sources.We assessed performance of DRAGON-AI on de novo term construction across ten diverse ontologies, making use of extensive manual evaluation of results. Our method has high precision for relationship generation, but has slightly lower precision than from logic-based reasoning. Our method is also able to generate definitions deemed acceptable by expert evaluators, but these scored worse than human-authored definitions. Notably, evaluators with the highest level of confidence in a domain were better able to discern flaws in AI-generated definitions. We also demonstrated the ability of DRAGON-AI to incorporate natural language instructions in the form of GitHub issues.These findings suggest DRAGON-AI's potential to substantially aid the manual ontology construction process. However, our results also underscore the importance of having expert curators and ontology editors drive the ontology generation process.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Evaluating the Effectiveness of Retrieval-Augmented Large Language Models in Scientific Document Reasoning

Despite the dramatic progress in Large Language Model (LLM) development, LLMs often provide seemingly plausible but not factual information, often referred as hallucinations. Retrieval-augmented LLMs provide a non-parametric approach to solve these issues by retrieving relevant information from external data sources and augment the training process. These models helps to trace evidence from an externally provided knowledge base allowing the model predictions to be better interpreted and verified. In this work, we critically evaluate these models in their ability to perform in scientific document reasoning tasks. To this end, we tuned multiple such model variants with science-focused instructions and evaluated them on a scientific document reasoning benchmark for the usefulness of the retrieved document passages. Our findings suggest that models justify predictions in science tasks with fabricated evidence and leveraging scientific corpus as pretraining data does not alleviate the risk of evidence fabrication.

• Artificial intelligence (AI) / machine learning ↗

Assessing the standard Molybdenum projector augmented wave VASP potentials

Density Functional Theory (DFT) based Equation of State (EOS) construction is a prominent part of Sandia’s capabilities to support engineering sciences. This capability is based on augmenting experimental data with information gained from computational investigations, especially in those parts of the phase space where experimental data is hard, dangerous, or expensive to obtain. A key part of the success of the Sandia approach is the fundamental science work supporting the computational capability. Not only does this work enhance the capability to perform highly accurate calculations but it also provides crucial insight into the limitations of the computational tools, providing high confidence in the results even where results cannot be, or have not yet been, validated by experimental data. This report concerns the key ingredient of projector augmented-wave (PAW) potentials for use in pseudo-potential computational codes. Using the tools discussed in SAND2012-7389 we assess the standard Vienna Ab-initio Simulation Package (VASP) PAWs for Molybdenum.

97 MATHEMATICS AND COMPUTING↗

A Demonstration of Light-Augmented Calorimetry For Low-Energy Electrons in Liquid Argon.

The ability to resolve electrons with energies as low as 5 MeV in liquid argon (LAr) is important for future studies of astrophysical neutrinos in liquid argon time projection chambers (LArTPCs). Existing methods for measuring the energy of electromagnetic showers in LArTPCs rely solely on charge-based reconstruction which requires correcting for assumed electron-ion recombination. However, LAr scintillation light has the potential to improve energy reconstruction over charge-based measurements alone. Here we present a demonstration of a light-augmented calorimetric technique for low-energy electrons in LAr that foregoes the need to correct for recombination. A sample of Michel electrons from stopping cosmic muons is collected in LArIAT (Liquid Argon In A Testbeam), a single-phase LArTPC at Fermilab’s Test Beam Facility. Michel electron energy spectra are reconstructed using both a traditional charge-based approach as well as a more holistic approach that incorporates both charge and light. A maximum-likelihood fitter, using LArIAT’s well-tuned simulation, is developed for combining these quantities to achieve optimal energy resolution. A sample of isolated electrons with Ee < 60 MeV is then simulated to better determine the energy resolution of this topology. Due to LArIAT’s low wire noise, the addition of light is not found to significantly improve upon the achieved charged-based resolution of σ/E ≃ 9%/√E ⊕ 1%. However, additional samples are generated with varying wire noise levels and light yields to gauge the impact of light-augmented calorimetry in large LArTPCs such as DUNE and SBND. At a charge-readout signal-to-noise of ≈10, the energy resolution for low-energy electrons is improved by ∼15%, ∼25%, and ∼45% over charge-only calorimetry for average light yields of 10, 20, and 100 pe/MeV, respectively.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Power System Resilience Metrics Augmentation for Critical Load Prioritization

One of the major goals of new grid operation regimes, such as transactive energy systems (TESs), is to make the power grid more resilient to withstand natural or man-made disasters and potential reliability events, and to continue to serve the maximum number of its customers. But it is a well-known fact to system operators that not all customers are the same. This implies that any discussion of TESs’ impacts on the resilience of the power system should consider the needs of its critical customers (such as the power system operation centers, fire and police stations, and hospitals) over those of other customers. When evaluating the resilience of the system, bonus points must be awarded to any system that could maintain its power supply to critical customers during a disturbance that may cause an outage. This report discusses critical infrastructure (CI) as found in the literature and then categorizes it based on the field to which the operations belong (such as human life/safety-related, operations management, necessary city operation, industrial customers, etc.). Each of these CI categories is further divided into types of critical customers (e.g., the human life/safety-related category has different types of customers like hospitals, fire and police stations, etc.). The entire demand of each of the critical customer types is not categorized as critical load (CL); instead, only a portion of the total load of these critical customers is characterized as critical load. This is done based on the categories of equipment, the function of which is crucial in the operation of the overall facility. CL categorization is performed to provide the ratio of the critical load portion to the overall load , so that it can serve as a parameter in the resilience evaluation of the grid through a metrics-based approach. Such categorization is important as it helps to augment the existing quantifiable resilience metrics with CL categorization. The metrics for a power system need to not only consider how well a system performed during a disturbance event, but also how it reduced strain and supplied power to its CLs. The first step in this process is characterize CLs in the system. After CL characterization, the next step is the inclusion of these loads in the resilience metrics. To that end, in this report weight-based augmentation of resilience metrics is proposed, where certain customers (the ones that are categorized as critical) are assigned higher weights than others. Though an overview of assigning weights to customers is discussed, there is no one-size-fits-all approach for every power system. The decisions made about assigning such weights to customers vary greatly from one operator to another, based on their unique systems and the current and predicted states of critical customers. This decision-making can include the type of disturbance event, which might only affect certain parts of the system. In general, analyzing critical customers before an event helps understand system vulnerabilities. It also helps in planning and conducting operations during the event, evaluating system performance after the event, and supporting better planning for future events. An alternative to the current practices of managing the grid for outages is an innovative TES, which has the potential to provide a platform for including distributed energy resources for managing CLs. This report also describes how TES qualities can help (1) to maintain power supply to critical customers for uninterrupted operations and (2) to restore lost power supply to the critical customers rapidly.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Data Visualization: Augmented Reality

In recent years, there has been an increasing interest in developing new technologies for automated characterization and visualization of condition monitoring data. Augmented Reality (AR) is a technology that is being developed to improve such data visualization. Augmented reality has been defined as a technology that merges virtual and physical components in real-time, and in three dimensions. Wearable, commercially-available AR devices allow onsite engineers and technicians to perform inspection tasks with significantly more available information such as comparisons of past and present sensor and imager data, onsite data analysis and result displays, and various forms of metadata including technical drawings, previous inspection reports and maintenance histories, operation manuals, codes and standards, and holograms representing data analysis results superimposed onto the in situ monitored system.

42 ENGINEERING↗