Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “gradient methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Geometrical defect detection for additive manufacturing with machine learning models

This study proposed a scheme based on Machine Learning (ML) models to detect geometric defects of additively manufactured objects. The ML models are trained with synthetic 3D point clouds with defects and then applied to detect defects in actual production. Using synthetic 3D point clouds rather than experimental data could save a huge amount of training time and costs associated with many prints for each design. Besides distance differences of individual points between source and target point clouds, this scheme uses a new concept called “patch” to capture macro-level information about nearby points for ML training and implementation. Numerical comparisons of prediction results on experimental data with different shapes showed that the proposed scheme outperformed the existing Z-difference method in the literature. Five ML methods (Bagging of Trees, Gradient Boosting, Random Forest, K-nearest Neighbors and Linear Supported Vector Machine) were compared under various conditions, such as different point cloud densities and defect sizes. Bagging and Random Forest were found the two best models regarding predictability; and the right patch size was found to be at 20. The proposed ML-based scheme is applicable to in-situ defect detection during additive manufacturing with the aid of a proper 3D data acquisition system.

Additive manufacturing↗
DOE OSTI2021

Improving Prediction of Surface Solar Irradiance Variability by Integrating Observed Cloud Characteristics and Machine Learning

A 5-year, 1-minute resolution observational dataset of clouds and solar radiation was produced that includes two metrics of the variability in surface solar irradiance due to cloud type and fractional sky cover. Multiple regression models were trained to fit observations of surface solar irradiance variability from those two cloud property predictors. We found that ensemble tree-based methods, Random Forest and Gradient Boosting Machine, have the least overfitting issues and showed the best performance with an R2 of 0.42. While the observational data trained in this study was only from one site, the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) site in Oklahoma, initial comparisons of the seasonality of the statistics suggest that these results are relatively weather regime independent; the generality of such a finding across sites will be tested in future work. The observational data and developed machine learning model are being used to create a numerical weather prediction model parameterization to enable day-ahead solar variability prediction in a computationally efficient way. This is a first step towards creating a new paradigm of predicting day-ahead variability with the potential to provide a new tool to improve grid operation, planning, and resilience.

Riihimaki, Laura↗
DOE OSTI2023

Ultrasonic measurement of temperature distributions in extreme environments: Electrical power plants testing in utility-scale steam generators

Thermal heterogeneities within energy conversion and storage, material processing, nuclear processes, aerospace, and military applications are often inaccessible to characterization by insertion sensors. When sensor deployment is possible, conventional pointwise temperature probes quickly degrade when inserted into harsh environments typical of such processes. We developed spatially-resolved ultrasonic thermometry to noninvasively measure the spatial distributions of thermal properties in such applications, even when sizable thermal gradients are present. Our method divides the path of ultrasonic propagation into segments bound by echogenic features, which create echoes in pulse-echo mode, encoding the information about interior temperature distributions. We use the acquired ultrasonic responses to estimate the internal temperature distributions by solving an inverse problem or concatenating segmental estimates. This work describes the implementation and industrial testing of the developed method at a coal-fired electrical power generation plant. We inserted an echogenically segmented Inconel 625 waveguide into the combustion zone of the utility-scale boiler and continuously acquired ultrasonic data while keeping sensitive components away from the damaging combustion environment. The accuracy of the time-dependent temperature distributions reconstructed from the ultrasonic measurements was comparable to that of thermocouples. The resiliency of ultrasonic thermometry to harsh combustion conditions was far superior to conventional insertion sensors. The measurements obtained during plant operation captured daily steam generation cycles in response to changing customer demand and intermittent contributions of renewable power sources to the power grid. These measurements have revealed new insights into the relationship between the dynamic power generation load and the conditions inside the steam generator. As a result, the successful industrial testing of spatially-resolved ultrasonic thermometry in solids indicates that the developed technology has matured to become an attractive alternative to conventional sensing in solving challenging problems of long-term thermal characterizations in extreme environments.

42 ENGINEERING↗
DOE OSTI2025

Predicting Flow in Fracture Networks With Quantum Algorithms

Uncertainty quantification plays a crucial role in the modeling of subsurface flow. For instance, uncertainties in the properties of geologic fracture networks significantly impact flow, requiring numerous simulations to accurately estimate quantities of interest. However, each simulation is computationally expensive because it requires solving a large linear system to capture features that involve both small and large fractures. An example is in percolation, where the interaction of many small fractures (which cumulatively can have a large surface area) with the rock matrix must be modeled precisely. Quantum computing is an emerging tool with the potential to address this issue. Quantum algorithms offer a significant speedup in solving linear systems, achieving efficiencies that are challenging to match with classical approaches. These classical approaches include direct solvers, such as LU decomposition, and iterative methods, notably preconditioned conjugate gradient, commonly used in subsurface modeling to solve large sparse systems. However, applying quantum algorithms to geologic fracture flow requires careful attention to algorithmic and problem-specific constraints to fully realize this quantum advantage. In this work we describe a quantum algorithm for generalized Monte Carlo applications with a quadratic speedup over the classical approaches which can be combined with the quantum speedup, currently under investigation, for solving quantum linear systems for subsurface flow. We show that for quantum algorithms the computational cost of estimating a quantity of interest for a statistical ensemble of networks is roughly the same as that of a single realization, essentially implying that one can get uncertainty quantification for free.

58 GEOSCIENCES↗
DOE OSTI2020

Degenerate doping in B-Ga 2 O 3 Single Crystals through Hf-doping

n-type conductivity of β-Ga 2 O 3 grown from the melt is typically achieved using Sn and Si. In this paper, we experimentally and computationally investigate Hf doping of β-Ga 2 O 3 single crystals using UV–vis-NIR absorption and Hall effect measurements and hybrid functional calculations. Unintentionally-doped and Hf-doped samples with a nominal concentration of 0.5at% were grown from the melt using vertical gradient freeze and Czochralski method in mixed Ar + O 2 atmosphere. We demonstrate Hf dopants, predicted to incorporate on the octahedral GaII site as a shallow donor, achieve degenerate doping in β-Ga 2 O 3 with a measured electron concentration ~2 × 10 19 cm -3 , mobility 80–65 cm 2 V -1 s -1 , and resistivity down to 5 mΩ cm in our samples. The concentration of Hf was measured to be 1.3 × 10 19 atoms cm -3 using glow discharge mass spectroscopy on doped samples, confirming Hf to be the cause of n-type conductivity (electron concentration ~2 × 10 19 cm -3 ).

36 MATERIALS SCIENCE↗
DOE OSTI2020

A log-barrier Newton-CG method for bound constrained optimization with complexity guarantees

Abstract We describe an algorithm based on a logarithmic barrier function, Newton’s method and linear conjugate gradients that seeks an approximate minimizer of a smooth function over the non-negative orthant. We develop a bound on the complexity of the approach, stated in terms of the required accuracy and the cost of a single gradient evaluation of the objective function and/or a matrix-vector multiplication involving the Hessian of the objective. The approach can be implemented without explicit calculation or storage of the Hessian.

O’Neill, Michael↗
DOE OSTI2023

Infrared fixed point of the SU(3) gauge theory with 𝑁 𝑓 = 10 flavors

We use lattice simulations and the continuous renormalization group method, based on the gradient flow, to calculate the 𝛽 function and anomalous dimensions of the SU(3) gauge theory with 𝑁 𝑓 = 10 flavors of fermions in the fundamental representation. We employ several improvements to extend the range of available renormalized couplings, including the addition of heavy Pauli-Villars bosons to reduce cutoff effects and the combination of a range of gradient flow transformations. While in the weak coupling regime our result is consistent with those of earlier studies, our techniques allow us to study the system at much stronger couplings than previously possible. We find that the renormalization group 𝛽 function develops a zero, corresponding to an infrared-stable fixed point, at gradient-flow coupling 𝑔 2 = 15.0⁢(5). We also determine the mass and tensor anomalous dimensions: At the fixed point we find 𝛾 𝑚 ≃0.6, suggesting that this system might be deep inside the conformal window.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

AlignOT: An Optimal Transport Based Algorithm for Fast 3D Alignment With Applications to Cryogenic Electron Microscopy Density Maps

Aligning electron density maps from Cryogenic electron microscopy (cryo-EM) is a first key step for studying multiple conformations of a biomolecule. As this step remains costly and challenging, with standard alignment tools being potentially stuck in local minima, we propose here a new procedure, called AlignOT, which relies on the use of computational optimal transport (OT) to align EM maps in 3D space. By embedding a fast estimation of OT maps within a stochastic gradient descent algorithm, our method searches for a rotation that minimizes the Wasserstein distance between two maps, represented as point clouds. Here, we quantify the impact of various parameters on the precision and accuracy of the alignment, and show that AlignOT can outperform the standard local alignment methods, with an increased range of rotation angles leading to proper alignment. We further benchmark AlignOT on various pairs of experimental maps, which account for different types of conformational heterogeneities and geometric properties. As our experiments show good performance, we anticipate that our method can be broadly applied to align 3D EM maps.

3D alignment↗
DOE OSTI2022

A Framework for Error-Bounded Approximate Computing, with an Application to Dot Products

Approximate computing techniques, which trade off the computation accuracy of an algorithm for better performance and energy efficiency, have been successful in reducing computation and power costs in several domains. However, error sensitive applications in high-performance computing are unable to benefit from existing approximate computing strategies that are not developed with guaranteed error bounds. While approximate computing techniques can be developed for individual high-performance computing applications by domain specialists, this often requires additional theoretical analysis and potentially extensive software modification. Hence, the development of low-level error-bounded approximate computing strategies that can be introduced into any high-performance computing application without requiring additional analysis or significant software alterations is desirable. In this paper, we provide a contribution in this direction by proposing a general framework for designing error-bounded approximate computing strategies and apply it to the dot product kernel to develop \bf qdot---an error-bounded approximate dot product kernel. Following the introduction of qdot, here we perform a theoretical analysis that yields a deterministic bound on the relative approximation error introduced by qdot. Empirical tests are performed to illustrate the tightness of the derived error bound and to demonstrate the effectiveness of qdot on a synthetic dataset, as well as two scientific benchmarks---the conjugate gradient (CG) and power methods. In some instances, using qdot for the dot products in CG can result in many components being quantized to half precision without increasing the iteration count required for convergence to the same solution as CG using a double precision dot product.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Search for HH → bbτ⁺τ⁻ Using Run 3 Scouting Data Analyze b-tagging and tau-tagging Performance with Unified Particle Transformer

B-tagging and tau-tagging performances play an important role in the search for the rare event HH → bbτ⁺τ⁻. A transformer-based neural network, Unified Particle Transformer, is applied for both tagging tasks, and Run 3 proton–proton collision scouting data at center-of-mass energy of 13.6 TeV is used. The scouting data stream accepts events at a much higher rate compared to traditional triggers, but stores only the objects reconstructed in the trigger, no low-level detector information. Therefore, existing taggers trained for the offline event reconstruction cannot be used. Analysis of the SoftMax plots, ROC/AUC curves, confusion matrix, accuracy and losses are used to evaluate model performance. Specifically, the tagging efficiency of the signal and misidentification probability across multiple background processes are compared for varying working points. Different training samples with distinct distributions of jet flavors are utilized and related model performances are analyzed. Interpretability methods, such as Integrated Gradients, may further be applied to study the input features’ influence on the model’s decisions, providing insights into potential improvements.

Chen, Blair [Purdue U., West Lafayette; Fermilab]↗
DOE OSTI2025

Numerical simulations of liquid jetting with solid inclusions

The dynamics of finite-sized particles in fluids, and their influence on the overall flow, are of great interest across several industrial, environmental, and medical fields. In the context of inkjet printing, the presence of solid inclusions can be either intentional, as in additive manufacturing, or unintentional, as in standard printing processes. These inclusions can strongly impact the jetting process, causing effects such as jet asymmetry, bubble entrapment, and the formation of satellite droplets. Understanding and controlling particle behavior is therefore essential, particularly to predict how and when particles are ejected over multiple jetting cycles. It is therefore critical to develop reliable models that allow for a deeper understanding of the complex interplay between particle and fluid during the whole printing process. To address this, we present a tailored implementation of the Color-Gradient multicomponent Lattice Boltzmann Method for fully resolved three-dimensional (3D) simulations of multicycle liquid jetting with particles. Our method supports realistic parameter settings aligned with industrial inkjet systems, and we provide both qualitative and quantitative validation against experimental data. Additionally, we introduce a simplified model based on the Stokes drag law, in which solid particles are represented as point particles and do not influence the fluid flow. Despite this limitation, the model offers a computationally efficient means to explore the vast parameter space typically encountered in industrial applications, allowing, e.g., identifying critical ejection regions and estimating the number of cycles required for particle release. These qualitative insights are valuable for guiding and complement fully two-way coupled simulations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

HGQ: High Granularity Quantization for Real-time Neural Networks on FPGAs

Neural networks with sub-microsecond inference latency are required by many critical applications. Targeting such applications deployed on FPGAs, we present High Granularity Quantization (HGQ), a quantization-aware training framework that optimizes parameter bit-widths through gradient descent. Unlike conventional methods, HGQ determines the optimal bit-width for each parameter independently, making it suitable for hardware platforms supporting heterogeneous arbitrary precision arithmetic. In our experiments, HGQ shows superior performance compared to existing network compression methods, achieving orders of magnitude reduction in resource consumption and latency while maintaining the accuracy on several benchmark tasks. These improvements enable the deployment of complex models previously infeasible due to resource or latency constraints. HGQ is open-source and is used for developing next-generation trigger systems at the CERN ATLAS and CMS experiments for particle physics, enabling the use of advanced machine learning models for real-time data selection with sub-microsecond latency.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

A Bayesian Learning Approach to Wireless Outdoor Heatmap Construction using Deep Gaussian Process

We present a novel Bayesian learning approach to outdoor radio heatmap construction utilizing deep Gaussian process (GP). The proposed approach employs a two-layer hierarchy which consists of two cascaded Gaussian processes that are capable of modeling more complex input-output relations than standard single-layer Gaussian processes. Since deriving the exact model likelihood is challenging, a lower bound is optimized instead so that gradient descent-based methods can be performed to find out the optimal model parameters. Typically, inducing points are used in GPs to facilitate low-rank approximation of covariance (kernel) matrices for computation speedup. However, the inaccuracy induced by inducing points can accumulate when stacking multiple layers of GP which may hinder the performance of deep GP. Moreover, since inducing points need to be learned, having them at all layers of deep GP also incurs computational burden. To overcome the above challenges, in contrast to the canonical deep GP model, we use a modified architecture where a full standard GP resides in the first layer and inducing points are only introduced for the second layer. This modified architecture strikes a balance between model accuracy and training complexity. In the proposed model, the noise parameter of the first GP layer is also eliminated to improve the training efficiency as the noise parameter at the output of the second layer suffices to model the uncertainty in the output. The proposed approach is evaluated on real-world datasets, in the form of location-Received Signal Strength (RSS) pairs, collected from the Platform for Open Wireless Data-driven Experimental Research (POWDER) located at the campus of the University of Utah. Experiment results show that the proposed approach can achieve smaller prediction errors on various training and testing data configurations than DNN-based and GP-based methods.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

An extrapolation method to remove spurious stress concentration in micromechanical analyses of composites using pixel-based meshes

It is easier to generate a finite element mesh of complicated geometries with voxel-based meshes compared to conformal meshes. However, the local stresses in voxel-based meshes are higher owing to artificial stress concentration caused due to jagged lines that approximate a curve. Here, we propose a method that accounts for this anomaly which would lead to accurate prediction of maximum von Mises stress in voxel-based meshes. The method is based on the variation of reciprocal of stresses and associated numerical gradient. The prediction of the proposed method is compared against the results of a conformal mesh by considering four two-dimensional example problems. The accuracy of the proposed method is verified using different mesh densities, material properties, and integration schemes. The proposed method was also implemented on a conformal mesh to verify that it filters out just the spurious stress concentration and not the realistic stress concentration.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Semantic Stealth: Crafting Covert Adversarial Patches for Sentiment Classifiers Using Large Language Models

Deep learning models have been shown to be vulnerable to adversarial attacks, in which perturbations to their inputs cause the model to produce incorrect predictions. As opposed to adversarial attacks in computer vision, where small changes introduced to pixel values can drastically alter a model's output while remaining imperceptible to humans, text-based attacks are difficult to conceal due to the discrete nature of tokens. Consequently, unconstrained gradient-based attacks often produce adversarial examples that lack semantic meaning, rendering them detectable through visual inspection or perplexity filters. In contrast to methods that rely on gradient-based optimization in the embedding space, we propose an approach that leverages a Large Language Model's ability to generate grammatically correct and semantically meaningful text to craft adversarial patches that seamlessly blend in with the original input text. These patches can be used to alter the behavior of a target model, such as a text classifier. Since our approach does not rely on gradient backpropagation, it only requires access to the target model's confidence scores, making it a grey-box attack. We demonstrate the feasibility of our approach using open-source LLMs, including Intel's Neural Chat, Llama2, and Mistral-Instruct, to generate adversarial patches capable of altering the predictions of a distilBERT model fine-tuned on the IMDB reviews dataset for sentiment classification.

Roa Carvajal, Maria↗
DOE OSTI2025

A Computational Framework to design 3D stiffness gradient acoustic metamaterials for impedance matching

Acoustic waves play a crucial role in various applications, including medical imaging, non-destructive testing, and sonar systems. One of the significant challenges in these applications is impedance matching, which is essential for minimizing reflections and maximizing the transfer of acoustic energy between different media. Acoustic metamaterials offer a promising solution to this challenge. In addition to impedance control, gradient stiffness can enhance structural efficiency and enable spatial control of wave propagation, making it a valuable feature in acoustic metamaterial design. In this pa- per, we present our developed computational method to design 3D stiffness gradient acoustic metamaterials for impedance matching. The key steps in our approach include generating initial designs using a periodic covariance function to provide unit cells that are both periodic on the boundaries and randomly formed inside the unit cell. Furthermore, we integrated manufacturing constraints into the design process, ensuring that the structures are interconnected for fabrication. We propose two computational optimization algorithms: GenUnit, based on a non-dominated sorting genetic algorithm (NSGA-II), and MLMatch, which leverages differentiable machine learning. The two approaches are not separate contributions but complementary com- ponents of a unified framework. GenUnit requires no training data and directly interfaces with physics-based simulations, making it highly accurate but slower for large-scale exploration. In contrast, MLMatch is data-hungry during training but, once trained, enables near-instantaneous inference and broad design-space coverage. Together, they form a hybrid strategy: ML- Match rapidly explores the global design space, and GenUnit provides local refinement with high-fidelity accuracy. This balance between training cost, inference time, and precision is the motivation for including both methods in the same study. We applied this dual-algorithm framework to generate two metallic-based metamaterial designs that match the acoustic impedance of water while exhibiting a controlled gradient in stiffness (from stiff to soft). The stiffness gradient is particularly advantageous in applications where one side of the structure must interface with soft or sensitive surfaces, such as human tissue or delicate components. Here, this work paves the way for improved materials in various acoustic applications, particularly in ultrasound devices, by providing better impedance.

Metamaterial↗
DOE OSTI2021

Prediction of the Thermal Runaway Limit and Optimal Operation of Heat Transfer-Limited, Fixed-Bed Reactor Systems

Here, we derive a new prediction for thermal runaway starting from the alpha model for fixed-bed reactor systems. This method accounts for thermal resistance internal to the reactor tube and the radial temperature gradients that result. To showcase our method, we compare its predictions to other common criteria for thermal runaway using o-xylene oxidation as the example chemistry. Even in systems where internal heat transfer is negligible, the empirical practical design criterion for thermal runaway is inaccurate. For cases where internal heat transfer is relevant, our runaway limit is more stringent than limits derived from simpler 1-D models. To augment our work, we optimize the product yield with the thermal runaway constraint using orthogonal collocation. Using the alpha model, the results illustrate that the thermal runaway limit can be accurately determined using either numerical or analytical methods.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗