Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Regularization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Regularizing INR with Diffusion Prior for Self-Supervised 3D Reconstruction OF Neutron Computed Tomography Data

Recently, generative diffusion priors have made huge strides as inverse problem solvers, including the ability to be adapted for inference on out-of-distribution data. Concurrently, implicit neural representations (INRs) have emerged as fast and lightweight inverse imaging solvers that are amenable to hybrid approaches that combine learned priors with traditional inverse problem formulations. In this paper, we present a diffusive computed tomography (CT) inversion framework for regularizing INRs called Diffusive INR (DINR), designed to enable high-quality reconstruction from sparse-view neutron CT. Pretrained purely on synthetic data, DINR is evaluated on simulated and experimentally obtained observations of concrete microstructures, where traditional reconstruction methods suffer substantial degradation when the number of views is reduced. Our approach delivers superior performance, reduces reconstruction artifacts, and achieves gains in PSNR and SSIM, enabling accurate micro-structural characterization even under extreme data limitations compared to state-of-the-art sparse-view reconstruction techniques.

Hossain, Maliha [ORNL]↗

DENSECL: Haze Mitigation Using Dense Blocks and Contrastive Loss Regularization

Haze, which occurs as a result of the scattering of light in the atmosphere by small particles, diminishes the visibility of scene objects, inflicting important image applications such as object detection. To address the problem, this paper introduces a new physics-based end-to-end deep learning approach to haze mitigation in outdoor scenes, including those in airborne images. The proposed model named DenseCL is designed with dense blocks and adopts a contrastive loss function as an additional regularization. The model also maintains the cycle consistency by remapping the dehazed outputs into a hazy image using the physics-based light scattering function. DenseCL has been trained with publicly available outdoor images and demonstrates outstanding performance on outdoor, indoor, and remotely sensed nonhomogeneous haze satellite images.

Mitra, Somosmita↗

REV-INR: Regularized Evidential Implicit Neural Representation for Uncertainty-Aware Volume Visualization

Applications of Implicit Neural Representations (INRs) have emerged as a promising deep learning approach for compactly representing large volumetric datasets. These models can act as surrogates for volume data, enabling efficient storage and on-demand reconstruction via model predictions. However, conventional deterministic INRs only provide value predictions without insights into the model’s prediction uncertainty or the impact of inherent noisiness in the data. This limitation can lead to unreliable data interpretation and visualization due to prediction inaccuracies in the reconstructed volume. Identifying erroneous results extracted from model-predicted data may be infeasible, as raw data may be unavailable due to its large size. To address this challenge, we introduce REV-INR, Regularized Evidential Implicit Neural Representation, which learns to predict data values accurately along with the associated coordinate-level data uncertainty and model uncertainty using only a single forward pass of the trained REV-INR during inference. By comprehensively comparing and contrasting REV-INR with existing well-established deep uncertainty estimation methods, we show that REV-INR achieves the best volume reconstruction quality with robust data (aleatoric) and model (epistemic) uncertainty estimates using the fastest inference time. Consequently, we demonstrate that REV-INR facilitates assessment of the reliability and trustworthiness of the extracted isosurfaces and volume visualization results, enabling analyses to be solely driven by model-predicted data.

Saklani, Shanu [Indian Institute of Technology, Ka↗

Enhancing Solar Power Forecasting with Regularized Constrained Quantile Regression Averaging and Bootstrapping Techniques

Probabilistic solar power forecasting (SPF) plays an essential role in optimizing power-grid operations by quantifying the forecast uncertainty. To improve the accuracy and robustness of probabilistic SPF, this paper introduces the regularized constrained quantile regression averaging (rCQRA) method to combine outputs from multiple PSPF models. In addition, a bootstrapping method was used to quantify model uncertainty, providing insights into the reliability and significance of each ensemble component. To evaluate its efficacy, the proposed rCQRA method is used to integrate four PSPF methods. The resulting SPF models are trained and validated using a real-world six-year dataset from a rooftop solar plant in the USA. The performance of the proposed rCQRA method is evaluated and compared with two benchmark methods under three categories of weather conditions. It is shown that the rCQRA method has superior performance in its forecast reliability, sharpness, and accuracy.

Ensemble learning, probabilistic solar power forec↗

O3BNN-R: An Out-Of-Order Architecture for High-Performance and Regularized BNN Inference

Binarized Neural Networks (BNN) have drawn tremendous attention due to significantly reduced computational complexity and memory demand. They have especially shown great potential in cost- and power-restricted domains, such as IoT and smart edge-devices, where reaching a certain accuracy bar is often sufficient, and real-time is highly desired.In this work, we demonstrate that the highly-condensed BNN model can be shrunk significantly further by dynamically pruning irregular redundant edges. Based on two new observations on BNN-specific properties, an out-of-order (OoO) architecture – O3BNN-R, can curtail edge evaluation in cases where the binary output of a neuron can be determined early. Similar to Instruction-Level-Parallelism(ILP), these fine-grained, irregular, runtime pruning opportunities are traditionally presumed to be difficult to exploit. In order to increase the pruning opportunities, we also optimize the training process by adding 2 regularization items in the loss function (1) for pooling pruning and (2) for threshold pruning. We evaluate our design on an FPGA platform using three well-known networks, including VggNet-16, AlexNet for ImageNet, and a VGG-like network for Cifar-10.

Geng, Tong↗

Hydrodynamic Analysis of a Suspended Cylinder Under Regular Wave Loading Based on Computational Fluid Dynamics

An investigation into the computation of hydrodynamic loads on a suspended cylinder in regular waves is presented. The primary goal was to perform a three-way validation of the loads between experimental measurements and simulations from two computational methods. Experimental measurements of the longitudinal in-line force on a cylinder suspended at a fixed position were available from the Offshore Code Comparison Collaboration, Continued, with Correlation (OC5) project, Phase Ia. These measurements were compared to computational fluid dynamics (CFD) simulations based on the solution of Reynolds-averaged Navier-Stokes (RANS) equations, as implemented in STAR-CCM+. The study encompassed a sensitivity analysis of the loads computed in STAR-CCM+ based on wave modeling, boundary conditions, turbulence modeling, and spatial and temporal discretization. The analysis was supplemented by results generated with the offshore wind turbine engineering software OpenFAST, based on a hybrid combination of second-order potential flow and viscous drag from Morison's equation. The focus of the investigation was on the assessment of the accuracy of the computation of first- and higher-order hydrodynamic loads. Substantial differences were observed in the numerical prediction of the second and third harmonic force contribution. Local flow field analysis with CFD was applied to study the physics of wave run-up and diffraction dynamics to identify the causes.

16 TIDAL AND WAVE POWER↗

Regular and irregular dynamics of spin-polarized wavepackets in a mesoscopic quantum dot at the edge of topological insulator

The dynamics of Dirac–Weyl spin-polarized wavepackets driven by a periodic electric field is considered for the electrons in a mesoscopic quantum dot formed at the edge of the two-dimensional HgTe/CdTe topological insulator with Dirac–Weyl massless energy spectra, where the motion of carriers is less sensitive to disorder and impurity potentials. It is observed that the interplay of strongly coupled spin and charge degrees of freedom creates the regimes of irregular dynamics in both coordinate and spin channels. The border between the regular and irregular regimes determined by the strength and frequency of the driving field is found analytically within the quasiclassical approach by means of the Ince–Strutt diagram for the Mathieu equation, and is supported by full quantum-mechanical simulations of the driven dynamics. The investigation of quasienergy spectrum by Floquet approach reveals the presence of non-Poissonian level statistics, which indicates the possibility of chaotic quantum dynamics and corresponds to the areas of parameters for irregular regimes within the quasiclassical approach. We find that the influence of weak disorder leads to partial suppression of the dynamical chaos. Our findings are of interest both for progress in the fundamental field of quantum chaotic dynamics and for further experimental and technological applications of spindependent phenomena in nanostructures based on topological insulators.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Tidal Effects in Some Regular Black Holes

This paper is aimed to study the tidal forces produced by a class of regular black holes. We consider the radial infall of test particle and find radial as well as angular components of tidal forces by taking geodesic deviation equations. We also compute geodesic deviation vector by solving geodesic deviation equation numerically. It is concluded that a particle undergos either compression or stretching in radial or angular direction due to tidal forces.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

2 + 1 Flavors QCD Equation of State in NJL Model with Proper Time Regularization

In this paper, we firstly combine the 2 + 1 flavors Nambu-Jona-Lasinio (NJL) model with propertime regularization (PTR) to study the equation of state (EOS) and fix the corresponding parameters in 2 + 1 flavors system. Based on this model, we calculate chiral susceptibility and quark number susceptibility and we find a crossover with chemical potential from 220 to 400 MeV. Then we consider the chemical equilibrium and electric charge neutrality conditions in electroweak reactions, which give some constrains of chemical potentials of different quark flavors. At last, we find that the 2 + 1 flavors system is more stable than 2 flavors system after a comparison and discussion of these two cases.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

On the possible dynamical realization of the Pauli–Villars regularization

The problem of free-particle scattering on virtual wormholes is considered. It is shown that, for all types of relativistic fields, this scattering leads to the appearance of additional very heavy particles, which play the role of auxiliary fields in the invariant scheme of Pauli–Villars regularization. A nonlinear correction that describes the back reaction of particles to the vacuum distribution of virtual wormholes is also obtained.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Polarimetry of Regular and Stochastic Signals in Magnetooptics

A brief review is presented of application of the high-sensitive laser polarimetry for detecting small changes—either regular, or stochastic—of the medium magnetization. Principles and results of application of the spectroscopy of spin fluctuations to atomic and semiconductor systems are described. New possibilities of studying the radiospectroscopic and optical properties of spin systems using the methods of noise spectroscopy are considered. Prospects for expanding the circle of objects of the spin noise spectroscopy at the expense of impurity dielectrics are discussed.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Regular Microstructures Based on Polyethylene Terephthalate Films

A method for forming regular dielectric and metallic microstructures based on polyethylene terephthalate films irradiated with a synchrotron radiation source through a mask with subsequent etching. To study their geometric parameters, scanning electron microscopy was used.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Moment Representation of Regularized Lattice Boltzmann Methods on NVIDIA and AMD GPUs

The lattice Boltzmann method is a highly scalable Navier-Stokes solver that has been applied to flow problems in a wide array of domains. However, the method is bandwidth-bound on modern GPU accelerators and has a large memory footprint. In this paper, we present new 2D and 3D GPU implementations of two different regularized lattice Boltzmann methods, which are not only able to achieve an acceleration of ∼ 1.4 × w.r.t. reference lattice Boltzmann implementations but also reduce the memory requirements by up to 35% and 47% in 2D and 3D simulations respectively. These new approaches are evaluated on NVIDIA and AMD GPU architectures.

Valero Lara, Pedro↗

Simulating many-engine spacecraft: Exceeding 1 quadrillion degrees of freedom via information geometric regularization

We present an optimized implementation of the recently proposed information geometric regularization (IGR) for unprecedented scale simulation of compressible fluid flows applied to multi-engine spacecraft boosters. We improve upon state-of-the-art computational fluid dynamics (CFD) techniques in terms of computational cost, memory footprint, and energy-to-solution metrics. Unified memory on coupled CPU–GPU or APU platforms increases problem size with negligible overhead. Mixed half/single-precision storage and computation are used on well-conditioned numerics. We simulate flow at 200 trillion grid points and 1 quadrillion degrees of freedom, exceeding the current record by a factor of 20. A factor of 4 wall-time speedup is achieved over optimized baselines. Ideal weak scaling is observed on OLCF Frontier, LLNL El Capitan, and CSCS Alps using the full systems. Strong scaling is near ideal at extreme conditions, including 80% efficiency on CSCS Alps with an 8 node baseline and stretching to the full system.

Wilfong, Benjamin [Georgia Institute of Technology↗

Integrating deep neural networks with full-waveform inversion: Reparameterization, regularization, and uncertainty quantification

Full-waveform inversion (FWI) is an accurate imaging approach for modeling the velocity structure by minimizing the misfit between recorded and predicted seismic waveforms. However, the strong nonlinearity of FWI resulting from fitting oscillatory waveforms can trap the optimization in local minima. We have adopted a neural-network-based full-waveform inversion (NNFWI) method that integrates deep neural networks with FWI by representing the velocity model with a generative neural network. Neural networks can naturally introduce spatial correlations as regularization to the generated velocity model, which suppresses noise in the gradients and mitigates local minima. Furthermore, the velocity model generated by neural networks is input to the same partial differential equation (PDE) solvers used in conventional FWI. The gradients of the neural networks and PDEs are calculated using automatic differentiation, which back propagates gradients through the acoustic PDEs and neural network layers to update the weights of the generative neural network. Experiments on 1D velocity models, the Marmousi model, and the 2004 BP model determine that NNFWI can mitigate local minima, especially for imaging high-contrast features such as salt bodies, and it significantly improves the inversion in the presence of noise. Adding dropout layers to the neural network model also allows analyzing the uncertainty of the inversion results through Monte Carlo dropout. NNFWI opens a new pathway to combine deep learning and FWI for exploiting the characteristics of deep neural networks and the high accuracy of PDE solvers. Because NNFWI does not require extra training data and optimization loops, it provides an attractive and straightforward alternative to conventional FWI.

58 GEOSCIENCES↗

Regularizing least squares quantum state tomography with classical shadows

Classical shadows herald remarkable opportunities for resource-efficient quantum estimation. Although superficially disconnected from traditional inference methods, we show how classical shadows fit under a larger umbrella of least squares regularization, revealing tradeoffs with related methods.

Zhu, Zhihui [Ohio State University]↗

A Pipeline for Large Data Processing Using Regular Sampling for Unstructured Grids

Large simulation data requires a lot of time and computational resources to compute, store, analyze, visualize, and run user studies. Today, the largest cost of a supercomputer is not hardware but maintenance, in particular energy consumption. Our goal is to balance energy consumption and cognitive value of visualizations of resulting data. This requires us to go through the entire processing pipeline, from simulation to user studies. To reduce the amount of resources, data can be sampled or compressed. While this adds more computation time, the computational overhead is negligible compared to the simulation time. We built a processing pipeline at the example of regular sampling. The reasons for this choice are two-fold: using a simple example reduces unnecessary complexity as we know what to expect from the results. Furthermore, it provides a good baseline for future, more elaborate sampling methods. We measured time and energy for each test we did, and we conducted user studies in Amazon Mechanical Turk (AMT) for a range of different results we produced through sampling.

97 MATHEMATICS AND COMPUTING↗

Regularized Finite Element Formulations for Shear Band Instabilities in Metals

In my research I have addressed several fundamental issues of dynamic fracture: 1. established the role of heat conduction as a natural regularizing mechanism in shearband problems (i.e. using the correct physics for this problem), 2. developed a unified model to incorporate fracture through a modified phase field formulation, 3. developed stability analysis tools to determine the onset of localization, 4. developed discretization methods and solvers to solve this problem (on parallel computers) that lead to mesh insensitive results and fast convergence. For such difficult problems, the physics and numerics are strongly coupled. To accurately model the physics, one must develop reliable numerics but reliable numerics depends on correct description of the physics. To this end, we have already made significant progress in the field showing that a fully-coupled implicit solution with heat conduction is the key to obtain reliable results for shear bands (see the next sections for more details). This research fits well within the mission of DOE ASCR program on all aspects: from governing equations to discretization to solvers to parallel computers to applications problems. It also relies on the computational tools developed through the SciDAC institutes FASTMath and SDAV, such as PETSc (and SLEPc), ParaView, Trilinos and Masquite.

97 MATHEMATICS AND COMPUTING↗