Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Regularization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Accelerated fast iterative shrinkage thresholding algorithms for sparsity-regularized cone-beam CT image reconstruction

Purpose: The development of iterative image reconstruction algorithms for cone-beam computed tomography (CBCT) remains an active and important research area. Even with hardware acceleration, the overwhelming majority of the available 3D iterative algorithms that implement nonsmooth regularizers remain computationally burdensome and have not been translated for routine use in time-sensitive applications such as image-guided radiation therapy (IGRT). In this work, two variants of the fast iterative shrinkage thresholding algorithm (FISTA) are proposed and investigated for accelerated iterative image reconstruction in CBCT. Methods: Algorithm acceleration was achieved by replacing the original gradient-descent step in the FISTAs by a subproblem that is solved by use of the ordered subset simultaneous algebraic reconstruction technique (OS-SART). Due to the preconditioning matrix adopted in the OS-SART method, two new weighted proximal problems were introduced and corresponding fast gradient projection-type algorithms were developed for solving them. We also provided efficient numerical implementations of the proposed algorithms that exploit the massive data parallelism of multiple graphics processing units. Results: The improved rates of convergence of the proposed algorithms were quantified in computer-simulation studies and by use of clinical projection data corresponding to an IGRT study. The accelerated FISTAs were shown to possess dramatically improved convergence properties as compared to the standard FISTAs. For example, the number of iterations to achieve a specified reconstruction error could be reduced by an order of magnitude. Volumetric images reconstructed from clinical data were produced in under 4 min. Conclusions: The FISTA achieves a quadratic convergence rate and can therefore potentially reduce the number of iterations required to produce an image of a specified image quality as compared to first-order methods. We have proposed and investigated accelerated FISTAs for use with two nonsmooth penalty functions that will lead to further reductions in image reconstruction times while preserving image quality. Moreover, with the help of a mixed sparsity-regularization, better preservation of soft-tissue structures can be potentially obtained. The algorithms were systematically evaluated by use of computer-simulated and clinical data sets.

60 APPLIED LIFE SCIENCES↗

Use of regularized principal component analysis to model anatomical changes during head and neck radiation therapy for treatment adaptation and response assessment

Purpose: To develop standard (SPCA) and regularized (RPCA) principal component analysis models of anatomical changes from daily cone beam CTs (CBCTs) of head and neck (H&N) patients and assess their potential use in adaptive radiation therapy, and for extracting quantitative information for treatment response assessment. Methods: Planning CT images of ten H&N patients were artificially deformed to create “digital phantom” images, which modeled systematic anatomical changes during radiation therapy. Artificial deformations closely mirrored patients’ actual deformations and were interpolated to generate 35 synthetic CBCTs, representing evolving anatomy over 35 fractions. Deformation vector fields (DVFs) were acquired between pCT and synthetic CBCTs (i.e., digital phantoms) and between pCT and clinical CBCTs. Patient-specific SPCA and RPCA models were built from these synthetic and clinical DVF sets. EigenDVFs (EDVFs) having the largest eigenvalues were hypothesized to capture the major anatomical deformations during treatment. Results: Principal component analysis (PCA) models achieve variable results, depending on the size and location of anatomical change. Random changes prevent or degrade PCA’s ability to detect underlying systematic change. RPCA is able to detect smaller systematic changes against the background of random fraction-to-fraction changes and is therefore more successful than SPCA at capturing systematic changes early in treatment. SPCA models were less successful at modeling systematic changes in clinical patient images, which contain a wider range of random motion than synthetic CBCTs, while the regularized approach was able to extract major modes of motion. Conclusions: Leading EDVFs from the both PCA approaches have the potential to capture systematic anatomical change during H&N radiotherapy when systematic changes are large enough with respect to random fraction-to-fraction changes. In all cases the RPCA approach appears to be more reliable at capturing systematic changes, enabling dosimetric consequences to be projected once trends are established early in a treatment course, or based on population models.

60 APPLIED LIFE SCIENCES↗

Electrostatic self-force in the field of an (n + 1)-dimensional black hole: Dimensional regularization

The self-energy of a classical charged particle localized at a relatively large distance outside the event horizon of an (n + 1)-dimensional Schwarzschild–Tangherlini black hole for an arbitrary n ≥ 3 is calculated. An expression for the electrostatic Green function is derived in the first two orders of the perturbation theory. Dimensional regularization is proposed to be used to regularize the corresponding formally divergent expression for the self-energy. The derived expression for the renormalized self-energy is compared with the results of other authors.

79 ASTRONOMY AND ASTROPHYSICS↗

NSVZ Relation in Supersymmetric Theories Regularized by Higher Derivatives

We investigate the NSVZ equation in N=1 supersymmetric gauge theories, which relates the β ‑function to the anomalous dimension of the matter superfields. In particular, we argue that it is closely connected with the non-renormalization theorem for the three-point gauge-ghost vertices (in which one external leg corresponds to the quantum gauge superfield). Using finiteness of these vertices the exact NSVZ β -function can be equivalently presented in the form of a relation between the β -function and the anomalous dimensions of the quantum gauge superfield, of the Faddeev–Popov ghosts, and of the matter superfields. This equation allows explaining how the NSVZ equation appears in the perturbation theory for theories regularized by higher covariant derivatives and constructing the NSVZ scheme in all orders in the case of using this regularization. The results are verified by an explicit three-loop calculation of the terms quartic in the Yukawa couplings.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Posterior Regularized Bayesian Neural Network

Traditional NNs often lack the ability for uncertainty quantification. Bayesian NNs(BNNs) could help measure the confidence level by using distributions in NNs modeling. Besides, knowledge is commonly available and could improve the performance of BNNs if it can be properly incorporated. In this work, we propose a novel Posterior-Regularized BNN(PR-BNN) model by incorporating soft and hard constraints as a posterior regularization term. We also propose an augmented Lagrangian method and stochastic optimization algorithm for efficient updating via Monte Carlo sampling. The simulations and case studies for solar PV plants have shown the performance improvement of the proposed model over traditional BNNs.

97 MATHEMATICS AND COMPUTING↗

Georgia Tech Accelerated, Compressed, and Regularized Compute of Kinetic-based PDEs (Final Report)

This report summarizes the collaborative effort between Lawrence Livermore National Laboratory and Georgia Tech to enhance the BoBa library for tensor train computation in PDE solvers, with a target on kinetic equations and their continuum limits. We aimed to reduce computational cost and memory usage by replacing traditional array-based computations with tensor trains. We examined the compressibility of time-evolving solutions to the Euler equations with discontinuities. We also explored using the first invsicid and linear regularization of the compressible flow equations via the information geometric regularization (IGR). We explored this in a tensor train formulation. To identify that inverse terms in the IGR equations pose problems for tensor train formulations and investigate efficient methods for batched inversion of tensor trains.

97 MATHEMATICS AND COMPUTING↗

Regularizing Invertible Neural Networks for Airfoil Design Through Dimension Reduction

This work examines how dimension reduction can improve the performance of invertible neural networks (INN) for airfoil design. Design workflows are typically expensive, relying on many evaluations of high fidelity computational fluid dynamics (CFD) models. Furthermore, the inverse design problem is typically ill-posed. That is, multiple valid solutions exist that satisfy the design criteria. Regularization can reduce this inverse design space and simplify the problem. We study the use of subspace-based input dimension reduction to act as a regularizer for the INN model and improve the recovery of new airfoil shapes with desired performance characteristics. We find that the dimension reduction identifies two dominant modes, relating to airfoil thickness and camber, that optimally determine the airfoil's aerodynamics. We demonstrate the capability of the proposed INN model to generate 100 airfoils that satisfy the specific aerodynamic and structural characteristics.

airfoil design↗

SYSTEMATIC REGULARITY OF HEMISPHERIC SUNSPOT AREAS OVER THE PAST 140 YEARS

Solar magnetic activity varies with time in the two hemispheres in different ways. The hemispheric interconnection of solar activity phenomena provides an important clue to understanding the dynamical behavior of solar dynamo actions. In this paper, several analysis approaches are proposed to analyze the systematic regularity of hemispheric asynchronism and amplitude asymmetry of long-term sunspot areas during solar cycles 9–24. It is found that, (1) both the hemispheric asynchronism and the amplitude asymmetry of sunspot areas are prevalent behaviors and are not anomalous, but the hemispheric asynchronism exhibits a much more regular behavior than the amplitude asymmetry; (2) the phase-leading hemisphere returns back to the identical hemisphere every 8 solar cycles, and the secular periodic pattern of hemispheric phase differences follows 3 (south leading) + 5 (north leading) solar cycles, which probably corresponds to the Gleissberg cycle; and (3) the pronounced periodicities of (absolute and normalized) asymmetry indices and lines of synchronization (LOSs) are not identical: the significant periodic oscillations are 80.65 ± 6.31, 20.91 ± 0.40, and 13.45 ± 0.16 years for the LOS values, and 51.34 ± 2.48, 8.83/8.69 ± 0.07, and 3.77 ± 0.02 years for the (absolute and normalized) asymmetry indices. The analysis results improve our knowledge on the hemispheric interrelation of solar magnetic activity and may provide valuable constraints for solar dynamo models.

79 ASTRONOMY AND ASTROPHYSICS↗

Unexpected series of regular frequency spacing of δ Scuti stars in the non-asymptotic regime. II. Sample-Echelle diagrams and rotation

A sequence search method was developed for searching for regular frequency spacing in δ Scuti stars by visual inspection (VI) and algorithmic search. The sample contains 90 δ Scuti stars observed by CoRoT. An example is given to represent the VI. The algorithm (SSA) is described in detail. The data treatment of the CoRoT light curves, the criteria for frequency filtering, and the spacings derived by two methods (i.e., three approaches: VI, SSA, and FT) are given for each target. Echelle diagrams are presented for 77 targets for which at least one sequence of regular spacing was identified. Comparing the spacing and the shifts between pairs of echelle ridges revealed that at least one pair of echelle ridges is shifted to midway between the spacing for 22 stars. The estimated rotational frequencies compared to the shifts revealed rotationally split doublets, triplets, and multiplets not only for single frequencies, but for the complete echelle ridges in 31 δ Scuti stars. Furthermore, using several possible assumptions for the origin of the spacings, we derived the large separation (${\rm{\Delta }}\nu $) that are distributed along the mean density versus large separations relation derived from stellar models.

79 ASTRONOMY AND ASTROPHYSICS↗

Fuel Stratification Effects on Gasoline Compression Ignition with a Regular-Grade Gasoline on a Single-Cylinder Medium-Duty Diesel Engine at Low Load

Prior research studies have investigated a wide variety of gasoline compression ignition (GCI) injection strategies and the resulting fuel stratification levels to maintain control over the combustion phasing, duration, and heat release rate. Previous GCI research at the US Department of Energy’s Oak Ridge National Laboratory has shown that for a combustion mode with a low degree of fuel stratification, called “partial fuel stratification” (PFS), gasoline range fuels with anti-knock index values in the range of regular-grade gasoline (~87 anti-knock index or higher) provides very little controllability over the timing of combustion without significant boost pressures. On the contrary, heavy fuel stratification (HFS) provides control over combustion phasing but has challenges achieving low temperature combustion operation, which has the benefits of low NOX and soot emissions, because of the air handling burdens associated with the required high exhaust gas recirculation rates. Furthermore, this work investigates HFS and PFS combustion, efficiency, and emissions performance on a single-cylinder, medium-duty engine with a regular-grade gasoline (91 research octane number) at 1,200 rpm, 4.3 bar, and 3.0 nominal gross indicated mean effective pressure operating points with boost levels similar to those in a medium-duty diesel application. Authority of combustion phasing with main injection timing sweeps for HFS and second injection timing sweeps and fuel split sweeps for PFS are shown. In addition, this work is discussed in the context of previous findings with a light-duty diesel platform, and next steps and future direction for this work are presented.

33 ADVANCED PROPULSION SYSTEMS↗

Deep Neural Networks are Adaptive to Function Regularity and Data Distribution in Approximation and Estimation

Deep learning has exhibited remarkable results across diverse areas. To understand its success, substantial research has been directed towards its theoretical foundations. Nev- ertheless, the majority of these studies examine how well deep neural networks can model functions with uniform regularities. In this paper, we explore a different angle: how deep neural networks can adapt to varying degrees of smoothness in functions and nonuni- form data distributions across different locations and scales. More precisely, we focus on a broad class of functions defined by nonlinear tree-based approximation methods. This class encompasses a range of function types, such as functions with uniform regularities and discontinuous functions. We develop nonparametric approximation and estimation theories for this class using deep ReLU networks. Our results show that deep neural networks are adaptive to the nonuniform smoothness of functions and nonuniform data distributions at different locations and scales. We apply our results to several function classes, and derive the corresponding approximation and generalization errors. The validity of our results is demonstrated through numerical experiments.

97 MATHEMATICS AND COMPUTING↗

Physically regularized machine learning emulators of aerosol activation

Abstract. The activation of aerosol into cloud droplets is an important step in the formation of clouds and strongly influences the radiative budget of the Earth. Explicitly simulating aerosol activation in Earth system models is challenging due to the computational complexity required to resolve the necessary chemical and physical processes and their interactions. As such, various parameterizations have been developed to approximate these details at reduced computational cost and accuracy. Here, we explore how machine learning emulators can be used to bridge this gap in computational cost and parameterization accuracy. We evaluate a set of emulators of a detailed cloud parcel model using physically regularized machine learning regression techniques. We find that the emulators can reproduce the parcel model at higher accuracy than many existing parameterizations. Furthermore, physical regularization tends to improve emulator accuracy, most significantly when emulating very low activation fractions. This work demonstrates the value of physical constraints in machine learning model development and enables the implementation of improved hybrid physical and machine learning models of aerosol activation into next-generation Earth system models.

58 GEOSCIENCES↗

Trajectory optimization using regularized variables

Regularized equations for a particular optimal trajectory are compared with unregularized equations with respect to computational characteristics, using perturbation type numerical optimization. In the case of the three dimensional, low thrust, Earth-Jupiter rendezvous, the regularized equations yield a significant reduction in computer time.

Lewallen, J. M.↗

The topology of the regularized integral surfaces of the 3-body problem.

A method is described by which the integral surface can be modified in such a way that Newton's equations of motion actually give a flow. The process of regularization of vector fields by surgery, as described by the author (1971) is reviewed. The planar 3-body problem and its regularization, and the topology of the integral surfaces are considered. The Lagrange-Jacobi identity is used to show that there exists an isolating block such that any orbit which ends in a triple collision must enter and remain in this block.

Easton, R.↗

Solar reflection from a regular array of horizontally finite clouds

The reflected flux from a regular array of 2- and 3-D clouds has been computed to estimate the effect of fractional cloud cover on albedos and the solar flux available to heat the earth's surface. The broken clouds are represented by a regular array of identical cuboids for the 3-D problem and equally spaced, infinitely long, bars for the 2-D problem. A diffusion approximation to the radiative transfer equation is used to compute the fluxes leaving each face of the cloud. Interaction between clouds is simulated by assuming diffuse exitance from the cloud faces and applying angle factors to obtain modified boundary conditions on each cloud face.

Weinman, J. A.↗

Application of the regular associated solution model to the Cd-Te and Hg-Te binary systems

The regular associated solution model is used to treat the phase diagrams of the binary II-VI semiconductor alloy systems Hg-Te and Cd-Te. The equations for the species activity coefficients are used without approximations regarding the magnitudes of the various binary interchange energies or the functional dependence on component mol fraction. The values of the four-adjustable parameters required for description of each system are fixed by fitting liquidus data, and the resulting activity coefficients are used to calculate component partial pressures, which are compared with experimental values as an indpendent check of the validity of the model. The results show that the regular associated solution model provides a usefully accurate, but not complete, description for both the Hg-Te and Cd-Te systems. The relationship of this work to previous investigations is discussed.

Kelley, J. D.↗

Autocorrelation and regularization in digital images. I - Basic theory

Spatial structure occurs in remotely sensed images when the imaged scenes contain discrete objects that are identifiable in that their spectral properties are more homogeneous within than between them and other scene elements. The spatial structure introduced is manifest in statistical measures such as the autocovariance function and variogram associated with the scene, and it is possible to formulate these measures explicitly for scenes composed of simple objects of regular shapes. Digital images result from sensing scenes by an instrument with an associated point spread function (PSF). Since there is averaging over the PSF, the effect, termed regularization, induced in the image data by the instrument will influence the observable autocovariance and variogram functions of the image data. It is shown how the autocovariance or variogram of an image is a composition of the underlying scene covariance convolved with an overlap function, which is itself a convolution of the PSF. The functional form of this relationship provides an analytic basis for scene inference and eventual inversion of scene model parameters from image data.

Jupp, David L. B.↗

Analysis of regularized Navier-Stokes equations, 2

A practically important regularization of the Navier-Stokes equations was analyzed. As a continuation of the previous work, the structure of the attractors characterizing the solutins was studied. Local as well as global invariant manifolds were found. Regularity properties of these manifolds are analyzed.

Ou, Yuh-Roung↗