Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Regularization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Effects of Jacobian Matrix Regularization on the Detectability of Adversarial Samples

The well-known vulnerability of Deep Neural Networks to adversarial samples has led to a rapid cycle of increasingly sophisticated attack algorithms and proposed defenses. While most contemporary defenses have been shown to be vulnerable to carefully configured attacks, methods based on gradient regularization and out-of-distribution detection have attracted much interest recently by demonstrating higher resilience to a broad range of attack algorithms. However, no study has yet investigated the effect of combining these techniques. In this paper, we consider the effect of Jacobian matrix regularization on the detectability of adversarial samples on the CIFAR-10 image benchmark dataset. We find that regularization has a significant effect on detectability, and in some cases can make an undetectable attack on a baseline model detectable. In addition, we give evidence that regularization may mitigate the known weaknesses of detectors to high-confidence adversarial samples. The defenses we consider here are highly generalizable, and we believe they will be useful for further investigations to transfer machine learning robustness to other data domains.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

LANL Regular Employee Population and Demographics, FY15-21

This document summarizes an effort to compile and analyze the LANL regular employee population’s demographic attributes and trends between FY15-FY21 using MicroStrategy, a web-based data analytics and visualization tool. LANL’s HR Division collected and prepared data for the Weapons Program’s annual reporting activities for the 2017 through 2023 NNSA Stockpile Stewardship and Management Plan (SSMP). Los Alamos workforce data represent the fiscal year-end snapshot of the permanent employee population who are categorized by the Common Occupational Classification System (COCS). This work enables further analyses, including trends for all workforce attributes presented in the SSMPs as well as a definition of a crosswalk between COCS categorization and the internal laboratory job classification hierarchy. Data for other sites and the federal workforce, as shown in the SSMPs, are included and corresponding figures can be visualized within the MicroStrategy tool. A portable, Excel-based version of the tool was developed and shared with the multi-site workforce working group. This summary highlights selected aspects of the LANL regular workforce. The data analyses and visualizations communicate insights within three major themes regarding permanent LANL employees: 1) demographic transformation, 2) attrition, and 3) skills. Regarding demographic transformation, and consistent with the general trend across the enterprise, early career regular employees are the fastest growing group, with growth ranging between 12-34% year-to-year over the seven-year period analyzed. The data also reflect effects of internal and external factors on attrition; the large spike in separations in FY18 aligns with the contract transition from LANS to Triad and the dip in attrition between FY20-FY21 is likely a result of the global pandemic. The population of regular employees in general management, engineer, and operator COCS categories have the fastest growth rates amongst all the occupational categories. The MicroStrategy and Excel tools provide additional details and trends.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Topological Regularization via Persistence-Sensitive Optimization

Optimization, a key tool in machine learning and statistics, relies on regularization to reduce overfitting. Traditional regularization methods control a norm of the solution to ensure its smoothness. Recently, topological methods have emerged as a way to provide a more precise and expressive control over the solution, relying on persistent homology to quantify and reduce its roughness. All such existing techniques back-propagate gradients through the persistence diagram, which is a summary of the topological features of a function. Their downside is that they provide information only at the critical points of the function. We propose a method that instead builds on persistence-sensitive simplification and translates the required changes to the persistence diagram into changes on large subsets of the domain, including both critical and regular points. This approach enables a faster and more precise topological regularization, the benefits of which we illustrate with experimental evidence.

Nigmetov, Arnur↗

Topological terms with qubit regularization and relativistic quantum circuits

Qubit regularization provides a rich framework to explore quantum field theories. The freedom to choose how the important symmetries of the theory are embedded in the qubit regularization scheme allows us to construct new lattice models with rich phase diagrams. Some of the phases can contain topological terms which lead to critical phases. In this work we introduce and study the SU(3)-F qubit regularization scheme to embed the SO(3) spin-symmetry. We argue that qubit models in this regularization scheme contain several phases including a critical phase which describes the k = 1 Wess-Zumino-Witten (WZW) conformal field theory (CFT) at long distances, and two massive phases one of which is trvially gapped and the other which breaks the lattice translation symmetry. We construct a simple space-time Euclidean lattice model with a single coupling U and study it using the Monte Carlo method. We show the model has a critical phase at small U and a trivially massive phase at large U with a first order transition separating the two. Another feature of our model is that it is symmetric under space-time rotations, which means the temporal and spatial lattice spacing are connected to each other. The unitary time evolution operator obtained by a Wick rotation of the transfer matrix of our model can help us compute the physics of the k = 1 WZW CFT in real time without the need for tuning the temporal lattice spacing to zero. We use this idea to introduce the concept of a relativistic quantum circuit on a discrete space-time lattice.

Bhattacharya, Tanmoy↗

A computational investigation of the finite-time blow-up of the 3D incompressible Euler equations based on the Voigt regularization

We report the results of a computational investigation of two blow-up criteria for the 3D incompressible Euler equations. One criterion was proven in a previous work, and a related criterion is proved here. These criteria are based on an inviscid regularization of the Euler equations known as the 3D Euler-Voigt equations, which are known to be globally well-posed. Moreover, simulations of the 3D Euler-Voigt equations also require less resolution than simulations of the 3D Euler equations for xed values of the regularization parameter α > 0. Therefore, the new blow-up criteria allow one to gain information about possible singularity formation in the 3D Euler equations indirectly; namely, by simulating the better-behaved 3D Euler-Voigt equations. The new criteria are only known to be suficient for blow-up. Therefore, to test the robustness of the inviscid-regularization approach, we also investigate analogous criteria for blow-up of the 1D Burgers equation, where blow-up is well-known to occur.

97 MATHEMATICS AND COMPUTING↗

A micromorphically regularized Cam-clay model for capturing size-dependent anisotropy of geomaterials

Here we introduce a regularized anisotropic modified Cam-clay (MCC) model which captures the size-dependent anisotropic elastoplastic responses for clay, mudstone, shales, and sedimentary rock. By homogenizing the multiscale anisotropic effects induced by clay particle aggregate, clusters, peds, micro-fabric, and mineral contact across length scales, we introduce two distinctive anisotropic mechanisms for the MCC model at the material point and mesoscale levels. We first employ a mapping that links the anisotropic stress state to a fictitious isotropic principal stress-space to introduce anisotropy at the material point scale. Then, the mesoscale anisotropy is introduced via an anisotropic regularization mechanism. This anisotropic regularization mechanism is triggered by introducing gradient-dependence of the internal variables through a penalty method such that the resultant gradient-enhanced plastic flow may exhibit anisotropic responses non-coaxial to the stress gradient of the yield function. The influence of the size-dependent anisotropy on the formation of the shear band and the macroscopic responses of the effective media are analyzed in 2D and 3D numerical examples.

42 ENGINEERING↗

Customizable adaptive regularization techniques for B-spline modeling

B-spline models are a powerful way to represent scientific data sets with a functional approximation. However, these models can suffer from spurious oscillations when the data to be approximated are not uniformly distributed. Model regularization (i.e., smoothing) has traditionally been used to minimize these oscillations; unfortunately, it is sometimes impossible to sufficiently remove unwanted artifacts without smoothing away key features of the data set. In this article, we present a method of model regularization that preserves significant features of a data set while minimizing artificial oscillations. Our method varies the strength of a smoothing parameter throughout the domain automatically, removing artifacts in poorly-constrained regions while leaving other regions unchanged. Further, the proposed method selectively incorporates regularization terms based on first and second derivatives to maintain model accuracy while minimizing numerical artifacts. The behavior of our method is validated on a collection of two- and three-dimensional data sets produced by scientific simulations. In addition, a key tuning parameter is highlighted and the effects of this parameter are presented in detail. This paper is an extension of our previous conference paper at the 2022 International Conference on Computational Science (ICCS) (Lenz et al., 2022).

97 MATHEMATICS AND COMPUTING↗

Group‐sparsity regularization for ill‐posed subsurface flow inverse problems

Abstract Sparse representations provide a flexible and parsimonious description of high‐dimensional model parameters for reconstructing subsurface flow property distributions from limited data. To further constrain ill‐posed inverse problems, group‐sparsity regularization can take advantage of possible relations among the entries of unknown sparse parameters when: (i) groups of sparse elements are either collectively active or inactive and (ii) only a small subset of the groups is needed to approximate the parameters of interest. Since subsurface properties exhibit strong spatial connectivity patterns they may lead to sparse descriptions that satisfy the above conditions. When these conditions are established, a group‐sparsity regularization can be invoked to facilitate the solution of the resulting inverse problem by promoting sparsity across the groups. The proposed regularization penalizes the number of groups that are active without promoting sparsity within each group. Two implementations are presented in this paper: one based on the multiresolution tree structure of Wavelet decomposition, without a need for explicit prior models, and another learned from explicit prior model realizations using sparse principal component analysis (SPCA). In each case, the approach first classifies the parameters of the inverse problem into groups with specific connectivity features, and then takes advantage of the grouped structure to recover the relevant patterns in the solution from the flow data. Several numerical experiments are presented to demonstrate the advantages of additional constraining power of group‐sparsity in solving ill‐posed subsurface model calibration problems.

Golmohammadi, Azarang↗

Vortex Dynamic Phases in Type II Superconducting Strips with Regular and Flattened Triangular Pinning Arrays

The dynamic behavior of vortices in type II superconducting infinite strips is simulated with two types of triangular pinning lattices: the regular one and a flattened triangular array that mimics the vortex lattice in a superconducting strip in the absence of a pinning array. The calculations were made at zero temperature and perpendicular magnetic field. The size effects are investigated for several strip widths maintaining the density and size of pinning centers unchanged. A driving force is applied in the infinite direction to analyze the depinning process and the different dynamic regimes. For the regular triangular pinning lattice, we found that there is a great richness of vortex dynamical phases because depending on strip width, part of the vortices may stabilize in different interstitial positions and the depinning process depends on the commensurability of each vortex chain. For the flattened triangular lattice, the system exhibits one ordered moving phase for narrower strips and two moving phases for the larger strip. As the transport force increases, vortices in the larger strip go from a disordered to an ordered phase. Moreover, the flattened lattice shows a much higher critical depinning force than the regular one due to commensurability effects.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Emergence of complex-regular eutectic patterns in Al–Ge: Observations from correlative nano-imaging

Eutectic solidification exemplifies nonequilibrium pattern formation, making it a well-studied moving boundary problem. Yet the mechanisms behind the formation of complex-regular microstructures – particularly in highly anisotropic systems with a significant volume fraction of a faceted phase – remain poorly understood. Our understanding of such systems is made complicated by the nonlinear interface kinetics and unique growth dynamics characteristic of faceted phases. To address these challenges, we investigate a model Al–Ge eutectic system, where the faceted Ge phase constitutes a substantial volume fraction (~0.35) and where the two solid phases arrange into so-called “fishbone” or “feather” complex-regular patterns. Using synchrotron-based x-ray nano-imaging and nanotomography with high spatial resolution (22 nm per pixel), we capture in real-time the evolution of the solid–liquid interfaces and the resulting three-dimensional microstructures in this faceted/non-faceted eutectic system. By integrating these observations with electron backscattered diffraction, we elucidate the crystallographic biases on the solidification process and the mechanisms driving the formation of such complex-regular microstructures. These findings inform a new growth model for irregular eutectics in (near-)symmetrical phase diagrams, offering insight on advanced microstructural design and processing strategies. More broadly, we demonstrate how interfacial curvature is generated in irregular eutectic alloys and how it depends on the volume fraction of the faceted phase.

36 MATERIALS SCIENCE↗

Non-ergodic delocalized phase in Anderson model on Bethe lattice and regular graph

We develop a novel analytical approach to the problem of single particle localization in infinite dimensional spaces such as Bethe lattice and random regular graph models. The key ingredient of the approach is the notion of the inverted order thermodynamic limit (IOTL) in which the coupling to the environment goes to zero before the system size goes to infinity. Using IOTL and Replica Symmetry Breaking (RSB) formalism we derive analytical expressions for the fractal dimension D{sub 1} that distinguishes between the extended ergodic, D{sub 1}=1, and extended non-ergodic (multifractal), 0<D{sub 1}<1 states on the Bethe lattice and random regular graphs with the branching number K. We also employ RSB formalism to derive the analytical expression lnS{sub typ}{sup −1}=−〈lnS〉∼(W{sub c}−W){sup −1} for the typical imaginary part of self-energy S{sub typ} in the non-ergodic phase close to the Anderson transition in the conventional thermodynamic limit. We prove the existence of an extended non-ergodic phase in a broad range of disorder strength and energy and establish the phase diagrams of the models as a function of disorder and energy. The results of the analytical theory are compared with large-scale population dynamics and with the exact diagonalization of Anderson model on random regular graphs. We discuss the consequences of these results for the many body localization.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Dynamical evolution of scalar field thin-shell for rotating regular black holes

This work deals with the dynamical behavior of thin-shell for a class of rotating regular black holes by using Israel’s thin-shell formalism. We consider the matter distribution located at thin-shell associated with a scalar field and analyze its effects on the dynamics of thin-shell through equations of motion. The corresponding dynamical equations, i.e., equations of motion and effective potential are studied numerically for both massless as well as massive scalar fields. It is found that the presence of charge as well as rotation parameter decreases the expanding and collapsing nature of the scalar field thin-shell. We conclude that the rate of collapse and expansion of rotating regular black holes is less than non-rotating regular black holes. Finally, the massless scalar field shell shows expansion, collapse and stable points while the massive case leads to collapse only for specific values of integrating constant.

79 ASTRONOMY AND ASTROPHYSICS↗

Attaining regularization length insensitivity in phase-field models of ductile failure

In this work, a cohesive phase-field model of ductile fracture in a finite-deformation setting is presented. The model is based on a free-energy function in which both elastic and plastic work contributions are coupled to damage. Using a strictly variational framework, the field evolution equations, damage kinetics, and flow rule are jointly derived from a scalar least-action principle. Particular emphasis is placed on the use of a rational function for the stress degradation that maintains a fixed effective strength with decreasing regularization length. The model is employed to examine crack growth in pure mode-I problems through the generation of crack growth resistance (J-R) curves. In contrast to alternative models, the current formulation gives rise to J-R curves that are insensitive to the regularization length. Numerical evidence suggests convergence of local fields with respect to diminishing regularization length as well.

42 ENGINEERING↗

Multi-omic data integration enables discovery of hidden biological regularities

Rapid growth in size and complexity of biological data sets has led to the ‘Big Data to Knowledge’ challenge. We develop advanced data integration methods for multi-level analysis of genomic, transcriptomic, ribosomal profiling, proteomic and fluxomic data. First, we show that pairwise integration of primary omics data reveals regularities that tie cellular processes together in Escherichia coli: the number of protein molecules made per mRNA transcript and the number of ribosomes required per translated protein molecule. Second, we show that genome-scale models, based on genomic and bibliomic data, enable quantitative synchronization of disparate data types. Integrating omics data with models enabled the discovery of two novel regularities: condition invariant in vivo turnover rates of enzymes and the correlation of protein structural motifs and translational pausing. These regularities can be formally represented in a computable format allowing for coherent interpretation and prediction of fitness and selection that underlies cellular physiology.

59 BASIC BIOLOGICAL SCIENCES↗

Assessing the effect of regularization on the molecular properties predicted by SCAN and self-interaction corrected SCAN meta-GGA

Recent regularization of the SCAN meta-GGA functional (rSCAN) has simplified the numerical complexities of the SCAN functional, alleviating SCAN's stringent demand on the numerical integration grids to some extent. The regularization of rSCAN, however, results in the breaking of some constraints such as the uniform electron gas limit, the slowly varying density limit, and coordinate scaling of the iso-orbital indicator. Here, we assess the effects of regularization on the electronic, structural, vibrational, and magnetic properties of molecules by comparing the SCAN and rSCAN predictions. The properties studied include atomic energies, atomization energies, ionization potentials, electron affinities, barrier heights, infrared intensities, dissociation and reaction energies, spin moments of molecular magnets, and isomer ordering of water clusters. Our results show that rSCAN requires less dense numerical grids and gives very similar results to those of SCAN for all properties examined with the exception of atomization energies, which are worsened in rSCAN. We also examine the performance of self-interaction-corrected (SIC) rSCAN with respect to SIC-SCAN using the Perdew–Zunger (PZ) SIC method. The PZSIC method uses orbital densities to compute one-electron self-interaction errors and places an even more stringent demand on numerical grids. Our results show that SIC-rSCAN gives marginally better performance than SIC-SCAN for almost all properties studied in this work with numerical grids that are on average half or less as dense as that needed for SIC-SCAN.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Remarks on the regularity criteria of three-dimensional magnetohydrodynamics system in terms of two velocity field components

We study the three-dimensional magnetohydrodynamics system and obtain its regularity criteria in terms of only two velocity vector field components eliminating the condition on the third component completely. The proof consists of a new decomposition of the four nonlinear terms of the system and estimating a component of the magnetic vector field in terms of the same component of the velocity vector field. This result may be seen as a component reduction result of many previous works [C. He and Z. Xin, “On the regularity of weak solutions to the magnetohydrodynamic equations,” J. Differ. Equ. 213(2), 234–254 (2005); Y. Zhou, “Remarks on regularities for the 3D MHD equations,” Discrete Contin. Dyn. Syst. 12(5), 881–886 (2005)].

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

L{sub 1/2} regularization based numerical method for effective reconstruction of bioluminescence tomography

Even though bioluminescence tomography (BLT) exhibits significant potential and wide applications in macroscopic imaging of small animals in vivo, the inverse reconstruction is still a tough problem that has plagued researchers in a related area. The ill-posedness of inverse reconstruction arises from insufficient measurements and modeling errors, so that the inverse reconstruction cannot be solved directly. In this study, an l{sub 1/2} regularization based numerical method was developed for effective reconstruction of BLT. In the method, the inverse reconstruction of BLT was constrained into an l{sub 1/2} regularization problem, and then the weighted interior-point algorithm (WIPA) was applied to solve the problem through transforming it into obtaining the solution of a series of l{sub 1} regularizers. The feasibility and effectiveness of the proposed method were demonstrated with numerical simulations on a digital mouse. Stability verification experiments further illustrated the robustness of the proposed method for different levels of Gaussian noise.

60 APPLIED LIFE SCIENCES↗

Contrary interfacial exciton dissociation at metal/organic interface in regular and reverse configuration organic solar cells

An opposite interfacial exciton dissociation behavior at the metal (Al)/organic cathode interface in regular and inverted organic solar cells (OSCs) was analyzed using transient photocurrent measurements. It is found that Al/organic contact in regular OSCs, made with the blend layer of poly[[4,8-bis[(2-ethylhexyl)oxy]benzo[1,2-b:4,5-b′]dithiophene-2,6-diyl] -[3-fluoro-2-[(2-ethylhexyl)carbonyl]thieno[3,4-b]-thiophenediyl]] (PTB7):3′H-Cyclopropa [8,25][5,6] fullerene-C70-D5h(6)-3′-butanoicacid,3′-phenyl-,methyl ester (PC{sub 70}BM), always hampers the electron collection. However, this is not observed in their reverse geometry OSCs fabricated using the same PTB7:PC{sub 70}BM blend system. The detrimental interfacial exciton dissociation in regular OSCs originates the compensation of field drifted photo-generated electrons at Al/organic interface. The unfavorable interfacial exciton dissociation can be eliminated, e.g., by interposing a ZnO-based interlayer between Al and organic layer, attaining an efficient electron collection, thereby power conversion efficiency.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗