Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “factorization machine”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

A new approach to the design of surface subsystems of polymeric insulators for HV and MV apparatus under AC voltage

The design of high voltage and medium voltage AC and DC standoff insulators, and, in general, of insulation systems where surface and interface properties are predominant factors, is based on specifications and standards that rely upon long-term experiences and lab testing. Surface insulating properties depend on electrical and thermal stresses, besides environmental factors, and the inception of extrinsic ageing phenomena, such as partial discharges, can be already a cause of reduced reliability and premature failure (for organic insulating materials). An innovative approach, based on field simulation, discharge modelling, and partial discharge inception measurements is presented by the authors, which can establish a solid basis to optimise insulation design for any type of supply voltage waveform. This method, the three-leg approach, is applied here to a cable system under AC sinusoidal voltage, but it can work for any type of insulation system, such as bushings, switch gears, transformers, rotating machines, and power electronics boards.

42 ENGINEERING↗

Identification of driver genes for critical forms of COVID-19 in a deeply phenotyped young patient cohort

The drivers of critical coronavirus disease 2019 (COVID-19) remain unknown. Given major confounding factors such as age and comorbidities, true mediators of this condition have remained elusive. We used a multi-omics analysis combined with artificial intelligence in a young patient cohort where major comorbidities were excluded at the onset. The cohort included 47 “critical” (in the intensive care unit under mechanical ventilation) and 25 “non-critical” (in a non-critical care ward) patients with COVID-19 and 22 healthy individuals. The analyses included whole-genome sequencing, whole-blood RNA sequencing, plasma and blood mononuclear cell proteomics, cytokine profiling, and high-throughput immunophenotyping. An ensemble of machine learning, deep learning, quantum annealing, and structural causal modeling were used. Patients with critical COVID-19 were characterized by exacerbated inflammation, perturbed lymphoid and myeloid compartments, increased coagulation, and viral cell biology. Among differentially expressed genes, we observed up-regulation of the metalloprotease ADAM9. This gene signature was validated in a second independent cohort of 81 critical and 73 recovered patients with COVID-19 and was further confirmed at the transcriptional and protein level and by proteolytic activity. Ex vivo ADAM9 inhibition decreased severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) uptake and replication in human lung epithelial cells. In conclusion, within a young, otherwise healthy, cohort of individuals with COVID-19, we provide the landscape of biological perturbations in vivo where a unique gene signature differentiated critical from non-critical patients. We further identified ADAM9 as a driver of disease severity and a candidate therapeutic target.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Domain Aware Deep-learning Algorithms Integrated with Scientific-computing Technologies (DADAIST)

This technical report summarized the contribution of the DADAIST project funded by the Data Model Convergence Initiative via the Laboratory Directed Research and Development (LDRD) investments at Pacific Northwest National Laboratory (PNNL). Specifically, we report the development of the NeuroMANCER (Neural Modules with Adaptive Nonlinear Constraints and Efficient Regularizations), a new open-source Scientific Machine Learning library for formulating and solving parametric constrained optimization problems, physics-informed system identification, and parametric optimal control problems. NeuroMANCER is using differentiable programming to combine modern data-driven models and optimization modeling language into a coherent algorithmic and software framework. NeuroMANCER is a Pytorch-based framework and adopts much of its philosophy focused on research and development, rapid prototyping, and streamlined deployment. Strong emphasis is given to extensibility, interoperability with the PyTorch ecosystem, and quick adaptability to custom domain problems. Neuromancer repository contains a comprehensive library of differentiable modules, including custom activation functions, matrix factorizations, deep learning architectures, neural differential equations, differential equation solvers, implicit layers such as iterative solvers, high-level API for symbolic expressions, API for modeling and control of dynamical systems, and extensive set of tutorial code examples in the form of python scripts and jupyter notebooks.

97 MATHEMATICS AND COMPUTING↗

CRADA Final Report: CRADA Number NFE-22-09330 with General Fusion

General Fusion is developing a magnetized target fusion (MTF) approach that involves compressing an initial magnetically confined plasma inside a cavity formed in liquid metal. This approach builds from concepts initially developed under the Linus program at the U.S. Naval Research Laboratory and combines it with advances from compact toroid experiment (CTX) and sustained spheromak plasma experiment (SSPX) in compact toroid plasmas and coaxial Marshall gun systems. Modeling the tokamak during compression is central to designing a successful MTF device. The plasma is formed by coaxial helicity injection in the General Fusion device. Immediately after formation, the plasma has a diverted tokamak configuration with a single null. As the wall moves inwards, the plasma is repelled from the conducting surface and driven inwards by currents induced by its magnetic field in the liquid metal wall. As the liquid metal closes (or bridges) the opening of the coaxial plasma injector, the magnetic field topology alters to remove the null. Due to this, the plasma moves from a diverted to a wall-limited configuration. The liquid metal liner continues to close in and change shape, reducing in radius by a factor of ten at the peak of plasma compression. A model of the MTF plasma must be able to handle this continually varying geometry, and to be predictive, it must faithfully include the real imperfections arising in the process. In this project, we pursued a Monte Carlo approach to closures for MHD by computing kinetic electron trajectories in an MHD plasma background from simulations of GF devices. This requires enhancing the capabilities of the KORC-T code for running large ensembles of kinetic trajectories by porting it to GPU architectures and enabling workflows for large ensembles on OLCF machines. With these capabilities, it is possible to produce a large library of kinetic calculations of electron orbits evolving in plasma configurations spanning the magnetic configurations and plasma density profiles, including non-axisymmetry, arising in the General Fusion’s existing PI3 spherical tokamak device. Using ensembles will capture particles passing a single point in space in a given magnetic configuration, and the entire dataset will cover a range of global magnetic field geometries. By sampling around many starting points, this dataset will capture the spatial dependence of the plasma parameters. From this large dataset, it is possible to produce a reduced model for the kinetic effects not captured in MHD.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Latent Mechanisms of Polarization Switching from In Situ Electron Microscopy Observations

In situ scanning transmission electron microscopy enables observation of the domain dynamics in ferroelectric materials as a function of externally applied bias and temperature. The resultant data sets contain a wealth of information on polarization switching and phase transition mechanisms. However, identification of these mechanisms from observational data sets has remained a problem due to a large variety of possible configurations, many of which are degenerate. Here, an approach based on a combination of deep learning-based semantic segmentation, rotationally invariant variational autoencoder (VAE), and non-negative matrix factorization to enable learning of a latent space representation of the data with multiple real-space rotationally equivalent variants mapped to the same latent space descriptors is introduced. By varying the size of training sub-images in the VAE, the degree of complexity in the structural descriptors is tuned from simple domain wall detection to the identification of switching pathways. Importantly, this yields a powerful tool for the exploration of the dynamic data in mesoscopic electron, scanning probe, optical, and chemical imaging. Moreover, this work adds to the growing body of knowledge of incorporating physical constraints into the machine and deep-learning methods to improve learned descriptors of physical phenomena.

36 MATERIALS SCIENCE↗

Electronic structure prediction of medium and high entropy alloys across composition space

We propose machine learning (ML) models to predict the electron density — the fundamental unknown of a material’s ground state — across the composition space of concentrated alloys. From this, other physical properties can be inferred, enabling accelerated exploration. A significant challenge is that the number of descriptors and sampled compositions required for accurate prediction grows rapidly with species. To address this, we employ Bayesian Active Learning (AL), which minimizes training data requirements by leveraging uncertainty quantification capabilities of Bayesian Neural Networks. Compared to the strategic tessellation of the composition space, Bayesian-AL reduces the number of training data points by a factor of 2.5 for ternary (SiGeSn) and 1.7 for quaternary (CrFeCoNi) systems. We also introduce easy-to-optimize, body-attached-frame descriptors, which respect physical symmetries while keeping descriptor-vector size nearly constant as alloy complexity increases. Our ML models demonstrate high accuracy and generalizability in predicting both electron density and energy across composition space.

materials science↗

Transformation rate maps of dissolved organic carbon in the contiguous US

Riverine dissolved organic carbon (DOC) plays a vital role in regional and global carbon cycles. However, the processes of DOC conversion from soil organic carbon (SOC) and leaching into rivers are insufficiently understood, inconsistently represented, and poorly parameterized, particularly in land surface and Earth system models. As a first attempt to fill this gap, we propose a generic formula that directly connects SOC concentration with DOC concentration in headwater streams, where a single parameter, the transformation rate from SOC in the soil to DOC leaching flux (P r ), accounts for the overall processes governing SOC conversion to DOC and leaching from soils (along with runoff) into headwater streams. We then derive high-resolution P r maps over the contiguous US (CONUS) using SOC data from two different sources: the Harmonized World Soil Database v1.2 (HWSD) and SoilGrids 2.0. Both maps are developed following the same five major steps: (1) selecting independent catchments where observed riverine DOC data are available with reasonable quality; (2) estimating catchment-average SOC for the independent catchments; (3) estimating the P r values for these catchments based on the generic formula and catchment-average SOC; (4) developing a predictive model of P r with machine learning (ML) techniques and catchment-scale climate, hydrology, geology, and other attributes; and (5) deriving a national map of P r based on the ML model. For evaluation, we compare the DOC concentration derived using the P r map and the observed DOC concentration values at evaluation catchments. The resulting mean absolute scaled error and coefficient of determination are 0.73 and 0.47 for the HWSD-based model and 0.58 and 0.72 for the SoilGrids-based model, respectively, suggesting the effectiveness of the overall methodology. Efforts to constrain uncertainty and evaluate sensitivity of P r to different factors are discussed. To illustrate the use of such maps, we derive a riverine DOC concentration reanalysis dataset over CONUS. The two P r maps, robustly derived and empirically validated, lay a critical cornerstone for better simulating the terrestrial carbon cycle in land surface and Earth system models. Our findings not only set a foundation for improving our predictive understanding of the terrestrial carbon cycle at the regional and global scales, but also hold promises for informing policy decisions related to decarbonization and climate change mitigation. The data presented in this study are publicly available at https://doi.org/10.5281/zenodo.14563816 (Li et al., 2024).

54 ENVIRONMENTAL SCIENCES↗

Double-Atom Catalysts Featuring Inverse Sandwich Structure for CO 2 Reduction Reaction: A Synergetic First-Principles and Machine Learning Investigation

Electrocatalytic CO 2 reduction reactions (CO 2 RR) based on scalable and highly efficient catalysis provide an attractive strategy for reducing CO 2 emissions. Here in this work, we combined first-principles density functional theory (DFT) and machine learning (ML) to comprehensively explore the potential of double-atom catalysts (DACs) featuring an inverse sandwich structure anchored on defective graphene (gra) to catalyze CO 2 RR to generate C 1 products. We started with five homonuclear M 2 ⊥gra (M = Co, Ni, Rh, Ir, and Pt), followed by 127 heteronuclear MM'⊥gra (M = Co, Ni, Rh, Ir, and Pt, M' = Sc–Au). Stable DACs were screened by evaluating their binding energy, formation energy, and dissolution potential of metal atoms, as well as conducting first-principles molecular dynamics simulations with and without solvent water molecules. Based on DFT calculations, Rh 2 ⊥gra DAC was found to outperform the other four homonuclear DACs and the Rh-based single- and double-atom catalysts of noninverse sandwich structures. Out of the 127 heteronuclear DACs, 14 were found to be stable and have good catalytic performance. An ML approach was adopted to correlate key factors with the activity and stability of the DACs, including the sum of radii of metal and ligand atoms (d M–M' , d M–C , and d M'–C ), the sum and difference of electronegativity of two metal atoms (P M + P M' , P M – P M '), the sum and difference of first ionization energy of two metal atoms (I M + I M' , I M – I M '), the sum and difference of electron affinity of two metal atoms (A M + A M' , A M – A M '), and the number of d-electrons of the two metal atoms (Nd). The obtained ML models were further used to predict 154 potential electrocatalysts out of 784 possible DACs featuring the same inverse sandwich configuration. Overall, this work not only identified promising CO 2 RR DACs featuring the reported inverse sandwich structure but also provided insights into key atomic characteristics associated with high CO 2 RR activity.

30 DIRECT ENERGY CONVERSION↗

A Data Library of Liquid Clouds Modelled With a Large Eddy Simulation Framework

We describe a library of atmospheric large eddy simulations (LES) of liquid-phase boundary layer clouds constructed to enable aerosol–cloud–turbulence interaction studies, support parameterization evaluation and development, and provide training data for machine learning applications. The simulations use a modern LES framework designed for high numerical accuracy, coupled to a detailed spectral bin microphysical scheme. Case studies are configured to represent observed conditions in four key global cloud regions—the Northeastern Atlantic, Northeastern Pacific, Continental United States and Southern Ocean—following a semi-idealised approach. The library also includes aerosol concentration halving and doubling experiments to expose the sensitivities of the case studies to aerosol perturbations. Simulation results are compared to observations on a case-by-case basis, then the library's coverage is evaluated in terms of spreads in meteorological factors and atmospheric boundary layer attributes.

aerosol↗

Influence of the laser light absorption by the colloid on the properties of silver nanoparticles produced by laser ablation in stirred and stationary liquid

Silver nanoparticles were produced by nanosecond pulsed-laser ablation at 1064 nm of Ag in pure water. These experiments were performed using an alternative ablation cell design where a cylindrical shaped Ag target was horizontally irradiated, while the liquid was stirred by a stir rod coaxially arranged to the target. The repeatability of the generated colloids properties (extinction and size distribution) is assessed by statistical tools. The colloids properties prepared under stationary liquid are found to be unpredictable, while they are highly repeatable at high stirring speed. At the same time, electronic microscopy examinations of the irradiated Ag targets revealed that the width of the laser-machined grooves exponentially decays in stationary liquid and almost linearly under high stirring speed as the ablation proceeds. In the latter case, the decay rate was found to be constant from one experiment to the other, while it was not repeatable stationary liquid. We show that the decay of the groove width is due to an attenuation of the laser energy reaching the target surface due to the formation of a more or less dense NPs layer in front of the target as the ablation proceeds. Using the ablation time-dependence of the groove width, we can quantify the attenuation factor of the laser energy with exposure time. Finally, the relationship between the laser energy attenuation, stirring speed, and repeatability of the colloids properties is interpreted and discussed in terms of mass transfer.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Observational evidence for groundwater influence on crop yields in the United States

As climate change shifts crop exposure to dry and wet extremes, a better understanding of factors governing crop response is needed. Recent studies identified shallow groundwater—groundwater within or near the crop rooting zone—as influential, yet existing evidence is largely based on theoretical crop model simulations, indirect or static groundwater data, or small-scale field studies. Here, we use observational satellite yield data and dynamic water table simulations from 1999 to 2018 to provide field-scale evidence for shallow groundwater effects on maize yields across the United States Corn Belt. We identify three lines of evidence supporting groundwater influence: 1) crop model simulations better match observed yields after improvements in groundwater representation; 2) machine learning analysis of observed yields and modeled groundwater levels reveals a subsidy zone between 1.1 and 2.5 m depths, with yield penalties at shallower depths and no effect at deeper depths; and 3) locations with groundwater typically in the subsidy zone display higher yield stability across time. We estimate an average 3.4% yield increase when groundwater levels are at optimum depth, and this effect roughly doubles in dry conditions. Groundwater yield subsidies occur ~35% of years on average across locations, with 75% of the region benefitting in at least 10% of years. Overall, we estimate that groundwater-yield interactions had a net monetary contribution of approximately $10 billion from 1999 to 2018. This study provides empirical evidence for region-wide groundwater yield impacts and further underlines the need for better quantification of groundwater levels and their dynamic responses to short- and long-term weather conditions.

60 APPLIED LIFE SCIENCES↗

Tensor Text-Mining Methods for Malware Identification and Detection, Malware Dynamics Characterization, and Hosts Ranking

Malware is one of the most persistent and costly cyber threats endangering reputation, confidentiality, integrity, and availability for organizations and national security. Consequently, many of the incident detection and prevention systems, and incident responders have begun to utilize machine learning as a helper in the fight against malware and other cyber threats. However, cyber defenders rely on interpretability and generalizability, yet the popular machine learning methods are black-box and often use traditional supervised solutions that do not generalize to novel malware. Therefore, there is a need to improve the existing solutions. At the same time, the majority of the prior research ignored essential evaluation criteria when reporting the results of their methods, which disables the safe reproducibility of the methods in a production environment. Tensor decomposition, on the other hand, enables interpretable unsupervised analysis of the large-scale data for the discovery of hidden patterns. Our findings, performed on real-world and large-scale experiments, show that tensor factorization-based methods yield performance results that surpasses or competes with existing supervised solutions with the added benefit of interpretability and generalizability. With the ability to analyze complex and large-scale data using tensors, we report results that reflect real-world production environments. We propose to develop new game- changing tools for malware identification and characterization that can trace malware evolution, rank the infected or malicious hosts, and streamline the work of incident response teams, malware analysts, and incident detection and prevention systems.

97 MATHEMATICS AND COMPUTING↗

10th International Topical Meeting on Nuclear Plant Instrumentation, Control and Human Machine Interface Technologies, San Francisco, CA, USA, June 11–15, 2017

As part of the ongoing efforts at the U.S. Department of Energy’s Light Water Reactor Sustainability Program, Idaho National Laboratory is conducting several pilot projects in collaboration with the nuclear industry to improve the reliability, safety, and economics of the nuclear power industry, especially as the nuclear power plants extend their operating licenses to 80 years. One of these pilot projects is the automated work package (AWP) pilot project. An AWP is an electronic intelligent and interactive work package. It uses plant condition, resources status, and user progress to adaptively drive the work process in a manner that increases efficiency while reducing human error. To achieve this mission, the AWP acquires information from various systems of a nuclear power plant’s and incorporates several advanced instrumentation and control technologies along with modern human factors techniques. With the current rapid technological advancement, it is possible to envision several available or soon-to-be-available capabilities that can play a significant role in improving the work package process. As a pilot project, the AWP project develops a prototype of an expanding set of capabilities and evaluates them in an industrial environment. While some of the proposed capabilities are based on using technological advances in other applications, others are conceptual; thus, require significant research and development to be applicable in an AWP. The scope of this paper is to introduce a set of envisioned capabilities, their need for the industry, and the industry difficulties they resolve.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Frequency domain measurements of melt pool recoil force using modal analysis

Recoil pressure is a critical factor affecting the melt pool dynamics during Laser Powder Bed Fusion (LPBF) processes. Recoil pressure depresses the melt pool. When the recoil pressure is low, thermal conduction and capillary forces may be inadequate to provide proper fusion between layers. However, excessive recoil pressure can produce a keyhole inside the melt pool, which is associated with gas porosity. Direct recoil pressure measurements are challenging because it is localized over an area proportionate to the laser spot size producing a force in the mN range. This paper reports a vibrationbased approach to quantify the recoil force exerted on a part in a commercial LPBF machine. The measured recoil force is consistent with estimates from high speed synchrotron imaging of entrained particles, and the results show that the recoil force scales with applied laser power and is inversely related to the laser scan speed. These results facilitate further studies of melt pool dynamics and have the potential to aid process development for new materials.

42 ENGINEERING↗

Reinterpreting fundamental plane correlations with machine learning

ABSTRACT This work explores the relationships between galaxy sizes and related observable galaxy properties in a large volume cosmological hydrodynamical simulation. The objectives of this work are to develop a better understanding of both the correlations between galaxy properties and the influence of environment on galaxy physics in order to build an improved model for the galaxy sizes, building off of the fundamental plane. With an accurate intrinsic galaxy size predictor, the residuals in the observed galaxy sizes can potentially be used for multiple cosmological applications, including making measurements of galaxy velocities in spectroscopic samples, estimating the rate of cosmic expansion, and constraining the uncertainties in the photometric redshifts of galaxies. Using projection pursuit regression, the model accurately predicts intrinsic galaxy sizes and have residuals which have limited correlation with galaxy properties. The model decreases the spatial correlation of galaxy size residuals by a factor of ∼5 at small scales compared to the baseline correlation when the mean size is used as a predictor.

Astronomy & Astrophysics↗

SU-E-T-31: A Fast Finite Size Pencil Beam (FSPB) Convolution Algorithm for a New Co-60 Arc Therapy Machine

Purpose: Present a fast Finite Size Pencil Beam (FSPB) convolution algorithm for a new Co-60 arc therapy machine. The FSPB algorithm accounts for (i) strong angular divergence (short SAD), (ii) heterogeneity effect for primary attenuation, and (iii) source energy spectrum. Methods: The FSPB algorithm is based on a 0.5×0.5-cm2 dose kernel calculated using the GEPTS (Gamma Electron and Positron Transport System) Monte Carlo code. The dose kernel is tabulated using a thin XYZ mesh (0.1 mm steps in lateral directions) for radius less than 1 cm and using an RZ mesh (with varying steps) for larger radial distance. To account for SSD effect, 11 dose kernels with SSDs varying between 30 cm to 80 cm are calculated. Maynord factor and “lateral stretching” are applied to account for differences between closest and actual SSD. Appropriate rotations and second order interpolation are used to calculate the dose from a given beamlet to a point. Results: Accuracy: Dose distributions in water with 80 cm SSD are calculated using the new FSPB convolution algorithm and full Monte Carlo simulation (gold standard). Figs 1–4 show excellent agreements between FSPB and Monte Carlo calculations for different field sizes and at different depths. The dose distribution for a prostate case is calculated using FSPB (Fig.5). Sixty conformal beams with rectum blocking are assumed. Figs 6–8 show the comparison with Monte Carlo simulation based on the same beam apertures. The excellent agreement demonstrates the accuracy of the new algorithm in handling SSD variation, oblique incidence, and scatter contribution.Speed: The FSPB convolution algorithm calculates 28 million dose points per second using a single 2.2-GHz CPU. The present algorithm is seven times faster than a similar algorithm from Gu et al. (Phys. Med. Biol. 54, 2009, 6287–6297). Conclusion: A fast and accurate FSPB convolution algorithm was developed and benchmarked.

60 APPLIED LIFE SCIENCES↗

MalGen: Malware Generation with Specific Behaviors to Improve Machine Learning-based Detectors

In recent years, infections and damage caused by malware have increased at exponential rates. At the same time, machine learning (ML) techniques have shown tremendous promise in many domains, often out performing human efforts by learning from large amounts of data. Results in the open literature suggest that ML is able to provide similar results for malware detection, achieving greater than 99% classifcation accuracy [49]. However, the same detection rates when applied in deployed settings have not been achieved. Malware is distinct from many other domains in which ML has shown success in that (1) it purposefully tries to hide, leading to noisy labels and (2) often its behavior is similar to benign software only differing in intent, among other complicating factors. This report details the reasons for the diffcultly of detecting novel malware by ML methods and offers solutions to improve the detection of novel malware.

97 MATHEMATICS AND COMPUTING↗

Investigation of Low-Energy Lattice Dynamics and Their Role in Superionic Na Diffusion and Ultralow Thermal Conductivity of Na 3 PSe 4 as a Solid-State Electrolyte

The atomic dynamics of Na 3 PSe 4 were investigated using a combination of neutron scattering experiments and ab initio and machine-learned molecular dynamics simulations to probe the interplay of fast ionic diffusion with atomic vibrations (phonons) of the host lattice. Our results reveal the existence of low-energy vibrational modes, simultaneously involving motions of Na + ions and framework polyanion subunits, and show that these modes become strongly overdamped in the superionic regime as they couple with the Na + hopping process. In particular, the Na+ migration energy landscape is strongly impacted by low-energy phonons derived from a soft acoustic branch of the host lattice, which modulates the diameter of the Na + diffusion channel at the bottleneck. We find that an additional factor for the enhanced Na + conductivity in Na 3 PSe 4 is the presence of Na-vacancies, which also affect the low-frequency dynamics and thermal vibration amplitudes, pointing to an interplay between Na + vacancies and host dynamics, jointly enhancing ionic diffusivity. Finally, we investigate the origin of ultralow thermal conductivities in Na 3 PSe 4 and Na 3 PS 4 using Green–Kubo simulations and find that low-energy acoustic phonon modes of the overall crystal framework provide a dominant contribution to the thermal conductivity.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗