Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Space Network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Oracle-Preserving Latent Flows

A fundamental task in data science is the discovery, description, and identification of any symmetries present in the data. We developed a deep learning methodology for the simultaneous discovery of multiple non-trivial continuous symmetries across an entire labeled dataset. The symmetry transformations and the corresponding generators are modeled with fully connected neural networks trained with a specially constructed loss function, ensuring the desired symmetry properties. The two new elements in this work are the use of a reduced-dimensionality latent space and the generalization to invariant transformations with respect to high-dimensional oracles. The method is demonstrated with several examples on the MNIST digit dataset, where the oracle is provided by the 10-dimensional vector of logits of a trained classifier. We find classes of symmetries that transform each image from the dataset into new synthetic images while conserving the values of the logits. We illustrate these transformations as lines of equal probability (“flows”) in the reduced latent space. These results show that symmetries in the data can be successfully searched for and identified as interpretable non-trivial transformations in the equivalent latent space.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Deep nonparametric estimation of operators between infinite dimensional spaces

Learning operators between infinitely dimensional spaces is an important learning task arising in machine learning, imaging science, mathematical modeling and simulations, etc. This paper studies the nonparametric estimation of Lipschitz operators using deep neural networks. Non-asymptotic upper bounds are derived for the generalization error of the empirical risk minimizer over a properly chosen network class. Under the assumption that the target operator exhibits a low dimensional structure, our error bounds decay as the training sample size increases, with an attractive fast rate depending on the intrinsic dimension in our estimation. Our assumptions cover most scenarios in real applications and our results give rise to fast rates by exploiting low dimensional structures of data in operator estimation. We also investigate the influence of network structures (e.g., network width, depth, and sparsity) on the generalization error of the neural network estimator and propose a general suggestion on the choice of network structures to maximize the learning efficiency quantitatively.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

A machine learning approach to emulation and biophysical parameter estimation with the Community Land Model, version 5

Abstract. Land models are essential tools for understanding and predicting terrestrial processes and climate–carbon feedbacks in the Earth system, but uncertainties in their future projections are poorly understood. Improvements in physical process realism and the representation of human influence arguably make models more comparable to reality but also increase the degrees of freedom in model configuration, leading to increased parametric uncertainty in projections. In this work we design and implement a machine learning approach to globally calibrate a subset of the parameters of the Community Land Model, version 5 (CLM5) to observations of carbon and water fluxes. We focus on parameters controlling biophysical features such as surface energy balance, hydrology, and carbon uptake. We first use parameter sensitivity simulations and a combination of objective metrics including ranked global mean sensitivity to multiple output variables and non-overlapping spatial pattern responses between parameters to narrow the parameter space and determine a subset of important CLM5 biophysical parameters for further analysis. Using a perturbed parameter ensemble, we then train a series of artificial feed-forward neural networks to emulate CLM5 output given parameter values as input. We use annual mean globally aggregated spatial variability in carbon and water fluxes as our emulation and calibration targets. Validation and out-of-sample tests are used to assess the predictive skill of the networks, and we utilize permutation feature importance and partial dependence methods to better interpret the results. The trained networks are then used to estimate global optimal parameter values with greater computational efficiency than achieved by hand tuning efforts and increased spatial scale relative to previous studies optimizing at a single site. By developing this methodology, our framework can help quantify the contribution of parameter uncertainty to overall uncertainty in land model projections.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Application-driven Privacy-preserving Data Publishing with Correlated Attributes

Recent advances in computing have allowed for the possibility to collect large amounts of data on personal activities and private living spaces. To address the privacy concerns of users in this environment, we propose a novel framework called PR-GAN that offers privacy-preserving mechanism using generative adversarial networks. Given a target application, PR-GAN automatically modifies the data to hide sensitive attributes - which may be hidden and can be inferred by machine learning algorithms - while preserving the data utility in the target application. Unlike prior works, the public's possible knowledge of the correlation between the target application and sensitive attributes is built into our modeling. We formulate our problem as an optimization problem, show that an optimal solution exists and use generative adversarial networks (GAN) to create perturbations. We further show that our method provides privacy guarantees under the Pufferfish framework, an elegant generalization of the differential privacy that allows for the modeling of prior knowledge on data and correlations. Through experiments, we show that our method outperforms conventional methods in effectively hiding the sensitive attributes while guaranteeing high performance in the target application, for both property inference and training purposes. Finally, we demonstrate through further experiments that once our model learns a privacy-preserving task, such as hiding subjects' identity, on a group of individuals, it can perform the same task on a separate group with minimal performance drops.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Deep Nonparametric Estimation of Operators between Infinite Dimensional Spaces

Learning operators between infinitely dimensional spaces is an important learning task arising in machine learning, imaging science, mathematical modeling and simulations, etc. This paper studies the nonparametric estimation of Lipschitz operators using deep neural networks. Non-asymptotic upper bounds are derived for the generalization error of the empirical risk minimizer over a properly chosen network class. Under the assumption that the target operator exhibits a low dimensional structure, our error bounds decay as the training sample size increases, with an attractive fast rate depending on the intrinsic dimension in our estimation. Our assumptions cover most scenarios in real applications and our results give rise to fast rates by exploiting low dimensional structures of data in operator estimation. We also investigate the influence of network structures (e.g., network width, depth, and sparsity) on the generalization error of the neural network estimator and propose a general suggestion on the choice of network structures to maximize the learning efficiency quantitatively.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Phase Selection Rules of Multi‐Principal Element Alloys

Abstract Computational prediction of phase stability of multi‐principal element alloys (MPEAs) holds a lot of promise for rapid exploration of the enormous design space and autonomous discovery of superior structural and functional properties. Regardless of many plausible works that rely on phenomenological theory and machine learning, precise prediction is still limited by insufficient data and the lack of interpretability of some machine learning algorithms, e.g., convolutional neural network. In this work, a comprehensive approach is presented, encompassing the development of a complete dataset that contains 72 387 density functional theory calculations, as well as a predictive global phenomenological descriptor. The phase selection descriptor, based on atomic electronegativity and valence electron concentration, significantly outperforms the widely used valence electron concentration, excelling in both accuracy (with an f1 score of 63% compared to 47%) and its ability to predict the HCP phase (0.48 recall compared to 0). The comprehensive data mining on the global design space of 61 425 quaternary MPEAs made from 28 possible metals, together with the phenomenological theory and physical interpretation, will set up a solid computational science foundation for data‐driven exploration of MPEAs.

Chemistry↗
DOE OSTI2023

Fast and accurate simulations of calorimeter showers with normalizing flows

In this study, we introduce caloflow, a fast detector simulation framework based on normalizing flows. For the first time, we demonstrate that normalizing flows can reproduce many-channel calorimeter showers with extremely high fidelity, providing a fresh alternative to computationally expensive geant4 simulations, as well as other state-of-the-art fast simulation frameworks based on generative adversarial networks (GANs) or variational autoencoders (VAEs). In addition to the usual histograms of physical features and images of calorimeter showers, we introduce a new metric for judging the quality of generative modeling: the performance of a classifier trained to differentiate real from generated images. We show that GAN-generated images can be identified by the classifier with nearly 100% accuracy, while images generated from caloflow are better able to fool the classifier. More broadly, normalizing flows offer several advantages compared to other state-of-the-art approaches (GANs and VAEs), including tractable likelihoods, stable and convergent training, and principled model selection. Normalizing flows also provide a bijective mapping between data and the latent space, which could have other applications beyond simulation, for example, to detector unfolding.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Hydraulic characterization of a fault zone from fracture distribution

A quantitative assessment of how faults control the migration of geofluids is critical in many areas of geosciences. Here we integrated geological fieldwork, quantitative analysis of the fractures distribution and numerical modeling to build a geometrical representation of a fault zone and to characterize its hydraulic properties. Our target is a fault located in the Majella Mountain (Italy). We collected 21 scan lines across the fault profile in order to characterize its architecture. The numerical modeling of the fracture network of the damage zones and their hydraulic parameters was performed using both commercial (Move ® ) and open source software (dfnWorks and PFLOTRAN). Move ® was used to build a representative model of the fault zone using fracture spacing as a proxy, and to model the hydraulic parameters of the different fault domains. dfnWorks and PFLOTRAN were employed to infer the hydraulic parameters of the damage zones of the fault and then upscale these properties to an equivalent continuum domain, suitable for fluid flow simulations through the whole fault zone. Our findings show how even in a relatively small area it is possible to describe changes in terms of hydraulic properties of a fault zone and to build models capable to represent these variations.

58 GEOSCIENCES↗
DOE OSTI2024

A Model for Optimally Allocating Curbside Space Among Competing Uses

The emergence of various new forms of urban mobility services in recent years is leading to new pressures on curbside space. Municipalities, the entities typically responsible for managing the curbside, are in many instances handling these growing pressures by reallocating portions of the curbside away from traditional uses (such as metered and residential parking) in favor of uses such as ridehailing, scooter and bike-share corrals. As yet, however, such actions are being undertaken on an ad-hoc basis, due to the rapidly growing complexity of the curbside and the lack of standard analytical approaches. This lack of analytical capability is due to the traditional focus of transportation network modeling being focused predominantly on the interaction of supply and demand on links and nodes, with limited focus on link edges (the curbside). In this paper we address this research need by proposing a framework for modeling inter-modal competition for curbside space, inspired by the classical Bid-Rent Model of urban land use, intended to support curb managers to move towards maximizing the aspects of economic welfare that relate to curb access. In the bi-level model, choices made by the curbside manager impact travelers’ mode choices, and vice versa. We then present a simple numerical case study to demonstrate the properties of the proposed model, showing its tractability, flexibility, and intuitive sensitivity to systematic variation in inputs. The framework demonstrates the type of adaptive and evolving approach needed to maximize benefits from increasingly dynamic curb management strategies. The paper concludes with a brief discussion of future research needs to advance this line of inquiry.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2020

A Multiple Filter Based Neural Network Approach to the Extrapolation of Adsorption Energies on Metal Surfaces for Catalysis Applications

Computational catalyst discovery involves the development of microkinetic reactor models based on estimated parameters determined from density functional theory (DFT). For complex surface chemistries, the number of reaction intermediates can be very large, and the cost of calculating the adsorption energies by DFT for all surface intermediates even for one active site model can become prohibitive. In this paper, we have identified appropriate descriptors and machine learning models that can be used to predict a significant part of these adsorption energies given data on the rest of them. Furthermore, our investigations also included the case when the species data used to train the predictive model are of different size relative to the species the model tries to predict—this is an extrapolation in the data space which is typically difficult with regular machine learning models. Due to the relative size of the available data sets, we have attempted to extrapolate from the larger species to the smaller ones in the current work. Here, we have developed a neural network based predictive model that combines an established additive atomic contribution based model with the concepts of a convolutional neural network that, when extrapolating, achieves a statistically significant improvement over the previous models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

The design space of E(3)-equivariant atom-centred interatomic potentials

Abstract Molecular dynamics simulation is an important tool in computational materials science and chemistry, and in the past decade it has been revolutionized by machine learning. This rapid progress in machine learning interatomic potentials has produced a number of new architectures in just the past few years. Particularly notable among these are the atomic cluster expansion, which unified many of the earlier ideas around atom-density-based descriptors, and Neural Equivariant Interatomic Potentials (NequIP), a message-passing neural network with equivariant features that exhibited state-of-the-art accuracy at the time. Here we construct a mathematical framework that unifies these models: atomic cluster expansion is extended and recast as one layer of a multi-layer architecture, while the linearized version of NequIP is understood as a particular sparsification of a much larger polynomial model. Our framework also provides a practical tool for systematically probing different choices in this unified design space. An ablation study of NequIP, via a set of experiments looking at in- and out-of-domain accuracy and smooth extrapolation very far from the training data, sheds some light on which design choices are critical to achieving high accuracy. A much-simplified version of NequIP, which we call BOTnet (for body-ordered tensor network), has an interpretable architecture and maintains its accuracy on benchmark datasets.

Computer Science↗
DOE OSTI2025

Dark Energy Survey Year 3 results: Simulation-based cosmological inference with wavelet harmonics, scattering transforms, and moments of weak lensing mass maps. II. cosmological results

Here, we present a simulation-based cosmological analysis using a combination of Gaussian and non-Gaussian statistics of the weak lensing mass (convergence) maps from the first three years of the Dark Energy Survey. We implement the following: (1) second and third moments; (2) wavelet phase harmonics; (3) the scattering transform. Our analysis is fully based on simulations, spans a space of seven 𝑤 Cold Dark Matter (𝑤⁢ CDM) cosmological parameters, and forward models the most relevant sources of systematics inherent in the data: masks, noise variations, clustering of the sources, intrinsic alignments, and shear and redshift calibration. We implement a neural network compression of the summary statistics, and we estimate the parameter posteriors using a simulation-based inference approach. Including and combining different non-Gaussian statistics is a powerful tool that strongly improves constraints over Gaussian statistics (in our case, the second moments); in particular, the figure of merit (𝑆 8 , Ω m ) is improved by 70% (Λ ⁢CDM) and 90% (𝑤 ⁢CDM). When all the summary statistics are combined, we achieve a 2% constraint on the amplitude of fluctuations parameter 𝑆 8 ≡ 𝜎 8 ⁢(Ω m /0.3) 0.5 , obtaining 𝑆 8 = 0.794 ±0.017 (Λ⁢ CDM) and 𝑆 8 = 0.817 ±0.021 (𝑤 ⁢CDM), and a ∼10% constraint on Ω m , obtaining Ω m =0.259 ±0.025 (Λ ⁢CDM) and Ω m = 0.273 ±0.029 (𝑤⁢ CDM). In the context of the 𝑤⁢ CDM scenario, these statistics also strengthen the constraints on the parameter 𝑤, obtaining 𝑤 <−0.72. The constraints from different statistics are shown to be internally consistent (with a 𝑝-value>0.1 for all combinations of statistics examined). We compare our results to other weak lensing results from the first three years of the Dark Energy Survey data, finding good consistency; we also compare with results from external datasets, such as planck constraints from the cosmic microwave background, finding statistical agreement, with discrepancies no greater than <2.2⁢𝜎.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Polymorphism and Negative Linear Compressibility in Pyrazine-d4

Pyrazine (1,4-diazine) is a widely used linker in coordination polymers, molecular magnets, and metal–organic frameworks, yet its solid-state polymorphism is controlled by weak C–H···N interactions. Using variable-temperature and high-pressure neutron diffraction, a previously unrecognized low-temperature transition to phase IV is identified, showing that the form stabilized under pressure can also be accessed below ∼90 K at ambient pressure in the perdeuterated compound. The transition from phase III → IV involves a symmetry-breaking lattice distortion driven by the reorganization of C–H···N hydrogen bonds, accompanied by negative linear compressibility, which is primarily accommodated through the reduction in void-space within the structure. Structural analysis reveals that while the overall monoclinic framework of phase IV is preserved under both temperature and pressure routes, the evolution of hydrogen-bonded network is distinct depending on the pathway taken. These results establish pyrazine as a model molecular solid for studying pressure–temperature polymorphism and demonstrate how weak directional interactions can produce anomalous mechanical responses in organic crystals.

Ridley, Christopher J. [Oak Ridge National Laborat↗
DOE OSTI2025

Deciphering supramolecular and polymer-like behavior in metallogels: real-time insights into temperature-modulated gelation and rapid self-assembly dynamics

Bis(pyridyl) urea-based gelators, namely L2 and its isomeric mixture ( L1 + L2 ), are known to self-assemble into 1D architectures capable of inducing supramolecular gelation. Coordination with metal ions such as Ag( I ), Cu( II ), and Fe( III ) introduces structural reinforcement, enabling the formation of distinct 3D networks governed by metal-specific coordination geometries. Here, we present a comprehensive investigation into the temperature-responsive behavior (20–60 °C) of L2 and L1 + L2 , both in the absence and presence of Ag( I ), Dy( III ), Fe( III ), Cu( II ), and Ho( III ), using real-time small-angle neutron scattering (SANS). To probe long-term structural evolution/kinetics of self-assembly, real-time small-angle X-ray scattering (SAXS) was employed on L2 + Ag gels, complemented by differential scanning calorimetry (DSC) to evaluate thermal transitions. Our results reveal strikingly divergent gelation behaviors: L2 forms a highly rigid, covalent polymer-like network, while L1 + L2 exhibits remarkable thermal adaptability. Upon metal coordination, the assemblies exhibit pronounced crystallinity and exceptional thermal stability, as evidenced by persistent Bragg reflections and invariant d-spacings. Intriguingly, L2 : Fe (2 : 1) and L1 : L2 : Fe (0.5 : 0.5 : 1) in acetonitrile-d 3 (ACN-d 3 ) deviate from this trend, forming thermally labile amorphous gels. These systems show a complete loss of crystalline order, reduced Porod exponents—indicative of collapsed or branched fiber morphologies—and prominent melting and glass transition events in DSC. Fitting SANS and SAXS data to the correlation length model unveiled insightful nanostructural features. While most systems displayed minimal temperature-induced variation in mesh size or surface morphology, L2 : Ag in dimethyl sulfoxide-d 6 (DMSO-d 6 )/D 2 O and L2 : Fe (1 : 1) in ACN-d 3 exhibited a rare combination of thermally stable correlation lengths and increasing high- q exponents—strongly suggesting progressive fiber densification or surface smoothing within a robust gel framework. These findings highlight the tunability and structural resilience of supramolecular gels through precise control of ligand architecture, metal coordination, and temperature, offering valuable design principles for functional soft materials.

Pajoubpong, Jinnipha [Univ. of Cincinnati, OH (Uni↗
DOE OSTI2023

LHC hadronic jet generation using convolutional variational autoencoders with normalizing flows

Abstract In high energy physics, one of the most important processes for collider data analysis is the comparison of collected and simulated data. Nowadays the state-of-the-art for data generation is in the form of Monte Carlo (MC) generators. However, because of the upcoming high-luminosity upgrade of the Large Hadron Collider (LHC), there will not be enough computational power or time to match the amount of needed simulated data using MC methods. An alternative approach under study is the usage of machine learning generative methods to fulfill that task. Since the most common final-state objects of high-energy proton collisions are hadronic jets, which are collections of particles collimated in a given region of space, this work aims to develop a convolutional variational autoencoder (ConVAE) for the generation of particle-based LHC hadronic jets. Given the ConVAE’s limitations, a normalizing flow (NF) network is coupled to it in a two-step training process, which shows improvements on the results for the generated jets. The ConVAE+NF network is capable of generating a jet in 18.30 ± 0.04 μ s , making it one of the fastest methods for this task up to now.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Effective cosmic density field reconstruction with convolutional neural network

ABSTRACT We present a cosmic density field reconstruction method that augments the traditional reconstruction algorithms with a convolutional neural network (CNN). Following previous work, the key component of our method is to use the reconstructed density field as the input to the neural network. We extend this previous work by exploring how the performance of these reconstruction ideas depends on the input reconstruction algorithm, the reconstruction parameters, and the shot noise of the density field, as well as the robustness of the method. We build an eight-layer CNN and train the network with reconstructed density fields computed from the Quijote suite of simulations. The reconstructed density fields are generated by both the standard algorithm and a new iterative algorithm. In real space at z = 0, we find that the reconstructed field is 90 per cent correlated with the true initial density out to $k\sim 0.5 \, \mathrm{ h}\, \rm {Mpc}^{-1}$, a significant improvement over $k\sim 0.2 \, \mathrm{ h}\, \rm {Mpc}^{-1}$ achieved by the input reconstruction algorithms. We find similar improvements in redshift space, including an improved removal of redshift space distortions at small scales. We also find that the method is robust across changes in cosmology. Additionally, the CNN removes much of the variance from the choice of different reconstruction algorithms and reconstruction parameters. However, the effectiveness decreases with increasing shot noise, suggesting that such an approach is best suited to high density samples. This work highlights the additional information in the density field beyond linear scales as well as the power of complementing traditional analysis approaches with machine learning techniques.

Astronomy & Astrophysics↗
DOE OSTI2024

High-accuracy emulators for observables in ΛCDM, N eff, Σ m ν, and w cosmologies

ABSTRACT We use the emulation framework CosmoPower to construct and publicly release neural network emulators of cosmological observables, including the cosmic microwave background (CMB) temperature and polarization power spectra, matter power spectrum, distance-redshift relation, baryon acoustic oscillation (BAO) and redshift-space distortion (RSD) observables, and derived parameters. We train our emulators on Einstein–Boltzmann calculations obtained with high-precision numerical convergence settings, for a wide range of cosmological models including ΛCDM, wCDM, ΛCDM + Neff, and ΛCDM + Σmν. Our CMB emulators are accurate to better than 0.5 per cent out to ℓ = 104, which is sufficient for Stage-IV data analysis, and our P(k) emulators reach the same accuracy level out to $k=50 \, \, \mathrm{Mpc}^{-1}$, which is sufficient for Stage-III data analysis. We release the emulators via an online repository (CosmoPower Organisation), which will be continually updated with additional extended cosmological models. Our emulators accelerate cosmological data analysis by orders of magnitude, enabling cosmological parameter extraction analyses, using current survey data, to be performed on a laptop. We validate our emulators by comparing them to class and camb and by reproducing cosmological parameter constraints derived from Planck TT, TE, EE, and CMB lensing data, as well as from the Atacama Cosmology Telescope Data Release 4 CMB data, Dark Energy Survey Year-1 galaxy lensing and clustering data, and Baryon Oscillation Spectroscopic Survey Data Release 12 BAO and RSD data.

Astronomy & Astrophysics↗
DOE OSTI2025

Observation of Unprecedented Fractional Magnetization Plateaus in a New Shastry-Sutherland Ising Compound

Geometrically frustrated magnetic systems, such as those based on the Shastry-Sutherland lattice (SSL), offer a rich playground for exploring unconventional magnetic states. The delicate balance between competing interactions in these systems leads to the emergence of novel phases. We present the characterization of Er 2 ⁢Be 2⁢ GeO 7 , an SSL compound with Er 3+ ions forming orthogonal dimers separated by nonmagnetic layers whose structure is invariant under the 𝑃⁢$\bar{4}21$⁢𝑚 space group. Neutron scattering reveals an antiferromagnetic dimer structure at zero field, typical of Ising spins on that lattice and consistent with the anisotropic magnetization observed. However, magnetization measurements exhibit fractional plateaus at 1/4 and 1/2 of saturation, in contrast to the expected 1/3 plateau of the SSL Ising model. By comparing the energy of candidate states with ground-state lower bounds we show that this behavior requires spatially anisotropic interactions, leading to an anisotropic Shastry-Sutherland Ising model symmetric under the 𝐶⁢𝑚⁢𝑚⁢2 space group. This anisotropy is consistent with the small orthorhombic distortion observed with single-crystal neutron diffraction. The other properties, including thermodynamics, which have been investigated theoretically using tensor networks, point to small residual interactions, potentially due to further couplings and quantum fluctuations. This study highlights Er 2 ⁢Be 2 ⁢GeO 7 as a promising platform for investigating exotic magnetic phenomena.

Yadav, Lalit [Duke University, Durham, NC (United ↗