Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “random sampling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

SDSS-IV MaNGA: spatial resolved properties of kinematically misaligned galaxies

We select 456 galaxies with kinematically misaligned gas and stellar components from 9456 parent galaxies in MaNGA, and classify them into 72 star-forming galaxies, 142 green-valley galaxies, and 242 quiescent galaxies. Comparing the spatial resolved properties of the misaligned galaxies with control samples closely match in the Dn4000 and stellar velocity dispersion, we find that: (1) the misaligned galaxies have lower values in V gas /σ gas and V star /σ star (the ratio between ordered to random motion of gas and stellar components) across the entire galaxies than their control samples; (2) the star-forming and green-valley misaligned galaxies have enhanced central concentrated star formation than their control galaxies. The difference in stellar population between quiescent misaligned galaxies and control samples is small; (3) gas-phase metallicity of the green valley and quiescent misaligned galaxies are lower than the control samples. For the star-forming misaligned galaxies, the difference in metallicity between the misaligned galaxies and their control samples strongly depends on how we select the control samples. All these observational results suggest that external gas accretion influences the evolution of star forming and green-valley galaxies, not only in kinematics/morphologies, but also in stellar populations. Furthermore, the quiescent misaligned galaxies have survived from different formation mechanisms.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Large Scale Caching and Streaming of Training Data for Online Deep Learning

The training of deep neural network models on large data remains a difficult problem, despite progress towards scalable techniques. In particular, there is a mismatch between the random but predetermined order in which AI flows select training samples and the streaming I/O patterns for which traditional HPC data storage (e.g., parallel file systems) are designed. In addition, as more data are obtained, it is feasible neither simply to train learning models incrementally, due to catastrophic forgetting (i.e., bias towards new samples), nor to train frequently from scratch, due to prohibitive time and/or resource constraints. In this paper, we study data management techniques that combine caching and streaming with rehearsal support in order to enable efficient access to training samples in both offline training and continual learning. We revisit state-of-art streaming approaches based on data pipelines that transparently handle prefetching, caching, shuffling, and data augmentation, and discuss the challenges and opportunities that arise when combining these methods with data-parallel training techniques. We also report on preliminary experiments that evaluate the I/O overheads involved in accessing the training samples from a parallel file system (PFS) under several concurrency scenarios, highlighting the impact of the PFS on the design of the data pipelines.

data pipelines↗
DOE OSTI2023

AutoFocus: AI-driven alignment of nanofocusing X-ray mirror systems

We describe the application of an AI-driven system to autonomously align complex x-ray-focusing mirror systems, including mirrors systems with variable focus spot sizes. The system has been developed and studied on a digital twin of nanofocusing X-ray beamlines, built using advanced optical simulation tools calibrated with wavefront sensing data collected at the beamline. We experimentally demonstrated that the system is reliably capable of positioning a focused beam on the sample, both by simulating the variation of a beamline with random perturbations due to typical changes in the light source and optical elements over time, and by conducting similar tests on an actual focusing mirror system.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

Accelerating multicanonical sampling with irreversibility

Flat-histogram Monte Carlo simulations are well-established, robust methods to perform random walks in a physical observable or parameter space, making them suitable for finding ground states or studying phase transitions in complex systems in statistical physics. However, their efficiency can be limited by the time to attain the desired flat distribution, which is generally unknown prior to the simulations. In particular, they might suffer from slowing down towards the end of a simulation due to the diffusive nature of random walks. In this work we apply irreversibility to the multicanonical Monte Carlo method via the lifting approach to alleviate this behavior. We achieve a 2–4 times speedup in ground-state search for a two-dimensional (2D) Ising model, and up to an order of magnitude of speedup for finding the ground-state energy in an Edwards–Anderson spin glass, compared to traditional multicanonical sampling. In conclusion, the round-trip times between ground states show a narrower distribution and are significantly shorter compared to the reversible counterpart, suggesting that a lower convergence time with a smaller time variance is feasible.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Preventing Failures By Dataset Shift Detection in Safety-Critical Graph Applications

Dataset shift refers to the problem where the input data distribution may change over time (e.g., between training and test stages). Since this can be a critical bottleneck in several safety-critical applications such as healthcare, drug-discovery, etc., dataset shift detection has become an important research issue in machine learning. Though several existing efforts have focused on image/video data, applications with graph-structured data have not received sufficient attention. Therefore, in this paper, we investigate the problem of detecting shifts in graph structured data through the lens of statistical hypothesis testing. Specifically, we propose a practical two-sample test based approach for shift detection in large-scale graph structured data. Our approach is very flexible in that it is suitable for both undirected and directed graphs, and eliminates the need for equal sample sizes. Using empirical studies, we demonstrate the effectiveness of the proposed test in detecting dataset shifts. We also corroborate these findings using real-world datasets, characterized by directed graphs and a large number of nodes.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Reassessing the MCNP Random Number Generator

Random number generators are integral components to Monte Carlo codes. They provide the pseudorandom number sequence used to actually sample the distributions of interest. As a result, they are one of the most important components to the software. The current recommended MCNP random number generator is a 63-bit linear congruential generator (LCG). This generator is quite fast, but it has some drawbacks. First, it only has a period of 2 63 . Due to the necessarily non-optimal usage of random numbers to ensure parallel reproducibility, this amount is too few to guarantee random number sequences are not reused in all configurations the code runs under. As simulation size increases, users will need to be aware of the limitations of the generator and tune configuration variables to best suit their simulations, or they will need to assume that reuse is not negatively affecting their answers. Neither of these are optimal. Second, small LCGs are fairly weak in bit generation quality, and this can have an unknown impact on the quality of the simulation. This paper is an investigation into whether or not more modern random number generators can supersede the current ones. The goal is to find a generator that is similar or superior in speed to the LCGs, has a state space large enough to make strong guarantees about random number reuse, and passes all modern random number test suites. If such a generator is found, it would eliminate the need for the user to even be aware of the limitations of the random number generator and would simplify the use of the code. This paper will be broken into several parts. Sec. 2 will discuss the evolution of the random number generator within the MCNP code. Sec. 3 will go over what a Monte Carlo code needs from a generator to be reproducible and portable and how the current generator behaves in that light. Sec. 4 goes through how each generator was tested. Finally, Sec. 5 will discuss improvements that could be made to the code.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Geographic source attribution of honey by strontium isotope analyses: Latvia and India measurements compared to model predictions in a feasibility study

Strontium isotope ratios ( 87 Sr/ 86 Sr) can be used to determine the geographic origin of agricultural products. Here, in this study, we measured the 87 Sr/ 86 Sr of honey samples from Richland, WA, USA, Latvia, and India, and compared the results to published 87 Sr/ 86 Sr from surrounding areas and values predicted based upon a random forest isoscape model (Bataille et al., 2020). While the 87 Sr/ 86 Sr of the honey samples compared well with previously published data, the model did not accurately predict the 87 Sr/ 86 Sr of the honey samples, demonstrating that further refinement of the model would be beneficial. Because Sr cycling in terrestrial ecosystems is complex, the 87 Sr/ 86 Sr of honey is likely to reflect several sources (e.g., nectar, surface water, dust) and may change over time. In order to accurately predict the 87 Sr/ 86 Sr of honey, models must consider local geology, ecology, and bee behavior. Additional research examining how Sr is incorporated into honey is needed to inform models.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Barium stars as tracers of s -process nucleosynthesis in AGB stars

Barium (Ba) stars help to verify asymptotic giant branch (AGB) star nucleosynthesis models since they experienced pollution from an AGB binary companion and thus their spectra carry the signatures of the slow neutron capture process (s process). For a large number (180) of Ba stars, we searched for AGB stellar models that match the observed abundance patterns. We aim to uncover any systematic deviations of the sample abundances from the predictions of the nucleosynthesis models. We employed three machine learning algorithms as classifiers: a Random Forest method, developed for this work, and the two classifiers used in our previous study. Compared to that work, we also expanded our observational sample with 11 Ba stars available in the supersolar metallicity range. We studied the statistical behaviour of the different s-process elements in the observational sample to investigate if the AGB models systematically under- or overpredict the abundances observed in the Ba stars and show the results in the form of violin plots of the residuals between spectroscopic abundances and model predictions. We inspected the correlations between the observed [Fe/H], the s-process elemental abundances, and the residuals. We employed the [Zr/Fe] and [Nb/Fe] abundances as a thermometer to constrain the operational temperature that rules the production of these elements in the sample stars, assuming a steady-state s process. We also investigated the mass distribution of the identified polluter AGB stars and the behaviour of the δ parameter, which describes the fraction of accreted AGB material relative to the Ba star envelope. We find a significant trend in the residuals that implies an underproduction of the elements just after the first s-process peak (Nb, Mo, and Ru) in the models relative to the observations. This may originate from a neutron-capture process (e.g. the intermediate neutron-capture process, i process) not yet included in the AGB models of metallicity from solar to roughly 1/5 solar, corresponding to the range of the Ba stars. Correlations are found between the residuals of these peculiar elements, suggesting a common origin for the deviations from the models. In addition, there is a weak metallicity dependence of the residuals of these elements. The s-process temperatures derived with the [Zr/Fe] – [Nb/Fe] thermometer have an unrealistic value for the majority of our stars. The most likely explanation is that at least a fraction of these elements are not produced in a steady-state s process, and instead may be due to processes not included in the AGB models. The mass distribution of the identified models confirms that our sample of Ba stars was polluted by low-mass AGB stars (< 4 M ⊙ ). Most of the matching AGB models require low accreted mass, but a few systems with high accreted mass are needed to explain the observations.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Adaptive sampling quasi-Newton methods for zeroth-order stochastic optimization

Here, we consider unconstrained stochastic optimization problems with no available gradient information. Such problems arise in settings from derivative-free simulation optimization to reinforcement learning. We propose an adaptive sampling quasi-Newton method where we estimate the gradients using finite differences of stochastic function evaluations within a common random number framework. We develop modified versions of a norm test and an inner product quasi-Newton test to control the sample sizes used in the stochastic approximations and provide global convergence results to the neighborhood of a locally optimal solution. We present numerical experiments on simulation optimization problems to illustrate the performance of the proposed algorithm. When compared with classical zeroth-order stochastic gradient methods, we observe that our strategies of adapting the sample sizes significantly improve performance in terms of the number of stochastic function evaluations required.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Estimating epistemic uncertainty in soil parameters for nonlinear site response analyses: Introducing the Latin Hypercube Sampling technique

This study quantifies the effects of epistemic uncertainty in soil parameters on nonlinear (NL) site response analysis (SRA) results, validated against the data recorded at a well-instrumented geotechnical downhole array located in Japan. To this end, a one-dimensional soil column model of the Service Hall Array (SHA) near the Kashiwazaki-Kariwa Nuclear Power Plant (KKNPP) is developed using the finite element (FE) program LS-DYNA. The dynamic stress–strain relationship is characterized by a modified two-stage hyperbolic (MTH) NL backbone curve formulation capable of capturing soil behavior at both small- and large-shear strains. The model is then validated against the ground motion recordings to capture the model bias. The uncertainties associated with the shear-wave velocity profile (a small-strain soil property) and soil shear strength (a large-strain soil property) are incorporated in NL SRA to quantify their separate and joint randomization effects on the results. This study proposes using the Latin Hypercube Sampling (LHS) method as an efficient alternative to commonly used methods, such as Standard Monte Carlo (SMC), to account for uncertainty propagation in such reliability analysis. Both low-intensity and design-level records from the recordings at the SHA are applied to study the contribution of the small- and large-strain NL dynamic soil properties. Results from 46,200 NL FE analyses (23,100 per input motion) are presented. Measured and predicted site response, using recorded ground motions at this downhole array, is compared to assess the significance of soil parameter uncertainty on the observed ground motion dispersions. It is demonstrated that increasing the number of soft realizations and implementing higher level earthquake intensity lead to higher ground motion dispersion. Unlike past studies in randomization of Vs profiles with the SMC method, the LHS method is shown to have no significant effect on the predicted median surface response spectra and amplification factors (AFs) for this case study.

Engineering↗
DOE OSTI2022

SDSS-IV MaNGA: The MaNGA Dwarf Galaxy Sample Presentation

We present the MaNGA Dwarf galaxy (MaNDala) Value Added Catalog (VAC), from the final release of the Sloan Digital Sky Survey-IV program. MaNDala consists of 136 randomly selected bright dwarf galaxies with M * < 10 9.1 M ⊙ and M g > -18.5, making it the largest integral field spectroscopy homogeneous sample of dwarf galaxies. We release a photometric analysis of the g, r, and z broadband imaging based on the DESI Legacy Imaging Surveys, as well as a spectroscopic analysis based on the Pipe3D SDSS-IV VAC. Our release includes the surface brightness (SB), geometric parameters, and color profiles, Sérsic fits as well as stellar population properties (such as stellar ages, metallicities, and star formation histories), and emission lines' fluxes within the FOV and the effective radii of the galaxies. We find that the majority of the MaNDala galaxies are star-forming late-type galaxies with $\langle$n Sersic,r $\rangle$ ~ 1.6 that are centrals (central/satellite dichotomy). MaNDala covers a large range of SB values (we find 11 candidate ultra-diffuse galaxies and three compact ones), filling the gap between classical dwarfs and low-mass galaxies in the Kormendy Diagram and in the size–mass/luminosity relation, which seems to flatten at 10 8 < M * /M ⊙ < 10 9 with $\langle$R e,r $\rangle$ ~ 2.7 kpc. A large fraction of MaNDala galaxies formed from an early low-metallicity burst of SF, but also from late SF events from more metal-enriched gas: half of the MaNDala galaxies assembled 50% of their mass at $\langle$z$\rangle$ > 2, while the last 20% was at $\langle$z$\rangle$ < 0.3. Finally, a bending of the sSFR-M * relation at M * ~ 10 9 M ⊙ for the main-sequence galaxies seems to be supported by MaNDala.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Interpreting High-resolution Spectroscopy of Exoplanets using Cross-correlations and Supervised Machine Learning

We present a new method for performing atmospheric retrieval on ground-based, high-resolution data of exoplanets. Our method combines cross-correlation functions with a random forest, a supervised machine-learning technique, to overcome challenges associated with high-resolution data. A series of cross-correlation functions are concatenated to give a “CCF-sequence” for each model atmosphere, which reduces the dimensionality by a factor of ∼100. The random forest, trained on our grid of ∼65,000 models, provides a likelihood-free method of retrieval. The precomputed grid spans 31 values of both temperature and metallicity, and incorporates a realistic noise model. We apply our method to HARPS-N observations of the ultra-hot Jupiter KELT-9b and obtain a metallicity consistent with solar (logM = − 0.2 ± 0.2). Our retrieved transit chord temperature (T=6000{sub −200}{sup +0}K) is unreliable as strong ion lines lie outside of the extent of the training set, which we interpret as being indicative of missing physics in our atmospheric model. We compare our method to traditional nested sampling, as well as other machine-learning techniques, such as Bayesian neural networks. We demonstrate that the likelihood-free aspect of the random forest makes it more robust than nested sampling to different error distributions, and that the Bayesian neural network we tested is unable to reproduce complex posteriors. We also address the claim in Cobb et al. 2019 that our random forest retrieval technique can be overconfident but incorrect. We show that this is an artifact of the training set, rather than of the machine-learning method, and that the posteriors agree with those obtained using nested sampling.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

MALDI-MS screening of microbial colonies with isomer resolution to select fatty acid desaturase variants

Creating controlled lipid unsaturation locations in oleochemicals can be a key to many bioengineered products. However, evaluating the effects of modifications to the acyl-ACP desaturase on lipid unsaturation is not currently amenable to high-throughput assays, limiting the scale of redesign efforts to <200 variants. Here, we report a rapid MS assay for profiling the positions of double bonds on membrane lipids produced by Escherichia coli colonies after treatment with ozone gas. By MS measurement of the ozonolysis products of Δ6 and Δ8 isomers of membrane lipids from colonies expressing recombinant Thunbergia alata desaturase, we screened a randomly mutagenized library of the desaturase gene at 5 s per sample. Two variants with altered regiospecificity were isolated, indicated by an increase in 16:1 Δ8 proportion. We also demonstrated the ability of these desaturase variants to influence the membrane composition and fatty acid distribution of E. coli strains deficient in the native acyl-ACP desaturase gene, fabA. Lastly, we used the fabA deficient chassis to concomitantly express a non-native acyl- ACP desaturase and a medium-chain thioesterase from Umbellularia californica, demonstrating production of only saturated free fatty acids.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Towards robust surrogate models: Benchmarking machine learning approaches to expediting phase field simulations of brittle fracture

Data-driven approaches have the potential to make modeling complex, nonlinear physical phenomena significantly more computationally tractable. For example, computational modeling of fracture is a core challenge where machine learning techniques have the potential to provide a much needed speedup that would enable progress in areas such as multi-scale modeling and uncertainty quantification. Currently, phase field modeling (PFM) of fracture is one such approach that offers a convenient variational formulation to model crack nucleation, branching and propagation. To date, machine learning techniques have shown promise in approximating PFM simulations. While standard fracture benchmarks represent realistic scenarios frequently observed in practice, they typically do not provide sufficiently challenging tests for data-driven methods. Here, to address this gap, we introduce a challenging dataset based on PFM simulations designed to benchmark and advance ML methods for fracture modeling. This dataset includes three energy decomposition methods, two boundary conditions, and 1000 random initial crack configurations for a total of 6000 simulations. Each sample contains 100 time steps capturing the temporal evolution of the crack field. Alongside this dataset, we also implement and evaluate Physics Informed Neural Networks (PINN), Fourier Neural Operators (FNO), and UNet models as baselines, and explore the impact of ensembling strategies on prediction accuracy. With this combination of our dataset and baseline models drawn from the literature we aim to provide a standardized and challenging benchmark for evaluating machine learning approaches to solid mechanics. Our results highlight both the promise and limitations of popular current models, and demonstrate the utility of this dataset as a testbed for advancing machine learning in fracture mechanics research.

Benchmark dataset↗
DOE OSTI2024

A robust synthetic data generation framework for machine learning in high-resolution transmission electron microscopy (HRTEM)

Machine learning techniques are attractive options for developing highly-accurate analysis tools for nanomaterials characterization, including high-resolution transmission electron microscopy (HRTEM). However, successfully implementing such machine learning tools can be difficult due to the challenges in procuring sufficiently large, high-quality training datasets from experiments. In this work, we introduce Construction Zone, a Python package for rapid generation of complex nanoscale atomic structures which enables fast, systematic sampling of realistic nanomaterial structures and can be used as a random structure generator for large, diverse synthetic datasets. Using Construction Zone, we develop an end-to-end machine learning workflow for training neural network models to analyze experimental atomic resolution HRTEM images on the task of nanoparticle image segmentation purely with simulated databases. Further, we study the data curation process to understand how various aspects of the curated simulated data—including simulation fidelity, the distribution of atomic structures, and the distribution of imaging conditions—affect model performance across three benchmark experimental HRTEM image datasets. Using our workflow, we are able to achieve state-of-the-art segmentation performance on these experimental benchmarks and, further, we discuss robust strategies for consistently achieving high performance with machine learning in experimental settings using purely synthetic data. Construction Zone and its documentation are available at https://github.com/lerandc/construction_zone.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Reinforcement learning in discrete action space applied to inverse defect design

Abstract Reinforcement learning (RL) algorithms that include Monte Carlo Tree Search (MCTS) have found tremendous success in computer games such as Go, Shiga and Chess. Such learning algorithms have demonstrated super-human capabilities in navigating through an exhaustive discrete action search space. Motivated by their success in computer games, we demonstrate that RL can be applied to inverse materials design problems. We deploy RL for a representative case of the optimal atomic scale inverse design of extended defects via rearrangement of chalcogen (e.g. S) vacancies in 2D transition metal dichalcogenides (e.g. MoS 2 ). These defect rearrangements and their dynamics are important from the perspective of tunable phase transition in 2D materials i.e. 2H (semi-conducting) to 1T (metallic) in MoS 2 . We demonstrate the ability of MCTS interfaced with a reactive molecular dynamics simulator to efficiently sample the defect phase space and perform inverse design—starting from randomly distributed S vacancies, the optimal defect rearrangement of defects corresponds a line defect of S vacancies. We compare MCTS performance with evolutionary optimization i.e. genetic algorithms and show that MCTS converges to a better optimal solution (lower objective) and in fewer evaluations compared to GA. We also comprehensively evaluate and discuss the effect of MCTS hyperparameters on the convergence to solution. Overall, our study demonstrates the effectives of using RL approaches that operate in discrete action space for inverse defect design problems.

42 ENGINEERING↗
DOE OSTI2025

Continuum-electron interferometry for enhancement of photoelectron circular dichroism and measurement of bound, free, and mixed contributions to chiral response

We develop photoelectron interferometry based on laser-assisted extreme ultraviolet ionization for flexible and robust control of photoelectron circular dichroism in randomly oriented chiral molecules. A comb of XUV photons ionizes a sample of chiral molecules in the presence of a time-delayed infrared or visible laser pulse promoting interferences between components of the XUV-ionized photoelectron wave packet. In striking contrast to multicolor phase control schemes relying on pulse shaping techniques, the magnitude of the resulting chiral signal is here controlled by the time delay between the XUV and laser pulses. Furthermore, we show that the relative polarization configurations of the XUV and IR fields allow for disentangling the contributions of bound and continuum states to the chiral response. Our proposal provides a simple, robust, and versatile tool for the control of photoelectron circular dichroism and experimentally feasible protocol for probing the individual contributions of bound and continuum states to the photoelectron circular dichroism in a time-resolved manner.

atomic and molecular processes in external fields↗
DOE OSTI2023

Data for MALDI-MS Screening of Microbial Colonies With Isomer Resolution to Select Fatty Acid Desaturase Variants

Creating controlled lipid unsaturation locations in oleochemicals can be a key to many bioengineered products. However, evaluating the effects of modifications to the acyl-ACP desaturase on lipid unsaturation is not currently amenable to high-throughput assays, limiting the scale of redesign efforts to <200 variants. Here, we report a rapid mass spectrometry (MS) assay for profiling the positions of double bonds on membrane lipids produced by Escherichia coli colonies after treatment with ozone gas. By MS measurement of the ozonolysis products of Δ6 and Δ8 isomers of membrane lipids from colonies expressing recombinant Thunbergia alata desaturase, we screened a randomly mutagenized library of the desaturase gene at 5 s per sample. Two variants with altered regiospecificity were isolated, indicated by an increase in 16:1 Δ8 proportion. We also demonstrated the ability of these desaturase variants to influence the membrane composition and fatty acid distribution of E. coli strains deficient in the native acyl-ACP desaturase gene, fabA. Finally, we used the fabA deficient chassis to concomitantly express a non-native acyl-ACP desaturase and a medium-chain thioesterase from Umbellularia californica, demonstrating production of only saturated free fatty acids.

Conversion↗