Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “adaptive methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

Multifidelity uncertainty quantification with models based on dissimilar parameters

Multifidelity uncertainty quantification (MF UQ) sampling approaches have been shown to significantly reduce the variance of statistical estimators while preserving the bias of the highest-fidelity model, provided that the low-fidelity models are well correlated. However, maintaining a high level of correlation can be challenging, especially when models depend on different input uncertain parameters, which drastically reduces the correlation. Existing MF UQ approaches do not adequately address this issue. In this work, we propose a new sampling strategy that exploits a shared space to improve the correlation among models with dissimilar parameterization. We achieve this by transforming the original coordinates onto an auxiliary manifold using the adaptive basis (AB) method (Tipireddy and Ghanem, 2014). The AB method has two main benefits: (1) it provides an effective tool to identify the low-dimensional manifold on which each model can be represented, and (2) it enables easy transformation of polynomial chaos representations from high- to low-dimensional spaces. This latter feature is used to identify a shared manifold among models without requiring additional evaluations. Here we present two algorithmic flavors of the new estimator to cover different analysis scenarios, including those with legacy and non-legacy high-fidelity (HF) data. We provide numerical results for analytical examples, a direct field acoustic test, and a finite element model of a nuclear fuel assembly. For all examples, we compare the proposed strategy against both single-fidelity and MF estimators based on the original model parameterization.

42 ENGINEERING↗

Anisotropic fluid dynamical simulations of heavy-ion collisions

We present VAH, a (3+1)–dimensional simulation that evolves the far-from-equilibrium quark-gluon plasma produced in ultrarelativistic heavy-ion collisions with anisotropic fluid dynamics. We solve the hydrodynamic equations on an Eulerian grid using the Kurganov–Tadmor algorithm in combination with a new adaptive Runge–Kutta method. Our numerical scheme allows us to start the simulation soon after the nuclear collision, largely avoiding the need to integrate it with a separate pre-equilibrium dynamics module. We test the code's performance by simulating on the Eulerian grid conformal and non-conformal Bjorken flow as well as conformal Gubser flow, whose (0+1)–dimensional solutions are precisely known. Finally, we compare non-conformal anisotropic hydrodynamics to second-order viscous hydrodynamics in central Pb+Pb collisions and find that the former's longitudinal flow profile responds more consistently to the fluid's gradients along the spacetime rapidity direction.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Multiresolution convolutional autoencoders

Herein we propose a multi-resolution convolutional autoencoder (MrCAE) architecture that integrates and leverages three highly successful mathematical architectures: (i) multigrid methods, (ii) convolutional autoencoders and (iii) transfer learning. The method provides an adaptive, hierarchical architecture that capitalizes on a progressive training approach for multiscale spatio-temporal data. This framework allows for inputs across multiple scales: starting from a compact (small number of weights) network architecture and low-resolution data, our network progressively deepens and widens itself in a principled manner to encode new information in the higher resolution data based on its current performance of reconstruction. Basic transfer learning techniques are applied to ensure information learned from previous training steps can be rapidly transferred to the larger network. As a result, the network can dynamically capture different scaled features at different depths of the network. The performance gains of this adaptive multiscale architecture are illustrated through a sequence of numerical experiments on synthetic examples and real-world spatial-temporal data.

97 MATHEMATICS AND COMPUTING↗

An Automated Ultraclean Ion Exchange Separation Method for the Determinations of 232Th and 238U in Copper using Inductively Coupled Plasma Mass Spectrometry

This work presents a novel automated analytical method developed for high throughput ultrasensitive determinations of Th and U in copper using inductively coupled plasma mass spectrometry (ICP-MS). The method is based on the use of ultra clean sample preparation procedures including the use of a fully automated off-line chromatography system for the extraction and pre-concentration of the analytes prior to ICP-MS analysis. The separation system is equipped with a single reusable chromatographic column that, with the rigorously clean procedures developed herein, provided a low carryover, low background, and reproducible automated separation method. Isotope dilution methods were used for quantitation. Method Detection Limits (MDLs) of 3.7 and 9.4 fg·g-1 were obtained for the quantitation of 232Th and 238U in copper, respectively, corresponding to activities of 0.0148 and 0.116 microBq·kg-1 for 232Th and 238U, respectively. The analytical method provided high and reproducible tracer recoveries. The use of an automated system significantly reduced the extremely tedious active work time required for the chemist (by ca. 80%) relative to manually performing the separation. This method could be adapted to other critical sample matrices requiring the utmost in high throughput clean chemistry procedures for automated ultrasensitive analyses.

Arnquist, Isaac J.↗

Electrochemical Nickel-Catalyzed Asymmetric Hydrogenation of C═C Bonds Facilitated by a Proton-Coupled Electron Transfer Mediator

Enantioselective hydrogenation of C═C bonds is foundational to asymmetric synthesis, yet its adaptation to electrochemical methods has been limited by challenges in achieving chemoselectivity versus the hydrogen evolution reaction (HER). In this article, we present a modular electrochemical strategy that merges chiral nickel catalysis with a cobaltocene-derived proton-coupled electron transfer (PCET) mediator to enable the asymmetric hydrogenation of α,β-unsaturated carbonyl compounds. Under optimized conditions, a range of substrates featuring diverse amide functionalities and substitution patterns are hydrogenated in high yields (up to 95%) and enantioselectivities (up to 98% ee). The results described highlight the potential benefits of mediator-assisted, fixed-potential electrocatalysis in selective, stereocontrolled hydrogenation under mild conditions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Adaptation Strategies Strongly Reduce the Future Impacts of Climate Change on Simulated Crop Yields

Abstract Simulations of crop yield due to climate change vary widely between models, locations, species, management strategies, and Representative Concentration Pathways (RCPs). To understand how climate and adaptation affects yield change, we developed a meta‐model based on 8703 site‐level process‐model simulations of yield with different future adaptation strategies and climate scenarios for maize, rice, wheat and soybean. We tested 10 statistical models, including some machine learning models, to predict the percentage change in projected future yield relative to the baseline period (2000–2010) as a function of explanatory variables related to adaptation strategy and climate change. We used the best model to produce global maps of yield change for the RCP4.5 scenario and identify the most influential variables affecting yield change using Shapley additive explanations. For most locations, adaptation was the most influential factor determining the projected yield change for maize, rice and wheat. Without adaptation under RCP4.5, all crops are expected to experience average global yield losses of 6%–21%. Adaptation alleviates this average projected loss by 1–13 percentage points. Maize was most responsive to adaptive practices with a projected mean yield loss of −21% [range across locations: −63%, +3.7%] without adaptation and −7.5% [range: −46%, +13%] with adaptation. For maize and rice, irrigation method and cultivar choice were the adaptation types predicted to most prevent large yield losses, respectively. When adaptation practices are applied, some areas are predicted to experience yield gains, especially at northern high latitudes. These results reveal the critical importance of implementing adequate adaptation strategies to mitigate the impact of climate change on crop yields.

54 ENVIRONMENTAL SCIENCES↗

On-the-fly active learning of interpretable Bayesian force fields for atomistic rare events

Abstract Machine learned force fields typically require manual construction of training sets consisting of thousands of first principles calculations, which can result in low training efficiency and unpredictable errors when applied to structures not represented in the training set of the model. This severely limits the practical application of these models in systems with dynamics governed by important rare events, such as chemical reactions and diffusion. We present an adaptive Bayesian inference method for automating the training of interpretable, low-dimensional, and multi-element interatomic force fields using structures drawn on the fly from molecular dynamics simulations. Within an active learning framework, the internal uncertainty of a Gaussian process regression model is used to decide whether to accept the model prediction or to perform a first principles calculation to augment the training set of the model. The method is applied to a range of single- and multi-element systems and shown to achieve a favorable balance of accuracy and computational efficiency, while requiring a minimal amount of ab initio training data. We provide a fully open-source implementation of our method, as well as a procedure to map trained models to computationally efficient tabulated force fields.

36 MATERIALS SCIENCE↗

Spin-on deposition of amorphous zeolitic imidazolate framework films for lithography applications

Amorphous zeolitic imidazolate framework (aZIF) films have been recently introduced as resists for electron beam and extreme ultraviolet lithography. aZIFs are also being considered for separation applications, including thin film membranes. However, the reported methods for aZIF deposition are currently based on highly empirical trial-and-error approaches that hinder control of film composition, thickness and uniformity as well as scale-up and transferability to different coating geometries. This work presents a method for depositing aZIF films with controllable thickness using dilute precursors mixed immediately before encountering the substrate. Importantly, the method is amenable to quantitative analysis by computational fluid dynamics to extract intrinsic deposition rates and limiting reactant transport diffusivities, enabling predictive physics-based modeling of the deposition process. This allows the deposition method to be adapted for spin coating on silicon wafers to prepare high-quality aZIF films with consistently controlled thickness. Using this approach, high-resolution resist performance and wafer-scale use for beyond extreme-ultraviolet lithography of aZIF films is demonstrated.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Breaking the mold: Overcoming the time constraints of molecular dynamics on general-purpose hardware

The evolution of molecular dynamics (MD) simulations has been intimately linked to that of computing hardware. For decades following the creation of MD, simulations have improved with computing power along the three principal dimensions of accuracy, atom count (spatial scale), and duration (temporal scale). Since the mid-2000s, computer platforms have, however, failed to provide strong scaling for MD, as scale-out central processing unit (CPU) and graphics processing unit (GPU) platforms that provide substantial increases to spatial scale do not lead to proportional increases in temporal scale. Important scientific problems therefore remained inaccessible to direct simulation, prompting the development of increasingly sophisticated algorithms that present significant complexity, accuracy, and efficiency challenges. While bespoke MD-only hardware solutions have provided a path to longer timescales for specific physical systems, their impact on the broader community has been mitigated by their limited adaptability to new methods and potentials. In this work, we show that a novel computing architecture, the Cerebras wafer scale engine, completely alters the scaling path by delivering unprecedentedly high simulation rates up to 1.144 M steps/s for 200 000 atoms whose interactions are described by an embedded atom method potential. This enables direct simulations of the evolution of materials using general-purpose programmable hardware over millisecond timescales, dramatically increasing the space of direct MD simulations that can be carried out. In this paper, we provide an overview of advances in MD over the last 60 years and present our recent result in the context of historical MD performance trends.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Bayesian experimental design and parameter estimation for ultrafast spin dynamics

Abstract Advanced experimental measurements are crucial for driving theoretical developments and unveiling novel phenomena in condensed matter and materials physics, which often suffer from the scarcity of large-scale facility resources, such as x-ray or neutron scattering centers. To address these limitations, we introduce a methodology that leverages the Bayesian optimal experimental design paradigm to efficiently uncover key quantum spin fluctuation parameters from x-ray photon fluctuation spectroscopy (XPFS) data. Our method is compatible with existing theoretical simulation pipelines and can also be used in combination with fast machine learning surrogate models in the event that real-time simulations are unfeasible. Our numerical benchmarks demonstrate the superior performance in predicting model parameters and in delivering more informative measurements within limited experimental time. Our method can be adapted to many different types of experiments beyond XPFS and spin fluctuation studies, facilitating more efficient data collection and accelerating scientific discoveries.

97 MATHEMATICS AND COMPUTING↗

Adaptive Generation of Training Data for ML Reduced Model Creation

Machine learning proxy models are often used to speed up or completely replace complex computational models. The greatly reduced and deterministic computational costs enable new use cases such as digital twin control systems and global optimization. The challenge of building these proxy models is generating the training data. A naive uniform sampling of the input space can result in a non-uniform sampling of the output space of a model. This can cause gaps in the training data coverage that can miss finer scale details resulting in poor accuracy. While larger and larger data sets could eventually fill in these gaps, the computational burden of full-scale simulation codes can make this prohibitive. In this paper, we present an adaptive data generation method that utilizes uncertainty estimation to identify regions where training data should be augmented. By targeting data generation to areas of need, representative data sets can be generated efficiently. The effectiveness of this method will be demonstrated on a simple one-dimensional function and a complex multidimensional physics model.

Cianciosa, Mark↗

HYPPO: A Surrogate-Based Multi-Level Parallelism Tool for Hyperparameter Optimization

We present a new software, HYPPO, that enables the automatic tuning of hyperparameters of various deep learning (DL) models. Unlike other hyperparameter optimization (HPO) methods, HYPPO uses adaptive surrogate models and directly accounts for uncertainty in model predictions to find accurate and reliable models that make robust predictions. Using asynchronous nested parallelism, we are able to significantly alleviate the computational burden of training complex architectures and quantifying the uncertainty. HYPPO is implemented in Python and can be used with both TensorFlow and PyTorch libraries. We demonstrate various software features on time-series prediction and image classification problems as well as a scientific application in computed tomography image reconstruction. Finally, we show that (1) we can reduce by an order of magnitude the number of evaluations necessary to find the most optimal region in the hyperparameter space and (2) we can reduce by two orders of magnitude the throughput for such HPO process to complete.

adaptation models↗

Data-Driven PMU Noise Emulation Framework using Gradient-Penalty-Based Wasserstein GAN

Availability of phasor measurement unit (PMUs) data has led to research on data-driven algorithms for event monitoring, control and ensuring stability of the grid. Unavailability of infrequent critical event field PMU data with component failures is driving the need to generate realistic synthetic PMU data for research. The synthetic data from power system simulation software often neglect noise profiles of received phasors, thus creating some discrepancies between real PMU data and synthetic ones. To address this issue, this work presents an initial study on the noise characteristics of PMUs, as well as presenting models for recreating their unique noise signatures. The proposed method, utilizing the Wasserstein generative adversarial network with gradient penalty (WGAN-GP) architecture, provides an excellent benchmark for matching the noise distribution. One can use a well-learned GAN model to draw noise signatures from a distribution that seemingly mirrors the real PMU noise distribution, while also being able to be detached from the PMU data once the training is done. Based on the observed results and employed data-driven methodology, it is expected that the proposed methods can be adapted to replicate the behavior of other sensors, providing research and other applications with a tool for data synthesis and sensor characterization.

PMU↗

Novel Data Driven Noise Emulation Framework using Deep Neural Network for Generating Synthetic PMU Measurements

Sensors play a critical role in supporting day-to-day grid operations and they are essential to operator’s decision-making process. Furthermore, sensors and sensor behaviors need to be emulated with grid simulations to perform modeling studies and to design cutting edge power systems applications. Ensuring the accurate behavior of these applications requires accurate emulation of sensors and pertinent signals. However, most grid simulators and modeling tools assume either zero error scenarios or simplistic noise models that may not always correlate to real-world sensors. To address the above issue, this work presents an initial study on the noise characteristics of phasor measurement units (PMUs), along with models for recreating their unique noise signatures. The proposed methods (both analytical and machine-learning-based) provide a substantial increase in a sensor’s model fidelity, a feature that can be leveraged by an end-user application to yield more accurate system representations. The proposed methods were then applied to micro PMU data from the EPFL microgrid campus to extract sensor noise profiles. This data was used to train a deep learning model, which was tested to emulate the noise characteristics present in actual signals. Based on the observed results and the employed data-driven methodology, the proposed methods may be adapted to replicate the behavior of other grid sensors and power new applications capable of detecting sensor degradation and eventual device failures in near real-time.

PMU, noise emulation, synthetic measurements, deep↗

Identification and characterization of a skin microbiome on Caenorhabditis elegans suggests environmental microbes confer cuticle protection

ABSTRACT In the wild, C. elegans are emersed in environments teeming with a veritable menagerie of microorganisms. The C. elegans cuticular surface serves as a barrier and first point of contact with their microbial environments. In this study, we identify microbes from C. elegans natural habitats that associate with its cuticle, constituting a simple “skin microbiome.” We rear our animals on a modified CeMbio, mCeMbio, a consortium of ecologically relevant microbes. We first combine standard microbiological methods with an adapted micro skin-swabbing tool to describe the skin-resident bacteria on the C. elegans surface. Furthermore, we conduct 16S rRNA gene sequencing studies to identify relative shifts in the proportion of mCeMbio bacteria upon surface-sterilization, implying distinct skin- and gut-microbiomes. We find that some strains of bacteria, including Enterobacter sp. JUb101 , are primarily found on the nematode skin, while others like Stenotrophomonas indicatrix JUb19 and Ochrobactrum vermis MYb71 are predominantly found in the animal’s gut. Finally, we show that this skin microbiome promotes host cuticle integrity in harsh environments. Together, we identify a skin microbiome for the well-studied nematode model and propose its value in conferring host fitness advantages in naturalized contexts. IMPORTANCE The genetic model organism C. elegans has recently emerged as a tool for understanding host–microbiome interactions. Nearly all of these studies either focus on pathogenic or gut-resident microbes. Little is known about the existence of native, nonpathogenic skin microbes or their function. We demonstrate that members of a modified C. elegans model microbiome, mCeMbio, can adhere to the animal's cuticle and confer protection from noxious environments. We combine a novel micro-swab tool, the first 16S microbial sequencing data from relatively unperturbed C. elegans , and physiological assays to demonstrate microbially mediated protection of the skin. This work serves as a foundation to explore wild C. elegans skin microbiomes and use C. elegans as a model for skin research.

16S RNA↗

Evaluating the Interplay between Trajectory Segmentation and Mode Inference Error

Travel behavior changes are essential to transportation decarbonization. Travel diaries, consisting of sequences of trips between places, are typically used to instrument human travel behavior. However, these diaries are only as accurate as the underlying methods used to construct them. Travel diary algorithms have been a popular research topic since the advent of Global Positioning System tracking surveys. These algorithms have typically been validated using prompted recall of presegmented trips, thus disregarding the continuity of mode inference. Phone operating systems have adopted battery-conserving techniques, but the resulting data collection errors have not been studied extensively. We introduce a framework to evaluate the accuracy of trip length computations and mode inference by analyzing continuous mode-segmented trajectories for groups of trips. We then use the framework to identify the input data quality and the impact of postprocessing. Our primary inputs to this evaluation are MobilityNet, a public dataset containing information from three artificial timelines covering 15 different travel modes, and sample open-source travel diary creation algorithms from the OpenPATH project. Our framework concretely shows that the variance of the distance error drops from (0.217, 0.0848) to (o.011, 0.0407) (Android, iOS) after postprocessing. Similarly, the weighted F-scores for mode inference increase from (0.25, 0.29) to (0.60, 0.74) (iOS, Android) between random forest and geographic information system-based models. We hope that this standardized method will be adapted to evaluate other, potentially proprietary, travel diary algorithms. Finally, the results can be used to understand and improve the state of the art in the travel diary creation field.

33 ADVANCED PROPULSION SYSTEMS↗

X-ray pulse generation with ultra-fast flipping of its orbital angular momentum

A method to temporally tailor the properties of X-ray radiation carrying Orbital Angular Momentum (OAM) is presented. In simulations, an electron beam is prepared with a temporally modulated micro-bunching structure which, when radiating at the second harmonic in a helical undulator, generates OAM light with a corresponding temporally modulated intensity. This method is shown to generate attosecond pulse trains of OAM light without the need for any additional external optics, making the wavelength range tunable. In addition to the OAM pulse train, the method can be adapted to generate radiation where the handedness of the OAM mode may also be temporally modulated (flipped).

43 PARTICLE ACCELERATORS↗