Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “surrogates”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,135 records · Page 63

Reliability‐based layout optimization in offshore wind energy systems

Abstract Existing methods for optimizing wind array layouts typically use power or cost objectives and rarely consider reliability‐based objectives. Component and system failure rates, however, are dependent on location‐specific wind conditions, are influenced by array layout and wake interactions, and have a direct and significant impact on capital costs, operational costs, and power production. Although wind power plant models exist that calculate wind loads with sufficient resolution to capture component loading dynamics from wind conditions, they are computationally expensive and thus not suitable for research applications requiring many evaluations, particularly optimization. This study describes the development of computationally efficient, reliability‐based layout optimization methods, enabling us to explore the relationship between component reliability and layout optimization. These methods include the surrogate modeling of the planet bearing life based on varying wind conditions simulated in FAST.Farm and the formulation of reliability‐based objectives based on failure cost and power production models. Through demonstration of this method, we explore how wind conditions, objective functions, and capacity density influence reliability‐based layout optimization. Results indicate that considering reliability alongside power production can reduce failure costs associated with replacement costs and downtime while maintaining or improving power production. Our conclusions highlight the opportunity for wind power plant developers to integrate reliability and operational expenditures alongside performance and capital expenditure objectives in plant design and development to improve plant performance and costs.

17 WIND ENERGY↗

In situ embedment of type K sheathed thermocouples with directed energy deposition

Advanced nuclear reactor systems require new technologies for heat transfer and system monitoring. Additive manufacturing (AM) offers the design flexibility to allow in-situ sensor embedment through smart manufacturing for real-time monitoring, and performance of these systems. Here, this study focuses on experiments investigating the feasibility of in-situ sensor embedment using directed energy deposition (DED). Type K thermocouples are embedded into 316L stainless steel (SS) samples using two different configurations (e.g., exposed and embedded tips) and two designs (e.g., flush to substrate) within an AM base. Embedded sensor samples are analyzed via in-situ measurements and high-temperature performance validation tests at 350ºC and 900ºC. Temperature performance results at both temperature tests show good agreement with manufacturer specifications proving that these sensors could still capture accurate temperature readings after in-situ embedment during DED processing. An additional optimization experiment was conducted on the exposed tip configuration using a surrogate thermocouple to improve tolerances and the embedment process. Results improved tolerances, lower porosity, smaller gaps between the sensor and base, and better junction contact for the sensor. Although further optimization of this embedment strategy is necessary to improve the structural stability and tolerances within the component, this research strategy provides a proof-of-feasibility for DED embedment with commercial sheathed thermocouples. This research provides early impact on embedment of sensor for multiple materials and complex geometric components..

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Anticipating gelation and vitrification with medium amplitude parallel superposition (MAPS) rheology and artificial neural networks

Abstract Anticipating qualitative changes in the rheological response of complex fluids (e.g., a gelation or vitrification transition) is an important capability for processing operations that utilize such materials in real-world environments. One class of complex fluids that exhibits distinct rheological states are soft glassy materials such as colloidal gels and clay dispersions, which can be well characterized by the soft glassy rheology (SGR) model. We first solve the model equations for the time-dependent, weakly nonlinear response of the SGR model. With this analytical solution, we show that the weak nonlinearities measured via medium amplitude parallel superposition (MAPS) rheology can be used to anticipate the rheological aging transitions in the linear response of soft glassy materials. This is a rheological version of a technique called structural health monitoring used widely in civil and aerospace engineering. We design and train artificial neural networks (ANNs) that are capable of quickly inferring the parameters of the SGR model from the results of sequential MAPS experiments. The combination of these data-rich experiments and machine learning tools to provide a surrogate for computationally expensive viscoelastic constitutive equations allows for rapid experimental characterization of the rheological state of soft glassy materials. We apply this technique to an aging dispersion of Laponite ® clay particles approaching the gel point and demonstrate that a trained ANN can provide real-time detection of transitions in the nonlinear response well in advance of incipient changes in the linear viscoelastic response of the system.

Lennon, Kyle R. (ORCID:0000000212515461)↗

U-net architected deep material network training with microstructure local field information

The Deep Material Network (DMN) has recently emerged as a powerful reduced-order modeling framework for simulating the mechanical response of heterogeneous materials such as composites. Unlike most data-driven approaches that directly learn a material’s response under prescribed loading, the DMN acts as a homogenization operator, learning the kinematic constraints and mechanical interactions of the underlying microstructure. However, traditional DMN training relies exclusively on homogenized effective properties derived from Direct Numerical Simulations (DNS), discarding the rich local field data that govern microstructural interactions. In this work, we extend the DMN framework to incorporate such local field information into the offline training process. Utilizing a U-Net architecture, we augment the DMN training objective to include the first and second statistical moments of the local stress fields obtained from linear DNS. This ensures that the learned network topology not only fits the effective stiffness but also accurately reflects the internal local stress and strain partitioning of the microstructure. The results confirm that supervising the localization process during training yields a superior surrogate model, reducing local prediction errors by an order of magnitude and significantly improving generalization to unseen nonlinear constitutive behaviors compared to traditional DMNs.

36 MATERIALS SCIENCE↗

Representative Phenomena of Cyclic Turbulent Combustion in High-Pressure Fuel Sprays

Abstract Cyclic variations in conventional diesel combustion engines can lead to large differences in engine out emissions even at steady operation. This study uses an optically accessible constant-pressure flow chamber to acquire fuel injections in quick succession to analyze mixing, auto-ignition, and combustion of diesel-surrogate n-heptane using multiple high-speed optical diagnostics. Prior studies have utilized fewer injections and/or they rely on analysis of ensemble average behavior. These approaches do not yield information on injection-to-injection variation or provide confidence in utilizing individual injection measurements for high-fidelity computational fluid dynamics(CFD) model validation. In this study, a large set of 500 injections is used to obtain global parameters including liquid length, vapor penetration length, ignition delay time, and lift-off length. Results for multiple injections are presented to illustrate large injection to injection variations. Potential sources for these variations are analyzed to conclude localized, small scale turbulence and rate of injection variations as the likely sources. Then, a statistical method based on z-scores is proposed and implemented to identify instantaneous injections that best represent the bulk data-set of jet boundaries measured independently by three different diagnostics. This synthesis of statistics-guided screening of data set and ensemble-average analysis offers higher confidence for CFD model validation relying upon both a representative single and average injection results.

42 ENGINEERING↗

Advancing Fusion with Machine Learning Research Needs Workshop Report

Abstract Machine learning and artificial intelligence (ML/AI) methods have been used successfully in recent years to solve problems in many areas, including image recognition, unsupervised and supervised classification, game-playing, system identification and prediction, and autonomous vehicle control. Data-driven machine learning methods have also been applied to fusion energy research for over 2 decades, including significant advances in the areas of disruption prediction, surrogate model generation, and experimental planning. The advent of powerful and dedicated computers specialized for large-scale parallel computation, as well as advances in statistical inference algorithms, have greatly enhanced the capabilities of these computational approaches to extract scientific knowledge and bridge gaps between theoretical models and practical implementations. Large-scale commercial success of various ML/AI applications in recent years, including robotics, industrial processes, online image recognition, financial system prediction, and autonomous vehicles, have further demonstrated the potential for data-driven methods to produce dramatic transformations in many fields. These advances, along with the urgency of need to bridge key gaps in knowledge for design and operation of reactors such as ITER, have driven planned expansion of efforts in ML/AI within the US government and around the world. The Department of Energy (DOE) Office of Science programs in Fusion Energy Sciences (FES) and Advanced Scientific Computing Research (ASCR) have organized several activities to identify best strategies and approaches for applying ML/AI methods to fusion energy research. This paper describes the results of a joint FES/ASCR DOE-sponsored Research Needs Workshop on Advancing Fusion with Machine Learning, held April 30–May 2, 2019, in Gaithersburg, MD (full report available at https://science.osti.gov/-/media/fes/pdf/workshop-reports/FES_ASCR_Machine_Learning_Report.pdf ). The workshop drew on broad representation from both FES and ASCR scientific communities, and identified seven Priority Research Opportunities (PRO’s) with high potential for advancing fusion energy. In addition to the PRO topics themselves, the workshop identified research guidelines to maximize the effectiveness of ML/AI methods in fusion energy science, which include focusing on uncertainty quantification, methods for quantifying regions of validity of models and algorithms, and applying highly integrated teams of ML/AI mathematicians, computer scientists, and fusion energy scientists with domain expertise in the relevant areas.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Gamma-ray spectrometry analysis methods for radioisotope dissolution and mixing for nuclear forensics applications

We report the production of surrogate nuclear explosive debris involves the dissolution of irradiated fissile material, elemental isolation, and recombination based on required fission product ratios. Gamma-ray spectrometry is used following each step to assess the radioactive fission product inventory. A high-purity germanium detector is used to measure each sample, and the detector efficiencies are determined prior to sample measurements. Through radiochemical techniques, elements are isolated and recombined into samples with specific fission product ratios. As a result, a matrix-based approach can account for imperfect chemical separations to calculate the proper mixture volumes to obtain intended volatile-to-refractory fission product ratios, or R-values.

07 ISOTOPE AND RADIATION SOURCES↗

Impurity Levels in Cerium Oxide Microspheres Prepared by Internal Gelation Sol-Gel Methods

Impurity levels were measured in cerium oxide microspheres fabricated by modified internal gelation sol-gel methods. A combination of glow discharge mass spectrometry, electron impact mass spectrometry, combustion gas analysis and instrumental gas analysis were used to assess a wide range of potential elemental impurities. Low concentrations of carbon, nitrogen, and hydrogen impurities in microspheres showed a dependence on how microspheres were washed. Silicon impurities are believed to derive from silicone oil used during sol-gel processing. Spheres washed by the preferred approach had impurity levels below 100 ppm for all elements tested. For applications such as nuclear fuels, sol-gel methods could meet purity specifications as long as metal nitrate feed solutions of sufficient purity are used and microspheres are washed appropriately. In this study, cerium was used as a surrogate for plutonium-238, which is used in radioisotope power systems as a heat source, to determine whether carbon or other impurities were concentrated during internal gelation processing and remained after heat treatments. Analyses indicated low concentrations of impurities in cerium oxide microspheres after sintering steps that were well below documented limits for plutonium-238 oxide fuels. Modified washing methods, combined with a pressurized water treatment, resulted in sintered cerium oxide sol-gel microspheres with low impurity levels.

cerium oxide, sol-gel, internal gelation, microsph↗

Explaining word embeddings with perfect fidelity: a case study in predicting research impact

The best-performing approaches for scholarly document quality prediction are based on embedding models. In addition to their performance when used in classifiers, embedding models can also provide predictions even for words that were not contained in the labelled training data for the classification model, which is important in the context of the ever-evolving research terminology. Although model-agnostic explanation methods, such as Local interpretable model-agnostic explanations, can be applied to explain machine learning classifiers trained on embedding models, these produce results with questionable correspondence to the model. We introduce a new feature importance method, Self-Model Entities Rated (SMER), for logistic regression-based classification models trained on word embeddings. We show that SMER has theoretically perfect fidelity with the explained model, as the average of logits of SMER scores for individual words (SMER explanation) exactly corresponds to the logit of the prediction of the explained model. Quantitative and qualitative evaluation is performed through five diverse experiments conducted on 50,000 research articles (papers) from the CORD-19 corpus. In conclusion, through an AOPC curve analysis, we experimentally demonstrate that SMER produces better explanations than LIME, SHAP and global tree surrogates.

Coarse-grained models↗

Consequential improvement acquisition function for efficient multi-fidelity Bayesian optimization

Abstract Surrogate-based Bayesian optimization has been widely applied in design optimization to increase sampling efficiency. However, the cost for each evaluation of the objective function can still be very high when physical experiments or large-scale simulations are involved. Multi-fidelity Bayesian optimization is the new approach to further improve the sampling efficiency by reducing the number of expensive samples at the highest fidelity level and supplementing them with less expensive ones at low-fidelity levels. In this paper, a new consequential improvement (CI) acquisition function is proposed to allow for the simultaneous selection of the solution and the fidelity level in problems with a known hierarchy of fidelity levels. The new CI acquisition function incorporates the consequential effectiveness of objective improvement with the considerations of cost, accuracy, and validity differences between high- and low-fidelity samples in engineering practice. The new method of multi-fidelity Bayesian optimization based on the CI is demonstrated with several analytical and simulation-based design examples. In the simulation-based design optimization example, the results show that the CI acquisition function has a decisive advantage in the sampling efficiency over the other methods of multi-fidelity Bayesian optimization with simultaneous selection. The results indicate that the proposed method is particularly advantageous in solving high-dimensional problems and when large cost ratios between high- and low-fidelity evaluations exist and high-fidelity validation is mandatory. Furthermore, the method robustly avoids the prevalent issue of over sampling at low-fidelity levels.

Aydogdu, Ibrahim [Georgia Institute of Technology,↗

An Experimental Method to Measure Gaseous Diffusivity in Tight and Partially Saturated Porous Media via Continuously Monitored Mass Spectrometry

Detection of radioxenon and radioargon produced by underground nuclear explosions is one of the primary methods by which the Comprehensive Nuclear-Test–Ban Treaty (CTBT) monitors for nuclear activities. However, transport of these noble gases to the surface via barometric pumping is a complex process relying on advective and diffusive processes in a fractured porous medium to bring detectable levels to the surface. To better understand this process, experimental measurements of noble gas and chemical surrogate diffusivity in relevant lithologies are necessary. However, measurement of noble gas diffusivity in tight or partially saturated porous media is challenging due to the transparent nature of noble gases, the lengthy diffusion times, and difficulty maintaining consistent water saturation. Here, the quasi-steady-state Ney–Armistead method is modified to accommodate continuous gas sampling via effusive flow to a mass spectrometer. An analytical solution accounting for the cumulative sampling losses and induced advective flow is then derived. Experimental results appear in good agreement with the proposed theory, suggesting the presence of retained groundwater reduces the effective diffusivity of the gas tracers by 10–1000 times. Finally, by using a mass spectrometer, the method described herein is applicable to a broad range of gas species and porous media.

47 OTHER INSTRUMENTATION↗

MimicGAN: Robust Projection onto Image Manifolds with Corruption Mimicking

In the past few years, Generative Adversarial Networks (GANs) have dramatically advanced our ability to represent and parameterize high-dimensional, non-linear image manifolds. As a result, they have been widely adopted across a variety of applications, ranging from challenging inverse problems like image completion, to problems such as anomaly detection and adversarial defense. A recurring theme in many of these applications is the notion of projecting an image observation onto the manifold that is inferred by the generator. In this context, Projected Gradient Descent (PGD) has been the most popular approach, which essentially optimizes for a latent vector that minimizes the discrepancy between a generated image and the given observation. However, PGD is a brittle optimization technique that fails to identify the right projection (or latent vector) when the observation is corrupted, or perturbed even by a small amount. Such corruptions are common in the real world, for example images in the wild come with unknown crops, rotations, missing pixels, or other kinds of non-linear distributional shifts which break current encoding methods, rendering downstream applications unusable. To address this, we propose corruption mimicking—a new robust projection technique, that utilizes a surrogate network to approximate the unknown corruption directly at test time, without the need for additional supervision or data augmentation. The proposed method is significantly more robust than PGD and other competing methods under a wide variety of corruptions, thereby enabling a more effective use of GANs in real-world applications. Finally, more importantly, we show that our approach produces state-of-the-art performance in several GAN-based applications—anomaly detection, domain adaptation, and adversarial defense, that benefit from an accurate projection.

97 MATHEMATICS AND COMPUTING↗

Comparison of mercury (Hg) bioaccumulation with mono- and mixed Lemna minor and Spirodela polyrhiza cultures

Mercury (Hg) is a prevalent and harmful contaminant that persists in the environment. For phytoremediation, it is important to discover which plants can bioaccumulate meaningful amounts of Hg while also tolerating its toxicity. Additionally, increasing biodiversity could create a more resilient and self-sustaining system for remediation. This study explores whether mixed populations of Lemna minor and Spirodela polyrhiza can better bioaccumulate and tolerate Hg than monocultures. Mono- and mixed cultures of L. minor and S. polyrhiza were grown in mesocosms of 0.5 μg/L or 100 μg/L Hg ( HgCl2) spiked water for 96 h. Change in weight of duckweed was used to assess Hg tolerance. Diffusive gradients in thin-films (DGTs) were used as surrogate monitoring devices for bioavailable levels of Hg. For biomass growth, the mixed culture of the L. minor was greater than the monoculture at the high dose. The L. minor accumulated more Hg in the mixed culture at the low dose while the S. polyrhiza was higher in the mixed at the high dose. Hg speciation in water was modeled using Windermere Humic Aqueous Model 7 (WHAM7) to compare the bioavailable species indicated by the DGTs. Potentially due to the controlled conditions, the WHAM7 output of bioavailable Hg was almost 1:1 to that estimated by the DGTs, indicating good predictive capability of geochemical modeling and passive sampler DGT on metal bioavailability. Altogether, the mixed cultures statistically performed as well as or better than the monocultures when tolerating and bioaccumulating Hg. However, there needs to be further work to see if the significant differences translate into practical differences worth the extra resources to maintain multiple species.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗

Digestion processes and elemental analysis of oxide and sulfide solid electrolytes

Detailed elemental analysis is essential for a successful development and optimization of material systems and synthesis methods. This is especially relevant for Li- and Na-containing compounds, found in state-of-the-art and next-generation battery systems. Their materials’ properties and thus the final device performance strongly depend on the crystal structure, the stoichiometry, and defect chemistry, e.g., influencing charge carrier concentration and activation energies for vacancy transport. However, a detailed quantitative analysis of light elements in a heavy matrix, featuring a broad range of solubilities and vapor pressures, is often difficult and associated with large uncertainties and thus neglected in favor of just reporting the stoichiometry as “weighed in.” Here, in this work, we report several approaches to digest and dissolve various oxide and sulfide-based materials, used in next-generation Li batteries, for elemental analysis via optical emission spectroscopy. These include the most common solid electrolytes Li-La-Ti–O, a perovskite material (LLTO), and Li-La-Zr-O which has garnet structure (LLZO). Additionally, a facile thermal digestion process is reported for a surrogate sulfide solid electrolyte (Na 2 S). The digestion procedures reported here are suitable for almost any laboratory environment and, when applied, will improve understanding of the synthesis-structure–property correlations needed to advanced batteries with all solid-state configurations.

Malkowski, Thomas F.↗

Temperature-Dependent Configurational Entropy Calculations for Refractory High-Entropy Alloys

The cluster expansion formalism for alloys is used to construct surrogate models for three refractory high-entropy alloys (NbTiVZr, HfNbTaTiZr, and AlHfNbTaTiZr). These cluster expansion models are then used along with Monte Carlo methods and thermodynamic integration to calculate the configurational entropy of these refractory high-entropy alloys as a function of temperature. Many solid solution alloy design guidelines are based on the ideal entropy of mixing, which increases monotonically with N , the number of elements in the alloy. However, our results show that at low temperatures, the configurational entropy of these materials is largely independent of N , and the assumption described above only holds in the high-temperature limit. This suggests that alloy design guidelines based on the ideal entropy of mixing require further examination.

36 MATERIALS SCIENCE↗

Multiscale Modeling Meets Machine Learning: What Can We Learn?

Machine learning is increasingly recognized as a promising technology in the biological, biomedical, and behavioral sciences. There can be no argument that this technique is incredibly successful in image recognition with immediate applications in diagnostics including electrophysiology, radiology, or pathology, where we have access to massive amounts of annotated data. However, machine learning often performs poorly in prognosis, especially when dealing with sparse data. This is a field where classical physics-based simulation seems to remain irreplaceable. In this review, we identify areas in the biomedical sciences where machine learning and multiscale modeling can mutually benefit from one another: Machine learning can integrate physics-based knowledge in the form of governing equations, boundary conditions, or constraints to manage ill-posted problems and robustly handle sparse and noisy data; multiscale modeling can integrate machine learn- ing to create surrogate models, identify system dynamics and parameters, analyze sensitivities, and quantify uncertainty to bridge the scales and understand the emergence of function. With a view towards applications in the life sciences, we discuss the state of the art of combining machine learning and multiscale modeling, identify applications and opportunities, raise open questions, and address potential challenges and limitations. We anticipate that it will stimulate discussion within the community of computational mechanics and reach out to other disciplines including mathematics, statistics, computer science, artificial intelligence, biomedicine, systems biology, and precision medicine to join forces towards creating robust and efficient models for biological systems.

machine learning, multiscale modeling, physics-bas↗

Mathematical analysis of laboratory microbial experiments demonstrating deterministic chaotic dynamics

Presented is a system of four ordinary differential equations and a mathematical analysis of microbiological experiments in a four-component chemostat—nutrient n, rods r, cocci c, and predators p. The analysis is consistent with the conclusion that previous experiments produced features of deterministic chaotic and classical dynamics depending on dilution rate. The surrogate model incorporates as much experimental detail as possible, but necessarily contains unmeasured parameters. The objective is to understand better the differences between model simulations and experimental results in complex microbial populations. The key methodology for simulation of chaotic dynamics, consistent with the measured dilution rate and microbial volume averages, was to cause the preference of p for r vs. c to vary with the r and c concentrations, to make r more competitive for nutrient than c, and to recycle some dying p biomass, leading to a modified version of the Monod kinetics model. Our mathematical model demonstrated that the occurrence of chaotic dynamics requires a predator, p, preference for r versus c to increase significantly with increases in r and c populations. Also included is a discussion of several generalizations of the existing model and a possible involvement of the minimum energy dissipation principle. This principle appears fundamental to thermodynamic systems including living systems. Several new experiments are suggested.

59 BASIC BIOLOGICAL SCIENCES↗

Sensitivity Analysis of an Electrospray Dehumidification System

Electrically enhanced condensation achieved by an electrospray system can enhance dehumidification in HVAC applications if successfully scaled up. The first step towards scale-up is identifying critical design and operating parameters that significantly impact dehumidification for the electrospray system. Sensitivity analysis is one approach for identifying critical parameters. This paper presents a methodology that can efficiently perform quantitative sensitivity analysis on a computationally expensive high fidelity simulation model, which is a computational fluid dynamics (CFD) model of the electrospray system. The methodology employs surrogate modeling and Sobol sensitivity analysis. We estimate the main and total effect Sobol sensitivity indices of four operating parameters of the electrospray system. The results reveal that the most important parameter is the size of the sprayed droplets, followed by the volumetric flow rate of the bulk air and injected water in the system. The water injection velocity of the spray was found to have little to no impact on dehumidification.

Young, David↗