Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Predictive analytics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,693 records · Page 94

Machine learning models inaccurately predict current and future high-latitude C balances

The high-latitude carbon (C) cycle is a key feedback to the global climate system, yet because of system complexity and data limitations, there is currently disagreement over whether the region is a source or sink of C. Recent advances in big data analytics and computing power have popularized the use of machine learning (ML) algorithms to upscale site measurements of ecosystem processes, and in some cases forecast the response of these processes to climate change. Due to data limitations, however, ML model predictions of these processes are almost never validated with independent datasets. To better understand and characterize the limitations of these methods, we develop an approach to independently evaluate ML upscaling and forecasting. We mimic data-driven upscaling and forecasting efforts by applying ML algorithms to different subsets of regional process-model simulation gridcells, and then test ML performance using the remaining gridcells. In this study, we simulate C fluxes and environmental data across Alaska using ecosys, a process-rich terrestrial ecosystem model, and then apply boosted regression tree ML algorithms to training data configurations that mirror and expand upon existing AmeriFLUX eddy-covariance data availability. We first show that a ML model trained using ecosys outputs from currently-available Alaska AmeriFLUX sites incorrectly predicts that Alaska is presently a modeled net C source. Increased spatial coverage of the training dataset improves ML predictions, halving the bias when 240 modeled sites are used instead of 15. However, even this more accurate ML model incorrectly predicts Alaska C fluxes under 21st century climate change because of changes in atmospheric CO 2 , litter inputs, and vegetation composition that have impacts on C fluxes which cannot be inferred from the training data. Our results provide key insights to future C flux upscaling efforts and expose the potential for inaccurate ML upscaling and forecasting of high-latitude C cycle dynamics.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of silicon carbide as a divertor armor material in DIII-D H-mode discharges

Silicon carbide (SiC) represents a promising but largely untested plasma-facing material (PFM) for next-step fusion devices. In this work, an analytic mixed-material erosion model is developed by calculating the physical (via SDTrimSP) and chemical (via empirical scalings) sputtering yield from SiC, Si, and C. The Si content in the near-surface SiC layer is predicted to increase during D plasma bombardment due to more efficient physical and chemical sputtering of C relative to Si. Silicon erosion from SiC thereby occurs primarily from sputtering of the enriched Si layer, rather than directly from the SiC itself. SiC coatings on ATJ graphite, manufactured via chemical vapor deposition, were exposed to repeated H-mode plasma discharges in the DIII-D tokamak to test this model. The qualitative trends from analytic modeling are reproduced by the experimental measurements, obtained via spectroscopic inference using the S/XB method. Quantitatively the model slightly under-predicts measured erosion rates, which is attributed to uncertainties in the ion impact angle distribution, as well as the effect of edge-localized modes. After exposure, minimal changes to the macroscopic or microscopic surface morphology of the SiC coatings were observed. Compositional analysis reveals Si enrichment of about 10%, in line with expectations from the erosion model. Extrapolating to a DEMO-type device, an order-of-magnitude decrease in impurity sourcing, and up to a factor of 2 decrease in impurity radiation, is expected with SiC walls, relative to graphite, if low C plasma impurity content can be achieved. Furthermore, these favorable erosion properties motivate further investigations of SiC as a low-Z, non-metallic PFM.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Development of Explainable, Knowledge-Guided AI Models to Enhance the E3SM Land Model Development and Uncertainty Quantification

Focal Area(s): (2)Predictive modeling using AI techniques and AI-derived model components; use of AI and other tools to design a prediction system comprising of a hierarchy of models. (3) Insight gleaned from complex data (both observed and simulated) using AI, big data analytics, and other advanced methods, including explainable AI and physics- or knowledge- guided AI. Science Challenge: The Energy Exascale Earth System Model (E3SM) is a fully coupled, state-of-the-science Earth system model that uses code optimized for DOE's advanced computers to address the most critical scientific questions facing our nation and society (Golaz et al., 2019). The E3SM Land model (ELM) is designed to understand how the changes in terrestrial land surfaces will interact with other Earth system components and has been used to understand hydrologic cycles, biogeophysics, and ecosystem dynamics. In spite of great successes, the ELM has several known issues that restrain rapid improvements. For example, the ELM uses equilibrium models to simulate dynamic land-climate interactions and it requires long model spin-up time to identify suitable initial conditions for transient simulations. The ELM lacks built-in uncertainty mechanisms that can improve the robustness of model predictions. The ELM is a holistic, deterministic model system with a rigid design, and in many situations, it is hard to modify the ELM system to incorporate new theory/hypothesis and new data across scales to address emerging science problems (such as predicting the impacts of water cycle extremes). In addition, The ELM is technically optimized for traditional CPU-centric computers and it cannot fully utilize the current and incoming leadership computers for model simulations and uncertainty quantification (UQ). The success of artificial intelligence (AI) has inspired scientists to use AI models to discover intrinsic features from simulation data (Chattopadhyay et al., 2020) and observational data (Reichstein et al., 2019) to gain further process understanding of Earth science problems. However, autonomous AI model training through deep learning usually requires a huge amount of annotated data. To overcome the limitations from the data and computing resources, knowledge-guided AI models are necessary where human-knowledge is ingested in model construction (Banino et al., 2018) and training process (Silver et al., 2016) for efficient learning. Herein, we present a new way that leverages the process understanding from the ELM to guide AI model development for the ELM enhancement and UQ. We hope this study can inspire further Earth and environmental system model developments and transformations.

54 ENVIRONMENTAL SCIENCES↗

Radio AGN in nearby dwarf galaxies: the important role of AGN in dwarf galaxy evolution

ABSTRACT We combine deep optical and radio data, from the Hyper Suprime-Cam and the Low-Frequency Array (LOFAR), respectively, to study 78 radio active galactic nuclei (AGN) in nearby (z < 0.5) dwarf galaxies. Comparison to a control sample, matched in stellar mass and redshift, indicates that the AGN and controls reside in similar environments, show similar star formation rates (which trace gas availability) and exhibit a comparable incidence of tidal features (which indicate recent interactions). We explore the AGN properties by combining the predicted gas conditions in dwarfs from a cosmological hydrodynamical simulation with a Monte Carlo suite of simulated radio sources, based on a semi-analytical model for radio-galaxy evolution. In the subset of LOFAR-detectable simulated sources, which have a similar distribution of radio luminosities as our observed AGN, the median jet powers, ages, and accretion rates are ∼1035 W, ∼5 Myr, and ∼10−3.4 M⊙ yr−1, respectively. The median mechanical energy output of these sources is ∼100 times larger than the median binding energy expected in dwarf gas reservoirs, making AGN feedback plausible. Since special circumstances (in terms of environment, gas availability, and interactions) are not necessary for the presence of AGN, and the central gas masses are predicted to be an order of magnitude larger than that required to fuel the AGN, AGN triggering in dwarfs is likely to be stochastic and a common phenomenon. Together with the plausibility of energetic feedback, this suggests that AGN could be important drivers of dwarf galaxy evolution, as is the case in massive galaxies.

Davis, F. (ORCID:0000000285224980)↗

Integrated Multi-Scale Data Analytics and Machine Learning for the Distribution Grid and Building-to-Grid Interface

This white paper introduces the application of advanced data analytics to the modernized grid. In particular, we consider the field of machine learning and where it is both useful, and not useful, for the particular field of the distribution grid and buildings interface. While analytics, in general, is a growing field of interest, and often seen as the golden goose in the burgeoning distribution grid industry, its application is often limited by communications infrastructure, or lack of a focused technical application. Overall, the linkage of analytics to purposeful application in the grid space has been limited. In this paper we consider the field of machine learning as a subset of analytical techniques, and discuss its ability and limitations to enable the future distribution grid and the building-to-grid interface. To that end, we also consider the potential for mixing distributed and centralized analytics and the pros and cons of these approaches. Machine learning is a subfield of computer science that studies and constructs algorithms that can learn from data and make predictions and improve forecasts. Incorporation of machine learning in grid monitoring and analysis tools may have the potential to solve data and operational challenges that result from increasing penetration of distributed and behind-the-meter energy resources. There is an exponentially expanding volume of measured data being generated on the distribution grid, which, with appropriate application of analytics, may be transformed into intelligible, actionable information that can be provided to the right actors – such as grid and building operators, at the appropriate time to enhance grid or building resilience, efficiency, and operations against various metrics or goals – such as total carbon reduction or other economic benefit to customers. While some basic analysis into these data streams can provide a wealth of information, computational and human boundaries on performing the analysis are becoming significant, with more data and multi-objective concerns. Efficient applications of analysis and the machine learning field are being considered in the loop.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Integrated End-to-end Performance Prediction and Diagnosis for Extreme Scientific Workflows

This report details recent progress for the ASCR funded project “Integrated End-to-end Performance Prediction and Diagnosis for Extreme Scientific Workflows”. We refer to the project as IPPD/2, reflecting the 2017 renewal under expanded scope and partners In IPPD/2, we increased our research scope to include data motion. We are focusing on three major aspects: a) observe how data is generated, distributed, and used; b) analyze how data is (repeatedly) consumed with a focus both on repeated patterns and anomalies; and c) explore how to optimize data motion. This new work on data motion will augment and complement IPPD/2’s research that focused on the computational aspects of tasks. We leverage and extend our existing tools and demonstrate our work on the Belle II workflow suite as well as on workflows from NSLS-II. The highlights of our work are as follows: Provenance for Workflows: Provenance is used to provide information enabling quality control, re-run computational workflows, and reproduce results. IPPD/2 has been building a scalable provenance management system that enables the capture of provenance from the high-level workflow through all relevant system levels in one integrated environment. Leveraging this work, our recent efforts have included using provenance as an enabling technique. Workload characterization: Leveraging provenance and analysis, we characterize data movement within network, storage, and memory over a variety of workloads. This characterization enables an understanding by performance analysts and application developers of the range of behaviors that could be expected. Performance Prediction for Workflows: The goal of modeling distributed workflows is to understand performance bottlenecks and enable more intelligent task scheduling to optimize selected metrics of interest (e.g., task throughput or output data rate). IPPD/2 has utilized both analytical and AI/ML modeling methodologies for performance modeling. Advanced Scheduling and Fault Modeling for Workflows: Scheduling of large-scale scientific workflows on geographically distributed resources is a challenging problem. To improve workflow throughput, we combined novel scheduling algorithms with task predictions from performance modeling and fault modeling. Dynamically Alleviating Bottlenecks in Workflows: Exploiting our provenance, analysis, and modeling efforts, we have explored and developed several techniques for dynamically detecting and alleviating bottlenecks in data movement. In particular, we have spent considerable effort demonstrating our techniques on production-like workflow configurations.

97 MATHEMATICS AND COMPUTING↗

Evaluating uncertainty-based active learning for accelerating the generalization of molecular property prediction

Deep learning models have proven to be a powerful tool for the prediction of molecular properties for applications including drug design and the development of energy storage materials. However, in order to learn accurate and robust structure–property mappings, these models require large amounts of data which can be a challenge to collect given the time and resource-intensive nature of experimental material characterization efforts. Additionally, such models fail to generalize to new types of molecular structures that were not included in the model training data. The acceleration of material development through uncertainty-guided experimental design has the promise to significantly reduce the data requirements and enable faster generalization to new types of materials. To evaluate the potential of such approaches for electrolyte design applications, we perform comprehensive evaluation of existing uncertainty quantification methods on the prediction of two relevant molecular properties - aqueous solubility and redox potential. We develop novel evaluation methods to probe the utility of the uncertainty estimates for both in-domain and out-of-domain data sets. Finally, we leverage selected uncertainty estimation methods for active learning to evaluate their capacity to support experimental design.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Controlling effective interactions and spatial dispersion of nanoparticles in multiblock copolymer melts

The microscopic Polymer Reference Interaction Site Model theory is employed to study, for the first time, the effective interactions, spatial organization, and miscibility of dilute spherical nanoparticles in non-microphase separating, chemically heterogeneous, compositionally symmetric AB multiblock copolymer melts of varying monomer sequence or architecture. The dependence of nanoparticle wettability on copolymer sequence and chemistry results in interparticle potentials-of-mean force that are qualitatively different from homopolymers. An important prediction is the ability to improve nanoparticle dispersion via judicious choice of block length and monomer adsorption-strengths which control both local surface segregation and chain connectivity induced packing constraints and frustration. The degree of dispersion also depends strongly on nanoparticle diameter relative to the block contour length. Small particles in copolymers with longer block lengths experience a more homopolymer-like environment which renders them relatively insensitive to copolymer chemical heterogeneity and hinders dispersion. Larger particles (sufficiently larger than the monomer diameter) in copolymers of relatively short block lengths provide better dispersion than either a homopolymer or random copolymer. The theory also predicts a novel widening of the miscibility window for large particles upon increasing the overall molecular weight of copolymers composed of relatively long blocks. The influence of a positive chi-parameter in the pure copolymer melt is briefly studied. Quantitative application to fullerenes in specific copolymers of experimental interest is performed, and miscibility predictions are made.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Machine Learning-Guided Exploration of Ternary Metal Borohydrides

We employ deep machine learning (ML) combined with first-principles calculations to explore energetically favorable ternary metal borohydrides. Using La–B–H as a prototype system, we demonstrate that iteratively trained ML models can efficiently screen hundreds of thousands of hypothetical structures and accurately select a small fraction of promising structures and compositions for further studies by first-principles calculations. Such an ML-guided approach dramatically accelerates the pace of materials discovery. A number of new La–B–H ternary compounds with formation energies within 100 meV/atom above the known ternary convex hull are discovered, including a known stable La(BH 4 ) 3 phase. Moreover, by replacing La with Group 1, 2, 3, 13, and 14 elements in the four lowest-energy La–B–H structures from our ML-guided predictions, several low-energy X–B-H (X = Mg, Ca, Sr, Ba, Sc, Y, Ac, Al, Ga, In, Si, Ge, Sn, Pb) compounds are predicted.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Evaporation of Water Nanodroplets on Heated Surfaces: Does Nano Matter?

While experiments and continuum models have provided a relatively good understanding of the evaporation of macroscopic water droplets, elucidating how sessile nanodroplets evaporate is an open question critical for advancing nanotechnological applications where nanodroplets can play an essential role. In this study, using molecular dynamics simulations, we find that evaporating nanodroplets, in contrast to their macroscopic counterparts, are not always in thermal equilibrium with the substrate and that the vapor concentration on the nanodroplet surface does not reach a steady state. As a result, the evaporative behavior of nanodroplets is significantly different. Regardless of hydrophobicity, nanodroplets do not follow conventional evaporation modes but instead exhibit dynamic wetting behavior characterized by huge, non-equilibrium, isovolumetric fluctuations in the contact angle and contact radius. For hydrophilic nanodroplets, the evaporation rate, controlled by the vapor concentration, decays exponentially over time. Hydrophobic nanodroplets follow stretched exponential kinetics arising from the slower thermalization with the substrate. The evaporative half-lifetime of the nanodroplets is directly related to the thermalization time scale and therefore increases monotonically with the hydrophobicity of the substrate. Finally, the evaporative flux profile along the nanodroplet surface is highly nonuniform but does not diverge at the contact line as the macroscopic continuum models predict.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Campaign 2 Level 2 Milestone Review 2009: Milestone # 3131 Grain Scale Simulation of Pore Collapse

The milestone reviewed on Sept. 16, 2009 was 'High-fidelity simulation of shock initiation of high explosives at the grain scale using coupled hydrodynamics, thermal transport and chemistry'. It is the opinion of the committee that the team has satisfied the milestone. A detailed description of how the goals were met is provided. The milestone leveraged capabilities from ASC Physics and Engineering Materials program combined with experimental input from Campaign 2. A combined experimental-multiscale simulation approach was used to create and validate the various TATB model components. At the lowest length scale, quantum chemical calculations were used to determine equations of state, thermal transport properties and reaction rates for TATB as it is decomposing. High-pressure experiments conducted in diamond anvil cells, gas guns and the Z machine were used to validate the EOS, thermal conductivity, specific heat and predictions of water formation. The predicted reaction networks and chemical kinetic equations were implemented in Cheetah and validated against the lower length scale data. Cheetah was then used within the ASC code ALE3D for high-resolution, thermo-mechanically coupled simulations of pore collapse at the micron size scale to predict conditions for detonation initiation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Separating the Wheat from the Chaff: Comparative Visual Cues for Transparent Diagnostics of Competing Models

Experts in data and physical sciences have to regularly grapple with the problem of competing models. Be it analytical or physics-based models, a cross-cutting challenge for experts is to reliably diagnose which model outcomes appropriately predict or simulate real-world phenomena. Expert judgment involves reconciling information across many, and often, conflicting criteria that describe the quality of model outcomes. In this paper, through a design study with climate scientists, we develop a deeper understanding of the problem and solution space of model diagnostics, resulting in the following contributions: i) a problem and task characterization using which we map experts’ model diagnostics goals to multi-way visual comparison tasks, ii) a design space of comparative visual cues for letting experts quickly understand the degree of disagreement among competing models and gauge the degree of stability of model outputs with respect to alternative criteria, and iii) design and evaluation of MyriadCues, an interactive visualization interface for exploring alternative hypotheses and insights about good and bad models by leveraging comparative visual cues. Here, we present case studies and subjective feedback by experts, which validate how MyriadCues enables more transparent model diagnostic mechanisms, as compared to the state of the art.

54 ENVIRONMENTAL SCIENCES↗

The role of pre-existing heterogeneities in materials under shock and spall

There has been a challenge for many decades to understand how heterogeneities influence the behavior of materials under shock loading, eventually leading to spall formation and failure. Experimental, analytical, and computational techniques have matured to the point where systematic studies of materials with complex microstructures under shock loading and the associated failure mechanisms are feasible. This is enabled by more accurate diagnostics as well as characterization methods. As interest in complex materials grows, understanding and predicting the role of heterogeneities in determining the dynamic behavior becomes crucial. Early computational studies, hydrocodes, in particular, historically preclude any irregularities in the form of defects and impurities in the material microstructure for the sake of simplification and to retain the hydrodynamic conservation equations. Contemporary computational methods, notably molecular dynamics simulations, can overcome this limitation by incorporating inhomogeneities albeit at a much lower length and time scale. This review discusses literature that has focused on investigating the role of various imperfections in the shock and spall behavior, emphasizing mainly heterogeneities such as second-phase particles, inclusions, and voids under both shock compression and release. Pre-existing defects are found in most engineering materials, ranging from thermodynamically necessary vacancies, to interstitial and dislocation, to microstructural features such as inclusions, second phase particles, voids, grain boundaries, and triple junctions. This literature review explores the interaction of these heterogeneities under shock loading during compression and release. Systematic characterization of material heterogeneities before and after shock loading, along with direct measurements of Hugoniot elastic limit and spall strength, allows for more generalized theories to be formulated. Further, continuous improvement toward time-resolved, in situ experimental data strengthens the ability to elucidate upon results gathered from simulations and analytical models, thus improving the overall ability to understand and predict how materials behave under dynamic loading.

36 MATERIALS SCIENCE↗

Analytical and computational approaches to define the Aspergillus niger secretome

We used computational and mass spectrometric approaches to characterize the Aspergillus niger secretome. The 11,200 gene models predicted in the genome of A. niger strain ATCC 1015 were the data source for the analysis. Depending on the computational methods used, 691 to 881 proteins were predicted to be secreted proteins. We cultured A. niger in six different media and analyzed the extracellular proteins produced using mass spectrometry. A total of 222 proteins were identified, with 39 proteins expressed under all six conditions and 74 proteins expressed under only one condition. The secreted proteins identified by mass spectrometry were used to guide the correction of about 20 gene models. Additional analysis focused on extracellular enzymes of interest for biomass processing. Of the 63 glycoside hydrolases predicted to be capable of hydrolyzing cellulose, hemicellulose or pectin, 94% of the exo-acting enzymes and only 18% of the endo-acting enzymes were experimentally detected.

09 BIOMASS FUELS↗

Hybridizing Machine Learning and Physically-based Earth System Models to Improve Prediction of Multivariate Extreme Events (AI Exploration of Wildland Fire Prediction)

Focal Areas: This project responds to two focal areas identified in the DOE Call for AI4ESP White Papers: 1) Predictive modeling through the use of artificial intelligence (AI) techniques, and 2) insights gleaned from complex data using explainable AI and big data analytics. Science Challenge: Large wildland fires (hereafter wildfires) appearing as high-impact compound climate extreme events are closely related to hydroclimate and water cycle extremes that modulate surface fuel supply and combustibility. These compound events have multivariate climatic features (e.g., temperature, precipitation, relative humidity, wind, lightning) and societal drivers (e.g., forest management, land use change, human caused ignitions). Meanwhile, they induce strong feedbacks to the coupled atmosphere, biosphere, and hydrosphere by perturbing regional and global radiation budget as well as ecological, biogeochemical, and water cycles across multiple spatiotemporal scales. The nonlinear interactions between these natural and anthropogenic components of the Earth system are too complex to be completely and adequately represented in today’s Earth system models (ESMs). The inherent stochastic nature of fire activity at all scales further increases the difficulty of its prediction using ESMs that are usually developed from deterministic equations and parameterizations. Besides, concurrence of long-term (decadal to interdecadal) global climate change and fire regime shifts overlapping with short-term (intraseasonal to interannual) variations of regional fire weather and burning activity confound predictability of these compound extreme events. We propose to address the above scientific challenges by using machine learning (ML)-based data-driven modeling techniques to integrate observations and physically-based ESMs’ simulations in a computationally efficient hybrid prediction system. This prediction system is supposed to characterize the wildfire’s sensitivity to climate and exogenous drivers at high resolution (~ 0.25°) on subseasonal to seasonal (S2S) timescales providing improved predictability and explainability. We will use the system to help identify: (1) What are the computational elements of a hybrid system needed to predict compound climate extreme events such as global wildfires? (2) What are the key drivers (either natural or anthropogenic) that modulate short-term variations of multivariate fire weather and burning activity over different regions? How can one take advantage of those driver-response relationships to improve the predictability of large wildfires on S2S time scales? (3) What are the underlying physical mechanisms and sources of improved predictability? Which ML techniques are optimal in revealing and adapting these mechanisms?

54 ENVIRONMENTAL SCIENCES↗

Observation of kinetic mix enhancement in thin-shell OMEGA implosions

Recent separated reactant experiments for thin-shell (6 µ⁢m) shock-driven implosions on OMEGA have demonstrated significant mix from a buried deuterated layer of the shell into the hot spot. Time resolved D 3 He-p reaction history data demonstrate a (50 ± 20)⁢ ps shift earlier in peak nuclear emission for separated reactant experiments relative to control, in contrast to past experimental data for thicker, 20 µ⁢m shells with no laser burn through that show a 75 ps delay due to the time required for hydrodynamic instabilities to develop. This contrast suggests that the mix mechanism was not hydrodynamic. Ion kinetic simulations utilizing fall line analyses show much closer agreement with mix yield and temperature than diffusion models, predicting a D 3 He-p mix yield of 1.7 × 10 9 as compared to the experimental value of 9.3⁢ (±2.1) × 10 8 . This is three orders of magnitude closer than the fall line analysis from a hydrodynamic simulation with an inline diffusive mix model, which suggests minimal mix and D 3 He-p yields of 5×10 5 . This makes kinetic mechanisms the only feasible explanation for the mix seen, demonstrating impact of a non-standard mix mechanism. An analytical model of this kinetic mix mechanism suggests that it can remain significant in situations when the shell expands significantly to low densities, and diffusive models predict negligible mix. Finally, kinetic mix will impact multiple types of high energy density, laser-driven fusion experiments including high-adiabat direct drive cryoexperiments, nuclear cross section experiments, and thin-shell polar direct drive experiments used to tune heat conduction models.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗