Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “network data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,549 records · Page 86
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Predicting spring phenology in deciduous broadleaf forests: NEON phenology forecasting community challenge

Accurate models are important to predict how global climate change will continue to alter plant phenology and near-term ecological forecasts can be used to iteratively improve models and evaluate predictions that are made a priori. The Ecological Forecasting Initiative's National Ecological Observatory Network (NEON) Forecasting Challenge, is an open challenge to the community to forecast daily greenness values, measured through digital images collected by the PhenoCam Network at NEON sites before the data are collected. For the first round of the challenge, which is presented here, we forecasted canopy greenness throughout the spring at eight deciduous broadleaf sites to investigate when, where, and for what model type phenology forecast skill is highest. A total of 192,536 predictions were submitted, representing eighteen models, including a persistence and a day of year mean null models. We found that overall forecast skill was highest when forecasting earlier in the greenup curve compared to the end, for shorter lead times, for sites that greened up earlier, and when submitting forecasts during times other than near budburst. The models based on day of year historical mean had the highest predictive skill across the challenge period. In this first round of the challenge, by synthesizing across forecasts, we started to elucidate what factors affect the predictive skill of near-term phenology forecasts.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Theoretical assessments of CO 2 activation and hydrogenation pathways on transition-metal surfaces

Carbon dioxide (CO 2 ) hydrogenation on transition-metal active sites offers a promising carbon utilization route toward mitigating greenhouse gas emissions. C 1 products are often formed in parallel during CO 2 hydrogenation, prompting investigations into the intrinsic properties of transition metals that drive activity and product selectivity. Here, in this work, close-packed surfaces of a selection of transition-metal catalysts (Ni, Co, Rh, Ru, Pd, and Pt) were studied with density functional theory (DFT) calculations to understand their fundamental reactivities for CO 2 transformation reactions. Results indicate that CO 2 conversion proceeds through CO* formation and hydrogenation to form C 1 products (* denotes an adsorbed species). Ni, Co, Rh, and Ru favor CO/CH 4 formation, while Pd and Pt favor CO/CH 3 OH formation. The ability of a metal to dissociate C-O bonds drives selectivity between CH 4 and CH 3 OH, while competition between CO* desorption and surface hydrogenation describes CO selectivities. The C-O bond dissociation steps often impose the highest barrier along CH 4 formation reaction profiles, suggesting their kinetic relevance for CH 4 formation rates. The provided DFT-derived data sets detail a comprehensive reaction network of elementary steps relevant to C 1 chemistries, ultimately offering a benchmark for insights into design strategies for materials that exploit transition-metal active sites in carbon capture or utilization processes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Advanced data science toolkit for non-data scientists – A user guide

Emerging modern data analytics attracts much attention in materials research and shows great potential for enabling data-driven design. Data populated from the high-throughput CALPHAD approach enables researchers to better understand underlying mechanisms and to facilitate novel hypotheses generation, but the increasing volume of data makes the analysis extremely challenging. Here in this paper, we introduce an easy-to-use, versatile, and open-source data analytics frontend, ASCENDS (Advanced data SCiENce toolkit for Non-Data Scientists), designed with the intent of accelerating data-driven materials research and development. The toolkit is also of value beyond materials science as it can analyze the correlation between input features and target values, train machine learning models, and make predictions from the trained surrogate models of any scientific dataset. Various algorithms implemented in ASCENDS allow users performing quantified correlation analyses and supervised machine learning to explore any datasets of interest without extensive computing and data science background. The detailed usage of ASCENDS is introduced with an example of experimental high-temperature alloy data.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2020

A physics-informed operator regression framework for extracting data-driven continuum models

The application of deep learning toward discovery of data-driven models requires careful application of inductive biases to obtain a description of physics which is both accurate and robust. We present here a framework for discovering continuum models from high fidelity molecular simulation data. Our approach applies a neural network parameterization of governing physics in modal space, allowing a characterization of differential operators while providing structure which may be used to impose biases related to symmetry, isotropy, and conservation form. Here, we demonstrate the effectiveness of our framework for a variety of physics, including local and nonlocal diffusion processes and single and multiphase flows. For the flow physics we demonstrate this approach leads to a learned operator that generalizes to system characteristics not included in the training sets, such as variable particle sizes, densities, and concentration.

42 ENGINEERING↗
DOE OSTI2022

Tempering kinetics during multilayer laser additive manufacturing of a ferritic steel

Grade 91 steel forms martensite during additive manufacturing and the extent of tempering of martensite significantly affects the mechanical properties of parts. Currently, there is a lack of quantitative understanding of the tempering kinetics for Grade 91 steel, and as a result, the effects of repeated thermal cycles on properties for different processing conditions cannot be determined. Here we evaluate the tempering kinetics by determining the constant terms in the Johnson Mehl Avrami kinetic equation from the tempering data available in the literature and the thermal cycles computed using a rigorously-tested heat and fluid flow model of multi-layer additive manufacturing. The raw tempering data are cleaned using a neural network to enhance accuracy. The lower layers experience repeating cycles of heating and cooling when the upper layers are added. As a result, the hardness is reduced owing to the tempering of martensite. In contrast, martensite formed in the upper layers is not tempered to the same extent and the hardness remains high. Therefore, the hardness of the part increases with the distance from the substrate. Variations in the heat input at different laser powers and scanning speeds significantly affect the extent of tempering. Finally, since the method used here can provide a quantitative understanding of the tempering of martensite and the spatial variation in hardness, it can be used to tailor the microstructure and hardness of heat treatable printed metallic parts.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Accelerating gradient descent and Adam via fractional gradients

Here we propose a class of novel fractional-order optimization algorithms. We define a fractional-order gradient via the Caputo fractional derivatives that generalizes integer-order gradient. We refer it to as the Caputo fractional-based gradient, and develop an efficient implementation to compute it. A general class of fractional-order optimization methods is then obtained by replacing integer-order gradients with the Caputo fractional-based gradients. To give concrete algorithms, we consider gradient descent (GD) and Adam, and extend them to the Caputo fractional GD (CfGD) and the Caputo fractional Adam (CfAdam). We demonstrate the superiority of CfGD and CfAdam on several large scale optimization problems that arise from scientific machine learning applications, such as ill-conditioned least squares problem on real-world data and the training of neural networks involving non-convex objective functions. Numerical examples show that both CfGD and CfAdam result in acceleration over GD and Adam, respectively. We also derive error bounds of CfGD for quadratic functions, which further indicate that CfGD could mitigate the dependence on the condition number in the rate of convergence and results in significant acceleration over GD.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Synergistic learning with multi-task DeepONet for efficient PDE problem solving

Multi-task learning (MTL) is an inductive transfer mechanism designed to leverage useful information from multiple tasks to improve generalization performance compared to single-task learning. It has been extensively explored in traditional machine learning to address issues such as data sparsity and overfitting in neural networks. In this work, we apply MTL to problems in science and engineering governed by partial differential equations (PDEs). However, implementing MTL in this context is complex, as it requires task-specific modifications to accommodate various scenarios representing different physical processes. To this end, we present a multi-task deep operator network (MT-DeepONet) to learn solutions across various functional forms of source terms in a PDE and multiple geometries in a single concurrent training session. We introduce modifications in the branch network of the vanilla DeepONet to account for various functional forms of a parameterized coefficient in a PDE. Additionally, we handle parameterized geometries by introducing a binary mask in the branch network and incorporating it into the loss term to improve convergence and generalization to new geometry tasks. Our approach is demonstrated on three benchmark problems: (1) learning different functional forms of the source term in the Fisher equation; (2) learning multiple geometries in a 2D Darcy Flow problem and showcasing better transfer learning capabilities to new geometries; and (3) learning 3D parameterized geometries for a heat transfer problem and demonstrate the ability to predict on new but similar geometries. Finally, our MT-DeepONet framework offers a novel approach to solving PDE problems in engineering and science under a unified umbrella based on synergistic learning that reduces the overall training cost for neural operators.

42 ENGINEERING↗
DOE OSTI2025

Challenges in integrating dissolved organic matter chemodiversity into kinetic models of soil respiration

The chemodiversity of dissolved organic matter (DOM) in soil has been proposed to influence the microbial metabolism and fate of belowground organic carbon (C). However, integrating DOM chemistry into soil C cycle models to improve predictions of C stocks and fluxes—beyond simply considering DOM pool size—remains a challenge. While recent research suggests that incorporating DOM chemodiversity into models can improve predictions of microbial respiration, there is still a lack of mechanistic understanding describing how DOM chemodiversity affects microbial metabolism and soil respiration. Here, we evaluated whether DOM chemodiversity was a determinant of soil respiration using paired measurements of high-resolution DOM chemistry, obtained from Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS), and potential soil respiration rates from across the United States (U.S.), all data provided by the Molecular Observation Network. Our objectives were to (1) assess statistical relationships between DOM chemodiversity and microbial respiration, and (2) evaluate the ability of kinetic models to leverage DOM chemistry to explain empirical relationships found in statistical models. Statistical regressions revealed that DOM chemodiversity (alpha diversity) was nonlinearly related to potential soil respiration rates, both independently and through its interactions with DOM and total C concentrations. In soils with relatively high DOM but low total C concentrations, potential soil respiration rates were negatively correlated with DOM alpha diversity, whereas in soils with relatively low DOM and high total C concentrations showed the opposite trend. However, when metabolic transition theory kinetic models were modified to include chemodiversity, their performance was comparable to traditional Monod kinetics approaches, which simulate respiration rates as a function of DOM concentration. The inability to account for nonlinearities in DOM chemodiversity–respiration relationships highlight an opportunity to advance substrate uptake kinetics by establishing causal links between DOM chemodiversity, microbial metabolism trade-offs, and potential interactions under varied environmental conditions.

Bioenergetic model↗
DOE OSTI2020

Deep Learning Emulation of Subgrid-Scale Processes in Turbulent Shear Flows

Deep neural networks (DNNs) are developed from a data set obtained from the dynamic Smagorinsky model to emulate the subgrid-scale (SGS) viscosity (ν sgs ) and diffusivity (κ sgs ) for turbulent stratified shear flows encountered in the oceans and the atmosphere. These DNNs predict ν sgs and κ sgs from velocities, strain rates, and density gradients such that the evolution of the kinetic energy budget and density variance budget terms is similar to the corresponding values obtained from the original dynamic Smagorinsky model. These DNNs also compute ν sgs and κ sgs ~2–4 times quicker than the dynamic Smagorinsky model resulting in a ~2–2.5 times acceleration of the entire simulation. This study demonstrates the feasibility of deep learning in emulating the subgrid-scale (SGS) phenomenon in geophysical flows accurately in a cost-effective manner. In a broader perspective, deep learning-based surrogate models can present a promising alternative to the traditional parameterizations of the subgrid-scale processes in climate models.

58 GEOSCIENCES↗
DOE OSTI2022

Three‐Dimensional Permeability Inversion Using Convolutional Neural Networks and Positron Emission Tomography

Abstract Quantification of heterogeneous multiscale permeability in geologic porous media is key for understanding and predicting flow and transport processes in the subsurface. Recent utilization of in situ imaging, specifically positron emission tomography (PET), enables the measurement of three‐dimensional (3‐D) time‐lapse radiotracer solute transport in geologic media. However, accurate and computationally efficient characterization of the permeability distribution that controls the solute transport process remains challenging. Leveraging the relationship between local permeability variation and solute advection behavior, an encoder‐decoder based convolutional neural network (CNN) is implemented as a permeability inversion scheme using a single PET scan of a radiotracer pulse injection experiment as input. The CNN can accurately capture the 3‐D spatial correlation between the permeability and the radiotracer solute arrival time difference maps in geologic cores. We first test the inversion accuracy using synthetic test datasets and then test the accuracy on a suite of experimental PET imaging datasets acquired on four different geologic cores. The network‐predicted permeability maps from the geologic cores are used to parameterize forward numerical models that are directly compared with the experimental PET imaging data. The results indicate that a single trained network can generate robust 3‐D permeability inversion maps in seconds. Numerical models parameterized with these permeability maps closely capture the experimentally observed solute arrival time behavior. This work provides an unprecedented approach for efficiently characterizing multiscale permeability heterogeneity in complex geologic samples.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Upscaling Soil Organic Carbon Measurements at the Continental Scale Using Multivariate Clustering Analysis and Machine Learning

Abstract Estimates of soil organic carbon (SOC) stocks are essential for many environmental applications. However, significant inconsistencies exist in SOC stock estimates for the U.S. across current SOC maps. We propose a framework that combines unsupervised multivariate geographic clustering (MGC) and supervised Random Forests regression, improving SOC maps by capturing heterogeneous relationships with SOC drivers. We first used MGC to divide the U.S. into 20 SOC regions based on the similarity of covariates (soil biogeochemical, bioclimatic, biological, and physiographic variables). Subsequently, separate Random Forests models were trained for each SOC region, utilizing environmental covariates and SOC observations. Our estimated SOC stocks for the U.S. (52.6 ± 3.2 Pg for 0–30 cm and 108.3 ± 8.2 Pg for 0–100 cm depth) were within the range estimated by existing products like Harmonized World Soil Database, HWSD (46.7 Pg for 0–30 cm and 90.7 Pg for 0–100 cm depth) and SoilGrids 2.0 (45.7 Pg for 0–30 cm and 133.0 Pg for 0–100 cm depth). However, independent validation with soil profile data from the National Ecological Observatory Network showed that our approach ( R 2 = 0.51) outperformed the estimates obtained from Harmonized World Soil Database ( R 2 = 0.23) and SoilGrids 2.0 ( R 2 = 0.39) for the topsoil (0–30 cm). Uncertainty analysis (e.g., low representativeness and high coefficients of variation) identified regions requiring more measurements, such as Alaska and the deserts of the U.S. Southwest. Our approach effectively captures the heterogeneous relationships between widely available predictors and the current SOC baseline across regions, offering reliable SOC estimates at 1 km resolution for benchmarking Earth system models.

58 GEOSCIENCES↗
DOE OSTI2021

Structural insights into the disruption of TNF-TNFR1 signalling by small molecules stabilising a distorted TNF

Tumour necrosis factor (TNF) is a trimeric protein which signals through two membrane receptors, TNFR1 and TNFR2. Previously, we identified small molecules that inhibit human TNF by stabilising a distorted trimer and reduce the number of receptors bound to TNF from three to two. Here we present a biochemical and structural characterisation of the small molecule-stabilised TNF-TNFR1 complex, providing insights into how a distorted TNF trimer can alter signalling function. We demonstrate that the inhibitors reduce the binding affinity of TNF to the third TNFR1 molecule. In support of this, we show by X-ray crystallography that the inhibitor-bound, distorted, TNF trimer forms a complex with a dimer of TNFR1 molecules. This observation, along with data from a solution-based network assembly assay, leads us to suggest a model for TNF signalling based on TNF-TNFR1 clusters, which are disrupted by small molecule inhibitors.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Deep learning workflow for the inverse design of molecules with specific optoelectronic properties

The inverse design of novel molecules with a desirable optoelectronic property requires consideration of the vast chemical spaces associated with varying chemical composition and molecular size. First principles-based property predictions have become increasingly helpful for assisting the selection of promising candidate chemical species for subsequent experimental validation. However, a brute-force computational screening of the entire chemical space is decidedly impossible. To alleviate the computational burden and accelerate rational molecular design, we here present an iterative deep learning workflow that combines (i) the density-functional tight-binding method for dynamic generation of property training data, (ii) a graph convolutional neural network surrogate model for rapid and reliable predictions of chemical and physical properties, and (iii) a masked language model. As proof of principle, we employ our workflow in the iterative generation of novel molecules with a target energy gap between the highest occupied molecular orbital (HOMO) and the lowest unoccupied molecular orbital (LUMO).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Bioplastic design using multitask deep neural networks

Abstract Non-degradable plastic waste jeopardizes our environment, yet our modern lifestyle and current technologies are impossible to sustain without plastics. Bio-synthesized and biodegradable alternatives such as polyhydroxyalkanoates (PHAs) have the potential to replace large portions of the world’s plastic supply with cradle-to-cradle materials, but their chemical complexity and diversity limit traditional resource-intensive experimentation. Here, we develop multitask deep neural network property predictors using available experimental data for a diverse set of nearly 23,000 homo- and copolymer chemistries. Using the predictors, we identify 14 PHA-based bioplastics from a search space of almost 1.4 million candidates which could serve as potential replacements for seven petroleum-based commodity plastics that account for 75% of the world’s yearly plastic production. We also discuss possible synthesis routes for the identified promising materials.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Ensemble flow reconstruction in the atmospheric boundary layer from spatially limited measurements through latent diffusion models

Due to costs and practical constraints, field campaigns in the atmospheric boundary layer typically only measure a fraction of the atmospheric volume of interest. Machine learning techniques have previously successfully reconstructed unobserved regions of flow in canonical fluid mechanics problems and two-dimensional geophysical flows, but these techniques have not yet been demonstrated in the three-dimensional atmospheric boundary layer. Here, we conduct a numerical analogue of a field campaign with spatially limited measurements using large-eddy simulation. We pose flow reconstruction as an inpainting problem, and reconstruct realistic samples of turbulent, three-dimensional flow with the use of a latent diffusion model. The diffusion model generates physically plausible turbulent structures on larger spatial scales, even when input observations cover less than 1% of the volume. Through a combination of qualitative visualization and quantitative assessment, we demonstrate that the diffusion model generates meaningfully diverse samples when conditioned on just one observation. These samples successfully serve as initial conditions for a large-eddy simulation code. We find that diffusion models show promise and potential for other applications for other turbulent flow reconstruction problems.

17 WIND ENERGY↗
DOE OSTI2025

Mind the gap: Bridging the divide between AI aspirations and the reality of autonomous microscopy

What does materials science look like in the “Age of Artificial Intelligence?” Each material’s domain—synthesis, characterization, and modeling—has a different answer to this question, motivated by unique challenges and constraints. This work focuses on the tremendous potential of autonomous characterization within electron microscopy. We present our recent advancements in developing domain-aware, multimodal models for microscopy analysis capable of describing complex atomic systems. We then address the critical gap between the theoretical promise of autonomous microscopy and its current practical limitations, showcasing recent successes while highlighting the necessary developments to achieve robust, real-world autonomy.

2D materials↗
DOE OSTI2022

Regulators of early maize leaf development inferred from transcriptomes of laser capture microdissection (LCM)-isolated embryonic leaf cells

The superior photosynthetic efficiency of C 4 leaves over C 3 leaves is owing to their unique Kranz anatomy, in which the vein is surrounded by one layer of bundle sheath (BS) cells and one layer of mesophyll (M) cells. Kranz anatomy development starts from three contiguous ground meristem (GM) cells, but its regulators and underlying molecular mechanism are largely unknown. To identify the regulators, we obtained the transcriptomes of 11 maize embryonic leaf cell types from five stages of pre-Kranz cells starting from median GM cells and six stages of pre-M cells starting from undifferentiated cells. Principal component and clustering analyses of transcriptomic data revealed rapid pre-Kranz cell differentiation in the first two stages but slow differentiation in the last three stages, suggesting early Kranz cell fate determination. In contrast, pre-M cells exhibit a more prolonged transcriptional differentiation process. Differential gene expression and coexpression analyses identified gene coexpression modules, one of which included 3 auxin transporter and 18 transcription factor (TF) genes, including known regulators of Kranz anatomy and/or vascular development. In situ hybridization of 11 TF genes validated their expression in early Kranz development. We determined the binding motifs of 15 TFs, predicted TF target gene relationships among the 18 TF and 3 auxin transporter genes, and validated 67 predictions by electrophoresis mobility shift assay. From these data, we constructed a gene regulatory network for Kranz development. Our study sheds light on the regulation of early maize leaf development and provides candidate leaf development regulators for future study.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

1.2 Mfps standalone X-ray detector for Time-Resolved Experiments

We present a standalone and autonomous X-ray detector capable of operation with the speed of up to1.2Mfps. The detector utilizes UFXC32k hybrid pixel detectors for sensing X-rays, Spartan-6 LX45 FPGA placed in commercially available sbRIO 9628 controller for data acquisition and processing including a compression with zero-suppression algorithm. A Linux-RT system working on the 400 MHz Dual-Core CPU is used for FPGA control and data streaming to the higher-level system over 1 Gbps Ethernet connection. 1.2 M frames per second is achieved in so-called burst mode of operation while in zerodead-time mode 70 kfps is possible. Due to efficient data compression in FPGA there’s no need of using high-speed transceivers and Frame-Grabber cards on the data server side and the detector can stream the data infinitely over standard 1 Gbps network connection. Operation modes were tested at Advanced Photon Source Synchrotron at Argonne National Laboratory.

47 OTHER INSTRUMENTATION↗