SEARCH · Engineering Papers

Results for “Transformer model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Disentangling the Impacts of Microtopography and Shrub Distribution on Snow Depth in a Subarctic Watershed: Toward a Predictive Understanding of Snow Spatial Variability

Snow plays a critical role in carbon cycling, vegetation dynamics, and permafrost hydrology at high latitudes by influencing surface energy exchange. Predicting snow distribution patterns is essential for understanding the evolution of Arctic ecosystems, yet scaling process-level knowledge to landscape predictions remains challenging. Here, we analyze snow depth (2019 and 2022), terrain elevation, and vegetation height from a watershed on the Seward Peninsula, Alaska, to examine how topography and shrubs shape snow redistribution across spatial scales. We find that snow depth is strongly coupled to terrain at scales below ∼60 m but becomes increasingly decoupled at larger scales. The topographic model of snow depth variation, which transforms terrain data to align with these scale-dependent snow patterns, is well correlated with local snow depth variations (linear fit R 2 > 0.5 for 85% of 100-m patches). A machine learning reconstruction of shrub canopy snow trapping reveals a simple exponential relationship between canopy structure and snow accumulation ( R 2 = 0.59), highlighting the combined influence of topography and vegetation on snow distribution. Together, these empirical relationships capture much of the observed snow variability in the watershed ( R 2 = 0.49, root mean square error (RMSE) = 30 cm), though systematic limitations persist in areas of strong scour and at coarser scales where wind-terrain interactions are more complex. These findings provide a framework for more efficient snow depth prediction and offer insights to improve snow-vegetation feedback representation in Earth System Models.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Understanding the Effect of Sample Geometry on Temperature Distribution during Optical Floating Zone Crystal Growth in Vacuum Environment through Heat Transfer Modeling

Optical floating zone furnaces (OFZ) have had a transformative impact on fundamental science due to their ability to rapidly produce large single crystals of a wide variety of complex materials. However, a quantitative understanding of the OFZ growth environment is generally lacking due to the difficulty of measuring the local sample temperatures during OFZ growth, as well as to the general lack of information about the temperature-dependent physical parameters needed to model heat transfer. To overcome these challenges, we apply a physics-based heat transfer model, parametrized by measurements from synchrotron experiments and a machine-learning (ML) algorithm, to simulate the temperature distributions of samples heated in an OFZ furnace in a vacuum environment. This model is used to quantitatively understand how the sample maximum temperature and temperature gradient (key parameters that influence the success of crystal growth) are affected by the rod size, rod shape, and heat-zone position on the rod. The results of this study can be applied to make informed decisions on how crystal growth parameters can be tuned to modify temperature profiles and to optimize crystal growth outcomes even when data on internal sample temperature profiles (e.g., those obtained through in situ synchrotron experiments) are not accessible.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Investigating Future Arctic Sea Ice Loss and Near–Surface Wind Speed Changes Related to Surface Roughness Using the Community Earth System Model

The Arctic is undergoing a pronounced and rapid transformation in response to changing greenhouse gasses, including reduction in sea ice extent and thickness. There are also projected increases in near-surface Arctic wind. This study addresses how the winds trends may be driven by changing surface roughness and/or stability in different Arctic regions and seasons, something that has not yet been thoroughly investigated. We analyze 50 experiments from the Community Earth System Model Version 2 (CESM2) Large Ensemble and five experiments using CESM2 with an artificially decreased sea ice roughness to match that of the open ocean. We find that with a smoother surface there are higher mean wind speeds and slower mean ice speeds in the autumn, winter, and spring. The artificially reduced surface roughness also strongly impacts the wind speed trends in autumn and winter, and we find that atmospheric stability changes are also important contributors to driving wind trends in both experiments. In contrast to the clear impacts on winds, the sea ice mean state and trends are statistically indistinguishable, suggesting that near-surface winds are not major drivers of Arctic sea ice loss. Two major results of this work are: (a) the near-surface wind trends are driven by changes in both surface roughness and near-surface atmospheric stability that are themselves changing from sea ice loss, and (b) the sea ice mean state and trends are driven by the overall warming trend due to increasing greenhouse gas emissions and not significantly impacted by coupled feedbacks with the surface winds.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Large Language Models for the Creation and Use of Semantic Ontologies in Buildings: Requirements and Challenges

Semantic ontologies offer a formalized, machine-readable framework for representing knowledge, enabling the structured description of complex systems. In the building domain, the adoption of ontologies like the Brick schema has transformed how buildings and their systems are modeled by providing a standardized, interoperable language. However, the complexity and the steep learning curve involved in developing and querying semantic models present substantial challenges, often requiring a workforce with specialized expertise. This paper builds on our experience in investigating how Large Language Models (LLMs) can help address these challenges, focusing on their role in constructing and querying of semantic models, particularly using the Brick Schema. Our study outlines the requirements and metrics for evaluating the scalability and effectiveness of LLM-based tools, while also discussing the current challenges and limitations in developing such tools. Ultimately, this paper aims to orient research efforts as various groups experiment with diverse techniques, while enabling more effective comparison of emerging solutions and fostering collaboration across the field.

Mulayim, Ozan Baris↗

DOE OSTI2024

Siting Lab [SWR-24-95]

Siting Lab contains a collection of user-friendly tutorials and guides for working with the Siting Lab (https://data.openei.org/siting_lab) data within the context of the reV model. The python code examples demonstrate the creation and transformation of Siting Lab data into reV compliant format as well as working with the reV model inputs and outputs. Specifically, Siting Lab provides a collection of Jupyter Notebooks that serve as guides for working with data from NREL's spatial analysis portfolio. These notebooks teach users how to create and interact with reV data in order to facilitate external use of the model. The guides in this repository reference NREL's Supply Curve data as well as Siting Lab spatial data available on OEDI.

Lopez, Anthony↗

DOE OSTI2021

Deep Learning Predicts Stress–Strain Relations of Granular Materials Based on Triaxial Testing Data

This study presents an AI-based constitutive modelling framework wherein the prediction model directly learns from triaxial testing data by combining discrete element modelling (DEM) and deep learning. A constitutive learning strategy is proposed based on the generally accepted frame-indifference assumption in constructing material constitutive models. The low-dimensional principal stress-strain sequence pairs, measured from discrete element modelling of triaxial testing, are used to train recurrent neural networks, and then the predicted principal stress sequence is augmented to other high-dimensional or general stress tensor via coordinate transformation. Through detailed hyperparameter investigations, it is found that long short-term memory (LSTM) and gated recurrent unit (GRU) networks have similar prediction performance in constitutive modelling problems, and both satisfactorily predict the stress responses of granular materials subjected to a given unseen strain path. Furthermore, the unique merits and ongoing challenges of data-driven constitutive models for granular materials are discussed.

42 ENGINEERING↗

DOE OSTI2024

Importance of Higher Fidelity Model Geometries during Optimization of Critical Experiments

PARADIGM, PARallel Approach of Differential and InteGral Measurements, is a cross-collaborative effort at Los Alamos National Laboratory between nuclear data theorists, differential and integral experimenters, as well as machine learning statisticians to tackle uncertainties in the intermediate region of 239 Pu. In essence, the idea behind PARADIGM is to remove the linear conceptualization of the nuclear data pipeline, shown in Figure 1, and replace it with a far more parallelized approach. The novel approach leverages machine learning to guide which differential measurements and integral experiments will result in the largest decrease in uncertain ties for a nuclide reaction pair in a given energy range. The concept builds off earlier work, EUCLID, which focused on the fast region of 239 Pu. The practical benefit of having evaluation, differential measurement, and integral experiment personnel in collaboration with machine learning is to represent the entire nuclear data in one snapshot. This enable large reduction in the time to deliver improved nuclear data, which using the PARADIGM approach could be done in 3 years. A general outline of PARADIGM and specific topics are available in other papers. The discussion here will pertain directly to the integral experiment design. More specifically, the process of taking a rough design and transforming it into a finalized neutronic model will be discussed.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

Neural Network‐Based Methods for Ocean Surface Wave Measurement Using Submarine Distributed Acoustic Sensing (DAS)

Two new data-driven models for estimating ocean surface waves from distributed acoustic sensing (DAS) submarine cable strain rate are developed using supervised machine learning on a 10-day data set collected offshore of Oliktok Point, Alaska. The new models were trained on target data from seafloor pressure moorings at three sites spaced evenly along 27.1 km of cable and were benchmarked against an empirical transfer function method previously used to estimate waves from DAS. A model which uses convolutional neural networks to transform 2-km frequency-wavenumber strain spectra to seafloor pressure spectra outperforms the benchmark in wave height prediction (RMSE of 0.15 vs. 0.41 m) and period prediction (0.29 vs. 0.37 s) when evaluated on a held-out test data set. When applied to a DAS data set collected on the same cable 2 years prior, the CNN-based model maintained similar significant wave height performance (RMSE = 0.23 m) relative to available satellite altimetry data. A two-hidden-layer, fully connected neural network which transforms 1-D strain spectra to seafloor pressure spectra also outperforms the benchmark in wave height prediction (RMSE of 0.19 vs. 0.41 m), but does not generalize as well to the prior data. Regression-based machine learning is useful for estimating waves from DAS data when the pressure-strain relationship varies temporally and spatially across different wave conditions. Models can be applied to DAS data to measure waves with higher spatial resolution and longer temporal coverage than traditional methods, which often measure waves only at a single point.

Davis, Jacob R. [Univ. of Washington, Seattle, WA ↗

DOE OSTI2020

Basic Research Needs for Transformative Manufacturing (Brochure)

Manufacturing is central to the nation’s prosperity and security. Manufacturing currently represents about 12% of the gross domestic product, provides nearly 13 million jobs, and accounts for about 25% of energy use. The nation’s economy relies heavily on wide-ranging manufacturing sectors - all of which share common challenges including data issues, lack of physics and chemistry-based models across scales, and resource constraints in a global environment. Furthermore, there are many hurdles that must be overcome to move basic science innovations to market. Addressing broad-ranging challenges demands a basic-science strategy that underpins applied research activities. This strategy would accelerate innovation and transform manufacturing. A Basic Research Needs workshop for Transformative Manufacturing was held in March 2020. The focus of the workshop was to identify the basic science research priorities that could accelerate innovation to transform manufacturing in the future. This was the first workshop of its kind to examine how basic energy science can drive manufacturing forward and innovate new ways to manufacture goods. Five Priority Research Directions were identified that address these science challenges: (1) innovative synthetic approaches to enable scalable assembly of matter, (2) computational methods and theoretical models to transform how manufacturing processes are controlled, (3) new characterization tools that can handle the necessary complexity, scales, and processing speeds to meet manufacturing needs, (4) new science to address opportunities relevant to sustainable and energy-efficient manufacturing, and (5) foundational approaches to co-design of materials, process, and products.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2023

GenSLMs: Genome-scale language models reveal SARS-CoV-2 evolutionary dynamics

We seek to transform how new and emergent variants of pandemic-causing viruses, specifically SARS-CoV-2, are identified and classified. By adapting large language models (LLMs) for genomic data, we build genome-scale language models (GenSLMs) which can learn the evolutionary landscape of SARS-CoV-2 genomes. By pre-training on over 110 million prokaryotic gene sequences and fine-tuning a SARS-CoV-2-specific model on 1.5 million genomes, we show that GenSLMs can accurately and rapidly identify variants of concern. Thus, to our knowledge, GenSLMs represents one of the first whole-genome scale foundation models which can generalize to other prediction tasks. We demonstrate scaling of GenSLMs on GPU-based supercomputers and AI-hardware accelerators utilizing 1.63 Zettaflops in training runs with a sustained performance of 121 PFLOPS in mixed precision and peak of 850 PFLOPS. We present initial scientific insights from examining GenSLMs in tracking evolutionary dynamics of SARS-CoV-2, paving the path to realizing this on large biological data.

Zvyagin, Maxim↗

DOE OSTI2022

Machine Learning Guided Synthesis of Flash Graphene

Advances in nanoscience have enabled the synthesis of nanomaterials, such as graphene, from low-value or waste materials through flash Joule heating. Though this capability is promising, the complex and entangled variables that govern nanocrystal formation in the Joule heating process remain poorly understood. In this work, machine learning (ML) models are constructed to explore the factors that drive the transformation of amorphous carbon into graphene nanocrystals during flash Joule heating. An XGBoost regression model of crystallinity achieves an r 2 score of 0.8051 ± 0.054. Feature importance assays and decision trees extracted from these models reveal key considerations in the selection of starting materials and the role of stochastic current fluctuations in flash Joule heating synthesis. Furthermore, partial dependence analyses demonstrate the importance of charge and current density as predictors of crystallinity, implying a progression from reaction-limited to diffusion-limited kinetics as flash Joule heating parameters change. Finally, a practical application of the ML models is shown by using Bayesian meta-learning algorithms to automatically improve bulk crystallinity over many Joule heating reactions. Furthermore, these results illustrate the power of ML as a tool to analyze complex nanomanufacturing processes and enable the synthesis of 2D crystals with desirable properties by flash Joule heating.

01 COAL, LIGNITE, AND PEAT↗

DOE OSTI2023

Model metamers reveal divergent invariances between biological and artificial neural networks

Deep neural network models of sensory systems are often proposed to learn representational transformations with invariances like those in the brain. To reveal these invariances, we generated ‘model metamers’, stimuli whose activations within a model stage are matched to those of a natural stimulus. Metamers for state-of-the-art supervised and unsupervised neural network models of vision and audition were often completely unrecognizable to humans when generated from late model stages, suggesting differences between model and human invariances. Targeted model changes improved human recognizability of model metamers but did not eliminate the overall human–model discrepancy. The human recognizability of a model’s metamers was well predicted by their recognizability by other models, suggesting that models contain idiosyncratic invariances in addition to those required by the task. Metamer recognizability dissociated from both traditional brain-based benchmarks and adversarial vulnerability, revealing a distinct failure mode of existing sensory models and providing a complementary benchmark for model assessment.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2021

Generic Multi-Frequency Modelling of Converter-Connected Renewable Energy Generators Considering Frequency and Sequence Couplings

Frequency and sequence couplings can compromise the trustworthiness of multi-frequency models for converter-based systems. There have been effective attempts to address the couplings mainly by linearized averaged models. Only a few studies have been conducted on practical optimization of such models with enormous matrices and experimental results. This paper provides a generic theory for coupling patterns and proposes a multi-frequency modelling method to detect and address only the main couplings in the sequence domain for converter-connected renewable energy generators. The proposed generic model is based on empirical tests using small-signal perturbations and adopting Fourier transform on the switching converter response. The proposed theory and modelling methodology are verified using a 7MVA grid emulator for voltage perturbation tests on a 2MVA photo-voltaic converter. Accordingly, the couplings can exist in more generic forms, including multiples of perturbation and fundamental frequencies. To the best of our knowledge, the patterns with the multiples of the perturbation frequency have been overlooked in the literature. Furthermore, the mirror frequency concept is valid for all coupling patterns and is included in the proposed model. Besides, the proposed patterns and the environment noise levels have been practical criteria for selecting the main couplings.

frequency and sequence couplings↗

DOE OSTI2023

TRACER-VOC: Speciated Volatile Organic Compounds at the Tracking Aerosol Convection Interactions Experiment Field Campaign Report

Formation of secondary organic aerosol (SOA) is responsible for the growth of particles into cloud condensation nuclei (CCN)-relevant sizes and accounts for a substantial fraction of aerosol mass in the troposphere. Despite its wide abundance and importance, capturing SOA in regional and climate models is still challenging due to complex chemical transformations involved in production of SOA. Oxidation products of biogenic hydrocarbons, such as isoprene, monoterpenes, and sesquiterpenes account for the largest fraction of SOA mass over the continents. As such, biogenic SOA is an important source of continental CCN, and has been recently shown to nucleate ice in the deposition mode. To better account for the processes involved in SOA formation in global and regional climate models, we need better measurements of sources and transformations of volatile organic compounds (VOCs), the precursors to SOA formation in the atmosphere. Understanding aerosol-deep convection interactions is an important science driver of the Tracking Aerosol Convection Interactions Experiment (TRACER), requiring a characterization of the critical controls on aerosol properties and processes, and how those properties and processes vary spatially and temporally in the Houston area. In that environment, the atmospheric photo-oxidative chemistry that drives the evolution and transformation of aerosol properties and processes is strongly impacted by the emission of VOCs, which have both anthropogenic (e.g., industrial, urban, transportation, biomass burning) and biogenic (e.g., marine) sources in the region. Understanding (and disentangling) the complex role of VOCs in such a heterogenous region requires high-time-resolution, speciated VOC measurements that are spatially resolved. To meet these measurement requirements, the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility’s time-of-flight proton transfer reaction-mass spectrometer (ToF-PTR-MS) was deployed during the TRACER intensive operational period (IOP) from June to September, 2022 at the ancillary site (ANC), which was sited to provide a characterization of the rural atmospheric environment in contrast to the main site.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Impacts of Experimentally Obtained Harmonic Spectrums of Residential Appliances on Distribution Feeder

Owing to the increased use of power electronic based appliances and energy-efficient home equipment such as modern lighting loads, the percentage of nonlinear loads has increased in the distribution system, which can impact system performance, loss, and stability. Thus a comprehensive knowledge of their power quality and harmonic analysis is essential to improve the load models, voltage stability assessment, determination of possible interactions at harmonic frequencies, protection planning, and the effect of system impedance. This paper focuses on harmonic load flow analysis for multiple residential load types to determine the expected impacts on an modeled distribution secondary. For this study, the household appliances include lighting, power electronic, resistive, and motor loads with a nominal supply voltage of 120 V single-phase or 240 V split phase at a nominal frequency of 60 Hz. The harmonic spectrums, as obtained from the experimental evaluation of real loads, are used to inform the harmonic load flow for a detailed secondary network, including the distribution service transformer extracted from a real distribution feeder's model. Additionally, the impact of voltage harmonics on a three-phase test load is presented with experimental results. The harmonic data of the transformer terminal voltage, as obtained from the former load flow study, are scaled to generate the source voltage for the three-phase configuration of the grid simulator to make the test setup very similar to a typical secondary design in the U.S.

ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATION↗

DOE OSTI2025

Enhancing occupant behavior representation for interoperability between building information modeling and building energy modeling

Building Performance Simulation (BPS) has been adopted as an essential tool for designing, operating, and retrofitting buildings to optimize energy efficiency throughout the building life cycle. The Green Building XML (gbXML) schema facilitates seamless data exchange between Building Information Modeling (BIM) and Building Energy Modeling (BEM) software tools. However, limited occupant behavior (OB) representation in BIM often leads to inconsistent and inaccurate energy simulation in BEM software. This paper presents 154 systematic enhancements to the existing occupant behavior XML (obXML) schema v1.3.4, initially developed for standardizing OB representation for BEM, to address existing limitations and improve interoperability with BIM models. The enhancements encompass improved integration with BIM models through extended building representations and system operations, expanded support for advanced OB models with additional environmental parameters and mathematical capabilities, and implementation of a standardized model documentation framework. To facilitate seamless data transformation between gbXML and obXML schemas, we developed a publicly available gb-obXML Schema Converter. Three case studies demonstrate the enhanced schema’s capabilities: representation of building information using a two-story office building model, documentation of a window operation behavior model, and validation of the schema converter’s functionality. The enhanced obXML schema v1.4 enables sophisticated modeling of occupant-building interactions while maintaining consistency with industry-standard BIM schemas. The standardized documentation framework facilitates reproducibility and knowledge sharing in the OB research community, while the schema converter automates the integration of building information into OB simulation workflows. These enhancements establish a foundation for more accurate building performance simulation by supporting sophisticated representation of occupant behavior within the BIM-to-BEM simulation workflows.

Chung, Jihoon↗

DOE OSTI2020

A pseudo-kinetic model to simulate phase changes in gas hydrate bearing sediments

Herein, modeling of the phase transitions anticipated in gas hydrate bearing sediments (GHBS) is critical for a proper understanding of time-dependent changes in states and volumes (e.g. the production of methane from this type of soils). We propose a new pseudo-kinetic approach to simulate the typical phase changes anticipated in GHBS, using published experimental results involving gas hydrate dissociation that are the basis of a widely used kinetic model. The proposed pseudo-kinetic model is formulated in the pressure-temperature (P-T) plane and assumes a rate of gas hydrate dissociation (or formation) proportional to the distance between the current state and the phase boundary. The model consists of only one parameter and is simple to implement in numerical simulators. A similar concept is used to model ice formation/thawing phenomena, but based on the ice/liquid-water phase boundary. We implemented the pseudo-kinetic model in a fully coupled thermo-hydro-chemo-mechanical (THCM) finite element code and validated it against experimental results performed on the dissociation of synthetic gas hydrate. We also evaluated the pseudo-kinetic model using synthetic cases covering several scenarios associated with gas hydrate formation/dissociation and ice formation/thawing. The model successfully reproduced the gas production test from a natural GHBS core from Korea (scaled gas venting experiment over 14 h), and also the formation of gas hydrate and ice in permafrost in Alaska (over 2 × 10 6 years). -The analyses show the versatility of the proposed pseudo-kinetic approach by applying it to model the different types of phase transitions typically encounter in GHBS. The simple formulation, easy implementation in numerical simulator, and reduced number of parameters (only one per phase change) make this model an attractive option for simulating phase transformations in problems involving GHBS.

58 GEOSCIENCES↗

DOE OSTI2022

Digitalization of an experimental electrochemical reactor via the smart manufacturing innovation platform

The exponential increase in data produced over the last two decades has revolutionized the way we collect, store, process, analyze, model, and interpret information to improve profitability. Manufacturing is no exception. How- ever, Smart Manufacturing, the digital practice, organization, workforce, and infrastructure transformation for collection and deployment of data and models at scale and at all levels of manufacturing, is a complex, costly, and labor-intensive journey that is still seeing slow adoption. The Clean Energy Smart Manufacturing Innovation Institute (CESMII), a national Manufacturing USA public-private partnership sponsored by the Department of Energy, is addressing this scaled use of data and modeling in manufacturing. CESMII has focused on how to col- lect and use operating data for numerous applications that improve productivity, precision, and performance of manufacturing operations from factory floor to supply chain using process simulation, predictive analytics, mon- itoring and control, and real-time optimization. Because contextualized data are key, CESMII has developed the Smart Manufacturing Innovation Platform (SMIP) to lower the barriers to the data that are needed to accelerate data-based model building, improve data visualization, and more quickly gain insights. Reusable, standards-based ways of doing data collection, ingestion, and contextualization are particularly important for scaling access and use of data. The SMIP uses a standards-based definition and construct for reusable information models called an SM Profile. When an SM Profile is used in conjunction with the SMIP, the SMIP ensures the availability of contextualized, operational data for model building. The present work demonstrates Smart Manufacturing and the application of the SMIP for building several data-centered models for the operation and control of an ex- perimental electrochemical reactor that reduces carbon dioxide (CO 2 ) gas to valuable liquid and gas chemicals, such as alcohols, olefins, and syngas. We describe how the SMIP plays a central role in more effective model building and we demonstrate how the electochemical reactor can be controlled and optimized for the desired products. Use of the SMIP involves the transmission of real-time sensor measurements to a cloud resource so that the operating data are available to all model building experts. The data collection and transmission process is fully automated to greatly reduce the need for manual manipulation of the data. Data-driven machine learning models are used for advanced real-time state estimation, real-time optimization, and model-based feedback control for the reactor. The application models are implemented as a system to monitor the data flow and control the electrochemical reactor with a single visualization interface. SM Profiles are used to demonstrate reusability of the information models for the reactor and the instrumentation. The application packages, algorithms, and user interfaces developed are cast as Docker images in a library to facilitate reusability of the application models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗