Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model scaling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

High-Temperature Fe-Based Fischer–Tropsch Synthesis: Experimentally Validated Kinetic Models Implemented at Pellet and Reactor Scales

Pellet- and reactor-scale models for Fischer–Tropsch synthesis (FTS) with a Fe–K/silica catalyst were developed to investigate the sensitivity of the hydrocarbon products and carbon dioxide selectivity to process conditions and feed composition at high temperature (350–400 °C), moderate pressure (1–10 bar), and a range of H 2 /CO ratios (3–1). The major objective of this paper is to develop, validate, and evaluate a high-temperature FTS model that is then used to assess the feasibility of process integration with syngas production. Since there is limited kinetic data available, in literature at these conditions, bench-scale reactor tests were conducted to obtain operational data for parameter fitting of kinetic expressions used in the model. This resulting kinetic model demonstrated agreement with the experimental data with an R 2 of 0.97 to the testing data set and, thus, was feasible to apply at pellet and reactor scales. Here, multiple pellet sizes were modeled to detail the role of transport limitations as the sphere’s diameter approached and exceeded 1 mm. Application of the reactor model indicated that hydrocarbon selectivity depended strongly on temperature, whereas the ratio of olefin to paraffin products decreased with increasing temperature, pressure, and H 2 /CO ratio. Product selectivity was not sensitive to the conversion of carbon monoxide. Furthermore, the roles of the pressure and H 2 /CO ratio were closely coupled. At a H 2 /CO ratio of 3, only slight variations in selectivity occurred over a pressure range of 1–20 bar, whereas at a ratio of 1, selectivity could vary by as much as 30% over the same pressure range. At pressures below 5 bar and temperatures above 350 °C, minimal selectivity to heavy hydrocarbons (C 12+ ) is obtained, and selectivity to midrange products (C 5–11 ) rapidly declined as pressure dropped below 5 bar, which indicated that an operational pressure of at least 5 bar is needed to achieve reasonable yields in this temperature range. These results, while tentative, provide guidelines for further experimentation and evaluation of integrated FTS processes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

OPER: Optimality-Guided Embedding Table Parallelization for Large-scale Recommendation Model

With the sharp increasing volume of user data, Deep Learning Recommendation Model (DLRM) becomes an indispensable infrastructure in large technology companies. However, large-scale DLRM on the multi-GPU platform is still inefficient due to unbalanced workload partitioning and intensive inter-GPU communication. To this end, we propose OPER, an OPtimality guided Embedding table placement for large-scale Recommendation model training and inference. OPER explores the potential of mitigating remote memory access latency in DLRM through fine-grained embedding table placement. Specifically, OPER proposes a theoretical modeling that builds up the relationship between EMT placement and the embedding communication latency in both training and inference. OPER proves the NP hardness of finding the optimal embedding table placement and proposes a heuristic algorithm that yields near optimal placement. OPER implements a SHMEM-based embedding table training system and a unified embedding index mapping to support fine-grained embedding table sharding and placement. Comprehensive experiments reveal that OPER achieves on average 3.4× and 5.1× speedup on training and inference respectively over state-of-the-art DLRM frameworks.

Wang, Zheng↗
DOE OSTI2026

HARMONY: Large-Scale Architecture Search for Efficient Hybrid Language Models

As large language models scale to trillions of parameters, their computational and memory requirements present critical challenges for efficient training and deployment. While Mixture of Experts (MoE) architectures enable efficient scaling through sparse parameter activation, and state-space models like Mamba offer linear-time complexity, principled methods for combining these paradigms remain undeveloped. We introduce HARMONY (Hybrid Architecture Research for Mamba, Optimized with Neural efficiencY), a multi-objective evolutionary neural architecture search framework for discovering efficient hybrid language models that integrate Transformer attention mechanisms, Mixture-of-Experts routing, and Mamba state-space components. Through large-scale distributed search using 16,384 MI250X GPUs on the Frontier supercomputer, HARMONY explores a comprehensive design space encompassing six attention variants (MHA, MQA, GQA, MLA, SWA, and Mamba-2), variable MoE configurations with both routed and shared experts, and extensive Mamba hyperparameters. Our framework discovers heterogeneous architectures that balance training performance with computational efficiency through multi-objective optimization incorporating latency penalties and fitness-based selection. Analysis of discovered architectures reveals that optimal hybrid designs favor heterogeneous component mixing rather than homogeneous patterns, with Mamba-2 and Multi-Head Latent Attention (MLA) emerging as preferred mechanisms. Discovered architectures demonstrate superior training efficiency: our best configuration achieves a final perplexity of 1.0874 with 2.38B parameters while processing 4,320 tokens/second, outperforming significantly larger manually designed models. Full-scale evaluation shows HARMONY's top architectures achieve better loss trajectories than equivalently-sized models using state-of-the-art configurations including Mixtral, Jamba, and Samba. Additionally, we demonstrate 91% weak scaling efficiency when training discovered 36B-parameter models across 1,024 GPUs. HARMONY is released as an open framework with comprehensive tools for building and training hybrid models using expert-data-pipeline parallelism, democratizing access to automated architecture design for next-generation language models.

Herron, Emily [ORNL] (ORCID:0000000273008172)↗
DOE OSTI2020

Development of a Genome-Scale Metabolic Model of Clostridium thermocellum and Its Applications for Integration of Multi-Omics Datasets and Computational Strain Design

Solving environmental and social challenges such as climate change requires a shift from our current non-renewable manufacturing model to a sustainable bioeconomy. To lower carbon emissions in the production of fuels and chemicals, plant biomass feedstocks can replace petroleum using microorganisms as biocatalysts. The anaerobic thermophile Clostridium thermocellum is a promising bacterium for bioconversion due to its capability to efficiently degrade lignocellulosic biomass. However, the complex metabolism of C. thermocellum is not fully understood, hindering metabolic engineering to achieve high titers, rates, and yields of targeted molecules. In this study, we developed an updated genome-scale metabolic model of C. thermocellum that accounts for recent metabolic findings, has improved prediction accuracy, and is standard-conformant to ensure easy reproducibility. We illustrated two applications of the developed model. We first formulated a multi-omics integration protocol and used it to understand redox metabolism and potential bottlenecks in biofuel (e.g., ethanol) production in C. thermocellum. Second, we used the metabolic model to design modular cells for efficient production of alcohols and esters with broad applications as flavors, fragrances, solvents, and fuels. The proposed designs not only feature intuitive push-and-pull metabolic engineering strategies, but also present novel manipulations around important central metabolic branch-points. We anticipate the developed genome-scale metabolic model will provide a useful tool for system analysis of C. thermocellum metabolism to fundamentally understand its physiology and guide metabolic engineering strategies to rapidly generate modular production strains for effective biosynthesis of biofuels and biochemicals from lignocellulosic biomass.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Advancing Catalytic Fast Pyrolysis Through Integrated Experimentation and Multi-Scale Computational Modeling

This webinar will highlight recent results from a multi-disciplinary research effort in which integrated reaction testing was coupled with particle- and reactor-scale computational modeling to advance catalytic fast pyrolysis (CFP) for the production of renewable hydrocarbon fuels. Data will be presented from a series of ex situ CFP experiments in which a fixed bed of Pt/TiO2 was utilized with co-fed H2 to upgrade woody biomass pyrolysis vapors. Further discussion will include the application of these data towards the development of (1) a multiscale simulation framework to de-couple apparent kinetics from both intraparticle and reactor-scale transport phenomena and (2) a finite element computational model to understand and predict thermal excursions during catalyst regeneration. Throughout the presentation, the speakers will emphasize synergistic outcomes derived from the collaborative approach and highlight ongoing research efforts to accelerate technology maturation.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

Large-scale parametric modeling of spent nuclear fuel dynamics in the 30 cm package drop scenario

Packages used to transport spent nuclear fuel (SNF) are required by the U.S. Code of Federal Regulations 10 CFR 71.71 to demonstrate satisfactory performance during a drop scenario. While the CFR is meant to ensure safe package function, it does not evaluate survival of the SNF within. The U.S. Department of Energy Spent Fuel and Waste Science and Technology program is working on closing the knowledge gap related to the response of SNF to external mechanical loads, including the hypothetical 30 cm package drop scenario in the CFR. In support of this effort, LS-DYNA finite element simulations were developed by Pacific Northwest National Laboratory (PNNL) to model generic drop scenarios at both the package and fuel assembly level. The models were validated against one-third scale package and full scale fuel assembly drop test data and were exercised to predict fuel cladding strains in a narrow range of model configurations. This work describes a large-scale parametric study conducted by PNNL using the previously developed and validated PWR finite element model, with the addition of a new generic BWR assembly model. The motivation for the parametric study was to characterize the broad range of SNF responses in the 30 cm package drop scenario. This was accomplished by varying the drop orientation, fuel assembly type (17x17 PWR and 10x10 BWR), burnup, cladding temperature, spacer grid buckling load, package mass, impact limiter stiffness, and mechanical gap conditions within the basket. A MATLAB framework was developed to automate LS-DYNA model generation and execution on PNNL institutional computing resources. In total, over 2000 simulations were performed. For each simulation, the SNF response was quantified in terms of permanent grid deformation, fuel rod contact pressure, and strains within the fuel rods, guide tubes, and water rods. The results provide valuable insight into the range of responses that could be reasonably expected from SNF in the hypothetical drop scenario, as well as the sensitivity to each input parameter. The results of this parametric study are a key component of the testing and modeling strategy the Spent Fuel and Waste Science and Technology program is using to close the external loads knowledge gap.

Kadooka, Kevin↗
DOE OSTI2021

Networked HIL Simulation System for Modeling Large-scale Power Systems

This paper presents a networked hardware-in-the-loop (HIL) simulation system for modeling large-scale power systems. Researchers have developed many HIL test systems for power systems in recent years. Those test systems can model both microsecond-level dynamic responses of power electronic systems and millisecond-level transients of transmission and distribution grids. By integrating individual HIL test systems into a network of HIL test systems, we can create large-scale power grid digital twins with flexible structures at required modeling resolution that fits for a wide range of system operating conditions. This will not only significantly reduce the need for field tests when developing new technologies but also greatly shorten the model development cycle. In this paper, we present a networked OPAL-RT based HIL test system for developing transmission-distribution coordinative Volt-VAr regulation technologies as an example to illustrate system setups, communication requirements among different HIL simulation systems, and system connection mechanisms. Impacts of communication delays, information exchange cycles, and computing delays are illustrated. Simulation results show that the performance of a networked HIL test system is satisfactory.

Xie, Fuhong↗
DOE OSTI2021

Challenges and Potential of Waveform Modeling for Crustal Scale Predictions

Waveform modeling is crucial to improving our understanding of observed seismograms. Forward simulation of wavefields provides quantitative methods of testing interactions between complicated source functions and the propagation medium. Here, we discuss three experiments designed to improve under standing of high frequency seismic wave propagation. First, we compare observed and predicted travel times of crustal phases for a set of real observed earthquakes with calculations and synthetic seismograms. Second, we estimate the frequency content of a series of nearly co-located earthquakes of varying magnitude for which we have a relatively well- known 1D velocity model. Third, we apply stochastic perturbations on top of a 3D tomographic model and qualitatively assess how those variations map to differences in the seismograms. While different in scope and aim, these three vignettes illustrate the current state of crustal scale waveform modeling and the potential for future studies to better constrain the structure of the crust.

58 GEOSCIENCES↗
DOE OSTI2020

MEMOTE for standardized genome-scale metabolic model testing

Reconstructing metabolic reaction networks enables the development of testable hypotheses of an organism’s metabolism under different conditions. State-of-the-art genome-scale metabolic models (GEMs) can include thousands of metabolites and reactions that are assigned to subcellular locations. Gene–protein–reaction (GPR) rules and annotations using database information can add meta-information to GEMs. GEMs with metadata can be built using standard reconstruction protocols, and guidelines have been put in place for tracking provenance and enabling interoperability, but a standardized means of quality control for GEMs is lacking. Here we report a community effort to develop a test suite named MEMOTE (for metabolic model tests) to assess GEM quality.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

An adaptive model-free robotic force control strategy for hydrodynamic real-time hybrid simulation of floating offshore wind turbines

Real-time hybrid simulation (RTHS) - a cyber-physical testing approach - promises to enhance the simulation fidelity of the model-scale experiments used to prototype floating offshore wind turbines (FOWTs). In hydrodynamic RTHS (hydro-RTHS), actuators emulate aerodynamic forces on model-scale FOWT specimens subjected to physical waves in a hydrodynamic laboratory. Robotic arms are promising candidates for actuation in hydro-RTHS due to their compact multi-degree-of-freedom (DOF) capabilities. Unlike classical RTHS for seismic applications, which typically relies on displacement control, hydro-RTHS requires 6-DOF force control on newly designed floating prototypes in a model-scale setting, which presents significant challenges, including modeling uncertainties, directional asymmetry, configuration drift, bandwidth limitations, and time-varying delays. To mitigate these constraints without extensive pre-test calibration, this study proposes an adaptive model-free robotic force control strategy that combines task-space explicit force control with a secondary joint-space pose-keeping task. The Adaptive Feedforward Compensator (AFC) is integrated into the force control loop to compensate for time-varying delay. Experimental testing was conducted using a Franka Emika Panda robotic arm with a 1:50 scale FOWT specimen under operational wind and wave conditions. Results demonstrate stable and consistent 6-DOF force tracking. Effective delay compensation was observed, with low-frequency delay reductions ranging from 71.4% to 91.8% and improvements in low-frequency surge force tracking of 25.0% to 52.1%. This study enhances robotic actuation performance in hydro-RTHS and introduces a force control strategy that supports reliable robotic operation in uncertain floating environments. Future work will explore disturbance-observer mechanisms to further enhance wave rejection capabilities under extreme wind and wave conditions.

17 WIND ENERGY↗
DOE OSTI2025

Cross-Scale Catalyst Modeling Applied to H 2 Storage and Release via Formic Acid

Here, we propose the Systems-to-Atoms (S2A) modeling framework that integrates the kinetics of reaction chemistry and structural configurations across various length scales with the aim of establishing a versatile template for multiscale modeling of reactive flow problems and to predict the operando activity of catalyst materials. The approach encompasses a microkinetic model to analyze surface reactions on individual facets of catalyst nanoparticles coupled with the computation of average surface reaction rates for catalyst nanoparticles of specific size distributions. Macro-homogeneous surface reaction kinetics are derived as a function of catalyst loading and used as input parameters for the continuum-scale reactor model. The cross-scale framework enables the optimization of catalyst utilization through reactor design and operating strategy. To demonstrate the framework, we studied the storage and release of hydrogen from formic acid, a promising liquid organic hydrogen carrier (LOHC), over Pd, Pt, and Cu catalysts. The framework predicts observed trends in formic acid dehydrogenation activity for catalysts with comparable weight loadings and metal particle diameters, demonstrating satisfactory quantitative alignment. Finally, the seamless transmission of parameter uncertainties between scales is also discussed.

08 HYDROGEN↗
DOE OSTI2024

Review and meta-analysis of electron temperatures from high-intensity laser–solid interactions

The accelerated electron spectrum from high-intensity laser–solid interaction is often conveniently described using a Boltzmann distribution, whose temperature is known within the field as the hot-electron temperature. The importance of the electron temperature is highlighted by the sheer number of experimental and simulation studies on the subject over the past three decades. Recently, multi-kJ, multi-ps pulses have yielded electron spectra with temperatures far beyond the expected ponderomotive result. Expressions that predict the electron temperature considering laser parameters beyond intensity and wavelength have been developed, albeit using small datasets. In this review, we present what is, to the best of our knowledge, the largest dataset of electron temperatures gathered from experimental measurements and particle-in-cell simulations. This dataset allows us to compare existing analytical and empirical hot-electron temperature scaling models over a wide parameter range. We also develop new scaling models that incorporate the laser pulse duration of the laser and the plasma scale length. Three models that include pulse-duration and scale length dependence are especially successful at predicting both simulated and experimental data. The dataset will soon be made publicly available to encourage further investigation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Integrating plant physiology into simulation of fire behavior and effects

Summary Wildfires are a global crisis, but current fire models fail to capture vegetation response to changing climate. With drought and elevated temperature increasing the importance of vegetation dynamics to fire behavior, and the advent of next generation models capable of capturing increasingly complex physical processes, we provide a renewed focus on representation of woody vegetation in fire models. Currently, the most advanced representations of fire behavior and biophysical fire effects are found in distinct classes of fine‐scale models and do not capture variation in live fuel (i.e. living plant) properties. We demonstrate that plant water and carbon dynamics, which influence combustion and heat transfer into the plant and often dictate plant survival, provide the mechanistic linkage between fire behavior and effects. Our conceptual framework linking remotely sensed estimates of plant water and carbon to fine‐scale models of fire behavior and effects could be a critical first step toward improving the fidelity of the coarse scale models that are now relied upon for global fire forecasting. This process‐based approach will be essential to capturing the influence of physiological responses to drought and warming on live fuel conditions, strengthening the science needed to guide fire managers in an uncertain future.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Assessing mechanical response of CO 2 storage into a depleted carbonate reef using a site-scale geomechanical model calibrated with field tests and InSAR monitoring data

Geomechanical risks of injection have raised concerns regarding secure CO 2 storage. In this work, a combined monitoring and modeling approach is used to assess the stress changes and surface uplift associated with CO 2 injection into a depleted carbonate reef of the Michigan basin. A site-scale geomechanical model is built by assigning mechanical properties of formations using well-log and experimental data. Gravity load is applied to the model to estimate the vertical component of stress as well as different lateral boundary displacement scenarios to estimate horizontal stresses. We used a poroelastic pressure-dependent model (instead of a linear elastic mechanical earth model) to calibrate initial stresses using hydraulic fracture test data measured at depleted reservoir status. Multi-phase fluid flow-geomechanical simulations are performed to estimate the poroelastic response during (1) primary depletion (2) field-scale CO 2 injection phase (3) a hypothetical forecast scenario in which well bottom hole pressure (BHP) reach 45000 KPa. The predicted surface uplift is less than 1 mm at the end of the field-scale CO 2 injection phase which is in good agreement with Interferometric Synthetic Aperture Radar (InSAR) uplift measurement. Although the InSAR data shows an insignificant uplift, hydromechanical modeling of injection shows that CO 2 injection still causes reservoir deformation emphasizing the role of carbonate overburden and reservoir formation mechanical properties and limited size of reef on diminishing the surface deformation. Modeling indicates poroelastic response of caprock matters to estimate uplift. The lower permeability of the top two layers provides additional barrier to large uplift. Also, history of subsidence due to production should be accounted to predict uplift due to a follow up injection correctly. This report shows the significance of combining a calibrated geomechanical model with field measured stresses and monitoring data to be used as a tool to ensure the safety of CO 2 storage.

42 ENGINEERING↗
DOE OSTI2023

Advances in genome-scale metabolic models of industrially important fungi

Many fungal species have been used in industrial production for biofuels and bioproducts. Developing strains with better performance in biomanufacturing requires systematic understanding of cellular metabolism. Genome-scale metabolic models (GEMs) offer a comprehensive view of interconnected pathways and a mathematical framework for downstream analysis. Recently, GEMs have been developed or updated in several industrially important fungi. Some of them incorporate enzyme constraints, enabling improved predictions of cell states and proteome allocation. In this report we provide an overview of these newly developed GEMs and computational methods that facilitate construction of enzyme-constrained GEMs and utilize flux predictions from GEMs. Furthermore, we highlight the pivotal roles of these GEMs in iterative design-build-test- learn cycles, ultimately advancing the field of fungal biomanufacturing.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Advancing the Representation of Human Actions in Large‐Scale Hydrological Models: Challenges and Future Research Directions

Characterizing the impact of human actions on terrestrial water fluxes and storages at multi-basin, continental, and global scales has long been on the agenda of scientists engaged in climate science, hydrology, and water resources systems analysis. This need has resulted in a variety of modeling efforts focused on the representation of water infrastructure operations. Yet, the representation of human-water interactions in large-scale hydrological models is still relatively crude, fragmented across models, and often achieved at coarse resolutions (~10–100 km) that cannot capture local water management decisions. In this commentary, we argue that the concomitance of four drivers and innovations is poised to change the status quo: “hyper-resolution” hydrological models (~0.1–1 km), multi-sector modeling, satellite missions able to monitor the outcome of human actions, and machine learning are creating a fertile environment for human-water research to flourish. We then outline four challenges that chart future research in hydrological modeling: (a) creating hyper-resolution global data sets of water management practices, (b) improving the characterization of anthropogenic interventions on water quantity, stream temperature, and sediment transport, (c) improving model calibration and diagnostic evaluation, and (d) reducing the computational requirements associated with the successful exploration of these challenges. Overcoming them will require addressing modeling, computational, and data development needs that cut across the hydrology community, thereby requiring a major communal effort.

catchment hydrology↗
DOE OSTI2022

Improving the particle dry deposition scheme in the CMAQ photochemical modeling system

Dry deposition of atmospheric aerosols in large-scale models is a critical, but highly uncertain, sink process with a strong dependence on particle size, meteorological conditions, and land surface properties. This study investigates the particle dry deposition scheme implemented in the standard Community Multiscale Air Quality (CMAQ) model v5.2.1, characterizes its underlying parameterized components with comparison to a similar scheme in a contemporary regional-scale model, and proposes two updated schemes that are then evaluated with available ambient particle deposition velocity (V d ) measurements. Both updated schemes reduce the surprisingly strong dependence of deposition velocity on the aerosol mode width, with one scheme further introducing a dependence on vegetation coverage that is broadly consistent with variability in observations between vegetated and non-vegetated surfaces. Compared to the base scheme, the updated scheme with vegetation dependence increases V d for submicron particles and decreases it for larger particles by an average of 37% and –66%, respectively. This scheme performs statistically better than the base scheme, reducing fractional biases by 56%–97% for vegetated land-use types and has roughly equivalent performance over water. The base and updated schemes are tested with three annual CMAQ (v5.2.1) simulations for the year 2011; predicted ambient aerosol concentrations are evaluated with routine monitoring network observations and predicted dry deposition fluxes are evaluated with data from the Clean Air Status and Trends Network (CASTNET). The updated scheme with vegetation dependence reduces negative fractional biases for PM 10 by 41% and positive fractional biases for PM 2.5 organic carbon by 15%. This scheme has been incorporated into the most recent publicly accessible versions of CMAQ (v5.3 and beyond) to replace the scheme used in previous versions of CMAQ (v4.5 through v5.2.1).

54 ENVIRONMENTAL SCIENCES↗