Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Modeling workflow”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

Characterizing Quantum Classifier Utility in Natural Language Processing Workflows

Quantum Natural Language Processing (QNLP) develops natural language processing (NLP) models for deployment on quantum computers. We explore feature and data prototype selection techniques to address challenges posed by encoding high dimensional features. Our study builds quantum circuit classifiers that includes classical feature pre-processing, quantum embedding and quantum model training. The quantum models are built on 4 or 6 qubits and the quantum neural network (QNN) uses the established bricklayer design. We compare the dependence of model performance (in terms of accuracy and F1 scores) on feature length, embedding gates and parameterized unitary design. We compare the performance of quantum machine learning models to classical convolution neural network model (CNN) on binary and multi-class classification tasks using two datasets of synthetic features and labels. The first is the ECP-CANDLE P3B3 dataset a corpus of synthetically generated cancer pathology reports. The second dataset is extracted from well-known benchmark dataset (MADELON) - features are generated with a combination of informative, repeated and uninformative features. Both datasets are used for binary classification and multi-class classification with 3 classes. We observe robust, accurate performance from all models on the binary classification tasks, but multiclass classification is a challenge for the quantum models-there is a notable decrease in accuracy when using 3 classes. Overall the performance is comparable in terms of recall and accuracy between QNNs and CNNs, even with large datasets. These results provide a point of comparison between quantum and classical models on real-world datasets.

Hamilton, Kathleen↗

A workflow for automatic generation and efficient refinement of individual pressure-dependent networks

Manual chemical kinetic model construction often requires modelists to at least implicitly guess all possible decay pathways and their relative fluxes for all important species. We present a workflow and associated tool for automatic generation and re finement of pressure-dependent networks that should enable modelists to efficiently and comprehensively identify decay pathways and estimate respective parameters for chemical species. This tool combines the capabilities of the Reaction Mechanism Generator (RMG) software to generate possible reaction paths, determine thermochemistry, approximate rate coefficients and estimate frequencies with the capabilities of the Arkane software to use quantum chemical parameters to compute thermochemistry and pressure dependent rates. A flux-based algorithm is used to decide which isomers to add to the network. Isomers added to the network are reacted to form other channels. When enough of the flux is accounted for by the isomers and bimolecular product channels, the generation process terminates to yield a comprehensive network. Network sensitivity analysis is applied to the network to identify the most important wells and barriers that can be refined using quantum chemistry calculations. Iterative refinement can then be used to achieve accuracy. The comprehensive network can be easily reduced using energy and flux-based algorithms to the most important channels and isomers in the network.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Design and Performance of Kokkos Staging Space toward Scalable Resilient Application Couplings

With the growing number of applications designed for heterogeneous HPC devices, application programmers and users are finding it challenging to compose scalable workflows as ensembles of these applications, that are portable, performant and resilient. The Kokkos C++ library has been designed to simplify this cumbersome procedure by providing an intra-application uniform programming model and portable performance. However, assembling multiple Kokkos-enabled applications into a complex workflow is still a challenge. Although Kokkos enables a uniform programming model, the inter-application data exchange still remains a challenge from both performance and software development cost perspectives. In order to address this issue, we propose Kokkos data staging memory space, an extension of Kokkos' data abstraction (memory space) for heterogeneous computing systems. This new abstraction allows to express data on a virtual shared-space for multiple Kokkos applications, thus extending Kokkos to support inter-application data exchange to build an efficient application workflow. Additionally, we study the effectiveness of asynchronous data layout conversions for applications requiring different memory access patterns for the shared data. Our preliminary evaluation with a synthetic benchmark indicate the effectiveness of this conversion adapted to three different scenarios representing access frequency and use patterns of the shared data.

97 MATHEMATICS AND COMPUTING↗

MARS: Malleable Actor-Critic Reinforcement Learning Scheduler

In this paper, we introduce MARS, a new scheduling system for HPC-cloud infrastructures based on a cost-aware, flexible reinforcement learning approach, which serves as an intermediate layer for next generation HPC-cloud resource manager. MARS ensembles the pre-trained models from heuristic workloads and decides on the most cost-effective strategy for optimization. A whole workflow application would be split into several optimizable dependent sub-tasks, then based on the pre- defined resource management plan, a reward will be generated after executing a scheduled task. Lastly, MARS updates the Deep Neural Network (DNN) model based on the reward. MARS is designed to optimize the existing models through reinforcement mechanisms. MARS adapts to the dynamics of workflow applications, selects the most cost-effective scheduling solution among pre-built scheduling strategies (backfilling, SJF, etc.) and self- learning deep neural network model at run-time. We evaluate MARS with different real-world workflow traces. MARS can achieve 5%-60% increased performance compare to state-of-the- art approaches.

Baheri, Betis↗

White Paper: Scalable Digital Twin Capabilities for Aging and Surveillance of Engineered Systems

This white paper presents a multi-year initiative to develop practical, secure, and scalable digital twin capabilities for engineered systems in aging and surveillance contexts—an approach pioneered at the National Nuclear Security Administration (NNSA) Lawrence Livermore National Laboratory (LLNL) that maps directly onto the needs and ambitions of the Navy for ship- and fleet-level digital twins. LLNL’s work in building part- and process-level digital twins for advanced manufacturing, with a vision to scale up to entire factory floors and, ultimately, enterprise-wide digital twins, offers an adaptable pathway for the Navy as it seeks to modernize lifecycle management, readiness, and predictive maintenance across ships and fleets. For our application, we integrate physics-based modeling with automated data ingestion, processing, and AI-driven calibration, creating hybrid models that are both interpretable and data responsive. We modernized legacy workflows, established centralized data infrastructure, automated experimental pipelines, and demonstrated end-to-end coupling of accelerated aging data with finite element simulations via optimization and surrogate modeling. The result is a generalizable framework that supports part-level digital twins today and lays the groundwork for future system-level twins suitable for Navy applications.

36 MATERIALS SCIENCE↗

WRF-ELM v1.0: a regional climate model to study land–atmosphere interactions over heterogeneous land use regions

Abstract. The Energy Exascale Earth System Model (E3SM) Land Model (ELM) is a state-of-the-art land surface model that simulates the intricate interactions between the terrestrial land surface and other components of the Earth system. Originating from the Community Land Model (CLM) version 4.5, ELM has been under active development, with added new features and functionality, including plant hydraulics, radiation–topography interaction, subsurface multiphase flow, and more explicit land use and management practices. This study integrates ELM v2.1 with the Weather Research and Forecasting (WRF; WRF-ELM) model through a modified Lightweight Infrastructure for Land Atmosphere Coupling (LILAC) framework, enabling affordable high-resolution regional modeling by leveraging ELM's innovative features alongside WRF's diverse atmospheric parameterization options. This framework includes a top-level driver for variable communication between WRF and ELM and Earth System Modeling Framework (ESMF) caps for the WRF atmospheric component and ELM workflow control, encompassing initialization, execution, and finalization. Importantly, this LILAC–ESMF framework demonstrates a more modular approach compared to previous coupling efforts between WRF and land surface models. It maintains the integrity of ELM's source code structure and facilitates the transfer of future developments in ELM to WRF-ELM. To test the ability of the coupled model to capture land–atmosphere interactions over regions with a variety of land uses and land covers, we conducted high-resolution (4 km) WRF-ELM ensemble simulations over the Great Lakes region (GLR) in the summer of 2018 and systematically compared the results against observations, reanalysis data, and WRF-CTSM (WRF coupled with the Community Terrestrial Systems Model). In general, the coupled WRF-ELM model has reasonably captured the spatial distribution of surface state variables and fluxes across the GLR, particularly over the natural vegetation areas. The evaluation results provide a baseline reference for further improvements in ELM in the regional application of high-resolution weather and climate predictions. Our work serves as an example to the model development community for expanding an advanced land surface model's capability to represent fully-coupled land–atmosphere interactions at fine spatial scales. The development and release of WRF-ELM marks a significant advancement for the ELM user community, providing opportunities for fine-scale regional representation, parameter calibration in coupled mode, and examination of new schemes with atmospheric feedback.

54 ENVIRONMENTAL SCIENCES↗

Neural-network accelerated coupled core-pedestal simulations with self-consistent transport of impurities and compatible with ITER IMAS

pedestal structure, current profile, and plasma equilibrium physics has been developed and tested against a DIII-D discharge. Here, key features of the achieved core-pedestal coupled workflow are its ability to account for the transport of impurities in the plasma self-consistently, as well as its use of machine learning accelerated models for the pedestal structure and for the turbulent transport physics. Notably, the coupled workflow is implemented within the OMFIT framework, and makes use of the ITER integrated modeling and analysis suite (IMAS) data structure for exchanging data among the physics codes that are involved in the simulations. Such technical advance has been facilitated by the development of a new numerical library named OMAS.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Scalable Multi-Facility Workflows for Artificial Intelligence Applications in Climate Research

Earth observation satellites and earth system models are sources of vast, multi-modal datasets that are invaluable for advancing climate and environmental research. However, their scale and complexity pose significant challenges for processing and analysis. In this paper we discuss our experiences in developing and using a scientific research application using an automated multi-facility workflow that orchestrates data collection, preprocessing, artificial intelligence (AI) inferencing, and data movement across diverse computational resources, leveraging the Advanced Computing Ecosystem Testbed at the Oak Ridge Leadership Computing Facility (OLCF). We demonstrate that our workflow can be seamlessly integrated and orchestrated across research facilities managed by different federal agencies, thus allowing users to extract new scientific insights from climate datasets. The experimental results indicate that the multi-facility workflow significantly reduces processing time, enhances scalability, and maintains high efficiency across varying workloads. Notably, our workflow processes 12,000 high-resolution satellite images in just 44 seconds using 80 workers distributed across 10 nodes on the OLCF systems. Such high throughput is essential for dynamic tokenization and sharding of petascale satellite data for distributed AI model training and inferencing at scale across thousands of GPUs.

Kurihana, Takuya [ORNL] (ORCID:0000000156698565)↗

Preparation of the Multi-Site Data Processing at the Vera C. Rubin Observatory

The Vera C. Rubin Observatory’s Legacy Survey of Space and Time (LSST) Camera is scheduled to start taking data in the summer of 2025. The Data Release Production will run the LSST Science Pipe software at data facilities in the US, France and the UK. The LSST Science Pipeline consists of complex directed acyclic graphs (DAGs) of tasks. Rubin will use the Production and Distributed Analysis (PanDA) workflow and workload management system to orchestrate this complex workflow and the distribution of workloads to the data facilities. When run end-to-end by a team of data production staff, this processing (the Science Pipelines, distributed by the workflow and workload management system) is referred to as a 'campaign'. This paper describes the central services and data facility specific services that support this multi-site data process model, including the service deployment infrastructure, the workload and workflow system, the Campaign Management tools, and connection to Rubin Data Management. This paper will also mention the experience of processing the Rubin Commissioning Camera data. All these are part of the effort to scale up the processing capabilities for the expected very large data volume from the LSST Camera.

Yang, Wei [SLAC]↗

Journey Over Destination: Differentiable Sensor Placement Enhances Generalization [Poster]

The challenge of reconstructing spatial fields that change over time from limited sensor data has been a focal point for many research studies. Various machine learning methods have been used in attempts to address this complex issue, including convolutional neural networks. All of the proposed methods share a common requirement that the user needs to manually determine the sensor positions. This requirement remains a limiting factor in the ongoing quest for efficient learning and accurate field reconstruction. This study aims to present a method that enables a model to optimize sensor positions via backpropagation, thereby facilitating the model’s exploration of the spatial domain and enhancing sensor positioning effectively. Indexing naturally incorporates discrete decisions. This operation is nondifferentiable which is a requirement for the application of gradient-based optimization methods. We showcased its effectiveness by training an attention-based neural network, which achieved top-tier performance on two separate datasets. To our knowledge, this represents the first fully end-to-end differentiable workflow for enhancing sensor placement within a neural network model.

58 GEOSCIENCES↗

A hierarchical stochastic modeling approach for representing point bar geometries and petrophysical property variations

The flow of fluids in point bars is affected by the existence of heterogeneities like shale drapes that are found on the surfaces of inclined heterolithic stratifications. In fact, these shale drapes can act as fluid flow baffles; therefore, developing a framework for modeling point bars and their associated heterogeneities is vital. In this study, a stochastic process-based modeling approach is presented for capturing the main point bar heterogeneities: accretion surfaces (i.e., the aerial heterogeneity) and inclined heterolithic stratifications (i.e., the vertical heterogeneity). The former was modeled using a sine-generation function and the latter, with a sigmoidal function after which they were combined into a 3D point bar model. To ensure proper modeling of petrophysical properties, we developed a more representative gridding scheme which generates curvilinear grids representative of the point bar geometry. This grid was then transformed into a rectilinear grid to allow for geostatistical simulation after which all petrophysical properties were mapped back into the original curvilinear grid. An essential element of this modeling approach is the stochastic representation of shale drapes at the interface between successive accretion surfaces. The workflow was tested using a real field dataset for the Cranfield field, Mississippi. The constructed model was then subjected to a flow simulation study mimicking a CO 2 storage scenario. Various sensitivities were simulated to evaluate the effect of heterogeneities on CO 2 flow within the point-bar. Results demonstrate the importance of representing point-bar related heterogeneity and the spatial distribution of shale drapes on CO 2 plume migration and storage.

58 GEOSCIENCES↗

Analysis-Specific Fast Simulation at the LHC with Deep Learning

Abstract We present a fast-simulation application based on a deep neural network, designed to create large analysis-specific datasets. Taking as an example the generation of W + jet events produced in $$\sqrt{s}=$$ s = 13 TeV proton–proton collisions, we train a neural network to model detector resolution effects as a transfer function acting on an analysis-specific set of relevant features, computed at generation level, i.e., in absence of detector effects. Based on this model, we propose a novel fast-simulation workflow that starts from a large amount of generator-level events to deliver large analysis-specific samples. The adoption of this approach would result in about an order-of-magnitude reduction in computing and storage requirements for the collision simulation workflow. This strategy could help the high energy physics community to face the computing challenges of the future High-Luminosity LHC.

Chen, C.↗

Adaptive workflow for simulation of RF heaters

Accurate RF (Radio Frequency) simulations of fusion systems like ITER require the definition of high-fidelity analysis geometries that include detailed antenna, reactor wall, and physics regions. Here, this paper will describe a workflow for the execution of adaptive high-performance simulations of RF fusion systems. In this workflow, the simulation input consists of a CAD model attributed with the needed analysis attributes. The analysis mesh is automatically generated and the analysis steps are executed using the time-harmonic Maxwell's equations solved using high-order Nédélec finite elements. A patch recovery-based error estimator is used to drive a conforming mesh adaptation procedure.

97 MATHEMATICS AND COMPUTING↗

Geologic hydrogen: From natural occurrences to anthropogenic generation – A review of fundamentals, potential, challenges and prospects

Growing demand for hydrogen is exposing the environmental and economic limits of reforming-based and carbon-managed supply chains, while the scale-up of electrolytic capacity remains capital-constrained. Geologic hydrogen, defined as molecular H₂ generated and stored within the Earth's crust offers a complementary, potentially lower-cost resource, yet exploration is still ad hoc. This review (1) revisits a global inventory of confirmed hydrogen seeps and subsurface occurrences; (2) analyzes the controlling reactions, migration pathways, and trapping conditions governing these occurrences; (3) proposes a process-based geologic hydrogen system concept analogous to, yet distinct from, the petroleum system; and (4) evaluates potential geologic hydrogen systems within the United States as a representative case study. Here, we contrast natural systems powered by serpentinization, mantle degassing or radiolysis with anthropogenic systems that stimulate the same reactions or convert in-situ hydrocarbons. Stable hydrogen accumulations require generation rates that outpace combined physical, chemical and microbial losses; the Bourakébougou field (Mali) exemplifies a self-recharging, free-gas reservoir sustained by meteoric-water serpentinization beneath an efficient caprock. Prospective geologic hydrogen resources are likely to occur in regions where iron-rich lithologies, deep-seated faults, and low-permeability sealing formations coexist. Applying this principle, we highlight three promising hydrogen play types in U.S. geological terrains: ophiolite belts (Appalachian and Californian regions), the Midcontinent Rift and the Lake Superior banded‑iron formations. Multiphysics numerical models and positive-unlabeled machine-learning workflows help to accelerate play screening and de-risk future production; yet, reaction kinetics, stimulation strategies, and full techno-economic and life-cycle assessments remain pivotal knowledge gaps.

Anthropogenic hydrogen generation↗

Autonomous Synthesis and Inverse Design of Electrochromic Polymers with High Efficiency and Accuracy

Here, the design and synthesis of functional polymers, aimed at targeted properties through specific structures, have long been challenged by their complex and often nonlinear structure–property relationships. Key processes, including knowledge accumulation for predictive design and experimental refinement and validation, are traditionally labor-insensitive and time-consuming, making it difficult to balance accuracy and efficiency. Here, we introduce an accelerated, autonomous system for the on-demand synthesis of electronic polymers that achieves the desired electrochromic functionality with high accuracy and efficiency. Our approach leverages large language model-assisted data mining, a physics-informed copolymer machine learning model, and an AI-driven autonomous robotic workflow in the Polybot lab. Within 72 h, Polybot autonomously synthesized electrochromic polymers (ECPs) with targeted, previously-unreported color values, including green polymers with specific absorption profiles, precisely fine-tuning copolymer structures with a 5% step size in comonomer composition within a three-monomer system. A publicly accessible ECP informatics database has also been created to foster knowledge exchange.

AI-driven Robotic Lab↗

The Memory Scaling of Reverse-Mode Differentiation in Particle Accelerator Simulations with Space Charge

The recent development of differentiable simulation codes for particle accelerators has enabled gradient-based workflows that promise finer control and more realistic modeling of accelerator facilities. However, when using reverse-mode automatic differentiation, the memory usage continuously increases during the simulation, and can potentially exceed the available hardware memory - especially when costly space charge computation is included. To study the memory requirements for differentiable simulations, we have implemented space charge in Cheetah, a PyTorch-based beam tracking code that supports reverse-mode differentiation. We find that the memory usage for reverse-mode differentiation grows linearly with the number of macroparticles and cells, and that it is proportional to the number of space charge kicks involved in the simulation. This general scaling can be used to evaluate whether a given differentiable simulation is feasible given hardware memory constraints.

Dhamrait, Arjun↗

M3SF-24LL010302052-Comprehensive Analysis of Radionuclide Interaction with Hydrothermally Altered Repository Materials

This progress report (Level 3 Milestone Number M3SF-24LL010302052) summarizes research conducted at Lawrence Livermore National Laboratory (LLNL) within the Crystalline Work Package Number SF-24LL01030205. The research is focused on actinide and radionuclide sequestration in hydrothermally altered repository materials. In FY24, we completed a rigorous analysis of Se sorption to iron oxide phases using our L-SCIE sorption database. This effort explicitly accounts for surface titration behavior of oxide surfaces that was the subject of a recently published manuscript (Han et al., 2023). With this in mind, our Se sorption analysis now yields a more robust workflow for developing self-consistent surface complexation modeling approaches that can be adapted to specific SCM conceptual and numerical approaches (i.e. non-electrostatic, diffuse layer, triple layer models). In late FY24, we plan to publish the results of our comprehensive surface complexation modeling of Se(IV) and Se(VI) sorption to iron oxide mineral phases and provide a path forward to developing robust radionuclide sorption models for use in performance assessment. In FY24, we also submitted a manuscript summarizing our approach to integrating radionuclide sorption and coprecipitation phenomena and evaluation of radionuclide partitioning values across a range of radionuclides relevant to performance assessment. We demonstrated our approach in detail using Se sorption and coprecipitation with iron oxide minerals as a test case. This manuscript was recently accepted for publication in Applied Geochemistry (Balboni et al., Accepted). We also continued experiments to identify radionuclide interaction with hydrothermally altered crystalline repository and backfill materials. Recent research performed at Los Alamos National Laboratory (LANL) and Sandia National Laboratory (SNL) has provided key insights regarding the hydrothermal alteration behavior of bentonite backfill in the presence of repository materials (steel, concrete, etc.). We are now examining how mineral alteration affects retardation behavior of a suite of radionuclides of interest to repository performance assessment. These experiments also allow us to test the predictive ability of our component additivity approach to surface complexation and ion exchange. Our guiding hypothesis is that a robust surface complexation/ion exchange model and associated database, developed using our L-SCIE approach, can effectively predict changes in radionuclide sorption behavior resulting from the hydrothermal alteration of mineralogy in a repository near field. A short update of results to date is presented below.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Optimal CO2 Transport and Storage Cost Screening: Application Example

Poster on “Optimal CO2 Transport and Storage Cost Screening: Application Example” for the CCUS 2025 conference held in Houston, Texas March 3-5, 2025. A major challenge to commercial scale CCS deployment from the perspective of coal and natural gas-fired power plants is understanding cost-optimal CO2 transport and viable geologic storage options. This study demonstrates unique workflows, using NETL-developed, publicly-available models and tools, to efficiently estimate optimal CO2 transport and storage (T&S) costs for each of the CO2 sources in NETL’s Carbon Capture Retrofit Databases (CCRD) for Electricity Generating Units. The results demonstrate the impact of cost-drivers on optimal T&S, and trends in optimal T&S data, based on real point sources that could be retrofitted with CO2 source technologies.

application example↗