Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data requirements”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

AMRIC: A Novel In Situ Lossy Compression Framework for Efficient I/O in Adaptive Mesh Refinement Applications

As supercomputers advance towards exascale capabilities, computational intensity increases significantly, and the volume of data requiring storage and transmission experiences exponential growth. Adaptive Mesh Refinement (AMR) has emerged as an effective solution to address these two challenges. Concurrently, error-bounded lossy compression is recognized as one of the most efficient approaches to tackle the latter issue. Despite their respective advantages, few attempts have been made to investigate how AMR and error-bounded lossy compression can function together. To this end, this study presents a novel in-situ lossy compression framework that employs the HDF5 filter to improve both I/O costs and boost compression quality for AMR applications. We implement our solution into the AMReX framework and evaluate on two real-world AMR applications, Nyx and WarpX, on the Summit supercomputer. Experiments with 512 cores demonstrate that AMRIC improves the compression ratio by 81X and the I/O performance by 39X over AMReX's original compression solution.

Wang, Daoce↗
DOE OSTI2024

OReole-FM: successes and challenges toward billion-parameter foundation models for high-resolution satellite imagery

While the pretraining of Foundation Models (FMs) for remote sensing (RS) imagery is on the rise, models remain restricted to a few hundred million parameters. Scaling models to billions of parameters has been shown to yield unprecedented benefits including emergent abilities, but requires data scaling and computing resources typically not available outside industry R&D labs. In this work, we pair high-performance computing resources including Frontier supercomputer, America's first exascale system, and high-resolution optical RS data to pretrain billion-scale FMs. Our study assesses performance of different pretrained variants of vision Transformers across image classification, semantic segmentation and object detection benchmarks, which highlight the importance of data scaling for effective model scaling. Moreover, we discuss construction of a novel TIU pretraining dataset, model initialization, with data and pretrained models intended for public release. By discussing technical challenges and details often lacking in the related literature, this work is intended to offer best practices to the geospatial community toward efficient training and benchmarking of larger FMs.

Ambrozio Dias, Philipe↗
DOE OSTI2026

ChatMPI: LLM-Driven MPI Code Generation for HPC Workloads

The Message Passing Interface (MPI) standard plays a crucial role in enabling scientific applications for parallel computing and is an essential component in high-performance computing (HPC). However, implementing MPI code manually—especially applying a proper domain decomposition and communication pattern—is a challenging and error-prone task. We present ChatMPI, an AI assistant for MPI parallelization of sequential C codes. In our analysis, we focus on testing six essential HPC workloads, which are based on Basic Linear Algebra Subprograms levels 1, 2, and 3 as well as sparse, stencil, and iterative operations. We analyze the process of creating ChatMPI by using the ChatHPC library. This lightweight large language model (LLM)–based infrastructure enables HPC experts to efficiently create and supervise trustworthy AI capabilities for critical HPC software tasks. We study the data required for training (fine-tuning) ChatMPI to generate parallel codes that not only use MPI syntax correctly but also apply HPC techniques to reduce memory communication and maximize performance by using proper work decomposition. With a relatively small training dataset composed of a few dozen prompts and fewer than 15 minutes of fine-tuning on one node equipped with two NVIDIA H100 GPUs, ChatMPI elevates trustworthiness for MPI code generation of current LLMs (e.g., Code Llama, ChatGPT-4o and ChatGPT 5). Additionally, we evaluate the performance of the MPI codes generated by ChatMPI in comparison with the ones generated by ChatGPT-4o and ChatGPT-5. The codes generated by ChatMPI provide up to a 4 × boost in performance by using better problem decomposition, communication patterns, and HPC techniques (e.g., communication avoiding).

Valero Lara, Pedro [ORNL] (ORCID:0000000214794310)↗
DOE OSTI2026

FLYING SERVING: On-the-Fly Parallelism Switching for Large Language Model Serving

Production LLM serving must simultaneously deliver high throughput, low latency, and sufficient context capacity under non-stationary traffic and mixed request requirements. Data parallelism (DP) maximizes throughput by running independent replicas, while tensor parallelism (TP) reduces per-request latency and pools memory for long-context inference. However, existing serving stacks typically commit to a static parallelism configuration at deployment; adapting to bursts, priorities, or long-context requests is often disruptive and slow. We present Flying Serving, a vLLM-based system that enables online DP-TP switching without restarting engine workers. Flying Serving makes reconfiguration practical by virtualizing the state that would otherwise force data movement: (i) a zero-copy Model Weights Manager that exposes TP shard views on demand, (ii) a KV Cache Adaptor that preserves request KV state across DP/TP layouts, (iii) an eagerly initialized Communicator Pool to amortize collective setup, and (iv) a deadlock-free scheduler that coordinates safe transitions under execution skew. Across three popular LLMs and realistic serving scenarios, Flying Serving improves performance by up to 4.79 × under high load and 3.47 × under low load while supporting latency- and memory-driven requests.

Gao, Shouwei [ORNL]↗
DOE OSTI2020

CheKiPEUQ

Parameter estimation for complex physical problems often suffers from finding 'solutions' that are not physically realistic. The CheKiPEUQ software provides tools for finding physically realistic parameter estimates.and CheKiPEUQ provide tools for making graphs of the parameter positions within parameter space as well as plots of the final simulation results. The primary purpose of the CheKiPEUQ software is to enable more physically realistic parameter estimation from comparing simulations to experiments. Specifically, when prior knowledge is available about the region of parameter space which is physically realistic and when the level of uncertainty from experiment can be estimated. The software is intentionally general and can be used for almost any type of simulation. The software is made in a user friendly manner so that users can simply enter the required data and then run the program, following guidelines provided by the authors along with some trial and error. Examples are provided. Users do not need to understand the methodology that will be namedi in the following sentences. While CheKiPEUQ can be used for conventional parameter estimation and other uses, the primary uses for CheKiPEUQ are: 1) Bayesian Parameter Estimation, 2) Bayesian Model Discrimination, 3) Bayesian Design of Experiments. For more information see the project website, documentation, examples, and related publications.

Savara, Aditya [Oak Ridge National Lab. (ORNL), Oa↗
DOE OSTI2023

Smart Preprocessing & Robust Integration Emulator

To achieve the desired particle size of biomass feedstocks during preprocessing for trouble-free handling and conversion to produce biofuels and bioproducts, the raw materials must undergo a crucial milling process. The particle size of biomass plays a critical role in subsequent biofuel manufacturing, where a larger area-to-volume ratio facilitates efficient synthesis while balancing the impact of moisture on biomass storage. To optimize biofuel production efficiency and overcome these challenges, it is imperative to accurately predict the particle size distribution (PSD) of the biomass in the design of efficient preprocessing systems. The population balance model (PBM), upon empirical calibration and validation, can provide rapid prediction of post-milling PSD of granular biomass. However, PSD has limitations related to mass conservation and the absence of moisture considerations. To overcome these drawbacks, a deep learning model called the enhanced deep neural operator (DNO+) is implemented in the code. This model not only retains the capabilities of the PBM in handling complex mapping functions but also incorporates additional factors influencing the system. By considering various experimental conditions such as sieve size and moisture content, the trained DNO+ model can effectively predict the PSD after milling for any given feed PSD. To further reduce the reliance on experimental data, the PBM is integrated into the DNO+ model, resulting in a physics-informed DNO+ (PIDNO+). The PIDNO+ model addresses the non-conservation of quality exhibited by the PBM while inheriting the advantages of the DNO+ model in considering multiple influencing factors. Moreover, the PIDNO+ model significantly reduces the amount of data required for model training. Both deep learning models, i.e., DNO+ and PIDNO+, are excellent in predictive performance, offering swift and accurate machine learning-based predictions. The use of this code that contains these models will assist in guiding the proper milling equipment selection and operational conditions to achieve the desired biomass particle sizes, ensuring the efficiency of subsequent biofuel and bioproduct production processes.

Xia, Yidong [Idaho National Laboratory (INL), Idah↗
DOE OSTI2025

Rotation-invariant-neural-networks

Rotational symmetries are a fundamental and inherent property of many sources of data. Ensuring NNs embody rotation invariance will enhance their accuracy and radically lower their data requirements across a transformatively wide spectrum of applications.

Lubbers, Nicholas [Los Alamos National Laboratory]↗
DOE OSTI2025

Scalable multilevel Monte Carlo methods exploiting parallel redistribution on coarse levels

Here, we study an element agglomeration coarsening strategy that requires data redistribution at coarse levels when the number of coarse elements becomes smaller than the number of MPI processes used on the finest level. The overall procedure generates coarse elements (general unstructured unions of fine grid elements) within the framework of element-based algebraic multigrid methods (or AMGe) studied previously. The AMGe-generated coarse spaces have the ability to exhibit approximation properties of the same order as the fine-level spaces since by construction they contain the piecewise polynomials of the same order as on the fine level. These approximation properties are key for the successful use of AMGe in multilevel solvers for nonlinear partial differential equations as well as for multilevel Monte Carlo (MLMC) simulations. The ability to coarsen without being constrained by the number of MPI processes, as described in the present paper, allows to improve the scalability of these solvers as well as the overall MLMC method. The paper illustrates this latter fact with detailed scalability study of MLMC simulations applied to model Darcy equations with a stochastic log-normal permeability field.

AMGe↗
DOE OSTI2020

Switchable resolution in soft x-ray tomography of single cells

The diversity of living cells, in both size and internal complexity, calls for imaging methods with adaptable spatial resolution. Soft x-ray tomography (SXT) is a three-dimensional imaging technique ideally suited to visualizing and quantifying the internal organization of single cells of varying sizes in a near-native state. The achievable resolution of the soft x-ray microscope is largely determined by the objective lens, but switching between objectives is extremely time-consuming and typically undertaken only during microscope maintenance procedures. Since the resolution of the optic is inversely proportional to the depth of focus, an optic capable of imaging the thickest cells is routinely selected. This unnecessarily limits the achievable resolution in smaller cells and eliminates the ability to obtain high-resolution images of regions of interest in larger cells. Here, we describe developments to overcome this shortfall and allow selection of microscope optics best suited to the specimen characteristics and data requirements. We demonstrate that switchable objective capability advances the flexibility of SXT to enable imaging cells ranging in size from bacteria to yeast and mammalian cells without physically modifying the microscope, and we demonstrate the use of this technology to image the same specimen with both optics.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Handbook: Water Evaluation Tools

This document provides general instructions on performing a walk-through water survey to collect the required data for a comprehensive water evaluation and entering data into the online Water Balance Tool.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Roadmap for thermal property measurements of Molten Salt Reactor systems

Thermal properties of molten salts, both with and without fissile and fertile material, are fundamental to modeling and simulation that supports design, construction, operation, and accident progression evaluation of molten salt reactors. This roadmap provides guidance to the research community on the types and amounts of required data for base, or carrier, salt systems, recommends simulated burnup fuel salt compositions to evaluate, and provides a technical foundation for a focused salt property evaluation matrix. The property values generated from both computation and experimental methods are used to develop models that constitute the Molten Salt Thermal Properties Database (MSTDB). While the building blocks of MSTDB are fundamental in nature, its data facilitates constructing engineering models that allow stakeholders to investigate the behavior of specific compositions of interest and supports broader modeling and simulation of MSRs through coupling to multi-physics, multi-scale mass accountancy tools.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Aeroacoustic Assessment of Wind Plant Controls

The Aeroacoustic Assessment project aims to quantify changes in aeroacoustic noise generation by a utility scale wind turbine operating under imposed yaw offsets common for wake steering and wind plant control strategies. Active plant control utilizing wake deflection control strategies have been shown experimentally and computationally to reliably produce 1-2% of additional annual energy production (AEP) without significant changes in turbine structural loads, the potential impact on aeroacoustic emissions has yet to be quantified or completely understood. Yawed operation of a wind turbine changes the three-dimensional aerodynamic interaction between the rotor blades and the incoming atmospheric flow, leading to changes in noise generation. This work quantifies the extent to which active control induces additional aeroacoustic emissions from additional separation and other flow interaction dynamic effects. Given public concerns about wind turbine noise and the need for observational data required for regulators to establish noise restrictions, we must understand potential acoustic emissions resulting from active control prior to commercial deployment and the development of practical noise reduction methods and technologies. The work outlined in this report details the new aeroacoustic measurement capability developed at NREL and its application to making full-field observations of noise from a utility-scale wind turbine. Preliminary noise modeling with the aeroacoustics module in OpenFAST helped to establish the design of the experiment, specifically targeting the noise observed at observers distributed around the DOE-owned GE 1.5 MW wind turbine. Low-frequency and infrasound measurement capability implemented in this project establish an operational baseline for the wind turbine, setting the stage for future control, rotor blade, and turbine design research.

17 WIND ENERGY↗
DOE OSTI2022

Non-Powered Dam Custom Analysis and Taxonomy (NPDamCAT) Framework

Over 85,000 non-powered dams (NPDs) exist in the United States that provide services such as flood control, navigation, and water storage for irrigation/domestic water use (USACE 2019). The existing infrastructure of NPDs poses an opportunity for improving economic and environmental performance and generating electricity, as well as a challenge for maintaining aging structures and remediating fragmented river systems. NPD stakeholders interested in the rehabilitation, retrofit, or removal of NPDs must have the relevant information about the population of dams to support decision-making. Each NPD has unique characteristics describing its design, operation, environmental impacts, social impacts, and economic potential. The large number of dams, the diversity of interests related to dams, the variety of dam characteristics, and the types of data required to describe dams all pose major challenges to an analysis of the entire dam population.

13 HYDRO ENERGY↗
DOE OSTI2022

NCSP Training and Education Program [Slides]

The mission of the Nuclear Criticality Safety Program is to provide sustainable expert leadership, direction and the technical infrastructure necessary to develop, maintain, and disseminate the essential technical tools, training, and data required to support safe, efficient fissionable material operations within DOE; the vision of the program is a Continually improving, adaptable, and transparent program that communicates and collaborates globally to incorporate technology, practices, and programs to be responsive to the essential technical needs of those responsible for developing, implementing, and maintaining nuclear criticality safety. Training and education topics for the program include a 1-week Manager/Criticality Safety Officer Course and a 2-week NCS Engineer Hands-on Training Course.

42 ENGINEERING↗
DOE OSTI2021

Brief Overview of the NCSP [Slides]

The mission of the NCSP is to provide sustainable expert leadership, direction, and the technical infrastructure necessary to develop, maintain, and disseminate the essential technical tools, training, and data required to support safe, efficient fissionable material operations within the Department of Energy. The vision of the NCSP is a continually improving, adaptable, and transparent program that communicates and collaborates globally to incorporate technology, practices, and programs to be responsive to the essential technical needs of those responsible for developing, implementing, and maintaining nuclear criticality safety.

2021 NCSP TPR Best Paper Award↗
DOE OSTI2022

The Source Physics Experiment (SPE) Science Plan

The Source Physics Experiment (SPE) series is a long-term NNSA research and development effort designed to improve U.S. arms control and nuclear nonproliferation verification and monitoring capabilities. The findings from the SPE will advance the United States’ nuclear explosion monitoring capabilities, particularly with respect to detection, discrimination and determination of yields associated with small nuclear explosions that can be lost amid the noisy seismo-acoustic background from other sources. The data generated from the SPE, a series of well-designed and recorded chemical explosions, will contribute to the development and validation of first-principles explosive source generated seismo-acoustic modeling codes. These codes will then facilitate the update of semi-empirical methods, currently based on historic test site data, such that key explosion observables can be reproduced, thus improving confidence in nuclear test monitoring in new areas and/or under novel emplacement conditions. The overall SPE project is comprised of both the development of the new explosion simulation codes and the chemical explosion test series. The chemical explosion test series will generate the empirical data required to both develop and validate the new simulation codes.

58 GEOSCIENCES↗
DOE OSTI2021

Overview of the NCSP Nuclear Data Program [Slides]

The mission of the NCSP is to provide sustainable expert leadership, direction and the technical infrastructure necessary to develop, maintain and disseminate the essential technical tools, training and data required to support safe, efficient fissionable material operations within the Department of Energy. The vision of the NCSP is to create a continually improving, adaptable and transparent program that communicates and collaborates globally to incorporate technology, practices and programs to be responsive to the essential technical needs of those responsible for developing, implementing and maintaining nuclear criticality safety.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗