SEARCH · Engineering Papers

Results for “model data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

All sources NASA NTRS DOE OSTI

DOE OSTI2026

Atmospheric Modeling and Denoising for Millimeter-Wave Line Intensity Mapping

Line-intensity mapping (LIM) offers a promising approach to mapping large-scale cosmic structure, and the greatest obstacle for ground-based observations at millimeter wavelengths is foreground contamination from atmospheric emission. In this work, we present a simulation and denoising framework designed to isolate and subtract atmospheric fluctuations from LIM data, modeled after the instrument parameters of the South Pole Telescope Summertime Line Intensity Mapper (SPT-SLIM). We generate mock observations spanning 125-175 GHz containing cosmic signals, precipitable water vapor screens, ice crystal fluctuations, and photon noise. We then implement a spatial-spectral atmospheric removal pipeline combining per-pixel linear template regression with a two-dimensional Fourier-domain filter. The framework is evaluated under simulated conditions in the South Pole and the Atacama Desert across three key metrics: cosmic signal preservation, foreground subtraction efficiency, and instrument noise injection. Our pipeline achieves atmospheric suppression at large spatial scales, and these results establish a physically grounded foundation for atmosphere removal in ground-based LIM data collection.

Saye, L. K. [UC, Berkeley (main)] (ORCID:000900078↗

DOE OSTI2022

Transactional Knowledge Graph Generation To Model Adversarial Activities

A Knowledge Graph (KG) is a formal and structured representation of facts, relationships, and semantic descriptions of a set of entities. Traditionally, KGs are used to describe metadata about entities and to provide additional context to target application results. Many real-world domains also involve temporal interactions between entities in addition to the metadata data. Modeling these attributed transactions is a critical requirement when using KGs in complex real-world applications. Modeling adversarial activities is one such application that develops methodology and tools to produce realistic large-scale background activity graphs that include embedded Weapons of Mass Destruction (WMD) activity patterns. We present a novel platform for constructing a transactional knowledge graph from a diverse set of sources. We present the core components and architecture of the framework, and a use case for generating a background knowledge graph and WMD activity template to evaluate network alignment and subgraph matching algorithms.

Purohit, Sumit↗

DOE OSTI2020

Towards scalable dataframe systems

Dataframes are a popular abstraction to represent, prepare, and analyze data. Despite the remarkable success of dataframe libraries in R and Python, dataframes face performance issues even on moderately large datasets. Moreover, there is significant ambiguity regarding dataframe semantics. In this paper we lay out a vision and roadmap for scalable dataframe systems. To demonstrate the potential in this area, we report on our experience building Modin, a scaled-up implementation of the most widely-used and complex dataframe API today, Python's pandas. With pandas as a reference, we propose a simple data model and algebra for dataframes to ground discussion in the field. Given this foundation, we lay out an agenda of open research opportunities where the distinct features of dataframes will require extending the state of the art in many dimensions of data management. We discuss the implications of signature dataframe features including flexible schemas, ordering, row/column equivalence, and data/metadata fluidity, as well as the piecemeal, trial-and-error-based approach to interacting with dataframes.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Data-driven building energy modeling with feature selection and active learning for data predictive control

Three gaps impede the development of cost-effective and accurate data-driven building energy modeling/models (DBEM) for energy forecasting and predictive control strategies. Gap 1: data bias is common in building operation data, but this topic is hardly studied in DBEM; Gap 2: high data dimensionality is common in DBEM, but a systematic and scalable methodology is lacking to solve the problem; Gap 3: the interactions between data bias and high dimensionality have not been systematically studied for DBEM and predictive control in buildings. In this work, to address the three gaps mentioned above, we develop a framework that integrates active learning and feature selection for DBEM used for whole building data predictive control (or DPC, which is a branch of model predictive control). The framework provides a systematic methodology and automatic workflow that starts with raw data from building automation systems to the establishment of data-driven energy models for DPC controllers. The developed strategies and framework are evaluated in a virtual testbed based on EnergyPlus and BCVTB. Improved performance and reduced computational complexity are observed from the DBEM built with the developed framework, as well as the DPC controller based on that DBEM, indicating the effectiveness of the developed framework.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2022

Bayesian operator inference for data-driven reduced-order modeling

This work proposes a Bayesian inference method for the reduced-order modeling of time-dependent systems. Informed by the structure of the governing equations, the task of learning a reduced-order model from data is posed as a Bayesian inverse problem with Gaussian prior and likelihood. The resulting posterior distribution characterizes the operators defining the reduced-order model, hence the predictions subsequently issued by the reduced-order model are endowed with uncertainty. The statistical moments of these predictions are estimated via a Monte Carlo sampling of the posterior distribution. Since the reduced models are fast to solve, this sampling is computationally efficient. Furthermore, the proposed Bayesian framework provides a statistical interpretation of the regularization term that is present in the deterministic operator inference problem, and the empirical Bayes approach of maximum marginal likelihood suggests a selection algorithm for the regularization hyperparameters. The proposed method is demonstrated on two examples: the compressible Euler equations with noise-corrupted observations, and a single-injector combustion process.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Improving Performance of M-to-N Processing and Data Redistribution in In Transit Analysis and Visualization

In an in transit setting, a parallel data producer, such as a numerical simulation, runs on one set of ranks M, while a data consumer, such as a parallel visualization application, runs on a different set of ranks N. One of the central challenges in this in transit setting is to determine the mapping of data from the set of M producer ranks to the set of N consumer ranks. This is a challenging problem for several reasons, such as the producer and consumer codes potentially having different scaling characteristics and different data models. The resulting mapping from M to N ranks can have a significant impact on aggregate application performance. In this work, we present an approach for performing this M-to-N mapping in a way that has broad applicability across a diversity of data producer and consumer applications. We evaluate its design and performance with a study that runs at high concurrency on a modern HPC platform. By leveraging design characteristics, which facilitate an “intelligent” mapping from M-to-N, we observe significant performance gains are possible in terms of several different metrics, including time-to-solution and amount of data moved.

Loring, Burlen↗

DOE OSTI2020

Improving Performance of M-to-N Processing and Data Redistribution in In Transit Analysis and Visualization

In an in transit setting, a parallel data producer, such as a numerical simulation, runs on one set of ranks M, while a data consumer, such as a parallel visualization application, runs on a different set of ranks N: One of the central challenges in this in transit setting is to determine the mapping of data from the set of M producer ranks to the set of N consumer ranks. This is a challenging problem for several reasons, such as the producer and consumer codes potentially having different scaling characteristics and different data models. The resulting mapping from M to N ranks can have a significant impact on aggregate application performance. In this work, we present an approach for performing this M-to-N mapping in a way that has broad applicability across a diversity of data producer and consumer applications. We evaluate its design and performance with a study that runs at high concurrency on a modern HPC platform. By leveraging design characteristics, which facilitate an ''intelligent'' mapping from M-to-N, we observe significant performance gains are possible in terms of several different metrics, including time-to-solution and amount of data moved.

Loring, Burlen↗

DOE OSTI2023

Data initiatives for ocean-driven melt of Antarctic ice shelves

Ocean-driven melt of Antarctic ice shelves is an important control on mass loss from the ice sheet, but is complex to study due to significant variability in melt rates both spatially and temporally. Here we assess the strengths and weakness of satellite and field-based observations as tools for testing models of ice-shelf melt. We discuss how the complementary use of field, satellite and model data can be a powerful but underutilised tool for studying melt processes. Finally, we identify some community initiatives working to collate and publish coordinated melt rate datasets, which can be used in future for validating satellite-derived maps of melt and evaluating processes in numerical simulations.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

HPC-FAIR: A Framework Managing Data and AI Models for Analyzing and Optimizing Scientific Applications

The increasing reliance on machine learning (ML) to analyze and optimize large-scale scientific applications on supercomputers faces a significant bottleneck: the lack of readily available, high-quality training datasets and the difficulty in reusing existing AI models. This project was motivated by the urgent need to address the “FAIR” principles (Findability, Accessibility, Interoperability, Reusability) for both training datasets and AI models in the high-performance computing (HPC) domain. The project developed HPC-FAIR, a high-performance computing data management framework designed to centralize HPC-related datasets and AI models within a unified hub. To ensure interoperability, the framework established a standardized representation and vocabulary (ontology) for both data and models. HPC-FAIR also implemented automated workflows to streamline data processing, model access, and benchmarking. Additionally, the project focused on optimizing data harnessing efficiency through advanced techniques like deep reuse and compression-based analytics.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Bim-to-fea Conversion Program

The purpose of this program is to enable interoperability between BIM-based architectural design software (i.e., Revit, ArchiCAD, AVEVA E3D) to structural analysis software (i.e., SAP2000). The program takes in BIM building model data via the IFC file format, automatically transforms the architectural coordination entities (structural beams, columns, slabs, walls) to structural analysis entities (i.e., finite element space frames and shells), automatically adjusts the connectivity of the structural analysis entities, and finally exports the structural analysis entities as a structural analysis model contained within a new IFC file. For example, a 3D building in Revit can be exported to an IFC file, run through this BIM-to-FEA program, then the exported IFC can be inputted into SAP2000.

Crowder, Nicholas [Idaho National Laboratory (INL)↗

DOE OSTI2024

A multi-algorithm approach for modeling coastal wetland eco-geomorphology

Coastal wetlands play an important role in the global water and biogeochemical cycles. Climate change makes it more difficult for these ecosystems to adapt to the fluctuation in sea levels and other environmental changes. Given the importance of eco-geomorphological processes for coastal wetland resilience, many eco-geomorphology models differing in complexity and numerical schemes have been developed in recent decades. However, their divergent estimates of the response of coastal wetlands to climate change indicate that substantial structural uncertainties exist in these models. To investigate the structural uncertainty of coastal wetland eco-geomorphology models, we developed a multi-algorithm model framework of eco-geomorphological processes, such as mineral accretion and organic matter accretion, within a single hydrodynamics model. The framework is designed to explore possible ways to represent coastal wetland eco-geomorphology in Earth system models and reduce the related uncertainties in global applications. We tested this model framework at three representative coastal wetland sites: two saltmarsh wetlands (Venice Lagoon and Plum Island Estuary) and a mangrove wetland (Hunter Estuary). Through the model–data comparison, we showed the importance of using a multi-algorithm ensemble approach for more robust predictions of the evolution of coastal wetlands. We also found that more observations of mineral and organic matter accretion at different elevations of coastal wetlands and evaluation of the coastal wetland models at different sites in diverse environments can help reduce the model uncertainty.

58 GEOSCIENCES↗

DOE OSTI2021

An Integrative Model for Soil Biogeochemistry and Methane Processes. II: Warming and Elevated CO 2 Effects on Peatland CH 4 Emissions

Peatlands are one of the largest natural sources for atmospheric methane (CH 4 ), a potent greenhouse gas. Climate warming and elevated atmospheric carbon dioxide (CO 2 ) are two important environmental factors that have been confirmed to stimulate peatland CH 4 emissions; however, the mechanisms underlying enhanced emissions remain elusive. A data-model integration approach was applied to understand the CH 4 processes in a northern temperate peatland under a gradient of warming and doubled atmospheric CO 2 concentration. We found that warming and elevated CO 2 stimulated CH 4 emissions through different mechanisms. Warming initially stimulated but then suppressed vegetative productivity while stimulating soil organic matter (SOM) mineralization and dissolved organic carbon (DOC) fermentation, which led to higher acetate production and enhanced acetoclastic and hydrogenotrophic methanogenesis. Warming also enhanced surface CH 4 emissions, which combined with warming-caused decreases in CH 4 solubility led to slightly lower dissolved CH 4 concentrations through the soil profiles. Elevated CO 2 enhanced ecosystem productivity and SOM mineralization, resulting in higher DOC and acetate concentrations. Higher DOC and acetate concentrations increased acetoclastic and hydrogenotrophic methanogenesis and led to higher dissolved CH 4 concentrations and CH 4 emissions. Both warming and elevated CO 2 had minor impacts on CH 4 oxidation. A meta-analysis of warming and elevated CO 2 impacts on carbon cycling in wetlands agreed well with a majority of the modeled mechanisms. Finally, this mechanistic understanding of the stimulating impacts of warming and elevated CO 2 on peatland CH 4 emissions enhances our predictability on the climate-ecosystem feedback.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

USAID Haiti Training Session #1: Engage Orientation [Slides]

Welcome to Engage! Engage is a capacity expansion modeling tool supported by the National Renewable Energy Laboratory and based on the Calliope open-source capacity expansion model developed by the ETH Zurich University, maintained at the TU Delft University. Engage is an accessible (free, open-access, web-hosted) and flexible web-based energy system planning application for rapid multiple-energy-form energy system scenario exploration. Its cloud-based, collaborator-sharable data model, intuitive interface and visualization capabilities facilitate collaboration and communication among teams, with experts, and among diverse stakeholder groups exploring energy system implications at from district to national-scale models. This training series was developed under USAID to empower Haitian stakeholders to explore modeling scenarios in Engage to develop a Haiti Energy Master Plan. This training series includes a general overview of how Engage works along with tailored exercises that target Haiti's specific energy needs, such as modeling the capacity expansion of the bulk power system, fuel scarcity challenges, the development of microgrids, and the economic viability of transmission strategies. See NREL/PR-7A40-89366 for the French translation of this document.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

USAID Haiti Training Session #2: Introduction to Engage [Slides]

Welcome to Engage! Engage is a capacity expansion modeling tool supported by the National Renewable Energy Laboratory and based on the Calliope open-source capacity expansion model developed by the ETH Zurich University, maintained at the TU Delft University. Engage is an accessible (free, open-access, web-hosted) and flexible web-based energy system planning application for rapid multiple-energy-form energy system scenario exploration. Its cloud-based, collaborator-sharable data model, intuitive interface and visualization capabilities facilitate collaboration and communication among teams, with experts, and among diverse stakeholder groups exploring energy system implications from district to national-scale models. This training series was developed under USAID to empower Haitian stakeholders to explore modeling scenarios in Engage to develop a Haiti Energy Master Plan. This training series includes a general overview of how Engage works along with tailored exercises that target Haiti's specific energy needs, such as modeling the capacity expansion of the bulk power system, fuel scarcity challenges, the development of microgrids, and the economic viability of transmission strategies. See NREL/PR-7A40-89369 for the French translation of this document.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

USAID Haiti Training Session #3: Capacity Expansion [Slides]

Welcome to Engage! Engage is a capacity expansion modeling tool supported by the National Renewable Energy Laboratory and based on the Calliope open-source capacity expansion model developed by the ETH Zurich University, maintained at the TU Delft University. Engage is an accessible (free, open-access, web-hosted) and flexible web-based energy system planning application for rapid multiple-energy-form energy system scenario exploration. Its cloud-based, collaborator-sharable data model, intuitive interface and visualization capabilities facilitate collaboration and communication among teams, with experts, and among diverse stakeholder groups exploring energy system implications from district to national-scale models. This training series was developed under USAID to empower Haitian stakeholders to explore modeling scenarios in Engage to develop a Haiti Energy Master Plan. This training series includes a general overview of how Engage works along with tailored exercises that target Haiti's specific energy needs, such as modeling the capacity expansion of the bulk power system, fuel scarcity challenges, the development of microgrids, and the economic viability of transmission strategies. See NREL/PR-7A40-89365 for the French translation of this document.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

Session de formation de l'USAID en Haiti n1: Orientation de l'outil Engage [Slides]

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

Session de formation de l'USAID en Haiti n2: Introduction a l'outil Engage [Slides]

Welcome to Engage! Engage is a capacity expansion modeling tool supported by the National Renewable Energy Laboratory and based on the Calliope open-source capacity expansion model developed by the ETH Zurich University, maintained at the TU Delft University. Engage is an accessible (free, open-access, web-hosted) and flexible web-based energy system planning application for rapid multiple-energy-form energy system scenario exploration. Its cloud-based, collaborator-sharable data model, intuitive interface and visualization capabilities facilitate collaboration and communication among teams, with experts, and among diverse stakeholder groups exploring energy system implications from district to national-scale models. This training series was developed under USAID to empower Haitian stakeholders to explore modeling scenarios in Engage to develop a Haiti Energy Master Plan. This training series includes a general overview of how Engage works along with tailored exercises that target Haiti's specific energy needs, such as modeling the capacity expansion of the bulk power system, fuel scarcity challenges, the development of microgrids, and the economic viability of transmission strategies. See NREL/PR-7A40-88836 for the English translation of this document.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

Seance de formation de l'USAID en Haiti n3: Expansion des capacites [Slides]

Welcome to Engage! Engage is a capacity expansion modeling tool supported by the National Renewable Energy Laboratory and based on the Calliope open-source capacity expansion model developed by the ETH Zurich University, maintained at the TU Delft University. Engage is an accessible (free, open-access, web-hosted) and flexible web-based energy system planning application for rapid multiple-energy-form energy system scenario exploration. Its cloud-based, collaborator-sharable data model, intuitive interface and visualization capabilities facilitate collaboration and communication among teams, with experts, and among diverse stakeholder groups exploring energy system implications from district to national-scale models. This training series was developed under USAID to empower Haitian stakeholders to explore modeling scenarios in Engage to develop a Haiti Energy Master Plan. This training series includes a general overview of how Engage works along with tailored exercises that target Haiti's specific energy needs, such as modeling the capacity expansion of the bulk power system, fuel scarcity challenges, the development of microgrids, and the economic viability of transmission strategies. See NREL/PR-7A40-88837 for the English translation of this document.

24 POWER TRANSMISSION AND DISTRIBUTION↗