Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “simulated data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Predicting weather impacts on corn production in a data-limited region using a transfer learning approach

The stability of food supply and prices may depend more on annual changes in yields from year-to-year variability in weather than on longer-term average changes from changing climatic conditions. However, the absence of high-quality data on crop yields at fine spatial resolutions in many regions of the world makes it challenging to statistically model their response to interannual variability in weather patterns. Therefore, there is a need for empirical methods that can project annual crop yield changes even in limited data regions. Here, we propose a transfer learning algorithm that uses high spatial resolution data from one region to project yields in another region with more limited data. The goal of our work is to understand what data types can be beneficial for transferring learning from a source region to a very different target region with more limited data. We utilize Long Short-Term Memory to develop a transfer learning model that is trained on historical county-level corn yield in the United States and predicts district-level corn yield variations in India. Even using smaller amounts of data in India, simulating a data-scarce region, we achieve an average root mean square error of 0.48 bu acre−1 in predicting interannual yield variations. Using Shapley values to interpret results, we explore the contribution of the different weather parameters to interannual yield variability and find a larger influence of precipitation-related variables. Our study demonstrates the usefulness of this method for transferring models of weather impacts on crop yields trained on a data-rich country to one with more limited data. It suggests the potential of applying the transfer learning model to mitigate the need for extensive raw data globally.

Vishwakarma, Srishti [ORNL] (ORCID:000000031674419↗
DOE OSTI2021

cuZ-Checker: A GPU-Based Ultra-Fast Assessment System for Lossy Compressions

Lossy compression is becoming an indispensable technique for the success of today's extreme-scale high-performance computing projects that produce vast volumes of data during scientific simulations or instrument data acquisitions. Comprehensively understanding the compression quality and performance of different lossy compressors is critical to selecting the best-fit compressors and using them properly and efficiently in practice. A few lossy compression assessment tools (e.g., Z-checker) have been developed, but none of them support the execution in a GPU environment. This is a significant gap because many recent extreme-scale applications and lossy compressors (e.g., cuSZ) can run entirely within GPUs. In this work, we develop an efficient lossy compression measuring system (called cuZ-Checker) on the GPU platform, which aims to perform the lossy compression quality and performance assessment completely within the GPU environment. Our contribution is threefold. (1) We develop a novel GPU-based lossy compression measuring framework using a computation pattern-based design approach. This approach classifies the computing-intensive metrics into three categories based on their patterns which creates large opportunities for kernel fusion and data reuse. (2) For each pattern in cuZ-Checker, we develop a CUDA kernel and provide fine-grained optimizations to boost its performance. (3) We thoroughly evaluate our cuZ-checker on a V100 GPU using four real-world scientific application datasets. Experiments show that cuZ-Checker can significantly accelerate the overall lossy compression assessment performance by 23X similar to 31X compared with the OpenMP-based multithreading CPU performance. To the best of our knowledge, this is the first lossy compression measuring system designed for GPU devices.

GPU↗
DOE OSTI2026

Enhancing ZFP: A Statistical Approach to Understanding and Reducing Error Bias in a Lossy Floating-Point Compression Algorithm

The amount of data generated and gathered in scientific simulations and data collection applications is continuously growing, putting mounting pressure on storage and bandwidth concerns. A means of reducing such issues is data compression; but, lossless data compression is typically ineffective when applied to floating-point data. Thus, users tend to apply a lossy data compressor, which allows for small deviations from the original data. It is essential to understand how the error from lossy compression impacts the accuracy of the data analytics. Thus, we must analyze not only the compression properties but the error as well. In this paper, we provide a statistical analysis of the error caused by ZFP compression, a state-of-the-art, lossy compression algorithm explicitly designed for floating-point data. We show that the error is indeed biased and propose simple modifications to the algorithm to neutralize the bias and further reduce the resulting error.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Athena - Shuttle Bus Optimization and Event Driven Simulator [SWR 20-105]

The primary purpose of the software is to optimize shuttle routes to and from terminals, given some airport campus location like the rental car center. This code was developed as part of the DOE funded Athena project. One aspect of the Athena project was to investigate if the optimization of shuttle routes that move passengers to and from the five DFW terminals and the rental car center could result in lower energy consumption from the shuttle fleet while still maintaining an acceptable level of service to passengers. Hence, the optimization done by the code determines a set of shuttle routes, the type of shuttle on each route, and the number of shuttles servicing each route. The optimization aims to make these choices in a way that the energy consumption per hour by the fleet is minimized. Additionally, the software can fast simulate airport shuttle operations with collected data. The simulation inputs are passenger arrival rates, shuttle routes and frequencies, and simulation configurations. The outputs include: time dependent shuttle energy level, time dependent charging station usage, time dependent number of passengers on each bus, time dependent number of passengers at each bus stop, history of number of passengers left at each bus stop, route history of fleet shuttle buses and on-demand buses, and time dependent bus distance traveled.

Kelly, Kenneth↗
DOE OSTI2021

Risk-Adaptive Experimental Design for High-Consequence Systems: LDRD Final Report

Constructing accurate statistical models of critical system responses typically requires an enormous amount of data from physical experiments or numerical simulations. Unfortunately, data generation is often expensive and time consuming. To streamline the data generation process, optimal experimental design determines the 'best' allocation of experiments with respect to a criterion that measures the ability to estimate some important aspect of an assumed statistical model. While optimal design has a vast literature, few researchers have developed design paradigms targeting tail statistics, such as quantiles. In this project, we tailored and extended traditional design paradigms to target distribution tails. Our approach included (i) the development of new optimality criteria to shape the distribution of prediction variances, (ii) the development of novel risk-adapted surrogate models that provably overestimate certain statistics including the probability of exceeding a threshold, and (iii) the asymptotic analysis of regression approaches that target tail statistics such as superquantile regression. To accompany our theoretical contributions, we released implementations of our methods for surrogate modeling and design of experiments in two complementary open source software packages, the ROL/OED Toolkit and PyApprox.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Event Selection in the MicroBooNE Deep Learning Based Low Energy Excess Analysis Using Two-Body Scattering Criteria

The uniquely detailed neutrino event information from liquid argon time projection chambers allows reconstruction of a set of kinematic quantities that over-constrain the expectations for charged current quasielastic scattering (CCQE). MicroBooNE makes use of the CCQE consistency requirements in a deep-learning-based search for the MiniBooNE low energy excess analysis. This requirement rejects backgrounds as well as events with poorly reconstructed neutrino energy due to final state interactions of the outgoing proton. The results presented here demonstrate the quality of the selection of $\nu_e$ and $\nu_µ$ events. We show excellent agreement between the data and the simulation across many data sets. This positions us to be ready to unblind the MicroBooNE low energy excess analysis in the very near future.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Accurate Dark Energy Constraints via the Precise Characterization of Galaxy Intrinsic Alignment Coupled with Shear and Redshift Interference

One of the most fundamental mysteries we face in physics is understanding what the nature of the dark energy component of our Universe is that causes the accelerated expansion of space. A powerful way to study dark energy is via weak gravitational lensing due to large-scale structure in the Universe, which we observe as tiny distortions in the shapes of very distant galaxies due to the bending of light by foreground mass. The Dark Energy Survey (DES) and Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) were designed to enable unprecedented measurements of these distortions in the shapes of galaxies to study dark energy. The intrinsic shapes of galaxies before they are distorted by weak gravitational lensing can cancel out some of the effects of lensing to obscure or bias what we infer about the nature of dark energy. This research program has led to improved image-level simulations of the Rubin Observatory LSST data. These simulations have made it possible to characterize for the first time the cosmic impact of these intrinsic shapes on biasing weak gravitational lensing calibration. This work will inform crucial improvements in methodology for studying dark energy with weak gravitational lensing at the precision promised by the the Rubin Observatory LSST over the next decade to ensure we are able to infer unbiased information about the nature of dark energy.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Storm and Annual Time Scale Hydrological Data for the Russian River Watershed 1996-2022

These files contains observed and simulated hydrological data (discharge, precipitation) that have been aggregated to the storm-event scale and to the annual time scale for the Russian River Watershed (RRW), California. Observed data are obtained from 12 different USGS hydrological stations located throughout the watershed, and discharge is simulated using the GR5H hourly hydrological model. Precipitation data are obtained from the NASA NLDAS NOAH Community Land Surface Model. All simulated and observed discharge are aggregated to the storm and annual time scales. We investigated changes in watershed hydrological conditions in the Russian River Watershed, a Mediterranean, drought prone, wildfire-adapted ecosystem, following eleven wildfires that occurred from 2017-2020. We ask two research questions: 1) How do interacting wildfire events, drought, and atmospheric rivers impact hydrological conditions of the watershed and in particular streamflow?, and 2) What percentage of new and/or cumulative wildfire disturbance is required to initiate hydrological change? We hypothesize that sub-watersheds of the RRW Mediterranean ecoregion have not burned beyond an intrinsic, and still unknown, threshold required to initiate change. Using a series of paired burned/unburned catchments nested within the larger watershed, we examined temporal and spatial patterns of pre-and-post wildfire water hydrology using a rainfall runoff hydrological model compared with data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

A comprehensive guide to CAN IDS data and introduction of the ROAD dataset

Although ubiquitous in modern vehicles, Controller Area Networks (CANs) lack basic security properties and are easily exploitable. A rapidly growing field of CAN security research has emerged that seeks to detect intrusions or anomalies on CANs. Producing vehicular CAN data with a variety of intrusions is a difficult task for most researchers as it requires expensive assets and deep expertise. To illuminate this task, we introduce the first comprehensive guide to the existing open CAN intrusion detection system (IDS) datasets. We categorize attacks on CANs including fabrication (adding frames, e.g., flooding or targeting and ID), suspension (removing an ID’s frames), and masquerade attacks (spoofed frames sent in lieu of suspended ones). We provide a quality analysis of each dataset; an enumeration of each datasets’ attacks, benefits, and drawbacks; categorization as real vs. simulated CAN data and real vs. simulated attacks; whether the data is raw CAN data or signal-translated; number of vehicles/CANs; quantity in terms of time; and finally a suggested use case of each dataset. State-of-the-art public CAN IDS datasets are limited to real fabrication (simple message injection) attacks and simulated attacks often in synthetic data, lacking fidelity. In general, the physical effects of attacks on the vehicle are not verified in the available datasets. Only one dataset provides signal-translated data but is missing a corresponding “raw” binary version. This issue pigeon-holes CAN IDS research into testing on limited and often inappropriate data (usually with attacks that are too easily detectable to truly test the method). The scarcity of appropriate data has stymied comparability and reproducibility of results for researchers. As our primary contribution, we present the Real ORNL Automotive Dynamometer (ROAD) CAN IDS dataset, consisting of over 3.5 hours of one vehicle’s CAN data. ROAD contains ambient data recorded during a diverse set of activities, and attacks of increasing stealth with multiple variants and instances of real (i.e. non-simulated) fuzzing, fabrication, unique advanced attacks, and simulated masquerade attacks. To facilitate a benchmark for CAN IDS methods that require signal-translated inputs, we also provide the signal time series format for many of the CAN captures. Our contributions aim to facilitate appropriate benchmarking and needed comparability in the CAN IDS research field.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Blueprints for Training Information Bottlenecks for Collider Analyses

Dimensionality reduction is a crucial aspect of data analysis in high energy physics, even if accompanied by information loss. Several methods, including histogram- and kernel-based analyses, are only computationally feasible for low-dimensional data. Furthermore, simulation models used in HEP can often only be validated for low-dimensional data. We provide several blueprints for using machine learning to create low-dimensional data representations (continuous event variables and discrete classification labels) for use in signal discovery and parameter estimation tasks. We also describe how to design the learned representation to facilitate a) searches with unknown model parameters and b) validation of simulation models in data control regions.

43 PARTICLE ACCELERATORS↗
DOE OSTI2020

An improved method for direct incident solar radiation calculation from hourly solar insolation data in building energy simulation

Solar radiation considerably influences the energy consumption of buildings and the power production of building integrated photovoltaic (BIPV) systems. Hourly solar insolation (Wh/m 2 ), represented as the amount of solar irradiance collected on the ground during a 1-h period, is the most common solar radiation data available and widely used in weather files applied in building energy modeling programs (BEMPs). Because the solar beam and position vary over time, the use of hourly insolation data as the input might result in errors in the estimation of the direct incident solar radiation on a particular surface. In this study, methods used in BEMPs for direct incident solar radiation calculations are first analyzed, and an improved method adopting a new algorithm for estimating the solar irradiance is proposed. Furthermore, the algorithm assumes that the solar irradiance changes linearly within a 1-h period and can be estimated based on the solar irradiance at the half clock and slope. The collected direct normal solar irradiance data of 2016 from eight solar radiation stations in China were used to demonstrate the proposed method and evaluate its performance by comparing the results with those from three conventional methods used in BEMPs along with the ground truth measurements. In addition, in this study, factors affecting the accuracy of the calculation results are explored. The results of the estimated direct incident solar radiation show that the proposed method achieves the best accuracy, followed by the methods used in DOE-2, EnergyPlus, and DeST. The proposed method guarantees that the hourly direct solar insolation will remain the same and reflects the variation in the direct solar irradiance across a 1-h time frame. The proposed method can be adopted in BEMPs to improve the accuracy of the solar radiation calculation, thereby improving the accuracy of the simulated building performance and the BIPV production.

14 SOLAR ENERGY↗
DOE OSTI2021

Measurements of the time-dependent cosmic-ray Sun shadow with seven years of IceCube data: Comparison with the Solar cycle and magnetic field models

Observations of the time-dependent cosmic-ray Sun shadow have been proven as a valuable diagnostic for the assessment of solar magnetic field models. Here, seven years of IceCube data are compared to solar activity and solar magnetic field models. A quantitative comparison of solar magnetic field models with IceCube data on the event rate level is performed for the first time. Additionally, a first energy-dependent analysis is presented and compared to recent predictions. We use seven years of IceCube data for the moon and the Sun and compare them to simulations on data rate level. The simulations are performed for the geometrical shadow hypothesis for the moon and the Sun and for a cosmic-ray propagation model governed by the solar magnetic field for the case of the Sun. We find that a linearly decreasing relationship between Sun shadow strength and solar activity is preferred over a constant relationship at the 6.4σ level. We test two commonly used models of the coronal magnetic field, both combined with a Parker spiral, by modeling cosmic-ray propagation in the solar magnetic field. Both models predict a weakening of the shadow in times of high solar activity as it is also visible in the data. We find tensions with the data on the order of 3σ for both models, assuming only statistical uncertainties. The magnetic field model CSSS fits the data slightly better than the PFSS model. This is generally consistent with what is found previously by the Tibet AS-γ Experiment; a deviation of the data from the two models is, however, not significant at this point. Regarding the energy dependence of the Sun shadow, we find indications that the shadowing effect increases with energy during times of high solar activity, in agreement with theoretical predictions.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

A Scientist-in-the-Loop Data Analytics Framework for Intelligent Simulation Model Tuning and Validation

This project developed a scientist-in-the-loop data analytics framework for intelligent simulation model tuning and validation, targeting the Weather Research and Forecasting (WRF) model and its solar energy variant, WRF-Solar-BNL. Domain experts, such as climate scientists, depend on large-scale numerical simulations for knowledge discovery and decision-making, yet the complexity of parameter tuning and the disconnect between automated optimization and domain expertise pose significant challenges. We extended an interactive visual analytics framework that enables domain experts to observe and intervene in the computational steering process by identifying disagreements between the simulation model, surrogate model, and the expert’s domain knowledge. Using Bayesian Optimization with Gaussian Process Regression as the surrogate model, our system allows users to probe parameter relationships, analyze correlation patterns, and adjust tuning parameters in real time. We developed use cases for solar irradiance forecasting through sustained collaboration with Brookhaven National Laboratory, resolving critical model configuration challenges and achieving meaningful reductions in prediction error. The project supported one PhD student, one MS student, and eight undergraduate students across three Data Science Capstone projects, resulting in one master’s thesis.

Dasgupta, Aritra [New Jersey Institute of Technolo↗
DOE OSTI2025

Demography, dynamics and data: building confidence for simulating changes in the world's forests

Vegetation demographic models (VDMs) are advanced tools for simulating forest responses to climate and land-use changes, and are essential for projecting carbon cycling and large-scale forest management strategies. Despite their increasing incorporation into Earth System Models, VDMs differ in their demographic assumptions, with no prior quantitative comparison of their performance. We benchmarked nine VDMs against observational data from boreal, temperate and tropical sites, assessing their accuracy in predicting tree growth, carbon turnover, biomass stocks and size distributions. Models were simulated under consistent climate conditions with postdisturbance recovery monitored for at least 420 yr. Postdisturbance carbon recovery trajectories showed significant variability while remaining within observational ranges. Initial regrowth rates varied substantially (0.03-0.60, 0.18-0.70 and 0.35-1.10 kgCm-2 yr-1 for boreal, temperate and tropical sites, respectively), influenced by each model's initial forest state. Models captured mature forest carbon content but showed compensating effects between overestimated growth and underestimated mortality rates. This first multi-model benchmarking identifies growth and mortality rates as critical calibration targets and highlights the need to refine postdisturbance establishment conditions for model development. We outline specific benchmarking variables needed to improve predictions of forest responses to environmental change.

demographic vegetation model benchmarking↗
DOE OSTI2020

An Empirical Study on the Use of the Rancor Microworld Simulator to Support Full-scope Data Collection

A lack of data has been identified as a major challenge in human reliability analysis (HRA). Accordingly, several institutes and researchers have tried to collect HRA data from different data sources such as actual historical measurements, expert judgements, or simulator studies. While the most recent studies predominantly focus on collecting data using full-scope simulators with actual operators, Idaho National Laboratory (INL) has begun to collect HRA data using a simplified simulator, i.e., the Rancor Microworld simulator, with student participants. Full-scope studies have been known to have several intrinsic challenges to securing enough quantity of the data due to many reasons like the high cost for performing experiments or requiring actual operators’ cooperation. The ultimate goal of INL’s effort aims to infer actual operators’ data collected from a full-scope simulator on the basis of microworld data with student subjects as well as collect additional data that could be missed in the full-scope research. As a first step to achieve this goal, this paper projects an experimental plan for investigating the differences in human performance between individuals in two groups: 1) an actual operator and 2) a student when using the Rancor Microworld simulator. A randomized factorial experiment design has been developed with two independent variables, i.e., type of scenario and type of subject. Six human performance measures, i.e., 1) time, 2) error, 3) workload, 4) situation awareness, 5) patterns of attention and 6) the number of manipulations were selected. A couple of scenarios and their procedures available to the Rancor Microworld simulator have been developed.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2024

Integrating Multi-Source Data for Bi-Level Traffic Simulator Calibration: A Literature Review and Highway Case Study

Traffic simulation serves as a powerful tool for pre-evaluating policies and technologies. In this context, simulation-based Dynamic traffic assignment (DTA) models are capable of capturing traffic dynamics. They are well-known as critical tools in controlling and predicting traffic situations. The reliability of simulation results heavily depends on the calibration process. Most studies in the literature formulate and calibrate simulators based on a single source of collected data or multiple data sets with the same spatiotemporal characteristics. However, in practice, traffic data is collected by various tools with usually different spatial and temporal resolutions. This study introduces a novel approach to taking into account diverse input data from a variety of sources. An iterative bi-level solution is proposed. to equally treat traffic flow and speed data. The upper level solves flow calibration with the exact solution method, and the lower level calibrates the speed with the simultaneous perturbation stochastic approximation (SPSA) algorithm. Subsequently, the effectiveness of the proposed model is investigated using data from a six-mile section of Nashville's I-24 highway in Tennessee. The results demonstrate that our proposed model creates an effective feedback loop between the optimizer and the simulator for calibrating flow and speed to reduce the error between simulated and real data.

42 ENGINEERING↗
DOE OSTI2022

Stochastic simulation of occupant-driven energy use in a bottom-up residential building stock model

The residential buildings sector is one of the largest electricity consumers worldwide and contributes disproportionally to peak electricity demand in many regions. Strongly driven by occupant activities, household energy consumption is stochastic and heterogeneous in nature. However, most residential energy models applied by industry use homogeneous, deterministic activity schedules, which work well for predictions of annual energy consumption, but can result in unrealistic hourly or sub-hourly electric load profiles, with exaggerated or muted peaks. The increasing proportion of variable renewable energy generators means that representing the heterogeneity and stochasticity of occupant behavior is now crucial for reliable planning at both bulk-power and distribution-system scales. This work presents a novel and open-source occupancy simulation approach that can simulate a diverse set of individual occupant and household event schedules for all major electricity, fuel, and hot water end uses. To accomplish this, we evaluated three alternative occupant activity simulation approaches before selecting a hybrid combining time-inhomogeneous Markov chains and probability-sampling of event durations and magnitudes. Further, we integrated the stochastic occupancy simulation with an open-source bottom-up physics-simulation building stock model and published a set of 550,000 diverse household end-use activity schedules representing a national housing stock. The simulator was verified against time-use survey data, and simulation results were validated against measured end-use electricity data for accuracy and reliability. While we use data for the United States, our application demonstrates how similar approaches could be applied using the time-use survey data collected in many countries around the world.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗