Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,675 records · Page 93

Evaluation of “Autotune” calibration against manual calibration of building energy models

Our paper demonstrates the application of Autotune, a methodology aimed at automatically producing calibrated building energy models using measured data, in two case studies. In the first case, a building model is de-tuned by deliberately injecting faults into more than 60 parameters. This model was then calibrated using Autotune and its accuracy with respect to the original model was evaluated in terms of the industry-standard normalized mean bias error and coefficient of variation of root mean squared error metrics set forth in ASHRAE Guideline 14. In addition to whole-building energy consumption, outputs including lighting, plug load profiles, HVAC energy consumption, zone temperatures, and other variables were analyzed. In the second case, Autotune calibration is compared directly to experts’ manual calibration of an emulated-occupancy, full-size residential building with comparable calibration results in much less time. Lastly, our paper concludes with a discussion of the key strengths and weaknesses of auto-calibration approaches.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Degradation Mechanisms and Lifetime Prediction for Lithium-Ion Batteries -- A Control Perspective: Preprint

Predictive models of Li-ion battery lifetime must consider a multiplicity of electrochemical, thermal, and mechanical degradation modes experienced by batteries in application environments. To complicate matters, Li-ion batteries can experience different degradation trajectories that depend on storage and cycling history of the application environment. Rates of degradation are controlled by factors such as temperature history, electrochemical operating window, and charge/discharge rate. We present a generalized battery life prognostic model framework for battery systems design and control. The model framework consists of trial functions that are statistically regressed to Li-ion cell life datasets wherein the cells have been aged under different levels of stress. Degradation mechanisms and rate laws dependent on temperature, storage, and cycling condition are regressed to the data, with multiple model hypotheses evaluated and the best model down-selected based on statistics. The resulting life prognostic model, implemented in state variable form, is extensible to arbitrary real-world scenarios. The model is applicable in real-time control algorithms to maximize battery life and performance. We discuss efforts to reduce lifetime prediction error and accommodate its inevitable impact in controller design.

25 ENERGY STORAGE↗

Accounting for herbaceous communities in process‐based models will advance our understanding of “grassy” ecosystems

Abstract Grassland and other herbaceous communities cover significant portions of Earth's terrestrial surface and provide many critical services, such as carbon sequestration, wildlife habitat, and food production. Forecasts of global change impacts on these services will require predictive tools, such as process‐based dynamic vegetation models. Yet, model representation of herbaceous communities and ecosystems lags substantially behind that of tree communities and forests. The limited representation of herbaceous communities within models arises from two important knowledge gaps: first, our empirical understanding of the principles governing herbaceous vegetation dynamics is either incomplete or does not provide mechanistic information necessary to drive herbaceous community processes with models; second, current model structure and parameterization of grass and other herbaceous plant functional types limits the ability of models to predict outcomes of competition and growth for herbaceous vegetation. In this review, we provide direction for addressing these gaps by: (1) presenting a brief history of how vegetation dynamics have been developed and incorporated into earth system models, (2) reporting on a model simulation activity to evaluate current model capability to represent herbaceous vegetation dynamics and ecosystem function, and (3) detailing several ecological properties and phenomena that should be a focus for both empiricists and modelers to improve representation of herbaceous vegetation in models. Together, empiricists and modelers can improve representation of herbaceous ecosystem processes within models. In so doing, we will greatly enhance our ability to forecast future states of the earth system, which is of high importance given the rapid rate of environmental change on our planet.

59 BASIC BIOLOGICAL SCIENCES↗

Denoising Seismograms in the Time Domain Using a Deep Learning Model

Deep learning has emerged as a transformative tool for enhancing the extraction of reliable information from seismograms, addressing the increasing demand for precise and efficient seismic data analysis. We introduce an innovative encoder–decoder deep learning model, named WaveDenoiser, designed for noise reduction in the time domain, thereby eliminating the need for spectrogram computations that have been used for existing deep learning tools and significantly improving processing speed. Utilizing the benchmark dataset that is Stanford Earthquake Dataset, we developed three models of varying sizes: base, medium, and large. Notably, the large (referred to as WaveDenoiser) model demonstrated superior performance, achieving a median signal‐to‐noise ratio improvement of 8.8 dB on in‐distribution unseen data (in the same geographic region) and 7.7 dB on out‐distribution unseen data (in a new geographic region), outpacing both the base and medium models. Further evaluation of the WaveDenoiser model revealed a reduction in median arrival‐time errors by 0.02 s for P waves and 0.01 s for S waves when processing waveforms prior to phase picking using PhaseNet on in‐distribution unseen data. When tested on out‐distribution unseen data, the model also effectively reduced the P‐wave median arrival‐time error by 0.02 and 0.01 s in median arrival‐time error for S waves. Importantly, the application of WaveDenoiser resulted in a significant reduction of phase picking outliers by 1.1% to 3.6% for both P and S waves. In addition, we achieved over five times acceleration in processing speed compared with the seisBench implementation of DeepDenoiser. Our findings underscore the potential of WaveDenoiser as a powerful tool for improving seismic data analysis and processing efficiency.

P-waves↗

Final Report on the Development of an Improved Cloud Microphysical Product for Model and Remote Sensing Evaluation using RACORO Observations

We proposed to analyze data collected during the Routine Aerial Facilities (AAF) Clouds with Low Optical Water Depths (CLOWD) Optical Radiative Observations (RACORO) in order to develop an integrated product of cloud microphysical properties (number concentration of drops in different size bins, total liquid drop concentration integrated over all bin sizes, liquid water content LWC, extinction of liquid clouds bw, effective radius of water drops re, and radar reflectivity factor) that could be used to evaluate large-eddy simulations (LES), general circulation models (GCMs) and ground-based remote sensing retrievals, and to develop cloud parameterizations with the end goal of improving the modeling of cloud processes and properties and their impact on atmospheric radiation. We have completed the development of this microphysical database and have submitted it to ARM for consideration of its inclusion on the ARM database as a PI product. This report describes the development of this database, and also describes research that has been conducted on cloud-aerosol interactions using the data obtained during RACORO. A list of conference proceedings and publications is also included.

54 ENVIRONMENTAL SCIENCES↗

Final Report fir DE-SC0005507 (A1618): The Development of an Improved Cloud Microphysical Product for Model and Remote Sensing Evaluation using RACORO Observations

We proposed to analyze data collected during the Routine Aerial Facilities (AAF) Clouds with Low Optical Water Depths (CLOWD) Optical Radiative Observations (RACORO) in order to develop an integrated product of cloud microphysical properties (number concentration of drops in different size bins, total liquid drop concentration integrated over all bin sizes, liquid water content LWC, extinction of liquid clouds, effective radius of water drops, and radar reflectivity factor) that could be used to evaluate large-eddy simulations (LES), general circulation models (GCMs) and ground-based remote sensing retrievals, and to develop cloud parameterizations with the end goal of improving the modeling of cloud processes and properties and their impact on atmospheric radiation. We have completed the development of this microphysical database. We investigated the differences in the size distributions measured by the Cloud and Aerosol Spectrometer (CAS) and the Forward Scattering Probe (FSSP), between the one dimensional cloud imaging probe (1DC) and the two-dimensional cloud imaging probe (2DC), and between the bulk LWCs measured by the Gerber probe against those derived from the size resolved probes.

58 GEOSCIENCES↗

Understanding Biomass Burning Aerosol via Integrated Analyses of Aerosol Mass Spectrometry Data from DOE Campaigns and ACRF Long Term Measurements

Biomass burning (BB) is one of the largest sources of aerosol particles in the atmosphere and a significant source of trace gases important to atmospheric chemistry. Organic aerosols from biomass burning sources (BBOA) are an important but poorly characterized component of the earth’s climate system. BBOA composition and life cycle processes are associated with enormous complexities and contribute significantly to model uncertainties. Hence it is important to improve the ability to simulate the concentration and properties (chemical, optical, and hygroscopic) of BBOA and the atmospheric aging processes that affect these properties. Here, we propose to analyze ambient data collected from the DOE Biomass Burning Observation Project (BBOP) field campaign and from a long term measurement site of the Atmospheric Radiation Measurement (ARM) program – the Southern Great Plains (SGP), where transported BB plumes and elevated BBOA episodes were frequently observed. This project is aimed at 1) gaining detailed, quantitative understanding of the chemical and physical properties of BBOA and their chemical changes during atmospheric aging via advanced analysis of aerosol measurement data acquired at the summit of Mt. Bachelor (MBO) during the BBOP campaign and through integration with concurrent measurements of trace gases, particle properties, and meteorological conditions performed at MBO and from the G-1 aircraft; 2) gaining better understanding of BBOA properties and its roles in radiative forcing via analysis of routine data from the ARM long-term measurement sites; and 3) integrating the results from 1) and 2) into a global database of aerosol mass spectrometry and collaborate with modelers on evaluating and improving numerical model performance as part of the ASR program.

54 ENVIRONMENTAL SCIENCES↗

Characterization of Extreme Wave Conditions for Wave Energy Converter Design and Project Risk Assessment

Best practices and international standards for determining n-year return period extreme wave (sea states) conditions allow wave energy converter designers and project developers the option to apply simple univariate or more complex bivariate extreme value analysis methods. The present study compares extreme sea state estimates derived from univariate and bivariate methods and investigates the performance of spectral wave models for predicting extreme sea states at buoy locations within several regional wave climates along the US East and West Coasts. Two common third-generation spectral wave models are evaluated, a WAVEWATCH III® model with a grid resolution of 4 arc-minutes (6–7 km), and a Simulating WAves Nearshore model, with a coastal resolution of 200–300 m. Both models are used to generate multi-year hindcasts, from which extreme sea state statistics used for wave conditions characterization can be derived and compared to those based on in-situ observations at National Data Buoy Center stations. Comparison of results using different univariate and bivariate methods from the same data source indicates reasonable agreement on average. Discrepancies are predominantly random. Large discrepancies are common and increase with return period. There is a systematic underbias for extreme significant wave heights derived from model hindcasts compared to those derived from buoy measurements. This underbias is dependent on model spatial resolution. However, simple linear corrections can effectively compensate for this bias. A similar approach is not possible for correcting model-derived environmental contours, but other methods, e.g., machine learning, should be explored.

16 TIDAL AND WAVE POWER↗

Virtual Refrigerant Charge Sensing Method for Next-Generation Refrigerant in Residential Heat Pumps

The charge level of refrigerant in heat pump systems significantly affects their operational performance. Virtual refrigerant charge (VRC) sensing technology has been well-established for traditional refrigerants (HFCs and HCFCs) for its low cost compared to physical sensors. However, other than traditional refrigerants, HFOs are increasingly used in next-generation heat pumps; whether these conventional VRC sensing methods remain applicable for heat pump systems utilizing next-generation refrigerants requires further investigation. To address these issues, this study develops a low-cost VRC sensing method for next-generation refrigerant heat pumps used in residential buildings. The developed algorithm is evaluated by using simulation models to evaluate the accuracy, considering an R454B heat pump with a nominal heating capacity of 51K Btu/hr (14.95 kW) as an example, and compared with those of the two reference VRC sensing algorithms. Though the developed VRC sensing algorithm and the two reference methods can accurately predict the charge level for the R454B heat pump system (with mean absolute percentage error for various cooling and heating conditions less than 7%), the developed VRC sensing algorithm uses fewer sensors and improves the overall accuracy for heating conditions by 7.1%, and the accuracy for undercharge cooling conditions 14.2%, compared with a mainstream algorithm. This technology will complement physical leakage detectors, and promote the adoption of next-generation heat pump systems, along with reducing wasted energy and maintenance costs.

Liang, Chenjiyu↗

Detailed geoid computations for GEOS-C altimeter experiment areas

The GEOS-C spacecraft is scheduled to carry onboard a radar altimeter for the purpose of measuring the geoid undulations in oceanic areas. An independently derived geoid map will provide a valuable complement to these experiments. A detailed gravimetric geoid is presented for the Atlantic and northeast Pacific Ocean areas based upon a combination of the Goddard Space Flight Center GEM-6 earth model and surface 1 deg x 1 deg gravity data. As part of this work a number of satellite derived gravity models were evaluated to establish the model which best represented the long wave length features of the geoid in the above mentioned area. Comparisons of the detailed geoid with the astrogeodetic data provided by the National Ocean Survey and dynamically derived tracking station heights indicate that the accuracy of this combined geoid is on the order of 2 meters or better where data was dense and 5 to 7 meters where data was less dense.

Marsh, J. G.↗

The effect of increased horizontal resolution on synoptic forecasts with the GISS model of the global atmosphere

The improved horizontal resolution global circulation model in question has a horizontal spacing of 2.5 deg latitude by 3 deg longitude for a resolution of about 250 km in midlatitude. This paper reports on experiments to determine the improvements in forecasting skill and in initial conditions that were made possible by the ultrafine resolution and ultrafine assimilation. The size of the improvement in skill score when the ultrafine model is used for forecasting and assimilation was so large that 60-hour forecasts with the ultrafine model had as good a skill score as the 48-hour forecasts with the fine model. Synoptic evaluations confirmed that ultrafine model forecasts are better than the fine model forecasts.

Quirk, W. J.↗

An assessment of DREAM, appendix E

The design realization, evaluation and modelling (DREAM) system is evaluated. A short history of the DREAM research project is given as well as the significant characteristics of DREAM as a development environment. The design notation which is the basis for the DREAM system is reviewed, and the development tools envisioned as part of DREAM are discussed. Insights into development environments and their production are presented and used to make suggestions for future work in the area of development environments.

Riddle, W. E.↗

Comment on two-equation models

Several turbulence models are studied and evaluated. All models are compared to each other and experimental values for flat plate boundary layer flow and channel flow. Among the models examined are: K-epsilon, k-omega, q-omega, and k-tau turbulence models. All results are presented in viewgraph format.

Lang, N.↗

The present status and future direction of algebraic Reynolds stress models: Comment on

A number of algebraic stress models are presented and evaluated. These models are then compared to each other as well as to experimental data for three different flow conditions. Finally, the limitations of the models are examined in the presence of curvature, rotation/swirl, gravitation/body forces, and streamwise corners. All results are presented in viewgraph format.

Demuren, A. O.↗

Comparison of Coupled Radiative Flow Solutions with Project Fire 2 Flight Data

A nonequilibrium, axisymmetric, Navier-Stokes flow solver with coupled radiation has been developed for use in the design or thermal protection systems for vehicles where radiation effects are important. The present method has been compared with an existing now and radiation solver and with the Project Fire 2 experimental data. Good agreement has been obtained over the entire Fire 2 trajectory with the experimentally determined values of the stagnation radiation intensity in the 0.2-6.2 eV range and with the total stagnation heating. The effects of a number of flow models are examined to determine which combination of physical models produces the best agreement with the experimental data. These models include radiation coupling, multitemperature thermal models, and finite rate chemistry. Finally, the computational efficiency of the present model is evaluated. The radiation properties model developed for this study is shown to offer significant computational savings compared to existing codes.

Olynick, David R.↗

Comparison of Coupled Radiative Navier-Stokes Flow Solutions with the Project Fire II Flight Data

A nonequilibrium, axisymmetric, Navier-Stokes flow solver with coupled radiation has been developed to use in the design of thermal protection systems for vehicles where radiation effects are important. The present method has been compared with an existing flow and radiation solver and with the Project Fire II experimental data. Very good agreement has been obtained over the entire Fire II trajectory with the experimentally determined values of the stagnation radiation intensity in the .2 to 6.2 eV range and with the total stagnation heating. The agreement was significantly better than previous numerical predictions. The effects of a number of flow models are examined to determine which combination of physical models produces the best agreement with the experimental data. These models include radiation coupling, multi-temperature thermal models, finite-rate chemistry, and a quasi-steady-state or Boltzmann assumption for the calculation of the excited electronic states. Finally, the computational efficiency of the present model is evaluated. The radiation properties model developed for this study is shown to offer significant computational savings compared to existing codes.

Olynick, David R.↗

Marin County Wildland Fires: Examining Fuel Load and Land Cover Change to Inform Fire Prevention and Suppression Decisions in Marin County, CA

Heightened occurrence of severe wildfires in the Western United States is increasing the need to better understand regions of high potential wildfire severity and develop methodologies for identifying the best locations for fuels reduction and active wildfire suppression, especially in populated regions such as Marin County, California. Marin County, located in the San Francisco Bay Area, has had significant development in the wildland-urban interface and periods of highly wildfire-prone conditions. The NASA DEVELOP team collaborated with Fire Foundry (a Marin-based fire service workforce development program) and the Marin County Fire Department to develop models to assist with fire management. Using data from Sentinel-2A, PlanetScope, ECOSTRESS, a county-wide LiDAR mapping effort, Landsat 7 Enhanced Thematic Mapper (ETM+), and Landsat 8 Operational Land Imager (OLI), our team developed a number of input data layers for three different models to evaluate wildfire severity. One model performed a suitability analysis with weights based on scientific literature; another model utilized a U-Net Convolutional Neural Network trained on previous fires in Marin and neighboring Sonoma County to predict the difference normalized burn severity; and the third inputted data layers into the FlamMap tool that outputs risk categories. We compared model outputs and performed a weighted overlay analysis to identify specific locations where a fireline could be constructed to interrupt the progress of an active fire. These tools will assist partners in preparing for and managing active wildfire situations.

Remote sensing↗