Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Validation Studies”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

First-In-Human Validation of CT-Based Proton Range Prediction Using Prompt Gamma Imaging in Prostate Cancer Treatments

Uncertainty in computed tomography (CT)-based range prediction substantially impairs the accuracy of proton therapy. Direct determination of the stopping-power ratio (SPR) from dual-energy CT (DECT) has been proposed (DirectSPR), and initial validation studies in phantoms and biological tissues have proven a high accuracy. However, a thorough validation of range prediction in patients has not yet been achieved by any means. Here, we present the first systematic validation of CT-based proton range prediction in patients using prompt gamma imaging (PGI).

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Experimental study of adaptive pointing and tracking for large flexible space structures

This paper describes an experimental study of adaptive pointing and tracking control for flexible spacecraft conducted on a complex ground experiment facility. The algorithm used in this study is based on a multivariable direct model reference adaptive control law. Several experimental validation studies were performed earlier using this algorithm for vibration damping and robust regulation, with excellent results. The current work extends previous studies by addressing the pointing and tracking problem. As is consistent with an adaptive control framework, the plant is assumed to be poorly known to the extent that only system level knowledge of its dynamics is available. Explicit bounds on the steady-state pointing error are derived as functions of the adaptive controller design parameters. It is shown that good tracking performance can be achieved in an experimental setting by adjusting adaptive controller design weightings according to the guidelines indicated by the analytical expressions for the error.

Boussalis, D.↗

Benchmark Shock Tube Experiments for Radiative Heating Relevant to Earth Re-Entry

Detailed spectrally and spatially resolved radiance has been measured in the Electric Arc Shock Tube (EAST) facility for conditions relevant to high speed entry into a variety of atmospheres, including Earth, Venus, Titan, Mars and the Outer Planets. The tests that measured radiation relevant for Earth re-entry are the focus of this work and are taken from campaigns 47, 50, 52 and 57. These tests covered conditions from 8 km/s to 15.5 km/s at initial pressures ranging from 0.05 Torr to 1 Torr, of which shots at 0.1 and 0.2 Torr are analyzed in this paper. These conditions cover a range of points of interest for potential fight missions, including return from Low Earth Orbit, the Moon and Mars. The large volume of testing available from EAST is useful for statistical analysis of radiation data, but is problematic for identifying representative experiments for performing detailed analysis. Therefore, the intent of this paper is to select a subset of benchmark test data that can be considered for further detailed study. These benchmark shots are intended to provide more accessible data sets for future code validation studies and facility-to-facility comparisons. The shots that have been selected as benchmark data are the ones in closest agreement to a line of best fit through all of the EAST results, whilst also showing the best experimental characteristics, such as test time and convergence to equilibrium. The EAST data are presented in different formats for analysis. These data include the spectral radiance at equilibrium, the spatial dependence of radiance over defined wavelength ranges and the mean non-equilibrium spectral radiance (so-called 'spectral non-equilibrium metric'). All the information needed to simulate each experimental trace, including free-stream conditions, shock time of arrival (i.e. x-t) relation, and the spectral and spatial resolution functions, are provided.

Shock Tube↗

Lake Charles CCS Project (Final Technical Report, Phase 2)

In late September 2014 development of the Lake Charles Clean Energy (LCCE) Plant was abandoned resulting in termination of Lake Charles Carbon Capture and Sequestration (CCS) Project which was a subset the LCCE Plant. As a result, the project was only funded through Phase 2A (Design) and did not enter Phase 2B (Construction) or Phase 2C (Operations). This report was prepared relying on information prepared and provided by engineering companies which were engaged by Leucadia Energy, LLC to prepare or review Front End Engineering and Design (FEED) for the Lake Charles Clean Energy Project, which includes the Carbon Capture and Sequestration (CCS) Project in Lake Charles, Louisiana. The Lake Charles Carbon Capture and Sequestration (CCS) Project was to be a large-scale industrial CCS project intended to demonstrate advanced technologies that capture and sequester carbon dioxide (CO 2 ) emissions from industrial sources into underground formations. The Scope of work was divided into two discrete sections; 1) Capture and Compression prepared by the Recipient Leucadia Energy, LLC, and 2) Transport and Sequestration prepared by sub-Recipient Denbury Onshore, LLC. Capture and Compression-The Lake Charles CCS Project Final Technical Report describes the systems and equipment that would be necessary to capture CO 2 generated in a large industrial gasification process and sequester the CO 2 into underground formations. The purpose of each system is defined along with a description of its equipment and operation. Criteria for selection of major equipment are provided and ancillary utilities necessary for safe and reliable operation in compliance with environmental regulations are described. Construction considerations are described including a general arrangement of the CCS process units within the overall gasification project. A cost estimate is provided, delineated by system area with cost breakdown showing equipment, piping and materials, construction labor, engineering, and other costs. The CCS Project Final Technical Report is based on a Front End Engineering and Design (FEED) study prepared by SK E&C, completed in [June] 2014. Subsequently, Fluor Enterprises completed a FEED validation study in mid-September 2014. The design analyses indicated that the FEED package was sufficient and as expected. However, Fluor considered the construction risk based on a stick-build approach to be unacceptable, but construction risk would be substantially mitigated through utilization of modular construction where site labor and schedule uncertainty is minimized. Fluor’s estimate of the overall EPC project cost utilizing the revised construction plan was comparable to SKE&C’s value after reflecting Fluor’s assessment of project scope and risk characteristic. Development was halted upon conclusion of Phase 2A FEED and the project was not constructed.Transport and Sequestration – The overall objective of the pipeline project was to construct a pipeline to transport captured CO 2 from the Lake Charles Clean Energy project to the existing Denbury Green Line and then to the Hastings Field in Southeast Texas to demonstrate effective geologic sequestration of captured CO 2 through commercial EOR operations. The overall objective of the MVA portion of the project was to demonstrate effective geologic sequestration of captured CO 2 through commercial Enhanced Oil Recovery (EOR) operations in order to evaluate costs, operational processes and technical performance. The DOE target for the project was to capture and implement a research MVA program to demonstrate the sequestration through EOR of approximately one million tons of CO 2 per year as an integral component of commercial operations.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Validation of RU-WRF, the Custom Atmospheric Mesoscale Model of the Rutgers Center for Ocean Observing Leadership

The Rutgers University Center for Ocean Observing Leadership (RU-COOL) contracted the National Renewable Energy Laboratory (NREL) to evaluate RU-COOL's atmospheric observation and modeling capabilities for characterizing the New Jersey offshore wind resource. The observational network used by RU-COOL consists of mostly public but some private coastal and offshore buoy-based stations. The core wind resource modeling capability of RU-COOL is a custom setup of the Weather Research and Forecasting (WRF) mesoscale model, referred to in this report as RU-WRF. The most unique feature of RU-WRF and not found in other WRF model setups is the use of custom sea surface temperature (SST) product generated by RU-COOL. This custom product was designed to better capture the unique coastal upwelling and strong storm mixing in the Mid-Atlantic Bight, which other typical SST products are not designed to capture. Funding for the development, maintenance, and use of RU-WRF by RU-COOL is provided by the New Jersey Board of Public Utilities, who also funded the validation work presented in this report. In this validation study, NREL was specifically tasked to: 1) Assess the observational network used by RU-COOL to validate RU-WRF and make recommendations for improvement, 2) Assess methods used by RU-COOL to validate RU-WRF and make recommendations for improvement, 3) Examine the inputs to and setup within RU-WRF, compare against available NREL data sets, and make recommendations for improvement.

17 WIND ENERGY↗

Bias Characterization, Vertical Interpolation, and Horizontal Interpolation for Distributed Wind Siting Using Mesoscale Wind Resource Estimates

Much like their counterparts in utility-scale wind energy, developers of industrial, small-scale and distributed wind turbine deployments need to understand and accurately characterize the wind resource to properly assess the power generation and financial ramifications during siting and planning. National Renewable Energy Laboratory’s WIND (Wind Integration National Dataset) Toolkit (WTK) provides a best-in-class wind resource dataset generated using the Weather Research and Forecasting (WRF) model. This dataset includes parameters such as the wind speed, wind direction, and temperature at various heights, plus atmospheric stability near the surface. This data is available at 2-km spatial resolution and five-minute temporal resolution across 7 years, from 2007 to 2013 through a publicly accessible API interface. The Tools Assessing Performance (TAP) project seeks to extend this dataset to allow long term resource estimates and leverage it to better equip distributed wind equipment manufacturers, owner-operators, and installation professionals with better tools for practical siting applications. In this report, we present the results from our investigation within the TAP project focused on characterization of bias in WTK-based wind speed estimates and evaluation of vertical and horizontal interpolation techniques. We discuss the tradeoffs between different techniques and their combinations, as well as describe the lower bounds we determine for the studied validation errors. While the specific estimates we present are specific to WTK and the validation dataset we have chosen for this investigation (NREL's Wind Resource Meteorological Database), the overall analysis and the studied techniques are general enough to be applied to a broader set of wind datasets, both simulation-based and observational.

17 WIND ENERGY↗

Bayesian model aggregation for ensemble-based estimates of protein pKa values

This paper investigates an ensemble-based technique called Bayesian Model Averaging (BMA) to improve the performance of protein amino acid p$K_a$ predictions. Structure-based p$K_a$ calculations play an important role in the mechanistic interpretation of protein structure and are also used to determine a wide range of protein properties. A diverse set of methods currently exist for p$K_a$ prediction, ranging from empirical statistical models to {\it ab initio} quantum mechanical approaches. However, each of these methods are based on a set of assumptions that have inherent bias and sensitivities that can effect a model's accuracy and generalizability for p$K_a$ prediction in complicated biomolecular systems. We use BMA to combine eleven diverse prediction methods that each estimate pKa values of amino acids in staphylococcal nuclease. These methods are based on work conducted for the pKa Cooperative and the pKa measurements are based on experimental work conducted by the Garc{\'i}a-Moreno lab. Our study demonstrates that the aggregated estimate obtained from BMA outperforms all individual prediction methods in our cross-validation study with improvements from 40-70\% over other method classes. This work illustrates a new possible mechanism for improving the accuracy of p$K_a$ prediction and lays the foundation for future work on aggregate models that balance computational cost with prediction accuracy.

electrostatics↗

A Corrected Score Function Framework for Modelling Circadian Gene Expression

Many biological processes display oscillatory behaviour based on an approximately 24 h internal timing system specific to each individual. One process of particular interest is gene expression, for which several circadian transcriptomic studies have identified associations between gene expression during a 24 h period and an individual's health. A challenge with analysing data from these studies is that each individual's internal timing system is offset relative to the 24 h day-night cycle, where day–night cycle time is recorded for each collected sample. Laboratory procedures can accurately determine each individual's offset and determine the internal time of sample collection. However, these laboratory procedures are labour-intensive and expensive. Here, in this paper, we propose a corrected score function framework to obtain a regression model of gene expression given internal time when the offset of each individual is too burdensome to determine. A feature of this framework is that it does not require the probability distribution generating offsets to be symmetric with a mean of zero. Simulation studies validate the use of this corrected score function framework for cosinor regression, which is prevalent in circadian transcriptomic studies. Illustrations with data from three circadian transcriptomic studies further demonstrate that the proposed framework consistently mitigates bias relative to using a score function that does not account for this offset.

59 BASIC BIOLOGICAL SCIENCES↗

Application of queueing models to multiprogrammed computer systems operating in a time-critical environment

A model of a central processor (CPU) which services background applications in the presence of time critical activity is presented. The CPU is viewed as an M/M/1 queueing system subject to periodic interrupts by deterministic, time critical process. The Laplace transform of the distribution of service times for the background applications is developed. The use of state of the art queueing models for studying the background processing capability of time critical computer systems is discussed and the results of a model validation study which support this application of queueing models are presented.

Eckhardt, D. E., Jr.↗

WEC-Sim Array Development and Experimental Comparison Study: Preprint

Wave energy is still considered to be an emerging industry, and one significant contribution that researchers are making is to find solutions that reduce costs. The National Renewable Energy Laboratory and Sandia National Laboratories have contributed to this by creating WEC-Sim, an opensource modeling toolbox, to assist with early design decisions related to the design of wave energy converters (WECs). Previously, studies involving WEC-Sim have focused on single WEC modeling. In this paper, we will conduct a validation study to investigate the accuracy and ability of WEC-Sim to model arrays of WECs. The results from the WEC-Sim array simulations are compared to those from an existing experimental study. In addition, the array model is used to investigate the interaction between the WECs in the array and the influence of array spacing on the WECs' hydrodynamic performance.

16 TIDAL AND WAVE POWER↗

GPM DPR Retrievals: Algorithm, Evaluation, and Validation

The primary goal of the Dual-frequency Precipitation Radar (DPR) aboard the Global Precipitation Measurement (GPM) core satellite is to infer precipitationrate and raindrop/particle size distributions (DSD/PSD). The focus of this paper is threefold: 1)description of the DPR retrieval algorithm that uses an adjustable relationship between rainrate (R) and the mass-weighted diameter (Dm) or an R-Dm relationship in solving for R and Dmsimultaneously; 2) evaluation of the DPR algorithm based on the physical simulationsthat employ measured DSD/PSD to understand the mechanism and errorcharacteristics of the retrieval method; 3) review of ground validation studies for theDPR product as well as analysis of the strengths and weaknesses of the ground radarand rain gauge/disdrometer validations. Overall, the DPR Version-6 algorithmprovides reasonably accurate estimates of R and Dm in rain. Non-uniformity in therain profile, however, tends to degrade the accuracy of the R and Dm estimates tosome extent as the range-independent assumption of the adjustable parameter () ofthe R-Dm relation is not able to fully account for natural variation of DSD in the verticalprofile. Underestimation of the DPR snow rate is found when compared with theindependent dual-frequency ratio (DFR) technique. This is possibly the result of theconstraint associated with the path integral attenuation (PIA)/differential PIA (dPIA)used in the DPR algorithm to find the best  and range-independent  assumption. Arange-variable  model, proposed in the DPR Version-7 algorithm, is expected toimprove rain and snow retrieval.

Liang Liao↗

Feature extraction for structural dynamics model validation

This study focuses on defining and comparing response features that can be used for structural dynamics model validation studies. Features extracted from dynamic responses obtained analytically or experimentally, such as basic signal statistics, frequency spectra, and estimated time-series models, can be used to compare characteristics of structural system dynamics. By comparing those response features extracted from experimental data and numerical outputs, validation and uncertainty quantification of numerical model containing uncertain parameters can be realized. In this study, the applicability of some response features to model validation is first discussed using measured data from a simple test-bed structure and the associated numerical simulations of these experiments. issues that must be considered were sensitivity, dimensionality, type of response, and presence or absence of measurement noise in the response. Furthermore, we illustrate a comparison method of multivariate feature vectors for statistical model validation. Results show that the outlier detection technique using the Mahalanobis distance metric can be used as an effective and quantifiable technique for selecting appropriate model parameters. However, in this process, one must not only consider the sensitivity of the features being used, but also correlation of the parameters being compared.

42 ENGINEERING↗

Comparison of C5 and C6 Aqua-MODIS Dark Target Aerosol Validation

We compare C5 and C6 validation to compare the C6 10 km aerosol product against the well validated and trusted aerosol product on global and regional scales. Only the 10 km aerosol product is evaluated in this study, validation of the new C6 3 km aerosol product still needs to be performed. Not all of the time series has processed yet for C5 or C6, and the years processed for the 2 products is not exactly the same (this work is preliminary!). To reduce the impact of outlier observations, MODIS is spatially averaged within 27.5 km of the AERONET site, and AERONET is temporatally averaged within 30 minutes of the MODIS overpass time. Only high quality (QA = 3 over land, QA greater than 0 over ocean) pixels are included in the mean.

MODIS↗

Characterizing diurnal and seasonal cycles in monsoon systems from TRMM and CEOP observations

The CEOP Inter-Monsoon Study (CIMS) is one of the two main science drivers of CEOP that aims to (a) provide better understanding of fundamental physical processes in monsoon regions around the world, and (b) demonstrate the synergy and utility of CEOP data in providing a pathway for model physics evaluation and improvement. As the data collection phase for EOP-3 and EOP-4 is being completed, two full annual cycles (2003-2004) of research-quality data sets from satellites, reference sites, and model output location time series (MOLTS) have been processed and made available for data analyses and model validation studies. This article presents preliminary results of a CIMS study aimed at the characterization and intercomparison of all major monsoon systems. The CEOP reference site data proved its value in such exercises by being a powerful tool to cross-validate the TRMM data, and to intercompare with multi-model results in ongoing work. We use 6 years (1998-2003) of pentad CEOP/TRMM data with 2deg x 2.5deg latitude-longitude grid, over the domain of interests to define the monsoon climatological diurnal and annual cycles for the East Asian Monsoon (EAM), the South Asian Monsoon (SAM), the West Africa Monsoon (WAM), the North America/Mexican Monsoon (NAM), the South American Summer Monsoon (SASM) and the Australian Monsoon (AUM). As noted, the TRMM data used in the study were cross-validated using CEOP reference site data, where applicable. Results show that the observed diurnal cycle of rain peaked around late afternoon over monsoon land, and early morning over the oceans. The diurnal cycles in models tend to peak 2-3 hours earlier than observed. The seasonal cycles of the EAM and SAM show the strongest continentality, i.e, strong control by continental processes away from the ITCZ. The WAM, and the AUM shows the less continentality, i.e, strong control by the oceanic ITCZ.

Lau, William K. M.↗

Characterizing Diurnal and Seasonal Cycles in Monsoon Systems from TRMM and CEOP Observations

The CEOP Inter-Monsoon Study (CIMS) is one of the two main science drivers of CEOP that aims to (a) provide better understanding of fundamental physical processes in monsoon regions around the world, and (b) demonstrate the synergy and utility of CEOP data in providing a pathway for model physics evaluation and improvement. As the data collection phase for EOP-3 and EOP-4 is being completed, two full annual cycles (2003-2004) of research-quality data sets from satellites, reference sites, and model output location time series (MOLTS) have been processed and made available for data analyses and model validation studies. This article presents preliminary results of a CIMS study aimed at the characterization and intercomparison of all major monsoon systems. The CEOP reference site data proved its value in such exercises by being a powerful tool to cross-validate the TRMM data, and to intercompare with multi-model results in ongoing work. We use 6 years (1998-2003) of pentad CEOP/TRMM data with 2 deg x 2.5 deg. latitude-longitude grid, over the domain of interests to define the monsoon climatological diurnal and annual cycles for the East Asian Monsoon (EAM), the South Asian Monsoon (SAM), the West Africa Monsoon (WAM), the North America/Mexican Monsoon (NAM), the South American Summer Monsoon (SASM) and the Australian Monsoon (AUM). As noted, the TRMM data used in the study were cross-validated using CEOP reference site data, where applicable. Results show that the observed diurnal cycle of rain peaked around late afternoon over monsoon land, and early morning over the oceans. The diurnal cycles in models tend to peak 2-3 hours earlier than observed. The seasonal cycles of the EAM and SAM show the strongest continentality, i.e, strong control by continental processes away from the ITCZ. The WAM, and the AUM shows the less continentality, i.e, strong control by the oceanic ITCZ.

Lau, William K. M.↗

Anion exchange membrane test protocol validation

This study presents the validation of protocols for measuring ion exchange capacity (IEC) and alkaline stability of anion exchange membranes (AEMs) for low-temperature water electrolysis. While protocols are often tested within individual laboratories, their results across multiple laboratories with varying equipment, environmental conditions, and personnel qualification remain unverified. The validation involved Los Alamos National Laboratory (LANL), National Renewable Energy Laboratory (NREL), and University of Oregon (UO) using the same commercially available AEM to assess reproducibility and reliability of the protocols under diverse conditions. For the IEC protocol, results across laboratories were consistent within ±10% of the NMR-determined reference value. The alkaline stability protocol could pose greater challenges due to factors such as variations in sample collection timing, preservation methods, and analytical techniques, but consistent test results for percentage IEC loss were demonstrated across institutions. These results highlight the reliability and applicability of the protocols, emphasizing the importance of validation to ensure consistency in diverse research environments.

08 HYDROGEN↗

Demonstration of RELAP5-3D for transient analysis of a dual coolant lead lithium fusion blanket concept

Our research aims to build a multiphysics framework for transient analysis of the Dual- Coolant Lead-Lithium (DCLL) blanket design of the proposed Fusion Nuclear Science Facility (FNSF) for all Onticipated Operational Occurrences (AOOs) using Reduced Order Models (ROMs). This paper presents an assessment of using RELAP5-3D for transient thermal-hydraulic blanket analysis of the DCLL design. Preliminary validation studies for the RELAP5-3D properties were conducted using a representative vertical flow loop model and a comparison study using experimental data from the thermal convection corrosion loops at ORNL. These studies inspected the thermal hydraulic response of Lead-Lithium Eutectic (PbLi) systems within the RELAP5-3D code; mainly pressure drop and heat transfer, as compared to analytical calculations and experimental data. The Magnetohydrodynamic (MHD) pressure drop effect for liquid metal under the effects of a uniform magnetic field was implemented into our models using an equivalent forms loss coefficient based on the phasic momentum equations. We verified our implementation of MHD pressure drop within RELAP5-3D using a systematic approach consisting of two studies. Models were developed to perform comparison studies based on experimental data from the Argonne Liquid metal EXperiment (ALEX) facility and the Magnetohydrodynamic PbLi Experiment (MaPLE) facility. Using the developed validation basis, we built a simplified DCLL channel model within RELAP5-3D, inspected MHD pressure drop and performed transient temperature analysis. The DCLL channel model used radial heating data from the International Thermonuclear Experimental Reactor (ITER) which was normalized to the FNSF design. Here, a representative startup transient was performed using a relative power curve from the initial ramp up of a long-term power pulse of the Tore Supra reactor. This study demonstrated that RELAP5-3D ROMs are capable of accurate transient analysis of the DCLL blanket. We have since utilized MCNP to develop heating profiles based on the FNSF design and are working toward implementing them into our DCLL model.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Application of MP-PIC on Dual Interconnected Chemical Looping Cold Flow System: Validation Process with Hydrodynamic Experiments

Chemical looping with oxygen uncoupling (CLOU) is a promising carbon capture technologies, that utilizes a dual fluidized bed interconnected by loopseals to selectively separate oxygen from ambient air. This study validated Barracuda-VR® hydrodynamic simulations of dual circulating fluidized bed. The experiments were run on a scaled-down cold-flow unit of a 100 kW dual reactor to find the quantities of interest: circulation rate, bed mass location distribution, and pressure profile. The numerical parameters of time step and grid resolution were studied to find the numeric uncertainty for the quantities of interest. The scenario parameters of flowrates, particle densities, and particle voidage were studied. The uncertainty from the model parameters of tangent-to-wall, drag multiplier, and stress model were studied. Simulation and experimental results matched over some of the parameters studied. These can be used to scale the system back to the 100 kW dual reactor and to a larger system.

Hamilton, Matthew A↗