SEARCH · Engineering Papers

Results for “data validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59

All sources NASA NTRS DOE OSTI

DOE OSTI2024

The MUSIC Critical Benchmark and Nuclear Data

The Measurement of Uranium Subcritical and Critical (MUSIC) experiment was a series of measurements of critical and subcritical configurations of bare highly enriched uranium. The goal was to compare measurement methods, analysis techniques, and simulation methods across regimes of criticality and to provide high-quality validation of 235 U nuclear data. A benchmark evaluation of the two critical configurations of the MUSIC experiments will soon be published in the release of the International Criticality Safety Benchmark Evaluation Project Handbook. The recent execution of the experiment aids in proper quantification of model simplifications and all uncertainties associated with the experiment. Historical benchmark evaluations are heavily relied on for uranium nuclear data validation despite the fact that the same level of documentation and comparable uncertainty analysis may not be present. The MUSIC evaluation is less likely to include “unknown unknowns” that could impede accurately modeling the system. Presented are both highly detailed and very simplified models, which represent the experimental configurations accurately, aiding the users of the benchmark for nuclear data or transport code validation. The sensitivities of k eff to nuclear data and nuclear data–related uncertainties are very similar between this experiment and previous bare uranium sphere experiments. In addition, the nuclear data uncertainties to any nuclides other than 235 U are small. For all these reasons, the recently evaluated MUSIC benchmark critical configurations could prove very useful for 235 U nuclear data validation. Currently, major libraries have good agreement with the experimental results, within 200 pcm for all nuclear data libraries, and within one standard deviation of the experimental result for most. Suggested nuclear data adjustments based on MUSIC and Lady Godiva are also presented, with posterior improvements to both the agreement in k eff and the uncertainty associated with the nuclear data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2023

Status of HEU-Pb in the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Handbook

The Department of Energy invests tens of millions of dollars each year to develop the next generation of nuclear engineering modeling & simulation (M&S) tools. These tools are used to analyze advanced reactor designs and the safety of current nuclear operations. As computers become more powerful, we are able to enhance resolution in our calculations. This improved resolution is taking us to a point where the limitations of simulation capability are in the quality of data, including our ability to quantify the uncertainty and sensitivity of the data. In order to model systems of interest with increasing accuracy, the industry must improve key nuclear data measurements. Thus, M&S tools need evaluated and quality-assured experimental data for validation purposes. The International Criticality Safety Benchmark Evaluation Project (ICSBEP) compiles and evaluates experiment data in a handbook that can be used by criticality safety engineers and others to validate computer codes and cross-section libraries at nuclear facilities. Both critical and subcritical experiments are included in the handbook. Figure 1 organizes all the benchmark evaluations that have been performed by the isotope of interest, in this case Pb, and the average neutron energy the system. Compared to other isotopes of interest for nuclear applications, there are few benchmark evaluations for Pb systems. The lack of integral measurements to determine errors in Pb cross-section data has caused the latest nuclear cross-section libraries to over/underestimate k eff compared to experimental results. Therefore, this evaluation fills an important knowledge gap in benchmark evaluations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2022

Optimizing Error-Bounded Lossy Compression for Scientific Data With Diverse Constraints

Vast volumes of data are produced by today's scientific simulations and advanced instruments. These data cannot be stored and transferred efficiently because of limited I/O bandwidth, network speed, and storage capacity. Error-bounded lossy compression can be an effective method for addressing these issues: not only can it significantly reduce data size, but it can also control the data distortion based on user-defined error bounds. In practice, many scientific applications have specific requirements or constraints for lossy compression, in order to guarantee that the reconstructed data are valid for post hoc analysis. For example, some datasets contain irrelevant data that should be isolated in particular and users often have intuition regarding value ranges, geospatial regions, and other data subsets that are crucial for subsequent analysis. Existing state-of-the-art error-bounded lossy compressors, however, do not consider these constraints during compression, resulting in inferior compression ratios with respect to user's post hoc analysis, due to the fact that the data itself provides little or no value for post hoc analysis. In this work we address this issue by proposing an optimized framework that can preserve diverse constraints during the error-bounded lossy compression, e.g., cleaning the irrelevant data, efficiently preserving different precision for multiple value intervals, and allowing users to set diverse precision over both regular and irregular regions. We perform our evaluation on a supercomputer with up to 2,100 cores. Experiments with six real-world applications show that our proposed diverse constraints based error-bounded lossy compressor can obtain a higher visual quality or data fidelity on reconstructed data with the same or even higher compression ratios compared with the traditional state-of-the-art compressor SZ. Furthermore, our experiments also demonstrate very good scalability in compression performance compared with the I/O throughput of the parallel file system.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Benchmark evaluation of one dimensional array of HEU moderated and reflected by Lucite

The evaluation of two HEU-Lucite experiments is presented. The critical experiments were performed using the Planet Universal Critical Assembly Machine at Los Alamos National Laboratory in 2019. In these experiments, HEU foils were interleaved with Lucite in a column stack and were moderated and reflected from the square Lucite plates. The neutron data produced were used to approximate the multiplication of each measured configuration. The evaluation of the experiments using calculational techniques is presented in the paper. A Monte-Carlo computational model to be used with MCNP6 was developed for the determination of uncertainties and the effects of various uncertainties on the multiplication factor were studied. The evaluation of the benchmark was performed for comparison of calculation results with the experimental data and validation of calculation techniques in particular the newly available thermal scattering data for the Lucite material. The sensitivity studies include parametric variations of material composition and geometry. Experimental uncertainties were low, with the overall height of the HEU/Lucite stack being the largest contributor to the overall uncertainty in k{sub eff}. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

NASA NTRS1988

NDE detectability of fatigue-type cracks in high-strength alloys: NDI reliability assessments

This program was conducted to generate quantitative flaw detection capability data for the nondestructive evaluation (NDE) techniques typically practiced by aerospace contractors. Inconel 718 and Haynes 188 alloy test specimens containing fatigue flaws with a wide distribution of sizes were used to assess the flaw detection capabilities at a number of contractor and government facilities. During this program 85 inspection sequences were completed presenting a total of 20,994 fatigue cracks to 53 different inspectors. The inspection sequences completed included 78 liquid penetrant, 4 eddy current, and 3 ultrasonic evaluations. The results of the assessment inspections are presented and discussed. In generating the flaw detection capability data base, procedures for data collection, data analysis, and specimen care and maintenance were developed, demonstrated, and validated. The data collection procedures and methods that evolved during this program for the measurement of flaw detection capabilities and the effects of inspection variables on performance are discussed. The Inconel 718 and Haynes 188 test specimens that were used in conducting this program and the NDE assessment procedures that were demonstrated, provide NASA with the capability to accurately assess the flaw detection capabilities of specific inspection procedures being applied or proposed for use on current and future fracture control hardware program.

Christner, Brent K.↗

NASA NTRS1997

Radiative Transfer Modeling

Our research efforts addressed theoretical work in radiative transfer which focused the following five major items: (1) Development of three dimensional radiative transfer methods; (2) Improvement to and maintenance of radiative transfer codes; (3) Creating new data-sets to define absorption by atmos.gases; (4) Model tests and validations with data from field experiments; and (5) Model application to study climatic impact of, aerosol/clouds.

Source record↗

NASA NTRS2023

Research and Technology Challenges for Human Data Analysts in Future Safety Management Systems

Enabling new and novel concepts of operations for Advanced Air Mobility poses an important need to evolve current safety management systems (SMS) and is posited to be realized through advances in Machine Learning (ML) Data Sciences and Artificial Intelligence. The “In-time Aviation Safety Management System” (IASMS) concept of operations supports the need to evolve today’s SMS to become more tailorable, scalable, and interoperable in response to forecasted changes expected for the future airspace system. Key to IASMS is integration of proactive and predictive ML algorithms trained to provide “in time” detection and mitigation of hazards and emergent risks through new methods and novel data types. IASMS research and technology development includes human factors design considerations for these systems to include human-system teaming, innovations in human interfaces and management of complex digital data information, human-system interaction/model-based system engineering, and verification and validation for data assurance and trust.

Chad L Stephens↗

DOE OSTI2024

MEASURING CLAS12 D(E, E′Π±) CROSS SECTIONS FOR E4NU

Neutrino experiments need neutrino event generators such as GENIE to simulate neutrinonucleus (¿A) interactions in order to measure neutrino oscillations. We need eA data to validate GENIE. GENIE d(e, e') cross sections do not match data in the pion production region. Further analysis of this region can help constrain GENIE models. The goal of this project was to compare 4.244 GeV CLAS12 d(e, e'p±) cross sections to GENIE predictions. We analyzed data from the Fall 2019 run period of Run Group B (RG-B). We applied particle identification, fiducial, and vertex cuts on electron and charged pion candidates. We compared the measured data with events generated with GENIE and another generator called onepigen. We used onepigen to simulate single charged pion production and to calculate radiative corrections for the data. We submitted GENIE and onepigen events to the GEant4 Monte-Carlo (GEMC) simulation of CLAS12 and applied the same cuts we used on the data. We plotted cross sections as functions of W and binned the events in Q2, ¿pq, and Pp. We used 2D (Q2), 3D (Q2 with ¿pq or Pp), and 4D (Q2, ¿pq, and Pp) binning schemes. We found GENIE describes d(e, e'p±) cross sections better than expected. GENIE describes the data remarkably well in the 2D bins and some 3D and 4D bins. There are many discrepancies between GENIE and data in the other 3D and 4D bins. The results show that, relative to data, GENIE cross sections increase as Q2 increases, decrease as Pp increases, and fit best at low ¿pq. These results will help guide improvements to GENIE in order to reduce the systematic uncertainties in neutrino-oscillation experiments.

Fogler, Caleb [Old Dominion Univ., Norfolk, VA (Un↗

NASA NTRS1993

Satellite data for diagnostics and for validation of model simulations

Two issues in the treatment of tropical convection in general circulation models are examined. First, several studies have found significant gradients in clear sky longwave fluxes near large convective systems. Increased upper tropospheric moisture associated with deep convection may explain the reduction in the longwave emission. Similar local gradients are not apparent in measurements from the Earth Radiation Budget Experiment (ERBE), an important data set for model validation. Thus the average cloud forcing and greenhouse effect derived from models and observations may differ systematically over warm tropical oceans. A comparison of ERBE fluxes with radiative calculations using coincident balloon-sonde atmospheric profiles indicates negligible systematic bias in the observations. The effect of convection on the clear sky fluxes may be localized to the edges of individual cloud systems. Second, the balance between shortwave and cloud forcing and longwave forcing is a persistent feature of tropical cloud systems in ERBE data. This cancellation effect has been used to diagnose problems in GCM (General Circulation Model) cloud fields on seasonal time scales. The daily record of net cloud radiative forcing is analyzed to determine the smallest spatial and temporal scales for the balance. The results show cancellation on periods as short as three days for regions smaller than 2.5 by 2.5 deg. The analysis indicates that the balance is primarily a local phenomenon characteristic of tropical convection. This is consistent with findings that the small cloud radiative forcing is due primarily to thick tropical cirrus. These results represent a particularly stringent test of convective parameterizations in GCM's with interactive ocean surfaces.

Collins, W. D.↗

NASA NTRS2007

Flight Testing an Iced Business Jet for Flight Simulation Model Validation

A flight test of a business jet aircraft with various ice accretions was performed to obtain data to validate flight simulation models developed through wind tunnel tests. Three types of ice accretions were tested: pre-activation roughness, runback shapes that form downstream of the thermal wing ice protection system, and a wing ice protection system failure shape. The high fidelity flight simulation models of this business jet aircraft were validated using a software tool called "Overdrive." Through comparisons of flight-extracted aerodynamic forces and moments to simulation-predicted forces and moments, the simulation models were successfully validated. Only minor adjustments in the simulation database were required to obtain adequate match, signifying the process used to develop the simulation models was successful. The simulation models were implemented in the NASA Ice Contamination Effects Flight Training Device (ICEFTD) to enable company pilots to evaluate flight characteristics of the simulation models. By and large, the pilots confirmed good similarities in the flight characteristics when compared to the real airplane. However, pilots noted pitch up tendencies at stall with the flaps extended that were not representative of the airplane and identified some differences in pilot forces. The elevator hinge moment model and implementation of the control forces on the ICEFTD were identified as a driver in the pitch ups and control force issues, and will be an area for future work.

Ratvasky, Thomas P.↗

DOE OSTI2020

Overview of the OECD-NEA Working Party on International Nuclear Data Evaluation Cooperation (WPEC)

The OECD Nuclear Energy Agency (NEA) Working Party on International Nuclear Data Evaluation Cooperation (WPEC) was established in 1989 to facilitate collaboration in nuclear data activities. Over its thirty year history, different Subgroups have been created to address topics in nearly every aspect of nuclear data, including: experimental measurements, evaluation, validation, model development, quality assurance of databases and the development of software tools. WPEC has recently completed activities on fission yield evaluation, the general nuclear database structure (GNDS) to replace the ENDF-6 format, methods to provide feedback to evaluation, studies of specific capture cross sections, new methods in thermal scattering kernel evaluation and the Collaborative International Evaluated Library Organisation (CIELO) Pilot Project. Ongoing activities in GNDS application programming interface (API) development, methods for covariance evaluation and quality assurance in nuclear data validation using the International Criticality Safety Benchmark Evaluation Project (ICSBEP) database are complemented by the work of two Expert Groups that oversee the High-Priority Request List (HPRL) for Nuclear Data and the continuous development of the GNDS. New activities on the use of integral experiments for nuclear data validation and adjustment, as well as the use of the Shielding Integral Benchmark Archive and Database (SINBAD) for validation have begun and will be coordinated alongside future Subgroups. After three decades we will review the status of WPEC, how it integrates other collections and activities organised by the NEA and how it dovetails with the initiatives of the IAEA and other bodies to effectively coordinate international activities in nuclear data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2023

Modular machine learning-based elastoplasticity: Generalization in the context of limited data

The development of highly accurate constitutive models for materials that undergo path-dependent processes continues to be a complex challenge in computational solid mechanics. Challenges arise both in considering the appropriate model assumptions and from the viewpoint of data availability, verification, and validation. Recently, data-driven modeling approaches have been proposed that aim to establish stress-evolution laws that avoid user-chosen functional forms by relying on machine learning representations and algorithms. However, these approaches not only require a significant amount of data but also need data that probes the full stress space with a variety of complex loading paths. Furthermore, they rarely enforce all necessary thermodynamic principles as hard constraints. Hence, they are in particular not suitable for low-data or limited-data regimes, where the first arises from the cost of obtaining the data and the latter from the experimental limitations of obtaining labeled data, which is commonly the case in engineering applications. In this work, we discuss a hybrid framework that can work on a variable amount of data by relying on the modularity of the elastoplasticity formulation where each component of the model can be chosen to be either a classical phenomenological or a data-driven model depending on the amount of available information and the complexity of the response. The method is tested on synthetic uniaxial data coming from simulations as well as cyclic experimental data for structural materials. The discovered material models are found to not only interpolate well but also allow for accurate extrapolation in a thermodynamically consistent manner far outside the domain of the training data. This ability to extrapolate from limited data was the main reason for the early and continued success of phenomenological models and the main shortcoming in machine learning-enabled constitutive modeling approaches. Training aspects and details of the implementation of these models into Finite Element simulations are discussed and analyzed.

42 ENGINEERING↗

NASA NTRS1986

Determinants of individual and group performance

A broad exploration of individual and group/organizational factors that influence performance in demanding environments such as space and air transport was undertaken. Primary efforts were directed toward defining critical issues, developing new methodologies for the assessment of performance in such environments, and developing new measures of personality and attitudes as predictors of performance. Substantial clarification of relevant issues for research and validation was achieved. A reliable instrument to assess crewmembers' attitudes regarding crew coordination and flightdeck management was validated. Major efforts in data collection to validate concepts were initiated. The results suggest that substantial improvements can be made in the prediction of performance and in the selection of crewmembers for aviation and space.

Helmreich, Robert L.↗

NASA NTRS1987

Boundary layer simulator (BLIMPJ) improvement

Improvements were made to advance the current Boundary Layer Integral Matrix Procedure - Version J (BLIMPJ) containing previously modeled simplified calculation methods accounting for surface roughness, relaminarization, and thick boundary layer effects. These improvements have potential applications in the design of the future Orbit Transfer Vehicles (OTV) engines. The coded wall roughness module was validated successfully against measured data from the LeRC 60-15 degree half-angle conical nozzle. The relaminarization model was modified to include wall cooling and roughness based on a set of test data from the same nozzle. The model was compared against typical data sets for validation in different flow regimes. The thrust loss calculation for thick boundary layer effects was computerized where the iterations between TDK and BLIMPJ proceeded automatically until convergence was achieved. An example is given for a typical OTV nozzle with an area ratio 1293.

Praharaj, S. C.↗

NASA NTRS2007

Medium Spatial Resolution Satellite Characterization

This project provides characterization and calibration of aerial and satellite systems in support of quality acquisition and understanding of remote sensing data, and verifies and validates the associated data products with respect to ground and and atmospheric truth so that accurate value-added science can be performed. The project also provides assessment of new remote sensing technologies.

Stensaas, Greg↗

NASA NTRS2010

The Effect of Incident Light Polarization on Vegetation Bidirectional Reflectance Factor

The Laboratory-based Bidirectional Reflectance Factor (BRF) polarization study of vegetation is presented in this paper. The BRF was measured using a short-arc Xenon lamp/monochromator assembly producing an incoherent, tunable light source with a well-defined spectral bandpass at visible and near-infrared wavelengths of interest at 470 nm and 870 nm and coherent light source at 1.656 microns. All vegetation samples were measured using P and S linearly polarized incident light over a range of incident and scatter angles. By comparing these results, we quantitatively examine how the BRF of the samples depends on the polarization of the incident light. The differences are significant, depend strongly on the incident and scatter angles, and can be as high as 120% at 67 deg incident and 470nm. The global nature of Earth's processes requires consistent long-term calibration of all instruments involved in data retrieval. The BRF defines the reflection characteristics of Earth surface. It provides the reflectance of a target in a specific direction as a function of illumination and viewing geometry. The BRF is a function of wavelength and reflects the structural and optical properties of the surface. Various space and airborne radiometric and imaging remote sensing instruments are used in the remote sensing characterization of vegetation canopies and soils, oceans, or especially large pollution sources. The satellite data is validated through comparison with airborne, ground-based and laboratory-based data in an effort to fully understand the vegetation canopy reflectance, The Sun's light is assumed to be unpolarized at the top of the atmosphere; however it becomes polarized to some degree due to atmospheric effects by the time it reaches the vegetation canopy. Although there are numerous atmospheric correction models, laboratory data is needed for model verification and improvement.

Georgiev, Georgi T.↗

NASA NTRS2012

First Assessments of Predicted ICESat-2 Performance Using Aircraft Data

The Ice, Cloud, and land Elevation Satellite-2 (ICESat-2) is a next-generation laser altimeter designed to continue key observations of ice sheet elevation change, sea ice freeboard, vegetation canopy height, earth surface elevation, and sea surface height. Scheduled for launch in mid-2016, ICESat-2 will use a high repetition rate (10 kHz), small footprint (10 m nominal ground diameter) laser, and a single-photon-sensitive detection strategy (photon counting) to measure precise range to the earth's surface. Using green light (532 nm), the six beams of ICESat-2 will provide improved spatial coverage compared with the single beam of ICESat, while the differences in transmit energy among the beams provide a large dynamic range. The six beams are arranged into three pairs of beams which allow slopes to measured on an orbit-by-orbit basis. In order to evaluate models of predicted ICESat-2 performance and provide ICESat-2-like data for algorithm development, an airborne ICESat-2 simulator was developed and first flown in 2010. This simulator, the Multiple Altimeter Beam Experimental Lidar (MABEL) was most recently deployed to Iceland in April 2012 and collected approx 85 hours of science data over land ice, sea ice, and calibration targets. MABEL uses a similar photon-counting measurement strategy to what will be used on ICESat-2. MABEL collects data in 16 green channels and an additional 8 channels in the infrared aligned across the direction of flight. By using NASA's ER-2 aircraft flying at 20km altitude, MABEL flies as close to space as is practical, and collects data through approx 95% of the atmosphere. We present background on the MABEL instrument, and data from the April 2012 deployment to Iceland. Among the 13 MABEL flights, we collected data over the Greenland ice sheet interior and outlet glaciers in the southwest and western Greenland, sea ice data over the Nares Strait and Greenland Sea, and a number of small glaciers and ice caps in Iceland and Svalbard. Several of the flights were coincident in time and space with NASA's Operation IceBridge, which provides an independent data set for validation. MABEL also collected data along CryoSat track 10482 in north central Greenland approximately one month after CryoSat passed overhead.

Neumann, Thomas↗

NASA NTRS2016

Non-Invasive Tension Measurement Devices for Parachute Cordage

The need for lightweight and non-intrusive tension measurements has arisen alongside the development of high-fidelity computer models of textile and fluid dynamics. In order to validate these computer models, data must be gathered in the operational environment without altering the design, construction, or performance of the test article. Current measurement device designs rely on severing a cord and breaking the load path to introduce a load cell. These load cells are very reliable, but introduce an area of high stiffness in the load path, directly affecting the structural response, adding excessive weight, and possibly altering the dynamics of the parachute during a test. To capture the required data for analysis validation without affecting the response of the system, non-invasive measurement devices have been developed and tested by NASA. These tension measurement devices offer minimal impact to the mass, form, fit, and function of the test article, while providing reliable, axial tension measurements for parachute cordage.

Litteken, Douglas A.↗