Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Verification of data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61

Comprehensive Understanding for Vegetated Scene Radiance Relationships

Directional reflectance distributions spanning the entire existent hemisphere were measured in two field studies; one using a Mark III 3-band radiometer and one using the rapid scanning bidirectional field instrument called PARABOLA. Surfaces measured included corn, soybeans, bare soils, grass lawn, orchard grass, alfalfa, cotton row crops, plowed field, annual grassland, stipa grass, hard wheat, salt plain shrubland, and irrigated wheat. Analysis of field data showed unique reflectance distributions ranging from bare soil to complete vegetation canopies. Physical mechanisms causing these trends were proposed. A 3-D model was developed and is unique in that it predicts: (1) the directional spectral reflectance factors as a function of the sensor's azimuth and zenith angles and the sensor's position above the canopy; (2) the spectral absorption as a function of location within the scene; and (3) the directional spectral radiance as a function of the sensor's location within the scene. Initial verification of the model as applied to a soybean row crop showed that the simulated directional data corresponded relatively well in gross trends to the measured data. The model was expanded to include the anisotropic scattering properties of leaves as a function of the leaf orientation distribution in both the zenith and azimuth angle modes.

Kimes, D. S.↗

The Experimental Regional Ensemble Forecast System (ExREF): Its Use in NWS Forecast Operations and Preliminary Verification

The Experimental Regional Ensemble Forecast (ExREF) system is a tool for the development and testing of new Numerical Weather Prediction (NWP) methodologies. ExREF is run in near‐realtime by the Global Systems Division (GSD) of the NOAA Earth System Research Laboratory (ESRL) and its products are made available through a website, an ftp site, and via the Unidata Local Data Manager (LDM). The ExREF domain covers most of North America and has 9‐km horizontal grid spacing. The ensemble has eight members, all employing WRF‐ARW. The ensemble uses a variety of initial conditions from LAPS and the Global Forecasting System (GFS) and multiple boundary conditions from the GFS ensemble. Additionally, a diversity of physical parameterizations is used to increase ensemble spread and to account for the uncertainty in forecasting extreme precipitation events. ExREF has been a component of the Hydrometeorology Testbed (HMT) NWP suite in the 2012‐2013 and 2013‐2014 winters. A smaller domain covering just the West Coast was created to minimize band‐width consumption for the NWS. This smaller domain has and is being distributed to the National Weather Service (NWS) Weather Forecast Office and California Nevada River Forecast Center in Sacramento, California, where it is ingested into the Advanced Weather Interactive Processing System (AWIPS I and II) to provide guidance on the forecasting of extreme precipitation events. This paper will review the cooperative effort employed by NOAA ESRL, NASA SPoRT (Short‐term Prediction Research and Transition Center), and the NWS to facilitate the ingest and display of ExREF data utilizing the AWIPS I and II D2D and GFE (Graphical Software Editor) software. Within GFE is a very useful verification software package called BoiVer that allows the NWS to utilize the River Forecast Center's 4 km gridded QPE to compare with all operational NWP models 6‐hr QPF along with the ExREF mean 6‐hr QPF so the forecasters can build confidence in the use of the ExREF in preparing their rainfall forecasts. Preliminary results will be presented.

Reynolds, David↗

A Data Analysis and Simulation Study of Urban Air Mobility

For the Urban Air Mobility (UAM) industry, NASA has defined a series of UAM Maturity Levels (UML) corresponding to increasingly more complex and operationally dense UAM operations. In support of the gradual progression towards higher UML levels, NASA is currently conducting a set of UAM air traffic simulations—collectively referred to as X4. This paper describes a set of system effectiveness measures, and their associated metrics, for data analysis of X4 simulations. The descriptions, rationales, and calculation procedures for two metrics to be used in data analysis of simulation results, the number of predicted demand-capacity imbalances and the pre-departure delays, are described. Results from data analysis of one set of simulation runs are presented to demonstrate how these metrics support the assessment of performance of the system architecture for X4 simulations and the verification of experiment requirements.

Urban Air Mobility↗

Runtime Verification Logics A Language Design Perspective

Runtime Verification is a light-weight approach to systems verification, where actual executions of a system are processed and analyzed using rigorous techniques. In this paper we shall narrow the term’s definition to represent the commonly studied variant consisting of verifying that a single system execution conforms to a specification written in a formal specification language. Runtime verification (in this sense) can be used for writing test oracles during testing when the system is too complex for full formal verification, or it can be used during deployment of the system as part of a fault protection strategy, where corrective actions may be taken in case the specification is violated. Specification languages for runtime verification appear to differ from for example temporal logics applied in model checking, in part due to the focus on monitoring of events that carry data, and specifically due to the desire to relate data values existing at different time points, resulting in new challenges in both the complexity of the monitoring approach and the expressiveness of languages. Over the recent years, numerous runtime verification specification languages have emerged, each with its different features and levels of expressiveness and usability. This paper presents an overview and a discussion of this design space.

Reger, Giles↗

HIFiRE Flight 2 Unstart Reliability Analysis

The objective of this work was to assess the unstart reliability of the HIFiRE Flight 2 system. To do this, a quantification of margins and uncertainties framework was used for comparing model predictions of the predicted combustion induced shock location to the predicted last stable shock location within the isolator. Uncertainty sources included parametric uncertainty in the flight conditions, the heat release model, and turbulence modeling, as well as model verification errors. Additionally, an estimate of model-form uncertainty was established by comparing the model to measured ground test data. A computationally efficient non-intrusive polynomial chaos approach was used to propagate parametric uncertainty through the computational flu-ids dynamics models of both the ground test configuration and the flight vehicle. Compared to direct-connect ground test data, computational fluid dynamics predictions yielded about two duct heights of model-form uncertainty. This was applied to a prediction of flight vehicle unstart margin at the Mach 6.5 flight condition. Building up all of the computational model uncertainty, including parametric uncertainty, verification errors, and the determined model-form uncertainty, a 95% probability level based confidence ratio, or a ratio of total uncertainty to a statistical margin measure, was found to be 0.31 for the flight system.

Thomas K West↗

An Overview of Ares-I CFD Ascent Aerodynamic Data Development And Analysis Based on USM3D

An overview of the computational results obtained from the NASA Langley developed unstructured grid, Reynolds-averaged Navier-Stokes flow solver USM3D, in support of the Ares-I project within the NASA s Constellation program, are presented. The numerical data are obtained for representative flow conditions pertinent to the ascent phase of the trajectory at both wind tunnel and flight Reynolds number without including any propulsion effects. The USM3D flow solver has been designated to have the primary role within the Ares-I project in developing the computational aerodynamic data for the vehicle while other flow solvers, namely OVERFLOW and FUN3D, have supporting roles to provide complementary results for fewer cases as part of the verification process to ensure code-to-code solution consistency. Similarly, as part of the solution validation efforts, the predicted numerical results are correlated with the aerodynamic wind tunnel data that have been generated within the project in the past few years. Sample aerodynamic results and the processes established for the computational solution/data development for the evolving Ares-I design cycles are presented.

FUN3D↗

Space shuttle seal material and design development for earth storable propellant systems

The results of a program to investigate and characterize seal materials suitable for space shuttle storable propellant systems are given. Two new elastomeric materials were identified as being potentially superior to existing state-of-the art materials for specific sealing applications. These materials were AF-E-124D and AF-E-411. AF-E-124D is a cured perfluorinated polymer suitable for use with dinitrogen tetroxide oxidizer, and hydrazine base fuels. AF-E-411 is an ethylene propylene terpolymer material for hydrazine base fuel service. Data are presented relative to low and high temperature characteristics as well as propellant exposure effects. Types of data included are: mechanical properties, stress strain curves, friction and wear characteristics, compression set and permeability. Sealing tests with a flat poppet-seal valve were conducted for verification of sealing capability. A bibliography includes over 200 references relating to seal design or materials and presents a concise tabulation of the more useful seal design data sources.

Source record↗

Detecting and Characterizing Fracture Zones Using a Convolutional Neural Network

This project directly supports the Geothermal Technologies Office (GTO) objectives outlined in the Multi-Year Program Plan (MYPP) by advancing two key research areas: “Exploration and Characterization” and “Data, Modeling, and Analysis.” This project has successfully demonstrated a pre-drilling ability to image and characterize the distribution and connectivity of subsurface faults and fractures, key parameters for identifying permeable pathways that enable geothermal fluids to circulate and produce energy. Specifically, we developed and implemented innovative machine learning methodologies to enhance geothermal exploration. Large-scale faults were detected using a Convolutional Neural Network (CNN), while small-scale fractures were characterized using a novel Double-Beam Neural Network (DBNN). These tools have proven both technically effective and cost-efficient by reducing reliance on expensive exploratory drilling. Through collaboration with our geothermal industry partner, this research has significantly advanced techniques for identifying hidden geothermal systems and extending the productive lifespan of existing geothermal fields. We applied our methods to two geothermal fields—Soda Lake (Nevada) and Lightning Dock (New Mexico)—to identify shallow steam-charged fracture zones and characterize deep faults at depths of 1.5-2 km. The steam zone identified at the Soda Lake geothermal field showed excellent agreement with prior drilling data, validating the effectiveness of our approaches. In addition, the analysis revealed three new prospective drilling targets for further development and verification. The outcomes of this project improve our scientific understanding of geothermal reservoir behavior, enhance exploration efficiency, extend the economic life of existing geothermal plants. Ultimately, these advancements contribute to GTO’s goal of achieving more sustainable, affordable, and data-driven geothermal energy development across the United States.

15 GEOTHERMAL ENERGY↗

MOOSE-based Tritium Migration Analysis Program, Version 8 (TMAP8) for advanced open-source tritium transport and fuel cycle modeling

Tritium management is critical for the safety, sustainability, and economics of fusion energy systems, and advanced and reliable modeling tools help accelerate the development of tritium technologies. This paper presents the Tritium Migration Analysis Program, Version 8 (TMAP8), an open-source, MOOSE-based application developed to provide state-of-the-art tritium transport and fuel cycle modeling capabilities. TMAP8 aims to expand the capabilities of previous versions (i.e., TMAP4 and TMAP7) by leveraging modern computational techniques, ensuring high software quality assurance standards (key to building trust), and enabling multispecies, multiscale, and multiphysics simulations for integrated tritium transport modeling in complex geometries. This paper outlines TMAP8’s scope and rigorous development practices, emphasizing its transparency, accessibility, modularity, and reliability. We present the current suite of verification and validation cases based on those from TMAP4, demonstrating TMAP8’s accuracy and reliability against analytical solutions and experimental data. Additionally, the paper showcases TMAP8’s integrated fuel cycle modeling capabilities, highlighting its applicability at various scales and levels. The TMAP8 code and documentation are openly available, promoting collaborative development and widespread adoption within the fusion community. Future work will soon expand TMAP8’s verification and validation suite to include those from TMAP7 and other recent experimental studies for validation.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Hybrid Verification of an Interface for an Automatic Landing

Modern commercial aircraft have extensive automation which helps the pilot by performing computations, obtaining data, and completing procedural tasks. The pilot display must contain enough information so that the pilot can correctly predict the aircraft's behavior, while not overloading the pilot with unnecessary information. Human-automation interaction is currently evaluated through extensive simulation. In this paper, using both hybrid and discrete-event system techniques, we show how one could mathematically verify that an interface contains enough information for the pilot to safely and unambiguously complete a desired maneuver. We first develop a nonlinear, hybrid model for the longitudinal dynamics of a large civil jet aircraft in an autoland/go-around maneuver. We find the largest controlled subset of the aircraft's flight envelope for which we can guarantee both safe landing and safe go-around. We abstract a discrete procedural model using this result, and verify a discrete formulation of the pilot display against it. An interface which fails this verification could result in nondeterministic or unpredictable behavior from the pilot's point of view.

Oishi, Meeko↗

A Data Analysis Approach for Simulations of Urban Air Mobility Operations

For the Urban Air Mobility (UAM) industry, NASA has defined a series of UAM Maturity Levels (UML) corresponding to increasingly more complex and operationally dense UAM operations. In support of the gradual progression towards higher UML levels, NASA is currently conducting a set of UAM air traffic simulations—collectively referred to as X4. This paper describes a set of system effectiveness measures, and their associated metrics, for data analysis of X4 simulations. The descriptions, rationales, and calculation procedures for two metrics to be used in data analysis of simulation results, the number of predicted demand-capacity imbalances and the pre-departure delays, are described. Results from data analysis of one set of simulation runs are presented to demonstrate how these metrics support the assessment of performance of the system architecture for X4 simulations and the verification of experiment requirements.

Urban Air Mobility↗

Oak Ridge National Laboratory Technical Input for the Nuclear Regulatory Commission Review of the 2017 Edition of ASME Section III, Division 5, ‘High Temperature Reactors’

To assist the Nuclear Regulatory Commission in its decision making on endorsement of the American Society for Mechanical Engineers Boiler and Pressure Vessel Code Section III, Division 5 (2017 Edition) for development of advanced non-light water reactors, the following Division 5 portions were reviewed: Article HBB-2000 Material; Article HCB-2000 Material; Article HGB-2000 Material; Mandatory Appendix HBB-I-14 Tables and Figures; and, Nonmandatory Appendix HBB-U Guidelines for Restricted Material Specifications to Improve Performance in Certain Service Applications. In addition to the 2017 Edition, the same parts of the 2019 Edition have also been reviewed as indicated in various sections of the report. This review was conducted by a collaboration of national laboratory and private sector participants with significant industrial experience, including some heavy lifting and deep diving from Clarus Consulting, LLC., all intended to achieve an objective, independent, and practical perspective. The report provides recommendations, descriptions of the evaluation methods, and the source references for the data used. To build confidence required for endorsement of the Code, this review was conducted as a verification and validation of the above Code contents. The objective of verification is to ensure that the Code is free of error – direct or implied; contains the information needed for its use, including proper coverage of the Code-specified materials for the intended application, and completeness and adequacy of references to other portions of the Code. The objective of validation is to authenticate that the Code tabulations and graphs represent design inputs consistent with what are determined using rules and methods specified by the Code. The authentication process used data that were assembled and/or generated independent of Code development, while the methods of analysis followed Code-specified methods where appropriate. The designated portions for this review cover the five alloys codified for high temperature reactor applications in Division 5, i.e. 316 SS, 304 SS, 800H, 2¼Cr-1Mo, and 9Cr-1Mo-V, regarding their general requirements, permitted specifications and design stress intensity values for pressure-retaining applications, deterioration in service, fatigue acceptance test, permissible weld materials, tensile and yield strength, expected minimum stress-to-rupture values (including for Alloy 718), weld stress rupture factors, permissible materials for bolting use, and restricted specifications in certain service applications. Additionally, stress intensity values for bolting materials including 316 SS, 304 SS and alloy 718 were reviewed. Analysis and discussion are also provided on contents outside of these designated Code portions where it was deemed relevant and necessary to develop a technically sound understanding of issues relating to the designated portions. Due to unavailability of sufficient test data on welds during the review period, the weld stress rupture factors in Tables HBB-I-10.14A to E, which cover a total of ten tables for the five alloys welded with twenty-eight different weld metals (some with similar properties), have been deferred to a future review effort. The review identified mainly two types of issues. The first type includes instances where the Code is found factually incomplete or incorrect, such as obsolete materials specifications listings, missing tabulation of stresses for bolting. Changes to the Code are recommended in these cases. The second type of issue includes instances where the Code tabulations and graphs are found to be less conservative than the review analysis results. In these cases, recommendations are made for further review and consideration where the difference in conservatism exceeds 10%, which is our threshold for questioning technical adequacy, meriting a risk assessment by the Nuclear Regulatory Commission and/or reactor designers. It is noted that this effort has been executed using all available data and established methods of analysis, including methods and criteria specified and used by the Code. As such, the findings that are presented in quantitative detail, in a format for convenient comparison with the Code, and with identification of where further review is recommended, should provide a sound technical basis for decisions about quantifying the implications of the reduced design margins and technical adequacy/inadequacy to form a basis for conditioning specific Code tabulation values on endorsement. Recommendations for specific changes to the Code, however, entail design conservatism considerations beyond the scope of this review effort, and are not made in this report.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Remote inspection of adversary-controlled environments

Remotely monitoring the location and enduring presence of valuable items in adversary-controlled environments presents significant challenges. In this article, we demonstrate a monitoring approach that leverages the gigahertz radio-wave scattering and absorption of a room and its contents, including a set of mirrors with random orientations placed inside, to remotely verify the absence of any disturbance over time. Our technique extends to large physical systems the application of physical unclonable functions for integrity protection. Its main applications are scenarios where parties are mutually distrustful and have privacy and security constraints. Examples range from the verification of nuclear arms-control treaties to the securing of currency, artwork, or data centers.

47 OTHER INSTRUMENTATION↗

Validation of the ESPRESSO wavelength calibration using iodine absorption cell spectra

ABSTRACT High-quality wavelength calibration is crucial for science cases like radial-velocity studies of exoplanets, the search for a possible variation of fundamental constants, and the redshift drift experiment. However, for state-of-the-art spectrographs, it has become difficult to verify the wavelength calibration on sky because no astrophysical source provides spectra with sufficiently stable or accurate wavelength information. We therefore propose to use iodine absorption cells to validate the wavelength calibration. Observing a bright and featureless star through the iodine cell emulates an astrophysical target with exactly known spectral features that can be analysed like any other science target, allowing to verify the wavelength calibration derived from the internal calibration sources and to identify systematics in the data processing. As demonstration, we temporarily installed an $\mathrm{I_2}$ absorption cell at ESPRESSO. Employing a full forward modelling approach of the $\mathrm{I_2}$ spectrum, including the instrumental line-spread function, we demonstrate wavelength calibration accuracy at the level of a few $\mathrm{m\,s^{-1}}$. We also show that wavelength measurements do depend on the geometry of the light-injection into the spectrograph fibers. This highlights the importance of probing exactly the same light path as science targets, something not possible with internal calibration sources alone. We also demonstrate excellent radial-velocity stability at the ${{< 20\, \mathrm{cm\,s^{-1}}}}$ level in a full end-to-end fashion, from sky to data product. Our study therefore showcases the great potential of absorption cells for the verification and long-term monitoring of the wavelength calibration as well as the unique insights they can provide.

Schmidt, Tobias M. (ORCID:0000000248337273)↗

Baseline Characterization Database Verification Report - NBG-18 Billet 635-14

The purpose of this Engineering Calculations and Analysis Report is to present the data being collected in the Baseline Graphite Characterization program, which is directly tasked with supporting the Idaho National Laboratory’s (INL’s) research and development efforts on the Next Generation Nuclear Plant (NGNP)/Very High Temperature Reactor (VHTR)/Advanced Reactor Technology (ART). This program is populating a comprehensive database that will reflect the baseline properties of nuclear-grade graphite regarding individual grade, billet, and position within individual billets. The physical and mechanical property information being collected will be transferred to the NGNP Data Management and Analysis System (NDMAS), and from that database will help populate handbook of property data available to member nations of the Generation IV International Forum (GIF).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Systems definition summary. Earth Observatory Satellite system definition study (EOS)

A standard spacecraft bus for performing a variety of earth orbit missions in the late 1970's and 1980's is defined. Emphasis is placed on a low-cost, multimission capability, benefitting from the space shuttle system. The subjects considered are as follows: (1) performance requirements, (2) internal interfaces, (3) redundancy and reliability, (4) communications and data handling module design, (5) payload data handling, (6) application of the modular design to various missions, and (7) the verification concept.

Source record↗

Model verification of large structural systems

A methodology was formulated, and a general computer code implemented for processing sinusoidal vibration test data to simultaneously make adjustments to a prior mathematical model of a large structural system, and resolve measured response data to obtain a set of orthogonal modes representative of the test model. The derivation of estimator equations is shown along with example problems. A method for improving the prior analytic model is included.

Lee, L. T.↗

An experimental/analytical program to assess the utility of lidar for pollution monitoring

The development and demonstration of lidar techniques for the remote measurement of atmospheric constituents and transport processes in the lower troposphere was carried out. Particular emphasis was given to techniques for monitoring SO2 and particulates, the principal pollutants in power plant and industrial plumes. Data from a plume dispersion study conducted in Maryland during September and October 1976 were reduced, and a data base was assembled which is available to the scientific community for plume model verification. A UV Differential Absorption Lidar (DIAL) was built, and preliminary testing was done.

Mills, F. S.↗