Results for “Verification of data” — Page 54

NASA NTRS1998

An Ecosystem Model for the Simulation of Physical and Biological Oceanic Processes-IDAPAK User's Guide and Applications

This TM describes the development, testing, and application of a 4-component (phytoplankton, zooplankton, nitrate, and ammonium) ecosystem model capable of simulating oceanic biological processes. It also reports and documents an in-house software package (Interactive Data Analysis Package - IDAPAK) for interactive data analysis of geophysical fields, including those related to the forcing, verification, and analysis of the ecosystem model. Two regions were studied in the Pacific: the Warm Pool (WP) in the Equatorial Pacific (165 deg. E at the equator) and at Ocean Weather Station P (OWS P) in the Northeast Pacific (50 deg. N, 145 deg. W). The WP results clearly indicate that the upwelling at 100 meters correlates well with surface blooms. The upwelling events in late 1987 and 1990 produced dramatic increases in the surface layer values of all 4 ecosystem components, whereas the spring-summer deep mixing events, do not seem to incur a significant response in any of the ecosystem quantities. The OWS P results show that the monthly profiles of temperature, the annual cycles of solar irradiance, and 0- to 50-m integrated nitrate accurately reproduce observed values. Annual primary production is 190 gC/m(exp 2)/yr, which is consistent with recent observations but is much greater than earlier estimates.

McClain, Charles R.↗

NASA NTRS2004

Validation of Orthorectified Interferometric Radar Imagery and Digital Elevation Models

This work was performed under NASA's Verification and Validation (V&V) Program as an independent check of data supplied by EarthWatch, Incorporated, through the Earth Science Enterprise Scientific Data Purchase (SDP) Program. This document serves as the basis of reporting results associated with validation of orthorectified interferometric interferometric radar imagery and digital elevation models (DEM). This validation covers all datasets provided under the first campaign (Central America & Virginia Beach) plus three earlier missions (Indonesia, Red River: and Denver) for a total of 13 missions.

Smith Charles M.↗

NASA NTRS2006

Crash Certification by Analysis - Are We There Yet?

This paper addresses the issue of crash certification by analysis. This broad topic encompasses many ancillary issues including model validation procedures, uncertainty in test data and analysis models, probabilistic techniques for test-analysis correlation, verification of the mathematical formulation, and establishment of appropriate qualification requirements. This paper will focus on certification requirements for crashworthiness of military helicopters; capabilities of the current analysis codes used for crash modeling and simulation, including some examples of simulations from the literature to illustrate the current approach to model validation; and future directions needed to achieve "crash certification by analysis."

Jackson, Karen E.↗

NASA NTRS2011

Orion Crew Module Landing System Simulation and Verification

NASA Langley Research Center (LaRC) has developed a comprehensive test and analysis program to evaluate the ability of LS-DYNA to model the materials and the phenomena involved in soil and water landing impacts of the Orion crew module. Elemental, scale boilerplate, and full-scale prototype testing is being conducted in support of the simulation verification and validation approach. Aspects of the simulations evaluated against test data include soil constitutive properties, water equations of state, and contact algorithms. Subsystems tested include airbags, crushable energy absorbing honeycomb materials, and energy absorbing seat support struts. The procedures, instrumentation, and general observations from each test series are presented. Plans for a series of swing tests of a full-scale boilerplate into a purpose-built water basin are described. Further plans for swing tests of flight-like prototypes into the water basin are noted.

Vassilakos, Gregory J.↗

NASA NTRS2017

Traveler Phase 1A Joint Review

The briefing contains the preliminary findings and suggestions for improvement of methods used in development and evaluation of a multi monitor runtime assurance architecture for autonomous flight vehicles. Initial system design, implementation, verification, and flight testing has been conducted. As of yet detailed data review is incomplete, and flight testing has been limited to initial monitor force fights. Detailed monitor flight evaluations have yet to be performed.

autonomy↗

NASA NTRS2020

A Statistical Model to Predict the Extratropical Transition of Tropical Cyclones

This paper introduces a logistic regression model for the extratropical transition(ET) of tropical cyclones in the North Atlantic and the Western North Pacific, using elastic net regularization to select predictors and estimate coefficients.Predictors are chosen from the 1979-2017 best track and reanalysis datasets, and verification is done against the tropical/extratropical labels in the best track data. In an independent test set, the model skillfully predicts ET at lead times up to two days, with latitude and sea surface temperature as its most important predictors. At a lead time of 24 h, it predicts ET with a Matthews correlation coefficient of 0.4 in the North Atlantic, and 0.6 in the Western North Pacific. It identifies 80% of storms undergoing ET in the North Atlantic, and 92% of those in the Western North Pacific. 90% of transition time errors are less than 24 h. Select examples of the model's performance on individual storms illustrate its strengths and weaknesses.Two versions of the model are presented: an "operational model" that may provide baseline guidance for operational forecasts, and a "hazard model"that can be integrated into statistical TC risk models. As instantaneous diagnostics for tropical/extratropical status, both models' zero lead time predictions perform about as well as the widely used Cyclone Phase Space (CPS) in the Western North Pacific and better than the CPS in the North Atlantic, and predict the timings of the transitions better than CPS in both basins.

Melanie Bieli↗

NASA NTRS2019

Ka-band Phase Measurement System for SWOT Mission

The KaRIn (Ka-band radar interferometer) instrument for SWOT (surface water ocean topography) mission faces unique challenges in terms of phase stability and group delay stability requirements to achieve centimeter level accuracy for height measurements. Conventional altimetry assumes nadir point return and measures a single range. SWOT will require additional angle of arrival information to provide swath coverage. Errors in differential phase and common group delay can both act as primary sources of systematic errors in determining the height using interferometric data. The ground support equipment (GSE) necessary for the performance requirements verification gets a fraction of the error allocation from the instrument. A phase measurement system capable of measuring millidegrees and working with pulsed excitation is developed and the preliminary results are described in this paper.

Esteban-Fernandez, Daniel↗

NASA NTRS1984

Detection of aspen/conifer forest mixes from multitemporal Landsat digital data

Aspen, conifer and mixed aspen/conifer forests were mapped for a 15-quadrangle study area in the Utah-Idaho Bear River Range using Landsat multispectral scanner data. Digital classification and statistical analysis of Landsat data allowed the identification of six groups of signatures which reflect different types of aspen/conifer forest mixing. Photo interpretations of the print symbols suggest that such classes are indicative of mid to late seral aspen forests. Digital print map overlayes and acreage calculations were prepared for the study area quadrangles. Further field verification is needed to acquire additional information about the nature of the forests. Single data Landsat analysis should be a cost effective means to index aspen forests which are at least in the mid seral phase of conifer invasion. Since aspen canopies tend to obscure understory conifers for early seral forests, a second data analysis, using data taken when aspens are leafless, could provide information about early seral aspen forests.

Merola, J. A.↗

DOE OSTI2026

Evaluation of AI-enabled Digital Documented Safety Analysis

The National Reactor Innovation Center (NRIC) is leading a transformative initiative to accelerate advanced reactor deployment by fundamentally reimagining how nuclear safety basis documentation is developed, reviewed, and maintained. Traditional Documented Safety Analysis (DSA) processes for DOE-authorized facilities rely on static, document-centric workflows that consume significant time and resources, exemplified by recent major licensing efforts requiring hundreds of thousands of staff hours and millions of pages of documentation review. These conventional approaches create barriers to the rapid, cost-effective deployment of advanced reactors that America's future energy needs demand. NRIC's DOE Authorization Digital Transformation Project addresses these challenges through an innovative framework that integrates artificial intelligence (AI), digital engineering, and systems-based data management into a cohesive digital ecosystem. This white paper presents NRIC's methodology for evaluating AI-enabled document generation capabilities within this broader digital infrastructure, using the Demonstration of Microreactor Experiments (DOME) facility as a pilot case study. The evaluation will assess an AI tool's ability to generate a Preliminary Documented Safety Analysis (PDSA) through progressive integration stages—from standalone document processing to full digital thread connectivity—while maintaining rigorous verification, validation, and regulatory acceptance standards. By establishing dynamic, traceable connections between design data and safety documentation, NRIC's approach has the potential to reduce both document development time and regulatory review cycles by as much as 50%, while simultaneously improving accuracy, consistency, and traceability. This initiative represents a critical step toward establishing reusable digital infrastructure that reactor developers can leverage to accelerate their path from concept to commercial operation, directly supporting NRIC's mission to demonstrate and deploy advanced nuclear energy technologies.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

NASA NTRS2019

A Streamlined Approach to Spatial Mapping of Complex 3D Thermal Boundary Condition Data

Spatial mapping of 1D, 2D, and particularly 3D thermal boundary condition data is essential for accurate thermal simulation of spacecraft and launch vehicles. This information typically is available in simple ASCII file format but can be problematic to use for thermal simulations. Difficulties that can be encountered include the ability to directly use the available file format, transformation of the data into the desired reference coordinate system in 3D space, and accurate interpolation of the data onto the thermal calculation domain. This paper presents a streamlined approach to spatial mapping of complex unsymmetrical 3D cold wall heat flux data using the fields’ capability in Simcenter3D. A recent example of 3D thermal plume simulation at MSFC will be employed to illustrate the use of text, csv, and Excel files, specifying coordinate systems for transformation of data in 3D space, and use of the various interpolation schemes available for spatial mapping. Spatial boundary condition verification is also very important, and the spacecraft thermal analyst needs effective visualization tools to develop confidence in the boundary condition definitions. Visualization of the spacecraft plume raw field data, the calculated field data, and the interpolated field data onto the thermal calculation domain will be discussed, with a particular focus on real-time viewing of the interpolated data for available interpolation schemes. The objective of this paper is to outline the modeling techniques used with the integrated thermal analysis of a terrestrial lunar lander demonstrator. Specifically, the techniques outlined herein focus on spatial mapping of convective and radiative exhaust plume results from a computational fluid dynamics (CFD) analysis. Two cases were investigated, however, the modeling techniques that were utilized translate to both cases seamlessly. Those two cases were as follows: • Lunar lander demonstrator firing on-pad (worst case). • Lunar lander demonstrator hovering at an elevated position above the launch pad. For the purposes of information control, this paper will focus on the modeling techniques only, using altered or dimensionless data where necessary. BACKGROUND The thermal model examined in this paper is of the lunar lander demonstrator known as XL-1T (terrestrial), born from a collaborative effort between Masten Space Systems (MSS) and NASA, under NASA’s Lunar CATALYST (also known as Lunar Cargo Transportation and Landing by Soft Touchdown) initiative. The lander is a reusable vertical takeoff/vertical landing (VTVL) test bed which is controlled by four throttleable main engines utilizing green hypergolic propellants.

Hawkins, Robert F.↗

NASA NTRS1987

The terminal area simulation system. Volume 2: Verification cases

The numerical simulation of five case studies are presented and are compared with available data in order to verify the three-dimensional version of the Terminal Area Simulation System (TASS). A spectrum of convective storm types are selected for the case studies. Included are: a High-Plains supercell hailstorm, a small and relatively short-lived High-Plains cumulonimbus, a convective storm which produced the 2 August 1985 DFW microburst, a South Florida convective complex, and a tornadic Oklahoma thunderstorm. For each of the cases the model results compared reasonably well with observed data. In the simulations of the supercell storms many of their characteristic features were modeled, such as the hook echo, BWER, mesocyclone, gust fronts, giant persistent updraft, wall cloud, flanking-line towers, anvil and radar reflectivity overhang, and rightward veering in the storm propagation. In the simulation of the tornadic storm a horseshoe-shaped updraft configuration and cyclic changes in storm intensity and structure were noted. The simulation of the DFW microburst agreed remarkably well with sparse observed data. The simulated outflow rapidly expanded in a nearly symmetrical pattern and was associated with a ringvortex. A South Florida convective complex was simulated and contained updrafts and downdrafts in the form of discrete bubbles. The numerical simulations, in all cases, always remained stable and bounded with no anomalous trends.

Proctor, F. H.↗

NASA NTRS1991

Testing, analysis, and code verification of aerodynamics and heat transfer related to turbomachinery

Discussed here are the writing of a data acquisition code and the installation and testing of new pressure and temperature instrumentation to be used in the testing and evaluation of miniature heat flux sensors. A brief summary of the problem which led to the need for these tests is presented as well as a proposed data acquisition program and the results of investigations of two measurement systems, the Omega OM-900 temperature sensing system and the Scani-Valve Hyscan pressure measurement system.

King, Paul I.↗

NASA NTRS1987

Verification of 3D viscous/turbulent codes for internal flows

A computational fluid dynamics code is validated using data obtained through a nonintrusive laser Doppler velocimeter. A space marching technique and a parabolic marching technique are use to calculate the flow in a compressor using compressible and incompressible flow assumptions. In a viewgraph format, both computational fluid dynamics techniques and experimental data are compared to each other.

Lakshminarayana, B.↗

NASA NTRS2008

Applying EVM to Satellite on Ground and In-Orbit Testing - Better Data in Less Time

Using Error Vector Magnitude (EVM) in satellite integration and test allows rapid verification of the Bit Error Rate (BER) performance of a satellite link and is particularly well suited to measurement of low bit rate satellite links where it can result in a major reduction in test time (about 3 weeks per satellite for the Geosynchronous Operational Environmental Satellite [GOES] satellites during ground test) and can provide diagnostic information. Empirical techniques developed to predict BER performance from EVM measurements and lessons learned about applying these techniques during GOES N, O, and P integration test and post launch testing, are discussed.

Peters, Robert↗

DOE OSTI2021

Challenges in Automated Detection of COVID-19 Misinformation

The COVID-19 pandemic has made the dangers of the spread of misinformation obvious but despite much global effort to curbing its spread, fake information about the pandemic keeps proliferating. In this paper, we address the development of automated methods for verification of claims about COVID-19 and discuss the challenges associated with this task. We focus on labeled data collection, limitations of existing models, and difficulties of applying misinformation detection models in practical applications. Our initial analysis indicates label imbalance may be a particular challenge for developing claim verification models and we discuss options for alleviating this issue.

Herrmannova, Dasha↗

DOE OSTI2020

Characterization and Analysis of the Energy-Reporting Accuracy of Connected Devices

Emerging energy-efficient building systems increasingly exhibit greater functionality, often requiring multiple operating modes (e.g. white-tunability for lighting products and data traffic for devices with networked, integrated sensors). This increased functionality makes energy consumption estimates more complex. Given that these functions consume energy, the energy performance of such building systems is dependent on what operating modes they use and how much time they spend in each mode. Devices and systems that can report their own energy consumption mitigate this energy-performance uncertainty. This study explores the energy-reporting accuracy of market-available connected electrical outlets. The study considers two residential-market products (five units each, one outlet per unit) and three commercial-market products (two units each, 18 to 24 outlets per unit) with the ability to report power drawn and/or energy consumed by devices connected to their receptacles. The products were purchased through typical market channels. Pacific Northwest National Laboratory (PNNL) conducted testing in December 2018 at its Connected Lighting Test Bed (CLTB), using a custom-developed test setup and method adapted from industry standards. The setup collected energy-consumption data reported by the outlet devices under test (DUTs) at one-minute intervals and compared that data with measurements taken by a reference meter over a range of test conditions. The residential products reported power draw but not interval or cumulative energy consumption. The commercial products reported both power draw and cumulative energy consumption. Relative reporting error (RRE) was calculated for all measurements, and analysis of the results revealed variations across devices and test conditions. The total number of measurements (50 for each residential product, 60 for each commercial product) offers an appreciable comparison of performance at the make/model level. The average RRE of the residential products derived from reported power draw was -0.02% and -1.20%. The average RRE for two of the three the commercial products derived from reported power draw was worse than those of the residential products (-2.40%, -2.72%, -0.36%). The internal integration of power over time, used to calculate cumulative energy consumption, typically occurs at current and voltage sampling rates much higher than once per minute. This suggests that the average commercial-product RRE derived from reported energy consumption should be very consistent and better than performance based on reported power draw. However, the RRE derived from reported energy consumption varied significantly across the three makes of commercial-market products and was uniformly less accurate than performance based on reported power draw. Subsequent analysis identified a number of root causes for this decrease in performance, most of which were related to reporting resolution. The goals of this study are to generate awareness of building systems capable of reporting their own energy consumption, further interest in the value of energy data for a variety of uses, draw attention to how the accuracy of reported metrics can be characterized, and quantify the performance variation found in marketavailable products. The results of this study and subsequent related work may be relevant to stakeholders in industry-specification and standards-development organizations. The methods this study employs could inform test and measurement procedures and performance classifications for connected outlets, lighting products, and other building systems capable of reporting their own energy consumption. The study concludes with stakeholder recommendations, including the following: • Energy-reporting device and system manufacturers developing products that report energy consumption should characterize the accuracy of reported metrics using a reference meter calibrated by an independent laboratory that was accredited by an ILAC MRA signatory (and whose scope of accreditation explicitly covers energy measurement), and should include this information on product data sheets. • Standards and specification development organizations should develop application-specific performance classifications that end users can understand and relate to their energy-data use needs (e.g., 2% accuracy class for utility streetlight energy billing needs, or 10% accuracy class for ESCO performance verification needs). • Current or potential owners, operators, and specifiers of energy-reporting building systems should rigorously analyze the dependency of current and planned energy-data use cases on accuracy, noting in particular the dependence (or lack thereof) on relative vs. absolute accuracy, and on trueness vs. precision (i.e., repeatability), and should communicate use-case needs to industry standards and specification organizations.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2020

Characterization and Analysis of the Energy-Reporting Accuracy of Connected Devices

Emerging energy-efficient building systems increasingly exhibit greater functionality, often requiring multiple operating modes (e.g. white-tunability for lighting products and data traffic for devices with networked, integrated sensors). This increased functionality makes energy consumption estimates more complex. Given that these functions consume energy, the energy performance of such building systems is dependent on what operating modes they use and how much time they spend in each mode. Devices and systems that can report their own energy consumption mitigate this energy-performance uncertainty. This study explores the energy-reporting accuracy of market-available connected electrical outlets. The study considers two residential-market products (five units each, one outlet per unit) and three commercial-market products (two units each, 18 to 24 outlets per unit) with the ability to report power drawn and/or energy consumed by devices connected to their receptacles. The products were purchased through typical market channels. Pacific Northwest National Laboratory (PNNL) conducted testing in December 2018 at its Connected Lighting Test Bed (CLTB), using a custom-developed test setup and method adapted from industry standards. The setup collected energy-consumption data reported by the outlet devices under test (DUTs) at one-minute intervals and compared that data with measurements taken by a reference meter over a range of test conditions. The residential products reported power draw but not interval or cumulative energy consumption. The commercial products reported both power draw and cumulative energy consumption. Relative reporting error (RRE) was calculated for all measurements, and analysis of the results revealed variations across devices and test conditions. The total number of measurements (50 for each residential product, 60 for each commercial product) offers an appreciable comparison of performance at the make/model level. The average RRE of the residential products derived from reported power draw was -0.02% and -1.20%. The average RRE for two of the three the commercial products derived from reported power draw was worse than those of the residential products (-2.40%, -2.72%, -0.36%). The internal integration of power over time, used to calculate cumulative energy consumption, typically occurs at current and voltage sampling rates much higher than once per minute. This suggests that the average commercial-product RRE derived from reported energy consumption should be very consistent and better than performance based on reported power draw. However, the RRE derived from reported energy consumption varied significantly across the three makes of commercial-market products and was uniformly less accurate than performance based on reported power draw. Subsequent analysis identified a number of root causes for this decrease in performance, most of which were related to reporting resolution. The goals of this study are to generate awareness of building systems capable of reporting their own energy consumption, further interest in the value of energy data for a variety of uses, draw attention to how the accuracy of reported metrics can be characterized, and quantify the performance variation found in marketavailable products. The results of this study and subsequent related work may be relevant to stakeholders in industry-specification and standards-development organizations. The methods this study employs could inform test and measurement procedures and performance classifications for connected outlets, lighting products, and other building systems capable of reporting their own energy consumption. The study concludes with stakeholder recommendations, including the following: • Energy-reporting device and system manufacturers developing products that report energy consumption should characterize the accuracy of reported metrics using a reference meter calibrated by an independent laboratory that was accredited by an ILAC MRA signatory (and whose scope of accreditation explicitly covers energy measurement), and should include this information on product data sheets. • Standards and specification development organizations should develop application-specific performance classifications that end users can understand and relate to their energy-data use needs (e.g., 2% accuracy class for utility streetlight energy billing needs, or 10% accuracy class for ESCO performance verification needs). • Current or potential owners, operators, and specifiers of energy-reporting building systems should rigorously analyze the dependency of current and planned energy-data use cases on accuracy, noting in particular the dependence (or lack thereof) on relative vs. absolute accuracy, and on trueness vs. precision (i.e., repeatability), and should communicate use-case needs to industry standards and specification organizations.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2024

Special Observing Period (SOP) data for the Year of Polar Prediction site Model Intercomparison Project (YOPPsiteMIP)

The rapid changes occurring in the polar regions require an improved understanding of the processes that are driving these changes. At the same time, increased human activities such as marine navigation, resource exploitation, aviation, commercial fishing, and tourism require reliable and relevant weather information. One of the primary goals of the World Meteorological Organization's Year of Polar Prediction (YOPP) project is to improve the accuracy of numerical weather prediction (NWP) at high latitudes. During YOPP, two Canadian “supersites” were commissioned and equipped with new ground-based instruments for enhanced meteorological and system process observations. Additional pre-existing supersites in Canada, the United States, Norway, Finland, and Russia also provided data from ongoing long-term observing programs. These supersites collected a wealth of observations that are well suited to address YOPP objectives. In order to increase data useability and station interoperability, novel Merged Observatory Data Files (MODFs) were created for the seven supersites over two Special Observing Periods (February to March 2018 and July to September 2018). All observations collected at the supersites were compiled into this standardized NetCDF MODF format, simplifying the process of conducting pan-Arctic NWP verification and process evaluation studies. This paper describes the seven Arctic YOPP supersites, their instrumentation, data collection and processing methods, the novel MODF format, and examples of the observations contained therein. MODFs comprise the observational contribution to the model intercomparison effort, termed YOPP site Model Intercomparison Project (YOPPsiteMIP). All YOPPsiteMIP MODFs are publicly accessible via the YOPP Data Portal (Whitehorse: https://doi.org/10.21343/a33e-j150, Huang et al., 2023a; Iqaluit: https://doi.org/10.21343/yrnf-ck57, Huang et al., 2023b; Sodankylä: https://doi.org/10.21343/m16p-pq17, O'Connor, 2023; Utqiagvik: https://doi.org/10.21343/a2dx-nq55, Akish and Morris, 2023c; Tiksi: https://doi.org/10.21343/5bwn-w881, Akish and Morris, 2023b; Ny-Ålesund: https://doi.org/10.21343/y89m-6393, Holt, 2023; and Eureka: https://doi.org/10.21343/r85j-tc61, Akish and Morris, 2023a), which is hosted by MET Norway, with corresponding output from NWP models.

54 ENVIRONMENTAL SCIENCES↗