SEARCH · Engineering Papers

Results for “Software Verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,387 records · Page 77

All sources NASA NTRS DOE OSTI

DOE OSTI2021

VERIFICATION MEASUREMENTS OF THE MASS AND ENRICHMENT OF URANIUM OXIDE CARD SOURCES

Measurements were performed to determine the mass and enrichment of 10 uranium oxide (U3O8) card sources. The measurements and analysis were completed as a verification of the card sources in support of Oak Ridge National Laboratory’s nuclear material control and accountability program. Although these cards are not nationally accredited as a nuclear standard, they are used as a working reference for measurements, such as holdup. The uranium card source measurements were taken with a broad energy germanium detector and the Genie 2000 Gamma Acquisition and Analysis software. A complete characterization of each of the 10 uranium card sources was performed using the 4 characteristic full energy peaks of 235U. Using the In Situ Object Counting System software to determine the mathematical efficiency of the measurement, the mass of 235U in each card was determined. The 235U mass in each card ranged from 10.42 to 12.63 g with a systematic error between 0.76 and 0.95 g and a random error of 0.01 g for each card source. The Multi-Group Analysis for Uranium (MGAU) software and the Fixed-Energy, Response Function Analysis with Multiple Efficiency (FRAM) isotopic analysis software were used to determine the isotopic composition of the uranium cards. The measured enrichment was compared to the declared enrichment for each card, with uncertainties ranging from 2.7% to 4.3% for the MGAU analysis and 2.3% to 4.1% for the FRAM analysis. This is a good example of how a well-benchmarked mathematical calibration method can be useful in characterizing uranium sources.

Hunneke, Rachel↗

NASA NTRSDate not supplied

VISUALIZING INTERANNUAL TO DECADAL COASTAL VARIABILITY NEAR VULNERABLE NASA INFRASTRUCTURE UTILIZING VIDEOS PRODUCED FROM REMOTELY SENSED DATA AT CAPE CANAVERAL, FL AND WALLOPS ISLAND, VA

Coastlines represent an interesting convolution of intense anthropogenic development superimposed onto morphologies that are among the most dynamic on the planet. Two of NASA’s critical facilities are particularly vulnerable to coastal change, Kennedy Space Center, Cape Canaveral, FL and Wallops Flight Facility, Wallops Island, VA. With continuing global sea level rise and increasing storminess coastal vulnerabilities at these facilities will only be exacerbated. These launch centers a subject to multiple coastal hazards including, flooding, episodic coastal erosion, saltwater intrusion, and coastal morphological changes. Although rapid change is readily observed during large storms or hurricanes, long term annual to decadal coastal change is much harder to visualize and conceptualize. The authors use videos developed from remotely sensed data to enhance conceptualization of coastal processes for planning and management stakeholders at these NASA facilities. Near or better than decadal coastal imagery has been available through high altitude photogrammetry efforts since the 1930’s. A significant amount of additional imagery was acquired through other federal, state, and local government agencies such as the USGS, NOAA, State DOT, and local Assessors Offices providing annual and inter annual images at spatial resolutions of 10cm – 1m. With the advent of GIS systems these images could be rectified and then layered to better understand change through time using a multitude of visual base shoreline proxies. With the increased awareness and use of video editing software the rectified images can be used to create videos. These videos can then be used to conceptualize a multitude of coastal processes including: performance of coastal restoration efforts, rapid change in sedimentation rates due to storms or other geomorphic processes, loss of protective barrier islands as sea level rises and lower sedimentation rates occur. The videos are also useful as a tool for verification and comparison to coastal models and provide an easy to understand educational resource for stakeholder engagement at these NASA centers, and other vulnerable coastal populations.

Richard A. MacKenzie III↗

DOE OSTI2016

Accuracy of automated measurement and verification (M&V) techniques for energy savings in commercial buildings

Trustworthy savings calculations are critical to convincing investors in energy efficiency projects of the benefit and cost-effectiveness of such investments and their ability to replace or defer supply-side capital investments. However, today’s methods for measurement and verification (M&V) of energy savings constitute a significant portion of the total costs of efficiency projects. They also require time-consuming manual data acquisition and often do not deliver results until years after the program period has ended. The rising availability of “smart” meters, combined with new analytical approaches to quantifying savings, has opened the door to conducting M&V more quickly and at lower cost, with comparable or improved accuracy. These meter- and software-based approaches, increasingly referred to as “M&V 2.0”, are the subject of surging industry interest, particularly in the context of utility energy efficiency programs. Program administrators, evaluators, and regulators are asking how M&V 2.0 compares with more traditional methods, how proprietary software can be transparently performance tested, how these techniques can be integrated into the next generation of whole-building focused efficiency programs. This paper expands recent analyses of public-domain whole-building M&V methods, focusing on more novel M&V2.0 modeling approaches that are used in commercial technologies, as well as approaches that are documented in the literature, and/or developed by the academic building research community. We present a testing procedure and metrics to assess the performance of whole-building M&V methods. We then illustrate the test procedure by evaluating the accuracy of ten baseline energy use models, against measured data from a large dataset of 537 buildings. The results of this study show that the already available advanced interval data baseline models hold great promise for scaling the adoption of building measured savings calculations using Advanced Metering Infrastructure (AMI) data. Median coefficient of variation of the root mean squared error (CV(RMSE)) was less than 25% for every model tested when twelve months of training data were used. With even six months of training data, median CV(RMSE) for daily energy total was under 25% for all models tested. Finally, these findings can be used to build confidence in model robustness, and the readiness of these approaches for industry uptake and adoption

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

NASA NTRS1983

The Proof of the SIFT Implementation

The Software Implemented Fault Tolerance SIFT specifications consist primarily of constraints on the schedule table and descriptions of the changes each routine makes to the global variables. The proof proceeds by proving that each routine is consistent with its specification. Each of these proofs is separate from the others and the order of the proofs is unimportant. A routine is proved by generating a set of verification conditions from the PASCAL code and the SPECIAL specifications. Each verification condition is a set of assertions derived from a particular path in the routine. A verification condition (VC) is generated for each possible path through the routine.

Source record↗

NASA NTRS2011

Payload and Components Real-Time Automated Test System (PACRATS), Data Acquisition of Leak Rate and Pressure Data Test Procedure

The purpose of this activity is to provide the Mechanical Components Test Facility (MCTF) with the capability to obtain electronic leak test and proof pressure data, Payload and Components Real-time Automated Test System (PACRATS) data acquisition software will be utilized to display real-time data. It will record leak rates and pressure/vacuum level(s) simultaneously. This added functionality will provide electronic leak test and pressure data at specified sampling frequencies. Electronically stored data will provide ES61 with increased data security, analysis, and accuracy. The tasks performed in this procedure are to verify PACRATS only, and are not intended to provide verifications for MCTF equipment.

Rinehart, Maegan L.↗

NASA NTRS1984

NASA/MSFC ground experiment for large space structure control verification

Marshall Space Flight Center has developed a facility in which closed loop control of Large Space Structures (LSS) can be demonstrated and verified. The main objective of the facility is to verify LSS control system techniques so that on orbit performance can be ensured. The facility consists of an LSS test article which is connected to a payload mounting system that provides control torque commands. It is attached to a base excitation system which will simulate disturbances most likely to occur for Orbiter and DOD payloads. A control computer will contain the calibration software, the reference system, the alignment procedures, the telemetry software, and the control algorithms. The total system will be suspended in such a fashion that LSS test article has the characteristics common to all LSS.

Waites, H. B.↗

NASA NTRS2003

Topography Experiment (TOPEX) Software Document Series Volume 7: TOPEX Mission Radar Altimeter Engineering Assessment Report, February 1994

This document describes the GSFC/WFF analysis of the on-orbit engineering data from the TOPEX radar altimeter, to establish altimeter performance. In accordance with Project guidelines, neither surface truth nor precision orbital data are used for the engineering assessment of the altimeter. The use of such data would imply not only a more intensive and complete performance evaluation, but also a calibration. Such evaluations and.calibrations are outside the scope of this document and will be presented in a separate Verification Report.

Hancock, David W., III↗

DOE OSTI2017

Initial 1.5D BISON Simulation Verification and Validation CASL FY17 Letter Report

This milestone report describes the current efforts to improve the usability of the recently developed 1.5 dimensional capability in BISON, the initial verification of this BISON capability, and initial validation of the 1.5 dimensional models against existing 2 dimensional axisymmetric full length light water reactor (LWR) fuel rods. The 1.5 dimensional (1.5D) capability in BISON was developed to enable the simulation of LWR fuel rods in a less computationally demanding simulation formulation while retaining key physics of interest. BISON was originally developed to solve 2D axisymmetric and 3D models, and this original development focus allows BISON to examine a wider range of fuel types and geometrically complexity than can be solved with lower dimensional frameworks. As the set of problems which BISON is used to solve expands, the software design requirements continue to evolve. Coupling physics in a higher dimensional geometry is not always required to resolve the physics of interest, such as the modeling of radial heat transfer and radial displacement. BISON, built on the dimension-agnostic MOOSE framework, is able to solve problems in 3D, 2D, and 1D with only minor modifications to the material definition code so that the appropriate geometrical representation can be applied in different problems of interest. The motivation for the development and validation of the BISON 1.5D capability is the CASL program's need for a simplified and computationally efficient version of BISON for use in the large multi-physics VERA simulations which include hundreds of individual fuel rods. The original development of the BISON 1.5D simulation capability is described in the CASL FY17 Letter Report from January 2017, and this report documents the continuing work identified in the previous report. The improvements to the usability of the 1.5D capability through input file simplifications, the results of the verification simulations, the results of the initial validation against the 2D assessment cases in BISON, and the future development needs are included within this report.

1.5D Capability↗

DOE OSTI2024

Digital Twin + AI: Control Room of the Future [Slides]

The control room functions as the central brain of the grid, essential for balancing supply and demand and ensuring moment-to-moment grid reliability. Like the human brain, which processes sensory data to make decisions, control room operators analyze operational data from power generation, transmission, and distribution to make informed decisions. Currently, decision-making primarily rests with operators due to hardware and software limitations. However, with technological advancements, Digital Twins and AI are becoming high interest points in the control room's decision-making pilot programs. NREL is developing a comprehensive decision-making platform that integrates Digital Twins, AI, and advanced visualization techniques. As this integration progresses, the role of Digital Twins will evolve from conducting automated simulations to serving as a Trustworthy AI enabler, offering verification and validation of AI-generated response for power systems or providing physics-aware synthetic data of AI pre-training.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS1973

A semi-automated system for plotting and computer cataloging of remote sensing imagery

Description of a computer-assisted system for plotting and descriptor-cataloging of aerial imagery - an ingredient of the aerial image data handling system of the NASA Earth Resources Aircraft Project (ERAP). The system under consideration uses two graphic tablets linked interactively with a digital computer as input devices for deriving frame coordinates by correlating image points to map points. The various software programs and operating modes facilitate a semiautomatic plotting of an image by selecting two or more points within the image for matching with map details. The computer performs the scaling and orientation transformations for the calculation of the center and corner coordinates of the frame. Twenty five other descriptors for each frame are fed into a computerized data base requiring a minimum operator's time for verification and correction.

Gnauck, G. E.↗

NASA NTRS1997

Use of the Aromascan(TM) Instrument for Nonsubjective Evaluation of Rodent Spaceflight Hardware

This report describes the verification and utilization of the AromaScan(TM) (Hollis, NH) instrument for the ground-based evaluation of odor containment by various spaceflight habitats developed at NASA's Ames Research Center (ARC). The AromaScan(TM) instrument is an electronic odor detection system consisting of 32 polymer sensors that respond differentially to 10 different chemical groups present in an air sample. The AromaScan(TM) system also includes neural network software for constructing a database of known odors, against which an unknown odor can be compared. At present, the standard method for characterizing rodent odor containment during the development and testing of spaceflight hardware is the use of a human odor assessment panel. However, this can be a very time consuming and costly process, and the results are inherently subjective. The AromaScan(TM) system should produce more consistent and objective results, as well as a cost savings in the long term. To test and verify the AromaScan(TM) instrument, daily air samples will be collected from the exhaust port of rodent habitats, during experiment development tests, then injected into the instrument and used to create a database of recognizable odors. Human sniff tests will be performed in conjunction with the AromaScan(TM) analysis, and the results will be correlated. We will then teach the neural network to differentiate between an acceptable and an unacceptable odor profile, as defined by the human sniff test, and to be able to accurately identify an odor that would not pass a sniff panel. The results of our efforts will be to verify that the AromaScan(TM) system is a valuable alternative to human sniff panel assessments for the early iterative process of designing and testing rodent waste filters for spaceflight. Acceptance by a human panel will remain one of the final criteria for successful rodent habitat development.

Scribner, K. A.↗

NASA NTRS1985

NASA/MSFC ground experiment for Large Space Structure control verification

NASA Marshall Space Flight Center has developed a facility in which closed loop control of Large Space Structures (LSS) can be demonstrated and verified. The main objective of the facility is to verify LSS control system techniques so that on-orbit performance can be ensured. The facility consists of an LSS test article which is connected to a payload mounting system that provides control torque commands. It is attached to a base excitation system which will simulate disturbances most likely to occur for Orbiter and DOD payloads. A control computer will contain the calibration software, the reference system, the alignment procedures, the telemetry software, and the control algorithms. The total system will be suspended in such a fashion that LSS test article has the characteristics common to all LSS.

Waites, H. B.↗

DOE OSTI2017

Safety software release options to support plant start-up and commissioning activities - 285

The schedule demands on new nuclear power plant site testing and commissioning programs challenge the plant's Instrumentation and Control (I and C) supplier's ability to provide certified safety software releases to meet the needs of these programs. This paper outlines the typical certified safety software development and certification process which follows a Waterfall software life-cycle model. The conflicts that result between supporting the site program and the safety software supplier's internal certification program are identified. An adapted 'functional' safety release process is presented that supports the site program's needs for software changes and in parallel enables the safety software certification process to proceed. Comparisons between the two safety software release processes are examined and the benefits realized through the use of the adapted 'functional' safety software release process are discussed. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2024

Formally Verified ZTA Requirements for OT/ICS Environments with Isabelle/HOL

The clean energy transformation includes the integration of distributed energy resources with the power grid, which has led to a substantial increase in the complexity of power grids infrastructure and the underlying operational technology environment. Power grids infrastructure represents an operational technology environment that has become a system of systems, integrating heterogeneous devices which are both software-and hardware-intensive; as a result, there are increasing demands to exploit advances in the commodity of software-hardware infrastructures to improve energy systems requirements such as cybersecurity and resilience. In such a setting, system requirements at different levels mix, which leads to vulnerabilities and undesirable outcomes. The use of formal methods to characterize and prove system requirements removes ambiguity, increases automation, and provides high levels of assurance and reliability. In this paper, we contribute a methodology and a framework for the system-level verification of zero trust architecture requirements in operational technology environments. We define a formal specification for the core functionalities of operational technology environments, the corresponding invariants, and security proofs. Of particular note is our modular approach for the formal verification of asynchronous interactions in operational technology environments. The formal specification and the proofs have been mechanized using the interactive theorem proving environment Isabelle/HOL.

formal methods↗

NASA NTRS1997

A Case Study of 4 & 5 Cost Effectiveness

This paper looks at the Independent Verification and Validation (IV&V) of NASA's Space Shuttle Day of Launch I-Load Update (DoLILU) project. IV&V is defined. The system's development life cycle is explained. Data collection and analysis are described. DoLILU Issue Tracking Reports (DITRs) authored by IV&V personnel are analyzed to determine the effectiveness of IV&V in finding errors before the code, testing, and integration phase of the software development life cycle. The study's findings are reported along with the limitations of the study and planned future research.

Neal, Ralph D.↗

NASA NTRS1983

STP: A Mechanized Logic for Specification and Verification

A logic and proof theory that was mechanized and successfully applied to prove nontrivial properties of a fully distributed fault tolerant system is described. The system is close to achieving the critical balance in man machine interaction necesary for successful application by users other than the system developers. Motivation for the form of man machine interaction embodied by STP is discussed. A formal description of the logic and the proof theory is contained, and the description illustrated with an example. The use of STP in a large scale effort to prove nontrivial properties on SIFT, a distributed Software Implemented Fault Tolerant operating system for aircraft flight control is discussed. Finally, directions for further work are described.

Shostak, R. E.↗

DOE OSTI2015

SU-E-J-153: Reconstructing 4D Cone Beam CT Images for Clinical QA of Lung SABR Treatments

Purpose: To verify that the planned Primary Target Volume (PTV) and Internal Gross Tumor Volume (IGTV) fully enclose a moving lung tumor volume as visualized on a pre-SABR treatment verification 4D Cone Beam CT. Methods: Daily 3DCBCT image sets were acquired immediately prior to treatment for 10 SABR lung patients using the on-board imaging system integrated into a Varian TrueBeam (v1.6: no 4DCBCT module available). Respiratory information was acquired during the scan using the Varian RPM system. The CBCT projections were sorted into 8 bins offline, both by breathing phase and amplitude, using in-house software. An iterative algorithm based on total variation minimization, implemented in the open source reconstruction toolkit (RTK), was used to reconstruct the binned projections into 4DCBCT images. The relative tumor motion was quantified by tracking the centroid of the tumor volume from each 4DCBCT image. Following CT-CBCT registration, the planning CT volumes were compared to the location of the CBCT tumor volume as it moves along its breathing trajectory. An overlap metric quantified the ability of the planned PTV and IGTV to contain the tumor volume at treatment. Results: The 4DCBCT reconstructed images visibly show the tumor motion. The mean overlap between the planned PTV (IGTV) and the 4DCBCT tumor volumes was 100% (94%), with an uncertainty of 5% from the 4DCBCT tumor volume contours. Examination of the tumor motion and overlap metric verify that the IGTV drawn at the planning stage is a good representation of the tumor location at treatment. Conclusion: It is difficult to compare GTV volumes from a 4DCBCT and a planning CT due to image quality differences. However, it was possible to conclude the GTV remained within the PTV 100% of the time thus giving the treatment staff confidence that SABR lung treatements are being delivered accurately.

60 APPLIED LIFE SCIENCES↗

NASA NTRS1988

Controls and guidance: Space

The Space Controls and Guidance Research and Technology Program is directed toward enabling the next generation of space transportation systems, large future spacecraft, and space systems such as the Space Station to have large communication antennas and high precision segmented reflector astrophysical telescopes. The new generation of transportation vehicles has demanding requirements to provide for an order of magnitude reduction in cost as well as an increase in capability. The future orbital facilities have demanding control requirements for pointing and stabilization, momentum management, build-up and growth accomodation, and disturbance management. To address these advanced requirements, the research and development program is designed to provide the generic technology base to support the implementation of advanced guidance, navigation, and control. The area of computational controls will be stressed in order to develop cost effective, high speed, high fidelity control system simulation and analysis and synthesis tools. The trust of this work will be to develop methods and software to enable analysis and real-time hardware-in-the-loop simulation of complex spacecraft for control design certification. To address future orbital facilities requirements, an advanced technology program is underway in system identification, distributed control, integrated controls/structures design methods, and advanced sensors and actuators. Because the behavior of large, light weight per unit area deployable/assembled spacecraft is greatly influenced by the ground environment, the testing and verification activity is both ground- and space-based.

Dibattista, John D.↗