Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Verification of data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,639 records · Page 91

Recommendations on the Use of Commercial-Off-The-Shelf (COTS) Electrical, Electronic, and Electromechanical (EEE) Parts for NASA Missions - Phase II

This assessment had two Phases. Phase I captured NASA Centers’ current practices for commercial-off-the-shelf (COTS) Electrical, Electronic, and Electromechanical (EEE) parts 1 used in spaceflight systems and ground support equipment (available at https://ntrs.nasa.gov/citations/20205011579) [ref. 1]. The Phase II report provides guidance for selecting and using COTS parts in NASA missions. The approaches proposed in this report differ from current agency practices. This top-level executive summary touches on these new approaches for using COTS parts but does not provide the detailed information that is critical in understanding the rationale behind these new approaches. Readers will need to read the entire report to gain full understanding and effectively use the recommendations herein. NASA’s historical approach to selecting and applying parts has been to define certain parts, primarily specific classes of military specification (MIL-SPEC) parts, as “standard”, leaving all others, including COTS parts, as nonstandard. Standard parts typically are used without further testing (“use-as-is”). Nonstandard parts are subjected to initial screening and subsequent lot acceptance testing of representative samples from each procured lot per MIL-SPEC or similar requirements. Decades later, top-tier commercial part manufacturers have evolved significant manufacturing, statistical control, and technological improvements that can now provide parts as reliable or more reliable than MIL-SPEC parts, when used within their datasheet limits. Concurrently, the space science and exploration community’s needs demand technological advances unavailable with MIL-SPEC parts. This ongoing change necessitates using COTS parts for space missions. Properly selected COTS parts in appropriate applications can offer performance and supply availability advantages compared to MIL-SPEC parts. Their utility and demonstrated reliability result from large volumes and automated production and testing processes. However, careful review and a thorough understanding of their specifications (i.e., datasheet limitations) is needed, and verifying that manufacturer specifications and reliability meet space hardware application needs are necessary. This report recommends MIL-SPEC screening and non-radiation-related lot acceptance testing be reduced or eliminated in cases where evidence of sufficient quality and reliability exists for COTS parts. The extent of NASA's insight into COTS manufacturers and the amount and nature of the needed evidence will differ by mission and will likely be driven by a mission's resources and associated risk posture. To facilitate this goal, two new terminologies have been defined and described: “Industry Leading Parts Manufacturer (ILPM)” and “Established COTS parts.” An ILPM is a COTS manufacturer that produces high quality and reliable parts. Some parts produced by ILPMs, defined as Established COTS parts, do not need any additional MIL-SPEC or NASA screening and lot acceptance testing to be used in space applications. This report provides guidance for selecting, procuring, and applying COTS parts and for performing part-, board-, and system-level COTS parts verification. The recommendation to select Established COTS parts from ILPMs will assure those COTS parts will have comparable quality to corresponding MIL-SPEC parts. Selecting, applying, and verifying Established COTS parts from ILPMs requires a holistic team approach, engaging parts engineers, circuit designers, quality, reliability, and systems engineers, procurement specialists, radiation specialists, avionics leads, and program/project managers. A mission-specific approach tailored to a project’s Mission, Environment, Applications and Lifetime (MEAL) [ref. 2] requirements should be developed and approved by program/project managers. Any associated risks should be clearly identified, quantified, mitigated, and/or accepted. Different approaches are recommended according to program/project Risk Classes A, B, C, and D [ref. 3] and human-rated missions [ref. 4]: 1. Recommend Classes A and B and human-rated missions consider a “MIL-SPEC parts- based design” approach. ”MIL-SPEC parts-based design” approach is one in which most parts are MIL-SPEC parts and Established COTS parts from ILPMs are used only when an equivalent MIL-SPEC part does not meet functional or size, weight, and power (SWaP) or performance requirements, or is not available. 2. Recommend Classes D and Sub-D missions consider a “System of COTS” approach. “System of COTS” approach is one which most parts are Established COTS parts from ILPMs. 3. Recommend Class C missions determine which approach is the best for their projects; that is, use either a “MIL-SPEC parts-based design” approach, “System of COTS” approach, or a combined approach utilizing elements of both. This report intends to provide guidance in using COTS parts for NASA missions with risk classifications of A through D and human-rated missions; but it does not address the costs of using COTS parts. Costs of using COTS parts in different NASA mission classes can vary significantly even if the same parts are used in different risk postures, due to differing verification levels needed. The guidance does not distinguish between critical or non-critical systems, and a given project will need to apply the appropriate guidance based on their risk posture. The intended audience of this report are NASA personnel and commercial practitioners who support NASA’s spaceflight missions, including spaceflight program or project managers, parts engineers, parts manufacturers, radiation engineers, avionics engineers, system engineers, circuit design engineers, reliability engineers, safety and mission assurance (SMA) personnel, and parts procurement specialists. The NEPP Program will perform a pathfinder study to explore implementing the guidance in this NESC report. An ILPM verification process is not the same as conventional vendor qualification processes performed according to military standards and specifications. This NESC report intends to provide guidance in utilizing available parts data from ILPM manufacturers for parts assurance assessments needed for NASA missions. The report also captured the current practices from DoD and Federal Aviation Administration (FAA) in Section 10. Note each DoD and FAA report was provided by the corresponding agencies regarding their practices, which are independent from the NESC recommendations in the report.

Commercial-Off-The-Shelf↗

High-Rate Delay Tolerant Networking (HDTN) Software Requirements Analysis

This document serves as a detailed analysis of the main networking protocols implemented by HDTN. Sources of the protocol specifications include Internet Engineering Task Force (IETF) Request for Comments (RFC) and Consultative Committee for Space Data Systems (CCSDS) standards. The focus of this report is to derive software requirements suitable for NASA Procedural Requirements 7150.2D Class B compliance, including requirements traceability and software verification and validation, from the source specifications. This analysis will be incorporated into the finalized HDTN Software Requirements Specification (SRS) but does not encompass the full scope of the HDTN SRS. Requirements in this document are considered draft. The complete requirements will include bundle application requirements, interface requirements, computer resource requirements, software quality factors, and additional requirements as determined by the project. This document is publicly released to the greater community to receive feedback and foster collaboration opportunities.

Rachel Dudukovich↗

Central California Disasters: Incorporating Satellite-Derived Precipitation and Soil Moisture Products into Flood Preparedness and Emergency Management in California

Atmospheric rivers are a major contributor to extreme precipitation events and flooding in California. This study assessed the feasibility of using Earth observation data to monitor precipitation, soil moisture, and flooding from atmospheric rivers in the Salinas River Watershed in central California during the winter of 2022-2023. The team analyzed satellite derived precipitation estimates from the Global Precipitation Measurement mission, soil moisture data from the Soil Moisture Active Passive radiometer, and synthetic aperture radar imagery from Sentinel-1 to detect flood inundation. Global Precipitation Measurement precipitation estimates were found to underestimate rainfall by 33% to 52% compared to rain gauge data. The team found the Soil Moisture Active Passive dataset to be a valuable flooding indicator that they could visualize through various graphical representations, although its accuracy still needs verification with in situ flood maps. Sentinel-1 synthetic aperture radar imagery provided mapping of flood inundation extent along the Salinas River and surrounding areas and the Blue Spot model appears to be a good predictor of pluvial flood zones. The findings suggest Earth observations can enhance precipitation and flooding monitoring by the California Department of Water Resources, though further verification is needed. Integration of these datasets with vulnerability indices highlighted communities at highest risk during the 2022-2023 flooding events.

Abhinav Banthiya↗

Machine learning-assisted identification of potential sources of bias in measurements of prompt-fission neutron spectra

Unrecognized sources of uncertainty (USU) can bias the reported mean and/or covariance of experimental nuclear data. These biases, in turn, can propagate through evaluated nuclear data to application simulations or may poorly inform nuclear theory that is fitted to the experimental data. Such unknown sources of bias must be tied to the inherent physical constituents of the measurements such as the characteristics of a detector response or a background reduction technique. Here, in this article, a sparse Bayesian learning model is used to support experts in their efforts to identify and characterize USU in experimental prompt fission neutron spectra (PFNS) for spontaneous fissioning of 252 Cf by linking observed biases to features of the measurement system. Three different bias components were found. The first acts as a verification case for the algorithm as it identifies a bias coming from a well-known source related to the use of 6 Li in the neutron detection system. The second two cases demonstrate how this method can benefit the evaluation of experimental nuclear data by identifying, quantifying, and relating unknown biases to potential causes.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

AmesDT: Digital Twin and Autonomy Validation Environment

A simulation of NASA Ames Research Center was developed to provide a common testbed for multiple areas of research within the Intelligent Systems Division, primarily related to verification and validation of autonomous technologies, machine learning, and digital twin systems. AmesSim corresponds a physical rover that is capable of navigation in the real-world environment; in this way, the same experiments can be run in both settings, with the same software and hardware stacks in the loop. The simulation is built in Unreal Engine 4 and uses the AirSim plugin for API convenience. Several custom modifications allow deterministic, faster-than-realtime execution, which enables consistent testing of on-line algorithms and large-scale data collection. This paper describes the architecture and capabilities of the simulation and discusses development challenge.

simulation↗

Validation of FAST.Farm Against Full-Scale Turbine SCADA Data for a Small Wind Farm

FAST.Farm is a new midfidelity engineering tool developed by the National Renewable Energy Laboratory targeted at accurately and efficiently predicting wind turbine power production and structural loading in wind farm settings, including wake interactions between turbines. FAST.Farm is based on some of the principles of the Dynamic Wake Meandering model—including passive tracer modeling of wake meandering—but addresses many of the limitations of previous Dynamic Wake Meandering (DWM) implementations. Previous FAST.Farm verification studies show the similarities and differences between FAST.Farm and large-eddy simulations for rigid and flexible turbines. In this validation study, FAST.Farm turbine responses are compared to multiturbine measurements from a subset of a full-scale wind farm. FAST.Farm predictions of turbine generator power, rotor speed, and blade pitch for five-turbine simulations are compared to supervisory control and data acquisition results. Results reveal that FAST.Farm generator power mean and standard deviation results reasonably match measured data for upstream and downstream turbines, as well as the mean rotor speed and blade pitch above rated wind speeds. However, FAST.Farm generally underpredicts the mean rotor speed and overpredicts the mean blade pitch below rated operation. These errors are likely related to inaccuracies in the generic controller simulated. Despite controller differences, FAST.Farm predicts the same overall relative rotor power trends for all waked turbines at all wind speeds.

17 WIND ENERGY↗

Evaluating the Contribution of NASA Remotely-Sensed Data Sets on a Convection-Allowing Forecast Model

The Short-term Prediction Research and Transition (SPoRT) Center is a collaborative partnership between NASA and operational forecasting partners, including a number of National Weather Service forecast offices. SPoRT provides real-time NASA products and capabilities to help its partners address specific operational forecast challenges. One challenge that forecasters face is using guidance from local and regional deterministic numerical models configured at convection-allowing resolution to help assess a variety of mesoscale/convective-scale phenomena such as sea-breezes, local wind circulations, and mesoscale convective weather potential on a given day. While guidance from convection-allowing models has proven valuable in many circumstances, the potential exists for model improvements by incorporating more representative land-water surface datasets, and by assimilating retrieved temperature and moisture profiles from hyper-spectral sounders. In order to help increase the accuracy of deterministic convection-allowing models, SPoRT produces real-time, 4-km CONUS forecasts using a configuration of the Weather Research and Forecasting (WRF) model (hereafter SPoRT-WRF) that includes unique NASA products and capabilities including 4-km resolution soil initialization data from the Land Information System (LIS), 2-km resolution SPoRT SST composites over oceans and large water bodies, high-resolution real-time Green Vegetation Fraction (GVF) composites derived from the Moderate-resolution Imaging Spectroradiometer (MODIS) instrument, and retrieved temperature and moisture profiles from the Atmospheric Infrared Sounder (AIRS) and Infrared Atmospheric Sounding Interferometer (IASI). NCAR's Model Evaluation Tools (MET) verification package is used to generate statistics of model performance compared to in situ observations and rainfall analyses for three months during the summer of 2012 (June-August). Detailed analyses of specific severe weather outbreaks during the summer will be presented to assess the potential added-value of the SPoRT datasets and data assimilation methodology compared to a WRF configuration without the unique datasets and data assimilation.

Zavodsky, Bradley T.↗

Development of a New Data Tool for Computing Launch and Landing Availability with Respect to Surface Weather

The Marshall Space Flight Center Natural Environments Branch has a long history of expertise in the modeling and computation of statistical launch availabilities with respect to weather conditions. Their existing data analysis product, the Atmospheric Parametric Risk Assessment (APRA) tool, computes launch availability given an input set of vehicle hardware and/or operational weather constraints by calculating the climatological probability of exceeding the specified constraint limits, APRA has been used extensively to provide the Space Shuttle program the ability to estimate impacts that various proposed design modifications would have to overall launch availability. The model accounts for both seasonal and diurnal variability at a single geographic location and provides output probabilities for a single arbitrary launch attempt. Recently, the Shuttle program has shown interest in having additional capabilities added to the APRA model, including analysis of humidity parameters, inclusion of landing site weather to produce landing availability, and concurrent analysis of multiple sites, to assist in operational landing site selection. In addition, the Constellation program has also expressed interest in the APRA tool, and has requested several additional capabilities to address some Constellation-specific issues, both in the specification and verification of design requirements and in the development of operations concepts. The combined scope of the requested capability enhancements suggests an evolution of the model beyond a simple revision process. Development has begun for a new data analysis tool that will satisfy the requests of both programs. This new tool, Probabilities of Atmospheric Conditions and Environmental Risk (PACER), will provide greater flexibility and significantly enhanced functionality compared to the currently existing tool.

Burns, K. Lee↗

Verification of the Serpent-Griffin Workflow using the SNAP 8 Experimental Reactor

The Systems for Nuclear Auxiliary Power (SNAP) program accumulated extensive experimental measurements over a span of 15 years. This work builds upon previous studies which validated Serpent against experimental data for various criticality configurations of the SNAP 8 Experimental Reactor (S8ER). A 2-stage sequence is applied here with Serpent used for the generation of few-group cross sections and Griffin as the transport eigenvalue solver. Sensitivity studies are performed to qualify the effect and uncertainty of various parameters, comparing against reference models for the S8ER. The results from this work will then be expanded to create a generalized methodology for the Serpent-Griffin 2-stage approach for microreactor applications.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Examining the Impacts of High-Resolution Land Surface Initialization on Model Predictions of Convection in the Southeastern U.S.

One of the most challenging weather forecast problems in the southeastern U.S. is daily summertime pulse convection. During the summer, atmospheric flow and forcing are generally weak in this region; thus, convection typically initiates in response to local forcing along sea/lake breezes, and other discontinuities often related to horizontal gradients in surface heating rates. Numerical simulations of pulse convection usually have low skill, even in local predictions at high resolution, due to the inherent chaotic nature of these precipitation systems. Forecast errors can arise from assumptions within physics parameterizations, model resolution limitations, as well as uncertainties in both the initial state of the atmosphere and land surface variables such as soil moisture and temperature. For this study, it is hypothesized that high-resolution, consistent representations of surface properties such as soil moisture and temperature, ground fluxes, and vegetation are necessary to better simulate the interactions between the land surface and atmosphere, and ultimately improve predictions of local circulations and summertime pulse convection. The NASA Short-term Prediction Research and Transition (SPORT) Center has been conducting studies to examine the impacts of high-resolution land surface initialization data generated by offline simulations of the NASA Land Informatiot~ System (LIS) on subsequent numerical forecasts using the Weather Research and Forecasting (WRF) model (Case et al. 2008, to appear in the Journal of Hydrometeorology). Case et al. presents improvements to simulated sea breezes and surface verification statistics over Florida by initializing WRF with land surface variables from an offline LIS spin-up run, conducted on the exact WRF domain and resolution. The current project extends the previous work over Florida, focusing on selected case studies of typical pulse convection over the southeastern U.S., with an emphasis on improving local short-term WRF simulations over the Mobile, AL and Miami, FL NWS county warning areas. Future efforts may involve examining the impacts of assimilating remotely-sensed soil moisture data, and/or introducing weekly greenness vegetation fraction composites (as opposed to monthly climatologies) into ol'fline NASA LIS runs. Based on positive impacts, the offline LIS runs could be transitioned into an operational mode, providing land surface initialization data to NWS forecast offices in real time.

Case, Jonathan L.↗

Verification and Validation of the PLTEMP/ANL Code for Thermal-Hydraulic Analysis of Experimental and Test Reactors, Volume 2

This is Volume 2 of a two-volume document that collects the verification and validation (V&V) works done for the PLTEMP/ANL code during the years of its development and improvement. Volume 1 describes the V&V of sixteen capabilities of the PLTEMP/ANL code that were identified by research reactor analysts as frequently used in their thermal-hydraulic analysis. Volume 2 describes the V&V of developments and improvements since the release of PLTEMP/ANL Version 4.3. Each chapter of the document focuses on verifying or validating a specific part of the software that calculates a particular phenomenon, e.g., channel flow calculation, coolant property calculation, heat transfer calculation, and flow instability calculation. Software verification is performed by comparing the code with a hand calculation, Microsoft spreadsheet calculation, Mathematica calculation, or MATLAB calculation. The software validation is achieved by comparing the code with experimental data or a widely tested code like the RELAP5 code. In addition, some PLTEMP/ANL V&V works that are available in the open literature are simply referenced in Volume 1 of the document. PLTEMP/ANL has been used in safety analysis reports of several US and foreign research reactors licensed and converted from highly enriched uranium fuel to low-enriched uranium fuel. A list of such reactors is given in Volume 1 of the document.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Investigation of uses of holographic optical elements

The data represent a thorough study of the aberrations and imaging properties of holographic optical elements. Principle studies include (1) the indepth experimental investigation of single holographic optical elements, (2) the verification of the accuracy of the theoretical computer-based description of hologram behavior, (3) the computer-generation of interferograms that are characteristic of a prescribed aberrated imaging condition, (4) the experimental verification of wavelength optimization, (5) the experimental determination of the space bandwidth product of single holographic optical elements as a function of bending and field angle, and (6) the first experimental study of the aberration properties of holographic optical elements constructed in very thick (750 microns) recording media.

Zech, R. G.↗

Mariner 9, an instrument of dynamical science

Mariner 9 viewed Mars and its satellites for a period of almost a year, transmitting doppler, time delay, visual images, and spectra to earth from its satellite orbit. This paper reviews the reduction of Mariner 9 data to more accurately define the dynamical characteristics of the Martian system. Primary results include the discovery of triaxiality of Martian gravity field and physical shape of Mars, and the verification of the discrepancy in optical and dynamic flattening. The impact of the Mariner 9 results on future space missions is evaluated in terms of the accuracy of control of a spacecraft in a 24.6 hour synchronous orbit about Mars.

Jordan, J. F.↗

STDN ranging equipment

Final results of the Spaceflight Tracking and Data Network (STDN) Ranging Equipment program are summarized. Basic design concepts and final design approaches are described. Theoretical analyses which define requirements and support the design approaches are presented. Design verification criteria are delineated and verification test results are specified.

Jones, C. E.↗

Mapping irrigated lands in Western Kansas from Landsat

A description is presented of a multidate visual interpretation technique for identifying and mapping irrigated lands in Western Kansas based on gray tone interpretation of Landsat imagery. The technique provides detailed maps of irrigated lands that can be updated yearly (from 1972 onwards) and used as the basis for calculations of water use and its temporal trends. A review of remote sensing work on irrigated lands indicates that three different types of study have evolved, involving various combinations of desired final data and the means of arriving at it. Attention is given to crop characteristics, the development of an interpretation technique, the interpretation procedure, the computer assisted output, and aspects of verification and accuracy. It is pointed out that the considered technique is likely to be applicable to similar situations of a semi-arid area dominated by a small number of crops.

Williams, T. H. L.↗

The evaluation of alternate methodologies for land cover classification in an urbanizing area

The usefulness of LANDSAT in classifying land cover and in identifying and classifying land use change was investigated using an urbanizing area as the study area. The question of what was the best technique for classification was the primary focus of the study. The many computer-assisted techniques available to analyze LANDSAT data were evaluated. Techniques of statistical training (polygons from CRT, unsupervised clustering, polygons from digitizer and binary masks) were tested with minimum distance to the mean, maximum likelihood and canonical analysis with minimum distance to the mean classifiers. The twelve output images were compared to photointerpreted samples, ground verified samples and a current land use data base. Results indicate that for a reconnaissance inventory, the unsupervised training with canonical analysis-minimum distance classifier is the most efficient. If more detailed ground truth and ground verification is available, the polygons from the digitizer training with the canonical analysis minimum distance is more accurate.

Smekofski, R. M.↗

Algorithm development for a spacecraft autonomous power system

Two algorithms were developed to demonstrate the implementation of autonomous functions in an existing spacecraft power system. The functions selected for autonomous operation include a typical performance monitoring function, battery state of charge, and a fault detection and response function represented by a battery state of charge below a preselected limit. The constraints imposed by the existing power system configuration are the available data in the telemetry stream and the existing commands and command structure. The areas requiring future development are the degree of battery characterization, the effects of hardware/software faults, and the verification of faults.

Bridgeforth, A. O.↗

Dynamic characterization and microprocessor control of the NASA/UVA proof mass actuator

The self-contained electromagnetic-reaction-type force-actuator system developed by NASA/UVA for the verification of spacecraft-structure vibration-control laws is characterized and demonstrated. The device is controlled by a dedicated microprocessor and has dynamic characteristics determined by Fourier analysis. Test data on a cantilevered beam are shown.

Zimmerman, D. C.↗