Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data coverage assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Evaluating Machine Learning-Based MRI Reconstruction Using Digital Image Quality Phantoms

Quantitative and objective evaluation tools are essential for assessing the performance of machine learning (ML)-based magnetic resonance imaging (MRI) reconstruction methods. However, the commonly used fidelity metrics, such as mean squared error (MSE), structural similarity (SSIM), and peak signal-to-noise ratio (PSNR), often fail to capture fundamental and clinically relevant MR image quality aspects. To address this, we propose evaluation of ML-based MRI reconstruction using digital image quality phantoms and automated evaluation methods. Our phantoms are based upon the American College of Radiology (ACR) large physical phantom but created in k-space to simulate their MR images, and they can vary in object size, signal-to-noise ratio, resolution, and image contrast. Our evaluation pipeline incorporates evaluation metrics of geometric accuracy, intensity uniformity, percentage ghosting, sharpness, signal-to-noise ratio, resolution, and low-contrast detectability. We demonstrate the utility of our proposed pipeline by assessing an example ML-based reconstruction model across various training and testing scenarios. The performance results indicate that training data acquired with a lower undersampling factor and coils of larger anatomical coverage yield a better performing model. The comprehensive and standardized pipeline introduced in this study can help to facilitate a better understanding of the performance and guide future development and advancement of ML-based reconstruction algorithms.

47 OTHER INSTRUMENTATION↗

Tracking motions from satellite water vapor imagery: Quantitative applications to hurricane track forecasting

Water vapor imagery from GOES satellites has been available for over a decade. These data are used extensively, mainly in a qualitative mode, by forecasters in the United States (Weldon and Holmes, 1991). Some attempts have been made at quantifying the data by tracking features in time sequences of the imagery (Stewart et al., 1985; Hayden and Stewart, 1987). For a variety of reasons, applications of this approach have produced marginal results (Velden, 1990). Recently, METEOSAT-3 (M-3) was repositioned at 50W by the European Space Agency, in order to provide complete coverage of the Atlantic Ocean. Data from this satellite are being transmitted to the U.S. for operational use. Compared with the GOES satellite, the M-3 has a superior resolution and signal-to-noise ratio in its water vapor channel, which translates into improved automated tracking capabilities. During a period in 1992 which included the Atlantic hurricane season, water vapor tracking algorithms were applied to the M-3 data in order to evaluate the coverage, accuracy and model impact of the derived vectors. Data sets were produced during several tropical cyclone cases, including Hurricane Andrew. In this paper, the M-3 water vapor wind sets are assessed, and their impact on a hurricane track forecast model is examined.

Velden, Christopher↗

Capabilities and Limitations of Space-Borne Passive Remote Sensing of Dust

Atmospheric dust particles have significant effects on the climate and the environment and despite notable recent advances in modeling and observation, wind-blown dust radiative effects remain poorly quantified in both magnitude and sign [IPCC, 2001]. To address this issue, many scientists are using passive satellite observations to study dust properties and to constrain emission/transport models, because the information provided is both time-resolved and global in coverage. In order to assess the effects of individual dust outbreaks on atmospheric radiation and circulation, relatively high temporal resolution (of the order of hours or days) is required in the observational data. Data should also be available over large geographical areas, as dust clouds may cover hundreds of thousands of square kilometers and will exhibit significant spatial variation in their vertical structure, composition and optical properties, both between and within dust events. Spatial and temporal data continuity is necessary if the large-scale impact of dust loading on climate over periods ranging from hours to months is to be assessed.

Kalashnikova, Olga↗

Performance Calculations for a Boundary-Layer-Ingesting Fan Stage from Sparse Measurements

A test of the Boundary Layer Ingesting-Inlet / Distortion-Tolerant Fan was completed in NASA Glenn's 8-Foot by 6-Foot supersonic wind tunnel. Inlet and fan performance were measured by surveys using a set of rotating rake arrays upstream and downstream of the fan stage. Surveys were conducted along the 100 percent speed line and a constant exit corrected flow line passing through the aerodynamic design point. These surveys represented only a small fraction of the data collected during the test. For other operating points, data was recorded as snapshots without rotating the rakes which resulted in a sparser set of recorded data. This paper will discuss analysis of these additional, lower measurement density data points to expand our coverage of the fan map. Several techniques will be used to supplement the snapshot data at test conditions where survey data also exists. The supplemented snapshot data will be compared with survey results to assess the quality of the approach. Effective methods will be used to analyze the data set for which only snapshots exist.

fan efficiency↗

Laboratory spectra of field samples as a check on two atmospheric correction methods

Atmospheric correction is the first step toward quantitative analysis of imaging spectroscopy data. Two methods, MODTRAN model and the empirical line, were used to convert AVIRIS radiance values to reflectance values. A set of laboratory spectra of field samples corresponding to AVIRIS coverage was used to assess these methods. This will also serve to select bands for future quantative analyses.

Xu, Pung↗

Global backscatter assessment

The focus of this effort is the development of a global-scale model of aerosol backscatter for laser atmospheric wind sounder (LAWS) design and performance studies. Background parameters are derived from aerosol data sets with global-scale spatial and/or temporal coverage, using objective statistical decomposition and/or a priori stratification based on supplementary data. Backscatter coefficients at the LAWS design wavelength are derived from background aerosol physical, chemical, and optical data, or from direct backscatter measurements at other wavelengths, using background conversion factors. Direct measurements of aerosol backscatter at 10.6 microns from the Royal Signals and Radar Establishment (RSRE) and the Wave Propagation Laboratory (WPL) were selected. The RSRE backscatter data processing code were optimized under low backscatter conditions, performed detailed analyses of collocated intercomparisons between the two lidars, and assisted in the analysis of the long-term backscatter climatologies from the two lidars. Timely presentation of global backscattering experiment (GLOBE) research results to the global geophysical community is required.

Bowdle, David A.↗

Technical Specification Surveillance Interval Extension Using Self-Diagnostics

As part of the Light Water Reactor Sustainability program, an ongoing research effort is being conducted on technical specifications surveillance interval extension of digital equipment in nuclear power plants. The research team is led by Idaho National Laboratory and includes Pacific Northwest National Laboratory, Technology Resources, and Oak Ridge National Laboratory. This research focuses on developing methods for applying the U.S. Nuclear Regulatory Commission (NRC)–approved guidance to implement a licensee-controlled, risk-informed surveillance frequency change program in digital instrumentation and control (I&C) systems that include self-diagnostics and online monitoring (OLM) capabilities. Although approved methods exist for extending technical specifications (TS) surveillance test intervals (STIs) for general equipment, including analog I&C equipment, gaps remain in technology and guidance on crediting newer digital equipment’s internal self-diagnostics and OLM characteristics. Previous research described a general methodology for crediting internal self-diagnostics for extending surveillance test intervals. The methodology used self-diagnostics to detect—and credited recovery from—failure. Self-diagnostics were also applied for performance monitoring during the extended surveillance interval. This report discusses the status of recent activities to evaluate the previously developed methodology using a pilot study. Although both a utility partner for a pilot study and a specific digital asset were identified in FY2020, delays in obtaining proprietary information resulted in a limited ability to fully evaluate the methodology, and further interactions were complicated by the COVID pandemic. Therefore, at that time, the use of public-domain information—along with current processes for surveillance interval extension through a surveillance frequency control program—identified the need to fully assess diagnostic coverage as part of the pilot study. Furthermore, self-diagnostics were also identified as a potential option to replace the drift analyses conducted as part of current STI extension procedures. In FY2022, the project was reconstituted with the industry partner, and information and data were made available by the industry partner to the research team for review. The shared information included failure event descriptions and data for a digital I&C system since its implementation, as well as recent STI extension interval reports developed by the utility partner on that digital I&C system. This report presents an evaluation of this information and data and describes an application of the proposed methodology cited above. The methodology seeks to take advantage of the self-diagnostics and OLM capabilities to reduce risk or reduce the level of qualitative monitoring assessment needed to perform a risk-informed STI extension using existing NRC approved guidance or both. Addressing these issues of STI extension by crediting self-diagnostics is likely to result in benefits for current and future nuclear power plant (NPP) operations, including lowering the barriers to adoption of digital I&C systems and increasing cost savings by deferring or eliminating unneeded preventive maintenance (tasks or checks or activities). Specifically, self-diagnostic and OLM capabilities of newer digital equipment being installed in non-safety and safety applications are designed to detect failures, provide early warning of potential failures, and notify plant operators to take appropriate action to reduce out of service (OOS) time thus protecting safety margins. Moreover, the equipment is expected to provide information that time-related operational degradation is identified early to ensure timely and planned corrective actions instead of a reactive and unplanned approach ahead of an extended-surveillance interval.

42 ENGINEERING↗

Evaluating Supply Prioritization Strategies for Risk-Informed Decision Making in an Arbitrary Gas Network

Supply disruptions and infrastructure failures in natural gas networks present critical challenges to energy reliability and risk-informed planning. This study evaluates two supply prioritization strategies, Maximum Delivery Prioritization (MDP) and Demand-Based Prioritization (DBP), within an arbitrary natural gas network under conditions of supply shortage. Model performance under both strategies is assessed in response to node and edge failure using demand satisfaction metrics, system-wide and localized dependency scores, and geographic information system (GIS)-based spatial analysis. Results show that DBP better preserves supply for high-demand nodes, while MDP offers broader coverage. The underlying network topology plays a critical role in shaping prioritization outcomes. Integrated GIS visualization enhances the interpretability of vulnerability assessments, revealing structurally critical components and localized vulnerabilities. The proposed framework supports scalable, data-driven decision-making for infrastructure planners and engineers, enabling improved disruption recovery and efficiency in constrained natural gas networks. These insights contribute to the development of more robust energy systems capable of withstanding stress and disruptions.

Peterson, Steven [ORNL] (ORCID:0000000287672998)↗

The Aura Mission and Its Application to Climate and Air Quality

NASA's Aura satellite is scheduled to launch in the second quarter of 2004 into a polar orbit. The Aura mission is designed to collect data to address three high priority environmental science questions: (1) Is the ozone layer recovering as expected? (2) What are the sources and processes that control tropospheric pollutants? And (3) what is the quantitative impact of constituents on climate change? Aura will answer these questions by globally measuring a comprehensive set of trace gases and aerosols in the troposphere and stratosphere. Aura data will also have applications for monitoring and predicting climate and air quality parameters. Aura s observations will continue the TOMS ozone trend record and provide an assessment as to whether the Montreal Protocol is achieving its objective. Aura will measure gases and aerosols in the upper troposphere and lower stratosphere that contribute to climate forcing. These data will be of sufficient coverage, vertical resolution, and accuracy to help constrain climate models. In addition, Aura observations of tropospheric ozone and its precursors will have regional as well as intercontinental coverage, which could improve emission inventories. Near real time data will tested for local air quality forecasts in collaboration with the US's Environmental Protection UV-B forecasts from Aura ozone and cloud cover data. An overview of Aura s instruments, data products, validation, and examples of data applications will be presented.

Hilsenrath, Ernest↗

Assessing the Expansion of Ground-Motion Sensing Capability in Smart Cities via Internet Fiber-Optic Infrastructure

Monitoring ground motion in smart cities can improve the public safety by providing critical insights on natural and anthropogenic hazards, for example, earthquakes, landslides, explosions, infrastructure failures, and so forth. Although seismic activity is typically measured using dedicated point sensors (e.g., geophones and accelerometers), techniques such as distributed acoustic sensing have demonstrated the utility of using fiber-optic cable to detect seismic activity over comparable distances. In this article, we present the results of a study that quantifies the expansion in an area monitored for low-amplitude ground-motion events by augmenting existing point sensors with the internet fiber-optic cable infrastructure. Here we begin by describing our methodology, which utilizes geospatial data on point sensors and internet optical fiber deployed in metropolitan statistical areas (MSAs) in the United States. We extend these data to identify the area that can be monitored by (1) considering the observed seismic noise data in target locations, (2) applying the model from Wilson et al. (2021) to understand the potential coverage area gains using optical fiber sensing, and (3) optimizing the selection of fiber segments to maximize coverage and minimize deployment costs. We implement our methodology in ArcGIS to assess the additional area that can be monitored for low-amplitude ground-motion events (i.e., magnitude >0.5) by utilizing internet fiber-optic cables in the 100 most populous MSAs in the United States. We find that the addition of internet fiber-based sensors in MSAs would increase the area monitored on average by over an order of magnitude from 1% to 12%, if the subset of fiber cable segments that maximize coverage and minimize deployment costs is chosen even if only 20% of all fibers are used.

58 GEOSCIENCES↗

A study of the break-up characteristics of Chena River Basin using ERTS imagery

The author has identified the following significant results. The Chena River Basin was selected because of the availability of ground truth data for comparison. Very good agreement for snow distribution and rates of ablation was found between the ERTS-1 imagery, the snowmelt model, and field measurements. Monitoring snowmelt rates for relatively small basins appears to be practical. The main limitation of the ERTS-1 imagery is the interval of coverage. More frequent overflights providing coverage are needed for the study of transient hydrologic events. ERTS-1 data is most useful when used in conjunction with snowmelt prediction models and existing snow course data. These results should prove very useful in preliminary assessment of hydrologic conditions in ungaged watersheds and will provide a tool for month-to-month volume forecasting.

Carlson, R. F.↗

Data base for the prediction of inlet external drag

Results are presented from a study to define and evaluate the data base for predicting an airframe/propulsion system interference effect shown to be of considerable importance, inlet external drag. The study is focused on supersonic tactical aircraft with highly integrated jet propulsion systems, although some information is included for supersonic strategic aircraft and for transport aircraft designed for high subsonic or low supersonic cruise. The data base for inlet external drag is considered to consist of the theoretical and empirical prediction methods as well as the experimental data identified in an extensive literature search. The state of the art in the subsonic and transonic speed regimes is evaluated. The experimental data base is organized and presented in a series of tables in which the test article, the quantities measured and the ranges of test conditions covered are described for each set of data; in this way, the breadth of coverage and gaps in the existing experimental data are evident. Prediction methods are categorized by method of solution, type of inlet and speed range to which they apply, major features are given, and their accuracy is assessed by means of comparison to experimental data.

Mcmillan, O. J.↗

Application of Orthogonal Defect Classification for Software Reliability Analysis

The modernization of existing and new nuclear power plants with digital instrumentation and control systems (DI&C) is a recent and highly trending topic. However, there lacks strong consensus on best-estimate reliability methodologies by both the United States (U.S.) Nuclear Regulatory Commission (NRC) and the industry. This has resulted in hesitation for further modernization projects until a more unified methodology is realized. In this work, we develop an approach called Orthogonal-defect Classification for Assessing Software Reliability (ORCAS) to quantify probabilities of various software failure modes in a DI&C system. The method utilizes accepted industry methodologies for software quality assurance that are also verified by experimental or mathematical formulations. In essence, the approach combines a semantic failure classification model with a reliability growth model to predict (and quantify) the potential failure modes of a DI&C software system. The semantic classification model is used to address the question: How do latent defects in software contribute to different software failure root causes? The use of reliability growth models is then used to address the question: Given the connection between latent defects and software failure root causes, how can we quantify the reliability of the software? A case study was conducted on a representative I&C platform (ChibiOS) running a smart sensor acquisition software developed by Virginia Commonwealth University (VCU). The testing and evidence collection guidance in ORCAS was applied, and defects were uncovered in the software. Qualitative evidence, such as condition coverage, was used to gauge the completeness and trustworthiness of the assessment while quantitative evidence was used to determine the software failure probabilities. The reliability of the software was then estimated and compared to existing operational data of the sensor device. It is demonstrated that by using ORCAS, a semantic reasoning framework can be developed to justify if the software is reliable (or unreliable) while still leveraging the strength of the existing methods.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Application of Orthogonal Defect Classification for Software Reliability Analysis

The modernization of existing and new nuclear power plants with digital instrumentation and control systems (DI&C) is a recent and highly trending topic. However, there lacks strong consensus on best-estimate reliability methodologies by both the United States (U.S.) Nuclear Regulatory Commission (NRC) and the industry. This has resulted in hesitation for further modernization projects until a more unified methodology is realized. In this work, we develop an approach called Orthogonal-defect Classification for Assessing Software Reliability (ORCAS) to quantify probabilities of various software failure modes in a DI&C system. The method utilizes accepted industry methodologies for software quality assurance that are also verified by experimental or mathematical formulations. In essence, the approach combines a semantic failure classification model with a reliability growth model to predict (and quantify) the potential failure modes of a DI&C software system. The semantic classification model is used to address the question: How do latent defects in software contribute to different software failure root causes? The use of reliability growth models is then used to address the question: Given the connection between latent defects and software failure root causes, how can we quantify the reliability of the software? A case study was conducted on a representative I&C platform (ChibiOS) running a smart sensor acquisition software developed by Virginia Commonwealth University (VCU). The testing and evidence collection guidance in ORCAS was applied, and defects were uncovered in the software. Qualitative evidence, such as condition coverage, was used to gauge the completeness and trustworthiness of the assessment while quantitative evidence was used to determine the software failure probabilities. The reliability of the software was then estimated and compared to existing operational data of the sensor device. It is demonstrated that by using ORCAS, a semantic reasoning framework can be developed to justify software reliability (or unreliability) while still leveraging the strength of the existing methods.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Simultaneous laboratory measurements of CO2 and H2O adsorption on palagonite: Implications for the Martian climate and volatile reservoir

We are measuring the simultaneous adsorption of H2O and CO2 on palagonite materials in order to improve the formulation of climate models for Mars. We report on the initial co-adsorption data. Models of the Martian climate and volatile inventory indicate that the regolith serves as one of the primary reservoirs of outgassed volatiles and that it exchanges H2O and CO2 with the atmosphere in response to changes in insolation associated with astronomical cycles. Physical adsorbate must exist on the surfaces of the cold particulates that constitute the regolith, and the size of that reservoir can be assessed through laboratory measurements of adsorption on terrestrial analogs. Many studies of the independent adsorption of H2O and CO2 on Mars analog were made and appear in the literature. Empirical expressions that relate the adsorptive coverage of each gas to the temperature of the soil and partial pressure have been derived based on the laboratory data. Numerical models incorporate these adsorption isotherms into climatic models, which predict how the adsorptive coverage of the regolith and hence, the pressure of each gas in the atmosphere will vary as the planet moves through its orbit. These models suggest that the regolith holds several tens to hundreds of millibars of CO2 and that during periods of high obliquity warming of the high-latitude regolith will result in desorption of the CO2, and a consequent increase in atmospheric pressure. At lower obliquities, the caps cool and the equator warms forcing the desorption of several tens of millibars of CO2, which is trapped into quasipermanent CO2 caps.

Zent, A. P.↗

Gravity model improvement using the DORIS tracking system on the SPOT 2 satellite

A high-precision radiometric satellite tracking system, Doppler Orbitography and Radio-positioning Integrated by Satellite system (DORIS), has recently been developed by the French space agency, Centre National d'Etudes Spatiales (CNES). DORIS was designed to provide tracking support for missions such as the joint United States/French TOPEX/Poseidon. As part of the flight testing process, a DORIS package was flown on the French SPOT 2 satellite. A substantial quantity of geodetic quality tracking data was obtained on SPOT 2 from an extensive international DORIS tracking network. These data were analyzed to assess their accuracy and to evaluate the gravitational modeling enhancements provided by these data in combination with the Goddard Earth Model-T3 (GEM-T3) gravitational model. These observations have noise levels of 0.4 to 0.5 mm/s, with few residual systematic effects. Although the SPOT 2 satellite experiences high atmospheric drag forces, the precision and global coverage of the DORIS tracking data have enabled more extensive orbit parameterization to mitigate these effects. As a result, the SPOT 2 orbital errors have been reduced to an estimated radial accuracy in the 10-20 cm RMS range. The addition of these data, which encompass many regions heretofore lacking in precision satellite tracking, has significantly improved GEM-T3 and allowed greatly improved orbit accuracies for Sun-synchronous satellites like SPOT 2 (such as ERS 1 and EOS). Comparison of the ensuing gravity model with other contemporary fields (GRIM-4C2, TEG2B, and OSU91A) provides a means to assess the current state of knowledge of the Earth's gravity field. Thus, the DORIS experiment on SPOT 2 has provided a strong basis for evaluating this new orbit tracking technology and has demonstrated the important contribution of the DORIS network to the success of the TOPEX/Poseidon mission.

Nerem, R. S.↗

The ASC-V&V Program [Slides]

The fundamental goal of the ASC-V&V Program is to obtain a quantitative understanding of our customers’ needs and priorities, and use it to assess applicability of numerical models of physical phenomena to physics questions, sensitivity of physics questions to physical phenomena, fidelity of a numerical implementation to the theory, the bounds of validity of theories, fidelity and coverage of experimental data relative to regimes of interest for physics questions, in order to warn users of IC codes and PEM data when simulations may lead to unsupported conclusions, and provide estimates of uncertainties on figures of merit calculated by the simulations.

97 MATHEMATICS AND COMPUTING↗

Wi-Fi Signal Survey of the International Space Station by Autonomous Free-Flying Robot

This paper analyzes Wi-Fi signal propagation inside pressurized modules of the International Space Station (ISS). Various flight datasets were collected by the Astrobee fleet of autonomous free-flying robots developed by the NASA Ames Research Center (ARC). The enclosed module spaces of the ISS pose unique challenges for Wi-Fi signal propagation, and understanding these challenges is crucial for optimizing connectivity in such environments. The survey data presented are valuable for optimizing wireless access point (WAP) locations and conditions. A computational method is developed to analyze the wireless communication system, RF coverage, and module compositions. The method is both rigorous and practical for assessing the ISS wireless system performance. The computational tools in this paper serve as a complementary approach to direct, on-orbit measurements, which is a complicated and expensive task. In some operational scenarios, ground measurements may be intractable due to the size of the spacecraft. Results from this research will aid future space missions and commercial spacecraft, providing insights into optimal WAP placements and robust wireless communication systems.

Astrobee↗