Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “independent evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Strain Gage Loads Calibration Testing with Airbag Support for the Gulfstream III SubsoniC Research Aircraft Testbed (SCRAT)

This paper describes the design and conduct of the strain-gage load calibration ground test of the SubsoniC Research Aircraft Testbed, Gulfstream III aircraft, and the subsequent data analysis and results. The goal of this effort was to create and validate multi-gage load equations for shear force, bending moment, and torque for two wing measurement stations. For some of the testing the aircraft was supported by three airbags in order to isolate the wing structure from extraneous load inputs through the main landing gear. Thirty-two strain gage bridges were installed on the left wing. Hydraulic loads were applied to the wing lower surface through a total of 16 load zones. Some dead-weight load cases were applied to the upper wing surface using shot bags. Maximum applied loads reached 54,000 lb. Twenty-six load cases were applied with the aircraft resting on its landing gear, and 16 load cases were performed with the aircraft supported by the nose gear and three airbags around the center of gravity. Maximum wing tip deflection reached 17 inches. An assortment of 2, 3, 4, and 5 strain-gage load equations were derived and evaluated against independent check cases. The better load equations had root mean square errors less than 1 percent. Test techniques and lessons learned are discussed.

flight tests↗

Validation of Fatigue Modeling Predictions in Aviation Operations

Bio-mathematical fatigue models that predict levels of alertness and performance are one potential tool for use within integrated fatigue risk management approaches. A number of models have been developed that provide predictions based on acute and chronic sleep loss, circadian desynchronization, and sleep inertia. Some are publicly available and gaining traction in settings such as commercial aviation as a means of evaluating flight crew schedules for potential fatigue-related risks. Yet, most models have not been rigorously evaluated and independently validated for the operations to which they are being applied and many users are not fully aware of the limitations in which model results should be interpreted and applied.

operational safety↗

Towards A Representation of Vertically Resolved Ozone Changes in Reanalyses

The Solar Backscatter Ultraviolet Radiometer (SBUV) instruments on NASA and NOAA spacecraft provide a long-term record of total-column ozone and deep-layer partial columns since about 1980. These data have been carefully processed to extract long-term trends and offer a valuable resource for ozone monitoring. Studies assimilating limb-sounding observations in the Goddard Earth Observing System (GEOS) data assimilation system (DAS) demonstrate that vertical ozone gradients in the upper troposphere and lower stratosphere (UTLS) are much better represented than with the deep-layer SBUV observations. This is exemplified by the use of retrieved ozone from the EOS Microwave Limb Sounder (EOS-MLS) instrument in the MERRA-2 reanalysis, for the period after 2004. This study examines the potential for extending the use of limb-sounding observations at earlier times and into the future, so that future reanalyses may be more applicable to the study of long-term ozone changes.Historical data are available from NASA instruments: the Limb Infrared Monitor of the Stratosphere (LIMS: 1978-1979); the Upper Atmospheric Research Satellite (UARS: 1991-1995); Sounding of the Atmosphere using Broadband Emission Radiometry (SABER: 2000-onwards). For the post EOS-MLS period, the joint NASA-NOAA Ozone Monitoring and Profiling Suite Limb Profiler (OMPS-LP) instrument was launched on the Suomi-NPP platform in 201x and is planned for future platforms. This study will examine two aspects of these data pertaining to future reanalyses. First, the feasibility of merging the EOS-MLS and OMPS-LP instruments to provide a long-term record that extends beyond the potential lifetime of EOS-MLS. If feasible, this would allow for long-term monitoring of ozone recovery in a three-dimensional reanalysis context. Second, the skill of the GEOS DAS in ingesting historical data types will be investigated. Because these do not overlap with EOS-MLS, use will be made of system statistics and evaluation using independent datasets. Impacts of using a complete ozone chemistry module will also be considered.

ML↗

On-Orbit Verification of GLM Navigation on GOES-16

The GOES-R flight project has developed the Image Navigation and Registration (INR) Performance Assessment Tool Set (IPATS) to perform independent INR evaluations of the optical instruments on the GOES-R series spacecraft. In this presentation, we document the development of navigation (NAV) evaluation capabilities within IPATS for the Geostationary Lightning Mapper (GLM). We also discuss the post-processing quality filtering developed for GLM NAV, and present example results for several GLM background image datasets. Initial results suggest that GOES-16 GLM is compliant with navigation requirements.

GLM↗

On-Orbit Verification of GLM Navigation on GOES-16

The GOES-R flight project has developed the Image Navigation and Registration (INR) Performance Assessment Tool Set (IPATS) to perform independent INR evaluations of the optical instruments on the GOES-R series spacecraft. In this paper, we document the development of navigation (NAV) evaluation capabilities within IPATS for the Geostationary Lightning Mapper (GLM). We also discuss the post-processing quality filtering developed for GLM NAV, and present example results for several GLM datasets. Initial results suggest that GOES-16 GLM is compliant with navigation requirements.

On-Orbit↗

Progress in Atmospheric Carbon Monitoring Using NASA's GEOS Model and Data from the OCO and GOSAT Missions

NASA's Global Modeling and Assimilation Office (GMAO) produces a variety of carbon products based the synthesis of satellite remote sensing data and outputs of the Goddard Earth Observing System (GEOS). This includes bottom-up surface fluxes due to fossil fuel emissions, biomass burning, terrestrial biospheric exchange, and ocean exchangeconstrained by measurements of nighttime lights, fire radiative power, normalized difference vegetation index, and ocean color. These fluxes are the basis of top-down estimates of carbon concentrations and fluxes. In particular, the GMAO system processes retrievals of column carbon dioxide (XCO2) from GOSAT and OCO-2 to produce a high-resolution, long-term global analysis of CO2 in three dimensions every 6 hours. Here, we discuss the potential applications of such products for satellite intercomparison and evaluation against independent, non-coincident data. We also highlight the ability to provide monthly global atmospheric growth rates inferred from the assimilated CO2 concentration product. Finally, we discuss the challenges facing such products including bias correction and the estimation and analysis of model transport errors.

Weir, B.↗

Radiometric Assessment of the First Three Years of the NOAA-20 VIIRS Reflective Solar Bands Calibration

NASA’s Clouds and the Earth’s Radiant Energy System (CERES) SYN1deg Ed4.1 product utilizes geostationary (GEO) satellite measured radiances and retrieved cloud properties to account for the regional diurnal fluctuations in the Earth’s radiant broadband fluxes for times between the CERES measurements gathered from the Aqua (1:30 PM) and Terra (10:30 AM) sun-synchronous satellites. In CERES Edition 4 products, a global uniformity in the cloud properties and computed surface fluxes across the GEO satellite domains is maintained by scaling the radiance observations from more than twenty GEO visible imagers in the CERES record to a common radiometric reference scale, i.e., Aqua-MODIS. With the new-generation GEO (Himawari-8/9 and GOES-16/17) imagers having multiple reflective solar bands (RSB) that are spectrally similar to those of VIIRS, the CERES Imager and Geostationary Calibration Group (IGCG) is preparing to use NOAA-20 VIIRS as the reference imager for maintaining the radiometric uniformity across the GEO imager constellation. Given the recent Aqua satellite anomaly, this transition may happen sooner than the projected date of Aqua’s de-orbit. This paper presents an independent performance evaluation of the first three years of the NOAA-20 VIIRS RSB calibration in the NASA VIIRS Land Science Investigator-led Processing System (Land SIPS) L1b Collection 2 dataset. The temporal radiometric stability is assessed using multiple invariant Earth targets, including tropical deep convective clouds and the Saharan desert. The invariant target anisotropic reflectance at the top of atmosphere was modeled using five years of stable satellite observations acquired from the previous VIIRS instrument onboard the Suomi National Polar-orbiting Partnership (S-NPP) satellite. The anisotropic corrections are essential for detecting temporal trends with a high statistical confidence. In addition, the radiometric consistency between the RSB of the two VIIRS instruments will be evaluated.

Rajendra Bhatt↗

Radiometric Assessment of the First Three Years of the NOAA-20 VIIRS Reflective Solar Bands Calibration

NASA’s Clouds and the Earth’s Radiant Energy System (CERES) SYN1deg Ed4.1 product utilizes geostationary (GEO) satellite measured radiances and retrieved cloud properties to account for the regional diurnal fluctuations in the Earth’s radiant broadband fluxes for times between the CERES measurements gathered from the Aqua (1:30 PM) and Terra (10:30 AM) sun-synchronous satellites. In CERES Edition 4 products, a global uniformity in the cloud properties and computed surface fluxes across the GEO satellite domains is maintained by scaling the radiance observations from more than twenty GEO visible imagers in the CERES record to a common radiometric reference scale, i.e., Aqua-MODIS. With the new-generation GEO (Himawari-8/9 and GOES-16/17) imagers having multiple reflective solar bands (RSB) that are spectrally similar to those of VIIRS, the CERES Imager and Geostationary Calibration Group (IGCG) is preparing to use NOAA-20 VIIRS as the reference imager for maintaining the radiometric uniformity across the GEO imager constellation. Given the recent Aqua satellite anomaly, this transition may happen sooner than the projected date of Aqua’s de-orbit. This paper presents an independent performance evaluation of the first three years of the NOAA-20 VIIRS RSB calibration in the NASA VIIRS Land Science Investigator-led Processing System (Land SIPS) L1b Collection 2 dataset. The temporal radiometric stability is assessed using multiple invariant Earth targets, including tropical deep convective clouds and the Saharan desert. The invariant target anisotropic reflectance at the top of the atmosphere was modeled using five years of stable satellite observations acquired from the previous VIIRS instrument onboard the Suomi National Polar-orbiting Partnership (S-NPP) satellite. The anisotropic corrections are essential for detecting temporal trends with high statistical confidence. In addition, the radiometric consistency between the RSB of the two VIIRS instruments will be evaluated.

Rajendra Bhatt↗

A Dynamic Landslide Hazard Monitoring Framework for the Lower Mekong Region

The Lower Mekong region is one of the most landslide-prone areas of the world. Despite the need for dynamic characterization of landslide hazard zones within the region, it is largely understudied for several reasons. Dynamic and integrated understanding of landslide processes requires landslide inventories across the region, which have not been available previously. Computational limitations also hamper regional landslide hazard assessment, including accessing and processing remotely sensed information. Finally, open-source software and modelling packages are required to address regional landslide hazard analysis. Leveraging an open-source data-driven global Landslide Hazard Assessment for Situational Awareness model framework, this study develops a region-specific dynamic landslide hazard system leveraging satellite-based Earth observation data to assess landslide hazards across the lower Mekong region. A set of landslide inventories were prepared from high-resolution optical imagery using advanced image-processing techniques. Several static and dynamic explanatory variables (i.e., rainfall, soil moisture, slope, relief, distance to roads, distance to faults, distance to rivers) were considered during the model development phase. An extreme gradient boosting decision tree model was trained for the monsoon period of 2015–2019 and the model was evaluated with independent inventory information for the 2020 monsoon period. The model performance demonstrated considerable skill using receiver operating characteristic curve statistics, with Area Under the Curve values exceeding 0.95. The model architecture was designed to use near-real-time data, and it can be implemented in a cloud computing environment (i.e., Google Cloud Platform) for the routine assessment of landslide hazards in the Lower Mekong region. This work was developed in collaboration with scientists at the Asian Disaster Preparedness Center as part of the NASA SERVIR Program’s Mekong hub. The goal of this work is to develop a suite of tools and services on accessible open-source platforms that support and enable stakeholder communities to better assess landslide hazard and exposure at local to regional scales for decision making and planning.

Nishan Kumar Biswas↗

From CMS to the U.S. Greenhouse Gas Center – Improved Tracking of Recent Changes in Co 2 and Ch 4 From NASA’s Quasi-Operational Modeling Systems

Reliable, low latency delivery of high quality global flux and concentration information is a growing but still unmet need to advance expanding measurement, monitoring, reporting, and verification efforts that underpin federal climate mitigation strategies. Here we present on progress toward developing space-based greenhouse gas (GHG) monitoring systems that can provide comprehensive information trailing real time by a matter of weeks to a few months. Through support from its Carbon Monitoring System (CMS) program, NASA has developed the capability to assimilate XCO 2 retrievals from the Orbiting Carbon Observatory, 2 (OCO 2 ) into the Goddard Earth Observing System (GEOS) Constituent Data Assimilation System (CoDAS) to create gap-filled, three-dimensional (3D) estimates of CO 2 mixing ratio. When observations are unavailable, concentration fields are further informed by observationally-informed bottom-up flux packages that incorporate remotely sensed fire, nighttime lights, and vegetation observations combined with estimates of atmospheric growth rate based on surface in situ data. The 3D nature of these datasets supports evaluation with independent aircraft data to improve confidence in satellite data, development of new regional modeling approaches, and quantification of the climate impacts of GHGs. The system has recently been expanded to assimilate XCH 4 from ESA’s TROPOspheric Monitoring Instrument (TROPOMI) instrument and is supported by companion efforts to improve delivery of estimates of bottom-up land and ocean fluxes. The quasi-operational GEOS-GHG system is contributing to the recently announced U.S. Greenhouse Gas Center (GHG Center) by delivering information on recent changes in CO 2 and CH 4 emissions and concentrations to support stakeholder and research communities. In this presentation, we provide an overview of the current system configured to support the GHG Center. We highlight examples of how this data contributes to broader NASA initiatives including the Earth Information Center, an innovative virtual and physical exhibit designed to show how NASA data helps the nation combat climate change. We conclude by discussing how innovations in CMS research can address remaining data gaps and modeling challenges to advance operational GHG monitoring in the future.

Lesley Ott↗

A Mathematical Framework for Representing Cyber-Physical System Interdependencies and Resilience

U.S. critical infrastructure is increasingly composed of integrated cyber-physical systems (CPS) whose components are operationally interdependent. These interdependencies can create additional vulnerabilities beyond those that are typically evaluated through independent physical and cyber risk assessments. These additional vulnerabilities, previously undetected at the sub-system and/or component level, could cause cascading effects across both the physical and cyber domains that could lead to infrastructure disruption or failure. This paper will review an initial mathematical framework developed to help understand the dynamics of these interfacing physical and cyber components at a holistic system level. The resulting framework also provides a method for modeling and assessing the resilience of CPS in complex and adaptive systems. It frames the system in terms of mission performance and the potential effects to performance caused by attacks that are cyber, physical, or blended in nature. The framework utilizes a systems-based, state-space modeling approach to reason about risk, resilience, and interdependencies in CPS. Probabilities are applied to each CPS component regarding a threat (both man-made and natural) and the likelihood of that particular component being impacted, along with indirect impact to other interdependent components. These component-level impacts from threats then translate into mission-level impact and systemic state change.

Brigantic, Robert T.↗

Quantifying Operational Drivers of Multimodal Biometric Verification in Aerial Surveillance

Multimodal biometric verification is increasingly applied across operational contexts ranging from close-range security cameras and building-mounted surveillance to long-range ground sensors and unmanned aerial system (UAS) imagery. Variations in acquisition conditions—such as image resolution, viewing geometry, and motion artifacts—pose significant challenges for cross-domain algorithmic generalization. This study evaluates two independent multimodal biometric verification systems developed under the Intelligence Advanced Research Projects Activity (IARPA) Biometric Recognition and Identification at Altitude and Range (BRIAR) program, comparing performance on close-range and aerial datasets. Close-range video served as a baseline to quantify the decline in verification performance on aerial footage. The dataset included six UAS platforms, spanning small quadcopters at 10m altitude to medium-sized fixed-wing aircraft at 360m. Mixed-effects logistic regression identified image resolution (head and body pixel counts), head height, sensor characteristics, and algorithm selection as primary determinants of verification success, whereas demographic attributes and mission gait were not significant predictors. Activity type and collection site influenced performance in close-range data but had negligible impact on UAS imagery. These results clarify modality-specific strengths and limitations and highlight opportunities to enhance cross-domain biometric verification.

Peluso, Alina [ORNL] (ORCID:0000000328950406)↗

The Suomi National Polar-Orbiting Partnership (SNPP): Continuing NASA Research and Applications

The Suomi National Polar-orbiting Partnership (SNPP) satellite was successfully launched into a polar orbit on October 28, 2011 carrying 5 remote sensing instruments designed to provide data to improve weather forecasts and to increase understanding of long-term climate change. SNPP provides operational continuity of satellite-based observations for NOAA's Polar-orbiting Operational Environmental Satellites (POES) and continues the long-term record of climate quality observations established by NASA's Earth Observing System (EOS) satellites. In the 2003 to 2011 pre-launch timeframe, NASA's SNPP Science Team assessed the adequacy of the operational Raw Data Records (RDRs), Sensor Data Records (SDRs), and Environmental Data Records (EDRs) from the SNPP instruments for use in NASA Earth Science research, examined the operational algorithms used to produce those data records, and proposed a path forward for the production of climate quality products from SNPP. In order to perform these tasks, a distributed data system, the NASA Science Data Segment (SDS), ingested RDRs, SDRs, and EDRs from the NOAA Archive and Distribution and Interface Data Processing Segments, ADS and IDPS, respectively. The SDS also obtained operational algorithms for evaluation purposes from the NOAA Government Resource for Algorithm Verification, Independent Testing and Evaluation (GRAVITE). Within the NASA SDS, five Product Evaluation and Test Elements (PEATEs) received, ingested, and stored data and performed NASA's data processing, evaluation, and analysis activities. The distributed nature of this data distribution system was established by physically housing each PEATE within one of five Climate Analysis Research Systems (CARS) located at either at a NASA or a university institution. The CARS were organized around 5 key EDRs directly in support of the following NASA Earth Science focus areas: atmospheric sounding, ocean, land, ozone, and atmospheric composition products. The PEATES provided the system level interface with members of the NASA SNPP Science Team and other science investigators within each CARS. A sixth Earth Radiation Budget CARS was established at NASA Langley Research Center (NASA LaRC) to support instrument performance, data evaluation, and analysis for the SNPP Clouds and the Earth's Radiant Budget Energy System (CERES) instrument. Following the 2011 launch of SNPP, spacecraft commissioning, and instrument activation, the NASA SNPP Science Team evaluated the operational RDRs, SDRs, and EDRs produced by the NOAA ADS and IDPS. A key part in that evaluation was the NASA Science Team's independent processing of operational RDRs and SDRs to EDRs using the latest NASA science algorithms. The NASA science evaluation was completed in the December 2012 to April 2014 timeframe with the release of a series of NASA Science Team Discipline Reports. In summary, these reports indicated that the RDRs produced by the SNPP instruments were of sufficiently high quality to be used to create data products suitable for NASA Earth System science and applications. However, the quality of the SDRs and EDRs were found to vary greatly when considering suitability for NASA science. The need for improvements in operational algorithms, adoption of different algorithmic approaches, greater monitoring of on-orbit instrument calibration, greater attention to data product validation, and data reprocessing were prominent findings in the reports. In response to these findings, NASA, in late 2013, directed the NASA SNPP Science Team to use SNPP instrument data to develop data products of sufficiently high quality to enable the continuation of EOS time series data records and to develop innovative, practical applications of SNPP data. This direction necessitated a transition of the SDS data system from its pre-launch assessment mode to one of full data processing and production. To do this, the PEATES, which served as NASA's data product testing environment during the prelaunch and early on-orbit periods, were transitioned to Science Investigator-led Processing Systems (SIPS). The distributed data architecture was maintained in this new system by locating the SIPS at the same institutions at which the CARS and PEATES were located. The SIPS acquire raw SNPP instrument Level 0 (i.e. RDR) data over the full SNPP mission from the NOAA ADS and IDPS through the NASA SDS Data Distribution and Depository Element (SD3E). The SIPS process those data into NASA Level 1, Level 2, and global, gridded Level 3 standard products using peer-reviewed algorithms provided by members of the NASA Science Team. The SIPS work with the NASA SNPP Science Team in obtaining enhanced, refined, or alternate real-time algorithms to support the capabilities of the Direct Readout Laboratory (DRL). All data products, algorithm source codes, coefficients, and auxiliary data used in product generation are archived in an assigned NASA Distributed Active Archive Center (DAAC).

remote sensing↗

Prompt fission neutron multiplicity in the 239 Pu(n, f) reaction and its energy dependence

Measuring prompt fission neutrons to high precision is an experimental challenge, especially for radioactive fissioning nuclides. However, accurate average multiplicities, $\overline{v}_{p}$, and kinetic energy distributions of prompt fission neutrons are essential for fundamental and applied nuclear physics. We present here a recent measurement of the 239 Pu (n,f) $\overline{v}_{p}$ as a function of the incident-neutron energy, over the range 1-700 MeV. The measurement was performed with a cutting-edge setup and an innovative technique, which allowed to minimize and account for the main sources of bias. An unprecedented precision was therefore achieved. Our data are compared to GEF predictions as well as to evaluated libraries. For the first time, at low energies, the ENDF/B-VIII.0 nuclear data evaluation is validated with an independent measurement and the evaluated uncertainty reduced by up to 60%. This work paves the way to precisely measure prompt fission neutron multiplicities on highly radioactive nuclei.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Independent Calibration Approach for the CLARREO Pathfinder Mission

A CLARREO (Climate Absolute Radiance and Refractivity Observatory) Pathfinder (CPF) mission has been funded to demonstrate retrieval of SI-traceable spectral reflectance with absolute uncertainty <0.3% (k=1). The mission consists of a Reflected Solar spectrometer that will be hosted on the International Space Station (ISS) in the 2023 timeframe and rely on a ratioing radiometer approach to retrieve the unprecedented accuracy. Demonstrating that the accuracy is achieved through an Independent Calibration effort similar in philosophy to the efforts in metrology laboratories relying on multiple, independent measurements to improve credibility for a sensor’s absolute and relative uncertainty error budgets. These measurements use different traceability paths and multiple instrument approaches and CPF’s Independent Calibration will be similar in this regard. The Independent Calibration relies on a pre-launch absolute radiometric calibration obtained from additional testing done after instrument thermal-vacuum (TVAC) testing. The added radiometric calibration is combined with a high fidelity instrument model to provide an on-orbit radiometric calibration independent from the ratioing radiometer approach. The current work describes the post-TVAC testing portion of the CPF Independent Calibration Plan and the Independent Model Development as well as planned on-orbit Evaluation of the Independent Calibration.

CLARREO Pathfinder↗