Pals (Passive Active L-band System) Radiometer-Based Soil Moisture Retrieval for the SMAP Validation Experiment 2012 (SMAPVEX12)
No abstract available
Colliander, Andreas↗
SEARCH · Engineering Papers
Results for “system validation”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
DAIDALUS Observations From UAS Integration in the NAS Project Flight Test 4
In order to validate the Unmanned Aerial System (UAS) Detect-and-Avoid (DAA) solution proposed by standards body RTCA Inc., the National Aeronautics and Space Administration (NASA) UAS Integration in the NAS project, alongside industry members General Atomics and Honeywell, conducted the fourth flight test in a series at Armstrong Flight Research Center in Edwards, California. Flight Test 4 (FT4) investigated problems of interoperability with the TCAS collision avoidance system with a DAA system as well as problems associated with sensor uncertainty. A series of scripted flight encounters between the NASA Ikhana UAS and various "intruder" aircraft were flown while alerting and guidance from the DAA algorithm were recorded to investigate the timeliness of the alerts and correctness of the guidance triggered by the DAA system. The results found that alerts were triggered in a timely manner in most instances. Cases where the alerting and guidance was incorrect were investigated further.
Vincent, Michael J.↗
Reusing JPSS Ground System Components to Process Aura Ozone Monitoring Instrument Science Products
New Earth observation instruments are planned to enable advancements in Earth science research over the next decade. Diversity of Earth observing instruments and their observing platforms will continue to increase as new instrument technologies emerge and are deployed as part of National programs such as Joint Polar Satellite System (JPSS), Geostationary Operational Environmental Satellite system (GOES), Landsat as well as the potential for many CubeSat and aircraft missions. The practical use and value of these observational data often extends well beyond their original purpose. The practicing community needs intuitive and standardized tools to enable quick unfettered development of tailored products for specific applications and decision support systems. However, the associated data processing system can take years to develop and requires inherent knowledge and the ability to integrate increasingly diverse data types from multiple sources. This paper describes the adaptation of a large-scale data processing system built for supporting JPSS algorithm calibration and validation (CalVal) node to a simplified science data system for rapid application. The new configurable data system reuses scalable JAVA technologies built for the JPSS Government Resource for Algorithm Verification, Independent Test, and Evaluation (GRAVITE) system to run within a laptop environment and support product generation and data processing of AURA Ozone Monitoring Instrument (OMI) science products. Of particular interest are the root requirements necessary for integrating experimental algorithms and Hierarchical Data Format (HDF) data access libraries into a science data production system. This study demonstrates the ability to reuse existing Ground System technologies to support future missions with minimal changes.
Science Data Systems↗
PIV Measurements of a Low-noise Top-mounted Propulsion Installation for a Supersonic Airliner
A model-scale exhaust system was tested to validate low-noise propulsion concepts and noise prediction methods. The tests involved far-field acoustics, phased array, and particle image velocimetry (PIV). This paper covers the particle image velocimetry portion. Data was acquired at NASA Glenn's Aero-Acoustic Propulsion Lab for a series of nozzles with different chevron designs, both uninstalled and installed on a representative aircraft planform. The impact of the various chevron treatments on the turbulent velocity field was documented, along with the impact of the pylon and planform. When correlated with far-field acoustic measurements and phased array measurements, reported in companion papers, the explanation of acoustic benefits from top-mounted propulsion is clear as is the path toward optimization of the concept.
Propulsion Airframe Integration↗
Implementation and Testing of Inverse Kinematics on Robotic Arm
COSIE (Coronal Spectrographic Imager in the Extreme Ultraviolet) is a proposed solar tracking ISS imaging payload that will help bridge the theoretical gap between the physics of the low corona and the heliosphere. This scientific instrument requires high pointing accuracy, on the order of arc seconds. The instrument is mounted on to a three revolute joint robotic arm in order to track the roll, pitch and yaw motion of the Sun. The goal of this project is to construct a prototype model of the robotic arm and implement the proposed analytical inverse kinematics algorithm. In robotics, the inverse kinematics problem is solving for the set of joint angles that achieve the desired end effect or location and/or orientation. In this case, orientation is the focus. Depending on the configuration, multiple sets of joint angle solutions may exist. Due to the complexity of robotics, typically iterative methods are used to solve for the joint angle solution sets. However, in this case, an analytical solution exists. A small robotic arm representative of the full size hardware was constructed. The inverse kinematics algorithm, originally in MATLAB/Simulink, was converted into C in order to interface with the motors. This C software was implemented on a Windows PC and micro-controller, and serial communication between the two was established, allowing the motors to be directly controlled by the inverse kinematics algorithm. Testing the inverse kinematics on a physical system will allow the validity and accuracy of the analytic solution to be verified.
Franz, Carter↗
Formalizing and Analyzing Requirements with FRET
Formal verification and simulation are powerful tools to validate requirements against complex systems. Requirements are developed in early stages of the software lifecycle and are typically written in ambiguous natural language. There is a gap between such requirements and formal notations that can be used by verification tools, and lack of support for proper association of requirements with software artifacts for verification. We propose to write requirements in an intuitive, structured natural language with formal semantics, and to support formalization and model/code verification as a smooth, well-integrated process. To this end, we have developed an end-to-end, open source requirements analysis framework that checks Simulink models against requirements written structured natural language.
Mavridou, Anastasia↗
Bridging the Gap Between Requirements and Model Analysis : Evaluation on Ten Cyber-Physical Challenge Problems
Formal verfication and simulation are powerful tools to validate requirements against complex systems. [Problem] Requirements are developed in early stages of the software lifecycle and are typically written in ambiguous natural language. There is a gap between such requirements and formal notations that can be used by verification tools, and lack of support for proper association of requirements with software artifacts for verification. [Principal idea] We propose to write requirements in an intuitive, structured natural language with formal semantics, and to support formalization and model/code verification as a smooth, well-integrated process. [Contribution] We have developed an end-to-end, open source requirements analysis framework that checks Simulink models against requirements written in structured natural language. Our framework is built in the Formal Requirements Elicitation Tool (fret); we use fret's requirements language named fretish, and formalization of fretish requirements in temporal logics. Our proposed framework contributes the following features: 1) automatic extraction of Simulink model information and association of fretish requirements with target model signals and components; 2) translation of temporal logic formulas into synchronous dataflow cocospec specifications as well as Simulink monitors, to be used by verification tools; we establish correctness of our translation through extensive automated testing; 3) interpretation of counterexamples produced by verification tools back at requirements level. These features support a tight integration and feedback loop between high level requirements and their analysis. We demonstrate our approach on a major case study: the Ten Lockheed Martin Cyber-Physical, aerospace-inspired challenge problems.
Mavridou, Anastasia↗
(abstract) NASA Scatterometer Experiment
This paper describes the four parts of the NASA Scatterometer (NSCAT) Experiment: the instrument, the ground system, the calibration and validation program, and the science studies. The instrument developed by NASA/JPL is being flown on the National Space Agency of Japan's Advanced Earth Observation Satellite (ADEOS) and represents a major collaborative effort between USA and Japan in Earth remote sensing.
NSCAT↗
Assessing within-Field Corn and Soybean Yield Variability from WorldView-3, Planet, Sentinel-2, and Landsat 8 Satellite Imagery
Crop yield monitoring is an important component in agricultural assessment. Multispectral remote sensing instruments onboard space-borne platforms such as Advanced Very High Resolution Radiometer (AVHRR), Moderate Resolution Imaging Spectroradiometer (MODIS), and Visible Infrared Imaging Radiometer Suite (VIIRS) have shown to be useful for efficiently generating timely and synoptic information on the yield status of crops across regional levels. However, the coarse spatial resolution data inherent to these sensors provides little utility at the management level. Recent satellite imagery collection advances toward finer spatial resolution (down to 1 m) alongside increased observational cadence (near daily) implies information on crops obtainable at field and within-field scales to support farming needs is now possible. To test this premise, we focus on assessing the efficiency of multiple satellite sensors, namely WorldView-3, Planet/Dove-Classic, Sentinel-2, and Landsat 8 (through Harmonized Landsat Sentinel-2 (HLS)), and investigate their spatial, spectral (surface reflectance (SR) and vegetation indices (VIs)), and temporal characteristics to estimate corn and soybean yields at sub-field scales within study sites in the US state of Iowa. Precision yield data as referenced to combine harvesters’ GPS systems were used for validation. We show that imagery spatial resolution of 3 m is critical to explaining 100% of the within-field yield variability for corn and soybean. Our simulation results show that moving to coarser resolution data of 10 m, 20 m, and 30 m reduced the explained variability to 86%, 72%, and 59%, respectively. We show that the most important spectral bands explaining yield variability were green (0.560 µm), red-edge (0.726 µm), and near-infrared (NIR - 0.865 µm). Furthermore, the high temporal frequency of Planet and a combination of Sentinel-2/Landsat 8 (HLS) data allowed for optimal date selection for yield map generation. Overall, we observed mixed performance of satellite-derived models with the coefficient of determination (R^2) varying from 0.21 to 0.88 (averaging 0.56) for the 30 m HLS and from 0.09 to 0.77 (averaging 0.30) for 3 m Planet. R^2 was lower for fields with higher yields, suggesting saturation of the satellite-collected reflectance features in those cases. Therefore, other biophysical variables, such as soil moisture and evapotranspiration, at similar fine spatial resolutions are likely needed alongside the optical imagery to fully explain the yields.
agriculture; yield; within-field; corn; soybean; r↗
Satellite and airborne remote sensing of gross primary productivity in boreal Alaskan lakes
In terrestrial and marine ecosystems, remote sensing has been used to estimate gross primary productivity (GPP) for decades, but few applications exist for shallow freshwater ecosystems.Here we show field-based GPP correlates with satellite and airborne lake color across a range of optically and limnologically diverse lakes in interior Alaska. A strong relationship between in situ GPP derived from stable oxygen isotopes (δ18O) and space-based lake color from satellites (e.g. Landsat-8, Sentinel-2 and CubeSats) and airborne imagery (AVIRIS-NG) demonstrates the potential power of this technique for improving spatial and temporal monitoring of lake GPP when coupled with additional field validation measurements across different systems. In shallow waters clear enough for sunlight to reach lake bottoms, both submerged vegetation (macrophytes and algae) and phytoplankton likely contribute to GPP. The stable isotopes and remotely sensed shallow lake color used here integrate both components. These results demonstrate the utility of lake color as a feasible means for mapping lake GPP from remote sensing. This novel methodology estimates GPP from remote sensing in shallow lakes by combining field measurements of oxygen isotopes with airborne, satellite and CubeSat imagery. This use of lake color for providing insight into ecological processes of shallow lakes is recommended, especially for remote arctic and boreal landscapes.
airborne remote sensing↗
Statistical learning framework for safety and failure analysis of a DNN-based autonomous aircraft system
Deep Neural Networks (DNNs) and Machine Learning technology is increasingly used for safety-critical applications in the Aerospace domain. To ensure safe operations, the DNN and the system must undergo rigorous verification and validation, including advanced statistical analyses. Performance and safety of the DNN and system behavior must not only be analyzed for the nominal case, but under numerous off-nominal and failure cases. In this paper we will describe how our statistical learning framework SYSAI can efficiently perform such analyses using the tool’s unique combination of advanced learning modeling and statistical analysis techniques. SYSAI can effectively explore the high-dimensional state and failure space of the system under test; geometrical shape detection of safety regions and boundaries support explainability of the results to the designer. In this paper, we report experiments and results obtained with a vision-based DNN control system (ACT) that is capable of autonomously steering an aircraft down a runway.
Yuning He↗
Observations of So2, O3, and Aerosols With the Langley Mobile Ozone Lidar
LMOL, the NASA Langley Mobile Ozone Lidar, is located near NASA's LaRC steam plant when not deployed in campaigns. The steam plant is an incinerator, and when SO2 was in the plume, it would affect the LMOL O3 measurements at the plume altitudes of 100m-200m. In 2022, we modified LMOL to observe four wavelengths simultaneously to distinguish between and measure both O3 and SO2. With an optimized selection of wavelengths, based on an analysis of the cross-sections, it is possible to retrieve both O3 and SO2 densities from three wavelengths. Adding a fourth wavelength enables better constrains the aerosol's backscatter and extinction. In this work, we present the dual observations of SO2 and O3 with the new channels of LMOL, and we present the advances in constraining the aerosol parameters from these multiple wavelengths. We highlight the SO2 and Ozone Water-Land Environmental Transition Study (SOWLETS) campaign in preparation for the validation of the new system.
Guillaume Gronoff↗
Design for validation, based on formal methods
Validation of ultra-reliable systems decomposes into two subproblems: (1) quantification of probability of system failure due to physical failure; (2) establishing that Design Errors are not present. Methods of design, testing, and analysis of ultra-reliable software are discussed. It is concluded that a design-for-validation based on formal methods is needed for the digital flight control systems problem, and also that formal methods will play a major role in the development of future high reliability digital systems.
Butler, Ricky W.↗
Automated space vehicle control for rendezvous proximity operations
Rendezvous during the unmanned space exploration missions, such as a Mars Rover/Sample Return will require a completely automatic system from liftoff to docking. A conceptual design of an automated rendezvous, proximity operations, and docking system is being implemented and validated at the Johnson Space Center (JSC). The emphasis is on the progress of the development and testing of a prototype system for control of the rendezvous vehicle during proximity operations that is currently being developed at JSC. Fuzzy sets are used to model the human capability of common sense reasoning in decision making tasks and such models are integrated with the expert systems and engineering control system technology to create a system that performs comparably to a manned system.
Lea, Robert N.↗
Automated space vehicle control for rendezvous proximity operations
Rendezvous during the unmanned space exploration missions, such as a Mars Rover/Sample Return will require a completely automatic system from liftoff to docking. A conceptual design of an automated rendezvous, proximity operations, and docking system is being implemented and validated at the Johnson Space Center (JSC). The emphasis is on the progress of the development and testing of a prototype system for control of the rendezvous vehicle during proximity operations that is currently being developed at JSC. Fuzzy sets are used to model the human capability of common sense reasoning in decision-making tasks and such models are integrated with the expert systems and engineering control system technology to create a system that performs comparably to a manned system.
Lea, Robert N.↗
IV and V Issues in Achieving High Reliability and Safety in Critical Control System Software
Risk analysis and integrated verification and validation are two important elements in a plan for ensuring the safety of critical software systems. We describe an approach we are currently developing for integrating risk analysis, and metrics analysis, and propose a fault predictor that would integrate the results of these activities. Practical difficulties associated with our approach are also discussed, as are limitations of the proposed predictor. We conclude with a discussion of what as been learned to date, and with suggestions for future work.
validation software reliability software risk asse↗
CFD Validation and Scaling of a Condenser Used in an ISRU Propellant Production System
This work develops a Computational Fluid Dynamics (CFD) model of a Commercial-Off-The-Shelf (COTS) condenser used for ground-based testing of an In-Situ Resource Utilization (ISRU) propellant production system. STAR-CCM+ was used to simulate water condensing through the condenser downstream of a methanation reactor. The computational data of the digital model is validated with test cases using nitrogen and water in ambient conditions. After validation with the test data, the digital model can be used to predict scale at higher production targets. The StarCCM+ simulation of the digital model shows good agreement with the test data provided. From the simulation, the condensation rate calculated was 18.3 g/hr and the process gas mass flow rate was 709.2 g/hr. The test data measured an average 16.9 g/hr condensation rate and 693.6 g/hr process gas mass flow rate. The simulation shows a 7.3% error in the water condensation and 2.2% error in the process gas at the outlet.
Condenser↗
Validation of Minimum Display Requirements for a UAS Detect and Avoid System
The full integration of Unmanned Aircraft Systems (UAS) into the National Airspace System (NAS), a prerequisite for enabling a broad range of public and commercial UAS operations, presents several technical challenges to UAS developers, operators and regulators. A primary barrier is the inability for UAS pilots (situated at a ground control station, or GCS) to comply with Title 14 Code of Federal Regulations sections 91.111 and 91.113, which require pilots to “see and avoid” other aircraft in order to maintain well clear. UAS pilots’ removal from the flight deck of the aircraft necessitates the development of a UAS-specific system for detecting nearby traffic and displaying traffic information to the pilot to support their ability to maintain an objectively defined “DAA well clear” threshold from other aircraft. This new UAS-specific function of remaining DAA well clear is called traffic avoidance. The resulting Detect and Avoid (DAA) system, however, will be subject to a collection of requirements that manufacturers will be obligated to meet in order to certify their equipment. RTCA Special Committee 228 (SC-228), a consortium of representatives from government, industry and academia, is responsible for developing and documenting the Minimum Operational Performance Standards (MOPS) for UAS DAA systems. The present study is the final in a series of human-in-the-loop (HITL) experiments designed to explore and test the various display and alerting requirements being incorporated into the DAA MOPS. Whereas the prior DAA HITLs examined a wide variety of DAA display features and concepts, the current experiment aims to validate the latest minimum display requirements for Phase 1 of the DAA MOPS. Rather than test different display concepts, this study tests two configurations of a MOPS-compatible DAA display: a version that is integrated into the primary navigation and control display of the GCS and a version that is physically separated from the primary display. This manipulation tests the draft minimum requirement that allows the DAA traffic display to be a separate, or standalone, configuration. This type of configuration is a more achievable near-term technology solution since it does not stipulate additional certification or integration requirements on UAS manufacturers. However, a standalone display configuration has the potential to result in pilot performance issues resulting from the cognitive costs of switching between the primary DAA display and the primary navigation and control display. This configuration is also particularly susceptible to errors if the displays are in different orientations (e.g., north-up versus track-up). Both the integrated and standalone display configurations were presented to 16 active UAS pilots in a medium-fidelity simulation, which included confederate air traffic controllers and pseudo pilots operating simulated manned traffic. Pilots were tasked with navigating two different mission routes while maintaining DAA well clear with scripted conflicts. Pilot response times (i.e., measured response) and ability to remain DAA well clear are reported. Primary results indicate that both display configurations resulted in favorable response times and well clear rates. While there were clear trends of pilots objectively performing better in the integrated display condition, with several measured response metrics reaching statistical significance, the differences between the two displays were typically moderate. While the primary variable of DAA display location did not have an especially large impact on pilot performance on its own, when examined alongside the type of DAA threat the pilot was facing (a caution-level versus a warning-level alert), the response time benefits associated with the integrated display were amplified. The implications of these American Institute of Aeronautics and Astronautics 2 results on the Phase 1 DAA MOPS and the connection of this data to previous studies is also discussed.
detect and avoid↗