Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Error Metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Verification of Anisotropic Mesh Adaptation for Turbulent Simulations over ONERA M6 Wing

Unstructured anisotropic mesh adaptation is known to be an efficient way to control discretization errors in Computational Fluid Dynamics (CFD) simulations. Method verification is required to provide the confidence for routine use in production analysis. The current work aims at verification of anisotropic mesh adaptation for RANS simulations over the ONERA M6 wing. The present verification study is performed using four different flow solvers, three different implementations of the metric field, and three mesh mechanics packages. Two of the flow solvers use stabilized finite-element discretizations (FUN3D-SFE and GGNS), one uses finite-volume discretization (FUN3D-FV), and the last one uses mixed finite-volume and finite element discretizations (Wolf). The mesh adaptation is based on an error estimator that aims to control the quadratic error term in the linear interpolation of Mach number. Two sets of adaptations were performed; the first one controls the interpolation error in L2 norm and the second one controls the interpolation error in L4 norm. Convergence studies were performed on the forces and the pitching moment using all four solvers, and the results are compared with previously verified convergence studies on fixed (nonadapted) meshes. Both forces and pitching moment on adapted meshes are found to be converging to the fine mesh values faster than those on fixed meshes. In addition to forces and moments, convergence of surface pressure and skin friction coefficients at various measurement locations on the wing are also presented. Adapted-mesh surface pressure distributions agree with the fine fixed mesh pressure distributions. Adapted-mesh skin friction distributions contain high frequency noise with mean values approaching the fixed mesh pressure skin friction distributions.

Aravind Balan↗

Assessing Individual Differences in Adaptation to Extreme Environments: A 36-Hour Sleep Deprivation Study

In space, astronauts may experience effects of cumulative sleep loss due to demanding work schedules that can result in cognitive performance impairments, mood state deteriorations, and sleep-wake cycle disruption. Individuals who experience sleep deprivation of six hours beyond normal sleep times experience detrimental changes in their mood and performance states. Hence, the potential for life threatening errors increases exponentially with sleep deprivation. We explored the effects of 36-hours of sleep deprivation on cognitive performance, mood states, and physiological responses to identify which metrics may best predict fatigue induced performance decrements of individuals.

Martinez, Jacqueline↗

Comparison Between Path Lengths Traveled by Solar Electrons and Ions in Ground-Level Enhancement Events

We have examined the Wind/3DP/SST electron and Wind/EPACT/LEMT ion data to investigate the path length difference between solar electrons and ions in the ground-level enhancement (GLE) events in solar cycle 23. Assuming that the onset time of metric type II or decameter-hectometric (DH) type III radio bursts is the solar release time of non-relativistic electrons, we have found that within an error range of plus or minus 10% the deduced path length of low-energy (approximately 27 keV) electrons from their release site near the Sun to the 1 AU observer is consistent with the ion path length deduced by Reames from the onset time analysis. In addition, the solar longitude distribution and IMF topology of the GLE events examined are in favor of the coronal mass ejection-driven shock acceleration origin of observed non-relativistic electrons.We have also found an increase of electron path lengths with increasing electron energies. The increasing rate of path lengths is correlated with the pitch angle distribution (PAD) of peak electron intensities locally measured, with a higher rate corresponding to a broader PAD. The correlation indicates that the path length enhancement is due to the interplanetary scattering experienced by first arriving electrons. The observed path length consistency implies that the maximum stable time of magnetic flux tubes, along which particles transport, could reach 4.8 hr.

electrons↗

ACES M and S: Unmitigated Factorial Encounter Study on DAA/TCAS Interoperability

Realization of the expected proliferation of Unmanned Aircraft System (UAS) operations in the National Airspace System (NAS) depends on the development and validation of standards for UAS Detect and Avoid (DAA) Systems. The RTCA Special Committee 228 is charged with leading the development of draft Minimum Operational Performance Standards (MOPS) for UAS DAA Systems. NASA, as a participating member of RTCA SC-228 is committed to supporting the development and validation of draft requirements for DAA alerting and guidance systems. This presentation contains the results of two combinatorial encounter analysis studies using NASA's SAA Control fast-time simulation capability for this purpose. In these studies, encounters between two aircraft were simulated one at a time for the full factorial combination of encounter geometries (e.g., encounter angle, CPA offset) and aircraft performance (e.g., ownership and intruder ground speeds and vertical rates). The first study analyzes the relationships (e.g., timeline) between the different alerting-safety regions in the SC-228 MOPS (in order of increasing severity): 1) DAA warning alert, 2) well clear recovery (WCR) guidance, 3) DAA-Collision Avoidance (CA), and 4) TCAS RA. This study will focus primarily on encounter situations in which TCAS RA occurs prior to any of the other alerting-safety boundaries. In particular, this study will investigate whether using vertical distance or vertical distance at closest point of approach (i.e., vertical miss distance or VMD) is more appropriate for the definition of the DAA-CA region. In addition, cases where transitions between different regions skip an intermediate region will be analyzed. The second study in this presentation explores a proposal to use an altitude rate error threshold to determine if vertical maneuvers are acceptable for DAA WCR guidance against non-cooperative intruders. This study incorporates the radar from the Honeywell sensor model and examines a series of pairwise encounters between a non-cooperative intruder and a UAS ownship, with different combinations of intruder states and ownship performance levels. The study uses SAA Control as a simulation platform and pilot model, and Omnibands to provide DWC recovery guidance. Two simulation sets, one that allows vertical DWC recovery guidance and one that does not, are compared to determine if encounters with altitude rate errors above 250 feet-per-minute are more likely to have more severe losses of well clear, as determined by the Loss of Well-Clear Severity metric.

SaaControl↗

Integrating Satellite and Surface Sensor Networks for Irrigation Management Applications in California

Satellite mapping of evapotranspiration (ET) from irrigated agricultural lands can provide agricultural producers and water managers with information that can be used to optimize agricultural water use, especially in regions with limited water supplies. The timely delivery of information on agricultural crop water requirements has the potential to make irrigation scheduling more practical, convenient, and accurate. We present a system for irrigation scheduling and management support in California and describe lessons learned from the development and implementation of the system. The Satellite Irrigation Management Support (SIMS) framework integrates satellite data with information from agricultural weather networks to map crop canopy development, basal crop coefficients (Kcb), and basal crop evapotranspiration (ETcb) at the scale of individual fields. Information is distributed to agricultural producers and water managers via a web-based irrigation management decision support system and web data services. SIMS also provides an application programming interface (API) that facilitates integration with other irrigation decision support tools, estimation of total crop evapotranspiration (ETc) and calculation of on-farm water use efficiency metrics. Accuracy assessments conducted in commercial fields for more than a dozen crop types to date have shown that SIMS seasonal ETcb estimates are within 10 mean absolute error (MAE) for well-watered crops and within 15 across all crop types studied, and closely track daily ETc and running totals of ETc measured in each field. Use of a soil water balance model to correct for soil evaporation and crop water stress reduces this error to less than 8 MAE across all crop types studied to date relative to field measurements of ETc. Results from irrigation trials conducted by the project for four vegetable crops have also demonstrated the potential for use of ET-based irrigation management strategies to reduce total applied water by 20-40 relative to grower standard practices while maintaining crop yields and quality.

Nemani, Ramakrishna R.↗

Airborne observations in support of a satellite observation-based OH product

This presentation outlines work to date analyzing airborne observations to improve a satellite observation-based hydroxyl radical (OH) column product by interrogating model chemistry processes. Anderson et al., 2023, established a machine learning method to combine satellite observations of O3, CO, NO2, HCHO, H2O, and aerosol optical depth, along with analyzed sea surface temperatures, for the prediction of tropospheric column OH (TCOH). Since the TCOH machine learning model was trained on output from the MERRA-2 GMI model simulation, we seek to identify if any model deficiencies may yield errors in the TCOH prediction. By evaluating F0AM box model simulations and neural networks trained to reproduce in situ OH concentrations, together with output reaction rates and interpretability metrics, respectively, we validate the Anderson et al. TCOH model and assess the largest contributors to uncertainties.

Hydroxyl, oxidizing capacity, troposphere, airborn↗

Analysis of the vibratory excitation of gear systems. II - Tooth error representations, approximations, and application

The second part of a theory for predicting the vibratory excitation of gear systems from fundamental descriptions of gear tooth elastic properties and deviations of tooth faces from perfect involute surfaces is presented. The first part of the theory provides expressions for the Fourier-series coefficients of the vibratory excitation, and this paper gives expressions for these Fourier-series coefficients in terms of easily interpreted gear tooth metrics that are readily evaluated from tooth-face measurements. Results are given for rectangular tooth-face contact regions using two-dimensional Legendre polynomial expansions of local tooth-pair stiffnesses and stiffness-weighted deviations of tooth faces from perfect involute surfaces. A rigorous transfer function approach is developed that permits separation of the effects of gear tooth errors and gear design parameters; the theory is applicable to helical and spur gears and is illustrated with measurements of tooth-spacing errors and tooth profiles obtained from a pair of spur gears.

Mark, W. D.↗

Grid Resolution Study over Operability Space for a Mach 1.7 Low Boom External Compression Inlet

This paper presents a statistical methodology whereby the probability limits associated with CFD grid resolution of inlet flow analysis can be determined which provide quantitative information on the distribution of that error over the specified operability range. The objectives of this investigation is to quantify the effects of both random (accuracy) and systemic (biasing) errors associated with grid resolution in the analysis of the Lockheed Martin Company (LMCO) N+2 Low Boom external compression supersonic inlet. The study covers the entire operability space as defined previously by the High Speed Civil Transport (HSCT) High Speed Research (HSR) program goals. The probability limits in terms of a 95.0% confidence interval on the analysis data were evaluated for four ARP1420 inlet metrics, namely (1) total pressure recovery (PFAIP), (2) radial hub distortion (DPH/P), (3) ) radial tip distortion (DPT/P), and (4) ) circumferential distortion (DPC/P). In general, the resulting +/-0.95 delta Y interval was unacceptably large in comparison to the stated goals of the HSCT program. Therefore, the conclusion was reached that the "standard grid" size was insufficient for this type of analysis. However, in examining the statistical data, it was determined that the CFD analysis results at the outer fringes of the operability space were the determining factor in the measure of statistical uncertainty. Adequate grids are grids that are free of biasing (systemic) errors and exhibit low random (precision) errors in comparison to their operability goals. In order to be 100% certain that the operability goals have indeed been achieved for each of the inlet metrics, the Y+/-0.95 delta Y limit must fall inside the stated operability goals. For example, if the operability goal for DPC/P circumferential distortion is ≤0.06, then the forecast Y for DPC/P plus the 95% confidence interval on DPC/P, i.e. +/-0.95 delta Y, must all be less than or equal to 0.06.

Grid↗

Propulsion-airframe interactions predictability

An illustration of the possible magnitude of the transonic performance prediction problem is shown. These results derived from a careful and systematic set of tests run on a jet effects model, an aerodynamic and force model, and a pressure model, evaluated test techniques and wind tunnel effects. The results were then carefully compared with flight test data where significant discrepancies in zero-lift drag were observed. A vigorous review of the test techniques identified a number of potential error sources. Some of these were thought to be aircraft roughness and protuberances, tunnel anomalies, sting/model support corrections, and hot gas effects. In addition, there were questions on model metric splitline location and magnitude of corrections for scale and Reynolds number. Flight test inlet/engine characteristics were thought to differ, also, from those of the calibration settings in the ground facilities.

Smith, R. H.↗

On the application of optical-fiber image scramblers to astronomical spectroscopy

Single, step-index optical fibers, when properly employed, can function as optically efficient image scramblers. Their use as optical feeds for astronomical slit spectrographs can reduce zonal error levels in those instruments by orders of magnitude. As a consequence, the application of optical-fiber couplers to new and existing spectrographs may greatly increase the wavelength metric quality of conventional astronomical spectroscopy. The optical efficiencies of fiber couplers of a few tens of meters in length can be comparable to those of typical coude mirror trains in the visible portions of the spectrum. Elements of the design of fiber couplers are illustrated by discussion of a currently operational instrument.

Heacox, W. D.↗

Using LDPC Code Constraints to Aid Recovery of Symbol Timing

A method of utilizing information available in the constraints imposed by a low-density parity-check (LDPC) code has been proposed as a means of aiding the recovery of symbol timing in the reception of a binary-phase-shift-keying (BPSK) signal representing such a code in the presence of noise, timing error, and/or Doppler shift between the transmitter and the receiver. This method and the receiver architecture in which it would be implemented belong to a class of timing-recovery methods and corresponding receiver architectures characterized as pilotless in that they do not require transmission and reception of pilot signals. Acquisition and tracking of a signal of the type described above have traditionally been performed upstream of, and independently of, decoding and have typically involved utilization of a phase-locked loop (PLL). However, the LDPC decoding process, which is iterative, provides information that can be fed back to the timing-recovery receiver circuits to improve performance significantly over that attainable in the absence of such feedback. Prior methods of coupling LDPC decoding with timing recovery had focused on the use of output code words produced as the iterations progress. In contrast, in the present method, one exploits the information available from the metrics computed for the constraint nodes of an LDPC code during the decoding process. In addition, the method involves the use of a waveform model that captures, better than do the waveform models of the prior methods, distortions introduced by receiver timing errors and transmitter/ receiver motions. An LDPC code is commonly represented by use of a bipartite graph containing two sets of nodes. In the graph corresponding to an (n,k) code, the n variable nodes correspond to the code word symbols and the n-k constraint nodes represent the constraints that the code places on the variable nodes in order for them to form a valid code word. The decoding procedure involves iterative computation of values associated with these nodes. A constraint node represents a parity-check equation using a set of variable nodes as inputs. A valid decoded code word is obtained if all parity-check equations are satisfied. After each iteration, the metrics associated with each constraint node can be evaluated to determine the status of the associated parity check. Heretofore, normally, these metrics would be utilized only within the LDPC decoding process to assess whether or not variable nodes had converged to a codeword. In the present method, it is recognized that these metrics can be used to determine accuracy of the timing estimates used in acquiring the sampled data that constitute the input to the LDPC decoder. In fact, the number of constraints that are satisfied exhibits a peak near the optimal timing estimate. Coarse timing estimation (or first-stage estimation as described below) is found via a parametric search for this peak. The present method calls for a two-stage receiver architecture illustrated in the figure. The first stage would correct large time delays and frequency offsets; the second stage would track random walks and correct residual time and frequency offsets. In the first stage, constraint-node feedback from the LDPC decoder would be employed in a search algorithm in which the searches would be performed in successively narrower windows to find the correct time delay and/or frequency offset. The second stage would include a conventional first-order PLL with a decision-aided timing-error detector that would utilize, as its decision aid, decoded symbols from the LDPC decoder. The method has been tested by means of computational simulations in cases involving various timing and frequency errors. The results of the simulations ined in the ideal case of perfect timing in the receiver.

Jones, Christopher↗

Models and metrics for software management and engineering

This paper attempts to characterize and present a state of the art view of several quantitative models and metrics of the software life cycle. These models and metrics can be used to aid in managing and engineering software projects. They deal with various aspects of the software process and product, including resources allocation and estimation, changes and errors, size, complexity and reliability. Some indication is given of the extent to which the various models have been used and the success they have achieved.

Basili, V. R.↗

Fatigue Management Strategies for the Stratospheric Observatory for Infrared Astronomy

Operation of the Stratospheric Observatory for Infrared Astronomy entails a great deal of night-time work, with the potential for both acute and chronic sleep loss, as well as circadian rhythm dysynchrony. Such fatigue can result in performance decrements, with an increased risk of operator error. The NASA Dryden Flight Research Center manages this fatigue risk by means of a layered approach, to include: 1) Education and Training 2) Work Schedule Scoring 3) Obtained Sleep Metrics 4) Workplace and Operational Mitigations and 5) Incident or Accident Investigation. Specifically, quantitative estimation of the work schedule score, as well as the obtained sleep metric, allows Supervisors and Managers to better manage the risk of fatigue within the context of mission requirements.

Bendrick, Gregg↗

Characterization of Errors in Satellite-Based HCHO/NO 2 Tropospheric Column Ratios With Respect to Chemistry, Column-to-PBL Translation, Spatial Representation, and Retrieval Uncertainties

The availability of formaldehyde (HCHO) (a proxy for volatile organic compound reactivity) and nitrogen dioxide (NO 2 ) (a proxy for nitrogen oxides) tropospheric columns from ultraviolet–visible (UV–Vis) satellites has motivated many to use their ratios to gain some insights into the near-surface ozone sensitivity. Strong emphasis has been placed on the challenges that come with transforming what is being observed in the tropospheric column to what is actually in the planetary boundary layer (PBL) and near the surface; however, little attention has been paid to other sources of error such as chemistry, spatial representation, and retrieval uncertainties. Here we leverage a wide spectrum of tools and data to quantify those errors carefully. Concerning the chemistry error, a well-characterized box model constrained by more than 500 h of aircraft data from NASA's air quality campaigns is used to simulate the ratio of the chemical loss of HO 2 + RO 2 (LRO x ) to the chemical loss of NO x (LNO x ). Subsequently, we challenge the predictive power of HCHO/NO 2 ratios (FNRs), which are commonly applied in current research, in detecting the underlying ozone regimes by comparing them to LRO x /LNO x . FNRs show a strongly linear (R 2 =0.94) relationship with LRO x /LNO x , but only on the logarithmic scale. Following the baseline (i.e., ln(LRO x /LNO x ) = −1.0 ± 0.2) with the model and mechanism (CB06, r2) used for segregating NO x -sensitive from VOC-sensitive regimes, we observe a broad range of FNR thresholds ranging from 1 to 4. The transitioning ratios strictly follow a Gaussian distribution with a mean and standard deviation of 1.8 and 0.4, respectively. This implies that the FNR has an inherent 20 % standard error (1σ) resulting from not accurately describing the RO x –HO x cycle. We calculate high ozone production rates (PO 3 ) dominated by large HCHO × NO 2 concentration levels, a new proxy for the abundance of ozone precursors. The relationship between PO 3 and HCHO × NO 2 becomes more pronounced when moving towards NO x -sensitive regions due to nonlinear chemistry; our results indicate that there is fruitful information in the HCHO × NO 2 metric that has not been utilized in ozone studies. The vast amount of vertical information on HCHO and NO 2 concentrations from the air quality campaigns enables us to parameterize the vertical shapes of FNRs using a second-order rational function permitting an analytical solution for an altitude adjustment factor to partition the tropospheric columns into the PBL region. We propose a mathematical solution to the spatial representation error based on modeling isotropic semivariograms. Based on summertime-averaged data, the Ozone Monitoring Instrument (OMI) loses 12 % of its spatial information at its native resolution with respect to a high-resolution sensor like the TROPOspheric Monitoring Instrument (TROPOMI) (> 5.5 × 3.5 km 2 ). A pixel with a grid size of 216 km 2 fails at capturing ∼ 65 % of the spatial information in FNRs at a 50 km length scale comparable to the size of a large urban center (e.g., Los Angeles). We ultimately leverage a large suite of in situ and ground-based remote sensing measurements to draw the error distributions of daily TROPOMI and OMI tropospheric NO 2 and HCHO columns. At a 68 % confidence interval (1σ), errors pertaining to daily TROPOMI observations, either HCHO or tropospheric NO 2 columns, should be above 1.2–1.5 × 10 16 molec. cm −2 to attain a 20 %–30 % standard error in the ratio. This level of error is almost non-achievable with the OMI given its large error in HCHO. The satellite column retrieval error is the largest contributor to the total error (40 %–90 %) in the FNRs. Due to a stronger signal in cities, the total relative error (< 50 %) tends to be mild, whereas areas with low vegetation and anthropogenic sources (e.g., the Rocky Mountains) are markedly uncertain (> 100 %). Our study suggests that continuing development in the retrieval algorithm and sensor design and calibration is essential to be able to advance the application of FNRs beyond a qualitative metric.

Amir H. Souri↗

Effect of Anisotropic Mesh Adaptation on Surface Pressure Predictions for Atmospheric Entry Simulations

A metric-based mesh adaptation capability has been developed for the advanced compressible flow solver US3D. Metric-based mesh adaptation is a solution informed mesh adaptation strategy that improves the resolution of the mesh along anisotropic flow features, like strong shock waves or shear layers. An anisotropic error indicator is reconstructed based on a provided Computational Fluid Dynamics (CFD) solution which prescribes the locally desired element size and orientation. The benefits of this mesh adaptation strategy is twofold: first, it simplifies the manual meshing labor that typically needs to be carried out by the CFD engineer because the mesh adaptation is informed by the provided solution. Second, the computational cost is kept to a minimum while improving the resolution of the simulation. The aim here is to demonstrate how anisotropic mesh adaptation can be employed to improve the predictions of surface pressure for atmospheric entry vehicles. In this work, we compare CFD simulations that use this newly developed anisotropic mesh adaptation capability for US3D with pressure data that was collected by Mars Entry, Descent, and Landing Instrumentation (MEDLI2) suite.

Dirk Ekelschot↗

Orbit determination accuracy assessment for an asteroid flyby - A Galileo case study

The Galileo spacecraft may be targeted for a close flyby of an asteroid on its way to an encounter with Jupiter. An orbit determination accuracy analysis was carried out for the case of the asteroid 29 Amphitrite based on the use of radio metric and optical data types. Prior to encounter, the uncertainty in the asteroid's position, based on astrometric observations from earth, amounts to several hundred kilometers. This ephemeris uncertainty constitutes the dominant error in the determination of the spacecraft orbit with respect to Amphitrite. It is shown that the spacecraft-asteroid relative position can be improved by imaging asteroid-star pairs with the Galileo charge-coupled device (CCD) camera, enabling an accurate flyby of the asteroid. The main benefit of optical navigation is to enable the instrument pointing updates necessary for closeup viewing of the asteroid. A discussion of the evolution of the target error ellipse parameters as a function of data coverage and various combinations of radiometric and optical data types is also presented.

Kechichian, Jean A.↗

Effect of anisotropic mesh adaptation on surface pressure predictions for atmospheric entry simulations.

Recently, a metric-based mesh adaptation capability has been developed for the advanced compressible flow solver US3D. Metric-based mesh adaptation is a solution informed mesh adaptation strategy that typically improves the resolution of the mesh along anisotropic flow features, like strong shock waves or shear layers. An anisotropic error indicator is reconstructed based on a provided Computational Fluid Dynamics (CFD) solution which prescribes the locally desired element size and orientation. The benefits of this mesh adaptation strategy is twofold: first, it simplifies the manual meshing labor that typically needs to be carried out by the CFD engineer because the mesh adaptation is informed by the provided solution. Second, the computational cost is kept to a minimum while improving the resolution of the simulation. The aim here is to demonstrate how anisotropic mesh adaptation can be employed to improve the predictions of surface pressure for atmospheric entry vehicles. In this work, we compare CFD simulations that use this newly developed anisotropic mesh adaptation capability for US3D with pressure data that was collected by Mars Entry, Descent, and Landing Instrumentation 2 (MEDLI2) during the atmospheric entry phase of Mars2020.

D. Ekelschot↗

Safety Metrics for Human-Computer Controlled Systems

The rapid growth of computer technology and innovation has played a significant role in the rise of computer automation of human tasks in modem production systems across all industries. Although the rationale for automation has been to eliminate "human error" or to relieve humans from manual repetitive tasks, various computer-related hazards and accidents have emerged as a direct result of increased system complexity attributed to computer automation. The risk assessment techniques utilized for electromechanical systems are not suitable for today's software-intensive systems or complex human-computer controlled systems.This thesis will propose a new systemic model-based framework for analyzing risk in safety-critical systems where both computers and humans are controlling safety-critical functions. A new systems accident model will be developed based upon modem systems theory and human cognitive processes to better characterize system accidents, the role of human operators, and the influence of software in its direct control of significant system functions Better risk assessments will then be achievable through the application of this new framework to complex human-computer controlled systems.

Leveson, Nancy G↗