SEARCH · Engineering Papers

Results for “Error Metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Tuning the Interpolation Basis in a Multigrid Decomposition for Local Error Control

In the compression of scientific data, error-controlled compressors enable to considerably decrease the size of the dataset while maintaining adequate levels of accuracy. In this paper, we note that multi-level refactoring scheme such as MGARD i) rely on an approximation of the data based on the interpolation of coefficients, ii) estimate the resulting error with global metrics on the dataset. To improve on these two aspects, we propose a method that aims to divide the original dataset into blocks based on their smoothness and refactors each block separately with the most relevant interpolation order. We show the relevance of such a method on tailored datasets and the benefits and challenges when applying it to large scientific data.

Vidal, Nicolas [ORNL]↗

NASA NTRS1992

Deployable reflector antenna performance optimization using automated surface correction and array-feed compensation

Methods for increasing the electromagnetic (EM) performance of reflectors with rough surfaces were tested and evaluated. First, one quadrant of the 15-meter hoop-column antenna was retrofitted with computer-driven and controlled motors to allow automated adjustment of the reflector surface. The surface errors, measured with metric photogrammetry, were used in a previously verified computer code to calculate control motor adjustments. With this system, a rough antenna surface (rms of approximately 0.180 inch) was corrected in two iterations to approximately the structural surface smoothness limit of 0.060 inch rms. The antenna pattern and gain improved significantly as a result of these surface adjustments. The EM performance was evaluated with a computer program for distorted reflector antennas which had been previously verified with experimental data. Next, the effects of the surface distortions were compensated for in computer simulations by superimposing excitation from an array feed to maximize antenna performance relative to an undistorted reflector. Results showed that a 61-element array could produce EM performance improvements equal to surface adjustments. When both mechanical surface adjustment and feed compensation techniques were applied, the equivalent operating frequency increased from approximately 6 to 18 GHz.

Schroeder, Lyle C.↗

NASA NTRS2018

LUVOIR Primary Mirror Segment Alignment Control With Joint Laser Metrology and Segment Edge Sensing

An approach is developed for the alignment and stability maintenance of the LUVOIR segmented primary mirror using a segment state estimation and wavefront control method based on a hybrid segment motion sensing architecture of laser truss metrology and segment edge sensors. Our current computer model was generated for LUVOIR Architecture Option A with a 15-meter aperture, 120segment primary mirror. The methodology and simulation results will be presented and analyzed. JPL has a long history of technology development in laser metrology and edge sensors, including work in SIM [7], Keck and TMT [8], CCAT [3] and LUVOIR [1]. We will discuss our current efforts of LUVOIR laser metrology and edge-sensor models development, showing sensitivities of sensor measurements to various mirror eigenmodes, removing global modes and strengthening weak modes by performing joint (hybrid) laser-metrology and edge sensing. We will define and derive an important performance metric called wavefront error multiplier (WEM), and show that WEM provides a simple link between sensor errors and the closed-loop (controlled) system wavefront error. We will show WEM values for several hybrid sensor configuration options studied. We will discuss an algorithm for mirror shape control and maintenance through segment state and wavefront estimations using joint edge-metrology sensing. We will compare simulated performance of mirror state estimation, wavefront estimation and wavefront control based on joint edge-metrology sensing among several sensor configurations, and show the impact of sensor error distributions on the segmented mirror alignment performance. Mirror shape control performance will be also be evaluated in terms of imaging contrast between inner working angles (IWA) and outer working angles (OWA) of a LUVOIR coronagraph. The research was carried out at the Jet Propulsion Laboratory, California Institute of Technology, under a contract with the National Aeronautics and Space Administration. LUVOIR is a mission concept under study for the next astronomy Decadal Survey—the information presented in this paper is pre-decisional and is provided for planning and discussion purposes only.

Shelton, Chris↗

NASA NTRSDate not supplied

Dense Feature Tracking of Atmospheric Winds with Deep Optical Flow

Atmospheric winds are a key physical phenomenon impacting natural hazards, energy transport, ocean currents, large-scale circulation, and ecosystem fluxes. Observing winds is a complex process and presents a large gap in NASA’s Earth Observation System. Atmospheric motion vectors (AMVs) aim to fill this gap by making numerical estimates of cloud movement between sequences of multi-spectral satellite images, tracking clouds and water vapor. Recent imaging hardware and software advancements have enabled the use of numerical optical flow techniques to produce accurate and dense vector fields outperforming traditional methods. This work presents WindFlow as the first machine learning based system for feature tracking atmospheric motion using optical flow. Due to the lack of large-scale satellite-based observations, we leverage high-resolution numerical simulations from NASA's GEOS-5 Nature Run to perform supervised learning and transfer to satellite images. We demonstrate that our approach using deep learning based optical flow scales to ultra-high-resolution images of size 2881x5760 with less than 1 m/s bias and 2.5 m/s average error. Four network and learning architectures are compared and it is found that recurrent all-pairs field transforms (RAFT) produces the lowest errors on all metrics for wind speed and direction. Results on held out numerical outputs shows RAFT's good performance in each of the spatial, temporal, and physical dimensions. A comparison between WindFlow and an operational AMV product against rawinsonde observations show that RAFT transfers across simulations and thermal infrared satellite observations. This work shows that machine learning based optical flow is an efficient approach to generating robust feature tracking for AMVs consistently over large regions.

Atmospheric winds↗

DOE OSTI2021

The Effect of Spectral Resolution of Light Sources on Photopic and a-opic Quantities

There is a growing interest in including light source spectrum in advanced lighting software tools and simulations. Given that traditional lighting software tools have been used primarily for calculating photometric quantities, their simplifying assumptions may not be suitable for calculating other a-opic quantities. Commonly used simulation tools use three values to represent the three primary colors (red, green, and blue), but others have expanded the number of bands (i.e., the spectral resolution) to 9, 27, or 81 in an attempt to more accurately represent variations in light source spectrum and downstream spectrally-derived quantities. It remains unclear, however, to what extent spectral resolution affects calculated quantities. To address this gap, a numerical analysis was completed using a large spectral power distribution database (n = 1,302 light sources). Calculated illuminance, a-opic irradiance, luminous efficacy of radiation (LER), melanopic efficacy of radiation (MER), and melanopic to photopic (M/P) ratio were compared for spectral resolutions of 3 and 9 bands compared to a baseline of 81 bands. Across all examined lighting quantities, considerable errors—a mean absolute percent error of 18.4%—were found when using 3 band calculations. These were reduced to 4% for 9 band calculations. The errors varied by metric and light source type. The results suggest that the use of 9 bands can more accurately characterize performance of different light source types across a range of metrics compared to using 3 bands.

Abboushi, Belal K.↗

NASA NTRSDate not supplied

Goal-Oriented Discretization Error Control in Coupled Nearfield-Farfield Low-Boom Simulations

The method of adjoint weighted residuals is used to determine the level of discretization error in loudness predictions of sonic booms on the ground. We analyze the standard nearfied-farfield domain decomposition approach. In the nearfield domain, the three-dimensional Euler equations are solved to obtain a pressure signature generated by the aircraft. In the farfield, this waveform is propagated through the atmosphere to the ground by solving the augmented Burgers’ equation. Loudness is characterized using weighted sound-exposure-level metrics. We formulate discretization error estimates for the ground signature and loudness metrics for this one-way coupled system. Although the nearfield solution is independent of the farfield, the adjoint formulation for the coupled system provides feedback from the farfield to identify high-error regions in the nearfield. The results demonstrate that the discrete adjoint implementation is asymptotically consistent and provides reliable error estimates. Furthermore, we show how the error can be controlled through adaptive refinement of the nearfield mesh. The approach is evaluated on two- and three-dimensional problems, including the X-59 flight demonstration aircraft.

CST↗

NASA NTRS2006

A Predictive Approach to Eliminating Errors in Software Code

NASA s Metrics Data Program Data Repository is a database that stores problem, product, and metrics data. The primary goal of this data repository is to provide project data to the software community. In doing so, the Metrics Data Program collects artifacts from a large NASA dataset, generates metrics on the artifacts, and then generates reports that are made available to the public at no cost. The data that are made available to general users have been sanitized and authorized for publication through the Metrics Data Program Web site by officials representing the projects from which the data originated. The data repository is operated by NASA s Independent Verification and Validation (IV&V) Facility, which is located in Fairmont, West Virginia, a high-tech hub for emerging innovation in the Mountain State. The IV&V Facility was founded in 1993, under the NASA Office of Safety and Mission Assurance, as a direct result of recommendations made by the National Research Council and the Report of the Presidential Commission on the Space Shuttle Challenger Accident. Today, under the direction of Goddard Space Flight Center, the IV&V Facility continues its mission to provide the highest achievable levels of safety and cost-effectiveness for mission-critical software. By extending its data to public users, the facility has helped improve the safety, reliability, and quality of complex software systems throughout private industry and other government agencies. Integrated Software Metrics, Inc., is one of the organizations that has benefited from studying the metrics data. As a result, the company has evolved into a leading developer of innovative software-error prediction tools that help organizations deliver better software, on time and on budget.

Source record↗

NASA NTRS2014

The Uncertainty of Biomass Estimates from LiDAR and SAR Across a Boreal Forest Structure Gradient

In this study, weexamined the uncertainty of aboveground live biomass (AGB) estimates based on light detection and ranging (LiDAR) and synthetic aperture radar (SAR) measurements distributed across a low-biomass vegetation structure gradient fromforest to non-forest in boreal-like ecosystems. The conifer-dominant structure gradient was compiled from ground data amassed from multiple field expeditions in central Maine (USA), Aurskog (Norway), and across central Siberia (Russia). Single variable empirical models were built tomodel AGB fromremote sensingmetrics. Using thesemodels, we calculated a rootmean square error (RMSE) and a 95% confidence interval (CI) of the RMSE fromthe difference between the remote sensing AGB predictions and the ground reference AGB estimates within AGB intervals across a 0-100 Mg ha(exp.−1) boreal forest structure gradient. The results show that the error in AGB predictions (RMSE) and the error uncertainty (the CI) from LiDAR and SAR change across a forest gradient. The errors of airborne LiDAR and SAR metrics and spaceborne LiDAR platforms show a general trend of reduced relative errors as AGBmagnitudes increase, particularly from0 to 60 Mg ha (exp.−1). Empirical models relating spaceborne metrics to AGB and estimates of spaceborne LiDAR error uncertainty demonstrate the difficulty of characterizing differences in AGB at the site-level with current spaceborne sensors, particularly below 80 Mg ha (exp.−1) with less than 50-100% error.

Taiga↗

NASA NTRS2008

Parallel Anisotropic Tetrahedral Adaptation

An adaptive method that robustly produces high aspect ratio tetrahedra to a general 3D metric specification without introducing hybrid semi-structured regions is presented. The elemental operators and higher-level logic is described with their respective domain-decomposed parallelizations. An anisotropic tetrahedral grid adaptation scheme is demonstrated for 1000-1 stretching for a simple cube geometry. This form of adaptation is applicable to more complex domain boundaries via a cut-cell approach as demonstrated by a parallel 3D supersonic simulation of a complex fighter aircraft. To avoid the assumptions and approximations required to form a metric to specify adaptation, an approach is introduced that directly evaluates interpolation error. The grid is adapted to reduce and equidistribute this interpolation error calculation without the use of an intervening anisotropic metric. Direct interpolation error adaptation is illustrated for 1D and 3D domains.

Park, Michael A.↗

NASA NTRS1977

A relationship between eye movement patterns and performance in a precognitive tracking task

Eye movements made by various subjects in the performance of a precognitive tracking task are studied. The tracking task persented by an antiaircraft artillery (AAA) simulator has an input forcing function represented by a deterministic aircraft fly-by. The performance of subjects is ranked by two metrics. Good, mediocre, and poor trackers are selected for analysis based on performance during the difficult segment of the tracking task and over replications. Using phase planes to characterize both the eye movement patterns and the displayed error signal, a simple metric is developed to study these patterns. Two characterizations of eye movement strategies are defined and quantified. Using these two types of eye strategies, two conclusions are obtained about good, mediocre, and poor trackers. First, the eye tracker who used a fixed strategy will consistently perform better. Secondly, the best fixed strategy is defined as a Crosshair Fixator.

Repperger, D. W.↗

NASA NTRS2016

Image Navigation and Registration Performance Assessment Tool Set for the GOES-R Advanced Baseline Imager and Geostationary Lightning Mapper

The GOES-R Flight Project has developed an Image Navigation and Registration (INR) Performance Assessment Tool Set (IPATS) for measuring Advanced Baseline Imager (ABI) and Geostationary Lightning Mapper (GLM) INR performance metrics in the post-launch period for performance evaluation and long term monitoring. For ABI, these metrics are the 3-sigma errors in navigation (NAV), channel-to-channel registration (CCR), frame-to-frame registration (FFR), swath-to-swath registration (SSR), and within frame registration (WIFR) for the Level 1B image products. For GLM, the single metric of interest is the 3-sigma error in the navigation of background images (GLM NAV) used by the system to navigate lightning strikes. 3-sigma errors are estimates of the 99.73rd percentile of the errors accumulated over a 24-hour data collection period. IPATS utilizes a modular algorithmic design to allow user selection of data processing sequences optimized for generation of each INR metric. This novel modular approach minimizes duplication of common processing elements, thereby maximizing code efficiency and speed. Fast processing is essential given the large number of sub-image registrations required to generate INR metrics for the many images produced over a 24-hour evaluation period. Another aspect of the IPATS design that vastly reduces execution time is the off-line propagation of Landsat based truth images to the fixed grid coordinates system for each of the three GOES-R satellite locations, operational East and West and initial checkout locations. This paper describes the algorithmic design and implementation of IPATS and provides preliminary test results.

Image Navigation↗

NASA NTRS2016

Image Navigation and Registration (INR) Performance Assessment Tool Set (IPATS) for the GOES-R Advanced Baseline Imager and Geostationary Lightning Mapper

The GOES-R Flight Project has developed an Image Navigation and Registration (INR) Performance Assessment Tool Set (IPATS) for measuring Advanced Baseline Imager (ABI) and Geostationary Lightning Mapper (GLM) INR performance metrics in the post-launch period for performance evaluation and long term monitoring. For ABI, these metrics are the 3-sigma errors in navigation (NAV), channel-to-channel registration (CCR), frame-to-frame registration (FFR), swath-to-swath registration (SSR), and within frame registration (WIFR) for the Level 1B image products. For GLM, the single metric of interest is the 3-sigma error in the navigation of background images (GLM NAV) used by the system to navigate lightning strikes. 3-sigma errors are estimates of the 99.73rd percentile of the errors accumulated over a 24 hour data collection period. IPATS utilizes a modular algorithmic design to allow user selection of data processing sequences optimized for generation of each INR metric. This novel modular approach minimizes duplication of common processing elements, thereby maximizing code efficiency and speed. Fast processing is essential given the large number of sub-image registrations required to generate INR metrics for the many images produced over a 24 hour evaluation period. Another aspect of the IPATS design that vastly reduces execution time is the off-line propagation of Landsat based truth images to the fixed grid coordinates system for each of the three GOES-R satellite locations, operational East and West and initial checkout locations. This paper describes the algorithmic design and implementation of IPATS and provides preliminary test results.

Image Registration↗

DOE OSTI2025

Optimising the processing and storage of visibilities using lossy compression

The next-generation radio astronomy instruments are providing a massive increase in sensitivity and coverage, largely through increasing the number of stations in the array and the frequency span sampled. The two primary problems encountered when processing the resultant avalanche of data are the need for abundant storage and the constraints imposed by I/O, as I/O bandwidths drop significantly on cold storage. An example of this is the data deluge expected from the SKA Telescopes of more than 60 PB per day, all to be stored on the buffer filesystem. While compressing the data is an obvious solution, the impacts on the final data products are hard to predict. In this paper, we chose an error-controlled compressor – MGARD – and applied it to simulated SKA-Mid and real pathfinder visibility data, in noise-free and noise-dominated regimes. As the data have an implicit error level in the system temperature, using an error bound in compression provides a natural metric for compression. MGARD ensures the compression incurred errors adhere to the user-prescribed tolerance. To measure the degradation of images reconstructed using the lossy compressed data, we proposed a list of diagnostic measures, exploring the trade-off between these error bounds and the corresponding compression ratios, as well as the impact on science quality derived from the lossy compressed data products through a series of experiments. We studied the global and local impacts on the output images for continuum and spectral line examples. We found relative error bounds of as much as 10%, which provide compression ratios of about 20, have a limited impact on the continuum imaging as the increased noise is less than the image RMS, whereas a 1% error bound (compression ratio of 8) introduces an increase in noise of about an order of magnitude less than the image RMS. For extremely sensitive observations and for very precious data, we would recommend a 0.1% error bound with compression ratios of about 4. These have noise impacts two orders of magnitude less than the image RMS levels. At these levels, the limits are due to instabilities in the deconvolution methods. We compared the results to the alternative compression tool DYSCO, in both the impacts on the images and in the relative flexibility. MGARD provides better compression for similar error bounds and has a host of potentially powerful additional features.

Techniques: interferometric↗

NASA NTRSDate not supplied

Anisotropic Goal-Based Mesh Adaptation Metric Clarification and Development

Adaptive unstructured mesh techniques have a limited, but growing impact on production analysis workflows to control discretization error for reliable simulation results. Multiple independent implementations of flow solvers, anisotropic metric construction methods, and anisotropic mesh adaptation mechanics have matured. Goal-based metrics target estimated error in output functions, such as lift and drag, through the guidance of an adjoint solution. A unification of goal-based anisotropic metrics is presented for steady viscous flows, which is an active area of research. These goal-based metrics drive robust and efficient anisotropic mesh adaptation for the calculation of output functions. The super-convergent functional output error behavior of stabilized finite-element methods is exploited without a formal proof, and evidence of super-convergence is shown in numerical experiments. Mesh adapted drag and lift outputs for two simple bodies in compressible viscous flow show convergence of error to less than a single drag count. Asymptotic behavior established for relatively coarse meshes shows the efficiency of this goal-based metric when compared to solution interpolation error control and expert-guided meshing. Anisotropic mesh adaptation techniques are applied to a transport aircraft in a high-lift configuration where variation between approaches decreases with mesh refinement, but asymptotic behavior is not observed with available resources.

goal-based↗

NASA NTRS2018

Recent Advances to Estimation of Fixed-Interface Modal Models Using Dynamic Substructuring

In 2010, Allen & Mayes proposed to estimate the fixed-interface modes of a structure by measuring the modes of the structure bolted to a fixture and then applying constraints to the fixture using the transmission simulator method. While the method proved useful, and has indeed been used in studies since that point, a few peculiarities were noted. First, in some cases the estimated fixed-base natural frequencies were observed to converge very slowly to the true values (in simulated experiments) as the number of constraints was increased. To formulate these constraints, prior studies used only the free-interface modes of the fixture or the measured modes of the assembly. This work extends that to consider other sets of constraints, showing improved results. Furthermore, in some prior studies it has been observed that there were errors of more than 10% in the natural frequencies even when the fixture motion was hundreds of times smaller than the motion of the structure of interest (and so it had presumably been removed). This work explores this phenomenon, seeking to use the strain energy in the fixture, to the extent that it can be estimated using a test-analysis model for the fixture, as a metric to predict frequency error. The proposed methods are explored by applying them to simulated measurements from a beam and from the NASA Space Launch System coupled to the Mobile Launcher.

Allen, Mathew S.↗

NASA NTRS2009

Usability: Human Research Program - Space Human Factors and Habitability

The Usability project addresses the need for research in the area of metrics and methodologies used in hardware and software usability testing in order to define quantifiable and verifiable usability requirements. A usability test is a human-in-the-loop evaluation where a participant works through a realistic set of representative tasks using the hardware/software under investigation. The purpose of this research is to define metrics and methodologies for measuring and verifying usability in the aerospace domain in accordance with FY09 focus on errors, consistency, and mobility/maneuverability. Usability metrics must be predictive of success with the interfaces, must be easy to obtain and/or calculate, and must meet the intent of current Human Systems Integration Requirements (HSIR). Methodologies must work within the constraints of the aerospace domain, be cost and time efficient, and be able to be applied without extensive specialized training.

Sandor, Aniko↗

DOE OSTI2020

Cross-Market Price Difference Forecast Using Deep Learning for Electricity Markets

Price forecasting is in the center of decision making in electricity markets. Many researches have been done in forecasting energy prices while little research has been reported on forecasting price difference between day-ahead and realtime markets due to its high volatility, which however plays a critical role in virtual trading. To this end, this paper takes the first attempt to employ novel deep learning architecture with Bidirectional Long-Short Term Memory (LSTM) units to forecast the price difference between day-ahead and real-time markets for the same node. The raw data is collected from PJM market, processed and fed into the proposed network. The Root Mean Squared Error (RMSE) and customized performance metric are used to evaluate the performance of the proposed method. Case studies show that it outperforms the traditional statistical models like ARIMA, and machine learning models like XGBoost and SVR methods in both RMSE and the capability of forecasting the sign of price difference. Additionally, to cross-market price difference forecast, the proposed approach has the potential to be applied to solve other forecasting problems such as price spread forecast in DA market for Financial Transmission Right (FTR) trading purpose.

DA/RT price difference↗

DOE OSTI2022

Energetic particle optimization of quasi-axisymmetric stellarator equilibria

Abstract An important goal of stellarator optimization is to achieve good confinement of energetic particles such as, in the case of a reactor, alphas created by deuterium–tritium fusion. In this work, a fixed-boundary stellarator equilibrium was re-optimized for energetic particle confinement via a two-step process: first, by minimizing deviations from quasi-axisymmetry (QA) on a single flux surface near the mid-radius, and secondly by maintaining this improved QA while minimizing the analytical quantity Γ C , which represents the angle between magnetic flux surfaces and contours of J | | , the second adiabatic invariant. This was performed multiple times, resulting in a group of equilibria with significantly reduced energetic particle losses, as evaluated by Monte Carlo simulations of alpha particles in scaled-up versions of the equilibria. This is the first time that energetic particle losses in a QA stellarator have successfully been reduced by optimizing Γ C . The relationship between energetic particle losses and metrics such as QA error ( E q a ) and Γ C in this set of equilibria were examined via statistical methods and a nearly linear relationship between volume-averaged Γ C and prompt particle losses was found.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗