Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Error Metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

TBIRD, a rapid prototyping approach for design, assembly, and test of a LEO-to-ground lasercom CubeSat

The TeraByte InfraRed Delivery (TBIRD) system is a 3U payload on a 6U CubeSat launched in May 2022 which has now demonstrated space to ground links of >1 Terabyte (TB) per pass at a max data rate of 200Gbps. As a CubeSat mission, the development of the TBIRD payload was focused on low SWaP and a “rapid prototyping” approach which accepted higher risks to accelerate the schedule and reduce costs. The optomechanical design process followed standard in-house processes to develop a system that would be robust to LEO environmental loads, with a focus on the stability of the transmit (Tx) and receive (Rx) channel performance metrics. The driving requirement of maintaining 20μrad pointing error between the TX and Rx channels forced specific attention to thermal and mechanical load changes over operational conditions, which drove major design decisions. This paper describes some of engineering challenges overcome and approaches used to make TBIRD a successful program, as well as some of the tradeoffs of rapid prototyping precision optical payloads. TBIRD successfully met and exceeded the total downlink requirements listed above, with a bandwidth of 200Gbps and a total downlink of 4.8TB of information in a single pass.

TBIRD↗
DOE OSTI2026

How to Minimize Faradaic Efficiency Error in Electrochemical CO 2 Reduction for Gas Products

Faradaic efficiency (FE) is an important metric for evaluating electrochemical processes, such as carbon dioxide reduction, that is often used for performance comparisons. Although the equation to calculate FE is well-known, details needed to yield accurate values are often overlooked, potentially leading to errors exceeding 100%. Avoiding any errors is crucial for drawing correct conclusions, especially during a catalysis optimization process. Factors with high potential for FE errors include incorrect mass flow rates and temperature values, imprecise gas chromatography calibrations, and uncorrected gas viscosities, while factors with less potential are also identified. In conclusion, this manuscript presents FE calculation guidelines intended for both newcomers and experts in the field of electrochemical fuel production.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1972

Variable-length codes and the Fano metric.

It is shown that the metric proposed originally by Fano for sequential decoding is precisely the required statistic for minimum-error-probability decoding of variable-length codes. The analysis shows further that the 'natural' choice of bias in the metric is the code rate and gives insight into why the Fano metric has proved to be the best practical choice in sequential decoding. The recently devised Jelinek-Zigangirov 'stack algorithm' is shown to be a natural consequence of this interpretation of the Fano metric. Finally, it is shown that the elimination of the bias in the 'truncated' portion of the code tree gives a slight reduction in average computation at the sacrifice of increased error probability.

Massey, J. L.↗
NASA NTRSDate not supplied

Discretization Error Estimation and Control for Farfield Acoustic Signatures

We investigate the utility of adjoint-based error estimates for sonic boom farfield simulations governed by solutions of the augmented Burgers’ equation. Solution of this nonlinear system uses operator splitting with a second-order finite volume discretization in space and second-order Runge-Kutta time marching, while the absorption and molecular relaxation are solved using second-order central differencing. The discretization error in selected ground sonic boom cost functionals is estimated using the method of adjoint-weighted residuals. Key elements of the implementation process are emphasized with details provided on the practical aspects as appliedto the sonic boom farfield propagation. We establish the accuracy of the adjoint solutions usingcomplex step and finite difference approaches, and examine the accuracy of the error estimates using analytical N-wave solutions. We then apply it to a pressure waveform corresponding to the X-59 research aircraft. The investigations demonstrate that the method of adjoint-weighted residuals accurately predicts the level of discretization error present in sonic boom farfield simulations while offering insight into which features of the near field signal are the primary drivers of ground noise metrics. The numerical results indicate that at sampling frequencies as low as50kHz, discretization error in the propagation is under 0.01 dB[A] for realistically complex examples.

CST↗
DOE OSTI2021

Constrained stellarator coil curvature optimization with FOCUS

Finding less complicated coils that have adequately low field errors is a crucial step in stellarator development. One coil metric that is of high importance is the maximum curvature of the coil centreline, or coil single filament. Conductors cannot be bent below some threshold minimum radius of curvature. High coil curvatures can cause strains to exceed acceptable levels, especially in superconducting coils. We investigate three ways to optimize coil curvature and find that applying penalty functions to the coil curvature solves for coils that have a constrained maximum curvature and low field error. Penalty functions are implemented in FOCUS and coil solutions optimized for an HSX-like ‘plasma boundary’ are presented.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
NASA NTRS2017

A new concept of stability in orbit propagation, useful for quantifying numerical errors

We present the concept of topological stability in the numerical propagation of orbits, and show how it results in a useful new method for measuring the global numerical error of an orbit propagation. The concept applies to any problem in orbital dynamics. Moreover, it can be extended to any three-dimensional system of di erential equations of second order. In order to assess the topological stability of a given integration a special metric is introduced, which can be used to estimate the numerical errors robustly. The method is particularly well suited for dealing with strongly perturbed and chaotic systems. The construction is based on the constraint imposed by the Hopf map that supports the Kustaanheimo-Stiefel transformation. Generic concepts of stability are translated to KS space.

Pelaez, Jesus↗
NASA NTRS2007

Anisotropic Solution Adaptive Unstructured Grid Generation Using AFLR

An existing volume grid generation procedure, AFLR3, was successfully modified to generate anisotropic tetrahedral elements using a directional metric transformation defined at source nodes. The procedure can be coupled with a solver and an error estimator as part of an overall anisotropic solution adaptation methodology. It is suitable for use with an error estimator based on an adjoint, optimization, sensitivity derivative, or related approach. This offers many advantages, including more efficient point placement along with robust and efficient error estimation. It also serves as a framework for true grid optimization wherein error estimation and computational resources can be used as cost functions to determine the optimal point distribution. Within AFLR3 the metric transformation is implemented using a set of transformation vectors and associated aspect ratios. The modified overall procedure is presented along with details of the anisotropic transformation implementation. Multiple two-and three-dimensional examples are also presented that demonstrate the capability of the modified AFLR procedure to generate anisotropic elements using a set of source nodes with anisotropic transformation metrics. The example cases presented use moderate levels of anisotropy and result in usable element quality. Future testing with various flow solvers and methods for obtaining transformation metric information is needed to determine practical limits and evaluate the efficacy of the overall approach.

Marcum, David L.↗
DOE OSTI2022

Code verification for practically singular equations

We report the method-of-moments implementation of the electric-field integral equation (EFIE) yields many code-verification challenges due to the various sources of numerical error and their possible interactions. Matters are further complicated by singular integrals, which arise from the presence of a Green's function. To address these singular integrals, an approach is presented in wherein both the solution and Green's function are manufactured. Because the arising equations are poorly conditioned, they are reformulated as a set of constraints for an optimization problem that selects the solution closest to the manufactured solution. In this paper, we demonstrate how, for such practically singular systems of equations, computing the truncation error by inserting the exact solution into the discretized equations cannot detect certain orders of coding errors. On the other hand, the discretization error from the optimal solution is a more sensitive metric that can detect orders less than those of the expected convergence rate.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Predicting Device Parameters for Dye-Sensitized Solar Cells from Electronic Structure Calculations to Reproduce Experiment.

Given that improvements to the power-conversion efficiency (PCE) of dye-sensitized solar cells (DSSCs) have slowed in recent years, a means to accurately predict the device parameters yielded by trial dyes in silico, without having to synthesize them, would be extremely valuable to speed up the design process. Currently, the best-performing methods of calculating device parameters rely on a set of experimentally determined kinetic coefficients. In practice, it is very difficult to measure these kinetic parameters accurately, limiting the overall accuracy of such predictive methods. This work proposes a model to obtain key parameters such as J(SC), V-OC, and PCE using only the results from density functional theory (DFT) and time-dependent DFT calculations, noting that rates of electron-transfer steps are ultimately linked to the electronic structure of the dye center dot center dot center dot TiO2 working electrode. Six organic DSSC dyes from dissimilar chemical classes (L0, L1, L2, WS-2, WS-92, and C281) were chosen to demonstrate the power of this approach. Their a priori known experimentally determined device performance metrics served to validate our predictions. The greatest absolute error in our predicted PCE values was 0.36% relative to the experiment, while the greatest fractional error was 0.042. This indicates that the proposed model offers a dramatic improvement on previous predictive methods for DSSC device parameters, both in accuracy and in consistency. Moreover, such a predictive model has great potential to be applied to other photovoltaic applications, further enabling the design of novel, highly efficient photoactive materials.

density functional theory↗
NASA NTRS1981

Coding tradeoffs for improved performance of FH/MFSK systems in partial band noise

Partial band noise jamming can severely degrade the performance of frequency-hopped, M-ary frequency-shift keyed communciation systems. This paper illustrates the tradeoffs between channel coding, diversity, and block orthogonal (MFSK) modulation as a means of overcoming the advantage of worst case, non-adaptive (as opposed to repeat-back) partial band jamming. For ease of computation, the analysis relies on exponentially tight error bounds, and is based on a noncoherent detection metric that requires jamming state information for each hop. A more robust, less complex receiver structure which eliminates the jamming knowledge requirement is shown to degrade performance less than 2-1/2 dB. The coding tradeoffs discussed in this report are exemplified in the design of a hypothetical 32 kb/s military frequency-hopped communication link.

Levitt, B. K.↗
NASA NTRS1991

A study of a proposed modified torsional agility metric

A new candidate lateral agility metric, the modified torsional agility parameter, is proposed and tested through generic, nonlinear, non-real-time flight simulation programs of the F-18 and F-5A. The metric is aimed at quantifying high subsonic loaded roll capabilities which might be useful in modern air combat. The metric is considered to be straightforward for testing and measuring based on nonreal-time unmanned flight simulation. The metric is found to be sensitive to pilot input errors of less than full lateral stick to capture bank angle, when tested using unmanned flight simulations. It is suggested that, for redesigned configurations of both aircraft with improved lateral agility, the major benefit would be provided by fast and highly effective rudders, and a high level of pitch, roll, and yaw damping at moderate to high normal load factor levels.

Valasek, John↗
NASA NTRS2004

Computer-Aided Systems Engineering for Flight Research Projects Using a Workgroup Database

An online systems engineering tool for flight research projects has been developed through the use of a workgroup database. Capabilities are implemented for typical flight research systems engineering needs in document library, configuration control, hazard analysis, hardware database, requirements management, action item tracking, project team information, and technical performance metrics. Repetitive tasks are automated to reduce workload and errors. Current data and documents are instantly available online and can be worked on collaboratively. Existing forms and conventional processes are used, rather than inventing or changing processes to fit the tool. An integrated tool set offers advantages by automatically cross-referencing data, minimizing redundant data entry, and reducing the number of programs that must be learned. With a simplified approach, significant improvements are attained over existing capabilities for minimal cost. By using a workgroup-level database platform, personnel most directly involved in the project can develop, modify, and maintain the system, thereby saving time and money. As a pilot project, the system has been used to support an in-house flight experiment. Options are proposed for developing and deploying this type of tool on a more extensive basis.

Mizukami, Masahi↗
NASA NTRS2004

Sub-nanometer Level Model Validation of the SIM Interferometer

The Space Interferometer Mission (SIM) flight instrument will not undergo a full performance, end-to-end system test on the ground due to a number of constraints. Thus, analysis and physics-based models will play a significant role in providing confidence that SIM will meet its science goals on orbit. The various models themselves are validated against the experimental results obtained from the MicroArcsecond Metrology (MAM) testbed adn the Diffraction testbed (DTB). The metric for validation is provided by the SIM astrometric error budget.

modeling↗
NASA NTRSDate not supplied

Verification of Viscous Goal-Based Anisotropic Mesh Adaptation

Adaptive unstructured mesh techniques have a limited, but growing impact on production analysis workflows where the control of discretization error is critical to obtaining reliable simulation results. Recent progress has matured a number of independent implementations of flow solvers, error estimation methods, and anisotropic mesh adaptation mechanics. Anisotropic metric construction methods are evaluated with analytically defined primal and adjoint fields. This allows the comparison of different metric formulations and different implementations of the same formulation without the complications of a flow and adjoint solution method. Unstructured mesh adaptation tools are verified by comparison on analytic primal and dual field before verification on benchmark aerodynamics cases. The documentation of these verification exercises helps to prepare these goal-based methods for routine use in production simulation workflows.

Mesh adaptation↗
NASA NTRS1991

Metrics

A development status evaluation is presented for practical software performance measurement, or 'metrics', in which major innovations have recently occurred. Metrics address such aspects of software performance as whether a software project is on schedule, how many errors can be expected from it, whether the methodology being used is effective and the relative quality of the software employed. Metrics may be characterized as explicit, analytical, and subjective. Attention is given to the bases for standards and the conduct of metrics research.

Mcgarry, Frank↗
NASA NTRS2024

Summarizing Multiple Aspects of Triple Collocation Analysis in a Single Diagram

With the ongoing expansion of global observation networks, it is expected that we shall routinely analyze records of geophysical variables such as temperature from multiple collocated instruments. Validating datasets in this situation is not a trivial task because every observing system has its own bias and noise. Triple collocation is a general statistical framework to estimate the error characteristics in three or more observational-based datasets. In a triple colocation analysis, several metrics are routinely reported but traditional multiple-panel plots are not the most effective way to display information. A new formula of error variance is derived for connecting the key terms in the triple collocation theory. A diagram based on this formula is devised to facilitate triple collocation analysis of any data from observations, as illustrated using three aerosol optical depth datasets from the recent Aerosol Cloud meTeorology Interactions oVer the western ATlantic Experiment (ACTIVATE). An observational-based skill score is also derived to evaluate the quality of three datasets by taking into account both error variance and correlation coefficient. Several applications are discussed and sample plotting routines are provided.

triple collocation↗
DOE OSTI2024

Diagnostics of Mixed-State Topological Order and Breakdown of Quantum Memory

Topological quantum memory can protect information against local errors up to finite error thresholds. Such thresholds are usually determined based on the success of decoding algorithms rather than the intrinsic properties of the mixed states describing corrupted memories. Here we provide an intrinsic characterization of the breakdown of topological quantum memory, which both gives a bound on the performance of decoding algorithms and provides examples of topologically distinct mixed states. We employ three information-theoretical quantities that can be regarded as generalizations of the diagnostics of ground-state topological order, and serve as a definition for topological order in error-corrupted mixed states. We consider the topological contribution to entanglement negativity and two other metrics based on quantum relative entropy and coherent information. In the concrete example of the two-dimensional (2D) Toric code with local bit-flip and phase errors, we map three quantities to observables in 2D classical spin models and analytically show they all undergo a transition at the same error threshold. This threshold is an upper bound on that achieved in any decoding algorithm and is indeed saturated by that in the optimal decoding algorithm for the Toric code. Published by the American Physical Society 2024

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

Inter-well connectivity detection in CO 2 WAG projects using statistical recurrent unit models

Routine well-wise injection and production measurements contain significant information on subsurface structure and properties. Data-driven technology that interprets surface data into subsurface structure or properties can assist operators in making informed decisions by providing a better understanding of field assets. Our machine-learning framework is built on the statistical recurrent unit (SRU) model and interprets well-based injection/production data into inter-well connectivity without relying on a geologic model. We test it on synthetic and field-scale CO 2 EOR projects utilizing the water-alternating-gas (WAG) process. SRU is a special type of recurrent neural network (RNN) that allows for better characterization of temporal trends, by learning various statistics of the input at different time scales. In our application, the complete states (injection rate, pressure and cumulative injection) at injectors and pressure states at producers are fed to SRU as the input and the phase rates at producers are treated as the output. Once the SRU is trained and validated, it is then used to assess the connectivity of each injector to any producer using permutation variable importance method, wherein inputs corresponding to an injector are shuffled and the increase in prediction error at a given producer is recorded as the importance (connectivity metric) of the injector to the producer. This method is tested in both synthetic and field-scale cases. The validation of the proposed data-driven inter-well connectivity assessment is performed using synthetic data from simulation models where inter-well connectivity can be easily measured using the streamline-based flux allocation. The SRU model is shown to offer excellent prediction performance on the synthetic case. Despite significant measurement noise and frequent well shut-ins imposed in the field-scale case, the SRU model offers good prediction accuracy, the overall relative error of the phase production rates at most producers ranges from 10% to 30%. It is shown that the dominant connections identified by the data-driven method and streamline method are in close agreement. This significantly improves confidence in our data-driven procedure. The novelty of this work is that it is purely data-driven method and can directly interpret routine surface measurements to intuitive subsurface knowledge. Furthermore, the streamline-based validation procedure provides physics-based backing to the results obtained from data analytics. This study results in a reliable and efficient data analytics framework that is well-suited for large field applications.

42 ENGINEERING↗