Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error metric”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

Monitoring cognitive function and need with the automated neuropsychological assessment metrics in Decompression Sickness (DCS) research

Hypobaric decompression sickness (DCS) research presents the medical monitor with the difficult task of assessing the onset and progression of DCS largely on the basis of subjective symptoms. Even with the introduction of precordial Doppler ultrasound techniques for the detection of venous gas emboli (VGE), correct prediction of DCS can be made only about 65 percent of the time according to data from the Armstrong Laboratory's (AL's) hypobaric DCS database. An AL research protocol concerned with exercise and its effects on denitrogenation efficiency includes implementation of a performance assessment test battery to evaluate cognitive functioning during a 4-h simulated 30,000 ft (9144 m) exposure. Information gained from such a test battery may assist the medical monitor in identifying early signs of DCS and subtle neurologic dysfunction related to cases of asymptomatic, but advanced, DCS. This presentation concerns the selection and integration of a test battery and the timely graphic display of subject test results for the principal investigator and medical monitor. A subset of the Automated Neuropsychological Assessment Metrics (ANAM) developed through the Office of Military Performance Assessment Technology (OMPAT) was selected. The ANAM software provides a library of simple tests designed for precise measurement of processing efficiency in a variety of cognitive domains. For our application and time constraints, two tests requiring high levels of cognitive processing and memory were chosen along with one test requiring fine psychomotor performance. Accuracy, speed, and processing throughout variables as well as RMS error were collected. An automated mood survey provided 'state' information on six scales including anger, happiness, fear, depression, activity, and fatigue. An integrated and interactive LOTUS 1-2-3 macro was developed to import and display past and present task performance and mood-change information.

Nesthus, Thomas E.↗

Management of the Three Mile Island Unit 2 Accident Corium and Severely Damaged Fuel Debris (Rev. 2)

The Three Mile Island, Unit Two (TMI-2) pressurized water reactor core underwent a significant meltdown in 1979 due to an untimely combination of maintenance problems that led to a loss of feedwater, followed by a series of operational misunderstandings and errors. Primary coolant discharging through a malfunctioning valve represented what was analyzed as a “small-break” loss-of-coolant accident (LOCA) and ultimately became a full core meltdown. The melted core recovery process required the development of a wide array of tools. After approximately three years of water management and other cleanup actions, the first views of the core revealed a much higher degree of damage than previously expected. Approximately 62 metric tons of the core had melted, leaving only 42 of the 177 fuel assemblies standing with fuel rods intact. The core to be recovered was composed of loose, gravel-like and granular particulate material and a central solidified mass of formerly molten fuel. Molten fuel had also penetrated some of the pressure vessel internals and resolidified below the main core support structure. Robotic tools that had been designed for the task were of limited effectiveness due to the range of material types and phases.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Management of the Three Mile Island Unit 2 Accident Corium and Severely Damaged Fuel Debris (Rev. 2)

The Three Mile Island, Unit Two (TMI-2) pressurized water reactor core underwent a significant meltdown in 1979 due to an untimely combination of maintenance problems that led to a loss of feedwater, followed by a series of operational misunderstandings and errors. Primary coolant discharging through a malfunctioning valve represented what was analyzed as a “small-break” loss-of-coolant accident (LOCA) and ultimately became a full core meltdown. The melted core recovery process required the development of a wide array of tools. After approximately three years of water management and other cleanup actions, the first views of the core revealed a much higher degree of damage than previously expected. Approximately 62 metric tons of the core had melted, leaving only 42 of the 177 fuel assemblies standing with fuel rods intact. The core to be recovered was composed of loose, gravel-like and granular particulate material and a central solidified mass of formerly molten fuel. Molten fuel had also penetrated some of the pressure vessel internals and resolidified below the main core support structure. Robotic tools that had been designed for the task were of limited effectiveness due to the range of material types and phases.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Pressurized Lunar Rover

The pressurized lunar rover (PLR) consists of a 7 m long, 3 m diameter cylindrical main vehicle and a trailer which houses the power and heat rejection systems. The main vehicle carries the astronauts, life support systems, navigation and communication systems, directional lighting, cameras, and equipment for exploratory experiments. The PLR shell is constructed of a layered carbon-fiber/foam composite. The rover has six 1.5 m diameter wheels on the main body and two 1.5 m diameter wheels on the trailer. The wheels are constructed of composites and flex to increase traction and shock absorption. The wheels are each attached to a double A-arm aluminum suspension, which allows each wheel 1 m of vertical motion. In conjunction with a 0.75 m ground clearance, the suspension aids the rover in negotiating the uneven lunar terrain. The 15 N-m torque brushless electric motors are mounted with harmonic drive units inside each of the wheels. The rover is steered by electrically varying the speeds of the wheels on either side of the rover. The PLR trailer contains a radiosotope thermoelectric generator providing 6.7 kW. A secondary back-up energy storage system for short-term high-power needs is provided by a bank of batteries. The trailer can be detached to facilitate docking of the main body with the lunar base via an airlock located in the rear of the PLR. The airlock is also used for EVA operation during missions. Life support is a partly regenerative system with air and hygiene water being recycled. A layer of water inside the composite shell surrounds the command center. The water absorbs any damaging radiation, allowing the command center to be used as a safe haven during solar flares. Guidance, navigation, and control are supplied by a strapdown inertial measurement unit that works with the on-board computer. Star mappers provide periodic error correction. The PLR is capable of voice, video, and data transmission. It is equipped with two 5 W X-band transponder, allowing simultaneous transmission and reception. An S-band transponder is used to communicate with the crew during EVA. The PLR has a total mass of 6197 kg. It has a nominal speed of 10 km/hr and a top speed of 18 km/hr. The rover is capable of towing 3 metric tons (in addition to the RTG trailer).

Creel, Kenneth↗

Scatter-Reducing Sounding Filtration Using a Genetic Algorithm and Mean Monthly Standard Deviation

Retrieval algorithms like that used by the Orbiting Carbon Observatory (OCO)-2 mission generate massive quantities of data of varying quality and reliability. A computationally efficient, simple method of labeling problematic datapoints or predicting soundings that will fail is required for basic operation, given that only 6% of the retrieved data may be operationally processed. This method automatically obtains a filter designed to reduce scatter based on a small number of input features. Most machine-learning filter construction algorithms attempt to predict error in the CO2 value. By using a surrogate goal of Mean Monthly STDEV, the goal is to reduce the retrieved CO2 scatter rather than solving the harder problem of reducing CO2 error. This lends itself to improved interpretability and performance. This software reduces the scatter of retrieved CO2 values globally based on a minimum number of input features. It can be used as a prefilter to reduce the number of soundings requested, or as a post-filter to label data quality. The use of the MMS (Mean Monthly Standard deviation) provides a much cleaner, clearer filter than the standard ABS(CO2-truth) metrics previously employed by competitor methods. The software's main strength lies in a clearer (i.e., fewer features required) filter that more efficiently reduces scatter in retrieved CO2 rather than focusing on the more complex (and easily removed) bias issues.

Mandrake, Lukas↗

Filter Tuning Using the Chi-Squared Statistic

This paper examines the use of the Chi-square statistic as a means of evaluating filter performance. The goal of the process is to characterize the filter performance in the metric of covariance realism. The Chi-squared statistic is the value calculated to determine the realism of a covariance based on the prediction accuracy and the covariance values at a given point in time. Once calculated, it is the distribution of this statistic that provides insight on the accuracy of the covariance. The process of tuning an Extended Kalman Filter (EKF) for Aqua and Aura support is described, including examination of the measurement errors of available observation types, and methods of dealing with potentially volatile atmospheric drag modeling. Predictive accuracy and the distribution of the Chi-squared statistic, calculated from EKF solutions, are assessed.

Filter Tuning↗

Winter Wheat Yield Assessment from Landsat 8 and Sentinel-2 Data: Incorporating Surface Reflectance, Through Phenological Fitting, into Regression Yield Models

A combination of Landsat 8 and Sentinel-2 offers a high frequency of observations (3–5 days) at moderate spatial resolution (10–30 m), which is essential for crop yield studies. Existing methods traditionally apply vegetation indices (VIs) that incorporate surface reflectances (SRs) in two or more spectral bands into a single variable, and rarely address the incorporation of SRs into empirical regression models of crop yield. In this work, we address these issues by normalizing satellite data (both VIs and SRs) derived from NASA’s Harmonized Landsat Sentinel-2 (HLS) product, through a phenological fitting. We apply a quadratic function to fit VIs or SRs against accumulated growing degree days (AGDDs), which affects the rate of crop development. The derived phenological metrics for VIs and SRs, namely peak, area under curve (AUC), and fitting coefficients from a quadratic function, were used to build empirical regression winter wheat models at a regional scale in Ukraine for three years, 2016–2018. The best results were achieved for the model with near infrared (NIR) and red spectral bands and derived AUC, constant, linear, and quadratic coefficients of the quadratic model. The best model yielded a root mean square error (RMSE) of 0.201 t/ha (5.4%) and coefficient of determination R2 = 0.73 on cross-validation.

phenological fitting↗

Evaluation of CMIP6 GCMs Over the CONUS for Downscaling Studies

Despite the necessity of Global Climate Models (GCMs) sub-selection in downscaling studies, an objective approach for their selection is currently lacking. Building on the previously established concepts in GCMs evaluation frameworks, we develop a weighted averaging technique to remove the redundancy in the evaluation criteria and rank 37 GCMs from the sixth phase of the Coupled Models Intercomparison Project over the contiguous United States. GCMs are rated based on their average performance across 66 evaluation measures in the historical period (1981–2014) after each metric is weighted between zero and one, depending on its uniqueness. The robustness of the outcome is tested by repeating the process with the empirical orthogonal function analysis in which each GCM is ranked based on its sum of distances from the reference in the principal component space. The two methodologies work in contrasting ways to remove the metrics redundancy but eventually develop similar GCMs rankings. A disparity in GCMs' behavior related to their sensitivity to the size of the evaluation suite is observed, highlighting the need for comprehensive multi-variable GCMs evaluation at varying timescales for determining their skillfulness over a region. The sub-selection goal is to use a representative set of skillful models over the region of interest without substantial overlap in their future climate responses and modeling errors in representing historical climate. Additional analyses of GCMs' independence and spread in their future projections provide the necessary information to objectively select GCMs while keeping all aspects of necessity in view.

54 ENVIRONMENTAL SCIENCES↗

How can a diverse set of integral and semi-integral measurements inform identification of discrepant nuclear data?

Nuclear data are used for a variety of applications, including criticality safety, reactor performance, and material safeguards. Despite the breadth of use-cases, the effective neutron multiplication factor, keff, of ICSBEP critical assemblies are primarily used for nuclear data validation; these are sensitive to specific energy regions and nuclides and are unable to uniquely constrain nuclear data. As a consequence, general-purpose nuclear data libraries, such as ENDF/B-VIII.0, may have deficiencies that, while not apparent in criticality applications, negatively impact other applications, such as non-destructive analysis of special nuclear material and neutron diagnosed subcritical experiments. Recent work by the Experiments Underpinned by Computational Learning for Improvements in Nuclear Data (EUCLID) project developed a machine learning tool, RAFIEKI, which uses random forests and the SHAP metric to determine which nuclear data contribute most to predicted bias between measured and simulated responses (e.g. keff). This paper contrasts RAFIEKI analysis applied to keff only against RAFIEKI analysis with keff paired with either LLNL pulsed sphere measurements or subcritical benchmarks. Two examples show that a) including pulsed sphere measurements substantially increases 9Be nuclear data importance to bias between 2 and 15 MeV, and b) including subcritical benchmarks has the potential for disentangling compensating errors between 240Pu (n,el) and (n,il) cross-sections between 0.1 and 10 MeV. These results show that RAFIEKI analysis applied to response sets that include, but go beyond, keff can aid nuclear data evaluators in identifying issues in nuclear data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Accurate and complete genomes from metagenomes

Genomes are an integral component of the biological information about an organism; thus, the more complete the genome, the more informative it is. Historically, bacterial and archaeal genomes were reconstructed from pure (monoclonal) cultures, and the first reported sequences were manually curated to completion. However, the bottleneck imposed by the requirement for isolates precluded genomic insights for the vast majority of microbial life. Shotgun sequencing of microbial communities, referred to initially as community genomics and subsequently as genome-resolved metagenomics, can circumvent this limitation by obtaining metagenome-assembled genomes (MAGs); but gaps, local assembly errors, chimeras, and contamination by fragments from other genomes limit the value of these genomes. Here, we discuss genome curation to improve and, in some cases, achieve complete (circularized, no gaps) MAGs (CMAGs). To date, few CMAGs have been generated, although notably some are from very complex systems such as soil and sediment. Through analysis of about 7000 published complete bacterial isolate genomes, we verify the value of cumulative GC skew in combination with other metrics to establish bacterial genome sequence accuracy. The analysis of cumulative GC skew identified potential misassemblies in some reference genomes of isolated bacteria and the repeat sequences that likely gave rise to them. We discuss methods that could be implemented in bioinformatic approaches for curation to ensure that metabolic and evolutionary analyses can be based on very high-quality genomes.

59 BASIC BIOLOGICAL SCIENCES↗

Models for Resilience Design Patterns

Resilience plays an important role in supercomputers by providing correct and efficient operation in case of faults, errors, and failures. Resilience design patterns offer blueprints for effectively applying resilience technologies. Prior work focused on developing initial efficiency and performance models for resilience design patterns. This paper extends it by (1) describing performance, reliability, and availability models for all structural resilience design patterns, (2) providing more detailed models that include flowcharts and state diagrams, and (3) introducing the Resilience Design Pattern Modeling (RDPM) tool that calculates and plots the performance, reliability, and availability metrics of individual patterns and pattern combinations.

Kumar, Mohit↗

Human Factors and Habitability Challenges for Mars Missions

As NASA is planning to send humans deeper into space than ever before, adequate crew health and performance will be critical for mission success. Within the NASA Human Research Program (HRP), the Space Human Factors and Habitability (SHFH) team is responsible for characterizing the risks associated with human capabilities and limitations with respect to long-duration spaceflight, and for providing mitigations (e.g., guidelines, technologies, and tools) to promote safe, reliable and productive missions. SHFH research includes three domains: Advanced Environmental Health (AEH), Advanced Food Technology (AFT), and Space Human Factors Engineering (SHFE). The AEH portfolio focuses on understanding the risk of microbial contamination of the spacecraft and on the development of standards for exposure to potential toxins such as chemicals, bacteria, fungus, and lunar/Martian dust. The two risks that the environmental health project focuses on are adverse health effects due to changes in host-microbe interactions, and risks associated with exposure to dust in planetary surface habitats. This portfolio also proposes countermeasures to these risks by making recommendations that relate to requirements for environmental quality, foods, and crew health on spacecraft and space missions. The AFT portfolio focuses on reducing the mass, volume, and waste of the entire integrated food system to be used in exploration missions, and investigating processing methods to extend the shelf life of food items up to five years, while assuring that exploration crews will have nutritious and palatable foods. The portfolio also delivers improvements in both the food itself and the technologies for storing and preparing it. SHFE sponsors research to establish human factors and habitability standards and guidelines in five risk areas, and provides improved design concepts for advanced crew interfaces and habitability systems. These risk areas include: Incompatible vehicle/habitat design, inadequate human-computer interaction, inadequate critical task design, inadequate human-automation/robotic interaction, and performance errors due to training deficiencies. To address the identified research gaps within each risk, SHFH's research plan includes studies in the laboratory, in analogs, and on International Space Station (ISS). In addition to establishing and maintaining the risk-based research portfolio, SHFH is also implementing a qualitative approach to determine how we at NASA evaluate human performance. Via interviews with experts, such as trainers, flight controllers, and flight surgeons, we are collecting the metrics by which they assess human performance, evidence of performance issues, and potential or actual consequences. The Human Performance Data Project will determine what human performance data have been collected in the past at NASA, and what data should be collected in the future in order to complete our knowledgebase and reduce risks related to human factors and habitability.

Whitmore, Mihriban↗

Cognition in Space Workshop: Metrics and Models - 1

"Cognition in Space Workshop I: Metrics and Models" was the first in a series of workshops sponsored by NASA to develop an integrated research and development plan supporting human cognition in space exploration. The workshop was held in Chandler, Arizona, October 25-27, 2004. The participants represented academia, government agencies, and medical centers. This workshop addressed the following goal of the NASA Human System Integration Program for Exploration: to develop a program to manage risks due to human performance and human error, specifically ones tied to cognition. Risks range from catastrophic error to degradation of efficiency and failure to accomplish mission goals. Cognition itself includes memory, decision making, initiation of motor responses, sensation, and perception. Four subgoals were also defined at the workshop as follows: (1) NASA needs to develop a human-centered design process that incorporates standards for human cognition, human performance, and assessment of human interfaces; (2) NASA needs to identify and assess factors that increase risks associated with cognition; (3) NASA needs to predict risks associated with cognition; and (4) NASA needs to mitigate risk, both prior to actual missions and in real time. This report develops the material relating to these four subgoals.

Woolford, Barbara↗

Accrued Delay Application in Trajectory-Based Operations

The air traffic management system lacks integration among its elements often due to using inconsistent information, models, and metrics about the traffic. Transitioning to trajectory-based operations, whereby flights are managed by full trajectories in space and time, will enable more integration, with the help of increased automation. Building on trajectory-based operations, an "accrued delay" metric is proposed, which continuously measures the amount of delay that a flight has accumulated up to the current time, including delays incurred during the current flight and inherited from previous flights through the turnaround process. Through a time-based metering and scheduling example, we show how using accrued delay as a metric can help integrate the decision-making across multiple decision horizons, leading to more efficient and balanced access to airspace services. We show that when prioritizing flights that have already accrued high delay because of a constrained runway resource, significant gains are achieved in terms of reducing total delay and its variance. We studied the sensitivity of these gains to numerous factors, such as time-based versus distance-based horizons, horizon size, and errors in conformance to scheduled times.

delay; trajectory-based operations; time-based flo↗

Accrued Delay Application in Trajectory-Based Operations

The air traffic management system lacks integration among its elements often due to using inconsistent information, models, and metrics about the traffic. Transitioning to trajectory-based operations, whereby flights are managed by full trajectories in space and time, will enable more integration, with the help of increased automation. Building on trajectory-based operations, an "accrued delay" metric is proposed, which continuously measures the amount of delay that a flight has accumulated up to the current time, including delays incurred during the current flight and inherited from previous flights through the turnaround process. Through a time-based metering and scheduling example, we show how using accrued delay as a metric can help integrate the decision-making across multiple decision horizons, leading to more efficient and balanced access to airspace services. We show that when prioritizing flights that have already accrued high delay because of a constrained runway resource, significant gains are achieved in terms of reducing total delay and its variance. We studied the sensitivity of these gains to numerous factors, such as time-based versus distance-based horizons, horizon size, and errors in conformance to scheduled times.

Idris, Husni↗

Thermonuclear Reaction Rates and Primordial Nucleosynthesis

Assuming the best numerical value for the cosmic baryonic density and the existence of three neutrino flavors, standard Big Bang nucleosynthesis is a parameter-free model. It is important to assess if the observed primordial abundances can be reproduced by simulations. Numerous studies have shown that the simulations overpredict the primordial 7 Li abundance by a factor of ≈3 compared to the observations. The discrepancy may be caused by unknown systematics in 7 Li observations, poorly understood depletion of lithium in stars, errors in thermonuclear rates that take part in the lithium and beryllium synthesis, or physics beyond the standard model. Here, we focus on the likelihood of a nuclear physics solution. The status of the key nuclear reaction rates is summarized. Big Bang nucleosynthesis simulations are performed with the most recent reaction rates, and the uncertainties of the predicted abundances are established using a Monte Carlo technique. Correlations between abundances and reaction rates are investigated based on the metric of mutual information. The rates of four reactions impact the primordial 7 Li abundance: 3 He(α,γ) 7 Be, d(p,γ) 3 He, 7 Be(d,p)2α, and 7 Be(n,p) 7 Li. We employ a genetic algorithm to search for simultaneous rate changes in these four reactions that may account for all observed primordial abundances. Furthermore, when the search is performed for reaction rate ranges that are much wider than recently reported uncertainties, no acceptable solutions are found. Based on the currently available evidence, we conclude that it is highly unlikely for the cosmological lithium problem to have a nuclear physics solution.

79 ASTRONOMY AND ASTROPHYSICS↗

GEM-CEDAR Challenge: Comparing Ionospheric Models with Poynting Flux from DMSP Observations

As part to the GEM-CEDAR challenge we are extending the model-data comparisons to electrodynamic in-situ measurements in low-Earth orbit. We use DMSP observations of electric and magnetic fields to compute Poynting Flux values along the satellite track in high latitudes including the auroral zones and the polar cap. Models of the ionosphere that include electrodynamic parameters have been run for five events selected for the GEM-CEDAR modeling challenge for which DMSP data are available for comparison. Combined with a magnetic field model we use the modeled electric fields to compute Poynting Flux and Joule Dissipation values from outputs of CTIPe, TIE-GCM, the ionospheric electrodynamics solvers of the SWMF, LFM and OpenGGCM magnetosphere-ionosphere coupled models, and the Weimer electric field model. The online metrics analysis tool at the Community Coordinated Modeling Center (CCMC) has been updated to handle the analysis of separate short segments of available data (high-latitude sections of the satellite orbit) with model outputs to analyze how well auroral patterns are being reproduced by the models. We present initial results from the new analysis tool in terms of model yields (ratio of the difference between maximum and minimum values of model results to the observation), timing/location errors of local maxima in the inbound and outbound auroral crossings as well as cross-correlations for individual passes. We collect the information for many DMSP passes and present an analysis for model performance during quiet and geomagnetically disturbed time periods using half-orbit integrated values as well.

Rastaetter, Lutz↗

An analysis of network deployment for a dedicated navigation tracking system

Stringent navigation accuracy requirements for future deep space missions are expected to be met by conventional two way radio metric data supplemented with Very Long Baseline Interferometric (VLBI) data provided by a dedicated tracking network. The performance of several proposed VLBI network configurations have been evaluated by comparing navigation capability for the probe delivery and post flight probe trajectory phases of the Galileo mission. Candidate configurations include stations located at the current intercontinental DSN sites, a network with sites in Hawaii, Florida and Washington, Regional (300 km) and a Micro (30 km) baseline systems. Sensitivity to systematic error sources, network deployment, viewing period and sampling strategy are investigated. The dominant factor in performance is shown to be the baseline length.

Ellis, J.↗