Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error metric”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

Development of a coupled experimental–computational approach for engineering optimization of spout-fluidized bed particle coating systems

The design of spout-fluidized bed (SFB) coating systems for nuclear particle fuels typically relies on trial-and-error processes, comprising iterative and time-consuming coating deposition experiments and post-deposition characterization. At an engineering scale, this approach to guided SFB system design is inefficient, highlighting the need for streamlined experimental methodologies which can correlate fluidization conditions to downstream coating outcomes. In this study, we combine time-resolved particle image velocimetry (PIV) with CFD–DEM simulations to benchmark hydrodynamic behavior in a 3D spout-fluidized bed. By exploiting easily accessible optical measurements of particle motion at the bed wall and within the spouting region, we obtain quantitative velocity fields that can be directly compared with model predictions of the occluded bed region, without resorting to complex imaging and characterization techniques such as X-ray or magnetic resonance tomography. Experimental benchmarking reveals strong agreement between CFD–DEM and PIV in the spout and annulus regions, while discrepancies near the wall highlight areas for future model development. Here, the proposed integrated experimental–numerical framework will enable a direct connection between measured variables and numerically predicted fluidization performance of dense, surrogate nuclear particle fuel feedstock such that experimental SFB component design can be rapidly evaluated, informing design decisions for nozzle geometry and operating conditions. Future work will extend this framework by correlating quantified fluidization metrics across nozzle geometries and operating conditions with the resulting coating morphology, microstructure, and uniformity. Establishing these correlations will enable predictive links between hydrodynamic performance and coating quality, providing a rational, scalable basis for optimizing SFB design prior to coating deposition.

CFD/DEM↗

A second order yield-temperature relation for accurate inference of burn-averaged quantities in multi-species plasmas

Measured yields and ion temperatures inferred from the fusion product energy spectra can be used as metrics for the performance of an ICF implosion. This can be to infer species separation, thermal decoupling, flows or other effects that can cause the inferred ion temperatures to deviate from the true underlying thermal temperature and the yield ratio to deviate from the expected value. Direct inference of the impact of these effects on observed temperatures and yields can be difficult to uncover due to underlying dependence on the shape and time evolution of the temperature and density proles of the fusing plasma. Due to differences in the temperature dependence of the reactivities, different fusion products are emitted from different regions and times within the implosion. In order to properly account for this, a second order analytic expression relating the apparent temperatures and yield ratios is developed. This expression can be coupled to models of yield and/or temperature altering effects to infer their burn-averaged impact on an implosion. The second order expression shows significant improvement over lower order expressions in synthetic data studies. Demonstrations of its applications to synthetic data coupled with models of ion thermal decoupling and radial flows are presented. In the case of thermal decoupling both first and second order expressions show reasonable levels of accuracy. To consistently infer the amplitude of radial flow with <10% error the second order equation is required.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

New Capability at ORNL: High Precision Uranium Titration

Destructive analytical measurements establish a nuclear facility’s nuclear material inventory and inventory differences for Nuclear Material Accountancy and Control. A nuclear laboratory’s ability to perform accurate high-precision analytical measurements is key for tracking large inventories within a facility’s material balance areas and during production to track material movement through dynamic processes. For uranium, these measurements are made by using several established high-precision measurement protocols. These include isotope dilution mass spectrometry, gravimetry, and potentiometric titrations. Whatever measurement technique a nuclear lab chooses to use, reference materials (RMs) with certified attributes and accompanying uncertainties are used to calibrate measurement systems, and are the cornerstone for accurate results. In addition to calibration, RMs provide for metrological traceability, are used for method development and validation, and thus provide critical evaluations of the appropriateness and performance of analytical processes used. Evaluations may include validation that a method is fit-for-purpose, quantification of systematic and random biases, and the evaluation of long-term and short-term performance metrics. High-precision measurement techniques require that measured attributes be certified to a high degree of precision in the RMs used—ultimately, to a higher degree than that of the measurement technique itself. The US authority on the production of special nuclear material Certified Reference Materials is the NBL Program Office (NBLPO), formally known as New Brunswick Laboratory (NBL). The NBLPO is responsible for the sales and distribution of existing NBL certified reference materials (CRMs) and for the production of the next generation of nuclear RMs. To accomplish its mission, NBLPO is establishing key base capabilities within the DOE laboratory complex that formerly existed at the NBL laboratory. The Nuclear Analytical Chemistry (NAC) section within the Chemical Sciences Division (CSD) at Oak Ridge National Laboratory (ORNL) is currently working with NBLPO to set up laboratory and measurement capabilities to provide measurements and capabilities for production and/or recertification of existing and future CRMs for uranium assay. The NBL-developed high-precision titration (HPT) method is a critically-evaluated, extremely precise and accurate primary method utilized for the determination of uranium content in a variety of uranium materials. The HPT method, combined with detailed balance weighing protocols, provides for an analytical methodology that is unsurpassed in precision and one in which all sources of error have been evaluated, a requirement of CRM certification. HPT capability within the United States was lost with the closure of the labs at NBL. The NAC has been collaborating with NBLPO to stand up and demonstrate the capability to perform uranium assay via HPT at ORNL. HPT can produce results with an expanded uncertainty of approximately 0.01% for pure uranium compounds, with typical precisions of <0.006%. The major tasks required to stand up the method at ORNL were the refurbishment of a dedicated lab and equipment setup, procedure development, analyst training, establishing method-specific quality assurance, and qualification of an analyst to perform the method. This report summarizes these tasks, outlines the documents drafted, and gives the outcome of the qualification titrations.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

A second order yield-temperature relation for accurate inference of burn-averaged quantities in multi-species plasmas

Measured yields and ion temperatures inferred from the fusion product energy spectra can be used as metrics for the performance of an ICF implosion. This can be used to infer species separation, thermal decoupling, flows, or other effects that can cause the inferred ion temperatures to deviate from the true underlying thermal temperature and the yield ratio to deviate from the expected value. Direct inference of the impact of these effects on observed temperatures and yields can be difficult to uncover due to the underlying dependence on the shape and time evolution of the temperature and density profiles of the fusing plasma. Due to differences in the temperature dependence of the reactivities, different fusion products are emitted from different regions and times within the implosion. In order to properly account for this, a second-order analytical expression relating the apparent temperatures and yield ratios is developed. This expression can be coupled to models of yield and/or temperature altering effects to infer their burn-averaged impact on an implosion. The second-order expression shows significant improvement over lower-order expressions in synthetic data studies. Demonstrations of its applications to synthetic data coupled with models of ion thermal decoupling and radial flows are presented. In the case of thermal decoupling, both first and second-order expressions show reasonable levels of accuracy. To consistently infer the amplitude of radial flow with a <10% error, the second-order equation is required.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Wireless Sensor Networks for Developmental and Flight Instrumentation

Wireless sensor networks (WSN) based on the IEEE 802.15.4 Personal Area Network and ZigBee Pro 2007 standards are finding increasing use in home automation and smart energy markets providing a framework for interoperable software. The Wireless Connections in Space Project, funded by the NASA Engineering and Safety Center, is developing technology, metrics and requirements for next-generation spacecraft avionics incorporating wireless data transport. The team from Stennis Space Center and Mobitrum Corporation, working under a NASA SBIR grant, has developed techniques for embedding plug-and-play software into ZigBee WSN prototypes implementing the IEEE 1451 Transducer Electronic Datasheet (TEDS) standard. The TEDS provides meta-information regarding sensors such as serial number, calibration curve and operational status. Incorporation of TEDS into wireless sensors leads directly to building application level software that can recognize sensors at run-time, dynamically instantiating sensors as they are added or removed. The Ames Research Center team has been experimenting with this technology building demonstration prototypes for on-board health monitoring. Innovations in technology, software and process can lead to dramatic improvements for managing sensor systems applied to Developmental and Flight Instrumentation (DFI) aboard aerospace vehicles. A brief overview of the plug-and-play ZigBee WSN technology is presented along with specific targets for application within the aerospace DFI market. The software architecture for the sensor nodes incorporating the TEDS information is described along with the functions of the Network Capable Gateway processor which bridges 802.15.4 PAN to the TCP/IP network. Client application software connects to the Gateway and is used to display TEDS information and real-time sensor data values updated every few seconds, incorporating error detection and logging to help measure performance and reliability in relevant target environments. Test results from our prototype WSN running the Mobitrum software system are summarized and the implications to the scalability and reliability for DFI applications are discussed. Our demonstration system, incorporating sensors for life support system and structural health monitoring is described along with test results obtained by running the demonstration prototype in relevant environments such as the Wireless Habitat Testbed at Johnson Space Center in Houston. An operations concept for improved sensor process flow from design to flight test is outlined specific to the areas of Environmental Control and Life Support System performance characterization and structural health monitoring of human-rated spacecraft. This operations concept will be used to highlight the areas where WSN technology, particularly plug-and-play software based on IEEE 1451, can improve the current process, resulting in significant reductions in the technical effort, overall cost and schedule for providing DFI capability for future spacecraft. RELEASED -

Alena, Richard↗

Characterization and Analysis of the Energy-Reporting Accuracy of Connected Devices

Emerging energy-efficient building systems increasingly exhibit greater functionality, often requiring multiple operating modes (e.g. white-tunability for lighting products and data traffic for devices with networked, integrated sensors). This increased functionality makes energy consumption estimates more complex. Given that these functions consume energy, the energy performance of such building systems is dependent on what operating modes they use and how much time they spend in each mode. Devices and systems that can report their own energy consumption mitigate this energy-performance uncertainty. This study explores the energy-reporting accuracy of market-available connected electrical outlets. The study considers two residential-market products (five units each, one outlet per unit) and three commercial-market products (two units each, 18 to 24 outlets per unit) with the ability to report power drawn and/or energy consumed by devices connected to their receptacles. The products were purchased through typical market channels. Pacific Northwest National Laboratory (PNNL) conducted testing in December 2018 at its Connected Lighting Test Bed (CLTB), using a custom-developed test setup and method adapted from industry standards. The setup collected energy-consumption data reported by the outlet devices under test (DUTs) at one-minute intervals and compared that data with measurements taken by a reference meter over a range of test conditions. The residential products reported power draw but not interval or cumulative energy consumption. The commercial products reported both power draw and cumulative energy consumption. Relative reporting error (RRE) was calculated for all measurements, and analysis of the results revealed variations across devices and test conditions. The total number of measurements (50 for each residential product, 60 for each commercial product) offers an appreciable comparison of performance at the make/model level. The average RRE of the residential products derived from reported power draw was -0.02% and -1.20%. The average RRE for two of the three the commercial products derived from reported power draw was worse than those of the residential products (-2.40%, -2.72%, -0.36%). The internal integration of power over time, used to calculate cumulative energy consumption, typically occurs at current and voltage sampling rates much higher than once per minute. This suggests that the average commercial-product RRE derived from reported energy consumption should be very consistent and better than performance based on reported power draw. However, the RRE derived from reported energy consumption varied significantly across the three makes of commercial-market products and was uniformly less accurate than performance based on reported power draw. Subsequent analysis identified a number of root causes for this decrease in performance, most of which were related to reporting resolution. The goals of this study are to generate awareness of building systems capable of reporting their own energy consumption, further interest in the value of energy data for a variety of uses, draw attention to how the accuracy of reported metrics can be characterized, and quantify the performance variation found in marketavailable products. The results of this study and subsequent related work may be relevant to stakeholders in industry-specification and standards-development organizations. The methods this study employs could inform test and measurement procedures and performance classifications for connected outlets, lighting products, and other building systems capable of reporting their own energy consumption. The study concludes with stakeholder recommendations, including the following: • Energy-reporting device and system manufacturers developing products that report energy consumption should characterize the accuracy of reported metrics using a reference meter calibrated by an independent laboratory that was accredited by an ILAC MRA signatory (and whose scope of accreditation explicitly covers energy measurement), and should include this information on product data sheets. • Standards and specification development organizations should develop application-specific performance classifications that end users can understand and relate to their energy-data use needs (e.g., 2% accuracy class for utility streetlight energy billing needs, or 10% accuracy class for ESCO performance verification needs). • Current or potential owners, operators, and specifiers of energy-reporting building systems should rigorously analyze the dependency of current and planned energy-data use cases on accuracy, noting in particular the dependence (or lack thereof) on relative vs. absolute accuracy, and on trueness vs. precision (i.e., repeatability), and should communicate use-case needs to industry standards and specification organizations.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Characterization and Analysis of the Energy-Reporting Accuracy of Connected Devices

Emerging energy-efficient building systems increasingly exhibit greater functionality, often requiring multiple operating modes (e.g. white-tunability for lighting products and data traffic for devices with networked, integrated sensors). This increased functionality makes energy consumption estimates more complex. Given that these functions consume energy, the energy performance of such building systems is dependent on what operating modes they use and how much time they spend in each mode. Devices and systems that can report their own energy consumption mitigate this energy-performance uncertainty. This study explores the energy-reporting accuracy of market-available connected electrical outlets. The study considers two residential-market products (five units each, one outlet per unit) and three commercial-market products (two units each, 18 to 24 outlets per unit) with the ability to report power drawn and/or energy consumed by devices connected to their receptacles. The products were purchased through typical market channels. Pacific Northwest National Laboratory (PNNL) conducted testing in December 2018 at its Connected Lighting Test Bed (CLTB), using a custom-developed test setup and method adapted from industry standards. The setup collected energy-consumption data reported by the outlet devices under test (DUTs) at one-minute intervals and compared that data with measurements taken by a reference meter over a range of test conditions. The residential products reported power draw but not interval or cumulative energy consumption. The commercial products reported both power draw and cumulative energy consumption. Relative reporting error (RRE) was calculated for all measurements, and analysis of the results revealed variations across devices and test conditions. The total number of measurements (50 for each residential product, 60 for each commercial product) offers an appreciable comparison of performance at the make/model level. The average RRE of the residential products derived from reported power draw was -0.02% and -1.20%. The average RRE for two of the three the commercial products derived from reported power draw was worse than those of the residential products (-2.40%, -2.72%, -0.36%). The internal integration of power over time, used to calculate cumulative energy consumption, typically occurs at current and voltage sampling rates much higher than once per minute. This suggests that the average commercial-product RRE derived from reported energy consumption should be very consistent and better than performance based on reported power draw. However, the RRE derived from reported energy consumption varied significantly across the three makes of commercial-market products and was uniformly less accurate than performance based on reported power draw. Subsequent analysis identified a number of root causes for this decrease in performance, most of which were related to reporting resolution. The goals of this study are to generate awareness of building systems capable of reporting their own energy consumption, further interest in the value of energy data for a variety of uses, draw attention to how the accuracy of reported metrics can be characterized, and quantify the performance variation found in marketavailable products. The results of this study and subsequent related work may be relevant to stakeholders in industry-specification and standards-development organizations. The methods this study employs could inform test and measurement procedures and performance classifications for connected outlets, lighting products, and other building systems capable of reporting their own energy consumption. The study concludes with stakeholder recommendations, including the following: • Energy-reporting device and system manufacturers developing products that report energy consumption should characterize the accuracy of reported metrics using a reference meter calibrated by an independent laboratory that was accredited by an ILAC MRA signatory (and whose scope of accreditation explicitly covers energy measurement), and should include this information on product data sheets. • Standards and specification development organizations should develop application-specific performance classifications that end users can understand and relate to their energy-data use needs (e.g., 2% accuracy class for utility streetlight energy billing needs, or 10% accuracy class for ESCO performance verification needs). • Current or potential owners, operators, and specifiers of energy-reporting building systems should rigorously analyze the dependency of current and planned energy-data use cases on accuracy, noting in particular the dependence (or lack thereof) on relative vs. absolute accuracy, and on trueness vs. precision (i.e., repeatability), and should communicate use-case needs to industry standards and specification organizations.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Overlapping Conditions in IMPACT

Introduction The IMPACT 1.0 model assumes independence of 119 different medical conditions. That is, it is assumed that one medical event maps to a single medical condition. However, it is often the case that a single medical event may lead to several different concurrent conditions (e.g., a single accident resulting in multiple fractures, chest/abdominal trauma, and sepsis). There is a significant overlap between many of the conditions in ICL 1.0. For example, depression and anxiety are two separate conditions but often co-exist. This overlap may lead to an overestimation in the incidence calculation. In future iterations of the model, we plan to address progression of medical conditions. Methods There are two possible methods to approach progression of a medical condition. The first is to take any medical condition in ICL, calculate its incidence and determine its outcomes no matter what sequelae occur. For example, calculate the incidence of prostatitis and determine its metrics (e.g., loss of crew life, risk of medical evacuation or task time affected) no matter what the sequelae might be (sepsis, hydronephrosis, renal failure, etc.). The second approach is to take any medical condition in the ICL and calculate the outcomes based on transitions to any other condition. For example, calculate the incidence of nephrolithiasis and determine the incidence of each possible transition (e.g., hydronephrosis, renal failure, UTI, pyelonephritis, sepsis) and then determine its metrics. With perfectly informative evidence, the answers should be the same using either method. The question is which approach best reduces the opportunity for overlapping. Results The team identified 31 conditions that were the most likely to transition to a secondary condition such as sepsis and respiratory failure. It was felt that the first approach, as described above, would be the easiest to implement and would have the greatest reduction in overlapping conditions. The identified conditions were primarily infectious conditions, like UTI and pneumonia (which could lead to both respiratory failure and sepsis), toxic inhalations, cardiac arrest, seizures, and trauma. Once these conditions were identified, the conditions were divided between the four clinicians on the team to identify those that were not consistent with the others in way they were approached. There were 13 conditions that were found to be problematic. Some condition definitions needed to be changed to eliminate references to transitions or to update them in cases where the definitions were out of date. Some conditions required new evidence to correct the loss of crew life, and one condition was felt to have so much overlap that it was recommended for elimination. A second effort required modification of the sepsis incidence calculation to prevent double counting of the conditions, such as prostatitis, that could progress to sepsis. Conclusion The team made significant progress in clarifying the method for dealing with transitions from one medical condition to another. In addition, errors were found and corrected in definitions, incidence, and loss of crew life as well as a condition in which reference was made to a CLiFF that was no longer included. These modifications will provide greater fidelity in the IMPACT model and reduce overlap.

Arian Anderson↗

A Blueprint for Demonstrating Quantum Supremacy with Superconducting Qubits

Long coherence times and high fidelity control recently achieved in scalable superconducting circuits paved the way for the growing number of experimental studies of many-qubit quantum coherent phenomena in these devices. Albeit full implementation of quantum error correction and fault tolerant quantum computation remains a challenge the near term pre-error correction devices could allow new fundamental experiments despite inevitable accumulation of errors. One such open question foundational for quantum computing is achieving the so called quantum supremacy, an experimental demonstration of a computational task that takes polynomial time on the quantum computer whereas the best classical algorithm would require exponential time and/or resources. It is possible to formulate such a task for a quantum computer consisting of less than a 100 qubits. The computational task we consider is to provide approximate samples from a non-trivial quantum distribution. This is a generalization for the case of superconducting circuits of ideas behind boson sampling protocol for quantum optics introduced by Arkhipov and Aaronson. In this presentation we discuss a proof-of-principle demonstration of such a sampling task on a 9-qubit chain of superconducting gmon qubits developed by Google. We discuss theoretical analysis of the driven evolution of the device resulting in output approximating samples from a uniform distribution in the Hilbert space, a quantum chaotic state. We analyze quantum chaotic characteristics of the output of the circuit and the time required to generate a sufficiently complex quantum distribution. We demonstrate that the classical simulation of the sampling output requires exponential resources by connecting the task of calculating the output amplitudes to the sign problem of the Quantum Monte Carlo method. We also discuss the detailed theoretical modeling required to achieve high fidelity control and calibration of the multi-qubit unitary evolution in the device. We use a novel cross-entropy statistical metric as a figure of merit to verify the output and calibrate the device controls. Finally, we demonstrate the statistics of the wave function amplitudes generated on the 9-gmon chain and verify the quantum chaotic nature of the generated quantum distribution. This verifies the implementation of the quantum supremacy protocol.

Kechedzhi, Kostyantyn↗

Calibration of the Diffusivity Predictions of Centipede Using Approximate Bayesian Computation and Applications in Nyx (Engineering Scale) and Xolotl-MARMOT (Meso-Scale) Simulations

Fission gas evolution and release in UO 2 nuclear fuel are important fuel performance metrics and occur in several distinct stages: 1) nucleation, growth and resolution of intra-granular bubbles, 2) diffusion to grain boundaries and 3) nucleation and growth of bubbles at grain boundaries, which eventually form a connected network (percolation) enabling release of gas from grain boundaries through connections to triple junctions, grain edges or free surfaces. The NE-SciDAC project is developing several computational tools to model this problem, which are connected in a hierarchical multi-scale framework. The information transfer in the multi-scale framework is a critical step that, in addition to best-estimates, should include uncertainty quantification. Despite taking a first-principles multi-scale approach, there is a need to perform parameter calibration to ensure consistency with available experimental data. In the present study, uncertainty quantification (UQ) and parameter calibration is demonstrated for one of the lower length scale codes in the multi-scale framework (Centipede) and then the results, including instances of the propagated uncertainties, are used in other codes within the framework, specifically Nyx and Xolotl-MARMOT. We calibrated the model parameters in Centipede, a computer code used to predict diffusivities of uranium (U) and xenon (Xe) in the context of the simulation of fission gas in uranium oxide (UO 2 ) nuclear fuel. The Centipede code depends on 183 parameters, all of which are subject to uncertainty. The three data sets used in our calibration effort are taken from the literature. This data is available as a set of measurements, including measurement errors. Our goal is to calibrate a statistical model that predicts both the value of the measurement and the uncertainty associated with the measurement. We perform a Bayesian calibration of the model parameters using a dedicated approximate Bayesian computation (ABC) likelihood function. To avoid excessive computational costs, we replace the expensive Centipede simulation code by a higher-order surrogate model, constructed using only the 9 most important parameters. These important parameters are identified by a preliminary global sensitivity analysis (GSA) study. Among the important parameters are T0 (the temperature at which UO 2 is perfectly stoichiometric) and Hf_pO2 (the temperature dependence of the oxygen (O) partial pressure) that should be considered as operating conditions to be estimated along with the other parameters. We consider two different cases: one where we define one set of these operating conditions for all data sets, and one where we define distinct operating condition parameters for each data set. The Xe diffusivities predicted by the latter case show distinct features that could not be observed in the former. Next, we use the diffusivity predictions by Centipede as input to Nyx, a reduced order fuel performance code focused on gas behavior alone, in order to estimate quantities associated with inter-granular bubble formation at conditions specified by the experiments. Finally, the diffusivities obtained from the calibrated Centipede runs were used in coupled Xolotl-MARMOT simulations of intra- and inter-granular gas evolution. The results are compared to simulations using the baseline diffusivities from Turnbull et al.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Object-Based Evaluation of Dynamical and Statistical Downscaled Precipitation Products over CONUS

High-resolution precipitation data, generated through dynamical downscaling (DD) or statistical downscaling (SD) of global climate model output, provide critical information for regional climate assessment and adaptation planning. Most downscaling development and validation have focused on accurate gridscale precipitation construction and ignored the spatial structure of precipitation across model grids and at the event scale. However, many applications, e.g., hydrologic modeling and the analysis using the downscaled precipitation, require a reasonable representation of the spatial structure of precipitation within watersheds. Therefore, a set of standard metrics to evaluate the representation of the spatial structure of individual storms across diverse downscaled precipitation products is desired. To address this need, we conducted an object-based evaluation of precipitation in decades-long DD and SD products over the contiguous United States (CONUS). Specifically, we evaluate their ability to reproduce various features of precipitation objects in the observations: total volume, precipitation area, peak intensity, and spatial structure. Multiple metrics (bias, Perkins score, and nonparametric statistical tests) are used to quantify model performance. Our evaluation reveals notable variations in performance among individual products across different climate zones and seasons, as well as between extreme and nonextreme events. In general, most DD products exhibit balanced performance across the four precipitation object features, while SD products vary more significantly in their performance across products. Based on this comprehensive evaluation, we provide guidance on choosing downscaled products for specific regions, seasons, and precipitation object features. These findings and recommendations can inform precipitation-relevant modeling and analysis over CONUS, guide future downscaling technique developments, and provide actionable information for climate impact assessment and adaptation.

Downscaling↗

A Metric to Quantify Shared Visual Attention in Two-Person Teams

Introduction: Critical tasks in high-risk environments are often performed by teams, the members of which must work together efficiently. In some situations, the team members may have to work together to solve a particular problem, while in others it may be better for them to divide the work into separate tasks that can be completed in parallel. We hypothesize that these two team strategies can be differentiated on the basis of shared visual attention, measured by gaze tracking. 2) Methods: Gaze recordings were obtained for two-person flight crews flying a high-fidelity simulator (Gontar, Hoermann, 2014). Gaze was categorized with respect to 12 areas of interest (AOIs). We used these data to construct time series of 12 dimensional vectors, with each vector component representing one of the AOIs. At each time step, each vector component was set to 0, except for the one corresponding to the currently fixated AOI, which was set to 1. This time series could then be averaged in time, with the averaging window time (t) as a variable parameter. For example, when we average with a t of one minute, each vector component represents the proportion of time that the corresponding AOI was fixated within the corresponding one minute interval. We then computed the Pearson product-moment correlation coefficient between the gaze proportion vectors for each of the two crew members, at each point in time, resulting in a signal representing the time-varying correlation between gaze behaviors. We determined criteria for concluding correlated gaze behavior using two methods: first, a permutation test was applied to the subjects' data. When one crew member's gaze proportion vector is correlated with a random time sample from the other crewmember's data, a distribution of correlation values is obtained that differs markedly from the distribution obtained from temporally aligned samples. In addition to validating that the gaze tracker was functioning reasonably well, this also allows us to compute probabilities of coordinated behavior for each value of the correlation. As an alternative, we also tabulated distributions of correlation coefficients for synthetic data sets, in which the behavior was modeled as a first-order Markov process, and compared correlation distributions for identical processes with those for disparate processes, allowing us to choose criteria and estimate error rates. 3) Discussion: Our method of gaze correlation is able to measure shared visual attention, and can distinguish between activities involving different instruments. We plan to analyze whether pilots strategies of sharing visual attention can predict performance. Possible measurements of performance include expert ratings from instructors, fuel consumption, total task time, and failure rate. While developed for two-person crews, our approach can be applied to larger groups, using intra-class correlation coefficients instead of the Pearson product-moment correlation.

Gontar, Patrick↗

Integrated Spatial, Spectral, & Temporal Optical Reflectance System for Precision Occupancy & Location Sensing to Improve Building Energy Efficiency

Buildings consume approximately 35% of the electricity used in the U.S. and building owners can significantly reduce this energy use by providing services like heating, electrical power and lighting only when people are present. The ARPAe funded program titled “INTEGRATED SPATIAL, SPECTRAL, & TEMPORAL OPTICAL REFLECTANCE SYSTEM FOR PRECISION OCCUPANCY & LOCATION SENSING TO IMPROVE BUILDING ENERGY EFFICIENCY” demonstrates how a low cost sensor technology developed for measuring distances can be used to count and locate occupants with a high degree of precision with a very low error rates. This platform tells a building control system where occupants are located (but not who they are) so that energy consuming services can be provided only when the services are needed by building occupants. The original proof of concept involved using low cost, commercially available time-of-flight (TOF) sensors that measure distance, but the performance of these existing sensors was lacking, as they could not operate properly in the presence of sunlight, which blinded the simple TOF sensors and limited their utility in buildings. This project proposed a powerful new class of TOF sensors that used state-of-the-art integrated circuit (IC) fabrication processes that combined advanced photonics with conventional silicon chip circuitry for improved sensor performance. An equally important part of this project was to find ways to maximize occupant count and location accuracy while using the fewest number of sensors possible, in order to keep costs low. By using building blueprints to create digital twins of commercial building spaces, the team developed new algorithms to maximize occupant count and tracking accuracy by properly locating the minimum number of sensors at just the right spots in the building. This capability not only minimizes system costs but also simplified sensor installation and system commissioning. Our simulations of our sensor networks for a range of commercial floorplan designs demonstrated that our installed cost target of $0.08/sqft was attainable, though not fully demonstrated during the project. Finally, we noted that the TOF sensor concept could provide a valuable role in health and eldercare by tracking patients without the need for worn sensors and would be useful for fall detection and other patient safety metrics, including tracking healthcare/patient interactions. We feel that, when fully developed, this new class of sophisticated TOF sensors and support software will be a powerful new approach to improving building energy efficiency based on occupant centric control platforms and will also open new levels of patient safety in healthcare operations. To realize this potential, the team formed the Troy Sensor Company LLC to oversee licensing of the programs patents and continue to seek commercialization of this program’s activity sensing technologies.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Tools for Analysis and Visualization of Large Time-Varying CFD Data Sets

In the second year, we continued to built upon and improve our scanline-based direct volume renderer that we developed in the first year of this grant. This extremely general rendering approach can handle regular or irregular grids, including overlapping multiple grids, and polygon mesh surfaces. It runs in parallel on multi-processors. It can also be used in conjunction with a k-d tree hierarchy, where approximate models and error terms are stored in the nodes of the tree, and approximate fast renderings can be created. We have extended our software to handle time-varying data where the data changes but the grid does not. We are now working on extending it to handle more general time-varying data. We have also developed a new extension of our direct volume renderer that uses automatic decimation of the 3D grid, as opposed to an explicit hierarchy. We explored this alternative approach as being more appropriate for very large data sets, where the extra expense of a tree may be unacceptable. We also describe a new approach to direct volume rendering using hardware 3D textures and incorporates lighting effects. Volume rendering using hardware 3D textures is extremely fast, and machines capable of using this technique are becoming more moderately priced. While this technique, at present, is limited to use with regular grids, we are pursuing possible algorithms extending the approach to more general grid types. We have also begun to explore a new method for determining the accuracy of approximate models based on the light field method described at ACM SIGGRAPH '96. In our initial implementation, we automatically image the volume from 32 equi-distant positions on the surface of an enclosing tessellated sphere. We then calculate differences between these images under different conditions of volume approximation or decimation. We are studying whether this will give a quantitative measure of the effects of approximation. We have created new tools for exploring the differences between images produced by various rendering methods. Images created by our software can be stored in the SGI RGB format. Our idtools software reads in pair of images and compares them using various metrics. The differences of the images using the RGB, HSV, and HSL color models can be calculated and shown. We can also calculate the auto-correlation function and the Fourier transform of the image and image differences. We will explore how these image differences compare in order to find useful metrics for quantifying the success of various visualization approaches. In general, progress was consistent with our research plan for the second year of the grant.

Wilhelms, Jane↗

A Quasi-Global Approach to Improve Day-Time Satellite Surface Soil Moisture Anomalies through the Land Surface Temperature Input

Passive microwave observations from various spaceborne sensors have been linked to the soil moisture of the Earth's surface layer. A new generation of passive microwave sensors are dedicated to retrieving this variable and make observations in the single theoretically optimal L-band frequency (1-2 GHz). Previous generations of passive microwave sensors made observations in a range of higher frequencies, allowing for simultaneous estimation of additional variables required for solving the radiative transfer equation. One of these additional variables is land surface temperature, which plays a unique role in the radiative transfer equation and has an influence on the final quality of retrieved soil moisture anomalies. This study presents an optimization procedure for soil moisture retrievals through a quasi-global precipitation-based verification technique, the so-called Rvalue metric. Various land surface temperature scenarios were evaluated in which biases were added to an existing linear regression, specifically focusing on improving the skills to capture the temporal variability of soil moisture. We focus on the relative quality of the day-time (01:30 pm) observations from the Advanced Microwave Scanning Radiometer for Earth Observing System (AMSR-E), as these are theoretically most challenging due to the thermal equilibrium theory, and existing studies indicate that larger improvements are possible for these observations compared to their night-time (01:30 am) equivalent. Soil moisture data used in this study were retrieved through the Land Parameter Retrieval Model (LPRM), and in line with theory, both satellite paths show a unique and distinct degradation as a function of vegetation density. Both the ascending (01:30 pm) and descending (01:30 am) paths of the publicly available and widely used AMSR-E LPRM soil moisture products were used for benchmarking purposes. Several scenarios were employed in which the land surface temperature input for the radiative transfer was varied by imposing a bias on an existing regression. These scenarios were evaluated through the Rvalue technique, resulting in optimal bias values on top of this regression. In a next step, these optimal bias values were incorporated in order to re-calibrate the existing linear regression, resulting in a quasi-global uniform LST relation for day-time observations. In a final step, day-time soil moisture retrievals using the re-calibrated land surface temperature relation were again validated through the Rvalue technique. Results indicate an average increasing Rvalue of 16.5%, which indicates a better performance obtained through the re-calibration. This number was confirmed through an independent Triple Collocation verification over the same domain, demonstrating an average root mean square error reduction of 15.3%. Furthermore, a comparison against an extensive in situ database (679 stations) also indicates a generally higher quality for the re-calibrated dataset. Besides the improved day-time dataset, this study furthermore provides insights on the relative quality of soil moisture retrieved from AMSR-E's day- and night-time observations.

soil moisture↗

Methods for Incorporating Model Uncertainty into Exoplanet Atmospheric Analysis

A key goal of exoplanet spectroscopy is to measure atmospheric properties, such as abundances of chemical species, in order to connect them to our understanding of atmospheric physics and planet formation. In this new era of high-quality JWST data, it is paramount that these measurement methods are robust. When comparing atmospheric models to observations, multiple candidate models may produce reasonable fits to the data. Typically, conclusions are reached by selecting the best-performing model according to some metric. This ignores model uncertainty in favor of specific model assumptions, potentially leading to measured atmospheric properties that are overconfident and/or incorrect. In this paper, we compare three ensemble methods for addressing model uncertainty by combining posterior distributions from multiple analyses: Bayesian model averaging, a variant of Bayesian model averaging using leave-one-out predictive densities, and stacking of predictive distributions. We demonstrate these methods by fitting the Hubble Space Telescope (HST) + Spitzer transmission spectrum of the hot Jupiter HD 209458b using models with different cloud and haze prescriptions. All of our ensemble methods lead to uncertainties on retrieved parameters that are larger but more realistic and consistent with physical and chemical expectations. Since they have not typically accounted for model uncertainty, uncertainties of retrieved parameters from HST spectra have likely been underreported. We recommend stacking as the most robust model combination method. Our methods can be used to combine results from independent retrieval codes and from different models within one code. They are also widely applicable to other exoplanet analysis processes, such as combining results from different data reductions.

79 ASTRONOMY AND ASTROPHYSICS↗

Development of Human System Integration at NASA

Human Systems Integration seeks to design systems around the capabilities and limitations of the humans which use and interact with the system, ensuring greater efficiency of use, reduced error rates, and less rework in the design, manufacturing and operational deployment of hardware and software. One of the primary goals of HSI is to get the human factors practitioner involved early in the design process. In doing so, the aim is to reduce future budget costs and resources in redesign and training. By the preliminary design phase of a project nearly 80% of the total cost of the project is locked in. Potential design changes recommended by evaluations past this point will have little effect due to lack of funding or a huge cost in terms of resources to make changes. Three key concepts define an effective HSI program. First, systems are comprised of hardware, software, and the human, all of which operate within an environment. Too often, engineers and developers fail to consider the human capacity or requirements as part of the system. This leads to poor task allocation within the system. To promote ideal task allocation, it is critical that the human element be considered early in system development. Poor design, or designs that do not adequately consider the human component, could negatively affect physical or mental performance, as well as, social behavior. Second, successful HSI depends upon integration and collaboration of all the domains that represent acquisition efforts. Too often, these domains exist as independent disciplines due to the location of expertise within the service structure. Proper implementation of HSI through participation would help to integrate these domains and disciplines to leverage and apply their interdependencies to attain an optimal design. Via this process domain interests can be integrated to perform effective HSI through trade-offs and collaboration. This provides a common basis upon which to make knowledgeable decisions. Finally, HSI must be considered early in the requirements development phase of system design and acquisition. This will provide the best opportunity to maximize return on investment (ROI) and system performance. HSI requirements must be developed in conjunction with capability ]based requirements generation through functional. HSI requirements will drive HSI metrics and embed HSI issues within the system design. After a system is designed, implementation of HSI oversights can be very expensive. An HSI program should be included as an integral part of a total system approach to vehicle and habitat development. This would include, but not limited to, workstation design, D&C development, volumetric analysis, training, operations, and human -robotic interaction. HSI is a necessary process for Human Space Flight programs to meet the Agency Human ]System standards and thus mitigate human risks to acceptable levels. NASA has been involved in HSI planning, procedures development, process, and implementation for many years, and has been building several internal and publicly accessible products to facilitate HSI fs inclusion in the NASA Systems Engineering Lifecycle. Some of these products include: NASA STD 3001 Volumes 1 and 2, Human Integration Design Handbook, NASA HSI Implementation Plan, NASA HSI Implementation Plan Templates, NASA HSI Implementation Handbook, and a 2 ]hour short course on HSI delivered as part of the NASA Space and Life Sciences Directorate Academy. These products have been created leveraging industry best practices and lessons learned from other Federal Government agencies.

Whitmore, Mihriban↗

Derivation and Testing of Consumptive Water Use Fraction for Specialty Crops

The Crop Consumptive Use Fraction (CCUF) expresses beneficial water use in the form of seasonal evapotranspiration of applied water (ETAW), relative to total irrigation volume. The metric is an indicator of the efficiency of agricultural water use and is a recommended component for preparation of agricultural water management plans in California. An FAO-56 based web application has been developed to facilitate retrospective evaluation of ETAW, and hence CCUF, at field level. The current application is optimized for prevailing climate in four of the state’s main growing regions: San Joaquin Valley, Sacramento Valley, Central Coast, and North Coast. User inputs include crop type, soil texture, irrigation method, daily irrigation volume, daily rainfall, and seasonal start/stop dates to define the analysis period. Time series of fractional green canopy cover (Fc), based on Landsat and Sentinel-2 Earth-resource satellite observations, are imported from NASA’s Satellite Irrigation Management Support (SIMS) system. Grass reference evapotranspiration (ETo) time series are accessed from Spatial CIMIS (California Irrigation Management Information System). Daily crop height (h) is estimated as a simple function of typical maximum height for the given crop type (from FAO-56) and Fc. A vegetation density coefficient (Kd) is derived from Fc and h. Stomatal control factors during mid-and late-season are applied to tree and vine crops. Typical values for minimum daily relative humidity and mean daily windspeed, derived from historical CIMIS weather data, are used to correct for regional deviations from standard climate (defined as RHmin=45%, windspeed =2m/s). The resulting daily basal crop coefficient (Kcb) represents the ET of a well-watered crop with minimal soil evaporation, relative to ETo. A soil water balance sub-model for the top 0.1 m is used to calculate daily evaporation coefficients (Ke). A second sub-model applies to the root zone to calculate crop water stress coefficients (Ks) and effective precipitation (Pe), which is the fraction of rainfall that is available for crop use. Those coefficients are combined with Kcb and ETo to calculate daily ETc. ETAW is then derived as cumulative ETc less cumulative Pe. For verification purposes, sensor installations were used to measure seasonal ETc in commercial fields for several annual and perennial specialty crops by soil water balance and energy balance methods. Model estimates of seasonal ETc show mean absolute error of <10% compared to the ground measurements.

Derivation↗