Key performance metrics
Explore the source record for details and available documents.
formation flying↗
SEARCH · Engineering Papers
Results for “key performance metrics”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Space-borne Doppler Weather Radar Modeling for Radar Design Evaluation
A model has been developed to predict the reflectivity and Doppler performance of a spaceborne weather radar for atmospheric aerosol and cloud monitoring. The goal is to predict radar sensitivity, resolution, uncertainties and other key performance metrics vs. radar design parameters and hardware nonidealities. Analytical formulas are readily available to predict key performance metrics of a space-borne radar system as a function of design parameters such as antenna size, spacecraft velocity, transmit power, and receive noise figure. Effects of some system nonidealities such as antenna pointing errors, power amplifier nonlinearity and phase noise can be estimated using idealized methods. These analytical formulas use idealized forms of the antenna radiation pattern and weather statistics to predict system performance. However, it is desirable to have a more physical model based on discretized weather volumes in which the particle size distribution, Doppler distribution, and other parameters can be varied to study how the radar hardware design parameters and nonidealities affect the measurement of the weather reflectivity and Doppler characteristics. This would allow the radar designers to have more insight into what is being measured and the hardware parameters and errors that need to be carefully controlled to achieve best radar performance, as well as potential methods to calibrate the system or correct errors. This presentation will demonstrate some proof-of-concept Ka-band simulations where the discretized model agrees with the analytical formulas for a simple case where the elements in the discretized weather volume are defined by a constant reflectivity and simple velocity vectors. In particular, the system sensitivity and Doppler uncertainty are evaluated by analytical formulas as well as the discretized model. Future work will expand on this to include more complex weather scenarios and the addition of system nonidealities.
Sara Tucker↗
Risk Characterization Research for Artemis II: Human Factors and Behavioral Performance
BACKGROUND Artemis II will be the first time NASA astronauts go beyond low-Earth orbit (LEO) since the Apollo era, and the first astronauts heading into space in the Orion vehicle. As such, it provides a critical opportunity to refine our understanding of the likelihood and consequences associated with the Behavioral Medicine (BMed), Team, Human System Integration Architecture (HSIA), and Sleep Risks, and prepare for future Moon and Mars missions. However, Artemis II research efforts are uniquely shaped by in-mission data collection constraints. There is currently no in-mission crew time available to complete measures. In-mission data will need to be collected unobtrusively from available data streams (e.g., audiovisual, existing records such as schedules, and actigraphy). Accordingly, the overarching goal of our research is to utilize Artemis II data to further define the likelihood and consequences of these risks, and to create an unobtrusive research infrastructure that can be expanded to include future Artemis missions. This goal spans four aims across three research phases: (1) identify and operationally define key performances metrics and constructs across the four aforementioned risks, (2) develop an unobtrusive methodology and coding scheme for in-mission data collection, (3) characterize performance decrements due to Bmed, Team, HSIA, and Sleep Risks, and (4) develop a data infrastructure for future Artemis missions. The following details results of Phase I efforts in which we address Aims 1 and 2 to develop an unobtrusive measurement plan and coding scheme to capture key constructs, contributing factors, and performance decrements across each risk area. METHOD As part of Phase I, we conducted an interdisciplinary literature review and consulted with SMEs to identify unobtrusive methodologies that leverage text, audio, and/or video data as well as conceptualize key performance metrics, contributing factors, and BMed, Team, HSIA, and Sleep risk constructs related to performance decrements. The Phase I effort resulted in a finalized pre- and post-mission protocol for Artemis II, along with a measurement and coding scheme for in-mission Artemis II data. Phase II will involve data collection from the upcoming Artemis II mission. Phase III will include data processing, coding, depiction, analysis, and report writing of the Artemis II data. RESULTS & DISCUSSION To date, we have completed Phase I efforts. Specifically, we identified BMed, Team, HSIA, and Sleep risk constructs related to performance metrics, summarized how these constructs can be measured using audiovisual data collected during the mission, and worked with NASA’s HFBP Element to finalize a data collection protocol that leverages audiovisual input from the Orion spacecraft system. Our protocol includes novel unobtrusive methodologies that adhere to in-mission data streams and subsequent constraints (e.g., limited storage space on GoPro cameras, ambient noise impeding audio files) to best capture in-mission phenomena across each risk area. We will present our results from Phase I efforts, namely best practices for unobtrusive measurement as identified through literature reviews and SME consultation as well as codebook excerpts for use in Artemis II. We will include a description of planned work as we prepare for Phase II and Phase III of this research plan and the Artemis II mission itself. SUMMARY We describe progress on our Human Factors and Behavioral Performance Research for Artemis II study.
behavioral health↗
JUSTIFI: Software for Improving Performance Objectives via Energy Efficiency
With growing energy supply concerns and rising costs, energy efficiency is a critical component of industrial energy resilience and competitiveness by directly reducing energy operating costs. Energy efficiency projects in manufacturing also yield valuable benefits to other key metrics, such as improved quality, reduced maintenance costs, improved safety, decreased pollution, and enhanced productivity. However, it is difficult to receive approval for energy efficiency projects, so implementation rates are low, even when meeting capital project payback period criteria. The inclusion and quantification of non-energy benefits (NEBs) in the decision-making process for energy efficiency projects can improve the overall financial payback period while demonstrating a positive impact on the firm's key performance metrics and business strategy. Despite their significant financial and strategic value, NEBs are rarely factored into decision-making due to lack of tools to effectively identify and quantify them. Therefore, a comprehensive and integrative approach is needed for the rapidly evolving energy landscape. To address these challenges, through funding from U.S. Department of Energy, our new assessment methodology integrates common continuous improvement six sigma concepts, such as the DMAIC process, and a protocol of guiding questions, into energy efficiency assessments to identify NEBs. We have also developed open-source software, JUSTIFI, to guide users through this process, data collection, and quantification. It is designed to be used concurrently with DOE energy system analysis software suite, MEASUR. Our methodology and tools inform energy assessors, firm engineering, decision makers, and workforce seeking to increase energy resilience and to maximize benefits aligned with performance metrics.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗
JUSTIFI: Software for Improving Performance Objectives via Energy Efficiency
With growing energy supply concerns and rising costs, energy efficiency is a critical component of industrial energy resilience and competitiveness by directly reducing energy operating costs. Energy efficiency projects in manufacturing also yield valuable benefits to other key metrics, such as improved quality, reduced maintenance costs, improved safety, decreased pollution, and enhanced productivity. However, it is difficult to receive approval for energy efficiency projects, so implementation rates are low, even when meeting capital project payback period criteria. The inclusion and quantification of non-energy benefits (NEBs) in the decision-making process for energy efficiency projects can improve the overall financial payback period while demonstrating a positive impact on the firm's key performance metrics and business strategy. Despite their significant financial and strategic value, NEBs are rarely factored into decision-making due to lack of tools to effectively identify and quantify them. Therefore, a comprehensive and integrative approach is needed for the rapidly evolving energy landscape. To address these challenges, through funding from U.S. Department of Energy, our new assessment methodology integrates common continuous improvement six sigma concepts, such as the DMAIC process, and a protocol of guiding questions, into energy efficiency assessments to identify NEBs. We have also developed open-source software, JUSTIFI, to guide users through this process, data collection, and quantification. It is designed to be used concurrently with DOE energy system analysis software suite, MEASUR. Our methodology and tools inform energy assessors, firm engineering, decision makers, and workforce seeking to increase energy resilience and to maximize benefits aligned with performance metrics.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗
Evaluation of a Tactical Surface Metering Tool for Charlotte Douglas International Airport via Human-in-the-Loop Simulation
NASA has been working with the FAA and aviation industry partners to develop and demonstrate new concepts and technologies that integrate arrival, departure, and surface traffic management capabilities. In March 2017, NASA conducted a human-in-the-loop (HITL) simulation for integrated surface and airspace operations, modeling Charlotte Douglas International Airport, to evaluate the operational procedures and information requirements for the tactical surface metering tool, and data exchange elements between the airline controlled ramp and ATC Tower. In this paper, we focus on the calibration of the tactical surface metering tool using various metrics measured from the HITL simulation results. Key performance metrics include gate hold times from pushback advisories, taxi-in-out times, runway throughput, and departure queue size. Subjective metrics presented in this paper include workload, situational awareness, and acceptability of the metering tool and its calibration.
Verma, Savita↗
Evaluation of a Tactical Surface Metering Tool for Charlotte Douglas International Airport Via Human-in-the-Loop Simulation
NASA has been working with the FAA and aviation industry partners to develop and demonstrate new concepts and technologies that integrate arrival, departure, and surface traffic management capabilities. In March 2017, NASA conducted a human-in-the-loop (HITL) simulation for integrated surface and airspace operations, modeling Charlotte Douglas International Airport, to evaluate the operational procedures and information requirements for the tactical surface metering tool, and data exchange elements between the airline controlled ramp and ATC Tower. In this paper, we focus on the calibration of the tactical surface metering tool using various metrics measured from the HITL simulation results. Key performance metrics include gate hold times from pushback advisories, taxi-in/out times, runway throughput, and departure queue size. Subjective metrics presented in this paper include workload, situational awareness, and acceptability of the metering tool and its calibration
air traffic management↗
Nuclear Data Impact Assessment for the HTR-10 Pebble-Bed Reactor Using SCALE
The HTR-10 was used as a representative pebble-bed high-temperature gas-cooled reactor in this assessment of nuclear data’s impact on important reactor and spent fuel metrics, including safety-related quantities such as the effective multiplication factor (k eff ), temperature reactivity feedback, spent fuel inventory, and decay heat. Using the SCALE code system tools and ENDF/B-VII.1 nuclear data libraries, we quantify the effect of nuclear data uncertainties on these key performance metrics for both fresh fuel and equilibrium core configurations. For reactor core key parameters, important contributors to uncertainty include reactions of 235 U [$\bar{v}$, fission, (n, γ)], 238 U [elastic, (n, γ)], and graphite [elastic, (n, γ)]. Additional important contributors for the equilibrium core include reactions of higher actinides ( 239 Pu, 240 Pu) and fission products ( 135 Xe, 149 Sm). For spent fuel analysis, most nuclide inventory uncertainties remain below 5%. Higher uncertainties up to 11% are being observed for minor actinides like 243 Am and 244 Cm. Additionally, fission product uncertainties in 155 Eu and 155 Gd, of 25% and 23% respectively, are also significant and have implications for burnup credit applications. 110m Ag also shows high uncertainty of up to 11%, mainly due to fission product yield uncertainties. Decay heat relative uncertainties remain below 0.6% up to 10 years’ cooling time after fuel discharge. The highest relative uncertainty of 1.5% occurs at 500 years of cooling; however, because the decay heat value is very low at that time, the absolute uncertainty is not significant. This work demonstrates that extending assessments beyond fresh fuel k eff to include irradiated cores, nuclide inventories, and decay heat is essential in understanding the behavior of uncertainties as a function of fuel burnup and can support improvements of safety margins and spent fuel management.
Nuclear data impact↗
Updated Mars Mission Architectures Featuring Nuclear Thermal Propulsion
Nuclear thermal propulsion (NTP) can potentially enable routine human exploration of Mars and the solar system. By using nuclear fission instead of a chemical combustion process, and using hydrogen as the propellant, NTP systems promise rocket efficiencies roughly twice that of the best chemical rocket engines currently available. The most recent major Mars architecture study featuring NTP was the Design Reference Architecture 5.0 (DRA 5.0), performed in 2009. Currently, the predominant transportation options being considered are solar electric propulsion (SEP) and chemical propulsion; however, given NTP's capabilities, an updated architectural analysis is needed. This paper provides a top-level overview of several different architectures featuring updated NTP performance data. New architectures presented include a proposed update to the DRA 5.0 as well as an investigation of architectures based on the current Evolvable Mars Campaign, which is the focus of NASA's current analyses for the Journey to Mars. Architectures investigated leverage the latest information relating to NTP performance and design considerations and address new support elements not available at the time of DRA 5.0, most notably the Orion crew module and the Space Launch System (SLS). The paper provides a top level quantitative comparison of key performance metrics as well as a qualitative discussion of improvements and key challenges still to be addressed. Preliminary results indicate that the updated NTP architectures can significantly reduce the campaign mass and subsequently the costs for assembly and number of launches.
Rodriguez, Mitchell A.↗
Online task-space motion control for positioner-coordinated multi-robot manufacturing systems
Incorporating multiple robotic manipulators into large-scale manufacturing systems enhances production efficiency and expands manufacturing capabilities beyond those of single-robot systems. Workpiece positioners in robotic manufacturing have demonstrated significant benefits for process optimization, but coordination strategies for multi-robot systems with shared positioners have received limited attention. This work presents a task-space coordinated trajectory-tracking control framework for multi-robot manufacturing systems, in which robots coordinate their motions within a shared, dynamic workpiece positioning frame. A workpiece positioner actively adjusts the pose of the manufactured component to enable greater operational concurrency and improve overall production efficiency. The proposed motion-coordination scheme employs a distributed and scalable architecture, supporting coordination across heterogeneous multi-robot systems. Two optimization methodologies are introduced to manage kinematic redundancies and maintain continuous, near-optimal operation throughout the manufacturing process. The first strategy exploits a task-space dimensionality reduction to achieve locally optimal configurations by leveraging symmetry-axis rotations of the tool. The second strategy utilizes the workpiece positioner to drive the coordinated robots toward stable and kinematically favorable configurations. For both optimization strategies, multiple objectives are defined to improve key performance metrics, including manipulability, configuration consistency, proximity to mechanical limits, and motion efficiency. Addressing a key limitation of existing coordination approaches, the framework is designed around online setpoint modification, allowing coordinated robots to respond effectively to in-situ process feedback. The proposed control framework is validated using the Robot Operating System (ROS) middleware on a combination of physical and simulated multi-robot system hardware.
Arbogast, Alex [ORNL] (ORCID:0000000154740723)↗
Zero Energy Ready Out of the Box
In this conference paper for the ASHRAE Buildings XV conference, December 2022, PNNL staff share key metrics for companies who are combining off site construction with certification to the U.S. Department of Energy’s Zero Energy Ready Home program to create homes that are both cost effective to construct and high performance to live in. Key performance metrics and measures for modular, panelized, and SIP homes are compared against all homes in the DOE Zero Energy Ready Home program and against new homes built to code. These metrics show that off-site construction homes got similar or better energy performance to site-built homes, and in the case of modular and panelized, at considerably lower average cost than site-built homes. The paper also highlights the experiences of two DOE Zero Energy Ready Home builders who employ offsite construction methods. One builder constructs production homes using pre-assembled panels. The other builder designs and ships kit homes all over the United States. The paper will focus on the optimum value engineering aspects of the panelized construction processes used by each builder to identify management and production practices employed by the builders to operate profitably while meeting high energy performance goals, despite a year marked by skyrocketing materials costs and supply chain and labor shortages. Cost and labor savings methods will be discussed in the context of these two unique business models.
U.S. Department of Energy Building Technologies Pr↗
Prelaunch Characterization and Performance of JPSS-3 VIIRS Reflective Solar Bands
The Joint Polar Satellite System 3 (JPSS-3) Visible Infrared Imaging Radiometer Suite (VIIRS) instrument is the fourth in a series (S-NPP VIIRS launched in October 2011, JPSS-1 VIIRS launched in November 2017, and JPSS-2 VIIRS currently undergoing spacecraft integration) of highly advanced polar-orbiting environmental satellites. JPSS-3 VIIRS underwent a comprehensive sensor-level Thermal Vacuum (TV) testing at the Raytheon Technologies El Segundo facility in the fall of 2020. While the test program provided characterization for many spatial, spectral, and radiometric aspects of the VIIRS sensor performance, this paper focuses on the radiometric performance of the 14 reflective solar bands (RSB) that cover the wavelength range from 0.41 to 2.3 μm. Key calibration parameters, such as the instrument gain, signal-to-noise ratio (SNR), dynamic range and radiometric uniformity, were derived in a TV environment for both the primary and redundant electronics at three instrument temperature plateaus: cold, nominal, and hot. This paper shows that all the JPSS-3 VIIRS RSB detectors have been well characterized, with the key performance metrics being comparable to those of the previous VIIRS instruments. Comparison of radiometric performance to sensor requirements, as well as a summary of key sensor testing and performance issues, will also be presented.
JPSS-3↗
Navigating the Deployment and Downlink Tradespace for Earth Imaging Constellations
Distributed Spacecraft Missions (DSMs) are gaining momentum in their application to Earth Observation (EO) missions owing to their unique ability to increase observation sampling in spatial, spectral, angular and temporal dimensions simultaneously. DSM design includes a much larger number of variables than its monolithic counterpart, therefore, Model-Based Systems Engineering (MBSE) has been often used for preliminary mission concept designs, to understand the trade-offs and interdependencies among the variables. MBSE models are complex because the various objectives a DSM is expected to achieve are almost always conflicting, non-linear and rarely analytical. NASA Goddard Space Flight Center (GSFC) is developing a pre-Phase A tool called Tradespace Analysis Tool for Constellations (TAT-C) to initiate constellation mission design. The tool will allow users to explore the tradespace between various performance, cost and risk metrics (as a function of their science mission) and select Pareto optimal architectures that meet their requirements. This paper will describe the different types of constellations that TAT-C’s Tradespace Search Iterator is capable of enumerating (homogeneous Walker, heterogeneous Walker, precessing type, ad-hoc) and their impact on key performance metrics such as revisit statistics, time to global access and coverage. We will also discuss the ability to simulate phased deployment of the given constellations, as a function of launch availabilities and/or vehicle capability, and show the impact on performance. All performance metrics are calculated by the Data Reduction and Metric Computation module within TAT-C, which issues specific requests and processes results from the Orbit and Coverage module. Our TSI is also capable of generating tradespaces for downlinking imaging data from the constellation, based on permutations of available ground station networks - known (default) or customized (by the user). We will show the impact of changing ground station options for any given constellation, on data latency and required communication bandwidth, which in turn determines the responsiveness of the space system.
Nag, Sreeja↗
Methods for Estimating Hydrogen Fuel Tank Characteristics
The pressure vessels needed to store hydrogen for next-generation hydrogen fuel cell vehicles are expected to be a substantial portion of the total system mass, volume, and cost. Gravimetric capacity, volumetric capacity, and cost per kilogram of usable hydrogen are key performance metrics that the U.S. Department of Energy (DOE) uses to determine the viability of hydrogen fuel cell systems. Research and development related to hydrogen storage systems covers a wide range of potential operating conditions, from cryogenic temperatures to high temperatures (above ambient) and low pressure to high pressure. Researchers at PNNL have developed methods for estimating these key pressure vessel characteristics to support on-board hydrogen storage system design and performance evaluation and to support decision-making about DOE hydrogen storage system research investments. This article describes the pressure tank estimation methodology that has been used as a stand-alone calculation and has been incorporated into larger system evaluation tools. The methodology estimates the geometry, mass, and material cost of type I, type III, and type IV pressure vessels based on operating pressure and material strength at the system's operating temperature, using classical thin-wall and thick-wall pressure vessel stress calculations. The geometry, mass, and material cost requirements of the pressure vessel have significant impacts on the total system performance. For example, hydrogen storage materials that can separately achieve a very high hydrogen density can be deemed impractical for use in fuel cell vehicle hydrogen storage systems because the pressure tank containing them is too large, heavy, or expensive. This article describes the design philosophy and analytical process of the tank characteristic estimation methodology, which has been implemented in spreadsheet calculation tools and system-level analysis tools used by DOE researchers. Each of the three tank types (type I, type III, and type IV) uses a different analysis methodology with some common elements. This article also provides examples of implementing the methodology to perform parametric studies of all three pressure vessel types. The goal of this article is to present the methodology in sufficient detail so it can be implemented in other hydrogen fuel cell vehicle design and analysis tools.
42 ENGINEERING↗
Visual Analytics of Performance of Quantum Computing Systems and Circuit Optimization
Driven by potential exponential speedups in business, security, and scientific scenarios, interest in quantum computing is surging. This interest feeds the development of quantum computing hardware, but several challenges arise in optimizing application performance for hardware metrics (e.g., qubit coherence and gate fidelity). In this work, we describe a visual analytics approach for analyzing the performance properties of quantum devices and quantum circuit optimization. Our approach allows users to explore spatial and temporal patterns in quantum device performance data and it computes similarities and variances in key performance metrics. Detailed analysis of the error properties characterizing individual qubits is also supported. We also describe a method for visualizing the optimization of quantum circuits. The resulting visualization tool allows researchers to design more efficient quantum algorithms and applications by increasing the interpretability of quantum computations.
Chae, Junghoon↗
Performance Assessments and Comparisons of S-NPP and NOAA-20 (JPSS-1) VIIRS On-Orbit Calibration
The first Visible Infrared Imaging Radiometer Suite (VIIRS) instrument has been in operation for more than 6 years on-board the S-NPP satellite and the second instrument, with the same design and performance requirements, was launched in November, 2017 on-board the JPSS-1 satellite (named NOAA-20 after reaching its orbit) and is currently in normal operation conditions. This paper provides a brief description of VIIRS on-orbit calibration and characterization activities and presents performance assessments and comparisons of S-NPP and NOAA-20 VIIRS using data collected from their on-board calibrators (OBC) and regularly scheduled lunar observations. Results show that NOAA-20 VIIRS is performing as well or better than S-NPP VIIRS in all of the key performance metrics. The NOAA-20 reflective solar bands, including the day-night band, have experienced less than 1% change in gain in the first 250 days since launch and did not suffer from the contamination related rapid degradation experienced by S-NPP VIIRS. Some of the NOAA20 thermal emissive bands had larger than expected gain degradation after launch due to ice buildup on the dewar window of the long-wave IR focal plane assembly but a mid-mission outgassing operation was able to restore their gains and maintain stable behavior. Though this study is focused on the sensor's key performance parameters, such as detector responses (gains), signal-to-noise ratios, and noise-equivalent temperature differences, challenges identified and lessons learned through different phases of on-orbit calibration and characterization are also discussed.
DNB↗
HFIR High Power HEU Neutronics Analyses
Department of Energy National Nuclear Security Administration Office of Material Management and Minimization’s mission includes the conversion of civilian research reactors from highly enriched uranium (HEU) to low-enriched uranium (LEU) fuel. Analyses have shown that the Oak Ridge National Laboratory High Flux Isotope Reactor (HFIR) will need to operate at 95 MW for the LEU silicide dispersion fuel designs to match key performance metrics obtained with HEU fuel at 85 MW. To prove safe operation of HFIR after installation of plant modifications to increase power, a high power HEU test cycle was proposed. Neutronics model updates and reactor physics analyses are performed to support the development of safety design reports for the high power (HP) HEU test cycle. Reactor physics metrics evaluated herein include fuel depletion, actinide production, cycle length, fission rate density distributions, axial power peaking factors, and reactor kinetic parameters. These reactor physics analyses support the development of future LEU safety design reports by providing key input for future HP HEU HFIR thermal hydraulics and reactor transient safety analyses.
21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
Better Climate Challenge Working Groups Non-Energy Benefits of Energy Projects-Improving Financial Payback
Energy efficiency is a key strategy recently identified by the United States Department of Energy as a pillar of industrial decarbonization. For manufacturing companies, improving energy efficiency will reduce money spent on energy utilities such as gas, electricity, and oil. Energy improvement projects also provide valuable benefits outside of simple operating cost reductions, such as reducing the carbon footprint, improving safety metrics and even enhancing quality and productivity. Unfortunately, energy efficiency projects have typically faced an adoption gap, even when they meet criteria such as payback period for capital projects. The inclusion and quantification of non-energy benefits (NEBs), also known as co-benefits, in the decision-making process for energy efficiency projects can improve the overall financial payback periods for those projects as well as potentially improve the company's key performance metrics aligned with business strategies. There are no readily available tools that facilitate this, however, and the most used tools for energy audits address NEBs in a perfunctory way if at all. We integrated research for finding and quantifying non-energy benefits of energy efficiency projects into a commonly recognized continuous improvement practice, the Define, Measure, Analyze, Improve and Control (DMAIC) Process. This process, along with software and supplemental materials, guides energy assessments to find and to quantify NEBs associated with energy conservation opportunities. Our aim is to deliver an easy to use and effective process and software tool and to maximize return on investment for energy efficiency projects as well as contribute to companies' strategic performance goals.
DMAIC↗