Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “performance metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Evaluation of a Tactical Surface Metering Tool for Charlotte Douglas International Airport Via Human-in-the-Loop Simulation

NASA has been working with the FAA and aviation industry partners to develop and demonstrate new concepts and technologies that integrate arrival, departure, and surface traffic management capabilities. In March 2017, NASA conducted a human-in-the-loop (HITL) simulation for integrated surface and airspace operations, modeling Charlotte Douglas International Airport, to evaluate the operational procedures and information requirements for the tactical surface metering tool, and data exchange elements between the airline controlled ramp and ATC Tower. In this paper, we focus on the calibration of the tactical surface metering tool using various metrics measured from the HITL simulation results. Key performance metrics include gate hold times from pushback advisories, taxi-in/out times, runway throughput, and departure queue size. Subjective metrics presented in this paper include workload, situational awareness, and acceptability of the metering tool and its calibration

air traffic management↗

Power-Capping Metric Evaluation for Improving Energy Efficiency in HPC Applications

With high-performance computing systems now running at exascale, optimizing power-scaling management and resource utilization has become more critical than ever. This paper explores runtime power-capping optimizations that leverage integrated CPU-GPU power management on architectures like the NVIDIA GH200 superchip. We evaluate energy-performance metrics that account for simultaneous CPU and GPU power-capping effects by using two complementary approaches: speedup-energy-delay and a Euclidean distance-based multi-objective optimization method. By targeting a mostly compute-bound exascale science application, the Locally Self-Consistent Multiple Scattering (LSMS), we explore challenging scenarios to identify potential opportunities for energy savings in exascale applications, and we recognize that even modest reductions in energy consumption can have significant overall impacts. Our results highlight how GPU task-specific dynamic power-cap adjustments combined with integrated CPU-GPU power steering can improve the energy utilization of certain GPU tasks, thereby laying the groundwork for future adaptive optimization strategies.

Patrou, Maria [ORNL] (ORCID:0000000339754638)↗

Monitoring Human Performance on Future Deep Space Missions Abstract

NASA and the commercial spacecraft community are working diligently to put the first woman on the moon in the 2024 timeframe. At the same time, NASA researchers are thinking about how to solve the even larger challenges that future deep space missions will bring. Space travel itself is difficult, but astronauts on deep space missions will face obstacles and unknowns never before experienced. In addition to the altered gravity and hostile/closed environment of a spacecraft, deep space crews will face increased radiation, isolation, and distance from Earth. During Extravehicular Activity (EVA, or “spacewalk”) operations, crew will experience increased physical and cognitive workload due to extended types, frequencies and durations of tasks performed on exploration missions in partial gravity environments. All of these stressors will impact crew physical and mental health and performance in difficult-to-anticipate ways. Crew autonomy may be one of the biggest challenges faced. Communication delays and blackouts will occur, and in those situations, the crew may not have access to the Mission Control Center (MCC). They may be forced to be solely dependent on each other and the available information onboard to stay alive, healthy, and achieve the mission. The only conceivable way to meet the challenges of Earth independence is to enable the crew to monitor their own health and performance -- preferably unobtrusively as they perform their duties. Technologies and techniques must be developed to aid the crew in these assessments. A deep space mission is expected to have relatively short periods of high cognitive demand, stress, and fatigue, alongside potentially long periods of cognitive underload during the transit, where boredom, loneliness, and depression can set in. Both ends of this spectrum are dangerous. Crew must be made aware when their task performance drops significantly, when their cognitive workload is too high, when they have lost situation awareness, or when they are too stressed or too fatigued to perform well. They must be able to identify these risks, and then mitigate them with countermeasures available onboard. A number of self-monitoring technologies are presently being explored by NASA to advance crew state determination capabilities. These range from real-time, physiological workload and situation awareness assessments, to crew health measurements determining physical and mental fitness for duty, to task performance metrics such as suit resource expenditures. For EVA tasks during surface exploration missions, biomedical information such as metabolic rate may be provided to crewmembers for situational awareness related to task performance efficiency. In addition, translation distances, hydration, nutrition, inspired CO2 exposure and other consumables usage rates may be useful input metrics for modeling individualized performance during tasks to inform crew or provide estimates of work efficiency. Oculomotor metrics such as gaze dwell time, pupilometry, and eye tracking collected in advanced helmet mounted displays could potentially be used to characterize crew situation awareness. This paper highlights some of these projects, and provides broader discussion about the need for advanced monitoring and smart technologies, as NASA takes the leap into the next generation of space exploration.

Kritina Holden↗

Optical space-to-ground link availability assessment and diversity requirements

The application of optical space-to-ground links (SGLs) for high speed data distribution from geosynchronous and low earth orbiting satellites (e.g., sensor data from the planned Earth Observing System), for lunar and Mars links, and for links from interplanetary probes has been a topic of considerable recent interest. These optical SGLs could conceivably represent the system's operational baseline, or could represent backup links in the event of a GEO relay terminal failure. In this paper the availability of optical SGLs for various system/orbit configurations is considered. Single CONUS sites are assessed for their probability of cloud free line of sight (PCFLOS), and cloud free field of view (PCFFOV). PCFLOS represents an availability metric for geosynchronous platforms, while PCFFOV is a relevant performance metric for non-geostationary platforms (e.g., low earth orbiting satellites). Additionally, the availability of multiple ground terminals utilized in a diversity configuration is considered. Availability statistics vs. the number of diversity sites are derived from climatological data bases for CONUS sites.

Chapman, William↗

The Super Tuesday Outbreak: Forecast Sensitivities to Single-Moment Microphysics Schemes

Forecast precipitation and radar characteristics are used by operational centers to guide the issuance of advisory products. As operational numerical weather prediction is performed at increasingly finer spatial resolution, convective precipitation traditionally represented by sub-grid scale parameterization schemes is now being determined explicitly through single- or multi-moment bulk water microphysics routines. Gains in forecasting skill are expected through improved simulation of clouds and their microphysical processes. High resolution model grids and advanced parameterizations are now available through steady increases in computer resources. As with any parameterization, their reliability must be measured through performance metrics, with errors noted and targeted for improvement. Furthermore, the use of these schemes within an operational framework requires an understanding of limitations and an estimate of biases so that forecasters and model development teams can be aware of potential errors. The National Severe Storms Laboratory (NSSL) Spring Experiments have produced daily, high resolution forecasts used to evaluate forecast skill among an ensemble with varied physical parameterizations and data assimilation techniques. In this research, high resolution forecasts of the 5-6 February 2008 Super Tuesday Outbreak are replicated using the NSSL configuration in order to evaluate two components of simulated convection on a large domain: sensitivities of quantitative precipitation forecasts to assumptions within a single-moment bulk water microphysics scheme, and to determine if these schemes accurately depict the reflectivity characteristics of well-simulated, organized, cold frontal convection. As radar returns are sensitive to the amount of hydrometeor mass and the distribution of mass among variably sized targets, radar comparisons may guide potential improvements to a single-moment scheme. In addition, object-based verification metrics are evaluated for their utility in gauging model performance and QPF variability.

Molthan, Andrew L.↗

Understanding International GNC Hardware Trends

An industry-wide survey of guidance, navigation and control (GNC) sensors, namely star trackers, gyros, and sun sensors was undertaken in 2014, in which size, mass, power, and various performance metrics were recorded for each category. A multidimensional analysis was performed, looking at the spectrum of available sensors, with the intent of identifying gaps in the available capability range. Mission types that are not currently well served by the available components were discussed, as well as some missions that would be enabled by filling gaps in the component space. This paper continues that study, with a focus on reaction wheels and magnetometers, as well as with updates to the listings of star trackers, gyros, and sun sensors. Also discussed are a framework for making the database available to the community at large, and the continued maintenance of this database and the analysis of its contents.

Greenbaum, Adam↗

New Horizons for a Practical and Performance-Optimized Solar System Internet

The High-rate Delay Tolerant Networking (HDTN) project at the NASA Glenn Research Center (GRC) is developing a performance-optimized Delay Tolerant Networking (DTN) implementation using the Bundle Protocol (BP) both for infusion in modern, distributed spacecraft systems and for foundational network research purposes. While one purpose of networking is to enable a returns-to-scale with communicating assets, it is recognized that neither the protocol nor its implementations may impose a bottleneck on data delivery if expected to be implemented. With this in mind, this paper explores the current status of the HDTN software, including its capabilities and also various performance metrics at the bundle layer, the convergence layers (e.g. performance-optimized Licklider Transmission Protocol, or LTP), and bundle storage and retrieval. This includes goals of software implementations that support multi-gigabit per second communications regardless of payload size. A discussion on the current software architecture and internal scheduling and routing is included. Interoperability with such extant DTN implementations as Interplanetary Overlay Network (ION) and DTN Marshall Enterprise Implementation (DTNME) are included. The research goals of the project are also listed, including Software-Defined Networking (SDN) and the theory of DTNs. A table-based filtration system for the Bundle Protocol (BP), called BP Filter, is also explored: this addition enables table-based policies within the context of a DTN for management purposes. Infusion begins with systems testing in the Johnson Space Center (JSC) Software Development and Integration Laboratory (SDIL), which supports International Space Station (ISS) Flight Software development, integration, and verification. Observations made from the results of testing in the SDIL and in flight testing are also discussed, pointing to a path for infusion into high data return low-earth orbit (LEO) missions. The paper concludes with areas for future work.

Delay Tolerant Networking↗

Performance Evaluation of a Single-Phase Grid-Forming Inverter Through Hardware Experiments: Preprint

Existing state-of-the-art of single-phase grid-forming (GFM) inverter are primarily focused on electromagnetic transient simulation, and there are very few works performing hardware test, and there is no clear understanding how the single-phase GFM inverter should behave from a hardware perspective. Therefore, this paper addresses the gap by performing hardware experiment to evaluate the performance of a single-phase GFM hardware inverter. We enrich the existing GFM testing protocols by investigating transient performance of GFM inverters under different grid dynamic events, and quantifiable performance metrics are made to have a common understanding of expected performance of single-phase GFM inverters. A commercial single-phase GFM inverter is used to verify the test protocols and understand the inverter's performance and functionalities.

dynamic events↗

EVs@Scale Next-Gen Profiles - Fleet Utilization 2024

As part of the U.S. Department of Energy’s EVs@Scale initiative, the Next-Gen Profiles (NGP) project provides a comprehensive, data-driven analysis of electric vehicle (EV) and electric vehicle supply equipment (EVSE) operations across real-world fleet deployments. This paper presents findings from the NGP’s Fleet Utilization study, which investigates operational behavior and asset usage across seventeen EV fleets and two EVSE fleets, encompassing a wide range of vehicle types and use cases. Data collected from diverse sources—varying in format and temporal resolution—are first reformatted into a unified structure. From this harmonized dataset, a suite of rigorously defined performance metrics is calculated at an hourly cadence, enabling consistent cross-comparison of charging, routing, and other key operational behaviors. Amid rapidly increasing EV adoption and growing demands for energy-efficient fleet operations, the analysis reveals clear utilization trends—including diurnal and weekly activity cycles, differences in short versus long charging session dependencies, and route-specific energy usage patterns. These findings highlight the need for tailored infrastructure strategies and the deployment of advanced energy management systems, such as Distributed Energy Resource Management Systems (DERMS) and Site Energy Management Systems (SEMS), which can optimize charging schedules and mitigate peak loads. By leveraging anonymized, harmonized datasets and standardized metrics, this study offers critical insights into fleet behavior and performance, providing a foundation to improve operational efficiency, reduce costs, and enable the scalable deployment of electrified transportation.

Wells, Landon↗

Membranes for Lithium Recovery From Conventional and Unconventional Sources

Lithium has been deemed a critical mineral of national importance that finds uses in a wide range of applications, and its demand has been rising significantly in recent years. The urgency of meeting this demand requires lithium extraction from various aqueous sources such as continental brines, geothermal brines, seawater, produced water, and battery waste. While direct lithium extraction (DLE) technologies such as adsorption, ion exchange, and solvent extraction have emerged as possible solutions, membrane technologies are also being investigated for various sources and at different stages of the recovery process. Here, we analyze the application of membranes for pretreatment of lithium source waters, bring management, lithium/magnesium separation, lithium/sodium separation, and lithium hydroxide conversion, and evaluate performance metrics for critical lithium separations from the literature. We explore the potential of membranes at every stage of the recovery process and describe their current status and future prospects. We describe hypothetical process trains with integrated membrane technologies for each source type and address their feasibility and challenges. The potential energy and water impacts of membrane-integrated and conventional DLE processes are also critically considered alongside performance and selectivity metrics, and this is illustrated using examples and calculated from published technical reports. This paper thus provides a comprehensive overview of the application of membranes along every stage of the lithium recovery process, emphasizing the versatility and potential of membrane technologies for critical mineral recovery.

36 MATERIALS SCIENCE↗

Performance analysis of LAN bridges and routers

Bridges and routers are used to interconnect Local Area Networks (LANs). The performance of these devices is important since they can become bottlenecks in large multi-segment networks. Performance metrics and test methodology for bridges and routers were not standardized. Performance data reported by vendors is not applicable to the actual scenarios encountered in an operational network. However, vendor-provided data can be used to calibrate models of bridges and routers that, along with other models, yield performance data for a network. Several tools are available for modeling bridges and routers - Network II.5 was used. The results of the analysis of some bridges and routers are presented.

Hajare, Ankur R.↗

Robust tracking control of a magnetically suspended rigid body

This study is an application of H-infinity and microsynthesis for designing robust tracking controllers for the Large Angle Magnetic Suspension Test Facility. The modeling, design, analysis, simulation, and testing of a control law that guarantees tracking performance under external disturbances and model uncertainties is investigated. The type of uncertainties considered and the tracking performance metric used is discussed. This study demonstrates the tradeoff between tracking performance at low frequencies and robustness at high frequencies. Two sets of controllers were designed and tested. The first set emphasized performance over robustness, while the second set traded off performance for robustness. Comparisons of simulation and test results are also included. Current simulation and experimental results indicate that reasonably good robust tracking performance can be attained for this system, using multivariable robust control approach.

Lim, Kyong B.↗

Intelligent vehicle control: Opportunities for terrestrial-space system integration

For 11 years the Department of Defense has cooperated with a diverse array of other Federal agencies including the National Institute of Standards and Technology, the Jet Propulsion Laboratory, and the Department of Energy, to develop robotics technology for unmanned ground systems. These activities have addressed control system architectures supporting sharing of tasks between the system operator and various automated subsystems, man-machine interfaces to intelligent vehicles systems, video compression supporting vehicle driving in low data rate digital communication environments, multiple simultaneous vehicle control by a single operator, path planning and retrace, and automated obstacle detection and avoidance subsystem. Performance metrics and test facilities for robotic vehicles were developed permitting objective performance assessment of a variety of operator-automated vehicle control regimes. Progress in these areas will be described in the context of robotic vehicle testbeds specifically developed for automated vehicle research. These initiatives, particularly as regards the data compression, task sharing, and automated mobility topics, also have relevance in the space environment. The intersection of technology development interests between these two communities will be discussed in this paper.

Shoemaker, Charles↗

Robust tracking control of a magnetically suspended rigid body

This study is an application of H-infinity and micro-synthesis for designing robust tracking controllers for the Large Angle Magnetic Suspension Test Facility. The modeling, design, analysis, simulation, and testing of a control law that guarantees tracking performance under external disturbances and model uncertainties is investigated. The type of uncertainties considered and the tracking performance metric used is discussed. This study demonstrates the tradeoff between tracking performance at low frequencies and robustness at high frequencies. Two sets of controllers were designed and tested. The first set emphasized performance over robustness, while the second set traded off performance for robustness. Comparisons of simulation and test results are also included. Current simulation and experimental results indicate that reasonably good robust tracking performance can be attained for this system using multivariable robust control approach.

Lim, Kyong B.↗

Systems Engineering Metrics: Organizational Complexity and Product Quality Modeling

Innovative organizational complexity and product quality models applicable to performance metrics for NASA-MSFC's Systems Analysis and Integration Laboratory (SAIL) missions and objectives are presented. An intensive research effort focuses on the synergistic combination of stochastic process modeling, nodal and spatial decomposition techniques, organizational and computational complexity, systems science and metrics, chaos, and proprietary statistical tools for accelerated risk assessment. This is followed by the development of a preliminary model, which is uniquely applicable and robust for quantitative purposes. Exercise of the preliminary model using a generic system hierarchy and the AXAF-I architectural hierarchy is provided. The Kendall test for positive dependence provides an initial verification and validation of the model. Finally, the research and development of the innovation is revisited, prior to peer review. This research and development effort results in near-term, measurable SAIL organizational and product quality methodologies, enhanced organizational risk assessment and evolutionary modeling results, and 91 improved statistical quantification of SAIL productivity interests.

Mog, Robert A.↗

Bridging the Gap on Data, Metrics, and Analyses for Grid Resilience to Weather Events: Information that utilities can provide regulators, state energy offices, and other stakeholders

A growing number of states require regulated utilities to file resilience plans to improve the electric grid’s ability to anticipate, withstand, adapt to and recover from increasingly severe weather events. This report aims to help state regulators identify and request data, metrics, and analyses from utilities and use it in decisions on utility resilience plans and investments. The report reviews state requirements and utility plans focused on overall grid resilience, climate change resilience and vulnerabilities, infrastructure modernization, storm protection, and wildfire mitigation. It details types of data, metrics, and analyses across five categories--and provides examples of each from the utility plans. The first category is vulnerability assessments, or evaluations of the susceptibility of systems, communities, or assets to potential harm from identified hazards. The second is data on hazards and the exposure of utility assets and customers to these hazards. The third is attribute metrics, or system characteristics that contribute to or describe the resilience of a system. The fourth is performance metrics, which are impacts of resilience investments on system performance--typically a reduction of negative impacts from hazard events. Finally, evaluation and prioritization are analyses that utilities conduct to estimate impacts from resilience measures (evaluation) and prioritize measures based on costs and estimated impacts (prioritization). The report concludes with examples of key trends and emerging best practices for states and utilities, and identifies areas for further research.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Database Performance Monitoring for DUNE

This project improves Checkmk monitoring for DUNE Rucio PostgreSQL database services by adding clearer dashboard visibility for connection and lock behavior. The work began with a request to monitor database performance metrics such as connection usage, configured limits, lock activity, wait behavior, query performance, storage trends, and saturation alerts. Existing Checkmk PostgreSQL checks were reviewed, and gaps were identified in how connection states and lock modes were displayed. To address these gaps, two DSG-specific local checks were added for dune_rucio_prod: one for connection-state monitoring and one for lock-state monitoring. These checks report active, idle, idle-in-transaction, total, usage-percent, lock-mode, waiting-lock, and wait-age metrics. The added metrics supplement built-in Checkmk monitoring and provide DUNE application developers with clearer service states, history graphs, dashboard widgets, and alerts.

Bowers, Elliot [Cabrillo Coll.]↗

Performance Evaluation of a Single-Phase Grid-Forming Inverter Through Hardware Experiments

This study conducts hardware experiments to assess the performance of a commercial single-phase grid-forming (GFM) inverter using a purely hardware-based approach. We adhere to a testing protocol for the GFM inverter and enhance it by exploring the transient performance of GFM inverters across various grid dynamic events. Quantifiable performance metrics are established for each testing scenario to gain insights into the performance of the single-phase GFM inverters. Based on the comprehensive tests, the following observations are summarized: 1) The performance of the single-phase GFM inverter is satisfactory, and it is capable of being the islanding master for residence homes when the main grid is gone. 2) For frequency response, the inverter is able to stay connected but cannot inject the needed active power to support the grid. This may be improved by the manufacturer by using droop control. 3) The GFM inverter exhibits harmful transients in voltage and frequency during islanding operation, which can be enhanced by maintaining the same operating points before and after the breaker is open.

black start↗