Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “reliability metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Historical and Future Learning for the New Era of Multi-Terawatt Photovoltaics

Solar photovoltaics (PV) is entering a new era of multi-terawatt deployment, with 2 TW already in service and more than 75 TW predicted in many scenarios by 2050. This next era has been enabled by over five decades of cumulative advances in PV module cost reduction, performance and reliability. The current scale of deployment also introduces new needs, opportunities and challenges. In this Perspective we frame a path forwards based on learning, broadly defined as a combination of expansion of knowledge and advances through research and development, experience and collaboration. We discuss historical topics where learning has driven PV deployment until now, and emerging areas that are required to sustain high levels of future deployment. We expect progress to continue in terms of module price, performance and reliability, driven by advances in PV cell and module design, the emergence of tandem devices and increased focus on extending module lifetimes. Large-scale deployment also means large-scale sustainability and responsibility. We therefore posit that additional metrics, such as the impact on global CO2 emissions, resource consumption and design for reuse and recycling, will become increasingly important to the PV industry and provide opportunities for further learning.

14 SOLAR ENERGY↗

Exploring the fusion power plant design space: comparative analysis of positive and negative triangularity tokamaks through optimization

The optimal configuration choice between positive triangularity (PT) and negative triangularity (NT) tokamaks for fusion power plants hinges on navigating different operational constraints rather than achieving specific plasma performance metrics. This study presents a systematic comparison using constrained multi-objective optimization with the integrated FUsion Synthesis Engine (FUSE) framework. Over 200 000 integrated design evaluations were performed exploring the trade-offs between capital cost minimization and operational reliability (maximizing q 95 ) while satisfying engineering constraints including 250 ± 50 MW net electric power, tritium breeding ratio > 1.1, power exhaust limits and an hour flattop time. Both configurations achieve similar cost-performance Pareto fronts through contrasting design philosophies. PT, while demonstrating resilience to pedestal degradation (compensating for up to 40% reduction), are constrained to larger machines (R 0 > 6.5 m) by the narrow operational window between L–H threshold requirements and the research-established power exhaust limit (P sol /R < 15 MW m –1 ). This forces optimization through comparatively reduced magnetic field (∼8 T). NT configurations exploit their freedom from these constraints to access compact, high-field designs (R 0 ~ 5.5 m, B 0 >12 T), creating natural synergy with advancing HTS technology. Sensitivity analyses reveal that PT’s economic viability depends critically on uncertainties in L–H threshold scaling and power handling limits. Notably, a 50% variation in either could eliminate viable designs or enable access to the compact design space. These results suggest configuration selection should be risk-informed: PT offers the lowest-cost path when operational constraints can be confidently predicted, while NT is robust to large variations in constraints and physics uncertainties.

FUSE framework↗

Review of Wave Energy Converter Power Take-Off Systems, Testing Practices, and Evaluation Metrics: Preprint

While the field of wave energy has been the subject of numerical simulation, scale model testing, and precommercial project testing for decades, wave energy technologies remain in the early stages of development and must continuing proving themselves as a promising modern renewable energy field. One of the difficulties that wave energy systems have been struggling to overcome is the design of highly efficient energy conversion systems that can convert the mechanical power, derived from the oscillation of wave activated bodies, into another useful product. Often the power take-off (PTO) is defined as the single unit responsible for converting mechanical power into another usable form such as electricity, pressurized fluid, compressed air, and others. The PTO, and the entire power conversion chain (PCC), is of great importance as it affects not only how efficient wave power is converted into electricity, but also contributes to the mass, size, structural dynamics, and levelized cost of energy (LCOE) of the wave energy converter (WEC). Unlike wind and solar, there is no industrial standard device, or devices, for wave energy conversion and this diversity is transferred to the PTO system. The majority of current WEC PTO systems incorporate a mechanical or hydraulic drive train, power generator, and an electrical control system. The challenge of WEC PTO designs is designing a mechanical-to-electrical component that can efficiently convert irregular, bi-directional, low frequency and low alternating velocity wave motions. While gross average power levels can be predicted in advance, the variable wave elevation input has to be converted into smooth electrical output and hence usually necessitates some type of energy storage system, such as battery storage, accumulator super capacitors, etc., or other means of compensation such as an array of devices. One of the primary challenges for wave energy converter systems is the fluctuating nature of wave resources, which require WEC components to be designed to handle loads (i.e. torques, forces, and powers) that are many times greater than the average load. This approach requires a much greater PTO capacity than the average power output and indicates a higher cost. In addition, supporting mechanical coupling and or gearing can be added to the PCC to help alleviate the difficulties with transmission and control of fluctuating large loads with low frequencies (indicative of wave forcing) into smaller loads at higher frequencies (optimum for conventional electrical machine design) can quickly increase the complexity of the PCC which could result in a greater number of failure modes and increased maintenance costs. All of the previous points demonstrate how the PTO influences WEC dynamics, reliability, performance and cost which are critical design factors. This paper further explores these topics by providing a review of the state-of-the-art PTO systems currently under development, how these novel PTO systems are tested and derisked prior to precommercial deployment, and the evaluation metrics historically used to differentiate between PTO designs and how they can be improved to support control co-design focused development of wave energy systems.

laboratory testing↗

Energy Intensity Baselining and Tracking Guidance

Each company joining the U.S. Department of Energy’s (DOE’s) Better Buildings, Better Plants Program (Better Plants) commits to establishing an energy consumption and energy intensity (EI) baseline and to tracking its energy performance over a 10-year period against that baseline. The baseline must reflect a company’s energy consumption over a 12-month period, covering all its U.S.-based operations. Energy consumption is calculated by fuel type in terms of primary energy (also known as source energy). EI is broadly defined as the amount of energy consumed per unit of output produced. For this guidance document and for the program, the term energy performance represents an evaluation of a facility’s capacity to use energy efficiently. Metrics used to assess a facility’s energy performance can include EI, energy consumption, improvements in EI, etc. Establishing an energy baseline and tracking system is a critical first step in effectively managing energy use. Developing a baseline can help a company understand energy use within the corporation and give it a point of comparison to evaluate future efforts to improve energy performance. It can also support efforts to validate a company’s energy management activities, improve comparative analyses when using benchmarks, and help in predicting future energy needs. In addition, a company that normalizes its performance data can determine highly defensible measures of energy savings generated through implemented energy efficiency projects. Establishing a baseline and tracking energy performance is also a requirement for ISO 50001 certification. Although basic energy data can be collected through utility bills, most manufacturers will have to perform additional analyses to develop accurate and robust energy baselines and tracking systems. Energy is consumed in many ways within the manufacturing sector and can come from multiple sources. Energy is sometimes generated and sold to other parties or captured and reused on-site. External events can exert a significant impact on a facility or company’s energy use independent of any purposeful efforts to improve energy efficiency. Operational changes, such as production shifts—which may be inevitable for some companies over the 10-year period covered by the program—can also make a big difference in energy use. Since Better Plants asks companies to account for all their U.S.-based operations, mergers, acquisitions, and divestitures can also have significant implications for a company’s energy metrics. This document aims to demystify the sometimes complex baselining process. It devotes special attention to the task of normalizing and adjusting energy consumption to account for external factors, such as weather and production changes. A key recommendation is that companies use regression analysis to normalize their energy consumption data whenever possible. Regression analysis is a statistical technique that estimates the dependence of a variable (i.e., energy use in the context of Better Plants) on one or more independent variables such as ambient temperature, while controlling for the influence of other variables at the same time. A properly developed regression analysis can provide a reliable estimate of energy savings resulting from energy improvement strategies and projects by accounting for the effects of variables such as annual production levels and weather. DOE has developed a companion Energy Performance Indicator software tool (EnPI) to simplify the baselining process. This tool can run regression models, calculate changes in EI at the facility level, and automatically compile facility-level data into a corporate-wide metric. Note that although the relevant equations used to calculate EI are provided in this document, the EnPI tool will automatically perform most calculations for the user. Additionally, Better Plants Partners (Partners) can call on their Technical Account Manager (TAM) to help them establish a baseline and assist with the necessary calculations to track progress.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Powering Circularity Through Data Reporting and Collection

Sustainability and Circular Economy have many metrics for evaluation. Calculating mass intensity, energy return on investment, financial payback, and recycling rate for proposed technology changes and lifecycle management can support decision making. Robust data with modeling tools can perform these calculations, informing good decision making. Analyses show that reliability is more critical than recyclability. Improved data gathering and tool accessibility will support our industry to make more circular choices for PV lifecycle management.

14 SOLAR ENERGY↗

A Simple Data-Centric Methodology for Producible Geothermal Well Determinations: Preprint

The Bureau of Land Management (BLM) has traditionally lacked a standardized methodology for determining if a newly drilled geothermal well is "producible," a designation essential for deciding whether a lease should be "held by production." This is a straightforward problem to solve in oil and gas: Demonstrate that a well is economically viable, meaning it produces sufficient oil or gas to exceed direct operating costs and lease-related expenses, such as rentals or minimum royalties. In geothermal, the problem is more complex: Geothermal wells are tightly coupled with the downstream infrastructure - specifically, the power plant, which is often not designed until well after a lease is deemed as "held by production." Although this designation is critical for advancing geothermal power plant development on BLM-managed lands, current geothermal well assessments often rely on ad hoc approaches that can be complex, operator-biased, and heavy in assumptions related to economic viability. To address this, we have developed two complementary methodologies: a minimum power requirement-based approach and a productivity index (PI)-based approach. These methods leverage key flow test data - pressure, temperature, flow rate, and specific enthalpy - to provide reliable and standardized producible well determinations. The minimum power requirement-based approach evaluates wells against specific power output thresholds informed by reservoir experts and the associated temperature requirements. The PI-based approach assesses well productivity using widely accepted reservoir engineering metrics, proposing a threshold of 2.5 kg/s/bar. Both methods are data-driven and grounded in empirical production data from operational geothermal wells, avoiding uncertain economic assumptions while maintaining decision-making accuracy. Wells falling below key performance thresholds (i.e., PI, specific power) are deemed non-producible. These methodologies aim to streamline BLM's decision-making process, reduce nontechnical barriers to geothermal energy adoption, and enable regulatory expansion into states lacking geothermal expertise. Preliminary results indicate clear trends and thresholds in production data that provide actionable insights for evaluating well producibility. Validation using well completion report (WCR) data is ongoing, with promising results demonstrating the potential for these standardized methodologies to impact geothermal development significantly.

15 GEOTHERMAL ENERGY↗

BTE-Sim: Fast Simulation Environment For Public Transportation

The public commute is essential to all urban centers and is an efficient and environment-friendly way to travel. Transit systems must become more accessible and user-friendly. Since public transit is majorly designed statically, with very few improvements coming over time, it can get stagnated, unable to update itself with changing population trends. To better understand transportation demands and make them more usable, efficient, and demographic-focused, we propose a fast, multi-layered transit simulation that primarily focuses on public transit simulation (BTE-Sim). BTE-Sim is designed based on the population demand, existing traffic conditions, and the road networks that exist in a region. The system is versatile, with the ability to run different configurations of the existing transit routes, or inculcate any new changes that may seem necessary, or even in extreme cases, new transit network design as well. In all situations, it can compare multiple transit networks and provide evaluation metrics for them. It provides detailed data on each transit vehicle, the trips it performs, its on-time performance and other necessary factors. Its highlighting feature is the considerably low computation time it requires to perform all these tasks and provide consistently reliable results.

Sen, Rishav↗

Local-Scale Framework for Techno-Economic Analysis of Subsurface Hydrogen Storage

The energy sector is evolving toward increased reliance on renewable energy technologies to meet state, national, and organization decarbonization goals. This trend is creating challenges and opportunities with meeting current and future energy demand under the variable supply conditions that most renewables provide. Hydrogen (H 2 ) is a promising energy carrier that may meet the need for both on-demand and long-duration storage to maintain energy security and resilience. Underground hydrogen storage (UHS) is a method of storing H 2 in subsurface geological systems, such as depleted hydrocarbon reservoirs, salt caverns, saline aquifers, hard rock, and other engineered systems. UHS has the potential to store large quantities of H 2 over time, providing a reliable source of energy while minimizing surface footprints at a lower investment cost compared to surface storage. Earlier work estimated that, if converted and retrofitted, existing underground natural gas storage (UGS) facilities in the U.S. can store approximately 327 TWh, or 9.8 million metric tons, of pure H 2 . However, a shift to pure H 2 would decrease the collective working-gas energy of the UGS facilities by approximately 75% due to physical and chemical differences between natural gas and hydrogen. The same work also suggests that almost 75% of the existing UGS facilities in the U.S. could maintain current energy demand buffering using a blend of only 20% H 2 to 80% natural gas, by volume at surface conditions. If we can take advantage of the suite of mature technologies of existing UGS facilities and natural gas utility systems to accelerate the transition to a hydrogen economy in the U.S., a 20% H 2 blend could lead to a 6-7% reduction of greenhouse gas emissions for energy delivered through natural gas utility systems.

03 NATURAL GAS↗

Dark Energy Survey Deep Field photometric redshift performance and training incompleteness assessment

Context. The determination of accurate photometric redshifts (photo-zs) in large imaging galaxy surveys is key for cosmological studies. One of the most common approaches are machine learning techniques. These methods require a spectroscopic or reference sample to train the algorithms. Attention has to be paid to the quality and properties of these samples since they are key factors in the estimation of reliable photo-zs. Aims. The goal of this work is to calculate the photo-zs for the Y3 DES Deep Fields catalogue using the DNF machine learning algorithm. Moreover, we want to develop techniques to assess the incompleteness of the training sample and metrics to study how incompleteness affects the quality of photometric redshifts. Finally, we are interested in comparing the performance obtained with respect to the EAzY template fitting approach on Y3 DES Deep Fields catalogue. Methods. We have emulated -- at brighter magnitude -- the training incompleteness with a spectroscopic sample whose redshifts are known to have a measurable view of the problem. We have used a principal component analysis to graphically assess incompleteness and to relate it with the performance parameters provided by DNF. Finally, we have applied the results about the incompleteness to the photo-z computation on Y3 DES Deep Fields with DNF and estimated its performance. Results. The photo-zs for the galaxies on DES Deep Fields have been computed with the DNF algorithm and added to the Y3 DES Deep Fields catalogue. They are available at https://des.ncsa.illinois.edu/releases/y3a2/Y3deepfields. Some techniques have been developed to evaluate the performance in the absence of "true" redshift and to assess completeness. We have studied... (Partial abstract)

79 ASTRONOMY AND ASTROPHYSICS↗

Comparative techno-economic and environmental analysis of using nuclear energy and fossil energy with carbon sequestration in U.S. Gulf Coast petroleum refineries

U.S. Gulf Coast refineries have processing capacity of approximately 9.4 million barrels of crude oil per day—about 50% of U.S. national capacity—while consuming natural gas, electricity, and hydrogen, resulting in approximately 100 million metric tonnes (MMT) of onsite CO₂ emissions in 2022. This study evaluates two alternative refinery energy supply pathways: nuclear energy (NE) and fossil energy-derived hydrogen with carbon capture and sequestration (FE-CCS; autothermal reforming), intermittent renewable sources are not considered as they cannot reliably meet continuous industrial heat and hydrogen demands. Using publicly available data for refineries, we conducted a bottom-up, facility-level assessment to estimate energy use by type, well-to-gate refinery emissions, and associated costs of integration. Compared to current refinery operations using natural gas energy supply and conventional hydrogen production (steam methane reforming without sequestration), NE and FE-CCS could produce, respectively, average emissions reductions of 37% and 42%, total abatement costs of $\$$52–$\$$221 and $\$$211–$\$$612/MT CO₂, and additional costs of about $\$$0.2–$\$$6 and $\$$3–$\$$11 per barrel of crude, respectively. Our analysis indicates that 25 out of 27 refineries have lower total additional cost ($\$$/bbl.) for the NE scenario than the FE-CCS scenario, making a strong case for NE integration with petroleum refineries. This work's main contribution is a detailed bottom-up refinery-level analysis method that can be utilized by the worldwide refining industry and stakeholders as they assess different technological options, along with their costs and environmental impacts for a specific refinery operation.

Carbon capture and sequestration↗

Benchmark probabilistic solar forecasts: Characteristics and recommendations

We illustrate and compare commonly used benchmark, or reference, methods for probabilistic solar forecasting that researchers use to measure the performance of their proposed techniques. A thorough review of the literature indicates wide variation in the benchmarks implemented in probabilistic solar forecast studies. To promote consistent and sensible methodological comparisons, we implement and compare ten variants from six common benchmark classes at two temporal scales: intra-hourly forecasts and hourly resolution forecasts. Using open-source Surface Radiation Budget Network (SURFRAD) data from 2018, these benchmark methods are compared using proper probabilistic metrics and common diagnostic tools. Practical implementation issues, such as the impact of missing data and applicability for operational forecasting, are also discussed. Furthermore, we make recommendations for practitioners on the appropriate selection of benchmark methods to properly showcase state-of-the-art improvements in forecast reliability and sharpness. All code and open-source data are available on Github for reproducibility and for other researchers to apply the same benchmark methods to their own data.

14 SOLAR ENERGY↗

The DESI Survey Validation: Results from Visual Inspection of the Quasar Survey Spectra

Abstract A key component of the Dark Energy Spectroscopic Instrument (DESI) survey validation (SV) is a detailed visual inspection (VI) of the optical spectroscopic data to quantify key survey metrics. In this paper we present results from VI of the quasar survey using deep coadded SV spectra. We show that the majority (≈70%) of the main-survey targets are spectroscopically confirmed as quasars, with ≈16% galaxies, ≈6% stars, and ≈8% low-quality spectra lacking reliable features. A nonnegligible fraction of the quasars are misidentified by the standard spectroscopic pipeline, but we show that the majority can be recovered using post-pipeline “afterburner” quasar-identification approaches. We combine these “afterburners” with our standard pipeline to create a modified pipeline to increase the overall quasar yield. At the depth of the main DESI survey, both pipelines achieve a good-redshift purity (reliable redshifts measured within 3000 km s −1 ) of ≈99%; however, the modified pipeline recovers ≈94% of the visually inspected quasars, as compared to ≈86% from the standard pipeline. We demonstrate that both pipelines achieve a median redshift precision and accuracy of ≈100 km s −1 and ≈70 km s −1 , respectively. We constructed composite spectra to investigate why some quasars are missed by the standard pipeline and find that they are more host-galaxy dominated (i.e., distant analogs of “Seyfert galaxies”) and/or more dust reddened than the standard-pipeline quasars. We also show example spectra to demonstrate the overall diversity of the DESI quasar sample and provide strong-lensing candidates where two targets contribute to a single spectrum.

79 ASTRONOMY AND ASTROPHYSICS↗

Foundations of Rigorous Cyber Experimentation

This report presents the results of the “Foundations of Rigorous Cyber Experimentation” (FORCE) Laboratory Directed Research and Development (LDRD) project. This project is a companion project to the “Science and Engineering of Cyber security through Uncertainty quantification and Rigorous Experimentation” (SECURE) Grand Challenge LDRD project. This project leverages the offline, controlled nature of cyber experimentation technologies in general, and emulation testbeds in particular, to assess how uncertainties in network conditions affect uncertainties in key metrics. We conduct extensive experimentation using a Firewheel emulation-based cyber testbed model of Invisible Internet Project (I2P) networks to understand a de-anonymization attack formerly presented in the literature. Our goals in this analysis are to see if we can leverage emulation testbeds to produce reliably repeatable experimental networks at scale, identify significant parameters influencing experimental results, replicate the previous results, quantify uncertainty associated with the predictions, and apply multi-fidelity techniques to forecast results to real-world network scales. The I2P networks we study are up to three orders of magnitude larger than the networks studied in SECURE and presented additional challenges to identify significant parameters. The key contributions of this project are the application of SECURE techniques such as UQ to a scenario of interest and scaling the SECURE techniques to larger network sizes. This report describes the experimental methods and results of these studies in more detail. In addition, the process of constructing these large-scale experiments tested the limits of the Firewheel emulation-based technologies. Therefore, another contribution of this work is that it informed the Firewheel developers of scaling limitations, which were subsequently corrected.

97 MATHEMATICS AND COMPUTING↗

Machine Learning Driven Contouring of High-Frequency Four-Dimensional Cardiac Ultrasound Data

Automatic boundary detection of 4D ultrasound (4DUS) cardiac data is a promising yet challenging application at the intersection of machine learning and medicine. Using recently developed murine 4DUS cardiac imaging data, we demonstrate here a set of three machine learning models that predict left ventricular wall kinematics along both the endo- and epi-cardial boundaries. Each model is fundamentally built on three key features: (1) the projection of raw US data to a lower dimensional subspace, (2) a smoothing spline basis across time, and (3) a strategic parameterization of the left ventricular boundaries. Model 1 is constructed such that boundary predictions are based on individual short-axis images, regardless of their relative position in the ventricle. Model 2 simultaneously incorporates parallel short-axis image data into their predictions. Model 3 builds on the multi-slice approach of model 2, but assists predictions with a single ground-truth position at end-diastole. To assess the performance of each model, Monte Carlo cross validation was used to assess the performance of each model on unseen data. For predicting the radial distance of the endocardium, models 1, 2, and 3 yielded average R2 values of 0.41, 0.49, and 0.71, respectively. Monte Carlo simulations of the endocardial wall showed significantly closer predictions when using model 2 versus model 1 at a rate of 48.67%, and using model 3 versus model 2 at a rate of 83.50%. These finding suggest that a machine learning approach where multi-slice data are simultaneously used as input and predictions are aided by a single user input yields the most robust performance. Subsequently, we explore the how metrics of cardiac kinematics compare between ground-truth contours and predicted boundaries. We observed negligible deviations from ground-truth when using predicted boundaries alone, except in the case of early diastolic strain rate, providing confidence for the use of such machine learning models for rapid and reliable assessments of murine cardiac function. To our knowledge, this is the first application of machine learning to murine left ventricular 4DUS data. Future work will be needed to strengthen both model performance and applicability to different cardiac disease models.

4D ultrasound↗

Beyond Expected Values Evolving Metrics for Resource Adequacy Assessment

Resource adequacy analysis quantifies the likelihood of capacity shortfall on a power system in a probabilistic manner. Using a combination of statistical techniques and power system fundamentals, the analysis typically evaluates hundreds or thousands of stochastic random samples (replications) of varying load, generator outages, variable renewable energy availability, and other aspects of power system uncertainty. In this range of uncertainty, there are - at times - periods where the power system's available resources are insufficient to meet system demand, referred to as a shortfall event. Today's power systems' rapidly evolving generation mix is changing the types of data needed by system planners and regulators, which can often render traditional resource adequacy metrics insufficient for ensuring resource adequacy for tomorrow's grid. In this paper we provide a critical assessment of traditional measures of shortfall risk in power systems, discussing their shortcomings and how they compare to metrics used in other domains. From this analysis we propose four steps forward for improving power system resource adequacy risk metrics in the future.

ENERGY PLANNING, POLICY, AND ECONOMY↗

Tool-Based Case Studies on Strategic Deployment of Untapped Micro-Pumped Hydro Storage in Michigan

With most classical hydropower sites already utilized and the global push for rapid integration of renewable energy sources accelerating, there is a critical need to identify alternative energy storage solutions. Pumped hydro energy storage, which accounts for the vast majority of global grid-scale storage, remains one of the most cost-effective and long-duration storage technologies available. Hence, this study presents a novel tool designed to assess the untapped potential of inland lakes and reservoirs for micro-PSH, using Michigan’s relatively flat landscape as a case study due to its extensive but underutilized water infrastructure. To ensure accuracy and reliability, the tool incorporates extensive data gathered from authorized sources, covering more than 420 water facilities and potential reservoirs in the state. The tool evaluates key parameters such as horizontal and vertical distances, volume, and the total storage capacity of each reservoir. Its robust assessment framework integrates these metrics to evaluate each site’s potential. The tool’s intuitive interface and geospatial visualizations support actionable insights for planners and scalable deployment of distributed storage infrastructure.

13 HYDRO ENERGY↗