Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “technology performance level assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Developing Technology Performance Level Assessments for Early-Stage Wave Energy Converter Technologies

The advantage of using Technology Performance Level (TPL) in conjunction with Technology Readiness Level (TRL) assessments in guiding technology development trajectories to successful outcomes in less time, at less overall cost, and with less encountered risk has been well articulated in the literature. In partnership with industry and international collaborators, a TPL assessment methodology for grid-connected applications has been developed through the application of the systems engineering approach. Metrics under seven different categories have been developed, weighted based on their relative relevance, and combined to yield a composite score. The methodology has been implemented in a spreadsheet tool plus a web application specifically aimed at assessing early stage (TRL 1-3) concepts. The target use cases are (a) technology developers improving their design, to find fatal flaws early, to get feedback on current design, to identify areas of improvement that will yield the highest return on investment, (b) reviewers assessing technologies in competitions or for making funding decisions, (c) investor or project developer doing due diligence, (d) policy makers landscaping the technology domain for formulating R&D strategy. The methodology and the tools are undergoing continuous improvement based on the experience and lessons learnt from applying it to internal and external marine energy technology development projects. The methodology is also being adapted for assessing WECs servicing markets outside the continental grid - broadly categorized as Powering the Blue Economy (PBE) applications. Such applications have vastly different functional requirements entailing a modification of the methodology to account for their higher risk tolerance, reduced price sensitivities, lower power needs, different permitting protocols, etc. This paper presents the latest status of the TPL assessment methodology and tools, describes its adaptation to select PBE markets, and explores its extension to other domains where it could provide a comprehensive and holistic measure of a nascent or disruptive technology's technoeconomic performance potential.

metrics↗
DOE OSTI2021

Developing Technology Performance Level Assessments for Early-Stage Wave Energy Converter Technologies: Preprint

The advantage of using Technology Performance Level (TPL) in conjunction with Technology Readiness Level (TRL) assessments in guiding technology development trajectories to successful outcomes in less time, at less overall cost, and with less encountered risk has been well articulated in the literature. In partnership with industry and international collaborators, a TPL assessment methodology for grid-connected applications has been developed through the application of the systems engineering approach. Metrics under seven different categories have been developed, weighted based on their relative relevance, and combined to yield a composite score. The methodology has been implemented in a spreadsheet tool plus a web application specifically aimed at assessing early stage (TRL 1-3) concepts. The target use cases are (a) technology developers improving their design, to find fatal flaws early, to get feedback on current design, to identify areas of improvement that will yield the highest return on investment, (b) reviewers assessing technologies in competitions or for making funding decisions, (c) investor or project developer doing due diligence, (d) policy makers landscaping the technology domain for formulating R&D strategy. The methodology and the tools are undergoing continuous improvement based on the experience and lessons learnt from applying it to internal and external marine energy technology development projects. The methodology is also being adapted for assessing WECs servicing markets outside the continental grid - broadly categorized as Powering the Blue Economy (PBE) applications. Such applications have vastly different functional requirements entailing a modification of the methodology to account for their higher risk tolerance, reduced price sensitivities, lower power needs, different permitting protocols, etc. This paper presents the latest status of the TPL assessment methodology and tools, describes its adaptation to select PBE markets, and explores its extension to other domains where it could provide a comprehensive and holistic measure of a nascent or disruptive technology's technoeconomic performance potential.

metrics↗
DOE OSTI2022

Adapting the Technology Performance Level Integrated Assessment Framework to Low-TRL Technologies Within the Carbon Capture, Utilization, and Storage Industry, Part I

With the urgent need to mitigate climate change and rising global temperatures, technological solutions that reduce atmospheric CO 2 are an increasingly important part of the global solution. As a result, the nascent carbon capture, utilization, and storage (CCUS) industry is rapidly growing with a plethora of new technologies in many different sectors. There is a need to holistically evaluate these new technologies in a standardized and consistent manner to determine which technologies will be the most successful and competitive in the global marketplace to achieve decarbonization targets. Life cycle assessment (LCA) and techno-economic assessment (TEA) have been employed as rigorous methodologies for quantitatively measuring a technology's environmental impacts and techno-economic performance, respectively. However, these metrics evaluate a technology's performance in only three dimensions and do not directly incorporate stakeholder needs and values. In addition, technology developers frequently encounter trade-offs during design that increase one metric at the expense of the other. The technology performance level (TPL) combined indicator provides a comprehensive and holistic assessment of an emerging technology's potential, which is described by its techno-economic performance, environmental impacts, social impacts, safety considerations, market/deployability opportunities, use integration impacts, and general risks. TPL incorporates TEA and LCA outputs and quantifies the trade-offs between them directly using stakeholder feedback and requirements. In this article, the TPL methodology is being adapted from the marine energy domain to the CCUS domain. Adapted metrics and definitions, a stakeholder analysis, and a detailed foundation-based application of the systems engineering approach to CCUS are presented. The TPL assessment framework is couched within the internationally standardized LCA framework to improve technical rigor and acceptance. It is demonstrated how stakeholder needs and values can be directly incorporated, how LCA and TEA metrics can be balanced, and how other dimensions (listed earlier) can be integrated into a single metric that measures a technology's potential.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

A Comprehensive Assessment Tool for Low-TRL Current Energy Converters

Along with a market-competitive levelized cost of energy, a current energy converter technology strongly benefits from an extensive consideration of socioeconomic, environmental, and regulatory factors early in the design process. As part of a technology performance level assessment, a series of assessment questions and guidance are developed and presented to evaluate an early-stage current energy technology on holistic criteria considering the entire device lifecycle. The assessment represents an accumulation of industry and research experience to date and relies on regular updates to ensure alignment with industry best-practices, regulatory requirements, and up-to-date technical understanding. A cradle-to-grave (materials, manufacturing, installation and deployment, operations and maintenance, and end-of-life) assessment of capabilities and functional requirements (i.e., high, medium, and low) performance criteria for current energy converters deployed in tidal, ocean current, and/or river applications. Key considerations related to manufacturing and installation include supply chain robustness, manufacturability and related job creation in the end-user and/or adjacent communities, and the time-to-repayment of the embodied energy debt. During deployment and maintenance operations, the safety of the device and subsystems during disconnect or grid failure, the difficulty and frequency of offshore heavy-lift activities, the avoidance or mitigation of area-use conflicts, the sea-states and weather conditions that permit maintenance access, and the availability of contingency plans (should conditions change unexpectedly) are a portion of the considered assessment criteria. Results include the potential impact of early-stage design decisions on the socioeconomic, environmental, and regulatory performance of a technology that allows developers to increase the product value and probability of success, and minimize costly late-stage design iterations through early and broad consideration of factors affecting overall performance and acceptability.

life cycle analysis↗
DOE OSTI2023

A Comprehensive Assessment Tool for Low-TRL Current Energy Converters

Along with a market-competitive levelized cost of energy, a current energy converter technology strongly benefits from an extensive consideration of socioeconomic, environmental, and regulatory factors early in the design process. As part of a technology performance level assessment, a series of assessment questions and guidance are developed and presented to evaluate an early-stage current energy technology on holistic criteria considering the entire device lifecycle. The assessment represents an accumulation of industry and research experience to date and relies on regular updates to ensure alignment with industry best-practices, regulatory requirements, and up-to-date technical understanding. A cradle-to-grave (materials, manufacturing, installation and deployment, operations and maintenance, and end-of-life) assessment of capabilities and functional requirements for tidal, river, and ocean current technologies has been completed. This work presents the evaluation questions and qualitative performance criteria for current energy converters deployed in tidal, ocean current, and/or river applications. Key considerations related to manufacturing and installation include supply chain robustness, manufacturability and related job creation in the end-user and/or adjacent communities, and the time-to-repayment of the embodied energy debt. During deployment and maintenance operations, the safety of the device and subsystems during disconnect or grid failure, the difficulty and frequency of offshore heavy-lift activities, the avoidance or mitigation of area use conflicts, the sea-states and weather conditions that permit maintenance access, and the availability of contingency plans (should conditions change unexpectedly) are a portion of the considered assessment criteria. Results include the potential impact of early-stage design decisions on the socioeconomic, environmental, and regulatory performance of a technology that allows developers to increase the product value and probability of success, and minimize costly late-stage design iterations through early and broad consideration of factors affecting overall performance and acceptability.

converter↗
DOE OSTI2023

A Comprehensive Assessment Tool for Low-TRL Current Energy Converters: Preprint

Along with a market-competitive levelized cost of energy, a current energy converter technology strongly benefits from an extensive consideration of socioeconomic, environmental, and regulatory factors early in the design process. As part of a technology performance level assessment, a series of assessment questions and guidance are developed and presented to evaluate an early-stage current energy technology on holistic criteria considering the entire device lifecycle. The assessment represents an accumulation of industry and research experience to date and relies on regular updates to ensure alignment with industry best-practices, regulatory requirements, and up-to-date technical understanding. A cradle-to-grave (materials, manufacturing, installation and deployment, operations and maintenance, and end-of-life) assessment of capabilities and functional requirements for tidal, river, and ocean current technologies has been completed. This work presents the evaluation questions and qualitative performance criteria for current energy converters deployed in tidal, ocean current, and/or river applications. Key considerations related to manufacturing and installation include supply chain robustness, manufacturability and related job creation in the end-user and/or adjacent communities, and the time-to-repayment of the embodied energy debt. During deployment and maintenance operations, the safety of the device and subsystems during disconnect or grid failure, the difficulty and frequency of offshore heavy-lift activities, the avoidance or mitigation of area use conflicts, the sea-states and weather conditions that permit maintenance access, and the availability of contingency plans (should conditions change unexpectedly) are a portion of the considered assessment criteria. Results include the potential impact of early-stage design decisions on the socioeconomic, environmental, and regulatory performance of a technology that allows developers to increase the product value and probability of success, and minimize costly late-stage design iterations through early and broad consideration of factors affecting overall performance and acceptability.

industry support↗
DOE OSTI2023

Understanding the Uncertainty in the Technical Performance Level Assessment for Wave Energy

In recent years, the design and development of wave energy converters (WECs) has been explored with intense interest, with highly varying design concepts emerging globally across both research enterprises and industry. The design space for WECs is vast - many concepts ranging in functionality, control systems, power development systems, materials, and scale have been ideated and prototyped, but WEC technology has yet to converge. One critical element of the technology trajectory that governs the speed of adoption is the performance of a WEC concept. In analogous but more-established industries (such as aerospace, and environmentally sustainable electronics design), performance assessment is a quantitative method, based on historical data, that is used as an iterative tool to improve the design of these systems early on in the design process. Though more nascent than these approaches, in wave energy R&D, WEC performance has been assessed using the Technology Performance Level (TPL) assessment, which provides designers with a quantitative score, situating a grid-scale WEC concept on a scale from 1-9 (1 being the lowest performance, and 9 being the highest, trending with the oft-used Technology Readiness Level, or TRL). The TPL assessment is designed to be used during design iteration, when a WEC concept is fully ideated, to enable designers to consider potential means of improving the downstream performance of the concept. One concern that may be slowing the adoption of TPL among WEC developers is the inherent uncertainty in the assessment, and how uncertainty in the individual questions asked as part of the assessment may contribute to perceived inaccuracies in the final score. In this work, we explore the uncertainty present in the assessment and quantify this uncertainty using both traditional mathematical operations and a Monte Carlo simulation. Results imply areas of improvement of the TPL assessment, where reducing uncertainty will be most helpful to end users, enabling both TPL practitioners and users to understand with more accuracy those design elements that can be improved to impact device performance most substantively.

techno-economic analysis↗
DOE OSTI2022

Collaborative TPL Assessment of Wave Energy Converters and Farms

The Technology Performance Level (TPL) assessment is a holistic methodology to assess a wave energy converter (WEC) technology’s ability to achieve [continental grid] market competitiveness and acceptability via criteria-based consideration of key cost, performance, environmental, safety, and societal drivers. The TPL assessment can be applied at all technology development stages and associated technology readiness levels (TRLs).

Technology Performance Level↗
DOE OSTI2021

Supporting the Transition from Grid-Scale to Emerging Market Wave Energy Converter Design and Assessment

In the past decade there has been increasing interest in emerging markets for wave energy, both as a stepping stone for development and as a way to create new opportunities for offshore markets such as ocean observation or desalination. Developers who were once focused exclusively on grid-scale development have begun to engage with more unique markets. This has led researchers to begin examining means of assessing emerging-market devices. In this paper, we analyze the Technology Performance Level (TPL) Assessment for its potential use in the assessment of emerging market wave energy converters (EM-WECs). We use Quality Function Deployment (QFD) and a question-by-question analysis of the TPL assessment to determine the changes necessary for such an assessment to be applicable in emerging markets. We discuss how the primary differences between the markets could impact the viable development pathways for developers hoping to succeed in multiple markets. We determine that the different stakeholders and stakeholder requirements of some emerging markets compared to gridscale applications should be met with changes to cost-toperformance metrics, prototype testing processes, recovery planning, materials selection, optimization objectives, and public engagement.

blue economy↗
NASA NTRSDate not supplied

Flight Testing of In-Time Safety Assurance Technologies for UAS Operations

Ongoing research at NASA is driven by a strategic plan defined by the Aeronautics Research Mission Directorate and a vision for future In-Time Aviation Safety Management Systems (IASMS) as described by the National Academies. In both visions, system safety awareness and provision are expanded through increased access to relevant data; integrated analysis and predictive capabilities; improved real-time detection and alerting of domain-specific hazards; decision support, and in some cases, automated risk mitigation strategies. One primary research focus is to develop means by which more timely (i.e., “in-time”) actions may be taken to mitigate precursors, anomalies, or trends that are observed during operations. In this paper, we describe such means as a collection of Services, Functions, and Capabilities (SFCs) that are supported by an underlying information system. For example, an integrated risk assessment capability is envisioned that continuously monitors safety-related metrics and margins and recommends timely operational changes. Assessment functions and/or services can be based on data analytics and predictive models derived from heterogeneous data sets that span relevant indicator metrics and their time histories. Likewise, on-board functions can identify and reduce susceptibility to precursor conditions that have led (and can lead) to aircraft loss-of-control or out-of-control accidents. This paper summarizes development and testing of such an information system tailored to hazards anticipated for future highly autonomous flight missions near and over densely populated areas. Testing is accomplished via simulation and by using small, unmanned aircraft operating over a test range at NASA’s Langley Research Center. Flight plans and test scenarios are defined to emulate several use-cases, including package delivery; reconnaissance; fire management; and urban air taxi vertiport operations. Two test phases are summarized with Phase 1 occurring in (2019-2020) and Phase 2 ongoing (2021-present). Results focus on SFC performance, technology readiness level assessment, and requirements discovery/validation. Companion papers are cited throughout for additional details on the recent testing.

safety management↗
DOE OSTI2026

Innovating Distributed Embedded Energy Prize (InDEEP): A Lessons Learned Report

The U.S. Department of Energy's Water Power Technologies Office (WPTO) launched the Innovating Distributed Embedded Energy Prize (InDEEP) in March 2023 to accelerate innovation in Distributed Embedded Energy Conversion Technologies (DEEC-Tec) for ocean wave energy. Administered by the National Laboratory of the Rockies (NLR) with technical support from Sandia National Laboratories (SNL), InDEEP focused on the development of small, distributed, and embeddable energy converters (DEECs) and their integration into scalable DEEC-Tec metamaterials for marine renewable energy applications. Spanning three phases over two years, InDEEP awarded approximately $2.3 million to teams from academia, industry, and startups. Phase I emphasized conceptual design. Phase II moved into the prototyping of individual DEECs. Phase III required integration into functional DEEC-Tec metamaterial prototypes. Across 60 submissions, teams explored a wide range of energy conversion mechanisms - including piezoelectric, variable-capacitance, ionic, and inductive methods. Note, the prize did not include the design nor demonstration of ocean wave energy conversion systems. Rather, the prize only required participants to design and demonstrate individual DEECs and corresponding DEEC-Tec metamaterials. This prize utilized a mix of novel and proven techniques to attract participants from outside marine energy, including an engagement leaderboard, robust recruitment, technical expert mentorship, and a suite of technical trainings. Key insights from the competition emphasized that DEEC-Tec metamaterials must be intentionally designed to produce beneficial emergent behaviors - advantages that go beyond simply combining multiple DEEC units. Top-performing teams showed that thoughtful design of system architecture, coordinated deformation, and systems adaptabilities could unlock meaningful performance gains both at the DEEC system level and DEEC-Tec metamaterial system level. A critical realization was that many DEEC-Tec metamaterials could benefit from being designed to accept lower-frequency energy inputs and shift those into higher-frequencies per each DEEC making up the respective DEEC-Tec metamaterial. Other important takeaways included the need for rigorous and quantitative performance testing, effective integration of power conditioning electronics, and the pivotal role of material science in enabling innovative, adaptive DEEC-Tec-based energy conversion designs. InDEEP also helped establish a growing DEEC-Tec community of practitioners, attracting participants from beyond traditional marine energy sectors. Through a strong support infrastructure, InDEEP fostered early-stage innovation and laid a foundation for future DEEC-Tec-based ocean wave energy conversion solutions - positioning DEEC-Tec as a promising pathway toward scalable, resilient ocean wave energy conversion. Through focused R&D of individual DEECs and their integration into DEEC-Tec metamaterials, alongside a growing, multidisciplinary community catalyzed by InDEEP, there is a strong opportunity to drive a disruptive shift in ocean wave energy conversion design and development. This convergence of novel architectures, emergent behaviors, and collaborative innovation positions DEEC-Tec as a transformative approach, moving the field from rigid, centralized energy conversion-based designs to resilient, modular systems highly adaptable for real-world ocean wave energy conversion applications.

16 TIDAL AND WAVE POWER↗
DOE OSTI2025

From TPL assessment to design optimization: Wave energy converter control co-design applied to the RM3

The Reference Model (RM) project developed six marine energy converter concepts using a sequential design methodology, which, while widely adopted in the industry, often overlooks interactions between system components, resulting in suboptimal designs. One such example is the Reference Model 3 (RM3), a two-body point absorber wave energy converter (WEC). An assessment using the Technology Performance Level (TPL) revealed that RM3’s low power-to-cost ratio, partly due to expensive steel construction, limits its techno-economic performance. Here, this study aims to redesign RM3 by reducing its scale and employing control co-design to integrate WEC and Power Take-Off (PTO) dynamics, constraints, and cost considerations within an optimization framework. We demonstrate the limitations of RM3’s current PTO design and explore the benefits of scaling down to enhance techno-economic viability by lowering material costs. Using WecOptTool, we conduct a parameter sweep over gear ratios and spring stiffnesses for various Commercial Off-The-Shelf generators in irregular wave conditions. Our findings emphasize the importance of aligning PTO components with WEC dynamics, showing that control co-design and strategic scaling can improve RM3’s power-to-cost ratio. This study presents a transferable example of applied control co-design for other WECs, supporting early-stage developers in their design decisions.

Off the shelf components↗
NASA NTRS2021

Effects of Energy Capture and Recovery on an N+3 Technology Level Reference Propulsion System

An initial, parametric study was performed to assess the benefits and drawbacks of waste heat recovery on a gas turbine engine. The NASA N+3 technology level reference propulsion system model, an advanced, single-aisle class, gas turbine engine was the baseline cycle. The amount of thermal energy removed from the high-energy core flow and transferred to lower-energy bypass or removed from the cycle was varied. Total pressure losses were included parametrically, as well as the effects of converting some of that thermal energy to work used within the cycle. Propulsion system thrust and thrust specific fuel consumption (TSFC) were minimally affected by total pressure losses or thermal energy removal from the core stream. However, total pressure losses in the bypass stream had significant thrust and TSFC penalties. Those penalties were partially offset if core thermal energy is transferred to the bypass stream. Core thermal energy converted to work for use within the engine cycle via a bottoming cycle showed significant thrust and TSFC benefits. In addition to these results, an engine dataset is also being made available. The dataset contains engine conditions (mass flow rate, total temperature and pressure, flow velocities, etc.) at four flight conditions (maximum climb limit, cruise, rolling takeoff and sea level static) that can be used for specific information to guide heat exchanger design to best realize these benefits with further research. The data set is a .csv (comma-separated values) file and is provided as a supplement to this report (available online from www.sti.nasa.gov).

propulsion↗
DOE OSTI2022

WaveSPARC: TPL Assessment - Guiding Technology Development Trajectories to Successful Outcomes in Less Time, at Less Overall Cost, and With Less Encountered Risk

The advantage of using Technology Performance Level (TPL) in conjunction with Technology Readiness Level (TRL) assessments in guiding technology development trajectories to successful outcomes in less time, at less overall cost, and with less encountered risk has been well articulated in the literature. This poster will showcase the TPL assessment methodology and tools developed at NREL.

marine renewable energy↗
NASA NTRS2004

Low Temperature Life-cycle Testing of a Lithium-ion Battery for Low-earth-orbiting Spacecraft

A flight-qualified, lithium-ion (Li-ion) battery developed for the Mars Surveyor Program 2001 lander is undergoing life-testing at low temperature under a low-Earth-orbit (LEO) profile to assess its capability to provide long term energy storage for aerospace missions. NASA has embarked upon an ambitious course to return humans to the moon by 2015-2020 in preparation for robotic and human exploration of Mars and robotic exploration of the moons of outer planets. Li-ion batteries are excellent candidates to provide power and energy storage for multiple aspects of these missions due to their low specific energy, low energy density, and excellent low temperature performance. Laboratory testing of Li-ion technology is necessary in order to assess lifetime, characterize multi-cell battery-level performance under aerospace conditions, and to gauge safety aspects of the technology. Life-cycle testing provides an opportunity to examine battery-level performance and the dynamics of individual cells in the stack over the entire life of the battery. Data generated through this testing will be critical to establish confidence in the technology for its widespread use in manned and unmanned mission. This paper discusses the performance of the 28 volt, 25 ampere-hour battery through 6000 LEO cycles, which corresponds to one year on LEO orbit. Testing is being performed at 0 C and 40% depth-of-discharge. Individual cell behaviors and their effect on the performance of the battery are described. Capacity, impedance, energy efficiency and end-of-discharge voltage at 1000 cycle intervals are reported. Results from this life-testing will help contribute to the database on battery-level performance of aerospace Li-ion batteries and low temperature cycling under LEO conditions.

Reid, Concha↗
NASA NTRS2006

Low Temperature Life-Cycle Testing of a Lithium-Ion Battery for Low-Earth-Orbiting Spacecraft

A flight-qualified, lithium-ion (Li-ion) battery developed for the Mars Surveyor Program 2001 Landeris undergoing life-testing at low temperature under a low-Earth-orbit (LEO) profile to assess its capability to provide long term energy storage for aerospace missions. NASA has embarked upon an ambitious course to return humans to the moon by 2015-2020 in preparation for robotic and human exploration of Mars and robotic exploration of the moons of outer planets. Li-ion batteries are excellent candidates to provide power and energy storage for multiple aspects of these missions due to their high specific energy, high energy density, and excellent low temperature performance. Laboratory testing of Li-ion technology is necessary in order to assess lifetime, characterize multi-cell battery-level performance under aerospace conditions, and to gauge safety aspects of the technology. Life-cycle testing provides an opportunity to examine battery-level performance and the dynamics of individual cells in the stack over the entire life of the battery. Data generated through this testing will be critical to establish confidence in the technology for its widespread use in manned and unmanned missions.

Reid, Concha↗
NASA NTRS1978

Economics of ion propulsion for large space systems

This study of advanced electrostatic ion thrusters for space propulsion was initiated to determine the suitability of the baseline 30-cm thruster for future missions and to identify other thruster concepts that would better satisfy mission requirements. The general scope of the study was to review mission requirements, select thruster designs to meet these requirements, assess the associated thruster technology requirements, and recommend short- and long-term technology directions that would support future thruster needs. Preliminary design concepts for several advanced thrusters were developed to assess the potential practical difficulties of a new design. This study produced useful general methodologies for assessing both planetary and earth orbit missions. For planetary missions, the assessment is in terms of payload performance as a function of propulsion system technology level. For earth orbit missions, the assessment is made on the basis of cost (cost sensitivity to propulsion system technology level).

Masek, T. D.↗