Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance Assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Assessing Performance of Radar and Visual Sensing Techniques for Ground-To-Air Surveillance in Advanced Air Mobility

The safe integration of Unmanned Aircraft Vehicles (UAV) within the civil airspace is of great interest to NASA’s Advanced Air Mobility project, which envisions high density of operations in and around urban areas that include both UAV and AAM aircraft. To enable safe autonomous operations of both platforms, reliable airspace surveillance strategies must be designed and experimentally validated in relevant scenarios, where multiple small UAV operate flying in low altitude conditions. An example of such a scenario is described in this paper which provides performance assessment of various sensing strategies experimentally tested during flight campaigns with four UAV completing simultaneous missions from vertiports. Such campaigns are performed by the High Density Vertiplex subproject which assesses a prototype of Urban Air Mobility ecosystem. For the purposes of this work, the flights are observed from multiple sensing nodes each with radar and camera sensors. The visual detection and tracking algorithms achieved 96.1% to 99.9% average tracking coverage of the UAV above the horizon, reaching detection ranges larger than 1 kilometer for octocopter. Radar-based tracking shows a lower coverage mainly due to ground clutter removal challenges but provides comparable detection ranges and meter-level range accuracy.

Federica Vitiello↗
NASA NTRS2020

Risk and Performance Assessment of Generic Mission Architectures: Showcasing the Artemis Mission

A has initiated a strong push to return face. In this work, we astronaut assess performance and risk for proposed mission architectures using a new Mission Architecture Risk Assessment (MARA) tool. The MARA tool can produce statistics about the availability of components and overall performance of the mission considering potential failures of any of its components. In a Monte Carlo approach, the tool repeats the mission simulation multiple times while a random generator lets modules fail according to their failure rates. The results provide statistically meaningful insights into the overall performance of the chosen architecture. A given mission architecture can be freely replicated in the tool, with the mission timeline and basic characteristics of employed mission modules (habitats, rovers, power generation units, etc.) specified in a configuration file. Crucially, failure rates for each module need to be known or estimated. The tool performs an event-driven simulation of the mission and accounts for random failure events. Failed modules can be repaired, which takes crew time but restores operations. In addition to tracking individual modules, MARA can assess the availability of predefined functions throughout the mission. For instance, the function of resource collection would require a rover to collect the resources, a power generation unit to charge the rover, and a resource processing module. Together, the modules that are required for a given function are called a functional group. Similarly, we can assess how much crew time is available to achieve a mission benefit (e.g. research, building a base, etc) as opposed to spending crew time on repairs. Here we employ the method on the proposed NASA Artemis mission. Artemis aims to return United States astronauts to the lunar surface by 2024. Results provide insights into mission failure probabilities, up- and downtime for individual modules and crew-time resources spent on the repair of failed modules. The tool also allows us to tweak the mission architecture in order to find setups that produce more favorable mission performance. As such, the tool can be an aid in improving the mission architect abling cost-benefit analysis for mission improvement.

Rumpf, Clemens M.↗
NASA NTRS1974

Digital temperature sensor performance assessment report

Performance assessment data accumulated during exposure of the digital temperature sensor to simulated shuttle flight type environments are presented. The test parameters were specifically designed to check the sensor for its: (1) ability to resolve temperature relative to the design specifications; (2) ability to maintain accuracy after interchanging the temperature probes with each electronics interface assembly; (3) stability (i.e., satisfactory operation and accuracy during and after exposure to flight environments); and (4) repeatability, or its ability to produce the same output on subsequent exposures to the identical stimulus. Equipment list, test descriptions, data summary, and conclusions are included.

Canniff, J. H.↗
DOE OSTI2023

A new control score concept for building performance assessment

In buildings, performance assessment often focuses on energy use with metrics such as energy use intensity (EUI) used to benchmark performance. However, energy performance of a building is fundamentally determined by the control system that engages the energy-using systems. There are two aspects of control that are of particular importance: (1) the ability to regulate process variables to their setpoints; and (2) whether the setpoints are at the right levels and/or following desired profiles. Most buildings do not reach their energy efficiency potential due to deficiencies in control performance and operators do not have access to metrics that can illuminate these deficiencies. Here this paper addresses this problem by providing novel techniques that combine these two aspects of control performance into a single standardized score on the scale of 0-10. The concept of a standardized control scores enables all systems in a building to be compared on the same scale and also for scores to be rolled up to different levels in the building and system hierarchy for system-wide analysis. The paper presents the theory for the method, describes a prototype tool for displaying scores, and presents results from application to a large building in Minneapolis.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

RANGERS: Modeling Report on Integrity and Performance Assessment of Engineered Barrier Systems in a Salt Repository for HLW/SNF

The Engineered Barrier System (EBS) plays an important role in ensuring the long-term safety and containment of high-level waste (HLW) and spent nuclear fuel (SNF) in deep geological repositories in salt formation. As part of a multi-barrier system, the EBS works alongside the natural barrier, which is the salt formation itself and the technical barrier comprising the disposal casks. The primary function of the EBS is to maintain containment during a defined period until the backfill used in the repository made of crushed salt, develops its sealing capacity through compaction. Over the time, the backfill eventually compacts to a state of low porosity and permeability, acting as a long-term seal. However, until this process is complete, the EBS must retain its structural and functional integrity. Regulatory guidelines in Germany currently require the EBS to remain effective for up to next ice age, that is expected in 50,000 years. The significant hydro-geological and topographic changes expected during an ice age could make it impossible to accurately predict the hydro-chemical conditions within the repository system at that time. In response to these challenges, BGE TECHNOLOGY GmbH (BGE TEC) and Sandia National Laboratories (SNL) have jointly developed a comprehensive methodology for the design and safety assessment of engineered barrier systems within the scope of the RANGERS project. This methodology is tailored for repositories in salt formations. The developed methodology provides a structured approach for designing and assessing the performance of the EBS in salt-based repositories. It begins with defining a sealing concept based on the geological characteristics of the selected site and the overall repository design. The entire repository system, comprising the geological site, repository infrastructure, and EBS, is then subjected to a Features, Events, and Processes (FEP) analysis, focusing solely on those FEPs that affect the EBS. The derived FEPs help identify the loads and stresses acting on the EBS, which serve as the foundation for conducting an integrity assessment. This analysis helps predict the EBS’s evolution and performance over the regulatory time frame, feeding into integrated performance assessment simulations.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2021

Quantitative Performance Assessment of Proxy Apps and Parents (Report for ECP Proxy App Project Milestone ADCD-504-11)

The ECP Proxy Application Project has an annual milestone to assess the state of ECP proxy applications. Our FY21 milestone (ADCD-504-11) proposed to: "Assess the performance and fidelity of proxy applications, including those in the ECP Proxy App Suite, relative to the ECP Application workload on heterogeneous platforms. Use proxy applications and selected ECP applications to assess the utility of critical elements of the Exascale toolchain, especially tools used to collect performance data. Identify gaps in coverage and/or common situations in which proxies may fail to adequately represent ECP applications." To satisfy this milestone, the following specific tasks were completed: Study ability of MACSio to represent I/O workloads of adaptive mesh codes; Prepare report on assessed performance and debugging tools; Perform cosine similarity study on Intel and P9 and submit paper; Complete LDMS/GPU subcontract, complete and receive report; Complete validation of LDMS data collection for GPUs and submit paper; and Perform cosine similarity study on GPUs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Special Analyses for the Hanford Integrated Disposal Facility Performance Assessment - 20102

In 2014, the Department of Energy (DOE) Office of River Protection and its contractors began to develop a performance assessment for the near-surface disposal of low-level and mixed low-level waste at the Hanford Site's Integrated Disposal Facility (IDF). The IDF is a doubly-lined landfill that was constructed between 2004 and 2006 to be the disposal facility for the vitrified low-activity waste that will be produced at the Waste Treatment and Immobilization Plant (WTP). IDF is also expected to receive solid secondary waste produced at the WTP and other solid wastes from site activities. The IDF has been in a preoperational state awaiting authorization from DOE and a RCRA permit modification from the State of Washington Department of Ecology to receive waste. Both the Disposal Authorization Statement and permit modification require a performance assessment demonstrating that the system of engineered and natural features will limit releases of radionuclides and hazardous chemicals from the IDF and be protective of human health and the environment. The simulated duration is 10,000 years. Based on the analyses presented in the 2017 Integrated Disposal Facility Performance Assessment, DOE issued a conditional Operating Disposal Authorization Statement for the IDF in June 2018. The long-term performance of the IDF to be protective of human health and the environment was evaluated under the requirements of DOE Order 435.1, Radioactive Waste Management. Computer simulations were performed to evaluate whether or not the IDF would comply with DOE requirements. In the time that has passed since the performance assessment was approved by DOE, new information has been discovered that had not been considered in the performance assessment. Since this new information has not been evaluated, the potential impact of the changes have not been taken into consideration in DoE's disposal authorization. DOE and its contractors follow a change control process to screen and, when necessary, evaluate new information that could potentially impact the conclusions of the completed performance assessment. This paper will describe the change control process and provide two examples of evaluations performed following the change control process. The first example evaluates a new waste form for liquid secondary waste that was not evaluated in the performance assessment. In the performance assessment, liquid secondary waste was assumed to be solidified with grout. A new recommendation to dispose of the liquid secondary waste after drying it to a powder was evaluated. The second example evaluates inventory implications from changes to the flow sheet that estimates the feed composition to the low-activity waste vitrification facility. The changes result in higher strontium concentrations in the vitrified waste stream. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS2004

DAG-TM Concept Element 11 CNS Performance Assessment: ADS-B Performance in the TRACON

Distributed Air/Ground (DAG) Traffic Management (TM) is an integrated operational concept in which flight deck crews, air traffic service providers and aeronautical operational control personnel use distributed decision-making to enable user preferences and increase system capacity, while meeting air traffic management (ATM) safety requirements. It is a possible operational mode under the Free Flight concept outlined by the RTCA Task Force 3. The goal of DAG-TM is to enhance user flexibility/efficiency and increase system capacity, without adversely affecting system safety or restricting user accessibility to the National Airspace System (NAS). DAG-TM will be accomplished with a human-centered operational paradigm enabled by procedural and technological innovations. These innovations include automation aids, information sharing and Communication, Navigation, and Surveillance (CNS) / ATM technologies. The DAG-TM concept is intended to eliminate static restrictions to the maximum extent possible. In this paradigm, users may plan and operate according to their preferences - as the rule rather than the exception - with deviations occurring only as necessary. The DAG-TM concept elements aim to mitigate the extent and impact of dynamic NAS constraints, while maximizing the flexibility of airspace operations

Raghavan, Rajesh S.↗
DOE OSTI2020

Development of a Conditioned System-Level Groundwater Model to Evaluate Long-Term Groundwater Impacts within a Performance Assessment - 20115

A preliminary performance assessment (PA) of single-shell tank Waste Management Area (WMA) A-AX located at the U.S. Department of Energy (DOE)'s Hanford Site in southeastern Washington is being conducted to satisfy the requirements of DOE Order 435.1 [1] as it relates to closure of the single-shell radioactive waste tanks in the WMA A-AX tank farms. A PA assesses the fate, transport, and impacts of radionuclides within a low-level radioactive waste disposal facility in its assumed closure configuration and the subsequent potential doses to humans over a 1,000-year compliance period and a 10,000-year performance evaluation period. The WMA A-AX preliminary PA evaluation is structured around the complementary use of process-level and system-level models to calculate the facility performance against established DOE Order 435.1 [1] performance objectives. Process-level models are those that represent a detailed phenomenological representation of processes of concern in the PA. Process models typically only represent one or a few of the components of the PA, such as groundwater flow and transport, and must be integrated with other modeling elements to perform PA calculations. System-level models are those that are abstracted from the process models, retaining the essential features of the process model, while allowing integration of all aspects of the PA in a single modeling framework. System-level models are often characterized by coarser numerical discretization, lower dimensionality, or other similar simplifications compared to the process-level model. Traditionally, a three-dimensional (3-D) process-level model is utilized primarily to evaluate the long-term impact on groundwater and the potential doses to individuals who consume contaminated groundwater. System-level models are also utilized to evaluate the groundwater pathway in PAs. These models typically have reduced dimensionality (1-D) and are conditioned utilizing flow fields (Darcy fluxes) and moisture content distributions that are abstracted from the process level models. The abstraction approach assures that the flow field in both models is consistent for a specific set of input parameters for flow, differing only in the discretization and dimensionality of the two models. The preliminary WMA A-AX PA incorporates a detailed representation of the geological system and hydraulic properties within the 3-D model STOMP{sup C} numerical code so that the effects of relevant features and processes on water flow and radionuclide transport in the subsurface can be evaluated. The complementary system-level model is developed utilizing the GoldSim{sup C} code to implement a simplified, 1-D equivalent model to represent the groundwater pathway. Contaminant transport through the vadose zone and unconfined aquifer for Tc-99 and I-129 were evaluated in each of the models. Adjustments to the saturated portion of the GoldSim{sup C} 1-D model were required to mimic the dispersion effect captured with the 3-D STOMP{sup C} model. Once this conditioning was conducted, highly similar results for the transport of Tc-99 and I-129 were achieved at the point of calculation, located 100 m downgradient from the WMA A-AX fenceline. These radionuclides represent elements that are regarded as primary dose drivers in the PA groundwater pathway analysis. The high degree of conformance between the two models suggests that the use of the equivalent 1-D system model is suitable for evaluating the full suite of radionuclides that will be released from the tank sources within WMA A-AX over the 1,000-year compliance period and over the 10,000-year evaluation period. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

Tools Assessing Performance

For the distributed wind industry, it can be challenging to accurately predict the performance and annual energy production of projects prior to their installation. The U.S. Department of Energy’s Tools Assessing Performance (TAP) project aims to improve wind resource characterization, thereby reducing the uncertainty of project performance and financing costs, increasing consumer confidence, and lowering the levelized cost of distributed wind energy. A collaborative effort among DOE National Laboratories, TAP will create a computational framework that provides the distributed wind community with access to newly developed wind resource data and modeling capabilities. These capabilities will allow users to perform timely and accurate performance assessments for distributed wind projects at locations across the United States.

wind, distributed, tools, performance↗
DOE OSTI2024

Value of abstraction in performance assessment – When is a higher level of detail necessary?

In this study, different approaches in performance assessment (PA) of the long-term safety of a repository for radioactive waste were examined. This investigation was carried out as part of the DECOVALEX-2023 project, an international collaborative effort for research and model comparison. One specific task of the DECOVALEX-2023 project was the Salt Performance Assessment Modelling task (Salt PA), which aimed at comparing various models and methods employed in the performance assessment of deep geological repositories in salt. In the context of the Salt PA task, three distinct teams from SNL (United States), Quintessa Ltd (United Kingdom), and GRS (Germany) examined the consequences of employing different levels of abstractions when modelling the repository's geometry and implementing various features and processes, using the example of a simple hypothetical repository structure in domal salt. Each team applied their own tools: PFLOTRAN (SNL), QPAC (Quintessa) and LOPOS (GRS). These differ essentially regarding numerical concept and degree of detail in the representation of the underlying physical processes. The discussion focused on when simplifications can be appropriately applied and what consequences result from them. Furthermore, it was explored when and if a higher level of fidelity in geometry or physical processes is required.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2019

Laying a Foundation for Performance Assessment (PA) Model Development - 19267

Performance Assessment (PA) models are abstractions of real-world conditions. As abstractions, modelers must make a number of decisions regarding model complexity and which features, events, and processes (FEPs) will be represented. To ensure that such decisions are transparent to stakeholders, modelers should document their approach and how this approach influences conceptual model development. This paper describes one such approach. Examples are used to describe an analysis of the potential FEPs. Through the FEPs analysis, all potentially relevant FEPs can be identified. These potentially relevant FEPs are then used to develop a detailed conceptual model known as the Central Scenario, which includes a description of the assessment context, the key features of the site and the closure system, and the expected processes of the system. From this Central Scenario conceptual model, mathematical models can be developed and implemented within modeling software and used to demonstrate compliance to PA performance objectives. FEPs which are beyond the scope of the Central Scenario are identified and used as the basis for developing alternative conceptual models (ACMs) or sensitivity analyses. Once these models and modeling cases are defined, the necessary inputs can be identified and defined. (author)

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Dose Calculation Methodology and Data for Solid Waste Performance Assessment and Composite Analysis at the Savannah River Site

This report provides a detailed description of the methodology developed to perform dose calculations for E-Area Low Level Waste Facility Performance Assessments and Savannah River Site Composite Analyses. Chapters 2 – 8 give a complete set of equations to be used to calculate dose for individual exposure pathways. The first set of dose scenarios assume that a member of the public establishes residence near the waste site and uses contaminated groundwater or contaminated surface water for personal consumption and to irrigate a garden and pasture where produce and farm animals are raised. Products from the garden and farm animals are used for personal consumption. This scenario applies to both E-Area Performance Assessments and Savannah River Site Composite Analyses. General dose exposure pathways for the resident farmer scenario are: 1. Ingestion pathways described in Chapter 2, 2. Inhalation pathways described in Chapter 3, 3. External exposure pathways described in Chapter 4, and 4. Recreational pathways described in Chapter 5 (Composite Analysis only). Doses from all of the above pathways are directly related to the contaminant concentration in the water. Additional dose scenarios considered for E-Area Performance Assessment assume that an inadvertent intruder encroaches on the waste disposal site after loss of institutional control. General dose exposure pathways considered for the inadvertent intruder are: 1. Ingestion pathways described in Chapter 6, 2. Inhalation pathways described in Chapter 7, and 3. External exposure pathways described in Chapter 8. Doses from all of the intruder pathways are directly related to the contaminant concentration in the buried waste. Special dose considerations related to human consumption of meat and dairy, and treatment of tritium in dose calculations are discussed in Chapter 9. Chapter 10 describes an Excel database named “Radionuclide, Element and Dose Parameter Data Package” that has been created to provide a system for maintaining the data required to perform radionuclide transport and dose calculations. This data includes: Isotope physical parameters and radioactive decay data needed for both transport and dose calculations, Isotope-specific dose coefficients and soil shielding factors associated with exposure pathways, Radionuclide drinking water concentration limits either published by the Environmental Protection Agency or derived from internal dose coefficients to meet the groundwater protection requirements in Department of Energy Order 435.1, Element-specific bio-transfer factors used in dose calculations, Dose equations and values of physical parameters and human factors used in dose calculations, and Key physical constants used in dose calculations. Revision 1 incorporates updated information developed since this report was issued for use in the next revision of the E-Area Low-Level Waste Facility Performance Assessment.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Quantitative Performance Assessment of Proxy Apps and Parents

The ECP Proxy Application Project has an annual milestone to assess the state of ECP proxy applications. Our FY21 milestone (ADCD-504-11) proposed to: Assess the performance and fidelity of proxy applications, including those in the ECP Proxy App Suite, relative to the ECP Application workload on heterogeneous platforms. Use proxy applications and selected ECP applications to assess the utility of critical elements of the Exascale toolchain, especially tools used to collect performance data. Identify gaps in coverage and/or common situations in which proxies may fail to adequately represent ECP applications.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1982

Performance assessment of planetary missions as launched from an orbiting space station

Results presented are intended to assist planners and the mission analysis community in assessing the performance impact (pro or con) of launching planetary missions from an orbiting space station as compared to the usual, ground-based Shuttle launch of such missions. The analyses comprising this assessment include: (1) a basic understanding and description of the space station launch problem; (2) examination of alternative injection strategies and selection of the most appropriate strategy for minimizing performance penalties; and (3) quantitative comparison of station-launched and Shuttle-launched performance over a wide energy/mass range of planetary mission opportunities. Data for each mission covers a full 360 deg of possible nodal location of the space station orbit. The main results are that planetary missions can be launched from a space station within acceptable penalty bounds, and that the station serving as a staging base/propellant depot can benefit some missions requiring large payload mass or high injection energy.

Friedlander, A.↗
DOE OSTI2023

Performance Assessment Closure Plan for the Active Low-Level Burial Ground Trenches 31, 34, and 94 at the Hanford Site

This report documents the closure plan for the active trenches within the Low-Level Burial Grounds of the Hanford Site, namely Trenches 31 and 34 in the 200 West Area and Trench 94 in 200 East Area. This closure plan is developed to meet the requirements of DOE O 435.1, Radioactive Waste Management. It is one of the several technical basis documents, along with the performance assessment (DOE/RL-2021-26, Performance Assessment of Active Trenches in 200 East and West Low-Level Burial Grounds at the Hanford Site), which is required for maintaining the Operating Disposal Authorization Statement as described in DOE-STD-5002-2017, Disposal Authorization Statement and Tank Closure Documentation.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

Preliminary design overview and performance assessment of the ITER low-field side reflectometer

The design of the ITER low-field side reflectometer (LFSR) has matured to a complete end-to-end preliminary design. LFSR will supply three key plasma measurements: (1) electron density profile, (2) electron density fluctuations, and (3) poloidal rotation. Simultaneous measurements of the three quantities are enabled by an array of six monostatic antennas which inject from an equatorial port on the outboard side of the ITER vessel. Low-loss transmission lines, consisting of corrugated, overmoded waveguide and miter bends, transmit the 30–165 GHz, O- and X-mode signals to and from the ITER plasma. Integrated transmission-line components serve a range of purposes, such as protection from high-power stray radiofrequency radiation, accommodation of transmission-line displacement, and simultaneous measurement of reference and plasma phases during the discharge. Broadband transmission signals are realized by full-band microwave transceivers combined with quasi-optical multiplexing. A field-programmable gate array (FPGA) processor demodulates the profile reflectometer signals, enabling real-time density profile measurements for plasma control system feedback. A full-scale transmission line test facility provides an integrated environment to assess the performance of critical LFSR components. Theoretical modeling together with insertion loss measurements provide the basis for a comprehensive power budget, which accounts for transmitted output power, transmission-line losses, antenna coupling, and plasma effects. Results indicate that high signal-to-noise ratios are achievable with the current design. A synthetic reflectometer model, using real design parameters and baseline ITER profiles, has been developed to estimate the return signal. With evolving microwave and data acquisition technologies, full-band, ultrafast sweeps (<1 μs) will be realizable for ITER.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗