Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Uranium Mass Attribute System (UMAS) Study: Evaluation of Options against the Arms Control Evaluation Criteria

In this FY19 study, a range of possible measurement systems for confirming a U-235 mass attribute were identified. The systems were reviewed for their applicability in a potential future arms control agreement, and a subset of the eight most plausible systems were selected for further evaluation against the Arms Control Evaluation Criteria (ACEC). The evaluation results were then used to identify a primary and secondary recommended measurement system for confirming a U-235 mass attribute on warheads, nuclear components of warheads, and/or materials as part of a hypothetical arms control agreement.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2020

Uranium Mass Attribute System (UMAS) Study: Evaluation of Options Against the Arms Control Evaluation Criteria

In this study, eleven possible radiation and other non-destructive measurement systems for confirming U-235 mass attribute were identified. The systems were reviewed for their applicability in a potential future arms control agreement, and a subset of the eight most plausible systems were selected for futher evaluation against the Arms Control Evaluation Criteria (ACEC). The evaluation results were then used to identify a primary and secondary recommended UMAS for confirming a U-235 mass attribute on warheads, nuclear components of warheads, and/or materials as part of a hypothetical arms control agreement.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Adaptive Cybersecurity for Distributed Energy Resources (AdCyDER): Online Reinforcement Learning with Stackelberg-Optimized Defenses — Pipeline Architecture, Evaluation Methodology, and Findings from a Synthetic-Data Evaluation

This report documents the design and evaluation of an integrated online-learning pipeline developed within the AdCyDER project for Distributed Energy Resource (DER) cybersecurity. The pipeline couples a Reinforcement Learning (RL) attack classifier — which produces an attack-type probability distribution — with a Stackelberg game-theoretic (GT) defense selector that consumes those distributions alongside SME-encoded priors over (defense, attack) effectiveness pairings and perdefense costs to choose grid-health-preserving defenses. The objective is not attack classification per se but production of distributions that drive effective defense selection through the Stackelberg layer, learned from delayed grid-health feedback rather than labeled attack data. AdCyDER as a whole is broader than the work presented here; this report covers the specific RL/GT loop integration and its evaluation. We present the integrated pipeline (SCADA telemetry with Fronius inverter physics, Suricata IDS, time-windowed aggregation, per-facility LSTM classifier, Stackelberg optimizer, OpenC2 actuators), an experimental campaign of 28 eight-hour iterations across three baseline modes, and a pipeline-ordered diagnostic protocol. The protocol identifies two distinct failure modes within the loop: paired supervised ceilings on the same features establish that the deployed online RL classifier (macro F1 ≈ 0.07) sits at least 4.7× below a same-architecture supervised LSTM (≈ 0.34) and 10–11× below a linear feature-signal ceiling (≈ 0.70–0.79 depending on per-facility isolation), localizing the dominant failure to the training procedure; and the reward signal driving online updates carries weak directional coupling with classifier correctness in the methodology-expected direction (multi-lens convergent: top-decile P(true) records produce more frequent state changes and slightly larger improvements, top-vs-bot Cohen’s 𝑑 ≈ −0.19), but at effect magnitudes too small to drive gradient-based learning at the campaign sample size. The original learning hypothesis is not supported by the data. The primary contributions are the diagnostic methodology — proposed as a transferable falsification protocol for online RL/GT defense pipelines learning from delayed environmental reward — and the open, reproducible experimental infrastructure. We outline reward reformulation as the highest-priority aspirational next step given the underpowered-but-aligned Q6 reading, with hardware-in-the-loop evaluation as the broadest scope-expansion option.

Blakely, Benjamin [Argonne National Laboratory (AN↗
DOE OSTI2024

Innovating the next generation of commercial smart building software

Nearly 30% of commercial building energy use is wasted due to equipment faults and HVAC controls problems. The result is increased emissions, compromised comfort and productivity, and less reliable coordination of building power needs with a clean grid. The energy impact alone represents $17 billion in potential savings. Today’s smart building software provides a robust solution to address these operational deficiencies. Energy management and information systems (EMIS) are saving up to 9% on average, with two-year paybacks. They are being incorporated into energy management processes, commissioning services, and utility programs. As effective as they are, two barriers prevent even deeper benefits; limited personnel to fix problems once they are identified, and the expense and time to manually implement changes in control systems. In partnership with the research community, the EMIS industry is developing new capabilities to overcome these barriers. Moving beyond siloed products for either fault detection and diagnostics, or optimal control, these new capabilities empower users to not only automatically identify faults, but also to push corrective action, and control improvements to their buildings. In this paper, several areas for enhancements are documented: ‘one-time’ correction of faults such as setpoints, schedules, and economizer lockouts; short-term active testing for automated proportional integral derivative (PID) loop tuning and functional testing; and continuous supervisory control for demand flexibility and year-round efficiency. Results are presented from a pair of partner implementations out of a dozen providers integrating these enhancements into their products, including field tests from across the country, and insights into operator acceptance and integration into operations and maintenance practices.

Casillas, Armando↗
NASA NTRS1981

A review and evaluation of the Langley Research Center's Scientific and Technical Information Program. Results of phase 5. Design and evaluation of STI systems: A selected, annotated bibliography

A selected, annotated bibliography of literature citations related to the design and evaluation of STI systems is presented. The use of manual and machine-readable literature searches; the review of numerous books, periodicals reports, and papers; and the selection and annotation of literature citations were required. The bibliography was produced because the information was needed to develop the methodology for the review and evaluation project, and a survey of the literature did not reveal the existence of a single published source of information pertinent to the subject. Approximately 200 citations are classified in four subject areas. The areas include information - general; information systems - design and evaluation, including information products and services; information - use and need; and information - economics.

Pinelli, T. E.↗
NASA NTRS1987

Configuration evaluation and criteria plan. Volume 2: Evaluation criteria plan (update). Space Transportation Main Engine (STME) configuration study

Candidate main engine configurations which enhance vehicle performance, operation and cost are identified. These candidate configurations are evaluated and the configurations which provide significant advantages over existing systems are selected for consideration for the next generation of launch vehicles. The unbiased selection of the Space Transportation Main Engine (STME) configuration requires that the candidate engines be evaluated against a predetermined set of criteria which must be properly weighted to emphasize critical requirements defined prior to the actual evaluation. During a prior study of the STME a Gas Generator Cycle engine was selected for conceptual design, with emphasis on reusability, reliability and low cost while achieving good performance. In this study emphasis is on expendable application of the STME while maintaining low cost and high reliability.

Bair, E. K.↗
NASA NTRS1991

Fuel Systems Architecture (FSA) evaluation criteria and concept evaluation methodology

Consideration is given to two methods developed for the evaluation, screening, and ranking of concepts for Space Exploration Initiative vehicle propellant management systems. The methods selected for handling this multicriteria decision problem are based on the utility theory which transforms both qualitative and quantitative criteria into a nondimensional utility scale for comparison of dissimilar figures of merit. The development of the resultant FSA evaluation criteria and concept evaluation methodology is summarized.

Hendershot, J. E.↗
NASA NTRS1996

Evaluation of High-Angle-of-Attack Handling Qualities for the X-31A Using Standard Evaluation Maneuvers

The X-31A aircraft gross-acquisition and fine-tracking handling qualities have been evaluated using standard evaluation maneuvers developed by Wright Laboratory, Wright-Patterson Air Force Base. The emphasis of the testing is in the angle-of-attack range between 30 deg and 70 deg. Longitudinal gross-acquisition handling qualities results show borderline Level 1/Level 2 performance. Lateral gross-acquisition testing results in Level 1/Level 2 ratings below 45 deg angle of attack, degrading into Level 3 as angle of attack increases. The fine-tracking performance in both longitudinal and lateral axes also receives Level 1 ratings near 30 deg angle of attack, with the ratings tending towards Level 3 at angles of attack greater than 50 deg. These ratings do not match the expectations from the extensive close-in combat testing where the X-31A aircraft demonstrated fair to good handling qualities maneuvering for high angles of attack. This paper presents the results of the high-angle-of-attack handling qualities flight testing of the X-31A aircraft. Discussion of the preparation for the maneuvers, the pilot ratings, and selected pilot comments are included. Evaluation of the results is made in conjunction with existing Neal-Smith, bandwidth, Smith-Geddes, and military specifications.

Stoliker, Patrick C.↗
NASA NTRS1996

Characterization and Evaluation of Acid Rain in East Central Florida from 1978 to 1995 and Evaluation of Some Chromatographic/Spectroscopic Results from Leachate Samples from CELSS

The results of monitoring the chemical composition of rain in east-central Florida have shown that the rain is moderately acid. The measured acidity of rain is less than that observed in other regions of the U. S., however, it does suggest that the level of acidity is substantial. The annual chemical composition of rain at UCF and at KSC has shown moderate variability. Extreme daily and monthly variations are observed, however these variations are not addressed here. The total ionic composition of rain collected at FL99 is greater than that for rain collected at UCF, however this can be accounted for by site proximity to the ocean with the accompanying marine influence. Difference in acidity data collected from the UCF and FL99 sites which are separated by 50 km may be due in part to the differences that have been observed between laboratory and field pH measurements. Trend assessment for precipitation composition requires evaluation of data that covers some minimum time period. In fact, the subdivision of the multi-year UCF record into individual 10 year records as described above can lead to the conclusion that a significant increase, a significant decrease or no trend exists for acidity depending upon the time period chosen for evaluation. Trend evaluation has also been accomplished by linear and nonlinear regression analysis using monthly volume weighted average concentrations and deposition using the UCF data set and some of the Florida NADP data set.

Madsen, Brooks C.↗
NASA NTRS1997

Evaluation of High-Angle-of-Attack Handling Qualities for the X-31A Using Standard Evaluation Maneuvers

The X-31A aircraft gross-acquisition and fine-tracking handling qualities have been evaluated using standard evaluation maneuvers developed by Wright Laboratory, Wright Patterson Air Force Base. The emphasis of the testing is in the angle-of-attack range between 30 deg. and 70 deg. Longitudinal gross-acquisition handling qualities results show borderline Level l/Level 2 performance. Lateral gross-acquisition testing results in Level l/Level 2 ratings below 45 deg. angle of attack, degrading into Level 3 as angle of attack increases. The fine tracking performance in both longitudinal and lateral axes also receives Level 1 ratings near 30 deg. angle of attack, with the ratings tending towards Level 3 at angles of attack greater than 50 deg. These ratings do not match the expectations from the extensive close-in combat testing where the X-31A aircraft demonstrated fair to good handling qualities maneuvering for high angles of attack. This paper presents the results of the high-angle-of-attack handling qualities flight testing of the X-31A aircraft. Discussion of the preparation for the maneuvers, the pilot ratings, and selected pilot comments are included. Evaluation of the results is made in conjunction with existing Neal Smith, bandwidth, Smith-Geddes, and military specifications.

Stoliker, Patrick C.↗
NASA NTRS2009

Chemical Kinetics and Photochemical Data for Use in Atmospheric Studies Evaluation Number 16. Supplement to Evaluation 15: Update of Key Reactions

This is the supplement to the fifteenth in a series of evaluated sets of rate constants and photochemical cross sections compiled by the NASA Panel for Data Evaluation. The data are used primarily to model stratospheric and upper tropospheric processes, with particular emphasis on the ozone layer and its possible perturbation by anthropogenic and natural phenomena. Copies of this evaluation are available in electronic form and may be printed from the following Internet URL: http://jpldataeval.jpl.nasa.gov/.

atmospheric modeling↗
DOE OSTI2023

Coronado Generating Station Repowering Evaluation - Siting Evaluation

The purpose of this initial siting evaluation is to consider the suitability of the Salt River Project (SRP) owned land at/near Coronado Generating Station (CGS) for a nuclear generating station (including advanced light water reactors, light water small modular reactors, and non-light-water designs1) and to assess if there are any exclusionary or avoidance factors associated with coal to nuclear repowering at CGS. This initial siting evaluation considers several characteristics (e.g., environmental conditions, seismic concerns, site footprint, water use, etc.) and highlights favorable/preferred characteristics as well as potential risks to feasibility. The results are intended to inform SRP on the strengths and weaknesses associated with the CGS site and inform the selection of candidate nuclear technologies for the CGS site that align with SRP’s mission and business objectives. This report relies on industry-recognized siting guidance, including Electric Power Research Institute’s (EPRI’s) Siting Guide (Reference 1) 2 and Nuclear Regulatory Commission’s (NRC’s) Regulatory Guide (RG) 4.7 (Reference 3), as well as nuclear domain expertise within the Gateway for Accelerated Innovation in Nuclear (GAIN), MPR Associates, Inc. (MPR), and the Idaho National Laboratory (INL).

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
NASA NTRS1986

Performance Evaluation Tests for Environmental Research (PETER): evaluation of 114 measures

The goal of the Performance Evaluation Tests for Environmental Research (PETER) Program was to identify a set of measures of human capabilities for use in the study of environmental and other time-course effects. 114 measures studied in the PETER Program were evaluated and categorized into four groups based upon task stability and task definition. The Recommended category contained 30 measures that clearly obtained total stabilization and had an acceptable level of reliability efficiency. The Acceptable-But-Redundant category contained 15 measures. The 37 measures in the Marginal category, which included an inordinate number of slope and other derived measures, usually had desirable features which were outweighed by faults. The 32 measures in the Unacceptable category had either differential instability or weak reliability efficiency. It is our opinion that the 30 measures in the Recommended category should be given first consideration for environmental research applications. Further, it is recommended that information pertaining to preexperimental practice requirements and stabilized reliabilities should be utilized in repeated-measures environmental studies.

NASA Program Space Medicine↗
DOE OSTI2022

Geomechanical and Hydrogeological Evaluation of a Shallow Hydraulic Fracture at the Devine Fracture Pilot Site, Medina County, Texas

UT-Austin’s Devine Fracture Pilot Site, 50 miles southwest of San Antonio, Texas, has been targeted for a comprehensive, multidisciplinary development of fracture diagnostic techniques that are cross-validated by ground-truth data acquisition near a recently created, 175-ft-deep, horizontal hydraulic fracture (Ahmadian et al. 2018 Demonstration of proof of concept of electromagnetic geophysical methods for high resolution illumination of induced fracture networks. In Proceedings of the SPE Hydraulic Fracturing Technology Conference and Exhibition, The Woodlands, Texas, USA, 23–25 January 2018. SPE-189858-MS.). To evaluate the fracture diagnostic methods at this site, we conducted injection tests with a predefined volumetric flow-rate profile, resembling a diagnostic fracture injection test on September 2020. Subsequently, we developed hydrogeological and geomechanical models based on flow-rate and bottomhole-pressure measurements. History-matching efforts using a simplified layer-cake hydrogeological model resulted in the field-scale formation permeability of 9.87 × 10 –15 m 2 (10 mD) and Darcy-scale fracture permeability. The analysis of the bottomhole pressure and injection-rate history showed that (1) the newly created horizontal fracture was closed adjacent to the injection well pre-injection and (2) the initial pump-pressure increase at a nominal volumetric injection rate led to near-well fracture reopening, fluid conductivity increase, and abrupt injection-rate increase. To overcome hydrogeological-model limitations of predicting fracture reopening throughout injection, we extended the modeling to a finite-element, poroelastic analysis of horizontal-fracture growth using a cohesive-zone model. Using this fracture-reopening model, we improved the history match of the transient-pressure response during the experiment by adjusting the hydromechanical properties. Furthermore, post-injection pressure transient analyses helped reduce uncertainty in the overburden-stress gradient, and the initial hydraulic-fracturing simulation verified the plausibility of achieving the surveyed propped fracture area.

02 PETROLEUM↗
DOE OSTI2022

Economic and Environmental Analysis to Evaluate the Potential Value of Co-Optima Diesel Bioblendstocks to Petroleum Refiners

The U.S. petroleum refining sector is undergoing a period of historic transformation, catalyzed by the decarbonization of the U.S. economy. Diesel-boiling-range bioblendstocks have gained traction, owing to their superior fuel properties and environmental performance as compared to traditional petroleum fuels. This work couples refinery linear programming models with life cycle assessment to quantify the potential economic and environmental benefits, and trade-offs, of blending diesel-boiling-range bioblendstocks at petroleum refineries. Linear programming models were developed in Aspen Process Industry Modeling Systems (PIMS) for three representative petroleum refinery configurations of differing complexity. Seven diesel-boiling-range bioblendstocks: 4-butoxyheptane, 5-ethyl-4-propylnonane, soy biodiesel, sludge hydrothermal liquefaction diesel, polyoxymethylene ethers, renewable diesel, and hexyl hexanoate, were investigated to identify key fuel properties that influence refineries' economics and to track the effect of adding bioblendstocks on refinery-wide cradle-to-gate greenhouse gases (GHG) emissions. These analyses considered blending levels from 10 to 30 vol% and fuel demand projections over the period 2040 to 2050. This analysis determines that bioblendstock sulfur content and cetane number are the primary fuel attributes with the potential to provide value to refiners. Life cycle assessment results indicate that the use of diesel-boiling-range bioblendstocks can reduce cradle-to-gate refinery GHG emissions by up to ~ 40 % relative to conventional refinery operations when considering carbon uptake in the supply chain of the bioblendstock. Refinery-wide marginal GHG abatement costs range from 120 to 3,600 USD2016/metric tons carbon dioxide equivalent avoided across the scenarios evaluated. Reducing the price of bioblendstocks is identified as a key to their adoption.

ADVANCED PROPULSION SYSTEMS,BIOMASS FUELS,ENERGY P↗
DOE OSTI2021

Evaluation of residual stresses in isothermal friction stir welded 304L stainless steel plates

Friction stir welding was performed on 304L SS plates in order to heal simulated cracks created by electrical discharge machining. Two different tool temperatures (825 and 725 °C) were chosen for this study. Both neutron diffraction and X-ray diffraction techniques were employed to evaluate the residual stresses along two orthogonal reference directions, longitudinal (syy) and transverse (sxx). The former technique was also used to measure residual stresses at various depths. It was found that, at 1 mm depth from the top surface inside the stir zone (SZ), the longitudinal component was tensile in nature while the transverse component was compressive. The nature and magnitude of the residual stress fields, and the position of the peak residual stresses were found to vary with the weld depth. The SZ of the 725 °C weld exhibited higher peak stress than 825 °C weld mainly due to a lack of stress relief at the lower temperature.

Friction stir welding, Steel↗
DOE OSTI2021

A modeling framework for designing and evaluating curbside traffic management policies at Dallas-Fort Worth International Airport

Emerging mobility technologies are changing the transportation system landscape. This is especially evident at airports, such as the Dallas-Fort Worth International Airport (DFW). Without careful analysis, these changes could lead to inefficient and costly airport operations. This paper presents a modeling framework that integrates travel mode encoding, demand projection, and microsimulation to enable airports to develop, simulate, and evaluate curbside traffic managements policies and measure their impact. Here, the framework is utilized to analyze several traffic scenarios and policies for DFW: a baseline scenario which represents DFW traffic pattern as observed in 2018 and projected to 2045, a transit network company (TNC) electrification policy, a TNC queuing policy, a policy that increased transit ridership, a bus-only policy which considers the use of only buses inside DFW, an autonomous vehicle (AV) policy which investigates the impact of autonomous vehicle (AV) adoption on airport operations, and an example COVID-19 scenario which models the impact of the COVID19 pandemic. The simulations’ results demonstrate that: increasing the DFW transit ridership postpones the need for airport curbside expansion the most; encouraging shared-mobility with the bus-only policy produces the most savings in curbside congestion delays; automation and electrification for all passenger vehicle trips to/from DFW generates the most saving in fuel consumption and emissions; and uncontrolled AV adoption incurs the highest increase in fuel consumption, delay, and emissions and could require immediate airport capacity extension. Without policy intervention or investment in additional infrastructure capacity, these results predict the current operations would face significant congestion on high demand days starting as early as 2028. While derived in close partnership with DFW, the methodology presented here can be generalized to any airport.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗