Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “independent evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43

Comparing multi-source urban flood indicators: satellite, simulation, and citizen-reported data

Urban flooding arises from complex mechanisms, making it challenging to capture accurately with a single detection method. This study evaluates three complementary approaches to detect flooding across three Chicago neighborhoods: (i) Sentinel-1 synthetic aperture radar (SAR), offering weather-independent, high-resolution (10 m) imagery of surface inundation; (ii) the storm water management model (SWMM), simulating combined sewer overflow and drainage performance; and (iii) citizen-generated 311 service requests, capturing observed flooding impacts. By analyzing six storms ranging from severe to mild, we examine how each source uniquely contributes to identifying urban flood events. SAR imagery effectively identifies standing water but can miss brief flooding due to satellite revisit constraints. SWMM provides detailed insights into system-wide drainage behavior yet may underestimate localized street-level flooding. Meanwhile, 311 calls reflect real-world flooding impacts but are vulnerable to underreporting. Statistical overlap analysis highlights chronic flood hotspots repeatedly identified across multiple detection methods, indicating persistent infrastructure and topographic vulnerabilities. Temporal analysis further reveals that while SWMM flooding aligns closely with rainfall peaks, 311 calls typically precede or persist beyond these peaks. Our findings emphasize the value of using satellite observations, hydrological modeling, and resident-reported data in a complementary manner to better interpret patterns in flood timing, severity, and spatial distribution—providing insights that can inform targeted infrastructure improvements and contribute to urban flood resilience planning.

311↗

HIPPO – A Software Platform for Electricity Market Research and Development

The goal of this project is to provide Regional transmission organizations (RTOs) and independent system operators (ISOs) a market design and prototyping software, High-Performance Power-Grid Optimization (HIPPO), that they can evaluate electricity market design options, calculate market planning strategies and operational performance. With the high standards and strict reliability requirements for operating power systems, impacts of new technologies need to be fully investigated prior to any consideration for adoption. A market design and prototyping software tool which can be used to prototype electricity market design options, to calculate market planning strategies and operational performance with high precision, and to investigate the impacts for integrating future power grid technologies will be valuable to RTOs/ISOs who operate power systems, to vendors like GE and ABB who provide the market solvers, and to market participants and researchers who are actively doing market research. HIPPO is a such tool that can be used to improve the current market operations and provide capabilities for rigorous forward-looking design and prototyping of next-generation energy markets. HIPPO has a high-resolution model for the day-ahead SCUC, which was validated with MISO and GE-Grid Solutions. HIPPO is built with parallel and distributed computing capabilities and can be executed in both multi-thread and high-performance computing (HPC) settings. This capability provides fast solution speed necessary to handle the larger and more complex SCUC problems of real-world cases and the potentially growing size and complexity of future scenarios. In addition, HIPPO has a concurrent optimizer (CO) which manages multiple algorithm executions simultaneously and leverages the advantages from different algorithms. This structure provides flexibility to better benchmark competing approaches. Highly accurate market model, fast solution technologies and flexible model and algorithm control are the features which will make HIPPO an extensible platform for developing and testing multiple approaches to meet a wide range of future market needs.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Sensitivity Analysis of Fluid–Fluid Interfacial Area, Phase Saturation and Phase Connectivity on Relative Permeability Estimation Using Machine Learning Algorithms

Recent studies have shown that relative permeability can be modeled as a state function which is independent of flow direction and dependent upon phase saturation (S), phase connectivity (X), and fluid–fluid interfacial area (A). This study evaluates the impact of each of the three state parameters (S, X, and A) in the estimation of relative permeability. The relative importance of the three state parameters in four separate quadrants of S-X-A space was evaluated using a machine learning algorithm (out-of-bag predictor importance method). The results show that relative permeability is sensitive to all the three parameters, S, X, and A, with varying magnitudes in each of the four quadrants at a constant value of wettability. We observe that the wetting-phase relative permeability is most sensitive to saturation, while the non-wetting phase is most sensitive to phase connectivity. Although the least important, fluid–fluid interfacial area is still important to make the relative permeability a more exact state function.

47 OTHER INSTRUMENTATION↗

Comparison of GOES16 Data with the TRACER-ESCAPE Field Campaign Dataset for Convection Characterization: A Selection of Case Studies and Lessons Learnt

Convective updrafts are one of the main characteristics of convective clouds, responsible for the convective mass flux and the redistribution of energy and condensate in the atmosphere. During the early stages of their lifecycle, convective clouds experience rapid cloud-top ascent manifested by a decrease in the geostationary IR brightness temperature (𝑇⁢𝐵 𝐼⁢𝑅 ). Under the assumption that the convective cloud top behaves like a black body, the ascent rate of the convective cloud top can be estimated as ($\frac{∂𝑇⁢𝐵_{𝐼⁢𝑅}}{∂𝑡}$), and it can be used to infer the near cloud-top convective updraft. The temporal resolution of the geostationary IR measurements and non-uniform beam-filling effects can influence the convective updraft estimation. However, the main shortcoming until today was the lack of independent verification of the strength of the convective updraft. Here, Doppler radar observations from the ESCAPE and TRACER field experiments provide independent estimates of the convective updraft velocity at higher spatiotemporal resolution throughout the convective core column and can be used to evaluate the updraft velocity estimates from the IR cooling rate for limited samples. Isolated convective cells were tracked with dedicated radar (RHIs and PPIs) scans throughout their lifecycle. Radial Doppler velocity measurements near the convective cloud top are used to provide estimates of convective updrafts. These data are compared with the geostationary IR and VIS channels (from the GOES satellite) to characterize the convection evolution and lifecycle based on cloud-top cooling rates.

TRACER/ESCAPE field campaign↗

False lock performance of quadriphase receivers

Quadriphase receivers, like biphase receivers, have the ability to false lock on a sideband on the data modulation. The theory associated with this phenomenon for receivers of binary phase-shift-keying (BPSK), using Costas loop demodulation, has recently been documented in the literature. This paper considers the corresponding theory for receivers of balanced quadriphase-shift-keying (QPSK) employing a quadriphase Costas loop (or equivalent fourth-power loop) for demodulation. Specific closed form expressions for false lock performance are developed and numerically evaluated for the particular case of single pole arm filters and an NRZ data format for each of the two statistically independent quadrature modulations.

Simon, M. K.↗

Predicting The Propagation Of Cracks

Advanced Crack Propagation Predictive Analysis Program, FLAGR04, developed as aid in predicting growth of preexisting flaws and cracks in structural components. Provides fracture-mechanics analyst with computerized method of evaluation of "safe crack-growth life" capabilities of structural components. Also used to evaluate tolerance-to-damage aspects of given structural design. Predicts growth of crack by use of two-dimensional model independently predicting growth of flaw in two directions based on calculation of stress-intensity factors. Input to FLAGR04 consists of initial definition of crack, type of rate solution, type and geometry of flaw, properties of material, data on load spectrum, load-stress functions, and design-limit stress levels. Output includes echo of input with any error or warning message and history of propagation of crack. Written in FORTRAN IV.

Tianlai, HU↗

Independent Orbiter Assessment (IOA): Analysis of the life support and airlock support subsystems

The results of the Independent Orbiter Assessment (IOA) of the Failure Modes and Effects Analysis (FMEA) and Critical Items List (CIL) are presented. The IOA approach features a top-down analysis of the hardware to determine failure modes, criticality, and potential critical items. To preserve independence, this analysis was accomplished without reliance upon the results contained within the NASA FMEA/CIL documentation. This report documents the independent analysis results corresponding to the Orbiter Life Support System (LSS) and Airlock Support System (ALSS). Each level of hardware was evaluated and analyzed for possible failure modes and effects. Criticality was assigned based upon the severity of the effect for each failure mode. The LSS provides for the management of the supply water, collection of metabolic waste, management of waste water, smoke detection, and fire suppression. The ALSS provides water, oxygen, and electricity to support an extravehicular activity in the airlock.

Arbet, Jim↗

Reliability analysis of composite structures

A probabilistic static stress analysis methodology has been developed to estimate the reliability of a composite structure. Closed form stress analysis methods are the primary analytical tools used in this methodology. These structural mechanics methods are used to identify independent variables whose variations significantly affect the performance of the structure. Once these variables are identified, scatter in their values is evaluated and statistically characterized. The scatter in applied loads and the structural parameters are then fitted to appropriate probabilistic distribution functions. Numerical integration techniques are applied to compute the structural reliability. The predicted reliability accounts for scatter due to variability in material strength, applied load, fabrication and assembly processes. The influence of structural geometry and mode of failure are also considerations in the evaluation. Example problems are given to illustrate various levels of analytical complexity.

Kan, Han-Pin↗

What the Logs Can Tell You: Mediation to Implement Feedback in Training

The problem addressed by Mediation to Implement Feedback in Training (MIFT) is to customize the feedback from training exercizes by exploiting knowledge about the training scenario, training objectives, and specific student/teacher needs. We achieve this by inserting an intelligent mediation layer into the information flow from observations collected during training exercises to the display and user interface. Knowledge about training objectives, scenarios, and tasks is maintained in the mediating layer. A designer constraint is that domain experts must be able to extend mediators by adding domain-specific knowledge that supports additional aggregations, abstractions, and views of the results of training exercises. The MIFT mediation concept is intended to be integrated with existing military training exercise management tools and reduce the cost of developing and maintaining separate feedback and evaluation tools for every training simulator and every set of customer needs. The MIFT Architecture is designed as a set of independently reusable components which interact with each other through standardized formalisms such as the Knowledge Interchange Format (KIF) and Knowledge Query and Manipulation Language (KQML).

Maluf, David↗

Computation of the Effects of Inhomogeneous Clouds on Retrieval of Remotely Sensed Properties

Current and future earth observation programs depend on satellite measurements of radiance to retrieve the properties of clouds on a global basis. At present, this retrieval is made assuming that the clouds in the instrument field of view are plane parallel and independent of adjacent pixels. While this assumption is known to be false except in very limited cases, its impact can be evaluated, and if possible corrected, based on emerging theoretical techniques. In this study, the Spherical Harmonic Discrete Ordinate Method (SHDOM, Evans, 1996) has been used to assess the sensitivity of the retrieval to a variety of cloud parameters. SHDOM allows the plane parallel assumption to be relaxed and makes 2D and even 3D radiative solutions practical. A previous study (Chambers et al., 1996) assessed the effect of horizontal inhomogeneity in 45 LANDSAT scenes of boundary layer clouds over ocean. The four scenes studied here represent overcast, broken, scattered and strongly thermally forced cloud fields and are used to perform sensitivity studies to a wider variety of parameters. Comparisons are made at three solar zenith angles (theta (sub 0) = 0, 49, and 63 degrees) to avoid ambiguity in the results due to solar zenith angle.

Chambers, Lin H.↗

Uncertainty Analysis for a Jet Flap Airfoil

An analysis of variance (ANOVA) study was performed to quantify the potential uncertainties of lift and pitching moment coefficient calculations from a computational fluid dynamics code, relative to an experiment, for a jet flap airfoil configuration. Uncertainties due to a number of factors including grid density, angle of attack and jet flap blowing coefficient were examined. The ANOVA software produced a numerical model of the input coefficient data, as functions of the selected factors, to a user-specified order (linear, 2-factor interference, quadratic, or cubic). Residuals between the model and actual data were also produced at each of the input conditions, and uncertainty confidence intervals (in the form of Least Significant Differences or LSD) for experimental, computational, and combined experimental / computational data sets were computed. The LSD bars indicate the smallest resolvable differences in the functional values (lift or pitching moment coefficient) attributable solely to changes in independent variable, given just the input data points from selected data sets. The software also provided a collection of diagnostics which evaluate the suitability of the input data set for use within the ANOVA process, and which examine the behavior of the resultant data, possibly suggesting transformations which should be applied to the data to reduce the LSD. The results illustrate some of the key features of, and results from, the uncertainty analysis studies, including the use of both numerical (continuous) and categorical (discrete) factors, the effects of the number and range of the input data points, and the effects of the number of factors considered simultaneously.

Green, Lawrence L.↗

Evaluation ofthe Middle East and North Africa Land Data Assimilation System

The Middle East and North Africa (MENA) region is dominated by dry, warm deserts, areas of dense population, and inefficient use of fresh water resources. Due to the scarcity, high intensity, and short duration of rainfall in the MENA, the region is prone to hydro climatic extremes that are realized by devastating floods and times of drought. However, given its widespread water stress and the considerable demand for water, the MENA remains relatively poorly monitored. This is due in part to the shortage of meteorological observations and the lack of data sharing between nations. As a result, the accurate monitoring of the dynamics of the water cycle in the MENA is difficult. The Land Data Assimilation System for the MENA region (MENA LDAS) has been developed to provide regional, gridded fields of hydrological states and fluxes relevant for water resources assessments. As an extension of the Global Land Data Assimilation System (GLDAS), the MENA LDAS was designed to aid in the identification and evaluation of regional hydrological anomalies by synergistically combining the physically-based Catchment Land Surface Model (CLSM) with observations from several independent data products including soil-water storage variations from the Gravity Recovery and Climate Experiment (GRACE) and irrigation intensity derived from the Moderate Resolution Imaging Spectroradiometer (MODIS). In this fashion, we estimate the mean and seasonal cycle of the water budget components across the MENA.

Bolten, John D.↗

Human Integration Design Processes (HIDP)

The purpose of the Human Integration Design Processes (HIDP) document is to provide human-systems integration design processes, including methodologies and best practices that NASA has used to meet human systems and human rating requirements for developing crewed spacecraft. HIDP content is framed around human-centered design methodologies and processes in support of human-system integration requirements and human rating. NASA-STD-3001, Space Flight Human-System Standard, is a two-volume set of National Aeronautics and Space Administration (NASA) Agency-level standards established by the Office of the Chief Health and Medical Officer, directed at minimizing health and performance risks for flight crews in human space flight programs. Volume 1 of NASA-STD-3001, Crew Health, sets standards for fitness for duty, space flight permissible exposure limits, permissible outcome limits, levels of medical care, medical diagnosis, intervention, treatment and care, and countermeasures. Volume 2 of NASASTD- 3001, Human Factors, Habitability, and Environmental Health, focuses on human physical and cognitive capabilities and limitations and defines standards for spacecraft (including orbiters, habitats, and suits), internal environments, facilities, payloads, and related equipment, hardware, and software with which the crew interfaces during space operations. The NASA Procedural Requirements (NPR) 8705.2B, Human-Rating Requirements for Space Systems, specifies the Agency's human-rating processes, procedures, and requirements. The HIDP was written to share NASA's knowledge of processes directed toward achieving human certification of a spacecraft through implementation of human-systems integration requirements. Although the HIDP speaks directly to implementation of NASA-STD-3001 and NPR 8705.2B requirements, the human-centered design, evaluation, and design processes described in this document can be applied to any set of human-systems requirements and are independent of reference missions. The HIDP is a reference document that is intended to be used during the development of crewed space systems and operations to guide human-systems development process activities.

Boyer, Jennifer↗

Stochastic-Strength-Based Damage Simulation Tool for Ceramic Matrix and Polymer Matrix Composite Structures

Stochastic-based, discrete-event progressive damage simulations of ceramic-matrix composite and polymer matrix composite material structures have been enabled through the development of a unique multiscale modeling tool. This effort involves coupling three independently developed software programs: (1) the Micromechanics Analysis Code with Generalized Method of Cells (MAC/GMC), (2) the Ceramics Analysis and Reliability Evaluation of Structures Life Prediction Program (CARES/ Life), and (3) the Abaqus finite element analysis (FEA) program. MAC/GMC contributes multiscale modeling capabilities and micromechanics relations to determine stresses and deformations at the microscale of the composite material repeating unit cell (RUC). CARES/Life contributes statistical multiaxial failure criteria that can be applied to the individual brittle-material constituents of the RUC. Abaqus is used at the global scale to model the overall composite structure. An Abaqus user-defined material (UMAT) interface, referred to here as "FEAMAC/CARES," was developed that enables MAC/GMC and CARES/Life to operate seamlessly with the Abaqus FEA code. For each FEAMAC/CARES simulation trial, the stochastic nature of brittle material strength results in random, discrete damage events, which incrementally progress and lead to ultimate structural failure. This report describes the FEAMAC/CARES methodology and discusses examples that illustrate the performance of the tool. A comprehensive example problem, simulating the progressive damage of laminated ceramic matrix composites under various off-axis loading conditions and including a double notched tensile specimen geometry, is described in a separate report.

composite structures↗

Pilot Evaluation of a UAS Detect-and-Avoid System's Effectiveness in Remaining Well Clear

Unmanned aircraft will equip with a detect-and-avoid (DAA) system that allows them to comply with the requirement to see and avoid other aircraft, an important layer in the overall set of procedural, strategic and tactical separation methods designed to prevent mid-air collisions. Although the effectiveness of the DAA system will be set to a minimum threshold by regulators, different combinations of algorithms, displays and procedures could be used to meet that minimum. The research presented in this paper indicates the effectiveness of the combined pilot-DAA system as a function of the DAA design requirements and provides data that may be used to model the behavior of pilots when employing such systems. Over the course of two simulations 21 professional UAS pilots evaluated eight different DAA system designs and metrics were collected on their ability to maintain the well clear separation standard. The independent variables were the time horizon at which pilots were alerted to potential losses of well clear, the location of the traffic display, and the tools and informational elements available on the display to aid the pilot in detecting and resolving those potential losses. In the second experiment the UAS encountered two categories of aircraft: those equipped with simulated transponders that could be seen dozens of miles away and those without that were only detectable by a simulated radar within a range of six nautical miles. The data indicate that integrating the traffic display with the primary mission map directly in front of the pilot reduced the frequency of losses of well clear. Improved detection and resolution tools, including explicit maneuver guidance and a trial planning capability, had less of an effect in reducing the frequency of losses but significantly reduced the time in loss when they occurred. The amount of warning time provided to the pilot had a strong effect on their ability to remain well clear: when alerts were first presented with less than about 15 seconds to a predicted loss of well clear pilots were able to maneuver successfully in only 26 percent of encounters, whereas they were about 83 percent successful when they had more than 15 seconds. Pilots' ability to separate from the two categories of aircraft was nearly the same after accounting for the amount of alert time provided in each encounter, although the limited surveillance volume for the non-transponder equipped aircraft meant alerts tended to occur later and therefore were more difficult to resolve.

loss of well clear↗

Lost and Found Opportunities Around the Chlorine Worth Study

Los Alamos National Laboratory performed a series of critical experiments in 2021 to examine the worth of chlorine in plutonium-fueled systems. This series of experiments has been dubbed the “Chlorine Worth Study,” and the evaluation of the experiments was presented to the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Technical Review Group in April, 2023. The primary purpose of these experiments was to enable validation of aqueous solutions crediting neutron absorption in 35 Cl. An external, independent view of the events leading up to the design and execution of these experiments indicates a missed opportunity to leverage sensitivity/uncertainty (S/U) analysis to assert validation without the experiments by taking an additional margin for the lack of direct validation of chlorine. On the other hand, the execution of these experiments also presents a rare opportunity to examine the efficacy of the S/U approach and extract useful information about the evaluated chlorine covariance data. TSUNAMI-1D models of representative application solutions were created and used to generate sensitivity data. Varying plutonium and chlorine concentrations were considered to examine the impact of these differences on the chlorine sensitivities and uncertainties. The data-induced uncertainty in k eff resulting from chlorine was calculated directly from uncertainty information calculated in the TSUNAMI-1D sequence. In all cases, this uncertainty was less than 0.1 %Δk. This result could potentially be used to justify a reactivity margin to account for the validation gap related to chlorine in the validation set. On the other hand, given that the experiments were performed, the community should endeavor to extract as much value from them and their results as possible. The results can be used to examine the actual bias associated with chlorine in these systems once the evaluations have been released. These data can be compared with the data-induced uncertainty margin discussed above to test the sufficiency of the validation gap penalty. This result will provide an indication of the performance of the chlorine covariance data specifically and the S/U validation approach generally. More advanced S/U techniques may also be employed to determine reactivity sensitivities associated with the chlorine in the experiments, potentially generating a more robust test of the chlorine covariance data.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Alternating Conditional Expectations: Introducing a Non‐Parametric Statistical Method to Interpret Long‐Term Greenhouse Gas Flux Measurements Over Semi‐Arid and Wetland Ecosystems

Abstract We explore the potential of using a non‐parametric statistical method called Alternating Conditional Expectations, ACE, to quantify functional relationships in biogeosciences. Here, ACE is used to quantify the non‐linear and multi‐faceted responses of greenhouse gas fluxes to a set of biophysical forcings, when the shapes of those response surfaces are unknown. We evaluated the statistical method over two contrasting ecosystems and two contrasting time steps. One case involved quantifying the biophysical controls of water vapor and carbon dioxide (CO 2 ) fluxes over a semi‐arid oak savanna using daily integrated fluxes. The other case evaluated the responses of CO 2 and methane (CH 4 ) flux measurements to a set of biophysical forcings at a restored tidal wetland using thirty‐minute averages. The statistical model, based on 4 independent variables, explained up over 90% of the variation in daily integrated flux densities of water vapor and net carbon dioxide exchange at the savanna site. This fit was defined by distinct non‐linear responses to such drivers as gross primary production, photosynthetically active radiation, air temperature, vapor pressure deficit and soil moisture. At the tidal wetland site, we evaluated net carbon dioxide and methane fluxes with short‐term measurements to capture the influence of rising and falling tides and seasonality in biological activity. The statistical model defined the shape of the forcing of fluxes due to the roles of carbon exudates, water table depth, oxygen level in the water column, temperature and vegetation status. The statistical fits of the greenhouse gas fluxes were less precise than the savanna case. The fetch varies on a run‐to‐run basis as it is comprised of a heterogeneous mosaic of open water and vegetation. Furthermore, it is difficult to monitor the environmental conditions of the archaea and bacteria in the sediments that produce methane and carbon dioxide.

Environmental Sciences & Ecology↗

Simulation Evaluation of Synthetic Vision as an Enabling Technology for Equivalent Visual Operations

Enhanced Vision (EV) and synthetic vision (SV) systems may serve as enabling technologies to meet the challenges of the Next Generation Air Transportation System (NextGen) Equivalent Visual Operations (EVO) concept ? that is, the ability to achieve or even improve on the safety of Visual Flight Rules (VFR) operations, maintain the operational tempos of VFR, and even, perhaps, retain VFR procedures independent of actual weather and visibility conditions. One significant challenge lies in the definition of required equipage on the aircraft and on the airport to enable the EVO concept objective. A piloted simulation experiment was conducted to evaluate the effects of the presence or absence of Synthetic Vision, the location of this information during an instrument approach (i.e., on a Head-Up or Head-Down Primary Flight Display), and the type of airport lighting information on landing minima. The quantitative data from this experiment were analyzed to begin the definition of performance-based criteria for all-weather approach and landing operations. Objective results from the present study showed that better approach performance was attainable with the head-up display (HUD) compared to the head-down display (HDD). A slight performance improvement in HDD performance was shown when SV was added, as the pilots descended below 200 ft to a 100 ft decision altitude, but this performance was not tested for statistical significance (nor was it expected to be statistically significant). The touchdown data showed that regardless of the display concept flown (SV HUD, Baseline HUD, SV HDD, Baseline HDD) a majority of the runs were within the performance-based defined approach and landing criteria in all the visibility levels, approach lighting systems, and decision altitudes tested. For this visual flight maneuver, RVR appeared to be the most significant influence in touchdown performance. The approach lighting system clearly impacted the pilot's ability to descend to 100 ft height above touchdown based on existing Federal Aviation Regulation (FAR) 91.175 using a 200 ft decision height, but did not appear to influence touchdown performance or approach path maintenance

Kramer, Lynda J.↗