SEARCH · Engineering Papers

Results for “independent evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

All sources NASA NTRS DOE OSTI

NASA NTRS2013

Evaluating Global Emission Inventories of Biogenic Bromocarbons

Emissions of halogenated very short-lived substances (VSLS) are poorly constrained. However, their inclusion in global models is required to simulate a realistic inorganic bromine (Bry) loading in both the troposphere, where bromine chemistry perturbs global oxidizing capacity, and in the stratosphere, where it is a major sink for ozone (O3). We have performed simulations using a 3-D chemical transport model (CTM) including three top-down and a single bottom-up derived emission inventory of the major brominated VSLS bromoform (CHBr3) and dibromomethane (CH2Br2). We perform the first concerted evaluation of these inventories, comparing both the magnitude and spatial distribution of emissions. For a quantitative evaluation of each inventory, model output is compared with independent long-term observations at National Oceanic and Atmospheric Administration (NOAA) ground-based stations and with aircraft observations made during the NSF (National Science Foundation) HIAPER Pole-to-Pole Observations (HIPPO) project. For CHBr3, the mean absolute deviation between model and surface observation ranges from 0.22 (38 %) to 0.78 (115 %) parts per trillion (ppt) in the tropics, depending on emission inventory. For CH2Br2, the range is 0.17 (24 %) to 1.25 (167 %) ppt. We also use aircraft observations made during the 2011 Stratospheric Ozone: Halogen Impacts in a Varying Atmosphere (SHIVA) campaign, in the tropical western Pacific. Here, the performance of the various inventories also varies significantly, but overall the CTM is able to reproduce observed CHBr3 well in the free troposphere using an inventory based on observed sea-to-air fluxes. Finally, we identify the range of uncertainty associated with these VSLS emission inventories on stratospheric bromine loading due to VSLS (Br(VSLS/y)). Our simulations show Br(VSLS/y) ranges from approximately 4.0 to 8.0 ppt depending on the inventory. We report an optimized estimate at the lower end of this range (approximately 4 ppt) based on combining the CHBr3 and CH2Br2 inventories which give best agreement with the compilation of observations in the tropics.

bromocarbons↗

NASA NTRS2016

Using High-Resolution Airborne Remote Sensing to Study Aerosol Near Clouds

The horizontal space in between clear and cloudy air is very complex. This so-called twilight zone includes activated aerosols that are not quite clouds, thin cloud fragments that are not easily observable, and dying clouds that have not quite disappeared. This is a huge challenge for satellite remote sensing, specifically for retrieval of aerosol properties. Identifying what is cloud versus what is not cloud is critically important for attributing radiative effects and forcings to aerosols. At the same time, the radiative interactions between clouds and the surrounding media (molecules, surface and aerosols themselves) will contaminate retrieval of aerosol properties, even in clear skies. Most studies on aerosol cloud interactions are relevant to moderate resolution imagery (e.g. 500 m) from sensors such as MODIS. Since standard aerosol retrieval algorithms tend to keep a distance (e.g. 1 km) from the nearest detected cloud, it is impossible to evaluate what happens closer to the cloud. During Studies of Emissions, Atmospheric Composition, Clouds and Climate Coupling by Regional Surveys (SEAC4RS), the NASA ER-2 flew with the enhanced MODIS Airborne Simulator (eMAS), providing MODIS-like spectral observations at high (50 m) spatial resolution. We have applied MODIS-like aerosol retrieval for the eMAS data, providing new detail to characterization of aerosol near clouds. Interpretation and evaluation of these eMAS aerosol retrievals is aided by independent MODIS-like cloud retrievals, as well as profiles from the co-flying Cloud Physics Lidar (CPL). Understanding aerosolcloud retrieval at high resolution will lead to better characterization and interpretation of long-term, global products from lower resolution (e.g.MODIS) satellite retrievals.

aerosols near clouds↗

NASA NTRS2017

Manned Versus Unmanned Risk and Complexity Considerations for Future Midsized X-Planes

The objective of this work was to identify and estimate complexity and risks associated with the development and testing of new low-cost medium-scale X-plane aircraft primarily focused on air transport operations. Piloting modes that were evaluated for this task were manned, remotely piloted, and unmanned flight research programs. This analysis was conducted early in the data collection period for X-plane concept vehicles before preliminary designs were complete. Over 50 different aircraft and system topics were used to evaluate the three piloting control modes. Expert group evaluations from a diverse set of pilots, engineers, and other experts at Aeronautics Research Mission Directorate centers within the National Aeronautics and Space Administration provided qualitative reasoning on the many issues surrounding the decisions regarding piloting modes. The group evaluations were numerically rated to evaluate each topic quantitatively and were used to provide independent criteria for vehicle complexity and risk. An Edwards Air Force Base instruction document was identified that emerged as a source of the effects found in our qualitative and quantitative data. The study showed that a manned aircraft was the best choice to align with test activities for transport aircraft flight research from a low-complexity and low-risk perspective. The study concluded that a manned aircraft option would minimize the risk and complexity to improve flight-test efficiency and bound the cost of the flight-test portion of the program. Several key findings and discriminators between the three modes are discussed in detail.

x-planes↗

NASA NTRS2017

Manned Versus Unmanned Risk and Complexity Considerations for Future Midsized X-Planes

quanitive analysis↗

NASA NTRS2023

The Atacama Cosmology Telescope: Map-Based Noise Simulations for DR6

The increasing statistical power of cosmic microwave background (CMB) datasets requires a commensurate effort in understanding their noise properties. The noise in maps from ground-based instruments is dominated by large-scale correlations, which poses a modeling challenge. This paper develops novel models of the complex noise covariance structure in the Atacama Cosmology Telescope Data Release 6 (ACT DR6) maps. We first enumerate the noise properties that arise from the combination of the atmosphere and the ACT scan strategy. We then prescribe a class of Gaussian, map-based noise models, including a new wavelet-based approach that uses directional wavelet kernels for modeling correlated instrumental noise. The models are empirical, whose only inputs are a small number of independent realizations of the same region of sky. We evaluate the performance of these models against the ACT DR6 data by drawing ensembles of noise realizations. Applying these simulations to the ACT DR6 power spectrum pipeline reveals a ≥ 20% excess in the covariance matrix diagonal when compared to an analytic expression that assumes noise properties are uniquely described by their power spectrum. Along with our public code, mnms, this work establishes a necessary element in the science pipelines of both ACT DR6 and future ground-based CMB experiments such as the Simons Observatory (SO).

CMBR experiments↗

NASA NTRS2018

The Evaluation of Cryogenic Force Balance Calibration Methodologies with Respect to Wind Tunnel Results

Independent tests of the NASA Common Research Model (CRM) at NASA's National Transonic Facility (NTF) and the European Transonic Windtunnel (ETW) revealed discrepancies at low operating temperatures and high Reynolds numbers that warranted further investigation. Since each facility used their own force balance for their tunnel entry, one suggestion for the discrepancy was the temperature compensation methodology developed and applied for each balance. This hypothesis is explored through simulation and experimentally. Independent calibrations of NASA's NTF-118A balance at NASA Langley and ETW reveal discrepancies in the thermal compensation of the normal force and pitching moment primary sensitivities with temperature, while the axial force primary sensitivities are in good agreement. The application of the force balance calibrations performed at NASA and ETW to the prior wind tunnel data suggests that the thermal compensation discrepancies are an order of magnitude less than the discrepancies observed between the wind tunnel aerodynamic coefficients.

Burns, Devin E.↗

NASA NTRS1997

PSP Testing at NASA Ames Research Center

Pressure sensitive paints (PSPs) are now used routinely for measuring surface pressures on wind tunnel models at transonic and supersonic Mach numbers. The method utilizes a surface coating containing fluorescent or phosphorescent materials, the brightness of which varies with the local air pressure on the surface. The present paper will summarize PSP activities (in progress and planned) at the NASA Ames Research Center. One of the main accomplishments at NASA Ames has been the development of a PSP measurement system that is production testing capable. This system has been integrated successfully into the large-scale wind tunnel facilities at Ames. There are several problems related to PSP testing which are unique to large-scale wind tunnel testing. The hardware is often difficult to set-up and must operate under harsh conditions (e.g. high pressures and low temperatures). The data acquisition and reduction times need to be kept to a minimum so that the overall wind tunnel productivity is not compromised. The pressure sensitive paints needs to be very robust; the paints must readily adhere to different surfaces with varying geometries and remain functional for long running times. The paint must have well understood, and preferably minimal, temperature sensitivity since fine control of the tunnel temperature is not easily achievable in the larger wind tunnels. In an effort to improve the overall accuracy of the PSP technique, we are currently evaluating some referenced pressure sensitive paints which contain a pressure- independent luminophor in addition to the one which is affected by the surface pressure. The two luminophors are chosen so that their emission wavelengths are somewhat different. Then by taking two 'wind-on' images with either two cameras (with different filters) or one camera with a rotating filter system, the need for 'wind-off' images can be eliminated. The ratio of the two wind-on images accounts for nonuniform lighting and model motion problems (physical movement of the model under aerodynamic loading) are not a concern any more. The paints and data acquisition and reduction software for this type of a PSI system are currently under development and evaluation. Additional information is contained within the original extended abstract.

Bell, J. H.↗

NASA NTRS1991

Parallel algorithms for placement and routing in VLSI design

The computational requirements for high quality synthesis, analysis, and verification of very large scale integration (VLSI) designs have rapidly increased with the fast growing complexity of these designs. Research in the past has focused on the development of heuristic algorithms, special purpose hardware accelerators, or parallel algorithms for the numerous design tasks to decrease the time required for solution. Two new parallel algorithms are proposed for two VLSI synthesis tasks, standard cell placement and global routing. The first algorithm, a parallel algorithm for global routing, uses hierarchical techniques to decompose the routing problem into independent routing subproblems that are solved in parallel. Results are then presented which compare the routing quality to the results of other published global routers and which evaluate the speedups attained. The second algorithm, a parallel algorithm for cell placement and global routing, hierarchically integrates a quadrisection placement algorithm, a bisection placement algorithm, and the previous global routing algorithm. Unique partitioning techniques are used to decompose the various stages of the algorithm into independent tasks which can be evaluated in parallel. Finally, results are presented which evaluate the various algorithm alternatives and compare the algorithm performance to other placement programs. Measurements are presented on the parallel speedups available.

Brouwer, Randall Jay↗

NASA NTRS2019

Structural Dynamic Testing Results for Air-Independent Proton Exchange Membrane (PEM) Fuel Cell Technologies for Space Applications

In 2016, the NASA Advanced Exploration Systems (AES) project office funded research at the NASA Glenn Research Center to evaluate the maturity of the Proton Exchange Membrane (PEM) fuel cell technology and its viability for supporting launch vehicle and space applications. This technology evaluation included vibration, reactant purity, and vacuum exposure sensitivity testing. The evaluation process did not include microgravity testing. This paper discusses the vibration sensitivity testing of two air-independent fuel cell stacks provided by different vendors to assess the ability of currently available fuel cell stack hardware to survive the projected random vibrational environment that would be encountered in an upper stage launch vehicle. Baseline performance testing was utilized to quantify stack performance and overboard leak rate at standard atmospheric conditions in order to provide a reference for post-test comparison. Both fuel cell stacks were tested at a random vibration qualification level of 10.4 grms for five minutes in each axis. Low-level sinusoidal sweeps were conducted before and after each random vibration level run to see if any significant change in resonances were detected. Following vibration facility testing, the baseline performance testing was repeated. Test results demonstrated no measurable change in fuel cell electrochemical or mechanical performance, indicating that the two evaluated PEM fuel cell stacks may be suitable for space applications pending microgravity testing.

Gilligan, Ryan P.↗

DOE OSTI2020

Validation and Independent Uncertainty Analysis of the MIX-SOL-THERM-003 ICSBEP Benchmark

The International Criticality Safety Benchmark Evaluation Project (ICSBEP) was started in 1992 by the United States Department of Energy and later in 1995 became an international project with contributions from 22 countries. The project is now organized by the OECD (Organisation for Economic Co-operation and Development) Nuclear Energy Agency (NEA). In its most recent iteration, the ICSBEP handbook contains over five thousand evaluations of critical, near-critical, and subcritical experiments conducted in facilities all around the world. These benchmarks serve as valuable information for criticality safety engineers who can use them to validate calculation techniques and establish minimum subcritical margins for operations with fissionable materials. The benchmarks in the handbook are categorized by their fissile material composition, material form (oxide, solution, or metal), and fission energy spectra. This is especially useful for those looking for benchmarks similar to a system they are working on to compare methods and identify trends. The ICSBEP Handbook Uncertainty Guide is document outlining recommended practices and methods for determining uncertainties in these benchmarks. Quantifying these uncertainties thoroughly is crucial as it allows a higher degree of confidence that data used from them is valid and relevant. The guide stresses the importance of a thorough and well documented uncertainty analysis when evaluating an experiment. All measured values of a system, whether they be dimensions or material compositions, have a certain amount of uncertainty associated with them and can be analyzed one by one to determine their effects on the system. Many evaluated benchmarks in the handbook present this in detail, however some do not, mostly earlier evaluations performed in the 1990’s and early 2000’s. Recently at Los Alamos National Laboratory (LANL), the Nuclear Criticality Safety Division (NCSD) of LANL has been validating MCNP6.2 ® input files of criticality benchmarks for use by Whisper, a criticality safety code developed at LANL. This effort is also part of the OECD NEA Working Party on International Nuclear Data Evaluation Co-operation (WPEC) Subgroup 45, also known as Validation of Nuclear Data Libraries (VaNDaL). The goal of VaNDaL is to compile a set of validated simulation inputs for use in validating nuclear data and simulation codes. As part of these efforts, one of the benchmarks reviewed was the MIX SOL-THERM-003 ICSBEP benchmark. This paper provides an independent uncertainty analysis of this benchmark experiment.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

NASA NTRS2016

Space Suit Portable Life Support System (PLSS) 2.0 Pre-Installation Acceptance (PIA) Testing

Following successful completion of the space suit Portable Life Support System (PLSS) 1.0 development and testing in 2011, the second system-level prototype, PLSS 2.0, was developed in 2012 to continue the maturation of the advanced PLSS design. This advanced PLSS is intended to reduce consumables, improve reliability and robustness, and incorporate additional sensing and functional capabilities over the current Space Shuttle/International Space Station Extravehicular Mobility Unit (EMU) PLSS. PLSS 2.0 represents the first attempt at a packaged design comprising first generation or later component prototypes and medium fidelity interfaces within a flight-like representative volume. Pre-Installation Acceptance (PIA) is carryover terminology from the Space Shuttle Program referring to the series of test sequences used to verify functionality of the EMU PLSS prior to installation into the Space Shuttle airlock for launch. As applied to the PLSS 2.0 development and testing effort, PIA testing designated the series of 27 independent test sequences devised to verify component and subsystem functionality, perform in situ instrument calibrations, generate mapping data, define set-points, evaluate control algorithms, evaluate hardware performance against advanced PLSS design requirements, and provide quantitative and qualitative feedback on evolving design requirements and performance specifications. PLSS 2.0 PIA testing was carried out in 2013 and 2014 using a variety of test configurations to perform test sequences that ranged from stand-alone component testing to system-level testing, with evaluations becoming increasingly integrated as the test series progressed. Each of the 27 test sequences was vetted independently, with verification of basic functionality required before completion. Because PLSS 2.0 design requirements were evolving concurrently with PLSS 2.0 PIA testing, the requirements were used as guidelines to assess performance during the tests; after the completion of PIA testing, test data served to improve the fidelity and maturity of design requirements as well as plans for future advanced PLSS functional testing.

Anchondo, Ian↗

DOE OSTI2022

A Robust Neural Network for Extracting Dynamics from Electrostatic Force Microscopy Data

Advances in scanning probe microscopy (SPM) methods such as time-resolved electrostatic force microscopy (trEFM) now permit the mapping of fast local dynamic processes with high resolution in both space and time, but such methods can be time-consuming to analyze and calibrate. Here, we design and train a regression neural network (NN) that accelerates and simplifies the extraction of local dynamics from SPM data directly in a cantilever-independent manner, allowing the network to process data taken with different cantilevers. We validate the NN’s ability to recover local dynamics with a fidelity equal to or surpassing conventional, more time-consuming, calibrations using both simulated and real microscopy data. We apply this method to extract accurate photoinduced carrier dynamics on n = 1 butylammonium lead iodide, a halide perovskite semiconductor film that is of interest for applications in both solar photovoltaics and quantum light sources. Lastly, we use SHapley Additive exPlanations to evaluate the robustness of the trained model, confirm its cantilever-independence, and explore which parts of the trEFM signal are important to the network.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2025

Vexcel Imaging's Suitability for Automatic Verification

Accurate, independently verified geospatial data is essential for automated calibration, validation, and operational decision-making. This study evaluated the positional accuracy of Vexcel Imaging™’s UltraCam® Osprey imagery (7.5 cm GSD) using globally distributed Continuously Operating Reference Stations (CORS) as independent control. Despite manufacturer claims of 15 cm horizontal accuracy, residual errors were consistently one to two orders of magnitude larger, with no subset of imagery meeting precision thresholds. These discrepancies cannot be explained by normal photogrammetric or environmental factors and raise concerns about the reliability of the imagery for high-precision tasks. The results demonstrate that Vexcel imagery, in its current form, is unsuitable for workflows requiring rigorous spatial accuracy or automated verification. At the same time, the reproducible validation framework developed in this study establishes a scalable method for assessing commercial imagery, ensuring that future products can be independently and objectively verified before operational adoption.

47 OTHER INSTRUMENTATION↗

DOE OSTI2025

Response of Atmospheric River Width and Intensity to Aquaplanet Warming: A Detection Algorithm‐ and Background Moisture‐Independent Approach

The width of an atmospheric river (AR) is an important parameter when evaluating its impact. Although previous research suggests ARs will widen with global warming, a precise response has been muddled by the large sensitivity of width to a diverse set of AR detection techniques (ARDTs). Here, we propose a methodology that removes the influence of the ARDT by modeling AR‐integrated vapor transport (IVT) profiles as idealized exponential curves with free parameters given by background IVT, intensity above background IVT, and profile width. Notably, our definition for AR profile width does not include any explicit numerical thresholds, relative or absolute, for IVT. We apply our approach to a series of idealized aquaplanet experiments, first with a baseline sea surface temperature (SST) distribution, and then with +2K, +4K, and +6K uniform warming, so as to determine the contributions of each free parameter to AR width. We also apply our approach to high‐resolution atmosphere‐only models forced with SSTs modified to preserve historical variability but following projected warming over 2016–2050. Our results show that contributions to impacts‐relevant AR widening comes primarily from enhancements in background IVT and AR intensity, as opposed to from dynamic width changes.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Development of aerosol activation in the double-moment Unified Model and evaluation with CLARIFY measurements

Representing the number and mass of cloud and aerosol particles independently in a climate, weather prediction or air quality model is important in order to simulate aerosol direct and indirect effects on radiation balance. Here we introduce the first configuration of the UK Met Office Unified Model in which both cloud and aerosol particles have “double-moment” representations with prognostic number and mass. The GLObal Model of Aerosol Processes (GLOMAP) aerosol microphysics scheme, already used in the Hadley Centre Global Environmental Model version 3 (HadGEM3) climate configuration, is coupled to the Cloud AeroSol Interacting Microphysics (CASIM) cloud microphysics scheme. We demonstrate the performance of the new configuration in high-resolution simulations of a case study defined from the CLARIFY aircraft campaign in 2017 near Ascension Island in the tropical southern Atlantic. We improve the physical basis of the activation scheme by representing the effect of existing cloud droplets on the activation of new aerosol, and we also discuss the effect of unresolved vertical velocities. We show that neglect of these two competing effects in previous studies led to compensating errors but realistic droplet concentrations. While these changes lead only to a modest improvement in model performance, they reinforce our confidence in the ability of the model microphysics code to simulate the aerosol–cloud microphysical interactions it was designed to represent. Capturing these interactions accurately is critical to simulating aerosol effects on climate.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS1975

Analytical evaluation of ILM sensors. Volume 2: Appendices

The applicability of various sensing concepts to independent landing monitor systems was analyzed. Microwave landing system MLS accuracy requirements are presented along with a description of MLS airborne equipment. Computer programs developed during the analysis are described and include: a mathematical computer model for use in the performance assessment of reconnaissance sensor systems; a theoretical formulation of electromagnetic scattering to generate data at high incidence angles; atmospheric attenuation of microwaves; and microwave radiometry, programs

Kirk, R. J.↗

DOE OSTI2025

Determination of Constraint-Independent Crack Tip Opening Angle for Stable Crack Growth in High-Strength Ductile Steels

The crack tip opening angle (CTOA) is one of fracture toughness parameters that has been used for decades in describing large stable crack growth in thin-walled aerospace structures under the low-constraint conditions. Recently, the pipeline industry has developed a growing interest in using the CTOA parameter to serve as the minimum required fracture toughness to arrest dynamic crack propagation in modern gas transmission pipelines made of high-strength ductile steel. To meet this industrial need, the CTOA test standard ASTM E3039 was therefore developed for measuring the constant critical CTOA. ASTM E3039 recommends a drop weight tearing test (DWTT) specimen with a shallow crack for standard CTOA testing, but its CTOA may depend on the low constraint condition of the DWTT specimen at the crack tip. Verifying the constraint independence of the DWTT-measured CTOA thus becomes indispensable for applying CTOA toughness to the running fracture control in the pipeline design. For this purpose, the present paper evaluates critical CTOA values in a set of fracture toughness tests on single-edge notched bend (SENB) specimens with shallow and deep cracks, based on four CTOA estimation models. Among these, the Ln(P)-LLD linear fit model is similar to that recommended by ASTM E3039 for CTOA calculation. Fracture test data for X80 pipeline steel and HY80 structural steel were considered in the CTOA evaluation. The results showed that the four CTOA models were able to determine a constraint independent CTOA value for stable crack growth in the SENB specimens. As a result, a single, reliable, constant CTOA value could be determined regardless of the specimen geometry or the crack-tip constraint conditions. Therefore, the CTOA measured using ASTM E3039 is constraint-independent and transferable to use in cases of actual cracks propagating in gas transmission pipelines.

36 MATERIALS SCIENCE↗

DOE OSTI2024

Implementation of a realistic artificial data generator for crash data generation

In this paper, a framework is outlined to generate realistic artificial data (RAD) as a tool for comparing different models developed for safety analysis. The primary focus of transportation safety analysis is on identifying and quantifying the influence of factors contributing to traffic crash occurrence and its consequences. The current framework of comparing model structures using only observed data has limitations. With observed data, it is not possible to know how well the models mimic the true relationship between the dependent and independent variables. Further, real datasets do not allow researchers to evaluate the model performance for different levels of complexity of the dataset. RAD offers an innovative framework to address these limitations. Hence, we propose a RAD generation framework embedded with heterogeneous causal structures that generates crash data by considering crash occurrence as a trip level event impacted by trip level factors, demographics, roadway and vehicle attributes. Within our RAD generator we employ three specific modules: (a) disaggregate trip information generation, (b) crash data generation and (c) crash data aggregation. For disaggregate trip information generation, we employ a daily activity-travel realization for an urban region generated from an established activity-based model for the Chicago region. We use this data of more than 2 million daily trips to generate a subset of trips with crash data. For trips with crashes crash location, crash type, driver/vehicle characteristics, and crash severity. The daily RAD generation process is repeated for generating crash records at yearly or multi-year resolution. In conclusion, the crash databases generated can be employed to compare frequency models, severity models, crash type and various other dimensions by facility type - possibly establishing a universal benchmarking system for alternative model frameworks in safety literature.

42 ENGINEERING↗