Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS1974

Evaluation program for secondary spacecraft cells: Initial evaluation tests of General Electric Company 6.0 ampere hour nickel-cadmium spacecraft cells with auxiliary electrodes for the atmospheric Explorer satellite C and D

The capacity of the cells ranged from 6.6 to 7.6 ampere hours during the three capacity tests. No voltage requirements or limits were exceeded during any portion of the test. All cells recovered to a voltage in excess of 1.193 volts during the 24-hour open-circuit portion of the internal short test. All the cells reached a pressure of 20 psia before reaching the voltage limit of 1.550 volts during the pressure versus capacity test. The average ampere/hours in and voltages at this pressure were 9.1 and 1.513, respectively. All cells exhibited pressure decay in the range of 1 to 5 psia during the last 30 minutes of the 1-hour open circuit stand. Average capacity out was 7.2 ampere/hours.

Harkness, J. D.↗
NASA NTRS1974

Noncircular orifice holes and advanced fabrication techniques for liquid rocket injectors. Phase 3: Analytical and cold-flow experimental evaluation of rectangular concentric tube injector elements for gas/liquid application. Phase 4: Analytical and experimental evaluation of noncircular injector elements for gas/liquid and liquid/liquid application

Results are presented of a cold-flow and hot-fire experimental study of the mixing and atomization characteristics of injector elements incorporating noncircular orifices. Both liquid/liquid and gas/liquid element types are discussed. Unlike doublet and triplet elements (circular orifices only) were investigated for the liquid/liquid case while concentric tube elements were investigated for the gas/liquid case. It is concluded that noncircular shape can be employed to significant advantage in injector design for liquid rocket engines.

Mchale, R. M.↗
NASA NTRS1974

Evaluation program for secondary spacecraft cells. Initial evaluation tests of General Electric Company standard and teflonated negative electrode 20.0 ampere-hour, nickel-cadmium spacecraft cells with auxiliary electrodes

The standard plate cells exhibited higher average end-of-charge (EOC) voltages than the cells with teflonated negative plates; they also delivered a higher capacity output in ampere hours following these charges. All the cells reached a pressure of 20 psia before reaching the voltage limit of 1.550 volts during the pressure versus capacity test. The average ampere hours in and voltages at this pressure were 33.6 and 1.505 volts respectively for the teflonated negative plate cells and 35.5 and 1.523 volts for the standard plate cells. All cells exhibited pressure decay in the range of 1 to 7 psia during the last 30 minutes of the 1-hour open circuit stand. Average capacity out for the teflonated and standard negative plate cells was 29.4 and 29.9 ampere hours respectively.

Source record↗
NASA NTRS1974

Evaluation of coated columbium alloy heat shields for space shuttle thermal protection system application. Volume 3, phase 3: Full size TPS evaluation

The thermal protection system (TPS), designed for incorporation with space shuttle orbiter systems, consists of one primary heat shield thermally and structurally isolated from the test fixture by eight peripheral guard panels, all encompassing an area of approximately 12 sq ft. TPS components include tee-stiffened Cb 752/R-512E heat shields, bi-metallic support posts, panel retainers, and high temperature insulation blankets. The vehicle primary structure was simulated by a titanium skin, frames, and stiffeners. Test procedures, manufacturing processes, and methods of analysis are fully documented. For Vol. 1, see N72-30948; for Vol. 2, see N74-15660.

Baer, J. W.↗
NASA NTRS1975

Evaluation program for secondary spacecraft cells: Initial evaluation tests of General Electric Company 6.0 ampere-hour nickel-cadmium spacecraft cells for the Improved Tiros Operational Satellite (ITOS)

Quality control measures for Ni-Cd spacecraft cells were analyzed. Cells were examined for electrolyte leakage, internal shorts, low capacity, or inability of any cell to recover its open circuit voltage above 1.50 volts during the internal short test. Test results are given in tabular form.

Harkness, J. D.↗
NASA NTRS1977

The evaluation of a HgCdTe photomixer with a Tunable Diode Laser (TDL) and the evaluation of TDL's as a local oscillator in a heterodyne detection system

Heterodyne systems would be much more versatile if a broadly tunable laser, such as a semiconductor diode laser (TDL), could be used as the local oscillator (LO). Previous studies have shown that while a TDL can be used as an LO, the TDL lack sufficient power to cause the signal-to-noise ratio to be shot noise limited. The heterodyne system with a HgCdTe photodiode as the LO was characterized and the beat frequency response of the heterodyne systems was mapped out.

Harward, C. N.↗
NASA NTRS1980

Shuttle orbiter Ku-band radar/communications system design evaluation. Ku band bent-pipe channel performance evaluation

Because of difficulties with the bit detector of the SPA mode 1 channel 3 input port, a new bit synchronizer was required. The two prime candidate designs are described and analyzed. The selected design is a modification of one which utilizes a phase frequency detector to track the received data clock frequency and a mid-bit transition point sample detector to generate a bit timing error (phase error) signal to control the relative phase between the local clock and the local data stream. The model used to calculate the effects of cable attenuation and rise time degradation is discussed.

Holmes, J. K.↗
NASA NTRS1979

Evaluation program for secondary spacecraft cells: Initial evaluation tests of General Electric Company, 6.0 ampere-hour nickel-cadmium spacecraft cells for the GOES-D, E and F satellite program

The tests are to insure that all cells put into the life cycle program are of high quality by the screening of cells found to have electrolyte leakage, internal shorts, low capacity, or inability of any cell to recover its open-circuit voltage above 1.150 volts during the internal short test. Test limits specify those values at which a cell is to be terminated from charge or discharge. Requirements are referenced to normally expected values based on past performance of aerospace nickel-cadmium cells with demonstrated life characteristics. Recommendations for the improvement of the manufacturing processes are presented.

Harkness, J. D.↗
NASA NTRS1980

Evaluation program for secondary spacecraft cells: Initial evaluation tests of General Electric Company 40.0 ampere hour nickel cadmium spacecraft cells for the tracking data relay satellite system

Average end of charge voltages and pressures, and capacity output in ampere hours are presented. Test limits specify those values at which a cell is to be terminated from charge or discharge. Requirements are based on past cell performance data. The requirement does not constitute a limit for discontinuance from testing. The nickel cadmium batteries were screened for internal shorts, low capacity, electrolyte leakage, or inability of any cell to recover its open circuit voltage above 1.150 volts during the internal short test.

Hall, S. W.↗
NASA NTRS1984

Evaluation program for secondary spacecraft cells. Initial evaluation tests of General Electric Company 4.0 ampere-hour nickel-cadmium spacecraft cells for the AMPTE satellite program

Cells found to have electrolyte leakage, internal shorts, low capacity, or inability of any cell to recover its open circuit voltage above 1.150 volts during the internal short test are addressed. The Active Magnetic Particle Tracer Explorer (AMPTE) cell design was characterized and the effects of specific mission parameters on cell life were demonstrated.

Harkness, J. D.↗
NASA NTRS1991

SRB environment evaluation and analysis. Volume 1: Redesigned SRB flight heating evaluation

Following the Space Shuttle STS-51L disaster on January 28, 1986, a considerable redesign effort was launched on the Solid Rocket Booster. This effort culminated in three instrumented flights, STS-26R, 27R, and 29R, beginning in September of 1989. Aeroheating data were obtained on these flights in the form of pressure, heat flux, and gas temperature probe measurements. These data were analyzed from an ascent and reentry heating point of view. The flight data were verified, compared with historic and theoretical results, and scaled to design. Impact of these results on the current design environment set was assessed and recommendations made. This report documents this effort.

Crain, William K.↗
NASA NTRS2002

Evaluation of SAGE II and Balloon-Borne Stratospheric Aerosol Measurements: Evaluation of Aerosol Measurements from SAGE II, HALOE, and Balloonborne Optical Particle Counters

Stratospheric aerosol measurements from the University of Wyoming balloonborne optical particle counters (OPCs), the Stratospheric Aerosol and Gas Experiment (SAGE) II, and the Halogen Occultation Experiment (HALOE) were compared in the period 1982-2000, when measurements were available. The OPCs measure aerosol size distributions, and HALOE multiwavelength (2.45-5.26 micrometers) extinction measurements can be used to retrieve aerosol size distributions. Aerosol extinctions at the SAGE II wavelengths (0.386-1.02 micrometers) were computed from these size distributions and compared to SAGE II measurements. In addition, surface areas derived from all three experiments were compared. While the overall impression from these results is encouraging, the agreement can change with latitude, altitude, time, and parameter. In the broadest sense, these comparisons fall into two categories: high aerosol loading (volcanic periods) and low aerosol loading (background periods and altitudes above 25 km). When the aerosol amount was low, SAGE II and HALOE extinctions were higher than the OPC estimates, while the SAGE II surface areas were lower than HALOE and the OPCS. Under high loading conditions all three instruments mutually agree to within 50%.

Hervig, Mark↗
NASA NTRS2022

A Coupled Evaluation of Operational MODIS and Model Aerosol Products for Maritime Environments Using Sun Photometry: Evaluation of the Fine and Coarse Mode

Although satellite retrievals and data assimilation have progressed to where there is a good skill for monitoring maritime Aerosol Optical Depth (AOD), there remains uncertainty in achieving further degrees of freedom, such as distinguishing fine and coarse mode dominated species in maritime environments (e.g., coarse mode sea salt and dust versus fine mode terrestrial anthropogenic emissions, biomass burning, and maritime secondary production). For the years 2016 through 2019, we performed an analysis of 550 nm total AOD550, fine mode AOD (FAOD550; also known as FM AOD in the literature), coarse mode AOD (CAOD550), and fine mode fraction (η550) between Moderate Resolution Spectral Imaging Radiometer (MODIS) V6.1 MOD/MYD04 dark target aerosol retrievals and the International Cooperative for Aerosol Prediction (ICAP) core four multi-model consensus (C4C) of analyses/short term forecasts that assimilate total MODIS AOD550. Differences were adjudicated by the global shipboard Maritime Aerosol Network (MAN) and selected island AERONET sun photometer observations with the application of the spectral deconvolution algorithm (SDA). Through a series of conditional and regional analyses, we found divergence included regions of terrestrial influence and latitudinal dependencies in the remote oceans. Notably, MODIS and the C4C and its members, while having good correlations overall, have a persistent +0.04 to +0.02 biases relative to MAN and AERONET for typical AOD550 values (84th% < 0.28), with the C4C underestimating significant events thereafter. Second, high biases in AOD550 are largely associated with the attribution of the fine mode in satellites and models alike. Thus, both MODIS and C4C members are systematically overestimating AOD550 and FAOD550 but perform better in characterizing the CAOD550. Third, for MODIS, findings are consistent with previous reports of a high bias in the retrieved Ångström Exponent, and we diagnosed both the optical model and cloud masking as likely causal factors for the AOD550 and FAOD550 high bias, whereas for the C4C, it is likely from secondary overproduction and perhaps numerical diffusion. Fourth, while there is no wind-speed-dependent bias for surface winds <12 m s−1, the C4C and MODIS AOD550s also overestimate CAOD550 and FAOD550, respectively, for wind speeds above 12 m/s. Finally, sampling bias inherent in MAN, as well as other circumstantial evidence, suggests biases in MODIS are likely MODIS and the C4C products have their own strengths and challenges for a given climate application and discuss needed research. even larger than what was diagnosed here. We conclude with a discussion on how

Aerosols↗
NASA NTRS2023

Commercial Smallsat Data Acquisition Program On-ramp #2 Airbus U.S. Synthetic Aperture Radar (SAR) Evaluation Report

In 2017, NASA’s Earth Science Division (ESD) launched the Private-Sector Small Constellation Satellite Data Product Pilot, now referred to as the Commercial Smallsat Data Acquisition (CSDA) program. The objective of CSDA is to identify, evaluate, and acquire commercial remote sensing data that support NASA’s Earth science research and application activities. The Pilot successfully concluded in early 2020, when CSDA transitioned into a sustained program with on-ramping opportunities for new vendors as the industry emerges with new candidates and capabilities. In October 2019, a Request for Information (RFI) seeking capability statements from parties interested in providing data from spaceborne platforms was released for the CSDA on-ramp #2 evaluations. To be responsive to the RFI, the commercial satellite constellations had to consist of three or more operating spacecraft actively collecting data in a non-geostationary orbit with full latitudinal coverage and be U.S. companies. Two vendors responded to the RFI and were evaluated by a committee composed of NASA ESD leadership, program managers, and scientists. Both vendors satisfied the RFI requirements and were asked to respond to a Request for Proposal (RFP). After review of the proposals, NASA entered into a Blanket Purchase Agreement (BPA) with Airbus Defense and Space GEO, Inc. (Airbus) U.S. in September 2021 and with BlackSky Geospatial Solutions, Inc. (BlackSky) in November 2021. In this report, CSDA provides an evaluation of the usefulness of data provided by the Airbus U.S. Synthetic Aperture Radar (SAR) satellite constellation, consisting of TerraSAR-X (launched in 2007), TanDEM-X (launched in 2010), and PAZ (launched in 2018), for advancing NASA’s Earth system science research and applications. The evaluation of the BlackSky commercial data will be provided in a separate report. To conduct the Airbus evaluation, NASA’s ESD augmented 13 existing research projects that could potentially benefit from, and had the expertise to evaluate, the commercial data being considered for longer-term purchase. Investigators from NASA’s Research and Analysis Program science focus areas and from NASA’s Applied Sciences Program elements participated in the evaluation. A summary of the research areas evaluated by the Principal Investigator (PI) teams is presented in Figure 3. CSDA also funded a dedicated activity to evaluate the satellite data quality (calibration and geolocation) independently by assessing the accuracy of data from Airbus. Evaluation activities were carried out by the selected PIs from December 7, 2022, to December 7, 2023. Delivery of datasets requested by the researchers began in January 2023. The vendors were evaluated on the accessibility of data, accuracy and completeness of metadata, and promptness and quality of user support services. Datasets purchased during the evaluation have been archived by NASA and will be made available to current and future government-funded researchers in accordance with the End User License Agreement (EULA). This synthesis report distills and integrates the findings of research reports commissioned by NASA for the Airbus evaluation. This report also includes recommendations that inform the way ahead for the program. The scientific results from the evaluations demonstrated that the commercial data from Airbus were able to advance NASA research and applications. However, the PIs encountered limitations that diminished the usefulness of the data due to the amount of effort that was required to access, preprocess, and analyze these data. One significant issue encountered was the limited spatial and temporal coverage of the data in the Airbus archive that could be used to conduct time series analyses or assessments over large spatial scales. Overall, however, the utility and the quality of the evaluated data outweighed the difficulties encountered, and NASA has concluded that the Airbus SAR data would complement NASA’s existing Earth observation capabilities and Airbus U.S. would qualify to participate in the sustained phase of the program.

Batuhan Osmanoglu↗
NASA NTRSDate not supplied

Objective Structured Clinical Evaluation (OSCE) of an Artificial Intelligence (AI) Clinical Decision Support System (CDSS) Tool

BACKGROUND Objective Structured Clinical Evaluations (OSCEs) have long been established as a robust methodology for summative assessment of clinical skills and decision-making during medical education. The recent integration of Artificial Intelligence (AI) into clinical decision-making processes has prompted the need for novel evaluation frameworks to assess the efficacy and reliability of AI clinical decision support system (CDSS) tools. This abstract outlines the process of quantitatively evaluating a novel CDSS (“Doc in a Box” Google 2024) trained on curated medical spaceflight data in the psychomotor domain as it interfaces with a human volunteer acting as the crew medical officer (CMO). PURPOSE The AI CDSS under review was developed as part of the Lunar Command and Control Interoperability (LuCCI) project, which is intended to address a gap in how Lunar Surface Systems (LSS) would interoperate across multiple programs, commercial partners, and international partners. The project objective is to define, prototype, integrate, and evaluate an interoperable lunar command, control, data, and software reference architecture to enable autonomy and informatics capability through common standards across LSS. A multi-modal AI-based CDSS compatible with Federated LSS will assist clinicians in diagnosing and managing complex medical conditions by providing evidence-based recommendations through predictive analytics. Given the critical role of decision-support as NASA continues to evolve its Earth-independent medical operations (EIMO), it is imperative to ensure that such AI tools perform reliably and align with clinical standards during progressive lunar and Martian exploration class missions. METHODS The OSCE framework, traditionally used for evaluating human clinicians, was adapted to assess the AI tool's decision-making capabilities in simulated clinical scenarios. In this adapted OSCE, the AI CDSS was tested across a series of structured clinical scenarios designed to mimic real-life spaceflight patient cases. These scenarios included a range of conditions and complexities, allowing for comprehensive assessment of the tool's performance. Key evaluation metrics included accuracy of diagnosis, timeliness of decision-making, and appropriate recommendations for therapies. The OSCE was scored by human physician evaluators who assessed the AI's recommendations in comparison with expert clinicians' medical decision making to ensure alignment with best practices and the standard of care. RESULTS Preliminary results indicate that the AI CDSS demonstrated high accuracy in diagnostic recommendations and decision support across various scenarios. However, certain limitations were noted, such as occasional discrepancies in handling complex or nuanced cases that required a more contextual understanding. Additionally, the tool scored higher on the diagnostic portion of the rubric, with lower scores in the therapeutic recommendations. These findings highlight the importance of continuous refinement and validation of AI tools through rigorous evaluation frameworks like the OSCE. The adaptation of OSCEs for AI tools presents several advantages, including a structured and reproducible approach to evaluation, the ability to test AI systems in diverse clinical scenarios, and the opportunity to benchmark AI performance against established clinical standards to permit charting of future progress as aerospace medicine evolves as a discipline. Remaining challenges include ensuring that these evaluations capture the full spectrum of clinical decision-making scenarios that will be confronted by CMOs during missions and adequately reflecting real-world variability of the austere spaceflight environment. CONCLUSION Employing OSCEs to evaluate AI clinical decision support tools offers a promising approach to validating their clinical utility and efficacy. This methodology not only provides insights into the tool's performance but also fosters ongoing improvement and alignment with standard of care practices. Future research should focus on refining these evaluation processes and addressing limitations to enhance the integration of AI tools in clinical spaceflight settings. REFERENCES Scott S, Hearns V, Barker MA. Testing Clinical Skills: A Look at the OSCE and USMLE Clinical Skills Exams. S D Med. 2019 Oct;72(10):451-453. Majumder MAA, Kumar A, Krishnamurthy K, Ojeh N, Adams OP, Sa B. An evaluative study of objective structured clinical examination (OSCE): students and examiners perspectives. Adv Med Educ Pract. 2019 Jun 5;10:387-397. Karam VY, Park YS, Tekian A, Youssef N. Evaluating the validity evidence of an OSCE: results from a new medical school. BMC Med Educ. 2018 Dec 20;18(1):313.

Ariana M Nelson↗