Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “empirical validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS1994

Models of Human Information Requirements: "When Reasonable Aiding Systems Disagree"

Aircraft flight management and Air Traffic Control (ATC) automation are under development to maximize the economy of flight and to increase the capacity of the terminal area airspace while maintaining levels of flight safety equal to or better than current system performance. These goals are being realized by the introduction of flight management automation aiding and operations support systems on the flight deck and by new developments of ATC aiding systems that seek to optimize scheduling of aircraft while potentially reducing required separation and accounting for weather and wake vortex turbulence. Aiding systems on both the flight deck and the ground operate through algorithmic functions on models of the aircraft and of the airspace. These models may differ from each other as a result of variations in their models of the immediate environment. The resultant flight operations or ATC commands may differ in their response requirements (e.g. different preferred descent speeds or descent initiation points). The human operators in the system must then interact with the automation to reconcile differences and resolve conflicts. We have developed a model of human performance including cognitive functions (decision-making, rule-based reasoning, procedural interruption recovery and forgetting) that supports analysis of the information requirements for resolution of flight aiding and ATC conflicts. The model represents multiple individuals in the flight crew and in ATC. The model is supported in simulation on a Silicon Graphics' workstation using Allegro Lisp. Design guidelines for aviation automation aiding systems have been developed using the model's specification of information and team procedural requirements. Empirical data on flight deck operations from full-mission flight simulation are provided to support the model's predictions. The paper describes the model, its development and implementation, the simulation test of the model predictions, and the empirical validation process. The model and its supporting data provide a generalizable tool that is being expanded to include air/ground compatibility and ATC crew interactions in air traffic management.

Corker, Kevin↗
NASA NTRS2002

SOFIA's Choice: Scheduling Observations for an Airborne Observatory

We describe the problem of scheduling observations for an airborne observatory. The problem is more complex than traditional scheduling problems in that it incorporates complex constraints relating the feasibility of an astronomical observation to the position and time of a mobile observatory, as well as traditional temporal constraints and optimization criteria. We describe the problem, its proposed solution and the empirical validation of that solution.

Frank, Jeremy↗
NASA NTRS2003

International Space Station Microgravity Analytical Model Correlation And Update

The acceleration environment aboard the completed International Space Station (ISS) is a key resource for scientific and technological endeavors. Hardware verification activIties and early measurements indicate that the ISS is well on the way of meeting these "Assembly Complete" "microgravity" provisions, however, the simulation models that compute these accelerations have, to date, lacked the high degree of empirical validation typical of standard aerospace industry practices. Assembly stage, on-orbit measurements are used to address this shortcoming and to develop higher confidence in the simulation models. The Phase I correlation results show the analyses to be consistently conservative, producing higher than measured levels. The 25 to 30% greater quasi-steady computations are deemed acceptable for verification. Updates are made to localized structural dynamic and vibroacoustic parameters that reduce responses in selected one-third octave bands by almost 50%. These models are then used for the Assembly Complete verification analysis which concludes that the ISS vehicle meets the ISS microgravity requirements with minor reservations. Two of the sixteen rack are marginally non-compliant in the quasi-steady regime, and operational constraints are needed on the U. S. Lab and ESA APM vacuum resource vents, and the Russian Resistive Exercise Device in the structural dynamic regime.

DelBasso, Steve↗
NASA NTRS2014

SUPERball: Exploring Tensegrities for Planetary Probes

The Dynamic Tensegrity Robotics Lab (DTRL) at NASA Ames Research Center is developing a compliant and distributed tensegrity robotic platform for planetary exploration. Working in collaboration with Ghent University, the DTRL built an untethered prototype robot, the SUPERball. In this work, multiple issues with the current SUPERball design are addressed, when considering an example mission to Titan. Specifically, engineering requirements for the mission are empirically validated, and the current design is extended under these requirements to meet expanded goals.Survival of impact forces under entry, descent, and landing are verified with a physical experiment performed in collaboration with the University of Idaho. Then, concepts for a fully-actuated redesign of SUPERball are generated, compared, and validated against current engineering requirements. This exploratory work moves the SUPERball project toward an eventual flight-ready design.\

Tensegrity↗
NASA NTRS2022

The Cooling Loop A Anomaly of 2013: A Case Study in Human-Systems Resilience

Throughout the history of human spaceflight, NASA has employed an operational paradigm of 24/7 dependence on experts in Mission Control Center (MCC). In addition to nominal flight control and mission operations, these 85+ experts per shift manage anomaly detection, diagnosis, and response, and support the crew in real-time in performing maintenance and repair, procedure execution, and other complex mission operations. Future long-duration exploration missions (LDEMs) beyond low-Earth orbit (LEO) will not operate successfully using this same Human-Systems Integration Architecture (HSIA) where crew rely on ground controllers, have ready access to resupply, and have a fallback plan of evacuation. As distance from Earth increases and the communication delay grows, crews will need to respond independently and adequately to time-critical vehicle malfunctions. It will not always be sufficient or even possible to ‘safe the system’ and then wait upon ground intervention. A new and radically different HSIA is needed to accommodate the paradigm shift of deep-space travel. Historical International Space Station (ISS) data show that for a 30-day mission, the likelihood of a high-consequence vehicle anomaly of uncertain origin that requires rapid response is greater than 10%. The likelihood of such an event is 50% by the fourth month of the mission, and it grows exponentially with time. Our team has conducted in-depth investigations into these events and their corresponding anomaly resolution activities. Using MCC and Mission Evaluation Room (MER) anomaly resolution artifacts (including meeting summaries, caution and warning data, and ISS daily summaries), we created timelines detailing ground actions and in-orbit events for two significant anomalies. We then mapped these timelines onto Mars transit conditions, introducing a ground-crew communications time delay and shifting immediate response, time-critical task execution, and vehicle commanding to the crew. In detailing successful anomaly resolution in transit to Mars, the timelines highlight where effective resolution requires drastically evolved onboard capabilities. Though this research has yielded a rich data set based on ground response in past missions, there is still insufficient knowledge to assess the potential impact of inflight anomalies on a small autonomous crew on future LDEMs beyond LEO. To begin building an evidence base that will inform future HSIA standards and requirements, we are developing an approach to systematically capture crew anomaly response and procedure execution during early Artemis missions. Being the first human spaceflight beyond LEO since Apollo, early Artemis missions provide a rare and unique opportunity to serve as a testbed for Mars missions. Our work aims to capitalize on planned data collection to derive crew operational responses to anomalous events in real-time. Our team is also researching the level of simulation fidelity required for empirically validating proposed HSIA standards and evaluating HSIA implementations for LDEMs beyond LEO. This work will produce a trade space study of HSIA simulation objectives and fidelity requirements. Ultimately, these research efforts will assist in developing the standards and technologies needed to build a next-generation HSIA for LDEMs beyond LEO.

human-systems integration architecture↗
NASA NTRSDate not supplied

The Examination of Individual Factors and AFTE Training Outcomes

Introduction: Motion sickness is common among military aviators. It describes a specific group of symptoms that include epigastric awareness, nausea, pallor, sweating, salivation, and fatigue. Occurrences of these symptoms can pose a significant risk to safety and adversely impact mission success. Accordingly, researchers have developed specific interventions to act as countermeasures. For example, Autogenic Feedback Training Exercise has been empirically validated as a training method that mitigates the impact of motion sickness. However, it remains unclear the extent to which individual factors moderate (or mediate) the effects of this intervention. The examination of individual factors such as interoceptive accuracy (IA) and specific personality traits might provide insight into whom may benefit most from AFTE. Methods: Participants were administered the Big Five Inventory (BFI) and State Trait Anxiety Inventory (STAI). In addition, they were given an interoceptive accuracy task (i.e., heartbeat counting task). The participants’ reported value was then compared to the actual number of heart beats obtained via ECG. Completion of the IA task was followed by pre- AFTE and Post-AFTE rotating chair tests to evaluate motion sickness and the effects of AFTE training. Results: Participants (n=16) were evaluated on IA, personality factors (i.e., BFI & STAI) and performance on the rotating chair. IA was unrelated to personality traits (p > .05), but inversely related to state anxiety post training (p < .05). Finally, IA did not predict performance (i.e., rotations or minutes tolerated ?) on rotating chair F (1, 14) = 1.18, p> .05). Discussion:(1) IA is unrelated to personality traits as measured by BFI and STAI. (2) Individual factors are unrelated to AFTE training outcome. (3) AFTE training can be beneficial for all.

motion sickness↗
NASA NTRS2021

Development and Validation of an Empirical Ocean Color Algorithm with Uncertainties: A Case Study with the Particulate Backscattering Coefficient

We explored how algorithm (model) and in situ measurement (observation) uncertainties can effectively be incorporated into empirical ocean color model development and assessment. In this study we focused on methods for deriving the particulate backscattering coefficient at 555 nm, b(bp)(555)/(m). We developed a simple empirical algorithm for deriving b(bp)(555) as a function of a remote sensing reflectance line height (LH) metric. Model training was performed using a high-quality bio-optical dataset that contains coincident in situ measurements of the spectral remote sensing reflectances, R(rs)(λ)/(sr), and the spectral particulate backscattering coefficients, b(bp)(λ). The LH metric used is defined as the magnitude of Rrs(555) relative to a linear baseline drawn between R(rs)(490) and R(rs)(670). Using an independent validation dataset, we compared the skill of the LH-based model with two other models. We used contemporary validation metrics, including bias and mean absolute error (MAE), that were corrected for model and observation uncertainties. The results demonstrated that measurement uncertainties do indeed impact contemporary validation metrics such as mean bias and MAE. Zeta-scores and z-tests for overlapping confidence intervals were also explored as potential methods for assessing model skill.

ocean color↗
NASA NTRS2014

Empirical and Face Validity of Software Maintenance Defect Models Used at the Jet Propulsion Laboratory

At the Mission Design and Navigation Software Group at the Jet Propulsion Laboratory we make use of finite exponential based defect models to aid in maintenance planning and management for our widely used critical systems. However a number of pragmatic issues arise when applying defect models for a post-release system in continuous use. These include: how to utilize information from problem reports rather than testing to drive defect discovery and removal effort, practical model calibration, and alignment of model assumptions with our environment.

software reliability↗
NASA NTRS2015

Development, Testing, and Validation of a Model-Based Tool to Predict Operator Responses in Unexpected Workload Transitions

One human factors challenge is predicting operator performance in novel situations. Approaches such as drawing on relevant previous experience, and developing computational models to predict operator performance in complex situations, offer potential methods to address this challenge. A few concerns with modeling operator performance are that models need to realistic, and they need to be tested empirically and validated. In addition, many existing human performance modeling tools are complex and require that an analyst gain significant experience to be able to develop models for meaningful data collection. This paper describes an effort to address these challenges by developing an easy to use model-based tool, using models that were developed from a review of existing human performance literature and targeted experimental studies, and performing an empirical validation of key model predictions.

model-based workload transition tool↗
NASA NTRSDate not supplied

Transfer Function Models and Sensitivity Analysis

In many situations, real or induced flaws such as tight cracks with known morphology cannot be manufactured in part configuration specimens or in real parts. Typically, fatigue cracks are manufactured in simple geometry specimens such as flat plates, dog-bone shaped flat or round specimens. If a nondestructive evaluation (NDE) technique is required to provide a reliably detectable target flaw size denoted as α_(90/95) for induced flaws in real part, then the direct method for qualifying the NDE procedure is to use the appropriate induced flaw specimens and perform probability of detection analysis using these flaws. This can be described as direct POD demonstration testing, which may follow guidelines of MIL-HDBK-1823. This paper considers a case, where induced flaws are not available in part configuration specimens. Therefore, a direct POD demonstration study cannot be undertaken. In such situation, general practice for NDE procedure qualification is to use artificial flaws in simple geometry and part configuration specimens, and induced flaws in the chosen simple geometry specimens. Signal response data is taken on all sets of artificial and induced flaws. NDE procedure testing on induced flaw in simple geometry specimen is called NDE demonstration testing here. A transfer function NDE procedure qualification method for forward case calculates predicted induced flaw size for demonstration using a chosen target flaw size. Another transfer function method for inverse case, calculates the target flaw size using a given demonstration flaw size. The transfer function analysis assumes relationship of artificial flaw signal responses in real parts and simple geometry specimens; and induced flaw responses in simple geometry specimens to induced flaws in real parts. The signal response transfer relationships model should be defined before transfer function models can be devised. Assuming that the signal response transfer relationships model is valid, forward and inverse case transfer function methods have been devised. Because of lack of signal response data from induced flaws in real part, 90/95% POD/confidence (P/C) cannot be demonstrated directly. However, the transfer function method may be assessed using simulation to evaluate whether the resulting target flaw size or demonstration flaw size provides adequate confidence to the assumed signal response transfer relationships model. Therefore, the transfer function approach is a risk assessment approach. Both the signal response transfer relationships model and the transfer function model are important in managing risk in results provided by the transfer function NDE technique qualification or assessment. The signal response transfer relationships model needs to be validated with empirical data and then transfer function model needs to be validated for desired P/C on case-by-case basis.

Nondestructive evaluation↗
NASA NTRS1990

Tank Pressure Control Experiment - A low-g mixing investigation

The Tank Pressure Control Experiment (TPCE) was conceived to meet the need for an aspect of cryogenic fluid management technology that is critical to several future national space missions: control of cryogenic storage tank pressures by active mixing. In-space testing is the only means of obtaining the fluid dynamic data necessary to develop and test predictive models of mixing. These models, when validated, will allow future cryogenic systems to be designed with more efficient and reliable pressure control systems. The objectives of the TPCE project are to characterize the fluid dynamics of jet-induced mixing in low gravity, evaluate the validity of empirical models and correlations, and provide data for use in developing and validating computational fluid dynamic models. This paper discusses prior studies of low-g mixing, the objectives and benefits of TPCE, the design and status of the payload, and preliminary results obtained from low-g aircraft testing.

Bentz, M. D.↗
NASA NTRSDate not supplied

Advanced Materials for the Lunar Surface: Multiscale Computational Design of Refractory Alloys and Carbides

Emerging operational environments, such as the lunar surface, present novel challenges for NASA and drive the need for advanced materials in applications like fission surface power systems. To address these demands, computational materials science is rapidly evolving to augment or replace costly and hazardous empirical testing. Although materials selection at NASA remains predominantly experimentally driven, advanced simulation methodologies are being steadily integrated into the engineering lifecycle. This work details the application of multiscale simulation techniques—including first-principles calculations, CALPHAD, dislocation dynamics, and molecular dynamics—at NASA's Ames Research Center to evaluate advanced materials for extreme environments. First, we present contributions to the Space Nuclear Propulsion Project. Be-cause propellant channel coatings in nuclear thermal rockets must withstand high-pressure, high-temperature hydro-gen, optimizing these materials is critical. First-principles calculations were employed to establish a rigorous quantitative and qualitative understanding of the behavior of the refractory carbides ZrC, NbC, and their mixtures in high-enthalpy hydrogen environments. This necessitated the generation of high-fidelity thermodynamic models for both stoichiometric and carbon-depleted carbides, both with and without the presence of hydrogen. Furthermore, we highlight efforts under the Refractory Alloy Additive Manufacturing Build Optimization (RAAMBO) project, where existing and novel alloy compositions were assessed for additive manufacturing printability and subsequent performance in applications such as heat pipes and rocket nozzle extensions. This was accomplished through a comprehensive multiscale simulation framework that bridged the gap from the nanometer to the millimeter scale. Across both initiatives, rigorous validation against empirical data was prioritized. By systematically employing a verified and validated computational frame-work, we demonstrate how simulation effectively supports multidisciplinary engineering efforts, builds project-wide confidence, and drives critical materials development.

computational materials↗
DOE OSTI2024

Rapid Demonstration of Bremsstrahlung Diode Optimization

Optimization of the radiation pattern from a Bremsstrahlung target for a given application is possible by controlling the electron beam that impacts the high-atomic-number target. In this work, the electron beam is generated by a 13MV vacuum diode that terminates a coaxial magnetically insulted transmission line (MITL) on the HERMES-III machine at Sandia National Labs. Work by Sanford introduced a geometry for vacuum diodes that can control the flow within bounds. The "indented anode", as coined by Sanford, can straighten out the electron beam in a high-current diode that would otherwise be prone to beam pinching. A straighter beam will produce a more forwardly directed radiation pattern while a pinching electron beam will yield a focal point or hot spot on axis and a more diffuse radiation pattern. Either one of these may be desirable depending on the application. This work serves as a first attempt to optimize the radiation pattern in the former sense of collimating the radiation pattern given a limited parameter space. The optimization is attempted first using electromagnetic particle-in-cell simulations in the EMPIRE code suite. The setup of the models used in EMPIRE is discussed along with some basic theory behind some of the models used in the simulations such as anode heating and secondary ions. Theoretical work performed by Allen Garner and his students at Purdue is included here, which concerns the impact of collisions in these vacuum diodes. The EMPIRE simulations consider both an aggressive and a conservative design. The aggressive design is inherently riskier while the conservative design is chosen as something that, while still a risk, is more likely to perform as expected. The ultimate goal of this work was to validate the EMPIRE code results with experimental data. While the experiment that tested the diode designs proposed by the simulation results fell outside of the fiscal boundaries of this project (and for that reason the results of which are not included in this report), the hardware for the experiment was designed and drafted within those same fiscal boundaries, and is thus included in this report. However, there was yet another experiment performed in this project that tested a key feature of the diode: the hemispherical cathode. Those results are documented here as well, which show that the cathode tip is an important aspect to controlling the diode flow. A short series of simulations on this diode were also performed after the experiment in order to gain a better understanding of the effect of ions. on the flow pattern and faceplate dose profile.

43 PARTICLE ACCELERATORS↗
NASA NTRS2008

Solar Tower Experiments for Radiometric Calibration and Validation of Infrared Imaging Assets and Analysis Tools for Entry Aero-Heating Measurements

The NASA Engineering and Safety Center sponsored Hypersonic Thermodynamic Infrared Measurements assessment team has a task to perform radiometric calibration and validation of land-based and airborne infrared imaging assets and tools for remote thermographic imaging. The IR assets and tools will be used for thermographic imaging of the Space Shuttle Orbiter during entry aero-heating to provide flight boundary layer transition thermography data that could be utilized for calibration and validation of empirical and theoretical aero-heating tools. A series of tests at the Sandia National Laboratories National Solar Thermal Test Facility were designed for this task where reflected solar radiation from a field of heliostats was used to heat a 4 foot by 4 foot test panel consisting of LI 900 ceramic tiles located on top of the 200 foot tall Solar Tower. The test panel provided an Orbiter-like entry temperature for the purposes of radiometric calibration and validation. The Solar Tower provided an ideal test bed for this series of radiometric calibration and validation tests because it had the potential to rapidly heat the large test panel to spatially uniform and non-uniform elevated temperatures. Also, the unsheltered-open-air environment of the Solar Tower was conducive to obtaining unobstructed radiometric data by land-based and airborne IR imaging assets. Various thermocouples installed on the test panel and an infrared imager located in close proximity to the test panel were used to obtain surface temperature measurements for evaluation and calibration of the radiometric data from the infrared imaging assets. The overall test environment, test article, test approach, and typical test results are discussed.

Splinter, Scott C.↗
DOE OSTI2022

Calibrating uncertain parameters in melt pool simulations of additive manufacturing

Melt pool scale numerical modeling of additive manufacturing (AM) processes can provide predictive capabilities and theoretical insight into the process-property-structure-performance relationships for AM parts. Despite capabilities of numerical models to solve complex multi-physics problems, it is often important to consider a tradeoff between detailed physics and computational cost. Therefore, sources of uncertainty in both experimental conditions and the parameters needed for modeling require models to be validated against empirical evidence. Here, a method is proposed to calibrate uncertain parameters used in continuum-scale melt pool models for powder bed fusion (PBF) AM. Both a simplified heat transfer model and a heat transfer and fluid flow model were investigated. A surrogate model and Markov chain-based optimization algorithm calibrated melt pool geometry for models within experimental variation of the target melt pool width and depth from the NIST AM-Bench 2018-02 dataset. The melt pool temperature distributions, solidification parameters, and simulated multi-layer solidification microstructures were compared between the two models. Similar results from both models indicate that calibrated, lower fidelity numerical models may be used in place of higher fidelity models to generate melt pool solidification data. Finally, these calibrated models therefore enable lower computational cost melt pool simulations without a noticeable decrease in simulation accuracy for grain-scale microstructure simulations.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Monitoring water quality in the lower Kansas River using remote sensing

Abstract We demonstrate how to combine remote sensing data from satellite imagery (Sentinel‐2) with in situ water quality gauging (USGS Super Gages and the Gybe hyperspectral radiometer) to create spatially dense maps of water quality parameters (chlorophyll‐a concentration, turbidity, and nitrate plus nitrite concentration) along the lower Kansas River. The water quality maps are created using locally tuned models of the target water quality parameters, and this study describes the steps used to design, calibrate, and validate the empirical correlations. Water quality parameters such as chlorophyll‐a concentration are correlated with well‐studied absorption and scattering features in the visible spectrum (roughly 400–700 nm). Nutrients (such as nitrate plus nitrite concentration) lack strong absorption features in the visible spectrum, and in those cases we describe a novel surrogate data modeling approach that identifies overlapping water parcels between the in situ gauging and the remote sensing imagery. Measurements from the overlapping water parcels yield excellent correlations () for the target water quality parameters for limited windows of time (or limited sections of river reaches). Examples are provided illustrating how the water quality maps can be used to track river inputs from ungauged sources (such as creeks), or reveal the mixing patterns at the confluences.

Tufillaro, Nicholas↗