Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49
All sourcesNASA NTRSDOE OSTI
NASA NTRS1999

Transonic Flutter Suppression Control Law Design Using Classical and Optimal Techniques with Wind-Tunnel Results

The benchmark active controls technology and wind tunnel test program at NASA Langley Research Center was started with the objective to investigate the nonlinear, unsteady aerodynamics and active flutter suppression of wings in transonic flow. The paper will present the flutter suppression control law design process, numerical nonlinear simulation and wind tunnel test results for the NACA 0012 benchmark active control wing model. The flutter suppression control law design processes using (1) classical, (2) linear quadratic Gaussian (LQG), and (3) minimax techniques are described. A unified general formulation and solution for the LQG and minimax approaches, based on the steady state differential game theory is presented. Design considerations for improving the control law robustness and digital implementation are outlined. It was shown that simple control laws when properly designed based on physical principles, can suppress flutter with limited control power even in the presence of transonic shocks and flow separation. In wind tunnel tests in air and heavy gas medium, the closed-loop flutter dynamic pressure was increased to the tunnel upper limit of 200 psf. The control law robustness and performance predictions were verified in highly nonlinear flow conditions, gain and phase perturbations, and spoiler deployment. A non-design plunge instability condition was also successfully suppressed.

Mukhopadhyay, Vivek↗
NASA NTRS2004

Project Golden Gate: towards real-time Java in space missions

This paper describes the problem domain and our experimentation with the first commercial implementation of the Real Time Specification for Java. The two main issues explored in this report are: (1) the effect of RTSJ's non-heap memory on the programming model, and (2) performance benchmarking of RTSJ/Linux relative to C++/VxWorks.

lander↗
NASA NTRS2010

Modeling Respiratory Toxicity of Authentic Lunar Dust

The lunar expeditions of the Apollo operations from the 60 s and early 70 s have generated awareness about lunar dust exposures and their implication towards future lunar explorations. Critical analyses on the reports from the Apollo crew members suggest that lunar dust is a mild respiratory and ocular irritant. Currently, NASA s space toxicology group is functioning with the Lunar Airborne Dust Toxicity Assessment Group (LADTAG) and the National Institute for Occupational Safety and Health (NIOSH) to investigate and examine toxic effects to the respiratory system of rats in order to establish permissible exposure levels (PELs) for human exposure to lunar dust. In collaboration with the space toxicology group, LADTAG and NIOSH the goal of the present research is to analyze dose-response curves from rat exposures seven and twenty-eight days after intrapharyngeal instillations, and model the response using BenchMark Dose Software (BMDS) from the Environmental Protection Agency (EPA). Via this analysis, the relative toxicities of three types of Apollo 14 lunar dust samples and two control dust samples, titanium dioxide (TiO2) and quartz will be determined. This will be executed for several toxicity endpoints such as cell counts and biochemical markers in bronchoaveolar lavage fluid (BALF) harvested from the rats.

Santana, Patricia A.↗
NASA NTRS2011

Human Thermal Model Evaluation Using the JSC Human Thermal Database

The human thermal database developed at the Johnson Space Center (JSC) is used to evaluate a set of widely used human thermal models. This database will facilitate a more accurate evaluation of human thermoregulatory response using in a variety of situations, including those situations that might otherwise prove too dangerous for actual testing--such as extreme hot or cold splashdown conditions. This set includes the Wissler human thermal model, a model that has been widely used to predict the human thermoregulatory response to a variety of cold and hot environments. These models are statistically compared to the current database, which contains experiments of human subjects primarily in air from a literature survey ranging between 1953 and 2004 and from a suited experiment recently performed by the authors, for a quantitative study of relative strength and predictive quality of the models. Human thermal modeling has considerable long term utility to human space flight. Such models provide a tool to predict crew survivability in support of vehicle design and to evaluate crew response in untested environments. It is to the benefit of any such model not only to collect relevant experimental data to correlate it against, but also to maintain an experimental standard or benchmark for future development in a readily and rapidly searchable and software accessible format. The Human thermal database project is intended to do just so; to collect relevant data from literature and experimentation and to store the data in a database structure for immediate and future use as a benchmark to judge human thermal models against, in identifying model strengths and weakness, to support model development and improve correlation, and to statistically quantify a model s predictive quality.

Cognata, T.↗
NASA NTRS2012

Human Thermal Model Evaluation Using the JSC Human Thermal Database

Human thermal modeling has considerable long term utility to human space flight. Such models provide a tool to predict crew survivability in support of vehicle design and to evaluate crew response in untested space environments. It is to the benefit of any such model not only to collect relevant experimental data to correlate it against, but also to maintain an experimental standard or benchmark for future development in a readily and rapidly searchable and software accessible format. The Human thermal database project is intended to do just so; to collect relevant data from literature and experimentation and to store the data in a database structure for immediate and future use as a benchmark to judge human thermal models against, in identifying model strengths and weakness, to support model development and improve correlation, and to statistically quantify a model s predictive quality. The human thermal database developed at the Johnson Space Center (JSC) is intended to evaluate a set of widely used human thermal models. This set includes the Wissler human thermal model, a model that has been widely used to predict the human thermoregulatory response to a variety of cold and hot environments. These models are statistically compared to the current database, which contains experiments of human subjects primarily in air from a literature survey ranging between 1953 and 2004 and from a suited experiment recently performed by the authors, for a quantitative study of relative strength and predictive quality of the models.

Bue, Grant↗
NASA NTRS2015

Cloud-Based Numerical Weather Prediction for Near Real-Time Forecasting and Disaster Response

The use of cloud computing resources continues to grow within the public and private sector components of the weather enterprise as users become more familiar with cloud‐computing concepts, and competition among service providers continues to reduce costs and other barriers to entry. Cloud resources can also provide capabilities similar to high‐performance computing environments, supporting multi‐node systems required for near real‐time, regional weather predictions. Referred to as "Infrastructure as a Service", or IaaS, the use of cloud-based computing hardware in an on‐demand payment system allows for rapid deployment of a modeling system in environments lacking access to a large, supercomputing infrastructure. Use of IaaS capabilities to support regional weather prediction may be of particular interest to developing countries that have not yet established large supercomputing resources, but would otherwise benefit from a regional weather forecasting capability. Recently, collaborators from NASA Marshall Space Flight Center and Ames Research Center have developed a scripted, on‐demand capability for launching the NOAA/NWS Science and Training Resource Center (STRC) Environmental Modeling System (EMS), which includes pre‐compiled binaries of the latest version of the Weather Research and Forecasting (WRF) model. The WRF‐EMS provides scripting for downloading appropriate initial and boundary conditions from global models, along with higher‐resolution vegetation, land surface, and sea surface temperature data sets provided by the NASA Short‐term Prediction Research and Transition (SPoRT) Center. This presentation will provide an overview of the modeling system capabilities and benchmarks performed on the Amazon Elastic Compute Cloud (EC2) environment. In addition, the presentation will discuss future opportunities to deploy the system in support of weather prediction in developing countries supported by NASA's SERVIR Project, which provides capacity building activities in environmental monitoring and prediction across a growing number of regional hubs throughout the world. Capacity‐building applications that extend numerical weather prediction to developing countries are intended to provide near real‐time applications to benefit public health, safety, and economic interests, but may have a greater impact during disaster events by providing a source for local predictions of weather‐related hazards, or impacts that local weather events may have during the recovery phase.

Molthan, Andrew↗
NASA NTRS2015

Contemporary Impact Analysis Methodology for Planetary Sample Return Missions

Development of an Earth entry vehicle and the methodology created to evaluate the vehicle's impact landing response when returning to Earth is reported. NASA's future Mars Sample Return Mission requires a robust vehicle to return Martian samples back to Earth for analysis. The Earth entry vehicle is a proposed solution to this Mars mission requirement. During Earth reentry, the vehicle slows within the atmosphere and then impacts the ground at its terminal velocity. To protect the Martian samples, a spherical energy absorber called an impact sphere is under development. The impact sphere is composed of hybrid composite and crushable foam elements that endure large plastic deformations during impact and cause a highly nonlinear vehicle response. The developed analysis methodology captures a range of complex structural interactions and much of the failure physics that occurs during impact. Numerical models were created and benchmarked against experimental tests conducted at NASA Langley Research Center. The postimpact structural damage assessment showed close correlation between simulation predictions and experimental results. Acceleration, velocity, displacement, damage modes, and failure mechanisms were all effectively captured. These investigations demonstrate that the Earth entry vehicle has great potential in facilitating future sample return missions.

Perino, Scott V.↗
NASA NTRSDate not supplied

An Expanded Role for Python in Expediting System Simulation Development

The Python programming language has traditionally been used as a “scripting” language and is not generally recognized as a language for building system simulations, where C++, Java, and other compiled languages are typically used. While very powerful and gaining favor for a large set of programming tasks, Python is generally regarded as not having the speed to directly do the extensive numeric computations required in large-scale simulation. This paper aims to present an approach, supported by case studies, to re-think this assertion. Directly using Python in this new role has the potential to expedite an agile, spiral cycle of development of design-test-modify for systems simulation.

programming language↗
NASA NTRSDate not supplied

Transonic Limit Cycle Oscillations of the Benchmark Supercritical Wing

This paper considers transonic flutter mechanisms of the Benchmark Supercritical Wing, a model under study in the Aeroelastic Prediction Workshop series. Flutter boundaries are mapped out across an angle of attack sweep at Mach 0.8, utilizing both time-domain and linearized frequency-domain solvers, manual meshes and adapted meshes, and various governing equations. With increased angle of attack, linearized and finite amplitude flutter predictions exhibit differences above 3◦ as the flow begins to separate; the latter predictions are found to be driven by subcritical limit cycle oscillations whose strength increases with angle of attack. Moderate perturbation values provide a stability boundary at 5◦ which matches the experimental data, but it is not clear how the experimental perturbation, from one test condition to the next, can be reasonably characterized.

Bret Stanford↗
DOE OSTI2025

Why Is Attention Sparse In Particle Transformer?

Transformer-based models have achieved state-of-the-art performance in jet tagging at the CERN Large Hadron Collider (LHC), with the Particle Transformer (ParT) representing a leading example of such models. A striking feature of ParT is its sparse, nearly binary, attention structure, raising questions about the origin of this behavior and whether it encodes physically meaningful correlations. In this work, we investigate the source of ParT's sparse attention by comparing models trained on multiple benchmark datasets and examine the relative contributions of the attention term and the physics-inspired interaction matrix before softmax. We find that binary sparsity arises primarily from the attention mechanism itself, with the interaction matrix playing a secondary role. Moreove, we show that ParT is able to identify key jet substructure elements, such as leptons in semileptonic top decays, even without explicit particle identification inputs. These results provide new insight into the interpretability of transformer-based jet taggers and clarify the conditions under which sparse attention patterns emerge in ParT.

Legge, Timothy [UC, San Diego]↗
DOE OSTI2026

Beyond Point Estimates: Benchmarking Uncertainty Quantification Methods on the AION-1 Astronomical Foundation Model

Foundation models for astronomical surveys offer powerful learned representations that can be transferred to downstream regression tasks such as galaxy property estimation. However, point predictions alone are insufficient for scientific inference; reliable uncertainty quantification (UQ) is essential. We compare seven UQ methods on galaxy property regression using frozen AION-1 foundation-model embeddings, predicting redshift, stellar mass, stellar-population age, gas-phase metallicity, and specific star-formation rate, from Legacy Survey photometry/imaging and DESI spectra, with PROVABGS-derived labels. Distribution-free conformal methods achieve marginal coverage within $\sim$1 pp of the nominal 90% across all properties, while non-conformal baselines (Deep Ensembles, MC~Dropout) fail to calibrate reliably. Among conformal approaches, Conformalized Quantile Regression (CQR) delivers the best coverage in the bin with the poorest model predictions. More importantly, only the Locally Valid and Discriminative (LVD) framework -- particularly when operating on AION-1 embeddings -- also provides finite-sample \emph{local validity}, producing intervals that adapt to each galaxy's local prediction difficulty rather than relying on marginal guarantees alone. These results establish conformal prediction, and LVD in particular, as the preferred UQ framework for uncertainty-aware inference on foundation-model embeddings in astrophysics.

Tame-Narvaez, Karla [Fermilab] (ORCID:000000022249↗
NASA NTRSDate not supplied

Transition prediction in hypersonic regime on complex geometries with RANS-based models

In the near future, RANS computations will continue to play a significant role in the design of hypersonic vehicles with complex geometries. Therefore, it is imperative to continue testing, benchmarking, and refining the RANS models. In the present study, we evaluate RANS-like, transport equations-based models for predicting laminar-turbulent transition over a full-scale scale model of the BOLT flight configuration that was tested in the CUBRC LENS-II wind tunnel test facility. Based on the availability of the experimental results, comparisons are made between computations from several pre-existing transition models and Computational Fluid Dynamics (CFD) codes, with an emphasis on using the same computational meshes and flow conditions for all computations. The analysis covers the sensitivity of the transition predictions to the input parameters for five different transition models (four mainstream models designed for low-speed flows and a uniquely high-speed model), grid resolution, and the details of model implementation across three different flow solvers. The results show that the phenomenological models can describe significant aspects of the measured transition front. However, a number of additional improvements are required before these models can offer more reliable estimates of transition in high-speed flows.

CFD↗
NASA NTRSDate not supplied

Transition Prediction in Hypersonic Regime on Complex Geometries With Rans-Based Models

In the near future, RANS computations will continue to play a significant role in the design of hypersonic vehicles with complex geometries. Therefore, it is imperative to continue testing, benchmarking, and refining the RANS models. In the present study, we evaluate RANS-like, transport equations-based models for predicting laminar-turbulent transition over a full-scale scale model of the BOLT flight configuration that was tested in the CUBRC LENS-II wind tunnel test facility. Based on the availability of the experimental results, comparisons are made between computations from several pre-existing transition models and Computational Fluid Dynamics (CFD) codes, with an emphasis on using the same computational meshes and flow conditions for all computations. The analysis covers the sensitivity of the transition predictions to the input parameters for five different transition models (four mainstream models designed for low-speed flows and a uniquely high-speed model), grid resolution, and the details of model implementation across three different flow solvers. The results show that the phenomenological models can describe significant aspects of the measured transition front. However, a number of additional improvements are required before these models can offer more reliable estimates of transition in high-speed flows.

CFD↗
DOE OSTI2024

DECOVALEX-2023: Task F1 Final Report

DECOVALEX-2023 Task F is a comparison of models and methods for post-closure performance assessment (PA) of a deep geologic repository for radioactive waste. The general aims of Task F are to build confidence in the models, methods, and software used for PA and to stimulate additional research and development in PA methodologies. The task objectives are to motivate development of PA modelling skills and capabilities, to examine the influence of model choices on calculated repository performance, and to compare the uncertainties introduced by model choices to other sources of uncertainty. Task F involves no actual experiment or site. It is a PA modelling exercise that requires the conceptual development of hypothetical repository designs and geologic settings. Because three of the teams were interested in salt and the rest of the teams were interested in crystalline rock, Task F was split into two branches: Task F1 for crystalline rock and Task F2 for salt. This report is for Task F1, crystalline rock. Teams from seven countries (Canada, Czech Republic, Germany, Korea, Sweden, Taiwan, and United States) participated in Task F1. The teams worked together to define the features, events, and processes of the reference case repository and established a set of performance measures. In addition, they defined a set of benchmark problems designed to test and compare modelling capabilities for fracture flow and transport at different scales. The repository design and benchmark problems are documented in a Task Specification that evolved over time as the group honed the specifications. The benchmark problems verified that each team can aptly model flow and transport in fractured media in 1-, 2-, and 3-dimensions. Two general approaches were used for the 3-dimensional benchmarks: discrete fracture network (DFN) and equivalent continuous porous medium (ECPM). DFN modelling involves explicit meshing of each fracture while ECPM modelling aims to capture the effective porosity and directional permeability of each cell in a space-filling mesh as affected by intersecting fractures. In some models, a combination of the two is used, i.e., DFN for large known fractures and ECPM for the rest of the domain. Transport is solved by using either the advection-dispersion equation or particle tracking. Although some variation is observed among model breakthrough curves in the benchmark problems, there is strong agreement in breakthrough behaviour up to at least the 75 th percentile for all benchmarks. At the 90 th percentile, breakthrough results show larger differences, suggesting several models retain substantially higher fractions of tracer in regions of slower moving water. In addition to the flow and transport benchmarks, several teams completed the source term benchmark, verifying capabilities for modelling radionuclide decay and ingrowth, waste package breach, instant release fractions, fuel matrix degradation rates, and radionuclide solubility limitations. The reference case is conceptualized as a generic spent fuel repository at a depth of 450 m in fractured crystalline rock. The repository has 50 parallel backfilled drifts, each with 50 deposition holes 6 m apart. Each deposition hole contains a 4-PWR waste package and bentonite buffer. The rock domain is 5 km in length, 2 km in width, and 1 km in depth. It has 6 deterministic fractured deformation zones and a multitude of stochastic fractures. Teams generally used the ECPM approach for the entire rock or a hybrid approach in which the deterministic fracture zones are modelled with a DFN and the rest of the rock is modelled by ECPM. Of the reference case problems specified, only the results of the initial reference case problem are compared in this report. The initial problem focuses on transport from the deposition holes to the surface, i.e., it neglects waste package performance. Tracers are released at all waste package locations at time zero and tracked for their releases to the near field and ground surface. The water fluxes calculated at the ground surface entry and exit regions of the domain are similar for all models except for two that have considerably lower fluxes. For tracer transport, large differences are observed among models in the magnitude of tracer transported. Much of the difference appears to be due to how the repository is implemented and hence the different degrees of repository simplification. Models that exclude the drifts, buffer, and backfill from the domain tend to show greater release of tracers and radionuclides from the repository. The initial study presented here indicates that major differences in modelling important processes within the repository (e.g., diffusion through buffer and backfill) can produce broadly different release and transport results, especially when those processes are excluded. Even for the models that included all specified features, events, and processes, the results show significant differences and demonstrate the importance of examining multiple modelling approaches in performance assessment. The differences in results observed in this study are expected to motivate teams to either increase complexity in future versions of the reference case models or to improve methods to account for the effects of simplified features and processes. Either way, future improvements in these models are expected to produce results that more closely agree.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS2016

Reference Solutions for Benchmark Turbulent Flows in Three Dimensions

A grid convergence study is performed to establish benchmark solutions for turbulent flows in three dimensions (3D) in support of turbulence-model verification campaign at the Turbulence Modeling Resource (TMR) website. The three benchmark cases are subsonic flows around a 3D bump and a hemisphere-cylinder configuration and a supersonic internal flow through a square duct. Reference solutions are computed for Reynolds Averaged Navier Stokes equations with the Spalart-Allmaras turbulence model using a linear eddy-viscosity model for the external flows and a nonlinear eddy-viscosity model based on a quadratic constitutive relation for the internal flow. The study involves three widely-used practical computational fluid dynamics codes developed and supported at NASA Langley Research Center: FUN3D, USM3D, and CFL3D. Reference steady-state solutions computed with these three codes on families of consistently refined grids are presented. Grid-to-grid and code-to-code variations are described in detail.

Diskin, Boris↗
DOE OSTI2022

Simulation of plasma transport in MPS-LD linear plasma device by using BOUT++

Here a linear plasma device (LPD) module based on the 2D transport module under the BOUT++ framework is developed in this paper to simulate plasma transport in the LPD. The LPD module includes three parts, i.e. magnetic field calculation, simulation mesh generation and plasma transport setup. The magnetic field is calculated with the circular current loop using the location and current information of each coil. The mesh generation code can produce a simulation mesh for LPD by employing the magnetic field. The plasma transport model is based on the reduced Braginskii equations, which consist of the continuity equation, momentum equation, and energy equation. The fluid neutral model is applied for neutral particle simulation. Deuterium (D) and helium (He) ions and atoms can be simulated by the model. The first attempt to simulate plasma transport in the new LPD, called multiple plasma simulation linear plasma device (MPS-LD), is presented using the developed model. The D plasma transport in the MPS-LD is simulated and benchmarked against the two-point model, showing the validation of the BOUT++ simulation. The effects of radial transport on the heat load to the target are studied, which illustrates the significant impact of the radial diffusivities $D_⟂$ and $\mathcal{X}_{⟂i,e}$ on the plasma. Moreover, the He impurity injection process during the discharge is studied with emphasis on plasma–impurity interactions. The simulation results show that He injection can reduce the plasma energy load to the target significantly, and the efficiency depends on the He source density and injection velocity. The present work provides an alternative and flexible simulation tool for plasma transport in LPDs.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
NASA NTRS2014

Multiscale Analysis of Structurally-Graded Microstructures Using Molecular Dynamics, Discrete Dislocation Dynamics and Continuum Crystal Plasticity

A multiscale modeling methodology is developed for structurally-graded material microstructures. Molecular dynamic (MD) simulations are performed at the nanoscale to determine fundamental failure mechanisms and quantify material constitutive parameters. These parameters are used to calibrate material processes at the mesoscale using discrete dislocation dynamics (DD). Different grain boundary interactions with dislocations are analyzed using DD to predict grain-size dependent stress-strain behavior. These relationships are mapped into crystal plasticity (CP) parameters to develop a computationally efficient finite element-based DD/CP model for continuum-level simulations and complete the multiscale analysis by predicting the behavior of macroscopic physical specimens. The present analysis is focused on simulating the behavior of a graded microstructure in which grain sizes are on the order of nanometers in the exterior region and transition to larger, multi-micron size in the interior domain. This microstructural configuration has been shown to offer improved mechanical properties over homogeneous coarse-grained materials by increasing yield stress while maintaining ductility. Various mesoscopic polycrystal models of structurally-graded microstructures are generated, analyzed and used as a benchmark for comparison between multiscale DD/CP model and DD predictions. A final series of simulations utilize the DD/CP analysis method exclusively to study macroscopic models that cannot be analyzed by MD or DD methods alone due to the model size.

Saether, Erik↗