Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Extension of the Time-Spectral Approach to Overset Solvers for Arbitrary Motion

Forced periodic flows arise in a broad range of aerodynamic applications such as rotorcraft, turbomachinery, and flapping wing configurations. Standard practice involves solving the unsteady flow equations forward in time until the initial transient exits the domain and a statistically stationary flow is achieved. It is often required to simulate through several periods to remove the initial transient making unsteady design optimization prohibitively expensive for most realistic problems. An effort to reduce the computational cost of these calculations led to the development of the Harmonic Balance method [1, 2] which capitalizes on the periodic nature of the solution. The approach exploits the fact that forced temporally periodic flow, while varying in the time domain, is invariant in the frequency domain. Expanding the temporal variation at each spatial node into a Fourier series transforms the unsteady governing equations into a steady set of equations in integer harmonics that can be tackled with the acceleration techniques afforded to steady-state flow solvers. Other similar approaches, such as the Nonlinear Frequency Domain [3,4,5], Reduced Frequency [6] and Time-Spectral [7, 8, 9] methods, were developed shortly thereafter. Additionally, adjoint-based optimization techniques can be applied [10, 11] as well as frequency-adaptive methods [12, 13, 14] to provide even more flexibility to the method. The Fourier temporal basis functions imply spectral convergence as the number of harmonic modes, and correspondingly number of time samples, N, is increased. Some elect to solve the equations in the frequency domain directly, while others choose to transform the equations back into the time domain to simplify the process of adding this capability to existing solvers, but each harnesses the underlying steady solution in the frequency domain. These temporal projection methods will herein be collectively referred to as Time-Spectral methods. Time-Spectral methods have demonstrated marked success in reducing the computational costs associated with simulating periodic forced flows, but have yet to be fully applied to overset or Cartesian solvers for arbitrary motion with dynamic hole-cutting. Overset and Cartesian grid methodologies are versatile techniques capable of handling complex geometry configurations in practical engineering applications, and the combination of the Time-Spectral approach with this general capability potentially provides an enabling new design and analysis tool. In an arbitrary moving-body scenario for these approaches, a Lagrangian body moves through a fixed Eulerian mesh and mesh points in the Eulerian mesh interior to the solid body are removed (cut or blanked), leaving a hole in the Eulerian mesh. During the dynamic motion some gridpoints in the domain are blanked and do not have a complete set of time-samples preventing a direct implementation of the Time-Spectral method. Murman[6] demonstrated the Time-Spectral approach for a Cartesian solver with a rigid domain motion, wherein the hole cutting remains constant. Similarly, Custer et al. [15, 16] used the NASA overset OVERFLOW solver and limited the amount of relative motion to ensure static hole-cutting and interpolation. Recently, Mavriplis and Mundis[17] demonstrated a qualitative method for applying the Time-Spectral approach to an unstructured overset solver for arbitrary motion. The goal of the current work is to develop a robust and general method for handling arbitrary motion with the Time-Spectral approach within an overset or Cartesian mesh method, while still approaching the spectral convergence rate of the original Time-Spectral approach. The viscous OVERFLOW solver will be augmented with the new Time-Spectral algorithm and the capability of the method for benchmark problems in rotorcraft and turbomachinery will be demonstrated. This abstract begins with a brief synopsis of the Time-Spectral approach for overset grids and provides details of e current approach to allow for arbitrary motion. Model problem results in one and two dimensions are included to demonstrate the viability of the method and the convergence properties. Section IV briefly outlines the implementation into the OVERFLOW solver, and the abstract closes with a description of the benchmark test cases which will be included in the final paper.

Leffell, Joshua Isaac↗

Autonomous Aerobraking Development Software: Phase 2 Summary

NASA has used aerobraking at Mars and Venus to reduce the fuel required to deliver a spacecraft into a desired orbit compared to an all-propulsive solution. Although aerobraking reduces the propellant, it does so at the expense of mission duration, large staff, and DSN coverage. These factors make aerobraking a significant cost element in the mission design. By moving on-board the current ground-based tasks of ephemeris determination, atmospheric density estimation, and maneuver sizing and execution, a flight project would realize significant cost savings. The NASA Engineering and Safety Center (NESC) sponsored Phase 1 and 2 of the Autonomous Aerobraking Development Software (AADS) study, which demonstrated the initial feasibility of moving these current ground-based functions to the spacecraft. This paper highlights key state-of-the-art advancements made in the Phase 2 effort to verify that the AADS algorithms are accurate, robust and ready to be considered for application on future missions that utilize aerobraking. The advancements discussed herein include both model updates and simulation and benchmark testing. Rigorous testing using observed flight atmospheres, operational environments and statistical analysis characterized the AADS operability in a perturbed environment.

Cianciolo, Alicia D.↗

An Approach for Performance Assessments of Extravehicular Activity Gloves

The Space Suit Assembly (SSA) Development Team at NASA Johnson Space Center has invested heavily in the advancement of rear‐entry planetary exploration suit design but largely deferred development of extravehicular activity (EVA) glove designs, and accepted the risk of using the current flight gloves, Phase VI, for unique mission scenarios outside the Space Shuttle and International Space Station (ISS) Program realm of experience. However, as design reference missions mature, the risks of using heritage hardware have highlighted the need for developing robust new glove technologies. To address the technology gap, the NASA Game‐Changing Technology group provided start‐up funding for the High Performance EVA Glove (HPEG) Project in the spring of 2012. The overarching goal of the HPEG Project is to develop a robust glove design that increases human performance during EVA and creates pathway for future implementation of emergent technologies, with specific aims of increasing pressurized mobility to 60% of barehanded capability, increasing the durability by 100%, and decreasing the potential of gloves to cause injury during use. The HPEG Project focused initial efforts on identifying potential new technologies and benchmarking the performance of current state of the art gloves to identify trends in design and fit leading to establish standards and metrics against which emerging technologies can be assessed at both the component and assembly levels. The first of the benchmarking tests evaluated the quantitative mobility performance and subjective fit of two sets of prototype EVA gloves developed ILC Dover and David Clark Company as compared to the Phase VI. Both companies were asked to design and fabricate gloves to the same set of NASA provided hand measurements (which corresponded to a single size of Phase Vi glove) and focus their efforts on improving mobility in the metacarpal phalangeal and carpometacarpal joints. Four test subjects representing the design‐to hand anthropometry completed range of motion, grip/pinch strength, dexterity, and fit evaluations for each glove design in pressurized conditions, with and without thermal micrometeoroid garments (TMG) installed. This paper provides a detailed description of hardware and test methodologies used and lessons learned.

Aitchison, Lindsay↗

A New Code SORD for Simulation of Polarized Light Scattering in the Earth Atmosphere

We report a new publicly available radiative transfer (RT) code for numerical simulation of polarized light scattering in plane-parallel atmosphere of the Earth. Using 44 benchmark tests, we prove high accuracy of the new RT code, SORD (Successive ORDers of scattering). We describe capabilities of SORD and show run time for each test on two different machines. At present, SORD is supposed to work as part of the Aerosol Robotic NETwork (AERONET) inversion algorithm. For natural integration with the AERONET software, SORD is coded in Fortran 90/95. The code is available by email request from the corresponding (first) author or from ftp://climate1.gsfc.nasa.gov/skorkin/SORD/.

AERONET↗

Comparison of Fully-Compressible Equation Sets for Atmospheric Dynamics

Traditionally, the equation for the conservation of energy used in atmospheric models is based on potential temperature and is used in place of the total energy conservation. This paper compares the application of the two equations sets for both the Euler and the Navier-Stokes solutions using several benchmark test cases. A high-resolution wave-propagation method which accurately takes into account the source term due to gravity is used for computing the non-hydrostatic atmospheric flows. It is demonstrated that there is little to no difference between the results obtained using the two different equation sets for Euler as well as Navier-Stokes solutions.

Ahmad, Nashat N.↗

Spin Glass Patch Planting

In this paper, we propose a patch planting method for creating arbitrarily large spin glass instances with known ground states. The scaling of the computational complexity of these instances with various block numbers and sizes is investigated and compared with random instances using population annealing Monte Carlo and the quantum annealing DW2X machine. The method can be useful for benchmarking tests for future generation quantum annealing machines, classical and quantum mechanical optimization algorithms.

Quantum Annealing↗

A Linear-Elasticity Solver for Higher-Order Space-Time Mesh Deformation

A linear-elasticity approach is presented for the generation of meshes appropriate for a higher-order space-time discontinuous finite-element method. The equations of linear-elasticity are discretized using a higher-order, spatially-continuous, finite-element method. Given an initial finite-element mesh, and a specified boundary displacement, we solve for the mesh displacements to obtain a higher-order curvilinear mesh. Alternatively, for moving-domain problems we use the linear-elasticity approach to solve for a temporally discontinuous mesh velocity on each time-slab and recover a continuous mesh deformation by integrating the velocity. The applicability of this methodology is presented for several benchmark test cases.

higher-order↗

NASA's Black Marble Nighttime Lights Product Suite

NASA's Black Marble nighttime lights product suite (VNP46) is available at 500 meters resolution since January 2012 with data from the Visible Infrared Imaging Radiometer Suite (VIIRS) Day/Night Band (DNB) onboard the Suomi National Polar-orbiting Platform (SNPP). The retrieval algorithm, developed and implemented for routine global processing at NASA's Land Science Investigator-led Processing System (SIPS), utilizes all high-quality, cloud-free, atmospheric-, terrain-, vegetation-, snow-, lunar-, and stray light-corrected radiances to estimate daily nighttime lights (NTL) and other intrinsic surface optical properties. Key algorithm enhancements include: (1) lunar irradiance modeling to resolve non-linear changes in phase and libration; (2) vector radiative transfer and lunar bidirectional surface anisotropic reflectance modeling to correct for atmospheric and BRDF (Bidirectional Reflectance Distribution Function) effects; (3) geometric-optical and canopy radiative transfer modeling to account for seasonal variations in NTL; and (4) temporal gap-filling to reduce persistent data gaps. Extensive benchmark tests at representative spatial and temporal scales were conducted on the VNP46 time series record to characterize the uncertainties stemming from upstream data sources. Initial validation results are presented together with example case studies illustrating the scientific utility of the products. This includes an evaluation of temporal patterns of NTL dynamics associated with urbanization, socioeconomic variability, cultural characteristics, and displaced populations affected by conflict. Current and planned activities under the Group on Earth Observations (GEO) Human Planet Initiative are aimed at evaluating the products at different geographic locations and time periods representing the full range of retrieval conditions.

Suomi-NPP↗

NASA's Black Marble Product Suite: Validation Strategy

NASA's Black Marble nighttime lights product suite (VNP46) is available at 500m resolution since January 2012 with data fro the Visible Infrared Imaging Radiometer Suite (VIIRS) Day/Night Band (DNB) onboard the Suomi National Polar-orbiting Platform (SNPP). The retrieval algorithm, developed and implemented for routine global processing at NASA's Land Science Investigator-led Processing System (SIPS), utilizes all high-quality, cloud-free, atmospheric-terrain, vegetation, snow, lunar and stray light corrected radiances to estimate daily nighttime lights (NTL) and other intrinsic surface optical properties. Extensive benchmark tests at representative spatial and temporal scales were conducted on the VNP46 time series record to characterize the uncertainties stemming from upstream data sources. Current and planned validation activities under the Group on Earth Observations (GEO) Human Planet Initiative are aimed at evaluating the products at difference geographic locations and time periods representing the full range of retrieval conditions.

GEO Human Planet↗

High-resolution Wave Propagation Method for Stratified Flows

The implementation of the multidimensional f-waves Riemann solver for the time-dependent, three-dimensional, nonhydrostatic, meso- and microscale atmospheric flows is described in detail. The Riemann solver employs flux-based wave decomposition (f-waves) for the calculation of Godunov fluxes in which the flux differences are written directly as the linear combination of the right eigenvectors of the hyperbolic system. The scheme incorporates the source term due to gravity without introducing discretization errors which is an important property in the context of atmospheric flows. The resulting flow solver is conservative, accurate, stable, and well-balanced. The implementation of the solver is evaluated using benchmark test cases for atmospheric dynamics.

Riemann problem↗

Benchmarking Simulations of the Compton Spectrometer and Imager with Calibrations

The Compton Spectrometer and Imager (COSI) is a balloon-borne 𝛾-ray (0.2-5 MeV) telescope designed to study astrophysical sources. COSI employs a compact Compton telescope design utilizing 12 high-purity germanium double-sided strip detectors and is inherently sensitive to polarization. In 2016, COSI was launched from Wanaka, New Zealand and completed a successful 46-day flight on NASA’s new Super Pressure Balloon. In order to perform imaging, spectral, and polarization analysis of the sources observed during the 2016 flight, we compute the detector response from well-benchmarked simulations. As required for accurate simulations of the instrument, we have built a comprehensive mass model of the instrument and developed a detailed detector effects engine which applies the intrinsic detector performance to Monte Carlo simulations. The simulated detector effects include energy, position, and timing resolution, thresholds, dead strips, charge sharing, charge loss, crosstalk, dead time, and detector trigger conditions. After including these effects, the simulations closely resemble the measurements, the standard analysis pipeline used for measurements can also be applied to the simulations, and the responses computed from the simulations are accurate. We have computed the systematic error that we must apply to measured fluxes at certain energies, which is 6.3% on a rage. Here we describe the detector effects engine and the benchmarking tests performed with calibrations.

Sleator, Clio C.↗

Adaptive Learning for Reliability Analysis using Support Vector Machines

A novel algorithm is presented for adaptive learning of an unknown function that separates two regions of a domain.In the context of reliability analysis these two regions represent the failure domain, where a set of constraints or requirements are violated, and a safe domain where they are satisfied. The Limit State Function (LSF) separates these two regions. Evaluating the constraints for a given parameter point requires the evaluation of a computational model that may well be expensive. For this reason we wish to construct a meta-model that can estimate the LSFas accurately as possible, using only a limited amount of training data. This work presents an adaptive strategy employing a Support Vector Machine (SVM) as a meta-model to provide a semi-algebraic approximation of the LSF.We describe an optimization process that is used to select informative parameter points to add to training data at each iteration to improve the accuracy of this approximation. A formulation is introduced for bounding the predictions of the meta-model; in this way we seek to incorporate this aspect of Gaussian Process Models (GPMs) within anSVM meta-model. Finally, we apply our algorithm to two benchmark test cases, demonstrating performance that is comparable with, if not superior, to a standard technique for reliability analysis that employs GPMs

Adaptive learning↗

Numerical Investigation of Flow Over Periodic Hill

Hybrid turbulence modeling strategies that blend between large-eddy simulation and Reynolds-averaged Navier-Stokes promise to make optimal use of the available grid resolution. A delayed detached eddy simulation hybrid turbulence modeling strategy, based on the shear-stress transport turbulence model, was implemented into a finite-volume compressible Navier-Stokes code. Then the flow through a two-dimensional periodic hill channel was simulated. This geometry is a widely accepted benchmark test case for validating hybrid turbulence modeling strategies. The computational grid for the simulation was downloaded from a hybrid turbulence model validation website. The present hybrid turbulence model simulation predicts the size of the separated flow region as well as velocity and Reynolds stress profiles in good agreement with large-eddy simulation reference data.

Computational Fluid Dynamics↗

Flow field Reconstruction for Inhomogeneous Turbulence using Data and Physics Driven Models

A methodology combining Large Eddy Simulation (LES) trained data and a physics driven wave packet model to obtain a reduced order reconstruction for broadband, three-dimensional, temporally stationary but spatially inhomogeneous, incompressible turbulence. Wake turbulence generated by an axisymmetric dragging disk with a turbulent co-flow serves as the benchmark test case. We begin by studying the proper-orthogonal decomposition of the turbulent fluctuations taken from a high-resolution LES to first identify whether the fields demonstrate a low-rank character. It is argued that the presence of the turbulent co-flow results in a largely broadband character lacking any tonal properties. This is especially true for Strouhal numbers greater than 1 and only a small fraction of energy is contained in the leading order Kelvin-Helmholtz modes. As such reconstructions and reduced order modeling purely relying on data from LES does not appear to be a lucrative solution - contrary to problems with strongly tonal character. To supplement the missing energy from a low order truncated mode expansion, we utilize a physics based super-resolution (enrichment) algorithm that relies on spatio-temporally localized Gabor wave packets whose time evolution is described using a set of ordinary differential equations. The reconstructed flow has single- and two-point correlations that are consistent with the reference high resolution simulation data.

SLS↗

A Convexification-Based Outer-Approximation Method for Convex and Nonconvex MINLP

The advancement of domain reduction techniques has significantly enhanced the performance of solvers in mathematical programming. This paper delves into the impact of integrating convexification and domain reduction techniques within the Outer-Approximation method. We propose a refined convexification-based Outer-Approximation method alongside a Branch-and-Bound method for both convex and nonconvex Mixed-Integer Nonlinear Programming problems. These methods have been developed and incorporated into the open-source Mixed-Integer Nonlinear Decomposition Toolbox for Pyomo-MindtPy. Comprehensive benchmark tests were conducted, validating the effectiveness and reliability of our proposed algorithms. These tests highlight the improvements achieved by incorporating convexification and domain reduction techniques into the Outer-Approximation and Branch-and-Bound methods.

Optimization↗

Modeling the Formation and Eruption of Coronal Structures by Linking Data-Driven Magnetofrictional and MHD Simulations for AR 12673

Context .The data-driven and time-dependent modeling of coronal magnetic fields is crucial for understanding solar eruptions. These efforts are complicated by the challenges of finding a balance between physical realism and computing efficiency. One possible technique is to couple two modeling approaches. Aims . Our aim here is to showcase our progress in using time-dependent magnetofrictional model (TMFM) results as input to dynamical magnetohydrodynamic (MHD) simulations. However, due to the different evolution processes in these two models, using TMFM snapshots in an MHD simulation is nontrivial. We address these issues, both physically and numerically, discuss the incompatibility of the TMFM output to serve as the initial condition in MHD simulations, and show our methods of mitigating this. The evolution of the flux systems and the cause of the eruption are investigated. Methods . TMFM is a prevalent approach that has proven to be a very useful tool in the study of the formation of unstable structures in the solar corona. In particular, it is capable of incorporating observational data as initial and boundary conditions and requires shorter computational time compared to MHD simulations. To leverage the efficiency of data-driven TMFM and also to simulate eruptive events in the MHD framework, one can apply TMFM up to a certain time before the expected eruption(s) and then proceed with the simulation in the full or ideal MHD regime in order to more accurately capture the eruption process. Results . We show the results of a benchmark test case with a linked TMFM and MHD simulation to study the evolution of NOAA active region 12673. A rise of a twisted flux bundle through the MHD simulation domain is observed, but we find that the rate of the rise and the altitude reached depends on the time of the TMFM snapshot that was used to initialize the MHD simulation and the helicity injected into the system. The analysis suggested that torus instability and slip-running reconnection could play an important role in the eruption. Conclusions . The results show that the linkage of TMFM and zero-β MHD models can be successfully used to model the eruptive coronal magnetic fields.

F. Daei↗

A Reinforcement Learning Hyper-Heuristic in Multi-Objective Optimization with Application to Structural Damage Identification

Multi-objective optimization allows satisfying multiple decision criteria concurrently, and generally yields multiple solutions. It has the potential to be applied to structural damage identification applications which are oftentimes under-determined. How to achieve high-quality solutions in terms of accuracy, diversity, and completeness is a challenging research subject. The solution techniques and parametric selections are believed to be problem specific. In this research, we formulate a reinforcement learning hyper-heuristic scheme to work coherently with the single-point search algorithm MOSA/R (Multi-Objective Simulated Annealing Algorithm based on Re-seed). The four low-level heuristics proposed can meet various optimization requirements adaptively and autonomously using the domination amount, crowding distance, and hypervolume calculations. The new approach exhibits improved and more robust performance than AMOSA, NSGA-II, and MOEA/D when applied to benchmark test cases. It is then applied to an active damage interrogation scheme for structural damage identification where solution diversity/completeness and accuracy are critically important. Results show that this approach can successfully include the true damage scenario in the solution set identified. The outcome of this research can potentially be extended to a variety of applications.

Pei Cao↗

Harnessing Collaborative Learning Automata to Guide Multi-objective Optimization based Inverse Analysis for Structural Damage Identification

Structural damage identification based on physical models is often transformed into an optimization problem that minimizes the difference between measurement information of structure being monitored and the model prediction in the parametric space. However, the objective function in this context often exhibits multimodality, involving high-dimensional variables due to the reliance on finite element models for damage identification. These features pose challenges to optimization algorithms, where entrapment in local solutions can lead to false positives and false negatives in damage identification. In this research, we propose a reinforcement learning based multi-swarm optimizer to tackle such challenges in pursuit of a small yet diverse solution set that can capture the true damage scenario as one of the solutions. The proposed method leverages the flexibility of the particle swarm optimizer and incorporates novel strategies of metaheuristics to realize targeted improvement. To enable the particle swarm to adaptively select the appropriate search strategy based on the current environment, we adopt the learning automata technique, which sidesteps the need for reward strategy selection that is usually ad hoc at each step of the search. The integration harnesses the automatic learning and self-adaptation capabilities of learning automata, enabling the particles to navigate based on environmental signals. This leads to accumulated probabilities tied to advantageous movements, fostering an adaptive exploration of particles in the search space. The proposed approach is first validated through implementing into benchmark test cases with comparisons. It is then applied to structural damage identification with piezoelectric admittance experimental signals. `The results highlight the capability of the algorithm to identify a small solution set with high accuracy to match the actual damage scenario.

Yang Zhang↗