Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Sensitivity Simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,603 records · Page 89

Guidance, Navigation, and Control Performance for the GOES-R Spacecraft

The Geostationary Operational Environmental Satellite-R Series (GOES-R) is the first of the next generation geostationary weather satellites. The series represents a dramatic increase in Earth observation capabilities, with 4 times the resolution, 5 times the observation rate, and 3 times the number of spectral bands. GOES-R also provides unprecedented availability, with less than 120 minutes per year of lost observation time. This paper presents the Guidance Navigation & Control (GN&C) requirements necessary to realize the ambitious pointing, knowledge, and Image Navigation and Registration (INR) objectives of GOES-R. Because the suite of instruments is sensitive to disturbances over a broad spectral range, a high fidelity simulation of the vehicle has been created with modal content over 500 Hz to assess the pointing stability requirements. Simulation results are presented showing acceleration, shock response spectra (SRS), and line of sight (LOS) responses for various disturbances from 0 Hz to 512 Hz. Simulation results demonstrate excellent performance relative to the pointing and pointing stability requirements, with LOS jitter for the isolated instrument platform of approximately 1 micro-rad. Attitude and attitude rate knowledge are provided directly to the instrument with an accuracy defined by the Integrated Rate Error (IRE) requirements. The data are used internally for motion compensation. The final piece of the INR performance is orbit knowledge, which GOES-R achieves with GPS navigation. Performance results are shown demonstrating compliance with the 50 to 75 m orbit position accuracy requirements. As presented in this paper, the GN&C performance supports the challenging mission objectives of GOES-R.

Control↗

Informing Algorithms from Ground Validation: The GPM Combined Algorithm

Ground validation (GV) for the Global Precipitation Measurement (GPM) mission encompasses in-situ (e.g., gauge, disdrometer) measurements, ground radar products, and comprehensive datasets from dedicated airborne field campaigns. These datasets are used for direct validation of the precipitation products from GPM as well as to inform assumptions used by the algorithms that produce these products. This presentation will focus on current and potential such uses of GV data in the GPM combined radar-radiometer algorithm.The GPM combined algorithm, by virtue of using data from the Dual-frequency Precipitation Radar (DPR) and GPM Microwave Imager (GMI), is the most well-constrained instantaneous precipitation product from GPM. It also plays an important in role the passive microwave algorithms as a basis for the construction of brightness temperature-precipitation profile databases and is a calibrator for the multi- satellite gridded product IMERG. Since both radar and radiometer data are used as observational inputs, and even with these data the retrievals are underconstrained, microphysical properties of the hydrometeor profile that are relevant over the range of GMI and DPR wavelengths and incidence angles need to be assumed by the algorithm forward models. Such properties include the normalized intercept parameter (N w ) and shape parameter () of the particle size distribution, ice size-density relationship, and particle size-aspect ratio relationships. The sub-beam variability must also be prescribed in order to accurately simulate the observed radar reflectivity profiles without introducing significant biases. The sensitivity of the algorithm to these parameters, along with their mean values and variability, will be discussed. Examples of future directions include refinement with new data (particularly the assumptions related to ice), and seeking relationships between assumptions and observable or environmental data.

Munchak, Joe.↗

Visual end-effector position error compensation for planetary robotics

This paper describes a vision-guided manipulation algorithm that improves arm end-effector positioning to subpixel accuracy and meets the highly restrictive imaging and computational constraints of a planetary robotic flight system. Analytical, simulation-based, and experimental analyses of the algorithm's effectiveness and sensitivity to camera and arm model error is presented along with results on several prototype research systems and ground-in-the-loop technology experiments on the Mars Exploration Rover (MER) vehicles. A computationally efficient and robust subpixel end-effector fiducial detector that is instrumental to the algorithm's ability to achieve high accuracy is also described along with its validation results on MER data.

Nickels, Kevin↗

The Earth Model Column Collaboratory (EMC2) v1.1: An Open-Source Ground-Based Lidar and Radar Instrument Simulator and Subcolumn Generator for Large-Scale Models

Climate models are essential for our comprehensive understanding of Earth's atmosphere and can provide critical insights on future changes decades ahead. Because of these critical roles, today's climate models are continuously being developed and evaluated using constraining observations and measurements obtained by satellites, airborne, and ground-based instruments. Instrument simulators can provide a bridge between the measured or retrieved quantities and their sampling in models and field observations while considering instrument sensitivity limitations. Here we present the Earth Model Column Collaboratory (EMC2), an open-source ground-based lidar and radar instrument simulator and subcolumn generator, specifically designed for large-scale models, in particular climate models, but also applicable to high-resolution model output. EMC2 provides a flexible framework enabling direct comparison of model output with ground-based observations, including generation of subcolumns that may statistically represent finer model spatial resolutions. In addition, EMC2 emulates ground-based (and air- or space-borne) measurements while remaining faithful to large-scale models' physical assumptions implemented in their cloud or radiation schemes. The simulator uses either single particle or bulk particle size distribution lookup tables, depending on the selected scheme approach, to perform the forward calculations. To facilitate model evaluation, EMC2 also includes three hydrometeor classification methods, namely, radar- and sounding-based cloud and precipitation detection and classification, lidar-based phase classification, and a Cloud Feedback Model Intercomparison Project Observational Simulator Package (COSP) lidar simulator emulator. The software is written in Python, is easy to use, and can be straightforwardly customized for different models, radars, and lidars. Following the description of the logic, functionality, features, and software structure of EMC2, we present a case study of highly supercooled mixed-phase cloud based on measurements from the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) West Antarctic Radiation Experiment (AWARE). We compare observations with the application of EMC2 to outputs from four configurations of the NASA Goddard Institute for Space Studies (GISS) climate model (ModelE3) in single-column model (SCM) mode and from a large-eddy simulation (LES) model. We show that two of the four ModelE3 configurations can form and maintain highly supercooled precipitating cloud for several hours, consistent with observations and LES. While our focus is on one of these ModelE3 configurations, which performed slightly better in this case study, both of these configurations and the LES results post-processed with EMC2 generally provide reasonable agreement with observed lidar and radar variables. As briefly demonstrated here, EMC2 can provide a lightweight and flexible framework for comparing the results of both large-scale and high-resolution models directly with observations, with relatively little overhead and multiple options for achieving consistency with model microphysical or radiation scheme physics.

Earth Model Column Collaboratory↗

Improving the Representation of Land Surface Processes using the Data Assimilation Research Testbed (DART)

The land surface is a critical part of the earth system as processes related to water, carbon, energy and nitrogen cycling have important implications for climate forcing, air quality, water availability and seasonal atmospheric forecasting. Despite advances in land surface modeling, land surface model performance is often limited because of errors related to initial and boundary conditions, model structure, and parameters. Data assimilation (DA) techniques combined with an expanding network of earth system observations present an opportunity to reduce these errors and improve simulations. Here we apply an Ensemble Kalman Filter DA system as part of the Data Assimilation Research Testbed to a variety of land surface simulations. First, we describe the use of remotely sensed biomass observations to provide improved simulations of plant phenology, carbon and water cycling for regions highly sensitive to climate change (Western US, China, and Arctic). We discuss approaches to account for systemic biases between models and observations, including the use of spatially-varying adaptive ensemble inflation as an alternative approach to re-scaling soil moisture observations. Finally, we discuss a strategy to incorporate complementary observations (snow water equivalent, solar-induced fluorescence) to better constrain the representation of carbon and water cycling across complex terrain.

DART↗

Optimal Decision Making in High-Throughput Virtual Screening Pipelines

ABSTRACT Effective selection of the potential candidates that meet certain conditions in a tremendously large search space has been one of the major concerns in many real-world applications. In addition to the nearly infinitely large search space, rigorous evaluation of a sample based on the reliable experimental or computational platform is often prohibitively expensive, making the screening problem more challenging. In such a case, constructing a high-throughput screening (HTS) pipeline that pre-sifts the samples expected to be potential candidates through the efficient earlier stages, results in a significant amount of savings in resources. However, to the best of our knowledge, despite many successful applications, no one has studied optimal pipeline design or optimal pipeline operations. In this study, we propose two optimization frameworks, applying to most (if not all) screening campaigns involving experimental or/and computational evaluations, for optimally determining the screening thresholds of an HTS pipeline. We validate the proposed frameworks on both analytic and practical scenarios. In particular, we consider the optimal computational campaign for the long non-coding RNA (lncRNA) classification as a practical example. To accomplish this, we built the high-throughput virtual screening (HTVS) pipeline for classifying the lncRNA. The simulation results demonstrate that the proposed frameworks significantly reduce the effective selection cost per potential candidate and make the HTS pipelines less sensitive to their structural variations. In addition to the validation, we provide insights on constructing a better HTS pipeline based on the simulation results.

97 MATHEMATICS AND COMPUTING↗

Constraining the masses of high-redshift clusters with weak lensing: Revised shape calibration testing for the impact of stronger shears and increased blending

Weak lensing measurements suffer from well-known shear estimation biases, which can be partially corrected for with the use of image simulations. Here we present an analysis of simulated images that mimic Hubble Space Telescope/Advance Camera for Surveys observations of high-redshift galaxy clusters, including cluster specific issues such as non-weak shear and increased blending. Our synthetic galaxies have been generated to have similar observed properties as the background-selected source samples studied in the real images. First, we used simulations with galaxies placed on a grid to determine a revised signal-to-noise-dependent (S/N KSB ) correction for multiplicative shear measurement bias, and to quantify the sensitivity of our KSB+ bias calibration to mismatches of galaxy or PSF properties between the real data and the simulations. Next, we studied the impact of increased blending and light contamination from cluster and foreground galaxies, finding it to be negligible for high-redshift (z > 0.7) clusters, whereas shear measurements can be affected at the ~1% level for lower redshift clusters given their brighter member galaxies. Finally, we studied the impact of fainter neighbours and selection bias using a set of simulated images that mimic the positions and magnitudes of galaxies in Cosmic Assembly Near-IR Deep Extragalactic Legacy Survey (CANDELS) data, thereby including realistic clustering. While the initial SExtractor object detection causes a multiplicative shear selection bias of –0.028 ± 0.002, this is reduced to –0.016 ± 0.002 by further cuts applied in our pipeline. Given the limited depth of the CANDELS data, we compared our CANDELS-based estimate for the impact of faint neighbours on the multiplicative shear measurement bias to a grid-based analysis, to which we added clustered galaxies to even fainter magnitudes based on Hubble Ultra Deep Field data, yielding a refined estimate of ~ –0.013. Our sensitivity analysis suggests that our pipeline is calibrated to an accuracy of ~0.015 once all corrections are applied, which is fully sufficient for current and near-future weak lensing studies of high-redshift clusters. As an application, we used it for a refined analysis of three highly relaxed clusters from the South Pole Telescope Sunyaev-Zeldovich survey, where we now included measurements down to the cluster core (r > 200 kpc) as enabled by our work. Compared to previously employed scales (r > 500 kpc), this tightens the cluster mass constraints by a factor 1.38 on average.

79 ASTRONOMY AND ASTROPHYSICS↗

A FIRE-ACE/SHEBA Case Study of Mixed-Phase Arctic Boundary Layer Clouds: Entrainment Rate Limitations on Rapid Primary Ice Nucleation Processes

Observations of long-lived mixed-phase Arctic boundary layer clouds on 7 May 1998 during the First International Satellite Cloud Climatology Project (ISCCP) Regional Experiment (FIRE)Arctic Cloud Experiment (ACE)Surface Heat Budget of the Arctic Ocean (SHEBA) campaign provide a unique opportunity to test understanding of cloud ice formation. Under the microphysically simple conditions observed (apparently negligible ice aggregation, sublimation, and multiplication), the only expected source of new ice crystals is activation of heterogeneous ice nuclei (IN) and the only sink is sedimentation. Large-eddy simulations with size-resolved microphysics are initialized with IN number concentration N(sub IN) measured above cloud top, but details of IN activation behavior are unknown. If activated rapidly (in deposition, condensation, or immersion modes), as commonly assumed, IN are depleted from the well-mixed boundary layer within minutes. Quasi-equilibrium ice number concentration N(sub i) is then limited to a small fraction of overlying N(sub IN) that is determined by the cloud-top entrainment rate w(sub e) divided by the number-weighted ice fall speed at the surface v(sub f). Because w(sub c)< 1 cm/s and v(sub f)> 10 cm/s, N(sub i)/N(sub IN)<< 1. Such conditions may be common for this cloud type, which has implications for modeling IN diagnostically, interpreting measurements, and quantifying sensitivity to increasing N(sub IN) (when w(sub e)/v(sub f)< 1, entrainment rate limitations serve to buffer cloud system response). To reproduce observed ice crystal size distributions and cloud radar reflectivities with rapidly consumed IN in this case, the measured above-cloud N(sub IN) must be multiplied by approximately 30. However, results are sensitive to assumed ice crystal properties not constrained by measurements. In addition, simulations do not reproduce the pronounced mesoscale heterogeneity in radar reflectivity that is observed.

Fridlin, Ann↗

Sensitivity Analysis for the Component Design App: Analysis of Success Assured Data

A new tool has been developed to perform variance-based global sensitivity analysis (VBGSA) on data from a set-based concurrent engineering software called Success Assured (SA). The tool is part of a digital component design app, which is currently in production as an Accelerated Digital Engineering Pathfinder at Sandia National Laboratories. When working with complex digital models, it is important to understand relationships between inputs and outputs, i.e., how “sensitive” model outputs are to changes in model inputs. After extensive research and trials of various sensitivity analysis methods, it was determined that estimation of Sobol’ indices for VBGSA with Monte Carlo simulation, paired with simple surrogate models, produces the best results for SA data. This tool increases understanding of SA models and streamlines the creation of SA datasets. This report details the methodology and implementation of this sensitivity analysis tool so others can understand it and implement it.

97 MATHEMATICS AND COMPUTING↗

Simulation of the Charge Measurements for the SuperCDMS Soudan Experiment

Astronomical observations lead us to believe that dark matter constitutes the majority of the mass of the Universe, yet it has never been directly observed experimentally. The Super Cryogenic Dark Matter Search Experiment (SuperCDMS) aims to discover the particle nature of dark matter, by developing and using some of the most sensitive detectors ever built. The SuperCDMS detectors are capable of rejecting known particles to search for dark matter interactions, but the discrimination is a complicated analysis task. Previous analyses with SuperCDMS set world leading sensitivity limits to dark matter interactions, but the analysis techniques have not been based on simulations. Now we have developed an efficient simulations infrastructure that will help better understand the detectors, develop a better background model, and optimize the next generation dark matter searches. In this thesis we present the fully-functional simulations infrastructure to produce high quality samples a s well as results for the charge system readout simulations, and comparisons to expectations from data. We show that our simulations well-reproduce dominant features of data, bringing SuperCDMS closer to a robust simulation-based analysis method, much needed for the upcoming SuperCDMS dark matter searches.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

LDSD POST2 Simulation and SFDT-1 Pre-Flight Launch Operations Analyses

The Low-Density Supersonic Decelerator (LDSD) Project's first Supersonic Flight Dynamics Test (SFDT-1) occurred June 28, 2014. Program to Optimize Simulated Trajectories II (POST2) was utilized to develop trajectory simulations characterizing all SFDT-1 flight phases from drop to splashdown. These POST2 simulations were used to validate the targeting parameters developed for SFDT- 1, predict performance and understand the sensitivity of the vehicle and nominal mission designs, and to support flight test operations with trajectory performance and splashdown location predictions for vehicle recovery. This paper provides an overview of the POST2 simulations developed for LDSD and presents the POST2 simulation flight dynamics support during the SFDT-1 launch, operations, and recovery.

Bowes, Angela L.↗

Helicopter simulation technology: An Ames Research Center perspective

The total experience for evidence regarding the levels of motion and visual cueing fidelity required for handling-qualities research in ground-based simulators is reviewed. Positive contributions of cockpit motion were identified, but much remains to be learned regarding the sensitivities of individual control modes to cueing attenuation. A firmer understanding of the pilot's utilization of visual and motion cues is the key to more efficient use of simulation in helicopter control-systems research.

Bray, R. S.↗

A numerical simulation of CCN impacts on weather modification efficiency

Aerosols affect development of clouds and precipitation by serving as cloud condensation nuclei (CCN) and ice nuclei (IN). Considering the dramatically changing ambient aerosol concentration, it is important to examine the potential “side effect” of aerosol pollution on precipitation enhancement by weather modification. In this study, the cloud seeding was performed on a precipitation event in Beijing in the summer of 2008, which is simulated by the NSSL two-moment cloud scheme of the Weather Research and Forecasting (WRF) model. Sensitivity tests were conducted by modifying the ambient aerosol concentration and the ice crystal seeding amount to investigate the cloud seeding efficacy in different CCN concentration scenarios. There was a slight difference in the precipitation distribution between the simulations with two ambient CCN concentrations: the northern precipitation center in polluted scenario was weaker and the southern center was stronger. Compared with normal CCN scenario, the cloud liquid water mass and ice crystal mass in the severe pollution scenario is larger, and the total contents of snow and graupel were not sensitive to the CCN concentration. With the same amount of man-made ice crystals seeding, the precipitation enhancement was quite different under different CCN conditions. The higher the CCN concentration usually leads to stronger precipitation suppression. As CCN concentration increase, the deposition growth of snow, auto-conversion and accretion of ice crystals to snow were weakened, as well as the conversion of melting snow and graupel into rainwater.

54 ENVIRONMENTAL SCIENCES↗

Understanding Uncertainty in Microstructure Evolution and Constitutive Properties in Additive Process Modeling

Coupled process–microstructure–property modeling, and understanding the sources of uncertainty and their propagation toward error in part property prediction, are key steps toward full utilization of additive manufacturing (AM) for predictable quality part development. The OpenFOAM model for process conditions, the ExaCA model for as-solidified grain structure, and the ExaConstit model for constitutive mechanical properties are used as part of the ExaAM modeling framework to examine a few of the various sources of uncertainty in the modeling workflow. In addition to “random” uncertainty (due to random number generation in the orientations and locations of grains present), the heterogeneous nucleation density N 0 and the mean substrate grain spacing S 0 are varied to examine their impact of grain area development as a function of build height in the simulated microstructure. While mean grain area after 1 mm of build is found to be sensitive to N 0 and S 0 , particularly at small N 0 and large S 0 (despite some convergence toward similar values), the resulting grain shapes and overall textures develop in a reasonably similar manner. As a result of these similar textures, ExaConstit simulation using ExaCA representative volume elements (RVEs) from various permutations of N 0 , S 0 , and location within the build resulted in similar yield stress, stress–strain curve shape, and stress triaxiality distributions. It is concluded that for this particular material and scan pattern, 15 layers is sufficient for ExaCA texture and ExaConstit predicted properties to become relatively independent of additional layer simulation, provided that reasonable estimates for N 0 and S 0 are used. However, additional layers of ExaCA will need to be run to obtain mean grain areas independent of build height and baseplate structure.

36 MATERIALS SCIENCE↗

Integrated Neutronics Modeling for Inertial Fusion Energy Systems: Development and Application to LD-FIRST

Lawrence Livermore National Laboratory (LLNL) is proposing a new Laser Driven Fusion Integration Research and Science Test Facility (LD-FIRST) with the goal of providing an experimental testbed for future Inertial Fusion Energy (IFE) systems. However, IFE systems require detailed and accurate multiphysics modeling to quantify material damage, thermal loading, and tritium breeding within complex chamber environments. This article presents the first step in an integrated multiphysics framework that couples meshed CAD-based geometry within Monte Carlo neutronic simulations to enable high-fidelity analysis of IFE chamber concepts, with future coupling to external codes. The neutronics workflow utilizes OpenMC and its third-party capability to use CAD-based geometries through DAGMC and tally on unstructured meshes with Libmesh to evaluate neutron transport behavior, geometric fidelity, and material performance under reactor-relevant conditions. The use of tailored tallies on unstructured meshes in this framework allows direct transfer without interpolating to CFD simulation tools. Two IFE chambers were evaluated, both conceived by LLNL: HYLIFE-II and Laser IFE (LIFE). This work produced high-fidelity conformal surface and volumetric meshes of the HYLIFE-II and LIFE chambers with mapped spatial insight into material damage, thermal loading, and tritium breeding. The HYLIFE-II model was built utilizing available resources and used as a test case to verify that the neutronics framework can handle complex geometries. The LIFE chamber CAD was provided by LLNL and was the main focus of this work. This work analyzes multiple ternary alloy breeding materials for the LIFE chamber, across different 6 Li enrichments to produce data relevant to the LD-FIRST project. This work also investigates the level of model fidelity for the LIFE chamber, and results show that inclusion of detailed first wall and coolant structures increased the predicted tritium breeding ratio (TBR) by ~30%, highlighting the sensitivity of tritium breeding and the need for a high-fidelity simulation framework for IFE chambers. These developments provide a scalable toolset for the design and optimization of next-generation IFE chambers, forming a solid foundation for future coupled multiphysics analysis.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

An evaluation of strategic behaviors in a high fidelity simulated flight task - Comparing primary performance to a figure of merit

The usual method of evaluating flight performance during a simulation is to collect as many primary performance measurements as possible. Then analyze all the measurements to find one sensitive to the manipulations imposed on the pilot during the scenario. Although this method can be useful, it is usually unreliable from one study to another. A simulation was conducted to test an integrated figure of merit (FOM) constructed using a standardized procedure. Pilots flew two full-mission scenarios in an instrument trainer with three degrees of motion freedom. The primary performance measurements selected assessed the pilot's performance in accuracy, smoothness, and activity. The results suggest that the integrated FOMs performed comparably to the primary performance measurements in determining which flight imposed the higher demands on the pilot. The standardized construction process allow adjustments to the FOM, so it can be used in different applications.

Bortolussi, Michael R.↗

Experiment Simulation Configurations Approximating DUNE TDR

The Deep Underground Neutrino Experiment (DUNE) is a next-generation long-baseline neutrino oscillation experiment consisting of a high-power, broadband neutrino beam, a highly capable near detector located on site at Fermilab, in Batavia, Illinois, and a massive liquid argon time projection chamber (LArTPC) far detector located at the 4850L of Sanford Underground Research Facility in Lead, South Dakota. The long-baseline physics sensitivity calculations presented in the DUNE Physics TDR, and in a related physics paper, rely upon simulation of the neutrino beam line, simulation of neutrino interactions in the near and far detectors, fully automated event reconstruction and neutrino classification, and detailed implementation of systematic uncertainties. The purpose of this posting is to provide a simplified summary of the simulations that went into this analysis to the community, in order to facilitate phenomenological studies of long-baseline oscillation at DUNE. Simulated neutrino flux files and a GLoBES configuration describing the far detector reconstruction and selection performance are included as ancillary files to this posting. A simple analysis using these configurations in GLoBES produces sensitivity that is similar, but not identical, to the official DUNE sensitivity. DUNE welcomes those interested in performing phenomenological work as members of the collaboration, but also recognizes the benefit of making these configurations readily available to the wider community.

Abi, B↗

Limitations of Separate Cloud and Rain Categories in Parameterizing Collision-Coalescence for Bulk Microphysics Schemes

Warm rain collision-coalescence has been persistently difficult to parameterize in bulk microphysics schemes. We use a flexible bulk microphysics scheme with bin scheme process parameterizations, called AMP, to investigate reasons for the difficulty. AMP is configured in a variety of ways to mimic bulk schemes and is compared to simulations with the bin scheme upon which AMP is built. We find that an important limitation in traditional bulk schemes is the use of separate cloud and rain categories. When the drop size distribution is instead represented by a continuous distribution, the simulation of cloud-to-rain conversion is substantially improved. We also find large sensitivity to the threshold size to distinguish cloud and rain in traditional schemes; substantial improvement is found by decreasing the threshold from 40 to 25 μm. Neither the use of an assumed functional form for the size distribution nor the choice of predicted distribution moments has a large impact on the ability of AMP to simulate rain production. When predicting four total moments of the liquid drop size distribution, either with a traditional two-category, two-moment scheme with a reduced size threshold, or a four-moment single-category scheme, errors in the evolution of mass and the cloud size distribution are similar, but the single-category scheme has a substantially better representation of the rain size distribution. Optimal moment combinations for the single-category approach are investigated and appear to be linked more to the information content they provide for constraining the size distributions than to their correlation with collision-coalescence rates.

54 ENVIRONMENTAL SCIENCES↗