Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error impact analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42

Modelling galaxy cluster triaxiality in stacked cluster weak lensing analyses

Counts of galaxy clusters offer a high-precision probe of cosmology, but control of systematic errors will determine the accuracy of this measurement. Using Buzzard simulations, we quantify one such systematic, the triaxiality distribution of clusters identified with the redMaPPer optical cluster finding algorithm, which was used in the Dark Energy Survey Year-1 (DES Y1) cluster cosmology analysis. We test whether redMaPPer selection biases the clusters’ shape and orientation and find that it only biases orientation, preferentially selecting clusters with their major axes oriented along the line of sight. Modelling the richness–mass relation as log-linear, we find that the log-richness amplitude ln (A) is boosted from the lowest to highest orientation bin with a significance of 14σ, while the orientation dependence of the richness-mass slope and intrinsic scatter is minimal. We also find that the weak lensing shear-profile ratios of cluster-associated dark haloes in different orientation bins resemble a ‘bottleneck’ shape that can be quantified with a Cauchy function. We test the correlation of orientation with two other leading systematics in cluster cosmology – miscentering and projection – and find a null correlation. The resulting mass bias predicted from our templates confirms the DES Y1 finding that triaxiality is a leading source of bias in cluster cosmology. However, the richness-dependence of the bias confirms that triaxiality does not fully resolve the tension at low-richness between DES Y1 cluster cosmology and other probes. Our model can be used for quantifying the impact of triaxiality bias on cosmological constraints for upcoming weak lensing surveys of galaxy clusters.

79 ASTRONOMY AND ASTROPHYSICS↗

Regional climates in the GISS general circulation model: Surface air temperature

One of the more viable research techniques into global climate change for the purpose of understanding the consequent environmental impacts is based on the use of general circulation models (GCMs). However, GCMs are currently unable to reliably predict the regional climate change resulting from global warming, and it is at the regional scale that predictions are required for understanding human and environmental responses. Regional climates in the extratropics are in large part governed by the synoptic-scale circulation and the feasibility of using this interscale relationship is explored to provide a way of moving to grid cell and sub-grid cell scales in the model. The relationships between the daily circulation systems and surface air temperature for points across the continental United States are first developed in a quantitative form using a multivariate index based on principal components analysis (PCA) of the surface circulation. These relationships are then validated by predicting daily temperature using observed circulation and comparing the predicted values with the observed temperatures. The relationships predict surface temperature accurately over the major portion of the country in winter, and for half the country in summer. These relationships are then applied to the surface synoptic circulation of the Goddard Institute for Space Studies (GISS) GCM control run, and a set of surface grid cell temperatures are generated. These temperatures, based on the larger-scale validated circulation, may now be used with greater confidence at the regional scale. The generated temperatures are compared to those of the model and show that the model has regional errors of up to 10 C in individual grid cells.

Hewitson, Bruce↗

An Overview of the Patch Integral Method (PIM), a New Heat Transfer Analysis Tool for Hypersonic Wind Tunnel Facilities at NASA Langley

NASA Langley’s hypersonic wind tunnels are heavily leveraged for planetary missions. The data collection method in these tunnels is thermography, and surface temperature measurements of the model surface are collected and reduced to produce surface heating data, as seen in Fig 1. However, during model injection, no temperature data are collected, and thus conventional, integral heat transfer methods cannot be used to solve for surface heating. A method was developed in the 1990’s to reduce this data despite the data gap, known as the step approximation method. The method assumes that the film coefficient behaves as a step function, the model is semi-infinite, and thermal properties are constant. With these simplifying assumptions, a Laplace transform can be performed to result in an equation that takes the initial temperature of the model and a temperature at some point in time to back out the film coefficient at that time. This is the method that is used in the current thermographic data reduction software, IHEAT. While computationally light-weight, the step approximation has several issues associated with it. The time-history of temperature is not accounted for, which is vital as heat transfer is an integral process. Additionally, the required semi-infinite assumption is unnecessary and might be violated during runtime. Thermal variation of material properties can have a sizeable impact on heating results and are not modeled by the method. This method also takes multiple seconds to “collapse” to a steady state, which is undesirable from both a facility and data reduction standpoint. The method is also very sensitive to the “effective time” approximation, an approximation of when heating instantaneously starts (which is a nonphysical simplification), and a small variation in this value can result in an error in heating results.

J. S. Cheatwood↗

Improvement in the Thermal-to-Structural Model Mapping Process for Integrated Modeling for the Roman Space Telescope

Integrated Modeling has been a key component of verifying optical requirements for the Nancy Grace Roman Space Telescope (RST) that are either impossible or impractical to verify exclusively through ground testing. Two major areas for integrated Modeling are Jitter and Thermal Distortion that require the exchanges of model performance predictions across disciplines. In both cases, distortions are impressed on optical models to evaluate the impact on boresight alignment and wave front error. In the case of Jitter, the disturbances are driven by reactions to motions most often from actuators; however, in the case of thermal distortion, the motions are driven by thermal expansion or contraction as a result of changing temperatures. This then requires a link further upstream to the thermal model, which is used to predict the thermal performance and temperature gradients and stability. The process for mapping temperatures from a thermal model to a corresponding structural model has been performed numerous times through the RST project lifecycle, with improvements in the accuracy, verification, and effort sought throughout. This paper describes some of the recent improvements to the process, including: capture of the visualization parameters, automatic generation of the mapped images for both the thermal and structural model groupings, and reduction in the effort to assemble the full set of mapped temperatures. These upgrades have greatly reduced the manual effort associated with thermal mapping and allowed for faster turn-around of Integrated Modeling predictions.

Thermal Mapping↗

Assessing the Usefulness of AIRS Radiance Observations in a 4D-Var Assimilation Scheme Using the Penn State/NCAR Mesoscale Model Version 5 (MM5) and a Stand Alone Radiative Transfer Algorithm (SARTA)

Short-term precipitation forecast skill remains poor despite further advances in numerical modeling and data analysis. Utilizing indirect observations, such as the radiance observations obtained from the Atmospheric Infrared Sounder (AIRS), in a 4D-Var assimilation scheme may lead to a rapid improvement in the skill of 12-h QPF. In order to investigate the usefulness of AIRS observations, the adjoint code of a radiative transfer model (SARTA) is developed and linked to MM5 4D-Var system. A statistical comparison of the AIRS radiances with those calculated using the linked MMS-SARTA model is carried out to assess errors in the radiative transfer model, MM5 and AIRS data, and to develop a quality control scheme. Outliers and any bias that may exist in radiative transfer model, MM5 and AIRS data are identified. An adjoint sensitivity study, utilizing the SARTA adjoint model, is then done to identify the relative sensitivities of each spectral channel to such parameters as atmospheric temperature, pressure, and mixing ratio. Another sensitivity study is done using the MM5 alone to determine the sensitivity of the 12-h QPF to model parameters such as atmospheric temperature, pressure, and mixing ratio under various weather regimes (i.e. summertime convection, winter snowfall). Results from these two types of adjoint sensitivity studies are used to determine which AIRS channels contribute most to 12-h QPF under differing weather regimes. This information is useful when conducting 4D-Var experiments using a subset of the 2378 AIRS spectral channels. Finally, 4D-Var experiments are done to analyze the impact of the AIRS observations on the quality of the 12-h QPF results. This project falls under the data assimilation general session topic as specified by the conference organizers.

Carrier, M.↗

Autonomous Navigation Performance During The Hartley 2 Comet Flyby

On November 4, 2010, the EPOXI spacecraft performed a 700-km flyby of the comet Hartley 2 as follow-on to the successful 2005 Deep Impact prime mission. EPOXI, an extended mission for the Deep Impact Flyby spacecraft, returned a wealth of visual and infrared data from Hartley 2, marking the fifth time that high-resolution images of a cometary nucleus have been captured by a spacecraft. The highest resolution science return, captured at closest approach to the comet nucleus, was enabled by use of an onboard autonomous navigation system called AutoNav. AutoNav estimates the comet-relative spacecraft trajectory using optical measurements from the Medium Resolution Imager (MRI) and provides this relative position information to the Attitude Determination and Control System (ADCS) for maintaining instrument pointing on the comet. For the EPOXI mission, AutoNav was tasked to enable continuous tracking of a smaller, more active Hartley 2, as compared to Tempel 1, through the full encounter while traveling at a higher velocity. To meet the mission goal of capturing the comet in all MRI science images, position knowledge accuracies of +/- 3.5 km (3-?) cross track and +/- 0.3 seconds (3-?) time of flight were required. A flight-code-in-the-loop Monte Carlo simulation assessed AutoNav's statistical performance under the Hartley 2 flyby dynamics and determined optimal configuration. The AutoNav performance at Hartley 2 was successful, capturing the comet in all of the MRI images. The maximum residual between observed and predicted comet locations was 20 MRI pixels, primarily influenced by the center of brightness offset from the center of mass in the observations and attitude knowledge errors. This paper discusses the Monte Carlo-based analysis that led to the final AutoNav configuration and a comparison of the predicted performance with the flyby performance.

flyby↗

Evaluation of High Mountain Asia-Land Data Assimilation System (version 1) from 2003 to 2016: 2. The impact of assimilating satellite-based snow cover and freeze/thaw observations into a land surface model

This second paper of the two-part series focuses on demonstrating the impact of assimilating satellite-based snow cover and freeze/thaw observations into the hyper-resolution, offline terrestrial modeling system used for the High Mountain Asia (HMA) region from 2003 to 2016. To this end, this study systematically evaluates a total of six sets of 0.01° (∼1 km) model simulations forced by different precipitation forcings, with and without the dual assimilation scheme enabled, at point-scale, basin-scale, and domain-scale. The key variables of interest include surface net shortwave radiation, surface net longwave radiation, skin temperature, near-surface soil temperature, snow depth, snow water equivalent (SWE), and total runoff. First, the point-scale assessment is mainly conducted via evaluating against ground-based measurements. In general, the assimilation enabled estimates are better than no-assimilation counterparts. Second, the basin-scale runoff assessment demonstrates that across three snow-dominated basins, the assimilation enabled experiment yields systematic improvements in all goodness-of-fit statistics through mitigating the negative effects brought by the fixed long-term precipitation correction factors. For example, when forced by the bias-corrected precipitation, the assimilation-enabled experiment improves the bias by 69%, the root-mean-squared error by 30%, and the unbiased root-mean-squared error by 18% (relative to the no-assimilation counterpart). Finally, the domainscale assessment is conducted via evaluating against satellite-based SWE and skin temperature products. Both sets of domain-scale analysis further corroborate the findings in the point-scale evaluations. Overall, this study suggests the benefits of the proposed multi-variate assimilation system in improving the cryospherichydrological process within a land surface model for use in HMA.

Yuan Xue↗

The impact of new d(p,γ)3 rates on Big Bang Nucleosynthesis

We consider the effect on Big Bang Nucleosynthesis (BBN) of new measurements of the d(p,γ) 3 He cross section by the LUNA Collaboration. These have an important effect on the primordial abundance of D/H which is also sensitive to the baryon density at the time of BBN. We have re-evaluated the thermal rate for this reaction, using a world average of cross section data, which we describe with model-independent polynomials; our results are in good agreement with a similar analysis by LUNA. We then perform a full likelihood analysis combining BBN and Planck cosmic microwave background (CMB) likelihood chains using the new rate combined with previous measurements and compare with the results using previous rates. Concordance between BBN and CMB measurements of the anisotropy spectrum using the old rates was excellent. The predicted deuterium abundance at the Planck value of the baryon density was (D/H) BBN+CMB old = (2.57 ± 0.13) × 10 –5 which can be compared with the value determined from quasar absorption systems (D/H) obs = (2.55 ± 0.03) × 10 –5 . Using the new rates we find (D/H) BBN+CMB = (2.51 ± 0.11) × 10 –5 . We thus find consistency among BBN theory, deuterium and 4He observations, and the CMB, when using reaction rates fit in our data-driven approach. We also find that the new reaction data tightens the constraints on the number of relativistic degrees of freedom during BBN, giving the effective number of light neutrino species N ν = 2.880 ± 0.144 in good agreement with the Standard Model of particle physics. Lastly, we note that the observed deuterium abundance continues to be more precise than the BBN+CMB prediction, whose error budget is now dominated by d(d,n) 3 He and d(d,p) 3 H.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Application of Design of Experiments and Surrogate Modeling within the NASA Advanced Concepts Office, Earth-to-Orbit Design Process

Decisions made during early conceptual design have a large impact upon the expected life-cycle cost (LCC) of a new program. It is widely accepted that up to 80% of such cost is committed during these early design phases. Therefore, to help minimize LCC, decisions made during conceptual design must be based upon as much information as possible. To aid in the decision making for new launch vehicle programs, the Advanced Concepts Office (ACO) at NASA Marshall Space Flight Center (MSFC) provides rapid turnaround pre-phase A and phase A concept definition studies. The ACO team utilizes a proven set of tools to provide customers with a full vehicle mass breakdown to tertiary subsystems, preliminary structural sizing based upon worst-case flight loads, and trajectory optimization to quantify integrated vehicle performance for a given mission. Although the team provides rapid turnaround for single vehicle concepts, the scope of the trade space can be limited due to analyst availability and the manpower requirements for manual execution of the analysis tools. In order to enable exploration of a broader design space, the ACO team has implemented an advanced design methods (ADM) based approach. This approach applies the concepts of design of experiments (DOE) and surrogate modeling to more exhaustively explore the trade space and provide the customer with additional design information to inform decision making. This paper will first discuss the automation of the ACO tool set, which represents a majority of the development effort. In order to fit a surrogate model within tolerable error bounds a number of DOE cases are needed. This number will scale with the number of variable parameters desired and the complexity of the system's response to those variables. For all but the smallest design spaces, the number of cases required cannot be produced within an acceptable timeframe using a manual process. Therefore, automation of the tools was a key enabler for the successful application of an ADM approach to an ACO design study. Following the overview of the tool set automation, an example problem will be given to illustrate the implementation of the ADM approach. The example problem will first cover the inclusion of ground rules and assumptions (GR&A) for a study. The GR&A are very important to the study as they determine the constraints within which a trade study can be conducted. These trades must ultimately reconcile with the customer's desired output and any anticipated "what if" questions. The example problem will then illustrate the setup and execution of a DOE through the automated ACO tools. This process is accomplished more efficiently in this work by splitting the tools into two separate environments. The first environment encompasses the structural optimization and mass estimation tools, while the second is focused on trajectory optimization. Surrogate models are fit to the outputs of each environment and are "integrated" via connection of the surrogate equations. Throughout this process, checks are implemented to compare the output of the surrogates to the output of manually run cases to ensure that the error of the final surrogates is at an acceptable level. The conclusion of the example problem demonstrates the utility of the ADM based approach. Using surrogate models gives the ACO team the ability to visualize vehicle sensitivities to various design parameters and identify regions of interest within the design space. The ADM approach can thus be used to inform concept down selection and isolate promising vehicle configurations to be explored in more detail through the manual design process. In addition it provides the customer with an almost instantaneous turnaround on any ''what if" questions that may arise within the bounds of the surrogate model. This approach ultimately expands the ability of the ACO team to provide its customer with broad and rapid turnaround trade studies for launch vehicle conceptual design. The ability to identify a selection of designs which can meet the customer requirements will help ensure lower LCC of launch vehicle designs originating from ACO.

Zwack, Mathew R.↗

Evaluation of High Mountain Asia-Land Data Assimilation System (version 1) from 2003 to 2016: 2. The impact of assimilating satellite-based snow cover and freeze/thaw observations into a land surface model

This second paper of the two-part series focuses on demonstrating the impact of assimilating satellite-based snow cover and freeze/thaw observations into the hyper-resolution, offline terrestrial modeling system used for the High Mountain Asia (HMA) region from 2003 to 2016. To this end, this study systematically evaluates a total of six sets of 0.01° (∼1 km) model simulations forced by different precipitation forcings, with and without the dual assimilation scheme enabled, at point-scale, basin-scale, and domain-scale. The key variables of interest include surface net shortwave radiation, surface net longwave radiation, skin temperature, near-surface soil temperature, snow depth, snow water equivalent (SWE), and total runoff. First, the point-scale assessment is mainly conducted via evaluating against ground-based measurements. In general, the assimilation enabled estimates are better than no-assimilation counterparts. Second, the basin-scale runoff assessment demonstrates that across three snow-dominated basins, the assimilation enabled experiment yields systematic improvements in all goodness-of-fit statistics through mitigating the negative effects brought by the fixed long-term precipitation correction factors. For example, when forced by the bias-corrected precipitation, the assimilation-enabled experiment improves the bias by 69%, the root-mean-squared error by 30%, and the unbiased root-mean-squared error by 18% (relative to the no-assimilation counterpart). Finally, the domain-scale assessment is conducted via evaluating against satellite-based SWE and skin temperature products. Both sets of domain-scale analysis further corroborate the findings in the point-scale evaluations. Overall, this study suggests the benefits of the proposed multi-variate assimilation system in improving the cryospheric-hydrological process within a land surface model for use in HMA.

Yuan Xue↗

Application of Design of Experiments and Surrogate Modeling within the NASA Advanced Concepts Office, Earth-to-Orbit Design Process

Decisions made during early conceptual design have a large impact upon the expected life-cycle cost (LCC) of a new program. It is widely accepted that up to 80% of such cost is committed during these early design phases.1 Therefore, to help minimize LCC, decisions made during conceptual design must be based upon as much information as possible. To aid in the decision making for new launch vehicle programs, the Advanced Concepts Office (ACO) at NASA Marshall Space Flight Center (MSFC) provides rapid turnaround pre-phase A and phase A concept definition studies. The ACO team utilizes a proven set of tools to provide customers with a full vehicle mass breakdown to tertiary subsystems, preliminary structural sizing based upon worst-case flight loads, and trajectory optimization to quantify integrated vehicle performance for a given mission.2 Although the team provides rapid turnaround for single vehicle concepts, the scope of the trade space can be limited due to analyst availability and the manpower requirements for manual execution of the analysis tools. In order to enable exploration of a broader design space, the ACO team has implemented an Advanced Design Methods (ADM) based approach. This approach applies the concepts of Design of Experiments (DOE) and surrogate modeling to more exhaustively explore the trade space and provide the customer with additional design information to inform decision making. This paper will first discuss the automation of the ACO tool set, which represents a majority of the development e ort. In order to t a surrogate model within tolerable error bounds a number of DOE cases are needed. This number will scale with the number of variable parameters desired and the complexity of the system's response to those variables. For all but the smallest design spaces, the number of cases required cannot be produced within an acceptable timeframe using a manual process. Therefore, automation of the tools was a key enabler for the successful application of an ADM approach to an ACO design study. Following the overview of the tool set automation, an example problem will be given to illustrate the implementation of the ADM approach. The example problem will first cover the inclusion of Ground Rules and Assumptions (GR&A) for a study. The GR&A are very important to the study as they determine the constraints within which a trade study can be conducted. These trades must ultimately reconcile with the customer's desired output and any anticipated \what if" questions. The example problem will then illustrate the setup and execution of a DOE through the automated ACO tools. This process is accomplished more efficiently in this work by splitting the tools into two separate environments. The first environment encompasses the structural optimization and mass estimation tools, while the second is focused on trajectory optimization. Surrogate models are t to the outputs of each environment and are integrated via connection of the surrogate equations. Throughout this process, checks are implemented to compare the output of the surrogates to the output of manually run cases to ensure that the error of the final surrogates is at an acceptable level. The conclusion of the example problem demonstrates the utility of the ADM based approach. Using surrogate models gives the ACO team the ability to visualize vehicle sensitivities to various design parameters and identify regions of interest within the design space. The ADM approach can thus be used to inform concept down selection and isolate promising vehicle configurations to be explored in more detail through the manual design process. In addition it provides the customer with an almost instantaneous turnaround on any \what if" questions that may arise within the bounds of the surrogate model. This approach ultimately expands the ability of the ACO team to provide its customer with broad and rapid turnaround trade studies for launch vehicle conceptual design. The ability to identify a selection of designs which can meet the customer requirements will have the potential to lower LCC of launch vehicle designs originating from ACO.

Zwack, Mathew R.↗

Practical Insights on Applying Simulation-Based Control Methods in Experimental Studies

Advanced nuclear reactors are crucial to the future of energy both in the United States and around the globe. In contrast to the current operating fleet, they are characterized as being deployable in remote locations and able to operate in semi-autonomous or autonomous fashion. This leap forward necessitates a new reactor control paradigm. Because advanced nuclear reactors are still under development in the United States, the creation of new control methods to achieve autonomous operations has been based on systems modeling and simulation. However, an important factor in successfully deploying these new control methods is the ability to seamlessly transition from simulation environments to real-world settings. Control methods tested in both simulation and experimental settings need to be investigated in the context of advanced reactor applications. This work developed a series of simple controllers for Idaho National Laboratory (INL)’s Microreactor Applications Research Validation and Evaluation (MARVEL) microreactor operating in load-following scenarios. These controllers were tested in both simulation and experimental settings, and a comparative performance analysis was performed. The simulation tests leveraged the Control and Optimization Modular Modeling Application for Nuclear Deployment (COMMAND) software developed in a previous stage of the current effort, along with the MARVEL Reactor Excursion and Leak Analysis Program (RELAP5-3D) and Monte Carlo N-Particle (MCNP) models. The experimental tests leveraged the COMMAND software, MARVEL models, and the U.S. Department of Energy Microreactor Program’s Microreactor Automated Control System (MACS). MACS was developed to serve as a control method testbed. It was customized to mirror the MARVEL microreactor, and COMMAND enabled MACS to emulate the physics of MARVEL. The load-following controller was developed using the simulation platform, with efforts to emulate real systems by introducing actuator saturation and noise. These factors were incrementally accounted for in the controller design. After finalizing the controller design, it was implemented with the experimental setup. The experimental conditions tested included an initial test under conditions similar to the final simulation test, and two additional scenarios. The first scenario introduced additional actuator saturation to account for equipment aging over time, which was unknown to the controller. The second scenario introduced sensor delay, a phenomenon anticipated with the use of remote operations or wireless communication in advanced reactors. These tests revealed several notable differences. While the controller performed well in simulation, it exhibited several limitations when transitioning to hardware. The main challenges involved maintaining the steady-state target power, as evidenced by larger error values between the true reactor power and setpoint power, as well as persistent oscillations in controlled reactor power. These issues could lead to unacceptable transient conditions in real reactor testing. Introducing actuator aging and stochastic delays in the experimental setup significantly impacted controller performance, resulting in increased overshoot and undershoot, and exacerbated error and oscillations previously mentioned. These findings underscore the importance of experimental testbeds for testing and validating control methods, as controllers developed using only theory and/or simulation may perform unexpectedly when applied to actual hardware. This research emphasizes the need for an experimental testbed for achieving such validation.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

Constraining Black Carbon Aerosol over Asia using OMI Aerosol Absorption Optical Depth and the Adjoint of GEOS-Chem

Accurate estimates of the emissions and distribution of black carbon (BC) in the region referred to here as Southeastern Asia (70degE-l50degE, 11degS-55degN) are critical to studies of the atmospheric environment and climate change. Analysis of modeled BC concentrations compared to in situ observations indicates levels are underestimated over most of Southeast Asia when using any of four different emission inventories. We thus attempt to reduce uncertainties in BC emissions and improve BC model simulations by developing top-down, spatially resolved, estimates of BC emissions through assimilation of OMI observations of aerosol absorption optical depth (AAOD) with the GEOS-Chem model and its adjoint for April and October of 2006. Overwhelming enhancements, up to 500%, in anthropogenic BC emissions are shown after optimization over broad areas of Southeast Asia in April. In October, the optimization of anthropogenic emissions yields a slight reduction (1-5%) over India and parts of southern China, while emissions increase by 10-50% over eastern China. Observational data from in situ measurements and AERONET observations are used to evaluate the BC inversions and assess the bias between OMI and AERONET AAOD. Low biases in BC concentrations are improved or corrected in most eastern and central sites over China after optimization, while the constrained model still underestimates concentrations in Indian sites in both April and October, possibly as a. consequence of low prior emissions. Model resolution errors may contribute up to a factor of 2.5 to the underestimate of surface BC concentrations over northern India. We also compare the optimized results using different anthropogenic emission inventories and discuss the sensitivity of top-down constraints on anthropogenic emissions with respect to biomass burning emissions. In addition, the impacts of brown carbon, the formulation of the observation operator, and different a priori constraints on the optimization are investigated. Overall, despite these limitations and uncertainties, using OMI AAOD to constrain BC sources improves model representation of BC distributions, particularly over China.

Aerosols↗

Application of Design of Experiments and Surrogate Modeling within the NASA Advanced Concepts Office, Earth-to-Orbit Design Process

Decisions made during early conceptual design have a large impact upon the expected life-cycle cost (LCC) of a new program. It is widely accepted that up to 80% of such cost is committed during these early design phases [1]. Therefore, to help minimize LCC, decisions made during conceptual design must be based upon as much information as possible. To aid in the decision making for new launch vehicle programs, the Advanced Concepts Office (ACO) at NASA Marshall Space Flight Center (MSFC) provides rapid turnaround pre-phase A and phase A concept definition studies. The ACO team utilizes a proven set of tools to provide customers with a full vehicle mass breakdown to tertiary subsystems, preliminary structural sizing based upon worst-case flight loads, and trajectory optimization to quantify integrated vehicle performance for a given mission [2]. Although the team provides rapid turnaround for single vehicle concepts, the scope of the trade space can be limited due to analyst availability and the manpower requirements for manual execution of the analysis tools. In order to enable exploration of a broader design space, the ACO team has implemented an advanced design methods (ADM) based approach. This approach applies the concepts of design of experiments (DOE) and surrogate modeling to more exhaustively explore the trade space and provide the customer with additional design information to inform decision making. This paper will first discuss the automation of the ACO tool set, which represents a majority of the development effort. In order to fit a surrogate model within tolerable error bounds a number of DOE cases are needed. This number will scale with the number of variable parameters desired and the complexity of the system's response to those variables. For all but the smallest design spaces, the number of cases required cannot be produced within an acceptable timeframe using a manual process. Therefore, automation of the tools was a key enabler for the successful application of an ADM approach to an ACO design study. Following the overview of the tool set automation, an example problem will be given to illustrate the implementation of the ADM approach. The example problem will first cover the inclusion of ground rules and assumptions (GR&A) for a study. The GR&A are very important to the study as they determine the constraints within which a trade study can be conducted. These trades must ultimately reconcile with the customer's desired output and any anticipated "what if" questions.

Zwack, Mathew R.↗

Analysis of Pull Force Test Results for Crimped Connections

Crimped electrical contacts are reliable when strict process controls are followed during manufacturing and accompanied by continuous process verification through pull force testing. Cable and wire harness assemblies’ standards are developed and refined over time to provide the minimum pull force that a crimp contact must meet before it breaks from the wire. However, in practice the failures occur at a much higher tensile strength than the minimum required. The first section of this paper reviewed 780 pull force test results provided by NASA Centers were collected and analyzed to determine how the data compares to NASA’s pre-existing requirements from the cable/harness standards NASA-STD-8739.4 and IPC/WHMA-A-620B-S. The measured tensile strength of most of the contact/conductor pairs (i.e. Contact/Wires or C/W) exceeded the minimum pull force values of NASA-STD-8739.4 and IPC/WHMA-A-620 standards by at least 100 %. The tensile strength samples of the C/W pairs values followed a normal distribution with an average tensile strength value that was at least 182 % of the minimum requirement, and all the samples analyzed passed the pull force testing. In addition, the 95 % confidence interval of the average tensile strength distributions for several C/W pairs was determined and plotted as error bars to show that there is good likelihood to observe C/W pair normal distribution with a 95 % confidence interval that will meet and surpass the standard requirements. The frequency of pull force testing can be problematic for projects because of the cost and availability of spare contacts for the destructive test. It could be possible to reduce the frequency of pull force testing if at the beginning of the production run, the conditions of the crimp tool and materials are verified, and the settings of the tool remain unchanged throughout the process. However, the project must evaluate the impact to risk from reducing the frequency of testing.

Crimped connections↗

Misalignment of magnetic field in DIII-D assessed by post-mortem analysis of divertor targets

Abstract We assess the toroidal magnetic field B t asymmetry in DIII-D due to a misalignment of the toroidal field coils with respect to the poloidal magnetic field coils and vacuum vessel. The peak-to-peak variation of the divertor strike point (SP) radius is measured to be 1 cm, with an n = 1 toroidal pattern. We use the centre of a narrow carbon deposition band on tungsten-coated divertor tiles just inside the outer strike point (OSP) as a proxy for the divertor SP location. The band occurred in a series of reverse B t discharges with the OSP positioned on the divertor inserts due to strong E × B drift transport of C from the inner to the outer SP through the private flux region. The variation in band radius (and hence the magnetic SP) is a (4.89 ± 0.31) mm shift toward (310 ± 4)° toroidal direction. These measurements agree well with previous measurements of the 3D magnetic field distribution (Luxon 2003 Nucl. Fusion 43 1813), simulations performed by the mafot field line integration code, and recent Langmuir probe measurements in the small-angle-slot (SAS) divertor (Watkins et al 2019 Nucl. Mater. Energy 18 46). Comparison of these measurements in the SAS divertor also indicates that there is the possibility of a tilt (in conjunction with the shift) of the B t coil field of (0.04 ± 0.07)° towards the toroidal angle of (215 ± 25)°. Previous measurements suggested a field misalignment of (4.6 ± 0.3) mm in the 270° toroidal direction, and a tilt of (0.06 ± 0.02)° toward the 114° toroidal direction, which is similar to the results reported here. These studies will be important for better understanding the radial variation of the toroidal strike line in DIII-D, for designing the new generation of SAS divertor, and for developing an understanding of the impact of error fields on tokamaks with tightly baffled slot divertors.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Space Radiation Cancer, Circulatory Disease and CNS Risks for Near Earth Asteroid and Mars Missions: Uncertainty Estimates for Never-Smokers

The uncertainties in estimating the health risks from galactic cosmic rays (GCR) and solar particle events (SPE) are a major limitation to the length of space missions and the evaluation of potential risk mitigation approaches. NASA limits astronaut exposures to a 3% risk of exposure induced cancer death (REID), and protects against uncertainties in risks projections using an assessment of 95% confidence intervals after propagating the error from all model factors (environment and organ exposure, risk coefficients, dose-rate modifiers, and quality factors). Because there are potentially significant late mortality risks from diseases of the circulatory system and central nervous system (CNS) which are less well defined than cancer risks, the cancer REID limit is not necessarily conservative. In this report, we discuss estimates of lifetime risks from space radiation and new estimates of model uncertainties are described. The key updates to the NASA risk projection model are: 1) Revised values for low LET risk coefficients for tissue specific cancer incidence, with incidence rates transported to an average U.S. population to estimate the probability of Risk of Exposure Induced Cancer (REIC) and REID. 2) An analysis of smoking attributable cancer risks for never-smokers that shows significantly reduced lung cancer risk as well as overall cancer risks from radiation compared to risk estimated for the average U.S. population. 3) Derivation of track structure based quality functions depends on particle fluence, charge number, Z and kinetic energy, E. 4) The assignment of a smaller maximum in quality function for leukemia than for solid cancers. 5) The use of the ICRP tissue weights is shown to over-estimate cancer risks from SPEs by a factor of 2 or more. Summing cancer risks for each tissue is recommended as a more accurate approach to estimate SPE cancer risks. 6) Additional considerations on circulatory and CNS disease risks. Our analysis shows that an individual s history of smoking exposure has a larger impact on GCR risk estimates than amounts of radiation shielding or age at exposure (amongst adults). Risks for never-smokers compared to the average U.S. population are estimated to be reduced between 30% and 60% dependent on model assumptions. Lung cancer is the major contributor to the reduction for never-smokers, with additional contributions from circulatory diseases and cancers of the stomach, liver, bladder, oral cavity and esophagus, and leukemia. The relative contribution of CNS risks to the overall space radiation detriment is potentially increased for never-smokers such as most astronauts. Problems in estimating risks for former smokers and the influence of second-hand smoke are discussed. Compared to the LET approximation, the new track structure derived radiation quality functions lead to a reduced risk for relativistic energy particles and increased risks for intermediate energy particles. Revised estimates for the number of safe days in space at solar minimum for heavy shielding conditions are described for never-smokers and the average U.S. population. Results show that missions to near Earth asteroids (NEA) or Mars violate NASA's radiation safety standards with the current levels of uncertainties. Greater improvements in risk estimates for never-smokers are possible, and would be dependent on improved understanding of risk transfer models, and elucidating the role of space radiation on the various stages of disease formation (e.g. initiation, promotion, and progression).

Cucinotta, Francis A.↗

Software Quality Assurance for EBR-II Fuels Irradiation and Physics Database (FIPD)

The Fuels Irradiation and Physics Database (FIPD) is an ongoing DOE project on archival of the EBR-II metal-alloy fuel irradiation experiments. As part of its use in support of license applications, the Quality Assurance Program Plan (QAPP) was drafted and endorsed by NRC in an effort to demonstrate its compliance with regulatory expectations. Software Quality Assurance (SQA) for the physics portion of FIPD is intended to qualify the calculated quantities such as fuel and cladding temperatures, neutron fluence and axially varying burnup estimates for irradiated fuel elements. This report covers the initial evaluation of SQA status of three neutron physics and thermo-fluid codes (REBUS, RCT and SE2RCT) that form the basis of calculated quantities for as-irradiated characteristics of the tested metallic fuel elements. The report also introduces an SQA plan to address the identified deficiencies. The REBUS, RCT, and SE2RCT codes are all part of the Argonne Reactor Code (ARC) code system. There is considerable knowledge and experience on REBUS and RCT but relatively less on SE2RCT. During FY2021, efforts focused on an assessment of how the data in the EBR-II Physics and Analysis DataBase (PADB) is generated with SE2RCT and used in FIPD. Additional tasks included considerations of uncertainties for power estimates in REBUS and RCT calculations and their impact on the combined RCT methodology. The RCT software usage in FIPD was assessed this year and the input/output details studied. A “requirements” document was created that identifies the key features of the RCT software being used in FIPD that need to have SQA documentation. A brief discussion on the history of RCT and its input is included in this report along with the basic SQA roadmap laid out in the requirements document. The SE2RCT software usage in FIPD is still being studied noting that there is no current manual. As part of the work done this year, two bugs were identified in the SE2RCT software which have a minor impact on the accuracy of the results it produces. No requirements document has been created, but one identified feature of SE2RCT being used that needs verification was its fuel pin temperature calculation. The work completed this year confirms that the approximations which will be included in the software verification report for SE2RCT are accurate. In addition to software quality assurance work for RCT and SE2RCT, an automated verification framework is proposed to simplify the software quality assurance process. The purpose of this framework is to streamline code verification and documentation while minimizing repetitive tasks for code developers and reviewers. The reduction of repeated input (between reference solution, software, and documentation input) throughout the SQA process reduces potential for human errors during the preparation of the supporting software quality records. The automation of the verification and documentation process proposed for this project leverages the existing verification structure already in place for the SAS4A/SASSYS-1 code.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗