Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “modeling and optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,531 records · Page 85

Design Optimization of A generic Fissile Solution for Mo99 production using Electron Beam-based Neutron Generator using MCNP+CFD

Molybdenum-99 ( 99 Mo) is a medical isotope used in 80% of all medical imaging procedures today. However, 99 Mo is not directly administered to patients for imaging; its decay product, technetium-99m ( 99 mTc), is a metastable isotope with a half-life of ~6 hours. Such a short half-life does not allow for production, separation, and application to a patient before decaying further. Therefore, the solution is to produce the precursor to 99 mTc, 99 Mo. 99 Mo has a half-life of 66 hours, long enough to produce the material and send it to the desired location before it fully decays. Under National Nuclear Security Administration’s (NNSA) highly enriched uranium (HEU) minimization mission, the Material Management and Minimization (M3) office leads the Molybdenum-99 (Mo-99) program. A major goal of the Mo-99 program is to develop methods of producing 99 Mo using low enriched uranium (LEU) opposed to the traditionally used HEU domestically in the U.S. Internationally, LEU is the new standard for use in research reactors and isotope production facility. In this study, we introduce a generic fissile solution system for 99 Mo production facility meeting the design requirement of 1) LEU usage as fissile material and 2) subcritical fissile system coupled with a horizontal electron beam (E-beam) accelerator. The focus of this research is to optimize a fissile solution configuration for maximum 99 Mo production yield using MCNP model, and ultimately implement the optimized design with computational fluid dynamics (CFD) model to understand thermal hydraulic behavior and solution convection characteristic. The report consists of two parts: 1) isotope yield calculation and criticality analysis with a wide range of parametric test matrix, and 2) thermal hydraulic analysis for solution mixing and cooling assessment.

60 APPLIED LIFE SCIENCES↗

A Stochastic Charging Station Deployment Model for Electrified Taxi Fleets in Coupled Urban Transportation and Power Distribution Networks

Metropolitansworldwide are increasingly adopting electric taxis (ET) to address concerns about transportation-related emissions. However, the widespread deployment of electric taxis presents challenges in terms of increased electricity demand and changing demand profiles. This transition impacts both the urban transportation network (TN) and the electricity power distribution network (PDN), highlighting the interdependence between these two systems. Here, in this paper, we propose a two-stage stochastic programming planning model that aims to optimize both the TN and PDN, enabling efficient deployment of charging stations and grid upgrades. Our model seeks to strike a balance between meeting ET drivers' charging preferences, minimizing the costs associated with infrastructure deployment and grid expansion, and harmonizing the coordination between the TN and PDN. Additionally, we explore the potential benefits of utilizing an autonomous ET fleet to enhance overall system performance.

33 ADVANCED PROPULSION SYSTEMS↗

Optimizing Distributed Training on Frontier for Large Language Models

Large language models (LLMs) have demonstrated remarkable success as foundational models, benefiting various downstream applications through fine-tuning. Loss scaling studies have demonstrated the superior performance of larger LLMs compared to their smaller counterparts. Nevertheless, training LLMs with billions of parameters poses significant challenges and requires considerable computational resources. For example, training a one trillion parameter GPT-style model on 20 trillion tokens requires a staggering 120 million exaflops. This research explores efficient distributed training strategies to extract this computation from Frontier, the world's first exascale supercomputer. We enable and investigate various model and data parallel training techniques, such as tensor parallelism, pipeline parallelism, and sharded data parallelism, to facilitate training a trillion-parameter model on Frontier. We empirically assess these techniques and their associated parameters to determine their impact on memory footprint, communication latency, and GPU's computational efficiency. We analyze the complex interplay among these techniques and find a strategy to combine them to achieve high throughput through hyperparameter tuning. We have identified efficient strategies for training large LLMs of varying sizes through empirical analysis and hyperparameter tuning. For 22 Billion, 175 Billion, and 1 Trillion parameters, we achieved GPU throughputs of 38.38%, 36.14%, and 31.96%, respectively. For the training of the 175 Billion parameter model and the 1 Trillion parameter model, we achieved 100% weak scaling efficiency on 1024 and 3072 Mi250X GPUs, respectively. We also achieved strong scaling efficiencies of 89% and 87% for these two models. We trained these models only tens of iterations instead of training till completion.

Yin, Junqi↗

Spatial distributions of X CO 2 seasonal cycle amplitude and phase over northern high-latitude regions

Satellite-based observations of atmospheric carbon dioxide (CO 2 ) provide measurements in remote regions, such as the biologically sensitive but undersampled northern high latitudes, and are progressing toward true global data coverage. Recent improvements in satellite retrievals of total column-averaged dry air mole fractions of CO 2 (X CO 2 ) from the NASA Orbiting Carbon Observatory 2 (OCO-2) have allowed for unprecedented data coverage of northern high-latitude regions, while maintaining acceptable accuracy and consistency relative to ground-based observations, and finally providing sufficient data in spring and autumn for analysis of satellite-observed X CO 2 seasonal cycles across a majority of terrestrial northern high-latitude regions. Here, we present an analysis of X CO 2 seasonal cycles calculated from OCO-2 data for temperate, boreal, and tundra regions, subdivided into 5° latitude by 20° longitude zones. We quantify the seasonal cycle amplitudes (SCAs) and the annual half drawdown day (HDD). OCO-2 SCAs are in good agreement with ground-based observations at five high-latitude sites, and OCO-2 SCAs show very close agreement with SCAs calculated for model estimates of X CO 2 from the Copernicus Atmosphere Monitoring Services (CAMS) global inversion-optimized greenhouse gas flux model v19r1 and the CarbonTracker2019 model (CT2019B). Model estimates of X CO 2 from the GEOS-Chem CO 2 simulation version 12.7.2 with underlying biospheric fluxes from CarbonTracker2019 (GC-CT2019) yield SCAs of larger magnitude and spread over a larger range than those from CAMS, CT2019B, or OCO-2; however, GC-CT2019 SCAs still exhibit a very similar spatial distribution across northern high-latitude regions to that from CAMS, CT2019B, and OCO-2. Zones in the Asian boreal forest were found to have exceptionally large SCA and early HDD, and both OCO-2 data and model estimates yield a distinct longitudinal gradient of increasing SCA from west to east across the Eurasian continent. In northern high-latitude regions, spanning latitudes from 47 to 72° N, longitudinal gradients in both SCA and HDD are at least as pronounced as latitudinal gradients, suggesting a role for global atmospheric transport patterns in defining spatial distributions of X CO2 seasonality across these regions. GEOS-Chem surface contact tracers show that the largest X CO 2 SCAs occur in areas with the greatest contact with land surfaces, integrated over 15–30d. The correlation of X CO 2 SCA with these land surface contact tracers is stronger than the correlation of X CO 2 SCA with the SCA of CO 2 fluxes or the total annual CO 2 flux within each 5° latitude by 20° longitude zone. This indicates that accumulation of terrestrial CO 2 flux during atmospheric transport is a major driver of regional variations in X CO 2 SCA.

54 ENVIRONMENTAL SCIENCES↗

Optimal observing strategies for velocity-suppressed dark matter annihilation

Numerous particle models for the cosmological dark matter feature a pair-annihilation rate that scales with powers of the relative velocity between the annihilating particles. As a result, the annihilation rate in the central regions of a dark matter halo can be significantly lower than at the halo’s periphery for particular ambient gravitational potentials. While this might be offset by an increasing dark matter pair number density in the inner halo, it raises the question; what angular region for dark matter models with velocity-suppressed annihilation rates optimizes the signal to noise ratio? We consider simplified background models for galactic and extragalactic targets and demonstrate that the optimal observing strategy varies greatly case by case. Generally, a bright central source warrants an annular region of interest, while a flatter background warrants as large as possible an angular region, possibly including the central regions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Overcoming sparse datasets with multi-task learning as applied to high entropy alloys

Abstract The design of novel High Entropy Alloys for use in high-temperature applications is an area of active interest due to their potential to provide exceptional properties compared to conventional alloys. Since the increased popularity of machine learning, an important cog in the design process has been training surrogate models on alloy properties. However, these Single-Task models are trained on individual mechanical properties and do not take advantage of the relatedness between properties. Multi-Task models can capture the interdependencies between tasks, leading to potentially more accurate predictions for all tasks. In this paper, we investigate if Multi-Task models can show improvement over Single-Task models when used for predicting the mechanical properties of these alloys. To ensure fair evaluation between the models, we apply L 0 regularization and skip connections to the models, which allows them to adjust the number of model parameters and depth for optimal performance. We find that the Multi-Task models can leverage task relationships to perform better than Single-Task models, especially for high amounts of missing data in the tasks. Furthermore, adding simple auxiliary targets can boost Multi-Task performance even further despite not being effective as input descriptors to single-task models themselves. We anticipate that the proposed strategies can achieve more accurate predictions and consequently enable better design capabilities for such data-constrained domains without incurring much additional computational cost.

Debnath, Arindam (ORCID:0000000194274499)↗

Surrogate Optimization of Computationally Expensive Black-Box Problems with Hidden Constraints (SHEBO) v1.0

SHEBO (surrogate optimization of problems with hidden constraints and expensive black-box objectives) is an efficient optimization algorithm that employs surrogate models to solve computationally expensive black-box simulation optimization problems that have hidden constraints. Hidden constraints are encountered when the objective function evaluation does not return a value for a parameter vector. These constraints are often encountered in optimization problems in which the objective function is computed by a black-box simulation code. SHEBO uses a combination of local and global search strategies together with an evaluability prediction function and a dynamically adjusted evaluability threshold to iteratively select new sample points.

Mueller, Juliane↗

Western Interconnection Baseline Study

The purpose of the baseline study is to evaluate the degree to which current industry planning processes meet the national 2035 decarbonization goals for the Western Interconnection. This analysis serves as a comparative baseline for the scenario analysis conducted in the NTP Study using a Western Interconnection dataset that is readily available to industry. This baseline analysis differs from the production cost modeling analysis and power flow analysis in the main NTP Study report (forthcoming). In particular, the analysis presented in this report reflects a business-as-usual future with an optimistic build out of specific planned transmission projects and foreseeable generation. In contrast, the NTP Study models a future generation and transmission expansion based on optimization from a capacity expansion model. The analysis presented herein also reflects a 2030 timeframe, whereas the main NTP Study production cost modeling analysis and power flow analysis reflect a 2035 time frame. This baseline analysis utilizes industry’s most reliable data to account for future transmission projects across various stages of development, with a particular focus on those in the permitting stage. Additionally, it incorporates projections for changes in generation capacity (both additions and retirements). This baseline analysis outlines a probable trajectory, given current process and practice, for the future of the bulk power system with a horizon extending to 2030.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Projecting the number of new HIV infections to formulate the "Getting to Zero" strategy in Illinois, USA

Objectives: Getting to Zero (GTZ) initiatives focus on expanding use of antiretroviral treatment (ART) and pre-exposure prophylaxis (PrEP) to eliminate new HIV infections. Computational models help inform policies for implementation of ART and PrEP continuums. Such models, however, vary in their design, and may yield inconsistent predictions. Using multiple approaches can help assess the consistency in results obtained from varied modeling frameworks, and can inform optimal implementation strategies. Methods: A study using three different modeling approaches is conducted. Two approaches use statistical time series analysis techniques that incorporate temporal HIV incidence data. A third approach uses stochastic stimulation, conducted using an agent-based network model (ABNM). All three approaches are used to project HIV incidence among a key population, young Black MSM (YBMSM), over the course of the GTZ implementation period (2016-2030). Results: All three approaches suggest that simultaneously increasing PrEP and ART uptake is likely to be more effective than increasing only one, but increasing ART and PrEP by 20% points may not eliminate new HIV infections among YBMSM. The results further suggest that a 20% increase in ART is likely to be more effective than a 20% increase in PrEP. All three methods consistently project that increasing ART and PrEP by 30% simultaneously can help reach GTZ goals. Conclusions: Increasing PrEP and ART uptake by about 30% might be necessary to accomplish GTZ goals. Such scale-up may require addressing psychosocial and structural barriers to engagement in HIV and PrEP care continuums. ABNMs and other flexible modeling approaches can be extended to examine specific interventions that address these barriers and may provide important data to guide the successful intervention implementation.

60 APPLIED LIFE SCIENCES↗

CIGS Technology Advancement via Fundamental Modeling of Defect/Impurity Interactions (Final Technical Report)

The primary goals of the proposed work were to provide modeling tools (and the associated insight which comes along with model development) for design and optimization of CuIn x Ga 1-x Se 2 (CIGS) and CdSeTe (CST) solar cell manufacturing processes and to establish the foundation for comprehensive end-to-end predictive modeling tools to enable optimization of thin film photovoltaic technology for performance, cost, yield, and reliability. The initial focus of efforts within this project was to develop coupled process/optical/device models for CIGS PV technology and to work with Siva Power to apply that TCAD (technology computer-aided design) system to improve the efficiency and reduce manufacturing costs for CIGS solar cells. Our approach to that end was to generate an extensive database of DFT calculations and to use those calculations via statistical thermodynamics methods and Monte Carlo simulation to develop and characterize models for the behavior of native defects as well as intentional and unintentional impurities, including the redistribution of the primary components of CIGS films. Increased effort went toward coupling those models for defect behavior and composition evolution to the performance of multicrystalline CIGS solar cells via prediction of doping level and recombination lifetime as function of manufacturing process. In the second budget period, the project pivoted to developing a similar system for the CdSeTe system, focused especially on understanding the role of Se/Te alloy concentration. Execution of the project resulted in the successful development of TCAD systems for both CIGS and CdSeTe thin film PV within the Synopsys Sentaurus framework by utilizing the Alagator interface. In the first budget period of the project, we developed quantitative models for the major components of CIGS PV and implemented them within a framework that couples process, optical, and device simulation. From the insights we have gained, we identified novel opportunities for enhancing CIGS solar cell performance and have laid the groundwork to further optimize the layer structure, composition profile, and thermal cycles for substantially improved efficiency and lower manufacturing costs. For the CIGS system, process changes to achieve greater than 1% absolute enhancement in efficiency were identified, but testing of those approaches was stymied by lack of a domestic CIGS manufacturing partner after the closure of Siva Power as well as Miasole. For CdSeTe, a fully capable TCAD system only became ready to apply near the end of the project period, so substantial opportunities remain to apply those models to enhance the leading thin film PV technology.

14 SOLAR ENERGY↗

Distributed Training and Optimization of Neural Networks

Deep learning models are yielding increasingly better performances thanks to multiple factors. To be successful, model may have large number of parameters or complex architectures and be trained on large dataset. This leads to large requirements on computing resource and turn around time, even more so when hyperparameter optimization is done (e.g. search over model architectures). While this is a challenge that goes beyond particle physics, we review the various ways to do the necessary computations in parallel, and put it in the context of high-energy physics.

Vlimant, Jean-Roch↗

Calibrating uncertain parameters in melt pool simulations of additive manufacturing

Melt pool scale numerical modeling of additive manufacturing (AM) processes can provide predictive capabilities and theoretical insight into the process-property-structure-performance relationships for AM parts. Despite capabilities of numerical models to solve complex multi-physics problems, it is often important to consider a tradeoff between detailed physics and computational cost. Therefore, sources of uncertainty in both experimental conditions and the parameters needed for modeling require models to be validated against empirical evidence. Here, a method is proposed to calibrate uncertain parameters used in continuum-scale melt pool models for powder bed fusion (PBF) AM. Both a simplified heat transfer model and a heat transfer and fluid flow model were investigated. A surrogate model and Markov chain-based optimization algorithm calibrated melt pool geometry for models within experimental variation of the target melt pool width and depth from the NIST AM-Bench 2018-02 dataset. The melt pool temperature distributions, solidification parameters, and simulated multi-layer solidification microstructures were compared between the two models. Similar results from both models indicate that calibrated, lower fidelity numerical models may be used in place of higher fidelity models to generate melt pool solidification data. Finally, these calibrated models therefore enable lower computational cost melt pool simulations without a noticeable decrease in simulation accuracy for grain-scale microstructure simulations.

36 MATERIALS SCIENCE↗