Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Power Iteration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

Overview of Rotor Hover Performance Capabilities at Low Reynolds Number for Mars Exploration

The Evolutionary aLgorithm for Iterative Studies of Aeromechanics (ELISA) software was developed in support of the Rotorcraft Optimization for the Advancement of Mars eXploration (ROAMX) project. ELISA was developed to enable aerodynamic rotor hover optimization for low Reynolds number flows in the Mars atmosphere. ELISA comprises two modules. The first module is dedicated to airfoil optimization and allows for the creation of multi-objective Pareto optimal (PO) airfoil sets with the airfoil performance evaluation performed using OVERFLOW. The second module is dedicated to rotor hover performance optimization and generates multi-objective PO rotor sets with the rotor performance evaluation performed using the comprehensive analysis code CAMRAD II. This paper presents recent updates to the ELISA optimization toolset. The airfoil module now includes variation in section Reynolds number, alongside simultaneous maximization of section lift and minimization of section drag. Consequently, the rotor optimization module can query PO airfoil sets (as a function of section lift, drag, and Reynolds number) and generate PO C81 decks tailored to specific Reynolds numbers, eliminating the need for adequate initial chord guesses and allowing for arbitrary rotor solidities to be studied. Furthermore, the rotor optimization has been extended to incorporate a third dimension, alongside maximization of blade loading and minimization of rotor power. This enables optimization across a relevant density range on Mars, presenting the lowest power rotor hover geometry, for each attainable blade loading, for each density. The goal of this work is to present the relevance of recent updates to the ELISA optimization toolset, by showing full rotor hover optimization using unconventional airfoils across a practical Mars density range, and by presenting various optimizations for changing blade numbers with unconstrained solidity in the Mars atmosphere.

Rotor↗

Modeling the Distribution and Type of High-Latitude Natural Wetlands for Methane Studies

High latitude (>50N) natural wetlands emit a substantial amount of methane to the atmosphere, and are located in a region of amplified warming. Northern hemisphere high latitudes are characterized by cold climates, extensive permafrost, poor drainage, short growing seasons, and slow decay rates. Under these conditions, organic carbon accumulates in the soil, sequestering CO2 from the atmosphere. Methanogens produce methane from this carbon reservoir, converting stored carbon into a powerful greenhouse gas. Methane emission from wetland ecosystems depends on vegetation type, climate characteristics (e.g, precipitation amount and seasonality, temperature, snow cover, etc.), and geophysical variables (e.g., permafrost, soil type, and landscape slope). To understand how wetland methane dynamics in this critical region will respond to climate change, we have to first understand how wetlands themselves will change and therefore, what the primary controllers of wetland distribution and type are. Understanding these relationships permits data-anchored, physically-based modeling of wetland distribution and type in other climate scenarios, such as paleoclimates or future climates, a necessary first step toward modeling wetland methane emissions in these scenarios. We investigate techniques and datasets for predicting the distribution and type of high latitude (>50N) natural wetlands from a suite of geophysical and climate predictors. Hierarchical clustering is used to derive an empirical methane-centric wetland model. The model is applied in a multistep process first to predict the distribution of wetlands from relevant geophysical parameters, and then, given the predicted wetland distribution, to classify the wetlands into methane-relevant types using an expanded suite of climate and biogeophysical variables. As the optimum set of predictor variables is not known a priori, the model is applied iteratively, and each simulation is evaluated with respect to observed high-latitude wetlands.

Romanski, Joy↗

Learning with Adaptive Conservativeness for Distributionally Robust Optimization: Incentive Design for Voltage Regulation: Preprint

Information asymmetry between the Distribution System Operator (DSO) and Distributed Energy Resource Aggregators (DERAs) obstructs designing effective incentives for voltage regulation. To capture this effect, we employ a Stackelberg game-theoretic framework, where the DSO seeks to overcome the information asymmetry and refine its incentive strategies by learning from DERA behavior over multiple iterations. We introduce a model-based online learning algorithm for the DSO, aimed at inferring the relationship between incentives and DERA responses. Given the uncertain nature of these responses, we also propose a distributionally robust incentive design model to control the probability of voltage regulation failure and then reformulate it into a convex problem. This model allows the DSO to periodically revise distribution assumptions on uncertain parameters in the decision model of the DERA. Finally, we present a gradient-based method that permits the DSO to adaptively modify its conservativeness level, measured by the size of a Wasserstein metric-based ambiguity set, according to historical voltage regulation performance. The effectiveness of our proposed method is demonstrated through numerical experiments.

distribution system operator↗

Interpretative 3D MHD modelling of deuterium SPI into a JET H-mode plasma

Abstract The pre-thermal quench (pre-TQ) dynamics of a pure deuterium ( D 2 ) shattered pellet injection (SPI) into a 3 MA / 7 MJ JET H-mode plasma is studied via 3D non-linear MHD modelling with the JOREK code. The interpretative modelling captures the overall evolution of the measured density and radiated power. The simulations also identify the importance of the drifts of ablation plasmoids towards the tokamak low field side (LFS) and the impurities in the background plasma in fragment penetration, assimilation, radiative cooling and MHD activity in D 2 SPI experiments. It is found that plasmoid drifts lead to an about 70% reduction of the central line-integrated density (compared to a simulation without drifts) in the JET D 2 SPI discharge considered. Impurities that pre-exist before the SPI as well as those from possible impurity influxes related to the SPI are shown to dominate the radiation in the considered discharge. With inputs from JOREK simulations, modelling with the Lagrangian particle-based pellet code PELOTON reproduces the deviation of the SPI fragments in the direction of the major radius as observed by the fast camera. This confirms the role of rocket effects and plasmoid drifts in the considered discharge and reinforces the validity of the JOREK modelling. The limited core density rise due to plasmoid drifts and the strong radiative cooling and MHD activity with impurities (depending on their species and concentration) could limit the effectiveness of LFS D 2 SPI in runaway electron avoidance and are worth considering in the design of the ITER disruption mitigation system.

Physics↗

Convolutional neural network based non-iterative reconstruction for accelerating neutron tomography *

Abstract Neutron computed tomography (NCT), a 3D non-destructive characterization technique, is carried out at nuclear reactor or spallation neutron source-based user facilities. Because neutrons are not severely attenuated by heavy elements and are sensitive to light elements like hydrogen, neutron radiography and computed tomography offer a complementary contrast to x-ray CT conducted at a synchrotron user facility. However, compared to synchrotron x-ray CT, the acquisition time for an NCT scan can be orders of magnitude higher due to lower source flux, low detector efficiency and the need to collect a large number of projection images for a high-quality reconstruction when using conventional algorithms. As a result of the long scan times for NCT, the number and type of experiments that can be conducted at a user facility is severely restricted. Recently, several deep convolutional neural network (DCNN) based algorithms have been introduced in the context of accelerating CT scans that can enable high quality reconstructions from sparse-view data. In this paper, we introduce DCNN algorithms to obtain high-quality reconstructions from sparse-view and low signal-to-noise ratio NCT data-sets thereby enabling accelerated scans. Our method is based on the supervised learning strategy of training a DCNN to map a low-quality reconstruction from sparse-view data to a higher quality reconstruction. Specifically, we evaluate the performance of two popular DCNN architectures—one based on using patches for training and the other on using the full images for training. We observe that both the DCNN architectures offer improvements in performance over classical multi-layer perceptron as well as conventional CT reconstruction algorithms. Our results illustrate that the DCNN can be a powerful tool to obtain high-quality NCT reconstructions from sparse-view data thereby enabling accelerated NCT scans for increasing user-facility throughput or enabling high-resolution time-resolved NCT scans.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Building Intelligent Cyberinfrastructure to Learn Iteratively from both Observations and Models for Understanding Watershed Dynamics

Focal Area(s): Predictive modeling through the use of AI techniques and AI-derived model components; the use of AI and other tools to design a prediction system comprising of a hierarchy of models (e.g., AI-driven model/component/parameterization selection). Science Challenge: Watershed processes, such as the fate and transport of sediment, carbon and nutrients across landscapes and their fluxes to water bodies (e.g., streams, rivers and lakes), have important implications for global and regional carbon and nutrient dynamics, biogeochemical functioning of terrestrial ecosystems, and soil functions. The magnitude of lateral surface/subsurface transport and fluxes of sediment, carbon and nutrients are key factors controlling the vulnerability of watersheds to climate extremes such as droughts, wildfires, and floods. Recent field observations and other scientific evidence suggest that the magnitudes of lateral transport and fluxes of sediment, carbon and nutrients are governed primarily by the spatial and vertical heterogeneity of landscape and soil properties and by pedogenic processes. However, the current generation of land surface and watershed models do not mechanistically couple the terrestrial and hydrologic systems, nor do they represent sufficiently the spatial and vertical heterogeneity of land surface and subsurface properties. On the other hand, increasing complexity of coupled watershed and land surface models requires more data to parameterize, calibrate and validate. Remote sensing (RS) provides a means to acquire spatial data and characterize their heterogeneity at the watershed scale, overcoming a major limitation associated with conventional point measurements. To improve the representation of land-surface and surface/subsurface process coupling and sub-grid heterogeneity in watershed models, it is essential to build our predictive understanding by learning from both the multi-scale multi-process modeling and diverse multi-scale data while leveraging powerful artificial intelligence (AI) techniques.

54 ENVIRONMENTAL SCIENCES↗

Monte Carlo simulation of particle acceleration at astrophysical shocks

A Monte Carlo code was developed for the simulation of particle acceleration at astrophysical shocks. The code is implemented in Turbo Pascal on a PC. It is modularized and structured in such a way that modification and maintenance are relatively painless. Monte Carlo simulations of particle acceleration at shocks follow the trajectories of individual particles as they scatter repeatedly across the shock front, gaining energy with each crossing. The particles are assumed to scatter from magnetohydrodynamic (MHD) turbulence on both sides of the shock. A scattering law is used which is related to the assumed form of the turbulence, and the particle and shock parameters. High energy cosmic ray spectra derived from Monte Carlo simulations have observed power law behavior just as the spectra derived from analytic calculations based on a diffusion equation. This high energy behavior is not sensitive to the scattering law used. In contrast with Monte Carlo calculations diffusive calculations rely on the initial injection of supra-thermal particles into the shock environment. Monte Carlo simulations are the only known way to describe the extraction of particles directly from the thermal pool. This was the triumph of the Monte Carlo approach. The question of acceleration efficiency is an important one in the shock acceleration game. The efficiency of shock waves efficient to account for the observed flux of high energy galactic cosmic rays was examined. The efficiency of the acceleration process depends on the thermal particle pick-up and hence the low energy scattering in detail. One of the goals is the self-consistent derivation of the accelerated particle spectra and the MHD turbulence spectra. Presumably the upstream turbulence, which scatters the particles so they can be accelerated, is excited by the streaming accelerated particles and the needed downstream turbulence is convected from the upstream region. The present code is to be modified to include a better description of particle scattering (pitch-angle instead of hard-sphere) and as iterative procedure for treating the self-excitation of the MHD turbulence.

Campbell, Roy K.↗

Particle-Tracking Proton Computed Tomography—Data Acquisition, Preprocessing, and Preconditioning

Proton CT (pCT) is a promising new imaging technique that can reconstruct relative stopping power (RSP) more accurately than x-ray CT in each cubic millimeter voxel of the patient. This, in turn, will result in better proton range accuracy and, therefore, smaller planned tumor volumes (PTV). The hardware description and some reconstructed images have previously been reported. In a series of two contributions, we focus on presenting the software algorithms that convert pCT detector data to the final reconstructed pCT images for application in proton treatment planning. There were several options on how to accomplish this, and we will describe our solutions at each stage of the data processing chain. In the first paper of this series, we present the data acquisition with the pCT tracking and energy-range detectors and how the data are preprocessed, including the conversion to the well-formatted track information from tracking data and water-equivalent path length from the data of a calibrated multi-stage energy-range detector. These preprocessed data are then used for the initial image formation with an FDK cone-beam CT algorithm. The output of data acquisition, preprocessing, and FDK reconstruction is presented along with illustrative imaging results for two phantoms, including a pediatric head phantom. The second paper in this series will demonstrate the use of iterative solvers in conjunction with the superiorization methodology to further improve the images resulting from the upfront FDK image reconstruction and the implementation of these algorithms on a hybrid CPU/GPU computer cluster.

42 ENGINEERING↗

State-of-the-Art: Small Spacecraft Technology

When the first edition of NASA’s Small Spacecraft Technology State-of-the-art report was published in 2013, 247 CubeSats and 105 other non-CubeSat small spacecraft under 50 kilograms (kg) had been launched worldwide, representing less than 2% of launched mass into orbit over multiple years. In 2013 alone, around 60% of the total spacecraft launched had a mass under 600 kg, and of those under 600 kg, 83% were under 200 kg and 37% were nanosatellites (1). Of the total 1,849 spacecraft launched in 2021, 94% were small spacecraft with an overall mass under 600 kg, and of those under 600 kg, 40% were under 200 kg, and 11% were nanosatellites (1). Since 2013, the fight heritage for small spacecraft has increased by over 30% and has become the primary source to space access for commercial, government, private, and academic institutions. The total number of spacecraft launched in the past 10 years is 5,681 and 45% of those had a mass. As with all previous editions of this report, the 2022 edition captures and distills a wealth of new information available on small spacecraft systems from NASA and other publicly available sources. This report is limited to publicly available information and cannot reflect major advances in development that are not publicly disclosed. We encourage any opportunity to publish mission outcomes and technology development milestones (e.g., via conference papers, press releases, company website) so they can be reflected in this report. Overall, this report is a survey of small spacecraft technologies sourced from open literature; it does not endeavor to be an original source, and only considers literature in the public domain to identify and classify devices. Commonly used sources for data include manufacturer datasheets, press releases, conference papers, journal papers, public filings with government agencies, news articles, presentations, the compendium of databases accessed via NASA’s Small Spacecraft Systems Virtual Institute (S3VI) Information Search, and engagement with companies. Data not appropriate for public dissemination, such as proprietary, export controlled, or otherwise restricted data, are not considered. As a result, this report includes many dedicated hours of desk research performed by subject matter experts reviewing resources noted above. Content in this 2022 edition is based on data available by October 2022. This report should not be considered as a comprehensive overview of all the technologies but a great reference for the current state-of-the-art SmallSat technologies. The organizational approach for each chapter is relatively consistent with previous editions and includes an introduction of the technology, current development status of the technology’s procurable systems, and summary tables of technologies surveyed. The content in each chapter is uniquely organized to present a mini-stand-alone report on spacecraft subsystems. As in previous years, chapters include information from previous editions but are updated with new and maturating technologies and reference missions. Tables in each section provide a convenient summary of the technologies discussed, with explanations and references in the body text. The authors have attempted to isolate trends in the small spacecraft industry to point out which technologies have been adopted after successful demonstration missions. Lastly, the authors tried to use the terms “SmallSat,” “microsatellite,” “nanosatellite,” and “CubeSat” in a consistent manner, even as these terms are often used interchangeably in the space industry. Every subsystem chapter contains updated information to reflect the growth in the small spacecraft market. Significant changes are included in several chapters. The “Complete Spacecraft Platforms” chapter now includes information on the two main market options, hosted payload services and dedicated buses. The “Power” chapter provides information on the development of solid-state batteries with significantly higher energy than the current state-of-theart lithium-ion batteries. A large effort was made to update the “Communications” chapter to appropriately capture the recent technology maturation of optical communications for SmallSats. The “Ground Data Systems and Mission Operations” chapter was updated to reflect the recent establishment of the Near Space Network and influx of SmallSat Optical Ground Stations. The “Guidance, Navigation and Control” chapter was updated to include Lidar sensor technology. The “Deorbit Systems” chapter includes a discussion of recently proposed changes by the Federal Communications Commission (FCC) to limit a spacecraft’s lifetime to no longer than 5 years after end-of-mission. The “Identification and Tracking” Chapter includes updated information on the progress of SmallSat tracking. Finally, this report now encompasses technology funded by NASA’s Small Spacecraft Technology (SST) program’s SmallSat Technology Partnerships (STP) initiative which is described further in this Introduction. The reader can find the included SST technology in the “On the Horizon” section of the “Thermal Systems”, “Communications”, and “Guidance, Navigation, and Control” chapters. A central element of this report is to list state-of-the-art technologies by NASA standard Technology Readiness Level (TRL) as defined by the 2020 NASA Engineering Handbook, found in NASA NPR 7123.1C NASA Systems Engineering Processes and Requirements. The authors have endeavored to independently verify the TRL value of each technology by reviewing and citing published test results or publicly available data to the best of their ability. Where test results and data disagree with vendors’ own advertised TRL, the authors have attempted to engage the vendors to discuss the discrepancy. Readers are strongly encouraged to follow the references cited in the literature describing the full performance range and capabilities of each technology. Readers of this report should reach out to individual companies to further clarify information. It is important to note that this report takes a broad system-level view. To attain a high TRL, the subsystem must be in a flight-ready configuration with all supporting infrastructure—such as mounting points, power conversion, and control algorithms—in an integrated unit. An accurate TRL assessment requires a high degree of technical knowledge on a subject device, and an in-depth understanding of the mission (including interfaces and environment) on which the device was flown. There is variability in TRL values depending on design factors for a specific technology. For example, differences in TRL assessment based on the operating environment may result from the thermal environment, mechanical loads, mission duration, or radiation exposure. If a technology has flown on a mission without success, or without providing valid confirmation to the operator, such claimed “flight heritage” was discounted. The authors believe TRLs are most accurately determined when assessed within the context of a program’s unique requirements. While the overall capability of small spacecraft has matured since the 2021 edition of this report, technologies are still being developed to make deep space SmallSat missions more routine and more cost effective. Future editions of this report may include content dedicated to the rapidly growing fields of assembly, integration, and testing services, and mission modeling and simulation–all of which are now extensively represented at small spacecraft conferences. Many of these subsystems and services are still in their infancy, but as they evolve and reliable conventions and standards emerge, the next iteration of this report may also evolve to include additional chapters.

Bruce Yost↗

Deployment Readiness Framework Subtask 1.1 (Literature Review)

Island and remote coastal communities face some of the most challenging environments for building, operating, and maintaining energy infrastructure, as well as the highest costs for electricity, fuels, and other essential energy sources. As sea-levels rise and storms become more intense and frequent, these communities and the energy infrastructure that supports coastal lives and livelihoods are also at increasing risk from natural hazards. To address these challenges, many coastal communities are envisioning energy solutions that will support the triple bottom line goals of the blue economy: economic growth, environmental sustainability, and social equity. Yet, island and remote coastal communities often face limited resources and capacity to tackle complex energy and coastal resilience issues. To support community-driven energy transitions in island and remote communities, and to better understand relationships between energy, community, and ecosystem resilience, the Department of Energy’s Water Power Technologies Office (WPTO) has initiated the development of a Deployment Readiness Framework (DRF). The objective of the work is to co-produce and test practical tools and approaches that assess the readiness of coastal communities for marine energy demonstration, deployment, and operation. The DRF aims to build on and support the Energy Transitions Initiative Partnership Program (ETIPP) and other community-oriented energy transition programs. This project is jointly led by Pacific Northwest National Laboratory (PNNL) and the National Renewable Energy Laboratory (NREL). The development of the DRF includes three main phases: 1) a learning phase involving stakeholder engagement and literature review to synthesize metrics of community readiness to advance through an energy transition and to understand the state of the research and practice of participatory science-policy processes in various sectors, 2) a design phase to define readiness approaches and tools that will be developed as part of the DRF, and 3) an implementation phase to create the applications and interfaces for WPTO and the national laboratories to interact with the DRF. All three phases include close collaboration with communities and end-users of the framework, first to identify gaps in the science and tools needed to achieve community-driven energy transition goals and second, to test and improve the framework iteratively. Through technical assistance programs like ETIPP and utilizing the completed DRF to understand the influencing factors which motivate or deter energy transitions, WPTO hopes to engage a number of near-term marine energy demonstration opportunities. Here we report on the results from the literature review (Subtask 1.1) to inform the stakeholder engagement (Subtask 1.2) and design phase (Task 2) of the project.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Tuning and Robustness Analysis for the Orion Absolute Navigation System

The Orion Multi-Purpose Crew Vehicle (MPCV) is currently under development as NASA's next-generation spacecraft for exploration missions beyond Low Earth Orbit. The MPCV is set to perform an orbital test flight, termed Exploration Flight Test 1 (EFT-1), some time in late 2014. The navigation system for the Orion spacecraft is being designed in a Multi-Organizational Design Environment (MODE) team including contractor and NASA personnel. The system uses an Extended Kalman Filter to process measurements and determine the state. The design of the navigation system has undergone several iterations and modifications since its inception, and continues as a work-in-progress. This paper seeks to show the efforts made to-date in tuning the filter for the EFT-1 mission and instilling appropriate robustness into the system to meet the requirements of manned space ight. Filter performance is affected by many factors: data rates, sensor measurement errors, tuning, and others. This paper focuses mainly on the error characterization and tuning portion. Traditional efforts at tuning a navigation filter have centered around the observation/measurement noise and Gaussian process noise of the Extended Kalman Filter. While the Orion MODE team must certainly address those factors, the team is also looking at residual edit thresholds and measurement underweighting as tuning tools. Tuning analysis is presented with open loop Monte-Carlo simulation results showing statistical errors bounded by the 3-sigma filter uncertainty covariance. The Orion filter design uses 24 Exponentially Correlated Random Variable (ECRV) parameters to estimate the accel/gyro misalignment and nonorthogonality. By design, the time constant and noise terms of these ECRV parameters were set to manufacturer specifications and not used as tuning parameters. They are included in the filter as a more analytically correct method of modeling uncertainties than ad-hoc tuning of the process noise. Tuning is explored for the powered-flight ascent phase, where measurements are scarce and unmodelled vehicle accelerations dominate. On orbit, there are important trade-off cases between process and measurement noise. On entry, there are considerations about trading performance accuracy for robustness. Process Noise is divided into powered flight and coasting ight and can be adjusted for each phase and mode of the Orion EFT-1 mission. Measurement noise is used for the integrated velocity measurements during pad alignment. It is also used for Global Positioning System (GPS) pseudorange and delta- range measurements during the rest of the flight. The robustness effort has been focused on maintaining filter convergence and performance in the presence of unmodeled error sources. These include unmodeled forces on the vehicle and uncorrected errors on the sensor measurements. Orion uses a single-frequency, non-keyed GPS receiver, so the effects due to signal distortion in Earth's ionosphere and troposphere are present in the raw measurements. Results are presented showing the efforts to compensate for these errors as well as characterize the residual effect for measurement noise tuning. Another robustness tool in use is tuning the residual edit thresholds. The trade-off between noise tuning and edit thresholds is explored in the context of robustness to errors in dynamics models and sensor measurements. Measurement underweighting is also presented as a method of additional robustness when processing highly accurate measurements in the presence of large filter uncertainties.

Holt, Greg N.↗

Performance Improvements of the Griffin Solvers in FY24

The Griffin code is a MOOSE-based reactor physics application jointly developed by Idaho National Laboratory and Argonne National Laboratory under the Department of Energy Office of Nuclear Energy Nuclear Energy Advanced Modeling and Simulation Program. This fiscal year, we have made significant efforts to improve the performance of transport solver options and cross-section generation for the efficient use of Griffin in advanced reactor applications. For the HFEM-PN solver, the residual evaluations of HFEM kernels were optimized by utilizing the pre- computed averaged cross sections for individual elements. Numerical integration involving the evaluation of basis functions at quadrature points was bypassed by facilitating precomputed element mass matrices for response matrices. Red-black iterations were improved by introducing a new generalized minimum residual based solver. The memory usage of response matrix storage was significantly reduced by applying basis function rotations on interfaces and calculating volumetric odd-parity moments on the fly. Additionally, the adjoint flux and transient calculation capabilities of the HFEM-PN solver were successfully implemented and verified using the TWIGL benchmark problem. For the DFEM-SN solver, memory footprint and computation time were significantly reduced by not treating angular flux vectors as the MOOSE nonlinear system vectors. Specifically for IQS, scalar adjoint weighting was introduced to further eliminate angular adjoint flux storage in the MOOSE auxiliary system. It was demonstrated through the three-dimensional Advanced Burner Test Reactor core problem that the memory usage for transient calculations with the IQS method was reduced by over 7.5× compared to before the optimizations. For the self-shielding application programming interface, a new double-heterogeneity treatment method, named the Bell Function-Based Analytic Two-Region Slowing Down Method, was developed to efficiently flux-volume homogenize TRISO particles with the matrix. Additionally, optimizations were made to hyper- fine group (HFG) slowing down calculations by pretabulating collision probability coefficients and grouping isotopes, significantly reducing the computational time for calculating scattering sources per HFG. Lastly, the pin power reconstruction module was extended to account for temporal behavior in a microreactor analysis problem, specifically for a control drum transient. Verification tests for each of these improvements demonstrated significant performance enhancements and memory reduction.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Plateau Phenomenon in Gradient Descent Training of RELU Networks: Explanation, Quantification, and Avoidance

The ability of neural networks to provide ‘best in class’ approximation across a wide range of applications is well-documented. Nevertheless, the powerful expressivity of neural networks comes to naught if one is unable to effectively train (choose) the parameters defining the network. In general, neural networks are trained by gradient descent type optimization methods,a stochastic variant thereof. In practice, such methods result in the loss function decreases rapidly at the beginning of training but then, after a relatively small number of steps, significantly slow down. The loss may even appear to stagnate over the period of a large number of epochs, only to then suddenly start to decrease fast again for no apparent reason. This so-called plateau phenomenon manifests itself in many learning tasks. The present work aims to identify and quantify the root causes of plateau phenomenon.analysis is carried out in the setting of univariate ReLU networks. No assumptions are made on the number of neurons relative to the number of training data, and our results hold for both the lazy and adaptive regimes. Here, the main findings are: plateaux correspond to periods during which activation patterns remain constant, where activation pattern refers to the number of data points that activate a given neuron; quantification of convergence of the gradient flow dynamics; and, characterization stationary points in terms solutions of local least squares regression lines over subsets of the training data. Based on these conclusions, we propose a new iterative training method, the Active Neuron Least Squares (ANLS), characterised by the explicit adjustment of the activation pattern at each step, which is designed to enable a quick exit from a plateau. Illustrative numerical examples are included throughout.

97 MATHEMATICS AND COMPUTING↗

Amino Acid Encoding for Deep Learning Applications

Background: The number of applications of deep learning algorithms in bioinformatics is increasing as they usually achieve superior performance over classical approaches, especially, when bigger training datasets are available. In deep learning applications, discrete data, e.g. words or n-grams in language, or amino acids or nucleotides in bioinformatics, are generally represented as a continuous vector through an embedding matrix. Recently, learning this embedding matrix directly from the data as part of the continuous iteration of the model to optimize the target prediction – a process called ‘end-to-end learning’ – has led to state-ofthe-art results in many fields. Although usage of embeddings is well described in the bioinformatics literature, the potential of end-to-end learning for single amino acids, as compared to more classical manually-curated encoding strategies, has not been systematically addressed. To this end, we compared classical encoding matrices, namely one-hot, VHSE8 and BLOSUM62, to end-to-end learning of amino acid embeddings for two different prediction tasks using three widely used architectures, namely recurrent neural networks (RNN), convolutional neural networks (CNN), and the hybrid CNN-RNN. Results: By using different deep learning architectures, we show that end-to-end learning is on par with classical encodings for embeddings of the same dimension even when limited training data is available, and might allow for a reduction in the embedding dimension without performance loss, which is critical when deploying the models to devices with limited computational capacities. We found that the embedding dimension is a major factor in controlling the model performance. Surprisingly, we observed that deep learning models are capable of learning from random vectors of appropriate dimension. Conclusion: Our study shows that end-to-end learning is a flexible and powerful method for amino acid encoding. Further, due to the flexibility of deep learning systems, amino acid encoding schemes should be benchmarked against random vectors of the same dimension to disentangle the information content provided by the encoding scheme from the distinguishability effect provided by the scheme.

Hesham ElAbd↗

Two-Photon Fluorescence Microscope for Microgravity Research

A two-photon fluorescence microscope has been developed for the study of biophysical phenomena. Two-photon microscopy is a novel form of laser-based scanning microscopy that enables three-dimensional imaging without many of the problems inherent in confocal microscopy. Unlike one-photon optical microscopy, two-photon microscopy utilizes the simultaneous nonlinear absorption of two near-infrared photons. However, the efficiency of two-photon absorption is much lower than that of one-photon absorption, so an ultra-fast pulsed laser source is typically employed. On the other hand, the critical energy threshold for two-photon absorption leads to fluorophore excitation that is intrinsically localized to the focal volume. Consequently, two-photon microscopy enables optical sectioning and confocal performance without the need for a signal-limiting pinhole. In addition, there is a reduction (relative to one-photon optical microscopy) in photon-induced damage because of the longer excitation wavelength. This reduction is especially advantageous for in vivo studies. Relative to confocal microscopy, there is also a reduction in background fluorescence, and, because of a reduction in Rayleigh scattering, there is a 4 increase of penetration depth. The prohibitive cost of a commercial two-photon fluorescence-microscope system, as well as a need for modularity, has led to the construction of a custom-built system (see Figure 1). This system includes a coherent mode-locked titanium: sapphire laser emitting 120-fs-duration pulses at a repetition rate of 80 MHz. The pulsed laser has an average output power of 800 mW and a wavelength tuning range of 700 to 980 nm, enabling the excitation of a variety of targeted fluorophores. The output from the laser is attenuated, spatially filtered, and then directed into a confocal scanning head that has been modified to provide for side entry of the laser beam. The laser output coupler has been replaced with a dichroic filter that reflects the longer-wavelength excitation light and passes the shorter-wavelength fluorescence light. Also, the confocal pinhole has been removed to increase the signal strength. The laser beam is scanned by a twoperpendicular- axis pair of galvanometer mirrors through a pupil transfer lens into the side port of an inverted microscope. Finally, the beam is focused by a 63-magnification, 1.3-numerical- aperture oil-immersion objective lens onto a specimen. The pupil transfer lens serves to match the intermediate image planes of the scanning head and the microscope, and its location is critical. In order to maximize the quality of the image, (that is, the point spread function of the objective lens for all scan positions), the entire system was modeled in optical-design software, and the various free design parameters (the parameters of the spatial-filter components as well as the separations of all of the system components) were determined through an iterative optimization process. A modular design was chosen to facilitate access to the optical train for future fluorescence correlation spectroscopy and fluorescence-lifetime experiments.

Fischer, David G.↗

Amino Acid Encoding for Deep Learning Applications

Background: The number of applications of deep learning algorithms in bioinformatics is increasing as they usually achieve superior performance over classical approaches, especially, when bigger training datasets are available. In deep learning applications, discrete data, e.g. words or n-grams in language, or amino acids or nucleotides in bioinformatics, are generally represented as a continuous vector through an embedding matrix. Recently, learning this embedding matrix directly from the data as part of the continuous iteration of the model to optimize the target prediction – a process called ‘end-to-end learning’ – has led to state-of-the-art results in many fields. Although usage of embeddings is well described in the bioinformatics literature, the potential of end-to-end learning for single amino acids, as compared to more classical manually-curated encoding strategies, has not been systematically addressed. To this end, we compared classical encoding matrices, namely one-hot, VHSE8 and BLOSUM62, to end-to-end learning of amino acid embeddings for two different prediction tasks using three widely used architectures, namely recurrent neural networks (RNN), convolutional neural networks (CNN), and the hybrid CNN-RNN. Results: By using different deep learning architectures, we show that end-to-end learning is on par with classical encodings for embeddings of the same dimension even when limited training data is available, and might allow for a reduction in the embedding dimension without performance loss, which is critical when deploying the models to devices with limited computational capacities. We found that the embedding dimension is a major factor in controlling the model performance. Surprisingly, we observed that deep learning models are capable of learning from random vectors of appropriate dimension. Conclusion: Our study shows that end-to-end learning is a flexible and powerful method for amino acid encoding. Further, due to the flexibility of deep learning systems, amino acid encoding schemes should be benchmarked against random vectors of the same dimension to disentangle the information content provided by the encoding scheme from the distinguishability effect provided by the scheme.

Deep-learning↗

Comparative study of boron and neon injections on divertor heat fluxes using SOLPS-ITER simulations

Here, based on the EAST equilibrium, the effects of boron (B) and neon (Ne) injected at different locations on the target heat load, and the distributions of B and Ne particles were investigated by transport code SOLPS-ITER. It was found that the B injection was more sensitive to the injection location for heat flux control than impurity Ne. The high electron and ion densities near the inner target in the discharge with impurity B injected from over X-point (R 1 ) led to plasma detachment only at the inner target, and the localized B ions in the cases with injection from outer target location (R 2 ) and upstream location (R 3 ) led to far-SOL detachment at the outer target, but not at the inner target. In contrast, for Ne, the spatial distributions of Ne ions and electrons were found to be similar in all the cases at the three injection locations, and the detached plasma was achieved at the inner target and the electron temperature was reduced at the outer target. For locations R 2 and R 3 , impurity B showed a more pronounced effect on the heat flux at the far-SOL of the outer target. Further analysis indicated that Ne atoms came mainly from the recycling sources, whereas B atoms came mainly from injection, and that their distinct atomic distributions resulted from the difference in the ionization threshold and ionization mean free path. In addition, the radiation proportion of B in the divertor region was larger than that of Ne when the total radiation power was similar, which suggests that B has less influence on the core region.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗