Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “algorithm selection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,297 records · Page 72

Gradient-Informed Design Optimization of Select Nuclear Systems

In this work, we present a gradient-informed design optimization of nuclear reactor core components based on neutronics objectives with both continuous and discrete materials. The main argument in favor of using gradient-informed design optimization is that it scales well with increasing dimensionality of the design space. First, a challenge problem with 121 free parameters is solved with a gradient-informed method and then with a genetic algorithm. Then, a challenge problem to optimize the flux profile of a simplified assembly with eight axial zones is solved. Both challenge problems are solved using directly calculated derivatives from Tools for Sensitivity and Uncertainty Analysis Methodology Implementation (TSUNAMI) in the SCALE package. Furthermore, we demonstrate how a discrete optimization problem—selection of materials for 121 voxels—can be lifted into a continuous problem with mixed materials. In the continuous space, adjoint-based gradients are well-defined, and gradient descent is applicable. Then, a forcing function is introduced that with the selection of an appropriately sized hyperparameter can be used to guide the optimized continuous solution back into a discrete solution. This paper presents an account of the challenges that were faced when applying a gradient-informed optimization algorithm using a Monte Carlo calculation to estimate the gradient information and compares a gradient descent optimization method to a genetic algorithm optimization of the same geometry. Overall, this work demonstrates the potential use of adjoint-based gradient calculations in design optimization of nuclear systems.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Improved Nested Sampling and Surrogate-Enabled Comparison With Other Marginal Likelihood Estimators

Estimating marginal likelihood is of central importance to Bayesian model selection and/or model averaging. The nested sampling method has been recently used together with the Metropolis-Hasting (M-H) sampling algorithm for estimating marginal likelihood. This study develops a new implementation of nested sampling by using the DiffeRential Evolution Adaptive Metropolis (DREAMzs) sampling algorithm. The two implementations of nested sampling are evaluated for four models of a synthetic groundwater flow modeling. The DREAMzs-based nested sampling outperforms the M-H-based nested sampling in terms of their accuracy, convergence, efficiency, and stability, which is attributed to the fact that DREAMzs is more robust than M-H for parameter sampling. The nested sampling method is also compared with four other methods (arithmetic mean, harmonic mean, stabilized harmonic mean, and thermodynamic integration) commonly used for estimating marginal likelihood and posterior probability of the four groundwater models. The comparative study requires hundreds of millions of model executions, which would not be possible without using surrogate models to replace the original models. Using the arithmetic mean estimator as the reference, the comparison reveals that thermodynamic integration outperforms nested sampling in terms of accuracy and stability, whereas nested sampling is more computationally efficient to reach to convergence. Here, the harmonic mean and stabilized harmonic mean methods give the worst marginal likelihood estimation. Accurate marginal likelihood estimation is important for accurate estimation of posterior model probability and better predictive performance of Bayesian model averaging.

54 ENVIRONMENTAL SCIENCES↗

Localized keyhole pore prediction during laser powder bed fusion via multimodal process monitoring and X-ray radiography

Systematic fault detection and control during laser powder bed fusion (L-PBF) has been a long-standing objective for system manufacturers and researchers in the additive manufacturing (AM) industry. This manuscript investigates a data fusion approach for detection of keyhole porosity formation during laser irradiation of Ti-6Al-4V substrates by concurrent recording of thermally induced optical emission measured using both off-axis and coaxial photodiode sensors, and acoustic emission. Subsurface defect formation was monitored via high-speed synchrotron X-ray imaging at 20,000 frames per second, enabling temporal registration of keyhole pore formation events to the monitoring signals at a resolution of 50 µs. We developed data fusion machine learning (ML) models for localized prediction of keyhole pore formation at various time scales ranging from 0.5 ms to 2 ms. The signal segments were featurized using two independent approaches: (1) power spectral density (PSD) and (2) highly comparative time series analysis (HCTSA) framework. The extracted features from different sensor modalities were fused together to construct a multimodal feature space and sequential feature selection was used to determine the most informative features for training the ML models. The predictive performance was evaluated for three classifying algorithms: Support Vector Machine (SVM), K-Nearest Neighbor (KNN), and Gaussian Naive Bayes (GNB). As a result, pore formation events were predicted with up to 0.95 F1-score, 1.0 recall and 0.94 accuracy. The most heavily weighted features indicate that model performance is chiefly governed by the acoustic monitoring signal, with a secondary contribution from the optical emission sensors.

36 MATERIALS SCIENCE↗

Parton distribution functions from scalar light-front parton gas model

Here, we propose an application of a microcanonical ensemble with light-front kinematics to model the phase-space distribution of relativistic constituents of a bound state. These constituents denoted by partons are treated as classical spin-zero particles confined inside the bound state with inter-parton collisions as their only interaction. The microcanonical molecular dynamics ensemble is applied to obtain the phase-space distribution of such a thermodynamic system. We sample this phase-space distribution using Monte Carlo algorithms to obtain the parton distribution functions (PDFs) in scenarios with 3, 4, and 5 identical partons. In addition PDFs when a selected number of massless partons are mixed with 3 massive partons are also presented.

Microcanonical ensemble↗

A New Global Storage-Area-Depth Data Set for Modeling Reservoirs in Land Surface and Earth System Models

Reservoir storage-area-depth relationships are the most important factors controlling thermal stratification in reservoirs and, more broadly, the water, energy and biogeochemical dynamics in the reservoirs and subsequently their impacts on downstream rivers. However, most land surface or earth system models do not account for the gradual changes of reservoir surface area and storage with the changing depth, inhibiting a consistent and accurate representation of mass, energy and biogeochemical balances in reservoirs. Here we present a physically coherent parameterization of reservoir storage-area-depth dataset at the global scale. For each reservoir, the storage-area-depth relationships were derived from an optimal geometric shape selected iteratively from five possible regular geometric shapes that minimizes the error of total storage and surface area estimation. We applied this algorithm to 6,800 reservoirs included in the Global Reservoir and Dam database (GRanD). The relative error between the estimated and observed total storage is no more than 5% and 50% for 66% and 99% of all GRanD reservoirs, respectively. More importantly, the storage-depth profiles derived from the approximated reservoir geometry compared well with remote sensing based estimation at 40 major reservoirs from previous studies, and ground-truth measurements for 34 reservoirs in the United States and China. Furthermore, the new global reservoir storage-area-depth dataset is critical for advancing future modeling and understanding of reservoir processes and subsequent effects on the terrestrial hydrological, ecological and biogeochemical cycles at the regional and global scales.

13 HYDRO ENERGY↗

TESTING A PREDICTION OF THE MERGER ORIGIN OF EARLY-TYPE GALAXIES: A CORRELATION BETWEEN STELLAR POPULATIONS AND ASYMMETRY

One of the key predictions of the merger hypothesis for the origin of early-type (elliptical and lenticular) galaxies is that tidally induced asymmetric structure should correlate with signatures of a relatively young stellar population. Such a signature was found by Schweizer and Seitzer at roughly 4{sigma} confidence. In this paper, we revisit this issue with a nearly ten-fold larger sample of 0.01 < z < 0.03 galaxies selected from the Two Micron All-Sky Survey and the Sloan Digital Sky Survey. We parameterize tidal structure using a repeatable algorithmic measure of asymmetry, and correlate this with color offset from the early-type galaxy color-magnitude relation. We recover the color offset-asymmetry correlation; furthermore, we demonstrate observationally for the first time that this effect is driven by a highly significant trend toward younger ages at higher asymmetry values. We present a simple model for the evolution of early-type galaxies through gas-rich major and minor mergers that reproduces their observed buildup from z = 1 to the present day and the distribution of present-day colors and ages. We show using this model that if both stellar populations and asymmetry were ideal 'clocks' measuring the time since last major or minor gas-rich interaction, then we would expect a rather tight correlation between age and asymmetry. We suggest that the source of extra scatter is natural diversity in progenitor star formation history, gas content, and merger mass ratio, but quantitative confirmation of this conjecture will require sophisticated modeling. We conclude that the asymmetry-age correlation is in basic accord with the merger hypothesis, and indicates that an important fraction of the early-type galaxy population is affected by major or minor mergers at cosmologically recent times.

79 ASTRONOMY AND ASTROPHYSICS↗

Visualization System for Evolutionary Neural Networks for Deep Learning

Deep learning is actively used in a wide range of fields for scientific discovery. To effectively apply deep learning to a particular problem, it is important to select an appropriate network architecture and other hyper-parameters (at each layer). Evolving architectures and hyper-parameters using a genetic algorithm is one current approach to search the huge space of all possible configurations to find those more optimal for the problem. However, examining an evolutionary process and tuning the genetic algorithm are challenging, pushing most users to treat the process as a black box. To address this challenge, we propose a visualization system for evolutionary neural networks for deep learning. The key feature of our visualization system is to provide a visual analytics environment for evaluating a genetic algorithm in order to improve the underlying operations to reduce time to find good solutions. Our system is able to not only visualize how a genetic algorithm traverses its search space but also allows users to examine evolving networks in-depth to get insights to improve performance through interactive visualization components.

Chae, Junghoon↗

A Machine Learning-based Reliability Evaluation Model for Integrated Power-Gas Systems

This article proposes a hybrid machine learning method for the reliability evaluation of integrated power-gas systems (IPGS) under the uncertain component failure probability distributions. The Random Forest (RF) method is designed to select important features to solve the insufficient quantity of data and the curse of dimensionality problems. The Extreme Gradient Boosting (XGBoost) regression algorithm is developed to quantify the relationship between the uncertain parameters and reliability metrics. Moreover, a ten-fold cross-validation method is employed to further improve the accuracy of the regression model. Simulation results on three test systems show that the proposed method can achieve high accuracy for the reliability evaluation.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Deep Jointly-Informed neural networks

OJINN Is an easy-to-use deep neural network model that requires fewer user-specified hyper-parameters than traditional neural networks. The algorithm leverages decision trees trained on the data to determine an appropriate deep neural network architectures and weight Initializations. Optional functions also select the learning rate, batch size. and number of training Iterations necessary to create an accurate model.

Humbird, Kelli↗

Observation Targeting for the Tehachapi Pass and Mid-Columbia Basin: WindSENSE Phase III Project Summary Report

The overall goal of this multi-phased research project known as WindSENSE is to develop an observation system deployment strategy that would improve wind power generation forecasts. The objective of the deployment strategy is to produce the maximum benefit for 1- to 6-hour ahead forecasts of wind speed at hub-height (~80 m). In Phase III of the project, the focus was on the Mid-Columbia Basin region which encompasses the Bonneville Power Administration (BPA) wind generation area shown in Figure 1 that includes Klondike, Stateline, and Hopkins Ridge wind plants. The typical hub height of a wind turbine is approximately 80-m above ground level (AGL). So it would seem that building meteorological towers in the region upwind of a wind generation facility would provide data necessary to improve the short-term forecasts for the 80-m AGL wind speed. However, this additional meteorological information typically does not significantly improve the accuracy of the 0- to 6-hour ahead wind power forecasts because processes controlling wind variability change from day-to-day and, at times, from hour-to-hour. It is also important to note that some processes causing significant changes in wind power production function principally in the vertical direction. These processes will not be detected by meteorological towers at off-site locations. For these reasons, it is quite challenging to determine the best type of sensors and deployment locations. To address the measurement deployment problem, Ensemble Sensitivity Analysis (ESA) was applied in the Phase I portion of the WindSENSE project. The ESA approach was initially designed to produce spatial fields that depict the sensitivity of a forecast metric to a set of prior state variables selected by the user. The best combination of variables and locations to improve the forecast was determined using the Multiple Observation Optimization Algorithm (MOOA) developed in Phase I. In Zack et al. (2010a), the ESA-MOOA approach was applied and evaluated for the wind plants in the Tehachapi Pass region for a period during the warm season. That research demonstrated that forecast sensitivity derived from the dataset was characterized by well-defined, localized patterns for a number of state variables such as the 80-m wind and the 25-m to 1-km temperature difference prior to the forecast time. The sensitivity patterns produced as part of the Tehachapi Pass study were coherent and consistent with the basic physical processes that drive wind patterns in the Tehachapi area. In Phase II of the WindSENSE project, the ESA-MOOA approach was extended and applied to the wind plants located in the Mid-Columbia Basin wind generation area of Washington-Oregon during the summer and to the Tehachapi Pass region during the winter. The objective of this study was to identify measurement locations and variables that have the greatest positive impact on the accuracy of wind forecasts in the 0- to 6-hour look-ahead periods for the two regions and to establish a higher level of confidence in ESA-MOOA for mesoscale applications. The detailed methodology and results are provided in separate technical reports listed in the publications section below. Ideally, the data assimilation scheme used in the Phase III experiments would have been based upon an ensemble Kalman filter (EnKF) that was similar to the ESA method used to diagnose the Mid-Columbia Basin sensitivity patterns in the previous studies. However, running an EnKF system at high resolution is impractical because of the very high computational cost. Thus, it was decided to use a three-dimensional variational (3DVAR) analysis scheme that is less computationally intensive. The objective of this task is to develop an observation system deployment strategy for the mid Columbia Basin (i.e. the BPA wind generation region) that is designed to produce the maximum benefit for 1- to 6-hour ahead forecasts of hub-height (~80 m) wind speed with a focus on periods of large changes in wind speed. There are two tasks in the current project effort designed to validate the ESA observational system deployment approach in order to move closer to the overall goal: (1) Perform an Observing System Experiment (OSE) using a data denial approach. (2) Conduct a set of Observing System Simulation Experiments (OSSE) for the Mid-Columbia basin region.

17 WIND ENERGY↗

Active Learning in the Era of Big Data

Active learning methods automatically adapt data collection by selecting the most informative samples in order to accelerate machine learning. Because of this, real-world testing and comparing active learning algorithms requires collecting new datasets (adaptively), rather than simply applying algorithms to benchmark datasets, as is the norm in (passive) machine learning research. To facilitate the development, testing and deployment of active learning for real applications, we have built an open-source software system for large-scale active learning research and experimentation. The system, called NEXT, provides a unique platform for realworld, reproducible active learning research. This paper details the challenges of building the system and demonstrates its capabilities with several experiments. The results show how experimentation can help expose strengths and weaknesses of active learning algorithms, in sometimes unexpected and enlightening ways.

Jamieson, Kevin↗

Accurate Characterization of Real Networks from Inaccurate Measurements

Our nation's dependence on information networks makes it vital to anticipate disruptions or find weaknesses in these networks. But networks like the Internet are vast, distributed, and there is no mechanism to completely collect their structure. We are restricted to specific data collection schemes (like traceroute samples from router interfaces) that examine tiny portions of such a network. It has been empirically documented and theoretically proven that these measurements have significant biases, and direct inferences from them will be wrong. But these data collection mechanisms have limited flexibility and cannot be easily modified. Moreover, in many applications there are limits on how much data can be collected. How do we make accurate inferences of network properties with biased and limited measurements? The general problem this report deals with is how to work with incompletely observed networks. We will present several different approaches to this problem. First we will present an approach to estimate the degree distribution of a graph by sampling only a small portion of the vertices. This algorithm provides provably accurate results with sublinear samples. An alternative approach would be to try to enhance the information in the by selective collecting new information by probing for neighbors of a vertex or presence of individual edges. A different setting for working with incomplete arises when we have full access to local information, but do not have any global version of the graph. Can we still identify critical nodes in such a graph? We present an approach to identify such nodes efficiently. Finally, how can we put these ideas together to identify the structure of a network? We present an approach that can complement the existing approaches for network mapping. We start with an estimate of network structure based on existing network mapping methods. Then we find a critical router in the network, use the traffic through this network to selectively collect new data to enhance our prediction.

97 MATHEMATICS AND COMPUTING↗

Towards Anomaly Detection at the CMS High-Level Trigger System

Traditional trigger strategies in CMS typically rely on model-dependent selections or rigid kinematic cuts, risking the omission of unexpected exotic signatures. To address this, we propose a novel anomaly detection (AD) algorithm for the High-Level Trigger (HLT), designed to serve as a complementary second layer of filtering to the Level-1 AXOL1TL AD algorithm. We employ a transformer-based foundation model trained on a diverse ensemble of Standard Model processes. By combining a joint contrastive and classification objective, and using particle kinematics as inputs, the model learns to map events to a physics-informed latent space where anomalous events are isolated from dominant backgrounds. Preliminary results show that this strategy enhances the signal-to-background ratio across a range of rare SM and BSM scenarios. Furthermore, this work constitutes foundational R&D for the potential implementation of an analogous AD algorithm in the Level-1 trigger system for Phase-2.

Cruz, Roy [U. Wisconsin, Madison (main)] (ORCID:00↗

Search for the Standard Model Higgs Boson in associated production with w boson at the Tevatron

A search for the Standard Model Higgs boson in proton-antiproton collisions with center-of-mass energy 1.96 TeV at the Tevatron is presented in this dissertation. The process of interest is the associated production of W boson and Higgs boson, with the W boson decaying leptonically and the Higgs boson decaying into a pair of bottom quarks. The dataset in the analysis is accumulated by the D0 detector from April 2002 to April 2008 and corresponding to an integrated luminosity of 2.7 fb -1 . The events are reconstructed and selected following the criteria of an isolated lepton, missing transverse energy and two jets. The D0 Neural Network b-jet identification algorithm is further used to discriminate b jets from light jets. A multivariate analysis combining Matrix Element and Neural Network methods is explored to improve the Higgs boson signal significance. No evidence of the Higgs boson is observed in this analysis. In consequence, an observed (expected) limit on the ratio of σ (p$\bar{p}$ → WH) x Br (H → b$\bar{b}$) to the Standard Model prediction is set to be 6.7 (6.4) at 95% C.L. for the Higgs boson with a mass of 115 GeV.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Smart Grid Integrity Attacks: Characterizations and Countermeasures

Real power injections at loads and generators, and real power flows on selected lines in a transmission network are monitored, transmitted over a SCADA network to the system operator, and used in state estimation algorithms to make dispatch, re-balance and other energy management system [EMS] decisions. Coordinated cyber attacks of power meter readings can be arranged to be undetectable by any bad data detection algorithm. These unobservable attacks present a serious threat to grid operations. Of particular interest are sparse attacks that involve the compromise of a modest number of meter readings. An efficient algorithm to find all unobservable attacks [under standard DC load flow approximations] involving the compromise of exactly two power injection meters and an arbitrary number of power meters on lines is presented. This requires O(n2m) flops for a power system with n buses and m line meters. If all lines are metered, there exist canonical forms that characterize all 3, 4, and 5-sparse unobservable attacks. These can be quickly detected in power systems using standard graph algorithms. Known secure phase measurement units [PMUs] can be used as countermeasures against an arbitrary collection of cyber attacks. Finding the minimum number of necessary PMUs is NP-hard. It is shown that p + 1 PMUs at carefully chosen buses are sufficient to neutralize a collection of p cyber attacks.

24 POWER TRANSMISSION AND DISTRIBUTION↗

SU-E-I-97: Smart Auto-Planning Framework in An EMR Environment (SAFEE)

Purpose: Our Radiation Oncology Department uses clinical practice guidelines for patient treatment, including normal tissue sparing and other dosimetric constraints. These practice guidelines were adapted from national guidelines, clinical trials, literature reviews, and practitioner's own experience. Modern treatment planning systems (TPS) have the capability of incorporating these practice guidelines to automatically create radiation therapy treatment plans with little human intervention. We are developing a software infrastructure to integrate clinical practice guidelines and radiation oncology electronic medical record (EMR) system into radiation therapy treatment planning system (TPS) for auto planning. Methods: Our Smart Auto-Planning Framework in an EMR environment (SAFEE) uses a software pipeline framework to integrate practice guidelines,EMR, and TPS together. The SAFEE system starts with retrieving diagnosis information and physician's prescription from the EMR system. After approval of contouring, SAFEE will automatically create plans according to our guidelines. Based on clinical objectives, SAFEE will automatically select treatment delivery techniques (such as, 3DRT/IMRT/VMAT) and optimize plans. When necessary, SAFEE will create multiple treatment plans with different combinations of parameters. SAFEE's pipeline structure makes it very flexible to integrate various techniques, such as, Model-Base Segmentation (MBS) and plan optimization algorithms, e.g., Multi-Criteria Optimization (MCO). In addition, SAFEE uses machine learning, data mining techniques, and an integrated database to create clinical knowledgebase and then answer clinical questions, such as, how to score plan quality or how volume overlap affects physicians' decision in beam and treatment technique selection. Results: In our institution, we use Varian Aria EMR system and RayStation TPS from RaySearch, whose ScriptService API allows control by external programs. These applications are the building blocks of our SAFEE system. Conclusion: SAFEE is a feasible method of integrating clinical information to develop an auto-planning paradigm to improve clinical workflow in cancer patient care.

60 APPLIED LIFE SCIENCES↗

Cardiac motion correction based on partial angle reconstructed images in x-ray CT

Purpose: Cardiac x-ray CT imaging is still challenging due to heart motion, which cannot be ignored even with the current rotation speed of the equipment. In response, many algorithms have been developed to compensate remaining motion artifacts by estimating the motion using projection data or reconstructed images. In these algorithms, accurate motion estimation is critical to the compensated image quality. In addition, since the scan range is directly related to the radiation dose, it is preferable to minimize the scan range in motion estimation. In this paper, the authors propose a novel motion estimation and compensation algorithm using a sinogram with a rotation angle of less than 360°. The algorithm estimates the motion of the whole heart area using two opposite 3D partial angle reconstructed (PAR) images and compensates the motion in the reconstruction process. Methods: A CT system scans the thoracic area including the heart over an angular range of 180° + α + β, where α and β denote the detector fan angle and an additional partial angle, respectively. The obtained cone-beam projection data are converted into cone-parallel geometry via row-wise fan-to-parallel rebinning. Two conjugate 3D PAR images, whose center projection angles are separated by 180°, are then reconstructed with an angular range of β, which is considerably smaller than a short scan range of 180° + α. Although these images include limited view angle artifacts that disturb accurate motion estimation, they have considerably better temporal resolution than a short scan image. Hence, after preprocessing these artifacts, the authors estimate a motion model during a half rotation for a whole field of view via nonrigid registration between the images. Finally, motion-compensated image reconstruction is performed at a target phase by incorporating the estimated motion model. The target phase is selected as that corresponding to a view angle that is orthogonal to the center view angles of two conjugate PAR images. To evaluate the proposed algorithm, digital XCAT and physical dynamic cardiac phantom datasets are used. The XCAT phantom datasets were generated with heart rates of 70 and 100 bpm, respectively, by assuming a system rotation time of 300 ms. A physical dynamic cardiac phantom was scanned using a slowly rotating XCT system so that the effective heart rate will be 70 bpm for a system rotation speed of 300 ms. Results: In the XCAT phantom experiment, motion-compensated 3D images obtained from the proposed algorithm show coronary arteries with fewer motion artifacts for all phases. Moreover, object boundaries contaminated by motion are well restored. Even though object positions and boundary shapes are still somewhat different from the ground truth in some cases, the authors see that visibilities of coronary arteries are improved noticeably and motion artifacts are reduced considerably. The physical phantom study also shows that the visual quality of motion-compensated images is greatly improved. Conclusions: The authors propose a novel PAR image-based cardiac motion estimation and compensation algorithm. The algorithm requires an angular scan range of less than 360°. The excellent performance of the proposed algorithm is illustrated by using digital XCAT and physical dynamic cardiac phantom datasets.

60 APPLIED LIFE SCIENCES↗

P Finder

P Finder is written in C# and has been tested in multiple 64-bit Windows environments (Windows 7/8/Vista). It has a user-friendly graphical user interface (GUI) that allows for intuitive RNase P RNA identification and/or annotation. The user can select from four search criteria including the use multiple threads. In addition, the user can determine what display data they wish to incorporate in the output such as: bitscore, E-value, percent ID, start location, end location, the strand in which the sequence is located, and of course the sequence itself. P Finder is the only available algorithm that is capable of not only identifying the RNase P RNA for annotation but also differentiating among the five different RNase P RNA structural types (A, B, C, M, and T) with the option to select these data types for display in the final output.

Ellis, JosephC↗