Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “sampling algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

Effects of Jacobian Matrix Regularization on the Detectability of Adversarial Samples

The well-known vulnerability of Deep Neural Networks to adversarial samples has led to a rapid cycle of increasingly sophisticated attack algorithms and proposed defenses. While most contemporary defenses have been shown to be vulnerable to carefully configured attacks, methods based on gradient regularization and out-of-distribution detection have attracted much interest recently by demonstrating higher resilience to a broad range of attack algorithms. However, no study has yet investigated the effect of combining these techniques. In this paper, we consider the effect of Jacobian matrix regularization on the detectability of adversarial samples on the CIFAR-10 image benchmark dataset. We find that regularization has a significant effect on detectability, and in some cases can make an undetectable attack on a baseline model detectable. In addition, we give evidence that regularization may mitigate the known weaknesses of detectors to high-confidence adversarial samples. The defenses we consider here are highly generalizable, and we believe they will be useful for further investigations to transfer machine learning robustness to other data domains.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

MADLens, a python package for fast and differentiable non-Gaussian lensing simulations

Here, we present MADLens a python package for producing non-Gaussian lensing convergence maps at arbitrary source redshifts with unprecedented precision. MADLens is designed to achieve high accuracy while keeping computational costs as low as possible. A MADLens simulation with only particles produces convergence maps whose power agrees with theoretical lensing power spectra up to within the accuracy limits of HaloFit. This is made possible by a combination of a highly parallelizable particle-mesh algorithm, a sub-evolution scheme in the lensing projection, and a machine-learning inspired sharpening step. Further, MADLens is fully differentiable with respect to the initial conditions of the underlying particle-mesh simulations and a number of cosmological parameters. These properties allow MADLens to be used as a forward model in Bayesian inference algorithms that require optimization or derivative-aided sampling. Another use case for MADLens is the production of large, high resolution simulation sets as they are required for training novel deep-learning-based lensing analysis tools. We make the MADLens package publicly available under a Creative Commons License

79 ASTRONOMY AND ASTROPHYSICS↗

Towards robust autonomous impedance spectroscopy analysis: A calibrated hierarchical Bayesian approach for electrochemical impedance spectroscopy (EIS) inversion

Distribution-based analyses, such as the distribution of relaxation times (DRT) and the distribution of diffusion times (DDT), present model-free alternatives to equivalent circuit modeling for analysis of electrochemical impedance spectroscopy (EIS) data. However, reconstructing such distributions from noisy impedance data is an ill-posed problem that must be solved with specialized inversion algorithms, requiring careful control and tuning. Furthermore, most inversion algorithms developed to date can only solve problems of limited complexity. Herein, we present a new hierarchical Bayesian method for EIS inversion, leveraging efficient algorithms for optimization and Hamiltonian Monte Carlo (HMC) sampling to solve models of arbitrary complexity. We overcome the challenge of ad-hoc parameter tuning by encoding intrinsic characteristics of the DRT and DDT into flexible prior distributions and “pre-calibrating” the model to simulated data. This approach is versatile, highly robust to noise, and provides quantitative estimates of both the error structure of the data and the uncertainty in the recovered distributions. The model is validated with simulated data to demonstrate accurate recovery of the DRT and the DDT. The method also shows promise for simultaneous recovery of multiple distributions, raising the intriguing possibility of semi-autonomous EIS analysis and ad-hoc model construction. Finally, the practical utility of the method is illustrated with experimental data. Throughout, we draw comparisons to several recently published EIS inversion methodologies.

36 MATERIALS SCIENCE↗

A Kriging-Based Approach to Autonomous Experimentation with Applications to X-Ray Scattering

Abstract Modern scientific instruments are acquiring data at ever-increasing rates, leading to an exponential increase in the size of data sets. Taking full advantage of these acquisition rates will require corresponding advancements in the speed and efficiency of data analytics and experimental control. A significant step forward would come from automatic decision-making methods that enable scientific instruments to autonomously explore scientific problems—that is, to intelligently explore parameter spaces without human intervention, selecting high-value measurements to perform based on the continually growing experimental data set. Here, we develop such an autonomous decision-making algorithm that is physics-agnostic, generalizable, and operates in an abstract multi-dimensional parameter space. Our approach relies on constructing a surrogate model that fits and interpolates the available experimental data, and is continuously refined as more data is gathered. The distribution and correlation of the data is used to generate a corresponding uncertainty across the surrogate model. By suggesting follow-up measurements in regions of greatest uncertainty, the algorithm maximally increases knowledge with each added measurement. This procedure is applied repeatedly, with the algorithm iteratively reducing model error and thus efficiently sampling the parameter space with each new measurement that it requests. We validate the method using synthetic data, demonstrating that it converges to faithful replica of test functions more rapidly than competing methods, and demonstrate the viability of the approach in an experimental context by using it to direct autonomous small-angle (SAXS) and grazing-incidence small-angle (GISAXS) x-ray scattering experiments.

36 MATERIALS SCIENCE↗

Progress Implementing a Model-Based Iterative Reconstruction Algorithm for Ultrasound Imaging of Thick Concrete

All commercial nuclear power plants (NPPs) in the United States contain concrete structures. These structures provide important foundation, support, shielding, and containment functions. Identification and management of aging and the degradation of concrete structures is fundamental to the proposed long-term operation of NPPs. Concrete structures in NPPs are often inaccessible and contain large volumes of massively thick concrete. While acoustic imaging using the synthetic aperture focusing technique (SAFT) works adequately well for thin specimens of concrete such as concrete transportation structures, enhancements are needed for heavily reinforced, thick concrete. We argue that image reconstruction quality for acoustic imaging in thick concrete could be improved with Model-Based Iterative Reconstruction (MBIR) techniques. MBIR works by designing a probabilistic model for the measurements (forward model) and a probabilistic model for the object (prior model). Both models are used to formulate an objective function (cost function). The final step in MBIR is to optimize the cost function. Previously, we have demonstrated a first implementation of MBIR for an ultrasonic transducer array system. The original forward model has been upgraded to account for direct arrival signal. Updates to the forward model will be documented and the new algorithm will be assessed with synthetic and empirical samples.

concrete NDE↗

STATISTICAL STUDY OF 2XMMi-DR3/SDSS-DR8 CROSS-CORRELATION SAMPLE

Cross-correlating the XMM-Newton 2XMMi-DR3 catalog with the Sloan Digital Sky Survey (SDSS) Data Release 8, we obtain one of the largest X-ray/optical catalogs and explore the distribution of various classes of X-ray emitters in the multidimensional photometric parameter space. Quasars and galaxies occupy different zones while stars scatter in them. However, X-ray active stars have a certain distributing rule according to spectral types. The earlier the type of stars, the stronger its X-ray emitting. X-ray active stars have a similar distribution to most stars in the g - r versus r - i diagram. Based on the identified samples with SDSS spectral classification, a random forest algorithm for automatic classification is performed. The result shows that the classification accuracy of quasars and galaxies adds up to more than 93.0% while that of X-ray emitting stars only amounts to 45.3%. In other words, it is easy to separate quasars and galaxies, but it is difficult to discriminate X-ray active stars from quasars and galaxies. If we want to improve the accuracy of automatic classification, it is necessary to increase the number of X-ray emitting stars, since the majority of X-ray emitting sources are quasars and galaxies. The results obtained here will be used for the optical spectral survey performed by the Large sky Area Multi-Object fiber Spectroscopic Telescope (LAMOST, also named the Guo Shou Jing Telescope), which is a Chinese national scientific research facility operated by the National Astronomical Observatories, Chinese Academy of Sciences.

79 ASTRONOMY AND ASTROPHYSICS↗

Validation of the stochastic inversion algorithm for acoustic travel-time tomography: a large eddy simulation study

Acoustic tomography (AT) is explored as a remote sensing technique to obtain instantaneous snapshots of temperature and velocity fluctuations for wind energy applications. This study integrates Large Eddy Simulation (LES) with the Stochastic Inversion (SI) method to validate the algorithm’s capacity for accurate reconstruction of atmospheric fluctuations. The initial findings demonstrate the efficacy of the method in accurately capturing the predominant flow structures. Normalized L2 error evaluations further inform the algorithm’s precision, with errors accentuated in less sampled peripheral regions. The results underscore the method’s promise as a non-intrusive observational tool, with ongoing development poised to improve its precision and reliability.

17 WIND ENERGY↗

Laminography as a tool for imaging large-size samples with high resolution

Despite the increased brilliance of the new generation synchrotron sources, there is still a challenge with high-resolution scanning of very thick and absorbing samples, such as a whole mouse brain stained with heavy elements, and, extending further, brains of primates. Samples are typically cut into smaller parts, to ensure a sufficient X-ray transmission, and scanned separately. Compared with the standard tomography setup where the sample would be cut into many pillars, the laminographic geometry operates with slab-shaped sections significantly reducing the number of sample parts to be prepared, the cutting damage and data stitching problems. In this work, a laminography pipeline for imaging large samples (>1 cm) at micrometre resolution is presented. The implementation includes a low-cost instrument setup installed at the 2-BM micro-CT beamline of the Advanced Photon Source. Additionally, sample mounting, scanning techniques, data stitching procedures, a fast reconstruction algorithm with low computational complexity, and accelerated reconstruction on multi-GPU systems for processing large-scale datasets are presented. The applicability of the whole laminography pipeline was demonstrated by imaging four sequential slabs throughout an entire mouse brain sample stained with osmium, in total generating approximately 12 TB of raw data for reconstruction.

47 OTHER INSTRUMENTATION↗

Grid artifact reduction for direct digital radiography detectors based on rotated stationary grids with homomorphic filtering

Purpose: Grid artifacts are caused when using the antiscatter grid in obtaining digital x-ray images. In this paper, research on grid artifact reduction techniques is conducted especially for the direct detectors, which are based on amorphous selenium. Methods: In order to analyze and reduce the grid artifacts, the authors consider a multiplicative grid image model and propose a homomorphic filtering technique. For minimal damage due to filters, which are used to suppress the grid artifacts, rotated grids with respect to the sampling direction are employed, and min-max optimization problems for searching optimal grid frequencies and angles for given sampling frequencies are established. The authors then propose algorithms for the grid artifact reduction based on the band-stop filters as well as low-pass filters. Results: The proposed algorithms are experimentally tested for digital x-ray images, which are obtained from direct detectors with the rotated grids, and are compared with other algorithms. It is shown that the proposed algorithms can successfully reduce the grid artifacts for direct detectors. Conclusions: By employing the homomorphic filtering technique, the authors can considerably suppress the strong grid artifacts with relatively narrow-bandwidth filters compared to the normal filtering case. Using rotated grids also significantly reduces the ringing artifact. Furthermore, for specific grid frequencies and angles, the authors can use simple homomorphic low-pass filters in the spatial domain, and thus alleviate the grid artifacts with very low implementation complexity.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

TH-CD-209-10: Scanning Proton Arc Therapy (SPArc) - The First Robust and Delivery-Efficient Spot Scanning Proton Arc Therapy

Purpose: To develop a delivery-efficient proton spot-scanning arc therapy technique with robust plan quality. Methods: We developed a Scanning Proton Arc(SPArc) optimization algorithm integrated with (1)Control point re-sampling by splitting control point into adjacent sub-control points; (2)Energy layer re-distribution by assigning the original energy layers to the new sub-control points; (3)Energy layer filtration by deleting low MU weighting energy layers; (4)Energy layer re-sampling by sampling additional layers to ensure the optimal solution. A bilateral head and neck oropharynx case and a non-mobile lung target case were tested. Plan quality and total estimated delivery time were compared to original robust optimized multi-field step-and-shoot arc plan without SPArc optimization (Arcmulti-field) and standard robust optimized Intensity Modulated Proton Therapy(IMPT) plans. Dose-Volume-Histograms (DVH) of target and Organ-at-Risks (OARs) were analyzed along with all worst case scenarios. Total delivery time was calculated based on the assumption of a 360 degree gantry room with 1 RPM rotation speed, 2ms spot switching time, beam current 1nA, minimum spot weighting 0.01 MU, energy-layer-switching-time (ELST) from 0.5 to 4s. Results: Compared to IMPT, SPArc delivered less integral dose(−14% lung and −8% oropharynx). For lung case, SPArc reduced 60% of skin max dose, 35% of rib max dose and 15% of lung mean dose. Conformity Index is improved from 7.6(IMPT) to 4.0(SPArc). Compared to Arcmulti-field, SPArc reduced number of energy layers by 61%(276 layers in lung) and 80%(1008 layers in oropharynx) while kept the same robust plan quality. With ELST from 0.5s to 4s, it reduced 55%–60% of Arcmulti-field delivery time for the lung case and 56%–67% for the oropharynx case. Conclusion: SPArc is the first robust and delivery-efficient proton spot-scanning arc therapy technique which could be implemented in routine clinic. For modern proton machine with ELST close to 0.5s, SPArc would be a popular treatment option for both single and multi-room center.

60 APPLIED LIFE SCIENCES↗

Model Analysis ToolKit

MATK provides basic functionality to facilitate model analysis within the Python computational environment. Model analysis setup within MATK includes: - define parameters - define observations - define model (python function) - define samplesets (sets of parameter combinations) Currently supported functionality includes: - forward model runs - Latin-Hypercube sampling of parameters - multi-dimensional parameter studies - parallel execution of parameter samples - model calibration using internal Levenberg-Marquardt algorithm - model calibration using lmfit package - model calibration using levmar package - Markov Chain Monte Carlo using pymc package MATK facilitates model analysis using: - scipy - calibration (scipy.optimize) - rpy2 - Python interface to R

Harp, DylanR.↗

Real-Time Dynamic Brake Assessment Proof of Concept Final Report

This proof-of-concept research was performed to explore the feasibility of using real-world braking data from commercial motor vehicles to make a diagnosis of brake condition similar to that of the performance-based brake tester (PBBT). This was done by determining the relationship between pressure and brake force (P-BF), compensating for the gross vehicle weight (GVW). The nature of this P-BF relationship (e.g., low braking force for a given brake application pressure) may indicate brake system problems. In order to determine the relationship between brake force and brake application pressure, a few key parameters of duty cycle information were collected. Because braking events are often brief, spanning only a few seconds, a sample rate of 10 Hz was needed. The algorithm under development required brake application pressure and speed (from which deceleration was calculated). Accurate weight estimation was also needed to properly derive the braking force from the deceleration. In order to ensure that braking force was the predominant factor in deceleration for the segments of data used in analysis, the data was screened for grade as well. Also, the analysis needed to be based on pressures above the crack pressure. The crack pressure is the pressure below which the individual brakes are not applied due the nature of the mechanical system. This value, which may vary somewhat from one wheel end to another, is approximately 10 psi. Therefore, only pressures 15 psi and above were used in the analysis. The Department of Energy s Medium Truck Duty Cycle research has indicated that under the real-world circumstances of the test vehicle brake pressures of up to approximately 30 psi can be expected. Several different types of data were collected during the testing task of this project. Constant-pressure stopping tests were conducted at several combinations of brake application pressure (15, 20, 25, and 30 psi), load conditions (moderately and fully laden), and speeds (20 and 30 mph). Data was collected at 10 Hz. Standard and stepped-pressure performance-based brake tests with brake pressure transducers were performed for each loading condition. The stepped-pressure test included the constant-pressure intervals of brake application at 15, 20, 25, and 30 psi. The PBBT data files included 10 Hz streaming data collected during the testing of each axle. Two weeks of real-world duty cycle (driving and braking) data was also collected at 10 Hz. Initial analysis of the data revealed that the data collected in the field (i.e., day-to-day operations) provided the same information as that obtained from the controlled tests. Analysis of the data collected revealed a strong linear relationship between brake application pressure and deceleration for given GVWs. As anticipated, initial speed was not found to be a significant factor in the deceleration-pressure relationship, unlike GVW. The positive results obtained from this proof of concept test point to the need for further research to expand this concept. A second phase should include testing over a wider range of speeds and include medium brake application pressures in addition to the low pressures tested in this research. Testing on multiple vehicles would also be of value. This future phase should involve testing to determine how degradation of braking performance affects the pressure-deceleration relationship.

99 GENERAL AND MISCELLANEOUS↗

Deep PDF parsing to extract features for detecting embedded malware.

The number of PDF files with embedded malicious code has risen significantly in the past few years. This is due to the portability of the file format, the ways Adobe Reader recovers from corrupt PDF files, the addition of many multimedia and scripting extensions to the file format, and many format properties the malware author may use to disguise the presence of malware. Current research focuses on executable, MS Office, and HTML formats. In this paper, several features and properties of PDF Files are identified. Features are extracted using an instrumented open source PDF viewer. The feature descriptions of benign and malicious PDFs can be used to construct a machine learning model for detecting possible malware in future PDF files. The detection rate of PDF malware by current antivirus software is very low. A PDF file is easy to edit and manipulate because it is a text format, providing a low barrier to malware authors. Analyzing PDF files for malware is nonetheless difficult because of (a) the complexity of the formatting language, (b) the parsing idiosyncrasies in Adobe Reader, and (c) undocumented correction techniques employed in Adobe Reader. In May 2011, Esparza demonstrated that PDF malware could be hidden from 42 of 43 antivirus packages by combining multiple obfuscation techniques [4]. One reason current antivirus software fails is the ease of varying byte sequences in PDF malware, thereby rendering conventional signature-based virus detection useless. The compression and encryption functions produce sequences of bytes that are each functions of multiple input bytes. As a result, padding the malware payload with some whitespace before compression/encryption can change many of the bytes in the final payload. In this study we analyzed a corpus of 2591 benign and 87 malicious PDF files. While this corpus is admittedly small, it allowed us to test a system for collecting indicators of embedded PDF malware. We will call these indicators features throughout the rest of this report. The features are extracted using an instrumented PDF viewer, and are the inputs to a prediction model that scores the likelihood of a PDF file containing malware. The prediction model is constructed from a sample of labeled data by a machine learning algorithm (specifically, decision tree ensemble learning). Preliminary experiments show that the model is able to detect half of the PDF malware in the corpus with zero false alarms. We conclude the report with suggestions for extending this work to detect a greater variety of PDF malware.

99 GENERAL AND MISCELLANEOUS↗

Probabilistic Look-ahead Contingency Analysis Integrated with GE EMS Tool

This report documents implementation of the smart sampling-based probabilistic look-ahead contingency analysis algorithm, the integration with General Electric (GE) Grid Solutions’ commercial energy management system (EMS) tool, and the case study results using real world data from the Bonneville Power Administration (BPA).The probabilistic look-ahead contingency analysis algorithm incorporates forecast errors of renewable energy and load into contingency analysis functions to enable a predictive capability with a more complete picture, revealing the potential violations that are not normally detected by traditional deterministic approaches. To test its performance under practical environments, the probabilistic look-ahead contingency analysis algorithm has been integrated with the dominant GE EMS tool as a proof-of-concept for a seamless integration. To meet the output format of GE EMS tool, an extreme value distribution (EVD) algorithm is newly adapted to analyze the GE EMS’s violation-only output. Real world data from BPA are used to test its performance, and the results clearly show the effectiveness of the developed algorithm and improved situational awareness. This effort is an example of successful technology transition and cooperation under a real-world environment because it is a joint effort from department of energy, a national laboratory, a commercial vendor, and a large utility.

24 POWER TRANSMISSION AND DISTRIBUTION↗

The Multi-Mission Maximum Likelihood framework (3ML)

The age of multi-wavelength and multi-messenger astronomy has arrived and with it, new tools are needed to analyze data from multiple instruments properly and with ease. The Multi-Mission Maximum Likelihood framework (3ML) provides this functionality via the novel use of instrument plugins which allow for every instrument’s unique data to be treated independently with an appropriate likelihood. Under the 3ML framework, users can design plugins that handle instrument specific data routines transparently in the background. When multiple instruments are used together, their independent likelihoods are treated under a common minimization or Bayesian sampling framework. 3ML provides a multitude of minimization algorithm for maximum likelihood estimation (MLE) as well as several popular Bayesian posterior samplers. The entire framework is provided via a modern Python interface providing the user with a modern and easily transportable analysis framework well suited for modern astronomy. New models can be added easily. It is also possible to perform time-energy modeling. We present the framework and its main functionalities.

79 ASTRONOMY AND ASTROPHYSICS↗

Model Analysis ToolKit

MATK provides basic functionality to facilitate model analysis within the Python computational environment. Model analysis setup within MATK includes: - define parameters - define observations - define model (python function) - define samplesets (sets of parameter combinations) Currently supported functionality includes: - forward model runs - Latin-Hypercube sampling of parameters - multi-dimensional parameter studies - parallel execution of parameter samples - model calibration using internal Levenberg-Marquardt algorithm - model calibration using lmfit package - model calibration using levmar package - Markov Chain Monte Carlo using pymc package MATK facilitates model analysis using: - scipy - calibration (scipy.optimize) - rpy2 - Python interface to R

Harp, Dylan R.↗

ANALYSIS OF SAFETY IMPACTS FROM EXTERNAL FLOODING USING THE RISK-INFORMED SAFETY MARGIN CHARACTERIZATION (RISMC) TOOLKIT

The existing fleet of U.S. nuclear power plants is in the process of extending its lifetime and increasing the power generated from these plants via power uprates. In order to evaluate the impact of these factors on the safety of the plant, the Risk-Informed Safety Margin Characterization (RISMC) project aims to provide insight to decision makers through a series of simulations of the plant dynamics for different initial conditions (e.g., probabilistic analysis and uncertainty quantification). This paper demonstrates how Idaho National Laboratory (INL) researchers use the RISMC Toolkit to investigate complex nuclear plant phenomena using RAVEN and RELAP-7. The analysis focused on a highly relevant topic currently facing some nuclear power plants – specifically flooding issues. This research and development looked at challenges to a hypothetical pressurized water reactor, including: (1) a potential loss of off-site power followed by the possible loss of all diesel generators (i.e., a station black-out event), (2) earthquake induced station-blackout, and (3) a potential earthquake induced tsunami flood. The analysis is performed by using a set of codes: a thermal-hydraulic code (RELAP-7), a flooding simulation tool (NEUTRINO) and a stochastic analysis tool (RAVEN) – these are currently under development at INL. Using RAVEN, we were able to perform multiple RELAP-7 simulation runs by changing specific parts of the model in order to reflect specific aspects of different scenarios, including both the failure and recovery of critical components. The simulation employed traditional statistical tools (such as Monte-Carlo sampling) and more advanced machine-learning based algorithms to perform uncertainty quantification in order to understand changes in system performance and limitations as a consequence of power uprate. Qualitative and quantitative results obtained gave a detailed picture of the issues associated with potential accident scenarios. These types of insights can provide useful material for decision makers to perform risk-informed margins management.

97 MATHEMATICS AND COMPUTING↗