Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data reduction methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46

Lossy checkpoint compression in full waveform inversion: a case study with ZFPv0.5.5 and the overthrust model

This paper proposes a new method that combines checkpointing methods with error-controlled lossy compression for large-scale high-performance full-waveform inversion (FWI), an inverse problem commonly used in geophysical exploration. This combination can significantly reduce data movement, allowing a reduction in run time as well as peak memory. In the exascale computing era, frequent data transfer (e.g., memory bandwidth, PCIe bandwidth for GPUs, or network) is the performance bottleneck rather than the peak FLOPS of the processing unit. Like many other adjoint-based optimization problems, FWI is costly in terms of the number of floating-point operations, large memory footprint during backpropagation, and data transfer overheads. Past work for adjoint methods has developed checkpointing methods that reduce the peak memory requirements during backpropagation at the cost of additional floating-point computations. Combining this traditional checkpointing with error-controlled lossy compression, we explore the three-way tradeoff between memory, precision, and time to solution. We investigate how approximation errors introduced by lossy compression of the forward solution impact the objective function gradient and final inverted solution. Empirical results from these numerical experiments indicate that high lossy-compression rates (compression factors ranging up to 100) have a relatively minor impact on convergence rates and the quality of the final solution.

58 GEOSCIENCES↗

Predictions of Slat Noise from the 30P30N at High Angles of Attack Using Zonal Hybrid RANS-LES

Aeroacoustic predictions of slat noise from the 30P30N three-element high-lift system at high angles of attack are presented using a zonal hybrid RANS-LES method. The simulations are part of the 5th AIAA Benchmark problems for Airframe Noise Computations (BANC-V) Workshop. An economical approach utilizing structured overset grids with spatially varying span-wise grid resolution and a high-order accurate finite difference method is described. The method is utilized for near-field predictions at three angles of attack: α = 5.5, 9.5, and 14.0 degrees. Far-field noise is obtained by propagating the near-field solution using a permeable surface Ffowcs Williams-Hawkings (FWH) method. Good agreement is obtained with both near-field and far-field Power Spectral Density (PSD) data from an experimental study of the 30P30N in the 2m x 2m Kevlar-wall wind tunnel at the Japan Aerospace Exploration Agency (JAXA). Specifically, the reduction in narrow band peaks and overall broadband noise levels with increasing angle of attack is captured well using the zonal hybrid RANS-LES method.

Housman, Jeffrey A.↗

WE-D-204-07: Development of An ImageJ Plugin for Renal Function Quantification: RenalQuant

Purpose: Commercial workstations usually have their own software to calculate dynamic renal functions. However, usually they have low flexibility and subjectivity on delimiting kidney and background areas. The aim of this paper is to present a public domain software, called RenalQuant, capable to semi-automatically draw regions of interest on dynamic renal scintigraphies, extracting data and generating renal function quantification parameters. Methods: The software was developed in Java and written as an ImageJ-based plugin. The preprocessing and segmentation steps include the user’s selection of one time frame with higher activity in kidney’s region, compared with background, and low activity in the liver. Next, the chosen time frame is smoothed using a Gaussian low pass spatial filter (σ = 3) for noise reduction and better delimitation of kidneys. The maximum entropy thresholding method is used for segmentation. A background area is automatically placed below each kidney, and the user confirms if these regions are correctly segmented and positioned. Quantitative data are extracted and each renogram and relative renal function (RRF) value is calculated and displayed. Results: RenalQuant plugin was validated using retrospective 20 patients’ 99mTc-DTPA exams, and compared with results produced by commercial workstation software, referred as reference. The renograms intraclass correlation coefficients (ICC) were calculated and false-negative and false-positive RRF values were analyzed. The results showed that ICC values between RenalQuant plugin and reference software for both kidneys’ renograms were higher than 0.75, showing excellent reliability. Conclusion: Our results indicated RenalQuant plugin can be trustingly used to generate renograms, using DICOM dynamic renal scintigraphy exams as input. It is user friendly and user’s interaction occurs at a minimum level. Further studies have to investigate how to increase RRF accuracy and explore how to solve limitations in the segmentation step, mainly when background region has higher activity compared to kidneys. Financial support by CAPES.

60 APPLIED LIFE SCIENCES↗

Noise reduction in spectral CT: Reducing dose and breaking the trade-off between image noise and energy bin selection

Purpose: Our purpose was to reduce image noise in spectral CT by exploiting data redundancies in the energy domain to allow flexible selection of the number, width, and location of the energy bins. Methods: Using a variety of spectral CT imaging methods, conventional filtered backprojection (FBP) reconstructions were performed and resulting images were compared to those processed using a Local HighlY constrained backPRojection Reconstruction (HYPR-LR) algorithm. The mean and standard deviation of CT numbers were measured within regions of interest (ROIs), and results were compared between FBP and HYPR-LR. For these comparisons, the following spectral CT imaging methods were used:(i) numerical simulations based on a photon-counting, detector-based CT system, (ii) a photon-counting, detector-based micro CT system using rubidium and potassium chloride solutions, (iii) a commercial CT system equipped with integrating detectors utilizing tube potentials of 80, 100, 120, and 140 kV, and (iv) a clinical dual-energy CT examination. The effects of tube energy and energy bin width were evaluated appropriate to each CT system. Results: The mean CT number in each ROI was unchanged between FBP and HYPR-LR images for each of the spectral CT imaging scenarios, irrespective of bin width or tube potential. However, image noise, as represented by the standard deviation of CT numbers in each ROI, was reduced by 36%-76%. In all scenarios, image noise after HYPR-LR algorithm was similar to that of composite images, which used all available photons. No difference in spatial resolution was observed between HYPR-LR processing and FBP. Dual energy patient data processed using HYPR-LR demonstrated reduced noise in the individual, low- and high-energy images, as well as in the material-specific basis images. Conclusions: Noise reduction can be accomplished for spectral CT by exploiting data redundancies in the energy domain. HYPR-LR is a robust method for reducing image noise in a variety of spectral CT imaging systems without losing spatial resolution or CT number accuracy. This method improves the flexibility to select energy bins in the manner that optimizes material identification and separation without paying the penalty of increased image noise or its corollary, increased patient dose.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Physics-Guided Machine Learning for Prediction of Cloud Properties in Satellite-Derived Solar Data

With over 20 years of high-resolution surface irradiance data covering most of the western hemisphere, the National Solar Radiation Database (NSRDB) is a vital public data asset. The NSRDB uses a two-step Physical Solar Model (PSM) that explicitly considers the effects of clouds and other atmospheric variables on radiative transfer. High-quality physical and optical cloud properties derived from satellite imagery are perhaps the most important data inputs to the PSM, representing the greatest source of radiation attenuation and scattering. However, traditional methods for cloud property retrieval have their own limitations and are unable to accurately predict cloud properties outside of nominal conditions. We introduce a physics-guided neural network that can accurately predict cloud properties when traditional methods fail or are inaccurate. Using this framework, we show reductions in relative Root Mean Square Error (RMSE) for Global Horizontal Irradiance (GHI) up to 13 percentage points for timesteps that previously had missing or low-quality cloud property data. We expect that this methodology will be effective in improving the quality of cloud property and solar irradiance data in the NSRDB.

cloud properties↗

Physics-Guided Machine Learning for Prediction of Cloud Properties in Satellite-Derived Solar Data: Preprint

With over 20 years of high-resolution surface irradiance data covering most of the western hemisphere, the National Solar Radiation Database (NSRDB) is a vital public data asset. The NSRDB uses a two-step Physical Solar Model (PSM) that explicitly considers the effects of clouds and other atmospheric variables on radiative transfer. High-quality physical and optical cloud properties derived from satellite imagery are perhaps the most important data input to the PSM, representing the greatest source of radiation attenuation and scattering. However, traditional methods for cloud property retrieval have their own limitations and are unable to accurately predict cloud properties outside of nominal conditions. We introduce a physics-guided neural network that can accurately predict cloud properties when traditional methods fail or are inaccurate. Using this framework, we show reductions in relative Root Mean Square Error (RMSE) for Global Horizontal Irradiance (GHI) up to 13 percentage points for timesteps that previously had missing or low-quality cloud property data. We expect that this methodology will be effective in improving the quality of cloud property and solar irradiance data in the NSRDB.

41 EE - Solar Energy Technologies Office (EE-4S)↗

A rapid method for obtaining frequency-response functions for multiple input photogrammetric data

A two-digital-camera photogrammetric technique for measuring the motion of a vibrating spacecraft structure or wing surface and an applicable data-reduction algorithm are presented. The 3D frequency-response functions are obtained by coordinate transformation from averaged cross and autopower spectra derived from the 4D camera coordinates by Fourier transformation. Error sources are investigated analytically, and sample results are shown in graphs.

Kroen, M. L.↗

Simulation of Thermographic Responses of Delaminations in Composites with Quadrupole Method

The application of the quadrupole method for simulating thermal responses of delaminations in carbon fiber reinforced epoxy composites materials is presented. The method solves for the flux at the interface containing the delamination. From the interface flux, the temperature at the surface is calculated. While the results presented are for single sided measurements, with ash heating, expansion of the technique to arbitrary temporal flux heating or through transmission measurements is simple. The quadrupole method is shown to have two distinct advantages relative to finite element or finite difference techniques. First, it is straight forward to incorporate arbitrary shaped delaminations into the simulation. Second, the quadrupole method enables calculation of the thermal response at only the times of interest. This, combined with a significant reduction in the number of degrees of freedom for the same simulation quality, results in a reduction of the computation time by at least an order of magnitude. Therefore, it is a more viable technique for model based inversion of thermographic data. Results for simulations of delaminations in composites are presented and compared to measurements and finite element method results.

Winfree, William P.↗

Inductive predictions of hydrologic events using a Long Short-Term Memory network and the Soil and Water Assessment Tool

We present machine learning methods to predict hydrologic features such as streamflow and soil moisture from spatially and temporally varying hydrological and meteorological data. Here, we used a temporal reduction technique to reduce computation and memory requirements and trained a Long Short-Term Memory (LSTM) network to predict soil moisture and streamflow over multiple watersheds. We show LSTM networks can be trained in a fraction of the time required by complex process-based and attention-based models such as Soil and Water Assessment Tool (SWAT) and GeoMAN without sacrificing accuracy. We also demonstrate that outside data - sourced from a watershed other than the target - can be used to train LSTM to comparable or even superior prediction accuracy. The success of LSTM in such spatially-inductive settings shows hydrologic features can be predicted with minimal prior knowledge of the watershed in question. Finally, we make all methodologies of this work publicly available as an end-to-end software pipeline that facilitates rapid prototyping of hydrologic learners.

97 MATHEMATICS AND COMPUTING↗

Efficient proactive vehicle relocation for on-demand mobility service with recurrent neural networks

One major challenge for on-demand mobility service (OMS) providers is to seamlessly match empty vehicles with trip requests so that the total vacant mileage is minimized. In this work, we develop an innovative data-driven approach for devising efficient vehicle relocation policy for OMS that (1) proactively relocates vehicles before the demand is observed and (2) reduces the inequality among drivers' income so that the proactive relocation policy is fair and is likely to be followed by drivers. Our approach represents the fusion of optimization and machine learning methods, which comprises three steps: First, we formulate the optimal proactive relocation as an optimal/stable matching problems and solve for global optimal solutions based on historical data. Second, the optimal solutions are then grouped and fed to train the deep learning models which consist of fully connected layers and long short-term memory networks. Low rank approximation is introduced to reduce the model complexity and improve the training performances. Finally, we use the trained model to predict the relocation policy which can be implemented in real time. We conduct comprehensive numerical experiments and sensitivity analyses to demonstrate the performances of the proposed method using New York City taxi data. Here, the results suggest that our method will reduce empty mileage per trip by 54-70% under optimal matching strategy, and a 25-32% reduction can also be achieved by following stable matching strategy. We also validate that the predicted relocation policies are robust in the presence of uncertain passenger demand level and passenger trip-requesting behavior.

33 ADVANCED PROPULSION SYSTEMS↗

Metabolic Profiling Directly from the Petri Dish Using Nanospray Desorption Electrospray Ionization Imaging Mass Spectrometry

Understanding molecular interaction pathways in complex biological systems constitutes a treasure trove of knowledge that might facilitate the specific, chemical manipulation of the countless microbiological systems that occur throughout our world. However, there is a lack of methodologies that allow the direct investigation of chemical gradients and interactions in living biological systems, in real time. Here, we report the use of nanospray desorption electrospray ionization (nanoDESI) imaging mass spectrometry for in vivo metabolic profiling of living bacterial colonies directly from the Petri dish with absolutely no sample preparation needed. Using this technique, we investigated single colonies of Shewanella oneidensis MR-1, Bacillus subtilis 3610, and Streptomyces coelicolor A3(2) as well as a mixed biofilm of S. oneidensis MR-1 and B. subtilis 3610. Data from B. subtilis 3610 and S. coelicolor A3(2) provided a means of validation for the method while data from S. oneidensis MR-1 and the mixed biofilm showed a wide range of compounds that this bacterium uses for the dissimilatory reduction of extracellular metal oxides, including riboflavin, iron-bound heme and heme biosynthetic intermediates, and the siderophore putrebactin.

Environmental Molecular Sciences Laboratory↗

Spectral Formulation for the Solution of Full-Wave Scattering from a Conducting Wedge Tipped with a Corrugated Cylinder

A spectral mode-matching technique is formulated to solve for the full-wave scattering of a corrugated cylinder-tipped wedge in the presence of an impressed electric or magnetic line source. Asymptotic approximations of large-order Bessel or Henkel functions for a fixed argument were introduced in order to overcome numerical difficulties in their regular series expansions. The corrugations on the conducting cylinder have the shape of annular sectors. The primary objective of this work is to investigate the impact of corrugations on the scattered field in the shadow region of the structure. An optimally designed corrugated cylinder placed at the tip of a conducting wedge can effectively suppress electromagnetic scattering in the shadow region. Obtained numerical results using the proposed approach prove the above concept. These results were validated against numerical data obtained using a nodal finite element method. The aim of this research is to utilize these corrugated tips in horn antenna design for the reduction of side-lobe level and the shaping of the respective E-plane radiation pattern.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Mixture Experiment Alternatives to the Slack Variable Approach

A mixture experiment involves mixing two or more components in various proportions and measuring one or more response variables on each mixture. This article presents mixture-experiment approaches for designing experiments and/or modeling the resulting data in situations where the slack-variable (SV) approach has been used. With the SV approach, one mixture component is designated the SV and the experiment is designed and/or the data are analyzed in terms of the remaining components. In a SV design, the proportion of the SV is obtained by subtracting from one the sum of the proportions of the remaining components, thus "taking up the slack". With the mixture-experiment approach, the experiment is designed and the data are analyzed using all of the mixture components. The article considers four situations in which the SV approach has been used, and explains for each situation that it is generally preferable to use an appropriate mixture-experiment approach. For each situation, the recommended mixture-experiment approach is discussed and compared to the SV approach using an example.

97 MATHEMATICS AND COMPUTING↗

Complementarity of neutron, XFEL and synchrotron crystallography for defining the structures of metalloenzymes at room temperature

Room-temperature macromolecular crystallography allows protein structures to be determined under close-to-physiological conditions, permits dynamic freedom in protein motions and enables time-resolved studies. In the case of metalloenzymes that are highly sensitive to radiation damage, such room-temperature experiments can present challenges, including increased rates of X-ray reduction of metal centres and site-specific radiation-damage artefacts, as well as in devising appropriate sample-delivery and data-collection methods. It can also be problematic to compare structures measured using different crystal sizes and light sources. In this study, structures of a multifunctional globin, dehaloperoxidase B (DHP-B), obtained using several methods of room-temperature crystallographic structure determination are described and compared. Here, data were measured from large single crystals and multiple microcrystals using neutrons, X-ray free-electron laser pulses, monochromatic synchrotron radiation and polychromatic (Laue) radiation light sources. These approaches span a range of 18 orders of magnitude in measurement time per diffraction pattern and four orders of magnitude in crystal volume. The first room-temperature neutron structures of DHP-B are also presented, allowing the explicit identification of the hydrogen positions. The neutron data proved to be complementary to the serial femtosecond crystallography data, with both methods providing structures free of the effects of X-ray radiation damage when compared with standard cryo-crystallography. Comparison of these room-temperature methods demonstrated the large differences in sample requirements, data-collection time and the potential for radiation damage between them. With regard to the structure and function of DHP-B, despite the results being partly limited by differences in the underlying structures, new information was gained on the protonation states of active-site residues which may guide future studies of DHP-B.

36 MATERIALS SCIENCE↗

Unsupervised discovery of temporal sequences in high-dimensional datasets, with applications to neuroscience

Identifying low-dimensional features that describe large-scale neural recordings is a major challenge in neuroscience. Repeated temporal patterns (sequences) are thought to be a salient feature of neural dynamics, but are not succinctly captured by traditional dimensionality reduction techniques. Here, we describe a software toolbox—called seqNMF—with new methods for extracting informative, non-redundant, sequences from high-dimensional neural data, testing the significance of these extracted patterns, and assessing the prevalence of sequential structure in data. We test these methods on simulated data under multiple noise conditions, and on several real neural and behavioral data sets. In hippocampal data, seqNMF identifies neural sequences that match those calculated manually by reference to behavioral events. In songbird data, seqNMF discovers neural sequences in untutored birds that lack stereotyped songs. Thus, by identifying temporal structure directly from neural data, seqNMF enables dissection of complex neural circuits without relying on temporal references from stimuli or behavioral outputs.

60 APPLIED LIFE SCIENCES↗

Fitting aerodynamic forces in the Laplace domain: An application of a nonlinear nongradient technique to multilevel constrained optimization

A technique which employs both linear and nonlinear methods in a multilevel optimization structure to best approximate generalized unsteady aerodynamic forces for arbitrary motion is described. Optimum selection of free parameters is made in a rational function approximation of the aerodynamic forces in the Laplace domain such that a best fit is obtained, in a least squares sense, to tabular data for purely oscillatory motion. The multilevel structure and the corresponding formulation of the objective models are presented which separate the reduction of the fit error into linear and nonlinear problems, thus enabling the use of linear methods where practical. Certain equality and inequality constraints that may be imposed are identified; a brief description of the nongradient, nonlinear optimizer which is used is given; and results which illustrate application of the method are presented.

Tiffany, S. H.↗

Improved omit set displacement recoveries in dynamic analysis

Two related methods for improving the dependent (OMIT set) displacements after performing a Guyan reduction are presented. The theoretical bases for the methods are derived. The NASTRAN DMAP ALTERs used to implement the methods in a NASTRAN execution are described. Data are presented that verify the methods and the NASTRAN DMAP ALTERs.

Allen, Tom↗