Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “filter methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

QSO photometric redshifts using machine learning and neural networks

ABSTRACT The scientific value of the next generation of large continuum surveys would be greatly increased if the redshifts of the newly detected sources could be rapidly and reliably estimated. Given the observational expense of obtaining spectroscopic redshifts for the large number of new detections expected, there has been substantial recent work on using machine learning techniques to obtain photometric redshifts. Here, we compare the accuracy of the predicted photometric redshifts obtained from deep learning (DL) with the k-nearest neighbour (kNN) and the decision tree regression (DTR) algorithms. We find using a combination of near-infrared, visible, and ultraviolet magnitudes, trained upon a sample of Sloan Digital Sky Survey quasi-stellar objects, that the kNN and DL algorithms produce the best self-validation result with a standard deviation of σΔz = 0.24 (σΔz(norm) = 0.11). Testing on various subsamples, we find that the DL algorithm generally has lower values of σΔz, in addition to exhibiting a better performance in other measures. Our DL method, which uses an easy to implement off-the-shelf algorithm with neither filtering nor removal of outliers, performs similarly to other, more complex, algorithms, resulting in an accuracy of Δz < 0.1 up to z ∼ 2.5. Applying the DL algorithm trained on our 70 000 strong sample to other independent (radio-selected) data sets, we find σΔz ≤ 0.36 (σΔz(norm) ≤ 0.17) over a wide range of radio flux densities. This indicates much potential in using this method to determine photometric redshifts of quasars detected with the Square Kilometre Array.

Curran, S. J.↗
NASA NTRS1991

Geodesy by radio interferometry - Water vapor radiometry for estimation of the wet delay

An important source of error in VLBI estimates of baseline length is unmodeled variations of the refractivity of the neutral atmosphere along the propagation path of the radio signals. This paper presents and discusses the method of using data from a water vapor radiomete (WVR) to correct for the propagation delay caused by atmospheric water vapor, the major cause of these variations. Data from different WVRs are compared with estimated propagation delays obtained by Kalman filtering of the VLBI data themselves. The consequences of using either WVR data or Kalman filtering to correct for atmospheric propagation delay at the Onsala VLBI site are investigated by studying the repeatability of estimated baseline lengths from Onsala to several other sites. The repeatability obtained for baseline length estimates shows that the methods of water vapor radiometry and Kalman filtering offer comparable accuracies when applied to VLBI observations obtained in the climate of the Swedish west coast. For the most frequently measured baseline in this study, the use of WVR data yielded a 13 percent smaller weighted-root-mean-square (WRMS) scatter of the baseline length estimates compared to the use of a Kalman filter. It is also clear that the 'best' minimum elevationi angle for VLBI observations depends on the accuracy of the determinations of the total propagation delay to be used, since the error in this delay increases with increasing air mass.

Elgered, G.↗
NASA NTRS2013

Simultaneous Estimation of Model State Variables and Observation and Forecast Biases Using a Two-Stage Hybrid Kalman Filter

In this paper, we present a two-stage hybrid Kalman filter to estimate both observation and forecast bias in hydrologic models, in addition to state variables. The biases are estimated using the discrete Kalman filter, and the state variables using the ensemble Kalman filter. A key issue in this multi-component assimilation scheme is the exact partitioning of the difference between observation and forecasts into state, forecast bias and observation bias updates. Here, the error covariances of the forecast bias and the unbiased states are calculated as constant fractions of the biased state error covariance, and the observation bias error covariance is a function of the observation prediction error covariance. In a series of synthetic experiments, focusing on the assimilation of discharge into a rainfall-runoff model, it is shown that both static and dynamic observation and forecast biases can be successfully estimated. The results indicate a strong improvement in the estimation of the state variables and resulting discharge as opposed to the use of a bias-unaware ensemble Kalman filter. Furthermore, minimal code modification in existing data assimilation software is needed to implement the method. The results suggest that a better performance of data assimilation methods should be possible if both forecast and observation biases are taken into account.

Data Assimilation↗
DOE OSTI2021

Identifying insects, clouds, and precipitation using vertically pointing polarimetric radar Doppler velocity spectra

Abstract. This study presents a method to identify and distinguish insects, clouds, and precipitation in 35 GHz (Ka-band) vertically pointing polarimetric radar Doppler velocity power spectra and then produce masks indicating the occurrence of hydrometeors (i.e., clouds or precipitation) and insects at each range gate. The polarimetric radar used in this study transmits a linear polarized wave and receives signals in collinear (CoPol) and cross-linear (XPol) polarized channels. The measured CoPol and XPol Doppler velocity spectra are used to calculate linear depolarization ratio (LDR) spectra. The insect–hydrometeor discrimination method uses CoPol and XPol spectral information in two separate algorithms with their spectral results merged and then filtered into single value products at each range gate. The first algorithm discriminates between insects and clouds in the CoPol Doppler velocity power spectra based on the spectra texture, or spectra roughness, which varies due to the scattering characteristics of insects vs. cloud particles. The second algorithm distinguishes insects from raindrops and ice particles by exploiting the larger Doppler velocity spectra LDR produced by asymmetric insects. Since XPol power return is always less than CoPol power return for the same target (i.e., insect or hydrometeor), fewer insects and hydrometeors are detected in the LDR algorithm than the CoPol algorithm, which drives the need for a CoPol based algorithm. After performing both CoPol and LDR detection algorithms, regions of insect and hydrometeor scattering from both algorithms are combined in the Doppler velocity spectra domain and then filtered to produce a binary hydrometeor mask indicating the occurrence of cloud, raindrops, or ice particles at each range gate. Forty-seven summertime days were processed with the insect–hydrometeor discrimination method using US Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) program Ka-band zenith pointing radar observations in northern Oklahoma, USA. For these 47 d, over 70 % of the hydrometeor mask column bottoms were within ±100 m of simultaneous ceilometer cloud base heights. All datasets and images are available to the public on the DOE ARM repository.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRSDate not supplied

Total Variation Majorization Minimization (TV-MM) Approach to Radiometer Brightness Temperature Gridding and Reconstruction

This paper presents the implementation of an algorithm to enhance the image resolution of the Earth's surface brightness temperature (T B ) data measured by radiometers such as the one onboard of the Soil Moisture Active Passive (SMAP) mission. A key step in radiometer T B processing is the conversion of the swath-based calibrated antenna temperature (T A ) measurements to the Level 3 Earth-centered grid. The simplest algorithm to transform this data from swath to gridded format is called drop-in-the-bucket which simply averages surrounding noisy T A samples to form a T B value at the gridded location. This method reduces noise, however produces low resolution products. To obtain a higher resolution product, SMAP uses other techniques such the Backus-Gilbert (BG) algorithm, which is the conventional method used in microwave radiometry. Although this method performs the required interpolation, it is not effective in denoising and removing blurring effects due to antenna filtering of the radiometer image data. Our motivation for this development is to further improve the resolution through post-processing of the radiometer T B image, a highly cost-effective method of image enhancement. The approach adapted in this work is based on the minimization of the Total Variation (TV) regularized objective function that is used extensively in solving general ill-posed linear inverse problems in image processing. Since the TV-based objective function is convex but not everywhere differentiable, there exists many numerical algorithms that can estimate the solution and the one selected for this work is called Majorization- Minimization (MM). By applying this algorithm, simulation experiments were performed based on synthetic data from the Geophysical model as well as real SMAP data to demonstrate the effectiveness of the technique. Results were then compared against the BG method.

Wing Lee↗
NASA NTRS2016

Influence of Measurement Uncertainties on Fractional Solubility of Iron in Mineral Aerosols over the Oceans

The atmospheric supply of mineral dust iron (Fe) plays a crucial role in the Earths biogeochemical cycle and is of specific importance as a micronutrient in the marine environment. Observations show several orders of magnitude variability in the fractional solubility of Fe in mineral dust aerosols, making it hard to assess the role of mineral dust for the global ocean biogeochemical Fe cycle. In this study we compare the operational solubility of mineral dust aerosol Fe associated with the flow-through leaching protocol to the results of the global 3-D chemical transport model GEOS-Chem. According to the protocol, aerosol Fe is defined as soluble by first deionized water leaching of mineral dust through a 0.45 m pore size membrane followed by acidification and storage of the leachate over a long period of time prior to analysis. To estimate the uncertainty in soluble Fe results introduced by the flow-through leaching protocol, we prescribe an average 50 (range of 30 to 70) fractional solubility to sub-0.45 m sized mineral dust particles that may inadvertently pass the filter and end up in the acidified (at pH1.7) leachate for a couple of month period. In the model, the fractional solubility of Fe is either explicitly calculated using a complex mineral aerosol Fe dissolution module, or prescribed to be 1 and 4. Calculations show that the fractional solubility of Fe derived through the flow-through leaching is higher compared to the model results. The largest differences (40) are predicted to occur farther away from the dust source regions, over the areas where sub-0.45 m sized mineral dust particles contribute a larger fraction of the total mineral dust mass. This study suggests that different methods used in soluble Fe measurements and inconsistences in the operational definition of filterable Fe in marine environment and soluble Fe in atmospheric aerosols are likely to contribute to the wide range of fractional solubility of aerosol Fe reported in the literature.

Soluble Iron↗
NASA NTRS1990

On recursive least-squares filtering algorithms and implementations

In many real-time signal processing applications, fast and numerically stable algorithms for solving least-squares problems are necessary and important. In particular, under non-stationary conditions, these algorithms must be able to adapt themselves to reflect the changes in the system and take appropriate adjustments to achieve optimum performances. Among existing algorithms, the QR-decomposition (QRD)-based recursive least-squares (RLS) methods have been shown to be useful and effective for adaptive signal processing. In order to increase the speed of processing and achieve high throughput rate, many algorithms are being vectorized and/or pipelined to facilitate high degrees of parallelism. A time-recursive formulation of RLS filtering employing block QRD will be considered first. Several methods, including a new non-continuous windowing scheme based on selectively rejecting contaminated data, were investigated for adaptive processing. Based on systolic triarrays, many other forms of systolic arrays are shown to be capable of implementing different algorithms. Various updating and downdating systolic algorithms and architectures for RLS filtering are examined and compared in details, which include Householder reflector, Gram-Schmidt procedure, and Givens rotation. A unified approach encompassing existing square-root-free algorithms is also proposed. For the sinusoidal spectrum estimation problem, a judicious method of separating the noise from the signal is of great interest. Various truncated QR methods are proposed for this purpose and compared to the truncated SVD method. Computer simulations provided for detailed comparisons show the effectiveness of these methods. This thesis deals with fundamental issues of numerical stability, computational efficiency, adaptivity, and VLSI implementation for the RLS filtering problems. In all, various new and modified algorithms and architectures are proposed and analyzed; the significance of any of the new method depends crucially on specific application.

Hsieh, Shih-Fu↗
DOE OSTI2020

Inferred UV fluence focal-spot profiles from soft x-ray pinhole-camera measurements on OMEGA

A method was developed with laser-irradiated Au planar foils to characterize the focal spot of UV laser beams on target at full energy from soft x-ray emission. A pinhole camera with a back-thinned charge-coupled–device detector and filtration with thin Be and Al foil filters provides images of the x-ray emission at photon energies <2 keV. This method requires a careful measurement of the relation between the applied UV fluence and the x-ray signal, which can be described by a power-law dependence. The measured exponent γ ~ 2 provides a dynamic range of ~25 for the inferred UV fluence. UV fluence profiles of selected beams were measured for 100-ps and 1-ns laser pulses and were compared to directly measured profiles from an UV equivalent-target-plane diagnostic. The inferred spot size and super-Gaussian order from the x-ray technique agree within several percent with the values measured with the direct UV measurements.

47 OTHER INSTRUMENTATION↗
NASA NTRS1984

Air data position-error calibration using state reconstruction techniques

During the highly maneuverable aircraft technology (HiMAT) flight test program recently completed at NASA Ames Research Center's Dryden Flight Research Facility, numerous problems were experienced in airspeed calibration. This necessitated the use of state reconstruction techniques to arrive at a position-error calibration. For the HiMAT aircraft, most of the calibration effort was expended on flights in which the air data pressure transducers were not performing accurately. Following discovery of this problem, the air data transducers of both aircraft were wrapped in heater blankets to correct the problem. Additional calibration flights were performed, and from the resulting data a satisfactory position-error calibration was obtained. This calibration and data obtained before installation of the heater blankets were used to develop an alternate calibration method. The alternate approach took advantage of high-quality inertial data that was readily available. A linearized Kalman filter (LKF) was used to reconstruct the aircraft's wind-relative trajectory; the trajectory was then used to separate transducer measurement errors from the aircraft position error. This calibration method is accurate and inexpensive. The LKF technique has an inherent advantage of requiring that no flight maneuvers be specially designed for airspeed calibrations. It is of particular use when the measurements of the wind-relative quantities are suspected to have transducer-related errors.

Whitmore, S. A.↗
NASA NTRS2016

Variation in Global Chemical Composition of PM2.5: Emerging Results from SPARTAN

The Surface PARTiculate mAtter Network (SPARTAN) is a long-term project that includes characterization of chemical and physical attributes of aerosols from filter samples collected worldwide. This paper discusses the ongoing efforts of SPARTAN to define and quantify major ions and trace metals found in fine particulate matter (PM (sub 2.5). Our methods infer the spatial and temporal variability of PM (sub 2.5) in a cost-effective manner. Gravimetrically weighed filters represent multi-day averages of PM (sub 2.5), with a collocated nephelometer sampling air continuously. SPARTAN instruments are paired with AErosol RObotic NETwork (AERONET) sun photometers to better understand the relationship between ground-level PM (sub 2.5) and columnar aerosol optical depth (AOD). We have examined the chemical composition of PM (sub 2.5) at 12 globally dispersed, densely populated urban locations and a site at Mammoth Cave (US) National Park used as a background comparison. So far, each SPARTAN location has been active between the years 2013 and 2016 over periods of 2-26 months, with an average period of 12 months per site. These sites have collectively gathered over 10 years of quality aerosol data. The major PM (sub 2.5) constituents across all sites (relative contribution plus or minus Standard Deviation) are ammoniated sulfate (20 percent plus or minus 11 percent), crustal material (13.4 percent plus or minus 9.9 percent), equivalent black carbon (11.9 percent plus or minus 8.4 percent), ammonium nitrate (4.7 percent plus or minus 3.0 percent), sea salt (2.3 percent plus or minus 1.6 percent), trace element oxides (1.0 percent plus or minus 1.1 percent), water (7.2 percent plus or minus 3.3 percent) at 35 percent relative humidity, and residual matter (40 percent plus or minus 24 percent). Analysis of filter samples reveals that several PM (sub 2.5) chemical components varied by more than an order of magnitude between sites. Ammoniated sulfate ranges from 1.1 microns per cubic meter (Buenos Aires, Argentina) to 17 microns per cubic meter (Kanpur, India in the dry season). Ammonium nitrate ranged from 0.2 microns per cubic meter (Mammoth Cave, in summer) to 6.8 microns per cubic meter (Kanpur, dry season). Equivalent black carbon ranged from 0.7 microns per cubic meter (Mammoth Cave) to over 8 microns per cubic meter (Dhaka, Bangladesh and Kanpur, India). Comparison of SPARTAN vs. coincident measurements from the Interagency Monitoring of Protected Visual Environments (IMPROVE) network at Mammoth Cave yielded a high degree of consistency for daily PM (sub 2.5) (r squared equals 0.76, slope equals 1.12), daily sulfate (r squared equals 0.86, slope equals 1.03), and mean fractions of all major PM (sub 2.5) components (within 6 percent). Major ions generally agree well with previous studies at the same urban locations (e.g. sulfate fractions agree within 4 percent for 8 out of 11 collocation comparisons). Enhanced anthropogenic dust fractions in large urban areas (e.g. Singapore, Kanpur, Hanoi, and Dhaka) are apparent from high Zn to Al ratios. The expected water contribution to aerosols is calculated via the hygroscopicity parameter kappa (sub v (volume)) for each filter. Mean aggregate values ranged from 0.15 (Ilorin) to 0.28 (Rehovot). The all-site parameter mean is 0.20 plus or minus 0.04. Chemical composition and water retention in each filter measurement allows inference of hourly PM (sub 2.5) at 35 percent relative humidity by merging with nephelometer measurements. These hourly PM (sub 2.5) estimates compare favourably with a beta attenuation monitor (MetOne) at the nearby US embassy in Beijing, with a coefficient of variation r squared equals 0.67 (number equals 3167), compared to r squared equals 0.62 when v (volume) was not considered. SPARTAN continues to provide an open-access database of PM (sub 2.5) compositional filter information and hourly mass collected from a global federation of instruments.

Snider, Graydon↗
NASA NTRS2017

Semi-analytic preliminary design of low-thrust missions

Using generalized logarithmic spirals to approximate low-thrust trajectories, a new strategy for the design of low-thrust gravity-assist transfers has been developed. Each transfer leg is defined by a semi-analytic model, and its solution is equivalent to a hybrid Lambert’s problem. The method is suitable for approximating both flyby and rendezvous transfer legs. A branch and prune algorithm is used to generate a collection of initial guesses for further optimization. The analytic nature of the low-thrust model simplifies the pruning step, since dynamical and operational constraints (like maximum thrust or total v) can be imposed easily. The solutions obtained with the global search algorithm can be post-processed, filtered, and ranked according to various criteria. This is where the versatility of the method resides, because changing the selection criteria does not require a new search. Selected candidates are then optimized further, in order to generate actual low-thrust orbits. Two mission design examples are presented: an asteroid deflection mission using a kinetic impactor, and a rendezvous mission to Jupiter. These examples are used to analyze the convergence of the optimization stage, in particular how far from the optimal solution the initial guesses are.

Park, Ryan S.↗
NASA NTRS2013

Semi-Supervised Eigenbasis Novelty Detection

Recent discoveries in high-time-resolution radio astronomy data have focused attention on a new class of events. Fast transients are rare pulses of radio frequency energy lasting from microseconds to seconds that might be produced by a variety of exotic astrophysical phenomena. For example, X-ray bursts, neutron stars, and active galactic nuclei are all possible sources of short-duration, transient radio signals. It is difficult to anticipate where such signals might appear, and they are most commonly discovered through analysis of high-time- resolution data that had been collected for other purposes. Transients are often faint and difficult to detect, so improved detection algorithms can directly benefit the science yield of all such commensal monitoring. A new detection algorithm learns a low-dimensional linear manifold for describing the normal data. High reconstruction error indicates a novel signal that does not match the patterns of normal data. One unsupervised portion of the manifold model adapts its representation in response to recent data. A second supervised portion of the model is made of a basis trained in advance using labeled examples of RFI; this prevents false positives due to these events. For a linear model, an orthonormalization operation is used to combine these bases prior to the anomaly detection decision. Another novel aspect of the approach lies in combining basis vectors learned in an unsupervised, online fashion from the data stream with supervised basis vectors learned in advance from known examples of false alarms. Adaptive, data-driven detection is achieved that is also informed by existing domain knowledge about signals that may be statistically anomalous, but are not interesting and should therefore be ignored. The method was evaluated using data from the Parkes Multibeam Survey. This data set was originally collected to search for pulsars, which are astronomical sources that emit radio pulses at regular periods. However, several non-pulsar anomalies have recently been discovered in this dataset, making it a compelling test case. By explicitly filtering known false alarm patterns, the approach yields significantly better performance than current transient detection methods.

Wagstaff, Kiri L.↗
DOE OSTI2021

An Inrush Current Limit Method for SiC-based Multi-level Grid-connected Converter During Low-Voltage Ride-Through

Low-voltage ride-through is one of the grid requirements for grid-connected converters, and during the transient of grid voltage change, a large inrush current could be induced due to the control delay of the converter. This inrush current is more severe in SiC-based multi-level converters due to the small filter inductance, which is selected based on harmonics consideration. In this paper, a PWM mask method is used to limit the inrush current of a cascaded H-bridge-based grid-connected converter during the transient of grid voltage change. Simulation and experiment results are provided to validate this method.

Li, Haiguo↗
NASA NTRS1990

Computational tools for multi-linked flexible structures

A software module which designs and tests controllers and filters in Kalman Estimator form, based on a polynomial state-space model is discussed. The user-friendly program employs an interactive graphics approach to simplify the design process. A variety of input methods are provided to test the effectiveness of the estimator. Utilities are provided which address important issues in filter design such as graphical analysis, statistical analysis, and calculation time. The program also provides the user with the ability to save filter parameters, inputs, and outputs for future use.

Lee, Gordon K. F.↗
DOE OSTI2023

Sensor Fusion-Based Vehicle Detection and Tracking Using a Single Camera and Radar at a Traffic Intersection

Recent advancements in sensor technologies, in conjunction with signal processing and machine learning, have enabled real-time traffic control systems to adapt to varying traffic conditions. This paper introduces a new sensor fusion approach that combines data from a single camera and radar to achieve cost-effective and efficient vehicle detection and tracking. Initially, vehicles are independently detected and classified using the camera and radar. Then, the constant-velocity model within a Kalman filter is employed to predict vehicle locations, while the Hungarian algorithm is used to associate these predictions with sensor measurements. Finally, vehicle tracking is accomplished by merging kinematic information from predictions and measurements through the Kalman filter. A case study conducted at an intersection demonstrates the effectiveness of the proposed sensor fusion method for traffic detection and tracking, including performance comparisons with individual sensors.

47 OTHER INSTRUMENTATION↗
NASA NTRS1976

Analysis of benzo(a)pyrene in airborne particulates by gas chromatography

A routine method was developed to measure benzo(a)pyrene in airborne particulates. Samples were collected on a filter and the organic portion was extracted with cyclohexane. The polynuclear hydrocarbon (PNHC) fraction was separated from the aliphatics by column chromatography. An internal standard was added to the extract and a portion of it was injected into a gas chromatograph. Although the gas chromatographic method has often been reported in the literature, satisfactory separation of benzo(a)pyrene and benzo(e)pyrene has not been achieved. With the introduction of a nematic liquid crystal as the stationary phase good separation is now possible.

Luedecke, E.↗
DOE OSTI2022

Facile alignment estimation in carbon nanotube films using image processing

Whether a macroscopic assembly of carbon nanotubes can exhibit the one-dimensional properties expected from individual nanotubes critically depends on how well the nanotubes are aligned inside the assembly. Therefore, a simple and accurate method for assessing the degree of alignment is desired for the rapid characterization of carbon nanotube films and fibers. Here, we present an end-to-end solution for determining the global and local spatial orientation of carbon nanotubes in films within a short amount of time using a fast, precise, and economical approach based on an image processing method applied to scanning electron microscopy images. Further, we first use Laplacian edge enhancement filtering for improving the appearance of edge regions, which is followed by image partitioning into multiple blocks to capture the nanoscale orientation characteristics and total variation-based image decomposition of these image blocks. We then perform a 2D-fast Fourier transform on the image decomposed textural components of these edge-enhanced image blocks to determine the orientation distribution, which is utilized to estimate the 2D nematic order parameter. To show the effectiveness of our method, we corroborated our results against results obtained with other state-of-the-art image processing and experimental techniques.

2D-FFT↗
NASA NTRS1987

Synthetic estimation filters for a control system

Hybrid optical correlators, which use spatial light modulators and solid state imagers to interface computers and optical Fourier correlators, will allow the rapid changing of filters and digital pre- or post-correlation processing in vision systems. However, optical correlation (particulary with phase-only filtration) is notoriously sensitive to mismatches of rotation and magnification between the reference image and the input image. Such sharpness is not always desirable if the correlation pattern is to be used in a control system. Two methods of conforming the response of an inherently sharp-response optical correlation to an in plane rotation between reference and object images are discussed. The objective is to condition the correlation for better suitability to a vision-controlled system. The first method is controlled convolutional blurring of a reference image followed by construction of a matched filter (perhaps implemented as a phase-only filter). An alternative is discussed in more detail: it is a synthesis from sharp filters, so weighted as to produce a specified off-center behavior.

Juday, Richard D.↗