Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “multivariate data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Comparison of Multivariate Time Series Prediction Techniques for Emulating Noah-LSM Soil Moisture Outputs

Land surface models are crucial tools for many earth science applications including numerical weather prediction, water resource and crop monitoring, and climatological analysis. Given a set of atmospheric forcings, seasonal data, and static parameters, models like Noah-LSM solve for land surface quantities including skin temperature, sensible heat flux, and soil moisture. While these calculations are theoretically robust, they are often computationally expensive. Since artificial neural networks (ANNs) are universal function approximators, they can learn to emulate the output of a deterministic numerical model given a time series of input forcings, with the learned ANN having substantially shorter execution time. The ANN could efficiently parameterize other models, generate ensembles, and provide first-guess inputs for retrievals. As such, with the goal of developing a model that efficiently mimics the output of Noah-LSM given NLDAS2 forcings on a region covering much of the central US, we examine and compare several neural network architectures for the multi-horizon multivariate time series forecasting problem. Recent literature includes a diverse set of approaches including autoregressive architectures like LSTM and GRU, parametric and non-parametric statistical predictors (ForecastNet and MQRNN), self-attention (LSTM-attention-LSTM), and temporal convovlution (DeepTCN). We implement several of these models for the Noah-LSM prediction task, highlighting the features and challenges for each and providing practical insight on the training process.

Mitchell Dodson↗

A hidden Markov model for population-level cervical cancer screening data

The Cancer Registry of Norway has been administrating a national cervical cancer screening program since 1992 by coordinating triennial cytology exam screenings for the female population between 25 and 69 years of age. Up to 80% of cancers are prevented through mass screening, but this comes at the expense of considerable screening activity and leads to overtreatment of clinically asymptomatic precancers. Here, we present a continuous-time, time-inhomogeneous hidden Markov model which was developed to understand the screening process and cervical cancer carcinogenesis in detail. By leveraging 1.7 million individual's multivariate time-series of medical exams performed over a 25-year period, we simultaneously estimate all model parameters. We show that an age-dependent model reflects the Norwegian screening program by comparing empirical survival curves from observed registry data and data simulated from the proposed model. The model can be generalized to include more detailed individual-level covariates as well as new types of screening exams. By utilizing individual screening histories and covariate data, the proposed model shows potential for improving strategies for cancer screening programs by personalizing recommended screening intervals.

59 BASIC BIOLOGICAL SCIENCES↗

Switchgrass sward establishment selection is consistent across multiple environments and fertilization levels

Strong selection can occur during switchgrass sward establishment. Differences in establishment selection due to environment or management could provide information on genotype-by-environment variation and could influence strategies for breeding perennial grasses. Leaf samples were collected before sward establishment and from 3-year-old swards for two breeding groups (lowland and hybrid) at three locations. Within two locations, samples were collected from paired fertilized (112 kg N ha –1 ) and unfertilized plots. Allele frequencies from pooled DNA samples were studied through multivariate analysis of variance, genomewide trait predictions (heading date and winter survivorship), and genomically estimated breeding values (GEBVs) for individual sward survival within an independent data set. This study found only minor variations in selection due to location or management. Predicted heading dates of the hybrid population had significant changes due to fertilization and location. There were strong correlations among sward establishment survival GEBVs between growing environments (hybrid r = 0.77; gulf r = 0.97). Interestingly, this study found a small number of genotypes that were over-represented in established swards across all growing environments. This study reinforces a prior report of selection during sward establishment and indicates that only a small degree of establishment selection is location-specific within these diverse growing conditions.

59 BASIC BIOLOGICAL SCIENCES↗

Perspectives on Polyolefin Catalysis in Microfluidics for High-Throughput Screening: A Minireview

Polyolefins are the largest produced plastics in the world which traditionally employ continuous stirred tank reactors and fluidized bed reactors for commercial production. The operating condition, reaction kinetics, and molecular interactions inside the reactor strongly affect the polyolefin properties, which require stringent process control in conventional procedures. Understanding the catalytic pathway, behavior of polymer particles and effect of reactor conditions are essential for designing specific polymer properties, namely the molecular weight, chain length, polydispersity, etc. Microfluidics can play a significant role in designing polymers tailored to the user needs. Smaller channel dimensions help obtain uniform reaction conditions over the length of the microfluidic reactor in a controlled environment. With real-time monitoring techniques in microfluidics, even single particle growth of polymer can be studied to understand the parameters affecting the polymer properties. High throughput microfluidics can help catalyst screening in a short duration with less consumption of reagents generating less waste. When supplemented with efficient machine learning algorithms, automated high throughput microfluidics has the potential to rapidly optimize the process and develop new knowledge even with a limited data set. When trained on data sets generated using microfluidic experiments that are designed efficiently with working knowledge of the process, machine learning algorithms can provide the relationship between the multivariable parameters space and polymer properties, which is not possible with the traditional statistical methods and interpolation techniques. Here, the rise in the utilization of microfluidics, with the advancement of machine learning algorithms, for polyolefin catalysis, highlights the importance of microfluidics for catalyst discovery, parameter optimization, and understanding reaction pathway for producing polymers with specific properties for specialized applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Building a landslide hazard indicator with machine learning and land surface models

The U.S. Pacific Northwest has a history of frequent and occasionally deadly landslides caused by various factors. Using a multivariate, machine-learning approach, we combined a Pacific Northwest Landslide Inventory with a 36-year gridded hydrologic dataset from the National Climate Assessment – Land Data Assimilation System to produce a landslide hazard indicator (LHI) on a daily 0.125-degree grid. The LHI identified where and when landslides were most probable over the years 1979–2016, addressing issues of bias and completeness that muddy the analysis of multi-decadal landslide inventories. The seasonal cycle was strong along the west coast, with a peak in the winter, but weaker east of the Cascade Range. This lagging indicator can fill gaps in the observational record to identify the seasonality of landslides over a large spatiotemporal domain and show how landslide hazard has responded to a changing climate.

XGBoost↗

Gaussian Process Regression Method for Costing SmallSat Bus Capabilities

NASA is responding to the growing interest in, andcapabilities of, small satellites for science applications with an increasingnumber and frequency of Announcements of Opportunityfor small satellite space missions. Estimating the probabilitythat these mission concepts will fit within the small cost capsof these opportunities is largely driven by the probability thatone of the burgeoning number of small satellite providers will beable to meet the payload’s accommodation requirements withinthe budget for the spacecraft. JPL has collected a databasecontaining technical specifications and cost of commerciallyavailable Smallsat buses across various vendors. The primarypurpose of the database is for use in JPL’s Team X architecturestudies to inform cost estimates of a spacecraft bus which fitsthe customer’s technical requirements for their payload andmission. Customer needs are often unique and don’t alignperfectly with an off-the-shelf commercial spacecraft bus, whichmotivates the need to develop a cost model across the continuoustechnical parameter space.Al’s Bus Cost Distribution Estimator (ABCDE) uses Gaussianprocess regression (GPR) to predict commercial Smallsat spacecraftbus cost based on a subset of a customer’s technicalrequirements (payload mass, payload power, delta V, pointingcontrol, and downlink rate). GPR is implemented in ABCDE asa Bayesian method which fits an implied multivariate regressionon the technical parameters and uses kriging to intentionally“overfit” the residuals. Overfitting the residuals allows costestimates to collapse in uncertainty closer to the data pointswhile maintaining larger uncertainty intervals in regions of parameterspace with fewer data records. The data used to fit thismodel is sensitive and represents cost estimates for off-the-shelfcommercial buses. GPR simultaneously protects the sensitivityof the database and uses the sparse nature of the database toaccount for uncertainty in cost in a useful way. For a givenset of customer technical requirements, the tool provides a costestimate distribution, the percentiles of which can be interpretedas a confidence level of finding a commercial bus under a specifiedcost cap. ABCDE dramatically pushes the boundaries ofspacecraft cost estimation models due to its Bayesian methodology(accounting for the maximum uncertainty in the underlyingregression), the mathematically advanced kriging methodology,and the novelty of its application in Team X architecture tradestudies.

Austin, Alex↗

A Southern Photometric Quasar Catalog from the Dark Energy Survey Data Release 2

We present a catalog of 1.4 million photometrically selected quasar candidates in the southern hemisphere over the ~5000 deg 2 Dark Energy Survey (DES) wide survey area. We combine optical photometry from the DES second data release (DR2) with available near-infrared (NIR) and the all-sky unWISE mid-infrared photometry in the selection. We build models of quasars, galaxies, and stars with multivariate skew-t distributions in the multidimensional space of relative fluxes as functions of redshift (or color for stars) and magnitude. Our selection algorithm assigns probabilities for quasars, galaxies, and stars and simultaneously calculates photometric redshifts (photo-z) for quasar and galaxy candidates. Benchmarking on spectroscopically confirmed objects, we successfully classify (with photometry) 94.7% of quasars, 99.3% of galaxies, and 96.3% of stars when all IR bands (NIR YJHK and WISE W1W2) are available. The classification and photo-z regression success rates decrease when fewer bands are available. Our quasar (galaxy) photo-z quality, defined as the fraction of objects with the difference between the photo-z z p and the spectroscopic redshift z s , |Δz| ≡ |z s - z p |/(1 + z s ) ≤ 0.1, is 92.2% (98.1%) when all IR bands are available, decreasing to 72.2% (90.0%) using optical DES data only. Our photometric quasar catalog achieves an estimated completeness of 89% and purity of 79% at r < 21.5 (0.68 million quasar candidates), with reduced completeness and purity at 21.5 < r ≲ 24. Among the 1.4 million quasar candidates, 87,857 have existing spectra, and 84,978 (96.7%) of them are spectroscopically confirmed quasars. Finally, we provide quasar, galaxy, and star probabilities for all (0.69 billion) photometric sources in the DES DR2 coadded photometric catalog.

79 ASTRONOMY AND ASTROPHYSICS↗

Specification of inputs and instrumentation for flutter testing of multivariable systems

The application of system identification methods in flutter testing of aeroelastic structure is discussed. The accuracy with which flutter parameters are estimated depends upon the test plan and on the algorithms used to reduce the data. The techniques for selecting the kinds and optimal positions of inputs and instrumentation, under typical test constraints, are presented. Identification results for both the input/output transfer function and the value of physical parameters are given. Numerical results on the optimal input spectrum and the accelerometer location for estimating flutter parameters of a two dimensional wing are obtained using these algorithms. Current work on applying system identification methods to high order three dimensional aeroelastic structures is reported.

Gupta, N. K.↗

Optimizing high energy density sulfur cathodes: A multivariate approach to electrode formulation and processing

Lithium-sulfur (Li-S) batteries involve complex solid-liquid-solid phase transformations during both discharging and charging processes, where cathode materials, formulation, and structure play a crucial role. Here, a design of experiments (DoE) methodology and an empirical model are developed to systematically explore the interactions and trade-offs among cathode factors and process variables, and to obtain generalizable effects estimates for the multivariate system. Compared to the conventional one-factor-at-a-time (OFAT) approach, this work demonstrates advantages in both efficiency and accuracy by allowing the data to guide future research and decisions. Further, an optimized cathode formulation and processing parameters are predicted and validated experimentally, achieving over 1000 mAh g -1 in discharge capacity and improved cycling under practical lean electrolyte (4 µL mg -1 S) and high S-loading cathodes (>4 mg cm -2 ) conditions. The optimized cathode was scaled up and assembled into Li-S pouch cells, achieving 316 Wh kg -1 in cell-level energy, proving that the comprehensive and rigorous framework for optimizing complex systems with DoE leads to improved performance in a practical pouch cell system.

25 ENERGY STORAGE↗

A Transported Livengood–Wu Integral Model for Knock Prediction in Computational Fluid Dynamics Simulation

This work describes the development of a transported Livengood–Wu (L–W) integral model for computational fluid dynamics (CFD) simulation to predict autoignition and engine knock tendency. The currently employed L–W integral model considers both single-stage and two-stage ignition processes, thus can be generally applied to different fuels such as paraffin, olefin, aromatics, and alcohol. The model implementation is first validated in simulations of homogeneous charge compression ignition (HCCI) combustion for three different fuels, showing good accuracy in prediction of autoignition timing for fuels with either single-stage or two-stage ignition characteristics. Then, the L–W integral model is coupled with G-equation model to indicate end-gas autoignition and knock tendency in CFD simulations of a direct-injection spark-ignition engine. This modeling approach is about 10 times more efficient than the ones that based on detailed chemistry calculation and pressure oscillation analysis. Two fuels with same Research Octane Number (RON) but different octane sensitivity are studied, namely, Co-Optima alkylate and Co-Optima E30. Feed-forward neural network model in conjunction with multivariable minimization technique is used to generate fuel surrogates with targets of matched RON, octane sensitivity, and ethanol content. The CFD model is validated against experimental data in terms of pressure traces and heat release rate for both fuels under a wide range of operating conditions. The knock tendency—indicated by the fuel energy contained in the autoignited region—of the two fuels at different load conditions correlates well with the experimental results and the fuel octane sensitivity, implying the current knock modeling approach can capture the octane sensitivity effect and can be applied to further investigation on composition of octane sensitivity.

33 ADVANCED PROPULSION SYSTEMS↗

Learning Planar Ising Models Software

Learning Planar Ising Models is a software package written in Matlab for learning relationships among variable in a dataset using graphical models. The software package implements a generally-applicable algorithm for learning planar Ising models from any multivariate dataset. The code provides an algorithm for learning the best planar Ising model to approximate an arbitrary collection of binary random variables (possibly from sample data). Given the set of all pairwise correlations among variables, we select a planar graph and optimal planar Ising model defined on this graph to best approximate that set of correlations. The software includes demonstrations of the algorithm in simulations and for applications on publicly available datasets. Details of the algorithm, demonstration simulations, and applications are given in Johnson, et al; 2016. Reference: Johnson, J. K., Oyen, D., Chertkov, M., and Netrapalli, P. (2016). Learning planar Ising models. Journal of Machine Learning Research.

Oyen, Diane↗

Factors Influencing Willingness to Pool in Ride-Hailing Trips

In the past decade, transportation network companies (TNCs) such as Uber, Lyft, and Via have established themselves as a viable transportation alternative to other modes. However, the popularity of these services has come with a fair share of criticism for their negative externalities such as increasing vehicle miles traveled and congestion in cities. Pooled ride-hailing trips, in which all or a part of two individual (or group) trips are combined in and served by a single vehicle, have the potential to reduce these externalities. Pooling of rides is an effective solution to reduce congestion and travel cost, but pooled rides still represent a small percentage of the total trips served (and miles driven) by TNCs relative to single-occupancy (and without customer) vehicle miles. Both TNCs and cities alike will benefit from understanding what factors encourage or deter pooling a ride-hailing trip. In this study, newly available Chicago transportation network provider data were explored to identify the extent to which different socioeconomic, spatiotemporal, and trip characteristics affect willingness to pool (WTP) in ride-hailing trips. Furthermore, multivariate linear regression and machine-learning models were employed to understand and predict WTP based on location, time, and trip factors. The results show intuitive trends, with income level at drop-off and pickup locations and airport trips as the most important predictors of WTP. Results from this study can help TNCs and cities devise strategies that increase pooled ride-hailing, thereby reducing adverse transportation and energy impacts from ride-hailing modes.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Tropospheric Ozone Increases over the Southern Africa Region: Bellwether for Rapid Growth in Southern Hemisphere Pollution?

Increases in free-tropospheric (FT) ozone based on ozonesonde records from the early 1990s through 2008 over two subtropical stations, Irene (near Pretoria, South Africa) and Réunion (21 deg. S, 55 deg. E; approx. 2800 km NE of Irene in the Indian Ocean), have been reported. Over Irene a large increase in the urban-influenced boundary layer (BL, 1.5-4 km) was also observed during the 18-year period, equivalent to 30%decade−1. Here we show that the Irene BL trend is at least partly due to a gradual change in the sonde launch times from early morning to the midday period. The FT ozone profiles over Irene in 1990-2007 are re-examined, filling in a 1995-1999 gap with ozone profiles taken during the Measurements of Ozone by Airbus In-service Aircraft (MOZAIC) project over nearby Johannesburg. A multivariate regression model that accounts for the annual ozone cycle, El Niño-Southern Oscillation (ENSO) and possible tropopause changes was applied to monthly averaged Irene data from 4 to 11 km and to 1992-2011 Réunion sonde data from 4 to 15 km. Statistically significant trends appear predominantly in the middle and upper troposphere (UT; 4-11 km over Irene, 4-15 km over Réunion) in winter (June-August), with increases 1 ppbv yr(exp. −1) over Irene and approx. 2 ppbv yr(exp. −1) over Réunion. These changes are equivalent to approx. 25 and 35-45%decade( exp. −1), respectively. Both stations also display smaller positive trends in summer, with a 45%decade(exp. −1) ozone increase near the tropopause over Réunion in December. To explain the ozone increases, we investigated a time series of dynamical markers, e.g., potential vorticity (PV) at 330-350 K. PV affects UT ozone over Irene in November-December but displays little relationship with ozone over Réunion. A more likely reason for wintertime FT ozone increases over Irene and Réunion appears to be long-range transport of growing pollution in the Southern Hemisphere. The ozone increases are consistent with trajectory origins of air parcels sampled by the sondes and with recent NOx emissions trends estimated for Africa, South America and Madagascar. For Réunion trajectories also point to sources from the eastern Indian Ocean and Asia.

Trends↗

Parallel processing implementations of a contextual classifier for multispectral remote sensing data

The applicability of parallel processing schemes to the implementation of a contextual classification algorithm which exploits the spatial and spectral context of a multispectral remote sensing pixel to achieve classification is examined. Two algorithms for classifying each multivariate pixel taking into account the probable classifications of neighboring pixels are presented which make use of a size three horizontally linear neighborhood, and the serial computational complexity of the more efficient algorithm is shown to grow in proportion to the number of pixels and the cube of the number of possible categories. The implementation of the more efficient algorithm on a CDC Flexible Processor system and on a multimicroprocessor system such as the proposed PASM is then discussed. It is noted that the use of N processors to perform the calculations N times faster than a single processor overcomes the principal disadvantage of contexual classifiers, i.e., their computational complexity.

Siegel, H. J.↗

Automated Framework for Groundwater Monitoring Using DWT with LSTM and Transformers

Environmental monitoring is critical for safeguarding public health and ecological well-being. Traditional data structuring and workflow monitoring methods consume significant time and effort, hindering timely insights and effective decision-making. Our study addresses this challenge by presenting an AI framework that automates data cleaning, structuring, and modeling processes, specifically targeting applications in groundwater monitoring. By leveraging automation for data processing and model training, our framework establishes a novel and efficient paradigm for environmental monitoring, with its potential application to the vast network of over a hundred Department of Energy Environmental Management (DoE-EM) cleanup sites across the country. It analyzes data streams from a network of groundwater Internet-of-Things (IoT) sensors deployed at the Savannah River Site (SRS) for prediction modeling. This allows human experts to focus on analysis and decision-making, ultimately leading to better environmental outcomes.The framework employs multivariate time-series forecasting methods to study and model the behavior of varying chemical analytes. The continuous learning process is enabled by utilizing deep learning techniques. It allows the framework to become more nuanced in its analysis over time, adapting to the specific characteristics of the environmental site and the evolving nature of contaminant behavior. Deep learning models known for sequence modeling, LSTM, and Transformers are employed for time series forecasting. Data processing and structuring are essential components significantly impacting the final model's performance. This hypothesis was proven by presenting a comparative analysis of model performance with processed and unprocessed data. The feature engineering approach utilized was the Discrete Wavelet Transform, which works well with time series data.

Discrete Wavelet Transform (DWT)↗

Reducing systematic bias in machine learning applications to J/ψ signal extraction in high-energy nuclear physics

Machine learning techniques are increasingly used in high-energy nuclear physics because they can exploit multivariate correlations more efficiently than conventional cut-based analyses. A central challenge is the construction of training samples that faithfully reproduce the detector response observed in data. Signal samples are usually derived from detector simulations; therefore, mismatches between simulation and data can degrade classifier performance and introduce systematic biases. This work presents two practical correction procedures, namely cumulative distribution function (CDF) mapping and a shift-and-scale transformation, to align simulated signal features with those measured in data. Their performance is demonstrated with $J$/$\psi$ yield measurements in $\sqrt{s_{nn}}$ = 200 GeV Ru+Ru and Zr+Zr collisions recorded by STAR. A set of self-consistency tests shows that these procedures substantially suppress the systematic bias associated with data-simulation discrepancies in machine-learning-based signal extraction.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Software For Multivariate Bayesian Classification

PHD general-purpose classifier computer program. Uses Bayesian methods to classify vectors of real numbers, based on combination of statistical techniques that include multivariate density estimation, Parzen density kernels, and EM (Expectation Maximization) algorithm. By means of simple graphical interface, user trains classifier to recognize two or more classes of data and then use it to identify new data. Written in ANSI C for Unix systems and optimized for online classification applications. Embedded in another program, or runs by itself using simple graphical-user-interface. Online help files makes program easy to use.

Saul, Ronald↗

Interannual Variation in Phytoplankton Class-specific Primary Production at a Global Scale

Phytoplankton is responsible for over half of the net primary production on earth. The knowledge on the contribution of various phytoplankton groups to the total primary production is still poorly understood. Data from satellite observations suggest that for upwelling regions, photosynthetic rates by microplankton is higher than that of nanoplankton but that when the spatial extent is considered, the production by nanoplankton is comparable or even larger than microplankton. Here, we used the NASA Ocean Biogeochemical Model (NOBM) combined with remote sensing data via assimilation to evaluate the contribution of 4 phytoplankton groups to the total primary production. Globally, diatoms were the group that contributed the most to the total phytoplankton production (approx. 50%) followed by coccolithophores and chlorophytes. Primary production by diatoms was highest in high latitude (>45 deg) and in major upwelling systems (Equatorial Pacific and Benguela system). We assessed the effects of climate variability on the class-specific primary production using global (i.e. Multivariate El Nino Index, MEI) and 'regional' climate indices (e.g. Southern Annular Mode (SAM), Pacific Decadal Oscillation (PDO) and North Atlantic Oscillation (NAO)). Most interannual variability occurred in the Equatorial Pacific and was associated with climate variability. These results provide a modeling and data assimilation perspective to phytoplankton partitioning of primary production and contribute to our understanding of the dynamics of the carbon cycle in the oceans at a global scale.

OBM↗