Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Functional data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Robust Machine Learning Inference from X-ray Absorption Near Edge Spectra through Featurization

X-ray absorption spectroscopy (XAS) is a commonly employed technique for characterizing functional materials. In particular, X-ray absorption near edge spectra (XANES) encode local coordination and electronic information, and machine learning approaches to extract this information are of significant interest. To date, most ML approaches for XANES have primarily focused on using the raw spectral intensities as input, overlooking the potential benefits of incorporating spectral transformations and dimensionality reduction techniques into ML predictions. Here, in this work, we focused on systematically comparing the impact of different featurization methods on the performance of ML models for XAS analysis. We evaluated the classification and regression capabilities of these models on computed data sets and validated their performance on previously unseen experimental data sets. Our analysis revealed an intriguing discovery: the cumulative distribution function feature achieves both high prediction accuracy and exceptional transferability. This remarkably robust performance can be attributed to its tolerance to horizontal shifts in the spectra, which is crucial when validating models using experimental data. While this work exclusively focuses on XANES analysis, we anticipate that the methodology presented here will hold promise as a versatile asset to the broader spectroscopy community.

36 MATERIALS SCIENCE↗

Temporal RNA Integrity Analysis of Archived Spaceflight Biological Samples from ALSDA from 1991 to 2016

The purpose of this study is to assess the quality of spaceflight tissues stored in Ames Life Science Data Archive (ALSDA) freezers. Garnering information for downstream functional analysis such as generation of omics datasets from tissues is, in part, dependent on the state of sample preservation. To assess the viability of a select group of tissues, RNA integrity number (RIN) values were calculated for RNA extracted from rodent livers. Rat livers from Spacelab Life Sciences 1 (SLS-1) and mouse livers from Commercial Biomedical Test Module 3 (CBTM-3), Rodent Research 1 (RR1), and Rodent Research 3 (RR3) were tested. It was found that mean RIN values from CBTM3, RR1, and RR3 were suitable for downstream functional analysis (RIN greater than 5) while the mean RIN value for SLS-1 was not (RIN equal to 2.5 plus or minus 0.1). Information from this study could lay the foundation for future efforts in determining the types of assays that are most appropriate for different tissues in ALSDA freezers, which would maximize the scientific return on rare spaceflight samples.

ALSDA↗

SASS wind ambiguity removal by direct minimization. II - Use of smoothness and dynamical constraints

A variational analysis method (VAM) is used to remove the ambiguity of the Seasat-A Satellite Scatterometer (SASS) winds. The VAM yields the best fit to the data by minimizing an objective function S which is a measure of the lack of fit. The SASS data are described and the function S and the analysis procedure are defined. Analyses of a single ship report which are analogous to Green's functions are presented. The analysis procedure is tuned and its sensitivity is described using the QE II storm. The procedure is then applied to a case study of September 6, 1978, south of Japan.

Hoffman, R. N.↗

Analyzing Commonality In A System

Cost decreased by use of fewer types of parts. System Commonality Analysis Tool (SCAT) computer program designed to aid managers and engineers in identifying common, potentially common, and unique components of system. Incorporates three major functions: program for creation and maintenance of data base, analysis of commonality, and such system utilities as host-operating-system commands and loading and unloading of data base. Produces reports tabulating maintenance, initial configurations, and expected total costs. Written in FORTRAN 77.

Pacheco, Alfred↗

A Critical Examination of Wind-Wave Spectral Functional Form

Traditionally, data from random ocean waves are presented in spectral functions. The spectra are the result of Fourier analysis. Fourier spectral analysis has dominated data analysis for, at least, the last hundred years. It has been the standard method for is examining the global amplitude-frequency distributions. Although Fourier transform valid under extremely general conditions, there are some crucial restrictions for the Fourier spectral analysis. The system must be linear, and the data must be stationary- otherwise, the resulting spectrum will make little physical sense. The stationarity requirement is also a common required criterion for most of other available data analysis methods. Nevertheless, few, if any, natural phenomena are linear and stationary. To compound these complications is the imperfection of our probes or numerical schemes the interactions of the imperfect probes even with a perfect linear system can make the final data nonlinear. Furthermore, all the available data are usually of finite duration. Under these conditions, Fourier analysis is of limited use, For lack of alternatives, however, Fourier analysis is still used to process such data. The loose application of Fourier analysis and the insouciant adoption of the stationary and linear assumptions may lead to misleading conclusions. Ocean waves are know to be nonlinear, and the wind system generating the wave field are seldom stationary- As a result, the traditional examination of the spectral form hardly made physical sense. A new method for analyzing nonlinear and nonstationary data has been developed. The key part is the Empirical Mode Decomposition (EMD) method with which any complicated data set can be decomposed into a finite and often small number of Intrinsic Mode Functions (IMF) that serve as the basis of the representation of the data, This decomposition method is adaptive, and, therefore, highly efficient. The IMFs admit well-behaved Hilbert transforms, and yield instantaneous energy and frequency as functions of time that give sharp identifications of imbedded structures. The final presentation of the results is an energy-frequency-time distribution, designated as the Hilbert Spectrum. Among the main conceptual innovations is the introduction of the instantaneous frequencies for complicated data sets, which eliminate the need of spurious harmonics to represent nonlinear and nonstationary signals. The spectral forms of the ocean waves are very different. This new method offers the first physical meaningful view of the wave spectrum. Data from laboratory and field will be presented to illustrate the differences.

Huang, Norden E.↗

Stability analysis of the discrete-data Large-Space-Telescope system

This paper considers the application of the discrete describing function to the stability analysis of the Large-Space Telescope (LST) system. An analytical model of the CMG gimbal friction is derived, which is then used to arrive at a closed-form analytical expression for the discrete describing function of the nonlinearity. The analysis is used for the study of the fine-pointing stability of the LST vehicle. Simulation results corroborate the conclusions from the analytical analysis.

Kuo, B. C.↗

Estimating errors in least-squares fitting

While least-squares fitting procedures are commonly used in data analysis and are extensively discussed in the literature devoted to this subject, the proper assessment of errors resulting from such fits has received relatively little attention. The present work considers statistical errors in the fitted parameters, as well as in the values of the fitted function itself, resulting from random errors in the data. Expressions are derived for the standard error of the fit, as a function of the independent variable, for the general nonlinear and linear fitting problems. Additionally, closed-form expressions are derived for some examples commonly encountered in the scientific and engineering fields, namely ordinary polynomial and Gaussian fitting functions. These results have direct application to the assessment of the antenna gain and system temperature characteristics, in addition to a broad range of problems in data analysis. The effects of the nature of the data and the choice of fitting function on the ability to accurately model the system under study are discussed, and some general rules are deduced to assist workers intent on maximizing the amount of information obtained form a given set of measurements.

Richter, P. H.↗

CJ15 global PDF analysis with new electroweak data from the STAR and SeaQuest experiments

We present updates to a recent CTEQ-Jefferson Lab (CJ) global analysis of parton distribution functions with a new set of electroweak data that provide unique access to quark flavor separation in the proton. In particular, recent W W and Z Z boson measurements from the STAR experiment at RHIC put additional constraints on light quarks and antiquarks near the valence regime. The new measurement of the Drell-Yan lepton pair production ratio in p+p p + p and p+d p + d collisions by the SeaQuest experiment at Fermilab extends the large- x x coverage of the previous E866 experiment and sheds new light on the light antiquarks distribution. In this report, the impact of these new data sets on parton distribution functions will be presented with emphasis given to the flavor asymmetry of the light antiquark sea at large values of the parton momentum x x .

Park, Sanghwa↗

CJ15 global PDF analysis with new electroweak data from the STAR and SeaQuest experiments

We present updates to a recent CTEQ-Jefferson Lab (CJ) global analysis of parton distribution functions with a new set of electroweak data that provide unique access to quark flavor separation in the proton. In particular, recent W and Z boson measurements from the STAR experiment at RHIC put additional constraints on light quarks and antiquarks near the valence regime. The new measurement of the Drell-Yan lepton pair production ratio in p+p and p+d collisions by the SeaQuest experiment at Fermilab extends the large-x coverage of the previous E866 experiment and sheds new light on the light antiquarks distribution. In this report, the impact of these new data sets on parton distribution functions will be presented with emphasis given to the flavor asymmetry of the light antiquark sea at large values of the parton momentum x.

Park, Sanghwa↗

16s Amplicon Analysis of Soil Data for Interactive effects of depth and differential irrigation on soil microbiome composition and functioning

Genomic DNA was isolated from soil and rhizosphere samples using the Zymo Quick-DNA fecal/soil microbe miniprep kit (catalog no. D6010) according to the manufacturer’s instructions (Zymo Research; Irvine, CA) with the modification of eluting in 100 uL elution buffer. Sample concentrations were quantified using the Qubit dsDNA HS assay kit (Thermo Fisher). For rhizosphere samples only, DNA was subsequently purified using Zymo’s ZR-96 DNA Clean & Concentrator kit (catalog no. D4024) to account for low DNA concentrations of these samples. . In each replicate block, there were five drip irrigation treatments (T1 = 100% normal irrigation, T2 = 56.25%, T3 = 37.5%, T4 = 18.75% and T5=no irrigation. On July 20, the strength of the drought treatments was increased: T1 remained at 100%, whereas T2 changed from 75% to 56.25%, T2 changed from 50% to 37.5%, and T4 changed from 25% to 18.75%. Sequencing was performed as described previously (Naylor, Fansler, et al. 2020). Sequences were amplified on the MiSeq platform (Illumina, San Diego, CA) using 16S primers (515F and 806R) specific to the V4 region. Raw sequence data was processed with the pipeline Hundo for amplicon quality control and annotation. Downstream statistical analyses on 16S datasets were performed using the program R and the packages ‘phyloseq’ and ‘vegan’.

Soil microbiome, metatranscriptomics↗

Application of a data-mining method based on Bayesian networks to lesion-deficit analysis

Although lesion-deficit analysis (LDA) has provided extensive information about structure-function associations in the human brain, LDA has suffered from the difficulties inherent to the analysis of spatial data, i.e., there are many more variables than subjects, and data may be difficult to model using standard distributions, such as the normal distribution. We herein describe a Bayesian method for LDA; this method is based on data-mining techniques that employ Bayesian networks to represent structure-function associations. These methods are computationally tractable, and can represent complex, nonlinear structure-function associations. When applied to the evaluation of data obtained from a study of the psychiatric sequelae of traumatic brain injury in children, this method generates a Bayesian network that demonstrates complex, nonlinear associations among lesions in the left caudate, right globus pallidus, right side of the corpus callosum, right caudate, and left thalamus, and subsequent development of attention-deficit hyperactivity disorder, confirming and extending our previous statistical analysis of these data. Furthermore, analysis of simulated data indicates that methods based on Bayesian networks may be more sensitive and specific for detecting associations among categorical variables than methods based on chi-square and Fisher exact statistics.

NASA Discipline Neuroscience↗

WISP: Watching grid Infrastructure Stealthily through Proxies (Final Technical Report)

The complex interdependencies of cyber systems (sensors and communications), physical grids and associated electricity market operations make protecting electric power grids a significant challenge. The energy sector is constantly under new, targeted, advanced and dangerous cyber-attacks that have the potential to result in the loss of human life. These threats are further exacerbated by our need to modernize the grid. One focus of cyber security research in smart grids is the securing of the SCADA system through advanced intrusion detection systems (IDS) and bad data detection algorithms in state estimation. These methods either require full knowledge of the system topology and parameters or fail to understand the physical behaviors under attack. WISP (Watching grid Infrastructure Stealthily through Proxies) is designed to provide additional protection to the power grid using only publicly available data. In particular, WISP exploits the spatio-temporal nature of the real time locational marginal prices (LMPs), in conjunction with other information such as bids, weather, outages and load data to analyze anomalous power pricing behaviors and then correlate those observations to localize regions of interest and identify potential cyber events. WISP is non-intrusive as the tool is deployed as a service in the Cloud or on premise and provides reliable information to system operators for enhanced situational awareness, without impeding energy delivery functions. The WISP technology comprises three modules: the data-driven anomaly detection core, the vulnerability and risk analysis and the root cause analysis. The data-driven anomaly detection core performs the tasks of feature selection, anomaly detection and attack region localization. The vulnerability and risk analysis module provides system level information of the vulnerable variables and times, assisting the operators in selecting monitoring and protection nodes. The root cause analysis module takes the detection results and identifies potential operational conditions that contribute to the detected anomalies. In Phase I, we have demonstrated the feasibility and effectiveness of WISP. We developed a realistic electricity market simulator capable of generating normal and attack market data under various operational conditions. We developed a series of cyber-attack detection and analysis algorithms and evaluated them under multiple data sources. Finally, we integrated all modules into an end-to-end software, providing functions for data management, data analytics and visualization. Specifically, we have achieved: (i) real-time data acceptance from external utility interfaces with >99% acceptance rate; (ii) high performance anomaly detection algorithms with >98% detection accuracy and <0.1% false alarm rate; and (iii) ultra-low computing delay <50 milliseconds. Additionally, our team developed algorithms to identify the vulnerable variables in electricity market operations and root cause analysis functions to identify major contributors to the price spikes. These ancillary modules are necessary when deploying WISP in real world industry environment. In Phase II, we have demonstrated the effectiveness of WISP software on realistic largescale power systems. We performed red team testing for the Phase I WISP software and identified software vulnerabilities and implemented corresponding mitigation solutions. We adapted the electricity market simulator for the Texas synthetic 2000-bus system and generated datasets for the false data injection attacks. We created database and visualization interfaces for the Texas system and the ISO New England system. We performed software optimization in terms of operation efficiency, computing speed and detection accuracy. Finally, we tested the software on the Texas system and the ISO New England system and evaluated the detection performance. Overall, we achieved above 89% detection rate, below 3% false alarm rate and below 37 seconds of end-to-end detection delay.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Neutron Valence Structure from Nuclear Deep Inelastic Scattering

Mechanisms of spin-flavor SU(6) symmetry breaking in Quantum Chromodynamics (QCD) are studied via an extraction of the free neutron structure function from a global analysis of deep inelastic scattering (DIS) data on the proton and on nuclei from $A = 2$ (deuterium) to 208 (lead). Modification of the structure function of nucleons bound in atomic nuclei (known as the EMC effect) are consistently accounted for within the framework of a universal modification of nucleons in short-range correlated (SRC) pairs. Our extracted neutron-to-proton structure function ratio $F_2^n/F_2^p$ becomes constant for $x_B \ge 0.6$, equalling $0.47 \pm 0.04$ as $x_B \rightarrow 1$, in agreement with theoretical predictions of perturbative QCD and the Dyson Schwinger equation, and in disagreement with predictions of the Scalar Diquark dominance model. Finally, we also predict $F_2^{^3\mathrm{He}}/F_2^{^3\mathrm{H}}$, recently measured, yet unpublished, by the MARATHON collaboration, the nuclear correction function that is needed to extract $F_2^n/F_2^p$ from $F_2^{^3\mathrm{He}}/F_2^{^3\mathrm{H}}$, and the theoretical uncertainty associated with this extraction.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Variational optimization analysis of temperature and moisture advection in a severe storm environment

Horizontal wind components, potential temperature, and mixing ratio fields associated with a severe storm environment in the south central U.S. were analyzed from synoptic upper air observations with a nonhomogeneous, anisotropic weighting function. Each data field was filtered with variational optimization analysis techniques. Variational optimization analysis was also performed on the vertical motion field and was used to produce advective forecasts of the potential temperature and mixing ratio fields. Results show that the dry intrusion is characterized by warm air, the advection of which produces a well-defined upward motion pattern. A corresponding downward motion pattern comprising a deep vertical circulation in the warm air sector of the low pressure system was detected. The axes alignment of maximum dry and warm advection with the axis of the tornado-producing squall line also resulted.

Mcfarland, M. J.↗

JGI QC impact on assembly, binning, phylogenomics, and functional analysis

Background Investigators using metagenomic sequencing to study their microbiomes are often provided data that has been trimmed and decontaminated or do it themselves without knowing the effect these procedures can have on their downstream analyses. Here we evaluated the impact that JGI trimming and decontamination procedures had on assembly and binning metrics, placement of metagenome assembled genomes into species trees, and functional profiles of metagenome-assembled genomes (MAGs) extracted from twenty three complex rhizosphere metagenomes. We also investigated how more aggressive trimming impacts these binning metrics. Results We found that JGI trimmed and decontamination of input reads had some significant impacts in assembly and binning metrics compared to raw reads, and that differences in placement of MAGs in species trees increased with decreasing completeness and contamination thresholds. More aggressive trimming beyond those used by JGI were found to reduce MAG counts. Conclusions Mild trimming and decontamination of metagenomics reads prior to assembly can change an investigator’s answer to the questions, “Who is there and what are they doing? However, mild trimming and decontamination of metagenomic reads with high quality scores is recommended for those who elect to do so.

59 BASIC BIOLOGICAL SCIENCES↗

Proactive Intrusion Detection and Mitigation System

SAND2023-05661O The proactive intrusion detection and mitigation system (PIDMS) provides grid-edge situational awareness for cybersecurity defense by capturing real-time distributed energy resource (DER) network traffic and performance data with a novel approach that improves the detection and prevention of cyber-physical attacks. The PIDMS addresses the grid-edge security gap with real-time analysis of both network traffic and photovoltaic performance data to deliver a novel, cyber-physical intrusion detection system (IDS) approach that increases the accuracy and effectiveness of detection and mitigation. This hybrid IDS analysis enables dual monitoring that increases the workload of the adversary; both cyber and physical data would have to be simultaneously spoofed to evade detection. Furthermore, monitoring and analyzing cyber data are insufficient in some cases. For example, in an insider threat aimed at disrupting inverter grid-support functions where proper credentials and authentication are achieved, only the altered PV performance would indicate abnormal behavior. All in all, the PIDMS provides novel capabilities for: • Distributed, real-time cyber-physical detection and mitigation analysis • Cybersecurity defense for grid-edge systems • Analysis framework that can provide situational awareness across the transmission, distribution, and DER systems The PIDMS sensor is designed to collect cyber-physical data, process the data using machine-learning algorithms, detect abnormal events, and deploy mitigations. With these goals, the main functional PIDMS objectives are: • Capability to collect cyber-physical data • Onboard storage of cyber-physical data • Peer-to-peer communication • Computationally efficient machine-learning algorithms • Online cyber-physical data analysis • Alerting/visualization capabilities • Mitigation deployment capability with bump-in-the-wire (BITW) implementation Each of these functional objectives enable PIDMS to perform effective cyber-physical intrusion detection and mitigation. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Jones, Christian↗

SOHO Ultraviolet Coronagraph Spectrometer (UVCS) Mission Operations and Data Analysis

The scientific goal of UVCS is to obtain detailed empirical descriptions of the extended solar corona as it evolves over the solar cycle and to use these descriptions to identify and understand the physical processes responsible for coronal heating, solar wind acceleration, coronal mass ejections (CMEs), and the phenomena that establish the plasma properties of the solar wind as measured by "in situ" solar wind instruments. This report covers the period from 15 February 2003 to 14 April 2004. During that time, UVCS observations have consisted of three types: 1) standard synoptic observations comprising, primarily, the H I Lyalpha line profile and the 0 VI 103.2 and 103.7 nm intensity over a range of heights from 1.5 to about 3.0 solar radii and covering 360 degrees about the Sun, 2) sit and stare observations for major flare watches, and 3) special observations designed by the UVCS Lead Observer of the Week for a specific scientific purpose. The special observations are often coordinated with those of other space-based and ground-based instruments and they often are part of SOHO joint observation programs and campaigns. Lead observers have included UVCS Co-Investigators, scientists from the solar physics community and several graduate and undergraduate level students. UVCS has continued to achieve its purpose of using powerful spectroscopic diagnostic techniques to obtain a much more detailed description of coronal structures and dynamic phenomena than existed before the SOHO mission. The new descriptions of coronal mass ejections (CMEs) and coronal structures from UVCS have inspired a large number of theoretical studies aimed at identifying the physical processes responsible for CMEs and solar wind acceleration in coronal holes and streamers. UVCS has proven to be a very stable instrument. Stellar observations have demonstrated its radiometric stability. UVCS has not required any flight software modifications and all mechanisms are operational. The UVCS 0 VI Channel with its redundant optical path for wavelengths near H I Lyalpha is capable of observing the entire UVCS wavelength range. The regions of the detector currently being used require different grating angles for direct OVI observations and redundant path H I Lyalpha observations, and so those can no longer be observed simultaneously. Since December 1998, the 0 VI Channel has been used for all UVCS observations. Although the H I Lyalpha Channel and detector are still operational, increases in the dark count up to about 5x10(exp 4) counts/sec/pixel and an increase in high voltage current to within a factor of two of the maximum used in the laboratory before flight led to the decision to not use that detector after 1998. The visible light channel functioned nominally during the reporting period. UVCS data, data analysis software, calibration files and the mission log are available from the SOHO archive and SAO. All UVCS data are now available within three months of the observations to scientists and the general public via the SOHO Data Archive and SAO. UVCS has resulted in 33 scientific papers in 2003. There were numerous presentations at scientific meetings. UVCS Education and Public Outreach activities involved nine members of the UVCS team. During the reporting period, there were over a dozen events directed at students and teachers, museum audiences, and public audiences via the mass media, internet and educational literature.

Gurman, Joseph↗