Engineering PapersSearch

SEARCH · Engineering Papers

Results for “metric learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Creating Innovative Frameworks to Spur Cultural Change at NASA Armstrong Flight Research Center

Changing the culture of an organization is a monumental task that often takes years and has no set formula. Steps can be taken, however, to spur cultural change by creating spaces and infrastructure to serve as the initial driving force. An innovation space and a bicycle sharing (bike share) program were implemented at the National Aeronautics and Space Administration (NASA) Armstrong Flight Research Center (AFRC) (Edwards, California) with a vision toward connecting Center personnel, fostering collaboration and innovation, retaining newer employees, promoting flexibility, and improving the culture and workplace atmosphere. This paper discusses the steps taken, challenges faced, novel culture-change-focused design elements, lessons learned, acquired metrics, and how these initiated cultural change at AFRC. For both the innovation space and the bike share program, funding was negotiated and provided through the NASA Convergent Aeronautics Solutions (CAS) project, which was seeking to improve the innovation and collaboration capabilities at each of the four NASA aeronautics Centers. Key stakeholders across AFRC from upper management, facilities, safety, engineering, and procurement were identified early in the process and were consulted and included throughout execution to ensure that any encountered roadblocks could be easily navigated. Research was then conducted by attending conferences and visiting culture-changing organizations both inside and outside United States Government agencies. Distilling the research, identifying available space, and deciding on specific design elements for the space was conducted by a subset of individuals of diverse backgrounds to enable quick, effective decision-making. Decisions were made with the intent to increase usage and diversity of users of the space; care was taken to ensure a well-crafted atmosphere that would foster the desired culture change. The allocated physical space required major structural modifications, new furniture, and new capabilities that would bring people in. Decisions and desires underwent a rapid reiterative process in order to stay within budget and short deadlines, while holding firm to what was seen as fundamental elements of an innovation space. The framework for cultural change being established, the more difficult task began: incubating the desired culture. Intentional workday use of the innovation space was encouraged, and organized events coordinated in order to truly foster culture change. Such incubation supports the organic spread of culture change to all areas of AFRC. This framework was complemented and expanded by the implementation of the bike share program. Steps for implementation included bike selection based on lessons learned, creating bike stations and signage, implementing bike share rules, and building a volunteer maintenance infrastructure. A novel user-reporting feedback system at each bike station is a low-impact method of capturing usage metrics. Due to the nature of the work conducted at AFRC, the bike share program and feedback system were negotiated and vetted through various organizations including legal, safety, and operations. The innovation space and the bike share program together are an effective initial framework for innovation and collaboration. Culture change takes time, but the innovation space and the bike share program are already showing signs of making a positive impact on the AFRC workforce.

rooms

Cloud-Based Demodulation and Data Distribution of a Satellite Downlink

Ground station networks connected to the cloud allow space missions to have global communications coverage without operating their own infrastructure. In this work, we describe the communications architecture for the TechEdSat-13 mission, which performed the first in-space characterization of a neuromorphic processor. The mission utilizes a commercial provider for S-band downlinks. A suite of cloud services and open-source software such as GNU Radio are leveraged to demodulate signals received by an AWS ground station during passes with TechEdSat-13 and store recovered data. Once a pass is scheduled, the entire process takes place without human intervention. On-orbit results the past year of operations are presented, demonstrating the advantages of this approach over traditional operator-owned ground stations. Use of software-defined radio makes possible custom signal processing. The homogeneity of apertures and their interfaces to the cloud simplifies scaling across many sites. This abundance of candidate links lays the groundwork for intelligent scheduling agents to optimize pass selection across several factors, automatically recover from failed contacts, and gather metrics to learn from past performance.

cloud demodulation

US metric study mission to the United Kingdom and the Federal Republic of Germany: Report of the NASA representative (Executive Summary)

The trip report is given of the NASA representative of the U.S. metric study mission to the United Kingdom and the Federal Republic of Germany. The mission was organized and conducted under the aegis of the American National Metric Council to learn at first hand the progress of metrication in the United Kingdom and the progress of metrication in the aerospace industry in both the United Kingdom and the Federal Republic of Germany. Representatives of the mission included a cross section of government, industry, labor, and other segments of the private sector. After general and special meetings in the United Kingdom, U.S. members with aerospace related interests met with aerospace representatives in the Federal Republic of Germany.

Vlannes, P. N.

Robust Explanations using Diverse Adversarially Trained Ensembles, Multi-Modal Contrastive Learning, and Attribution-based Confidence Metrics

The primary objective of this project is to strengthen the trustworthiness of AI systems by designing algorithms that make their internal decision-making processes more understandable to human users. This involves creating clear, interpretable explanations for AI decisions and developing metrics to assess these explanations' validity and reliability. Significant progress has been achieved through (i) developing symbolic explanations, (ii) generating meaningful interpretive insights, (iii) establishing accuracy and confidence metrics, and (iv) devising methods to evaluate the knowledge boundaries of AI models. To date, the research findings have been shared in peer-reviewed publications, with accompanying scientific and technical information (STI) detailed below.

97 MATHEMATICS AND COMPUTING

Evaluating Function-as-a-Service (FaaS) frameworks for the Accelerator Control System

As particle accelerator control systems evolve in complexity and scale, the need for responsive, scalable, and cost-effective computational infrastructure becomes increasingly critical. Function-as-a-Service (FaaS) offers an alternative to traditional monolithic architecture by enabling event-driven execution, automatic scaling, and fine-grained resource utilization. This paper explores the applicability and performance of FaaS frameworks in the context of a modern particle accelerator control system, with the objective of evaluating their suitability for short lived and triggered workloads. In this paper, we evaluate prominent open-source FaaS platforms in executing functional logic, triggers, and diagnostics routines. Evaluation metrics consist of cold-start latency, scalability, performance, integration with other open-source tools like Kafka. Experimental workloads were designed to simulate real-world control tasks when implemented as stateless FaaS functions. These workloads were benchmarked under various invocation loads and network conditions. Self-hosted FaaS platforms, when deployed within accelerator networks, offer greater control over execution environment, better integration with legacy systems, and support for real-time guarantees when paired with message queues. Based on lessons learned and evaluation metrics, this paper describes reliability of the FaaS framework for the Accelerator Control Systems (ACS).

Jaikar, A. [Fermilab] (ORCID:0000000332046217)

STAT_UQ_AI

Code to reproduce results in "Statistical Uncertainty Quantification for Aggregate Performance Metrics in Machine Learning Benchmarks".

Gopalan, Giri

Value, Cost, and Sharing: Open Issues in Constrained Clustering

Clustering is an important tool for data mining, since it can identify major patterns or trends without any supervision (labeled data). Over the past five years, semi-supervised (constrained) clustering methods have become very popular. These methods began with incorporating pairwise constraints and have developed into more general methods that can learn appropriate distance metrics. However, several important open questions have arisen about which constraints are most useful, how they can be actively acquired, and when and how they should be propagated to neighboring points. This position paper describes these open questions and suggests future directions for constrained clustering research.

constraints

NASA Langley's Approach to the Sandia's Structural Dynamics Challenge Problem

The objective of this challenge is to develop a data-based probabilistic model of uncertainty to predict the behavior of subsystems (payloads) by themselves and while coupled to a primary (target) system. Although this type of analysis is routinely performed and representative of issues faced in real-world system design and integration, there are still several key technical challenges that must be addressed when analyzing uncertain interconnected systems. For example, one key technical challenge is related to the fact that there is limited data on target configurations. Moreover, it is typical to have multiple data sets from experiments conducted at the subsystem level, but often samples sizes are not sufficient to compute high confidence statistics. In this challenge problem additional constraints are placed as ground rules for the participants. One such rule is that mathematical models of the subsystem are limited to linear approximations of the nonlinear physics of the problem at hand. Also, participants are constrained to use these models and the multiple data sets to make predictions about the target system response under completely different input conditions. Our approach involved initially the screening of several different methods. Three of the ones considered are presented herein. The first one is based on the transformation of the modal data to an orthogonal space where the mean and covariance of the data are matched by the model. The other two approaches worked solutions in physical space where the uncertain parameter set is made of masses, stiffnesses and damping coefficients; one matches confidence intervals of low order moments of the statistics via optimization while the second one uses a Kernel density estimation approach. The paper will touch on all the approaches, lessons learned, validation 1 metrics and their comparison, data quantity restriction, and assumptions/limitations of each approach. Keywords: Probabilistic modeling, model validation, uncertainty quantification, kernel density

Horta, Lucas G.

Application of Machine Learning Techniques to Delay Tolerant Network Routing

This dissertation discusses several machine learning techniques to improve routing in delay tolerant networks (DTNs). These are networks in which there may be long one-way trip times, asymmetric links, high error rates, and deterministic as well as non-deterministic loss of contact between network nodes, such as interplanetary satellite networks, mobile ad hoc networks and wireless sensor networks. This work uses historical network statistics to train a multi-label classifier to predict reliable paths through the network. In addition, a clustering technique is used to predict future mobile node locations. Both of these techniques are used to reduce the consumption of resources such as network bandwidth, memory and data storage that is required by replication routing methods often used in opportunistic DTN environments. Thesis contributions include: an emulation tool chain developed to create a DTN test bed for machine learning, the network and software architecture for a machine learning based routing method, the development and implementation of classification and clustering techniques and performance evaluation in terms of machine learning and routing metrics.

Dudukovich, Rachel M.

Automated Global-Scale Detection and Characterization of Anthropogenic Activity using Multi-Source Satellite-Based Remote Sensing Imagery

Satellite-based remote sensing imagery is an effective means for detecting objects and structures in support of many applications. However, detecting the spatial and temporal bounds of a specific activity in satellite imagery is inherently more complex and research in this area is nascent. One reason for this is that describing an activity implies defining both spatial and temporal bounds and while activity is inherently continuous in nature, the geospatial (imagery) time series for any particular swath of ground provided by satellite imagery is relatively sparse and discrete in comparison. The IARPA Space-Based Machine Automated Recognition Technique (SMART)1 program is the first large-scale research program to target advancing the state of the art for automatically detecting, characterizing, and monitoring large-scale anthropogenic activity in global, multispectral satellite imagery. The program has two primary research objectives: 1) the “harmonization” of multiple imagery sources and 2) automated reasoning at scale to detect, characterize, and monitor activities of interest. This paper provides details on the goals, dataset, metrics, and lessons learned of the IARPA SMART program. By releasing the annotated dataset, the program aims to foster additional research in this area by the community at large.

Hirsh R Goldberg

Energy metric prediction for double insertion mutants via the RoseNet deep learning framework

Studying the structural and functional implications of protein mutations is an important task in computational biology and bioinformatics. We leverage our previously proposed RoseNet neural network architecture to predict energy metrics of proteins with double amino acid insertions or deletions (InDels). We train models on previously generated benchmark datasets containing the exhaustive double InDel mutations for three proteins, as well as an additional three proteins for which ∼145k random mutants, each with two InDels, have been generated. We expand on our previous work by evaluating three additional proteins and analyzing domain features that impact the prediction capabilities of RoseNet. These features include InDels into secondary structures and the solvent accessible surface area (SASA) scores of the residues. We uncover further evidence to support that RoseNet has a higher proficiency of generalizing to unseen residue combinations than unseen insertion positions. We also observe that RoseNet produces higher-quality predictions when inserting into a β-sheet over an α-helix. Additionally, when the insertions fall in an area of high SASA, RoseNet often displays better performance than inserting into areas of low SASA.

59 BASIC BIOLOGICAL SCIENCES

Quantitative Analysis and Prediction of Thermal Runaway Metrics of High-Nickel Oxide Cathodes by Machine Learning Models

The pursuit of higher energy density in lithium-ion batteries has made high-nickel (Ni) layered oxides leading cathode candidates for next-generation electric vehicles. However, their poor thermal stability, particularly at Ni contents ≥ 90%, increases the risk of cathode-initiated thermal runaway. Furthermore, we present a data-driven framework combining linear and nonlinear machine learning models to predict key thermal runaway descriptors from a high-throughput differential scanning calorimetry database. With cathode composition and state of charge (SOC) as input features, the ensemble model accurately predicts peak temperature, heat release, and peak heat flow. SHAP analysis identifies Ni content and SOC as the dominant factors controlling thermal runaway temperature, while SOC primarily governs heat release and peak heat flow. Al, Mg, and Mn improve thermal stability by strengthening metal–oxygen bonding and delaying structural transformation, whereas B mainly reduces heat release through surface passivation. Validation with a new cathode composition confirms accurate prediction of SOC-dependent thermal runaway behavior and critical SOC.

25 ENERGY STORAGE

Anomaly Detection in Flight Operational Data Using Deep Learning

In this session, we demonstrate two recently developed deep learning models for anomaly detection in flight operational data by the Data Sciences Group at NASA Ames Research Center. The first model is Convolutional Variational Auto-Encoder (CVAE) [1], which is an unsupervised deep encoder-decoder model, designed specifically for finding anomalies in heterogeneous multivariate time series data. We will demonstrate its application to finding anomalies in streaming data from NASA’s Digital Information Platform’s Fuser source. CVAE identifies data instances that are not representative of expected nominal behavior as anomalous. Since it is an unsupervised approach, the flagged anomalies will need to be reviewed by the subject matter experts (SMEs) for validation and labeling and is designed to assist with vulnerability discovery within Safety Monitoring System programs. The second model is Robust and Explainable Semi-supervised Anomaly Detection (RESAD) model [2], which builds on CVAE to allow learning from both minimally labeled data (previously reviewed by the SMEs) as well as majority unlabeled data. RESAD takes advantage of graph theoretic techniques to propagate the labels from the labeled data to the unlabeled data based on a pre-defined similarity metric and structures the learned feature space from flight time-series so that data of the same class would cluster tightly together. This model characteristic is enabled by training with an augmented loss function and allows learning of a more informative feature space for down-stream tasks such as search and active learning. We demonstrate RESAD using data from the NASA DASHlink project [3].

anomaly detection