Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “active machine learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Quantifying the drivers and predictability of seasonal changes in African fire

Africa contains some of the most vulnerable ecosystems to fires. Successful seasonal prediction of fire activity over these fire-prone regions remains a challenge and relies heavily on in-depth understanding of various driving mechanisms underlying fire evolution. Here, we assess the seasonal environmental drivers and predictability of African fire using the analytical framework of Stepwise Generalized Equilibrium Feedback Assessment (SGEFA) and machine learning techniques (MLTs). The impacts of sea-surface temperature, soil moisture, and leaf area index are quantified and found to dominate the fire seasonal variability by regulating regional burning condition and fuel supply. Compared with previously-identified atmospheric and socioeconomic predictors, these slowly evolving oceanic and terrestrial predictors are further identified to determine the seasonal predictability of fire activity in Africa. Our combined SGEFA-MLT approach achieves skillful prediction of African fire one month in advance and can be generalized to provide seasonal estimates of regional and global fire risk.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2017

Astronaut Photography of the Earth: A Long-Term Dataset for Earth Systems Research, Applications, and Education

The NASA Earth observations dataset obtained by humans in orbit using handheld film and digital cameras is freely accessible to the global community through the online searchable database at https://eol.jsc.nasa.gov, and offers a useful compliment to traditional ground-commanded sensor data. The dataset includes imagery from the NASA Mercury (1961) through present-day International Space Station (ISS) programs, and currently totals over 2.6 million individual frames. Geographic coverage of the dataset includes land and oceans areas between approximately 52 degrees North and South latitudes, but is spatially and temporally discontinuous. The photographic dataset includes some significant impediments for immediate research, applied, and educational use: commercial RGB films and camera systems with overlapping bandpasses; use of different focal length lenses, unconstrained look angles, and variable spacecraft altitudes; and no native geolocation information. Such factors led to this dataset being underutilized by the community but recent advances in automated and semi-automated image geolocation, image feature classification, and web-based services are adding new value to the astronaut-acquired imagery. A coupled ground software and on-orbit hardware system for the ISS is in development for planned deployment in mid-2017; this system will capture camera pose information for each astronaut photograph to allow automated, full georegistration of the data. The ground system component of the system is currently in use to fully georeference imagery collected in response to International Disaster Charter activations, and the auto-registration procedures are being applied to the extensive historical database of imagery to add value for research and educational purposes. In parallel, machine learning techniques are being applied to automate feature identification and classification throughout the dataset, in order to build descriptive metadata that will improve search capabilities. It is expected that these value additions will increase interest and use of the dataset by the global community.

Stefanov, William L.↗
NASA NTRS2018

A 3D Citizen Science Video Game for NeMO-Net, the NASA Neural Multi-Modal Observation and Training Network for Global Coral Reef Assessment

NeMO-Net, the NASA neural multi-modal observation and training network for global coral reef assessment, is an open-source deep convolutional neural network aimed at accurately assessing the present and past dynamics of coral reef ecosystems through determination of percent living cover and morphology. We present here the active learning component of the project, which consists of an interactive video game prototype for tablet and mobile devices where players are able to intuitively label morphology classifications over mm-scale 3D coral reef imagery. Active learning applications present a novel methodology for engaging the public while efficiently providing large-scale training and test data for increasingly complex and data-intensive machine learning algorithms. NeMO-Net trains players on domain-specific knowledge through interactive tutorials and periodically checks players' input against pre-classified coral imagery to gauge their accuracy and utilize in-game mechanics to provide personalized classification training. Players can rate the classifications of other players, unlock rewards and join a global community as they explore and classify coral reefs and other shallow marine environments.

Citizen Science↗
NASA NTRSDate not supplied

Development of Solar Flare and Energetic Particle Prediction Portal (SEP 3 )

Solar activity is a primary factor determining the state of the Earth’s space environment, geomagnetic and ionospheric disturbances, and radiation hazards. In the current state of knowledge, machine learning (ML) methods provide essential tools for processing data, investigating relationships among various physical properties and characteristics, uncovering hidden connections, and predicting hazardous solar events. The primary difficulty in developing and applying modern machine-learning tools in heliophysics is that the essential data are scattered among over a hundred data repositories developed by instrument teams of space missions and ground-based observatories. In addition, statistical and ML methods require long time series of homogeneous measurements. To facilitate ML-ready data preparation and access, we have developed an interactive database of solar flares integrating the most essential datasets (https://solarflare.njit.edu/). The database performs an initial data processing and is automatically updated. In addition, we are developing the Solar Energetic Particle Prediction Portal (SEP3, https://sun.njit.edu/SEP3), which hosts web applications that allow users to retrieve the database records. The Portal has a search page for browsing the events from the most widely used catalogs and a dedicated space to share the most recent achievements of the team. The interactive widget can display soft X-ray and proton flux time series from GOES satellites and the flare records. The data portal has been used to evaluate the forecasts of solar proton events and investigate machine-learning approaches to SEP prediction.

SMD↗
DOE OSTI2023

Tools and Methods for Optimization of Nuclear Plant Outages

Refueling outages are one of the most challenging phases in a nuclear power plants (NPP) operating cycle. Refueling outages are extremely costly for a NPP due to the large amount of required resources and because of lost revenue due to plant being off the grid. Outage durations have steadily decreased across the industry over that last few decades primarily due to improved planning and coordination, but there are still many plants that struggle to meet the performance metrics accomplished by other utilities. Schedule resilience is one of the issues. NPP outages require scheduling thousands of activities in a duration of around 30 days on average. Outage staff begin working on the schedule more than a year ahead of the outage start and make every effort to build a robust schedule. Despite the robust and detailed planning, once the outage starts, numerous emergent issues typically appear along with schedule delays requiring continuous replanning and adjusting. When schedule disruption occurs during an outage, plant staff make urgent efforts to recover but often not able to maintain the planned outage duration. These outage delays can cost a utility several million dollars per day. Tools that could help outage schedulers create a more resilient schedule and allow them to optimally reschedule emergent work could significantly reduce outage delays. One key aspect of creating a resilient schedule is to have accurate estimates for activity duration. Another important outage scheduling capability is the ability to schedule emergent work with minimal disruption. The Optimization of Outage Activities project under the Risk-Informed Systems Analysis Pathway (RISA) sponsored by Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) program focuses on developing tools and methods to support nuclear power plants with optimization of outage schedules. The goal of the outage optimization is the completion of all planned and emergent outage activities as fast as possible while maintaining highest level of safety. This report describes the initial development of tools to support outage management that leverage computational and machine learning methods developed in other RISA and LWRS projects.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Incorporating space and time into random forest models for analyzing geospatial patterns of drug-related crime incidents in a major U.S. metropolitan area

The opioid crisis has hit American cities hard, and research on spatial and temporal patterns of drug-related activities including detecting and predicting clusters of crime incidents involving particular types of drugs is useful for distinguishing hot zones where drugs are present that in turn can further provide a basis for assessing and providing related treatment services. In this study, we investigated spatiotemporal patterns of more than 52,000 reported incidents of drug-related crime at block group granularity in Chicago, IL between 2016 and 2019. We applied a space-time analysis framework and machine learning approaches to build a model using training data that identified whether certain locations and built environment and sociodemographic factors were correlated with drug-related crime incident patterns, and establish the top contributing factors that underlaid the trends. Space and time, together with multiple driving factors, were incorporated into a random forest model to analyze these changing patterns. We accommodated both spatial and temporal autocorrelation in the model learning process to assist with capturing the changes over time and tested the capabilities of the space-time random forest model by predicting drug-related activity hot zones. Overall, we focused particularly on crime incidents that involved heroin and synthetic drugs as these have been key drug types that have highly impacted cities during the opioid crisis in the U.S.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2022

Local Scale (3-M) Soil Moisture Mapping Using SMAP and Planet Superdove

A capability for mapping meter-level resolution soil moisture with frequent temporal sampling over large regions is essential for quantifying local-scale environmental heterogeneity and eco-hydrologic behavior. However, available surface soil moisture (SSM) products generally involve much coarser grain sizes ranging from 30 m to several 10s of kilometers. Hence a new method is proposed to estimate 3-m resolution SSM using a combination of multi-sensor fusion, machine- learning (ML) and Cumulative Distribution Function (CDF) matching approaches. This method established favorable SSM correspondence between 3-m pixels and overlying 9-km grid cells from overlapping Planet SuperDove (PSD) observations and NASA Soil Moisture Active-Passive (SMAP) mission products. The resulting 3-m SSM predictions showed improved accuracy by reducing ab- solute bias and RMSE by ~0.01 cm3/cm3 over the original SMAP data in relation to in-situ soil moisture measurements for the Australian Yanco region, while preserving the high sampling frequency (1-3 day global revisit) and sensitivity to surface wetness (R 0.865) from SMAP. Heterogeneous soil moisture distributions varying with vegetation biomass gradients and irrigation regimes were generally captured within a selected study area. Further algorithm refinement and implementation for regional applications will allow for improvement in water resources management, precision agriculture, and disaster forecasts and responses.

soil moisture↗
DOE OSTI2026

Data for A Generalized Platform for Artificial Intelligence-powered Autonomous Protein Engineering

Proteins are the molecular machines of life with numerous applications in energy, health, and sustainability. However, engineering proteins with desired functions for practical applications remains slow, expensive, and specialist-dependent. Here we report a generally applicable platform for autonomous enzyme engineering that integrates machine learning and large language models with biofoundry automation to eliminate the need for human intervention, judgement, and domain expertise. Requiring only an input protein sequence and a quantifiable way to measure fitness, this automated platform can be applied to engineer a wide array of proteins. As a proof of concept, we engineer Arabidopsis thaliana halide methyltransferase (AtHMT) for a 90-foldimprovement in substrate preference and 16-fold improvement in ethyl-transferase activity, along with developing a Yersinia mollaretii phytase (YmPhytase) variant with 26-fold improvement in activity at neutral pH. This is accomplished in four rounds over 4 weeks, while requiring construction and characterization of fewer than 500 variants for each enzyme. This platform for autonomous experimentation paves the way for rapid advancements across diverse industries, from medicine and biotechnology to renewable energy and sustainable chemistry.

AI/ML↗
DOE OSTI2025

Methods in PES-Learn: Direct-Fit Machine Learning of Born–Oppenheimer Potential Energy Surfaces

The release of PES-L EARN version 1.0 as an open-source software package for the automatic construction of machine learning models of semi-global molecular potential energy surfaces (PESs) is presented. Improvements to PES-L EARN ’s interoperability are stressed with new Python API that simplifies workflows for PES construction via interaction with QCSchema input and output infrastructure. In addition, a new machine learning method is introduced to PES-L EARN : kernel ridge regression (KRR). The capabilities of KRR are emphasized with examination of select semi-global PESs. All machine learning methods available in PES-L EARN are benchmarked with benzene and ethanol datasets from the rMD17 database to illustrate PES-L EARN ’s performance ability. Fitting performance and timings are assessed for both systems. Finally, the ability to predict gradients with neural network models is presented and benchmarked with ethanol and benzene. PES-L EARN is an active project and welcomes community suggestions and contributions.

kernel ridge regression↗
DOE OSTI2023

Accelerating Battery Simulations by Using High Performance Computing and Opportunities with Machine Learning

The US Department of Energy (DOE) estimates that the battery pack cost of $60 per kilowatt-hour while increasing the driving range to over 300 miles and vehicle charging under 15 min or less would enable mass penetration of electric vehicles in the USA by 2030. These projections are based on the currently available high-density cell chemistry combined with a system level design and optimized electrodes. Electrodes for current state-of-the-art lithium-ion cell technology are fabricated from electrode slurry comprising of active material, polymeric binder, and conductive diluent such as carbon black that are coated on metal current collectors such as copper and aluminum. Given these challenging requirements for development of electrical energy storage devices for future transportation needs, a predictive simulation capability which can accelerate design by considering performance and safety implications of different geometry, materials, and chemistry choices is required. In this chapter, we discuss our state-of-the-art three-dimensional modeling framework, providing examples on battery performance and safety simulations. We also present approaches to use machine learning in the context of large datasets that are becoming available.

Allu, Srikanth↗
DOE OSTI2024

Efficient Anomaly Detection Driven By Different Machine Learning Architectures And Models

The rapid growth and ubiquitous adoption of the internet and cyber-physical systems (CPS) have fundamentally transformed modern communication, work, and human-system interactions. While networks now form the backbone of critical digital ecosystems, enabling seamless data transmission across diverse, interconnected systems, this increased connectivity also expands the attack surface, making real-time detection of network intrusions and anomalies a pressing challenge. Detecting unusual activities within network infrastructure requires advanced data traffic analysis to differentiate between legitimate and malicious interactions. Traditional approaches to network anomaly detectionâ??such as rule-based and signature-based systemsâ??often depend on predefined patterns to identify known anomalies, limiting their effectiveness against emerging, stealthy, or previously unseen threats. These conventional methods suffer from high false alarm rates and fail to adapt to the ever-evolving nature of network traffic, particularly in large-scale, decentralized environments where data volume, velocity, and variety are constantly increasing. This dissertation presents artificial intelligence (AI)-driven approaches to anomaly detection that leverage graphics processing unit (GPU)-enabled high-performance computing (HPC) platforms for processing massive network traffic data and monitoring the components of cyber-physical systems (CPS) for potentially hazardous conditions. The research advances several key contributions: (1) Designing efficient machine learning techniques for CPS condition monitoring and anomaly detection; (2) enabling federated learning (FL) frameworks that enable distributed detection while preserving data privacy and system resilience; (3) exploring graph-based methodologies combining graph neural networks (GNN) and graph machine learning (ML) approaches for the Internet of Things (IoT) and automotive network security, and (4) performing distributed edge computing optimizations that integrate FL with scalable technologies for reduced communication overhead. Through extensive experiments, these methodologies demonstrate that complex anomaly detection and condition monitoring tasks can be achieved while balancing computational efficiency and detection accuracy through fine-grained network information processing. The frameworks developed in this research establish a robust foundation for network anomaly detection, providing scalable, adaptive, and privacy-preserving solutions for safeguarding CPS and IoT networks in an increasingly interconnected digital landscape. The practical implications of these research findings are significant, as they can inform the development of next-generation network security systems and contribute to the protection of critical infrastructure against sophisticated cyber attacks.

Marfo, William↗
DOE OSTI2020

Bio-inspired gas sensing: boosting performance with sensor optimization guided by “machine learning”

The performance of existing gas sensors often degrades in field conditions because of the loss of measurement accuracy in the presence of interferences. Thus, new sensing approaches are required with improved sensor selectivity. We are developing a new generation of gas sensors, known as multivariable sensors, that have several independent responses for multi-gas detection with a single sensor. In this study, we analyze the capabilities of natural and fabricated photonic three-dimensional (3-D) nanostructures as sensors for the detection of different gaseous species, such as vapors and non-condensable gases. We employed bare Morpho butterfly wing scales to control their gas selectivity with different illumination angles. Next, we chemically functionalized Morpho butterfly wing scales with a fluorinated silane to boost the response of these nanostructures to the vapors of interest and to suppress the response to ambient humidity. Further, we followed our previously developed design rules for sensing nanostructures and fabricated bioinspired inorganic 3-D nanostructures to achieve functionality beyond natural Morpho scales. These fabricated nanostructures have embedded catalytically active gold nanoparticles to operate at high temperatures of ≈300 °C for the detection of gases for solid oxide fuel cell (SOFC) applications. Our performance advances in the detection of multiple gaseous species with specific nanostructure designs were achieved by coupling the spectral responses of these nanostructures with machine learning (a.k.a. multivariate analysis, chemometrics) tools. Our newly acquired knowledge from studies of these natural and fabricated inorganic nanostructures coupled with machine learning data analytics allowed us to advance our design rules for sensing nanostructures toward the required gas selectivity for numerous gas monitoring scenarios at room and high temperatures for industrial, environmental, and other applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Process window estimation in manufacturing through Entropy-Sigma active learning

In manufacturing, there exist boundary identification problems for defining parameter spaces that meet desired thresholds on outcomes. This paper presents an Entropy-Sigma acquisition function for active learning of the process window/map in manufacturing using a Gaussian Process surrogate. Here, the method is applied to identify the stability boundary for the stability process map in machining using time-domain simulations with a periodic sampling stability metric. Results show that the proposed Entropy-Sigma method significantly outperforms Latin hypercube sampling or grid-based methods. The described method can be applied to identify the process window/map for any manufacturing application using a quantitative process outcome metric.

42 ENGINEERING↗
DOE OSTI2024

Accelerating the Discovery of New, Single Phase High Entropy Ceramics via Active Learning

High-entropy ceramics have garnered interest due to their remarkable hardness, compressive strength, thermal stability, and fracture toughness; yet the discovery of new high-entropy ceramics (out of a tremendous number of possible elemental permutations) still largely requires costly, inefficient, trial-and-error experimental and computational approaches. The entropy forming ability (EFA) factor was recently proposed as a computational descriptor that positively correlates with the likelihood that a 5-metal high-entropy carbide (HECs) will form the desired single phase, homogeneous solid solution; however, discovery of new compositions is computationally expensive. If you consider 8 candidate metals, the HEC EFA approach uses 49 optimizations for each of the 56 unique 5-metal carbides, requiring a total of 2744 costly density functional theory calculations. Here, we describe an orders-of-magnitude more efficient active learning (AL) approach for identifying novel HECs. To begin, we compared numerous methods for generating composition-based feature vectors (e.g., magpie and mat2vec), deployed an ensemble of machine learning (ML) models to generate an average and distribution of predictions, and then utilized the distribution as an uncertainty. Here we then deployed an AL approach to extract new training data points where the ensemble of ML models predicted a high EFA value or was uncertain of the prediction. Our approach has the combined benefit of decreasing the amount of training data required to reach acceptable prediction qualities and biases the predictions toward identifying HECs with the desired high EFA values, which are tentatively correlated with the formation of single phase HECs. Using this approach, we increased the number of 5-metal carbides screened from 56 to 15,504, revealing 4 compositions with record-high EFA values that were previously unreported in the literature. Our AL framework is also generalizable and could be modified to rationally predict optimized candidate materials/combinations with a wide range of desired properties (e.g., mechanical stability, thermal conductivity).

36 MATERIALS SCIENCE↗
DOE OSTI2026

Single-cell chromatin accessibility and cis -regulatory element analyses in plants using the scPlantReg platform

Understanding gene regulation is fundamental to plant improvement, but the lack of plant-specific single-cell assay for transposase-accessible chromatin using sequencing (scATAC-seq) frameworks and cross-species databases has limited insights into cell-type-specific cellular regulation. Here we present ‘scPlantReg’, an integrated framework and database for plant scATAC-seq data. scPlantReg supports end-to-end analyses from raw data processing to biological interpretation and features ‘scATACtor’, a supervised machine-learning approach that outperforms existing tools for cell-type annotation. We applied scPlantReg to pearl millet to characterize cell-type-specific chromatin accessibility and identify validated activating and repressing accessible chromatin regions (ACRs), revealing WRKY transcription factors as potential regulators of xylem development. Furthermore, we reanalysed scATAC-seq datasets from 8 plant species, spanning 11 tissues and multiple developmental stages, enabling cross-species comparisons. Furthermore, these analyses uncovered conserved regulatory programmes, including AP2/EREBP-associated ACRs linked to cell wall development and cell-type-conserved TFs across grasses. Collectively, scPlantReg provides a general framework and resource for comparative regulatory analysis in plants.

Epigenomics↗
DOE OSTI2023

Accurate prediction of carbon dioxide capture by deep eutectic solvents using quantum chemistry and a neural network

Carbon dioxide (CO 2 ) emissions from fossil fuel combustion are a significant source of greenhouse gas, contributing in a major way to global warming and climate change. Carbon dioxide capture and sequestration is gaining much attention as a potential method for controlling these greenhouse gas emissions. Among the environmentally friendly solvents, deep eutectic solvents (DESs) have demonstrated the potential capability for carbon capture. To establish a theoretical framework for DES activity, thermodynamics modeling and solubility predictions are significant factors to anticipate and understand the system behavior. Here, in this study, we combine the COSMO-RS model with machine learning techniques to predict the solubility of CO 2 in various deep eutectic solvents. A comprehensive data set was established comprising 1973 CO 2 solubility data points in 132 different DESs at a variety of temperatures, pressures, and DES molar ratios. This data set was then utilized for the further verification and development of the COSMO-RS model. The CO 2 solubility (ln(x CO 2 )) in DESs calculated with the COSMO-RS model differs significantly from the experiment with an average absolute relative deviation (AARD) of 23.4%. A multilinear regression model was developed using the COSMO-RS predicted solubility and a temperature-pressure dependent parameter, which improved the AARD to 12%. Finally, a machine learning model using COSMO-RS-derived features was developed based on an artificial neural network algorithm. The results are in excellent agreement with the experimental CO 2 solubilities, with an AARD of only 2.72%. The ML model will be a potentially useful tool for the design and selection of DESs for CO 2 capture and utilization.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRSDate not supplied

DELTA: An Open-Source Framework to Simplify Deep Learning with Satellite Imagery

DELTA (Deep Earth Learning, Tools, and Analysis) is an open-source framework developed at NASA for deep learning on satellite imagery based on tensorflow. It helps simplify data engineering and preprocessing steps and reduces the need for a lot of the boilerplate code that needs written to make datasets palatable for machine learning. This lets data scientists focus on model development while DELTA handles the grunt work. This presentation will demonstrate DELTA’s functionality and share some examples from an active project using it for flood mapping.

Michael von Pohle↗
NASA NTRSDate not supplied

DELTA: An Open-Source Framework to Simplify Machine Learning with Satellite Imagery

DELTA (Deep Earth Learning, Tools, and Analysis) is an open-source framework developed at NASA to simplify running and training machine learning (ML) models on satellite imagery. Users new to machine learning can run existing ML models on satellite imagery with minimal setup and configuration. For experienced ML users, DELTA helps simplify data engineering, preprocessing steps, and reduces the need for boilerplate code that needs written to make satellite imagery datasets palatable for machine learning. This lets data scientists focus on model development while DELTA handles the imagery manipulation. This presentation will demonstrate DELTA’s functionality and share some examples from an active project using it for flood mapping using imagery from multiple satellite sources

Michael von Pohle↗