Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Science Pipeline”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Evolving Multi-hazard Machine Learning Modeling for Advanced Risk-Informed Infrastructure Resilience Assessment

The socioeconomic impacts of pipeline incidents have escalated over the past three decades, revealing the limitation of traditional risk modeling methods when applied to extensive pipeline networks. This research aims to develop machine learning (ML) models that effectively identify, rank, and predict the diverse hazards and socioeconomic consequences associated with pipeline incidents. Utilizing historical data on pipeline incidents alongside weather and oceanographic data from the 1980s onward, the Houston metropolitan area serves as a testbed for the proposed methodologies. The research segments the combined datasets into three consecutive periods, demonstrating the efficacy of the updated model in predicting future events, particularly concerning precipitation rate data. Despite the challenges posed by a relatively limited dataset, local-level ML modeling offers valuable insights into the spatial and temporal dynamics of multiple hazards that contribute to pipeline incidents. These findings hold significant implications for future research, particularly in understanding and mitigating risks in various locations across the Gulf Coast and other coastal regions.

42 ENGINEERING↗
DOE OSTI2021

Improve the Search of Very Metal-poor Stars Using the Deep Learning Method

Very metal-poor (VMP) stars have [Fe/H] < -2.0 dex. They are among the oldest stars in the universe, and their unique metallicity can help explore the enrichment mechanism and evolutionary history of the chemical elements of stars in the early universe. However, most current stellar parameter estimation methods do not perform well in determining the stellar parameters of VMP stars, which limits our ability to discover and exploit the properties of VMP stars. In this study, we propose a new model based on a convolutional neural network to determine the stellar atmospheric parameters of VMP stars. We tested our model on the LAMOST spectra; our model can determine the effective temperature (T {sub eff}), surface gravity (log g), metallicity ([Fe/H]), and carbon abundance ([C/Fe]) of the LAMOST spectra with precisions σ(T {sub eff}) = 134.82 K, σ(log g) = 0.33 dex, σ ([Fe/H]) = 0.20 dex, and σ([C/Fe]) = 0.35 dex. Furthermore, our model can distinguish VMP stars from normal stars with an accuracy of 88.65%. We also compared this model with other widely used methods, and found that this method performs better than other methods. It can be applied to the stellar parameter pipelines of upcoming large surveys such as 4MOST, WEAVES, and MOONS to search for VMP stars and identify carbon-enhanced metal-poor stars.

36 MATERIALS SCIENCE↗
DOE OSTI2019

Reliable and explainable machine-learning methods for accelerated material discovery

Abstract Despite ML’s impressive performance in commercial applications, several unique challenges exist when applying ML in materials science applications. In such a context, the contributions of this work are twofold. First, we identify common pitfalls of existing ML techniques when learning from underrepresented/imbalanced material data. Specifically, we show that with imbalanced data, standard methods for assessing quality of ML models break down and lead to misleading conclusions. Furthermore, we find that the model’s own confidence score cannot be trusted and model introspection methods (using simpler models) do not help as they result in loss of predictive performance (reliability-explainability trade-off). Second, to overcome these challenges, we propose a general-purpose explainable and reliable machine-learning framework. Specifically, we propose a generic pipeline that employs an ensemble of simpler models to reliably predict material properties. We also propose a transfer learning technique and show that the performance loss due to models’ simplicity can be overcome by exploiting correlations among different material properties. A new evaluation metric and a trust score to better quantify the confidence in the predictions are also proposed. To improve the interpretability, we add a rationale generator component to our framework which provides both model-level and decision-level explanations. Finally, we demonstrate the versatility of our technique on two applications: (1) predicting properties of crystalline compounds and (2) identifying potentially stable solar cell materials. We also point to some outstanding issues yet to be resolved for a successful application of ML in material science.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2008

Targeting and Localization for Mars Rover Operations

A design and a partially developed application framework were presented for improving localization and targeting for surface spacecraft. The program has value for the Mars Science Laboratory mission, and has been delivered to support the Mars Exploration Rovers as part of the latest version of the Maestro science planning tool. It also has applications for future missions involving either surface-based or low-altitude atmospheric robotic vehicles. The targeting and localization solutions solve the problem of how to integrate localization estimate updates into operational planning tools, operational data product generalizations, and flight software by adding expanded flexibility to flight software, the operations data product pipeline, and operations planning tools based on coordinate frame updates during a planning cycle.

Powell, Mark W.↗
DOE OSTI2021

SARS-CoV2 Docking Dataset

Description: Small-molecule conformations and docking scores for 1.4 billion molecules docked against 6 protein targets from SARS-CoV2: MPro 5R84, MPro 6WQF, NSP15 6WLC, PLPro 7JIR, Spike 6M0J, and a hand-optimized model of the RNA-dependent RNA polymerase. Docking was carried out using the Autodock-GPU program performing 20 independent structure minimizations per dock - saving 3 results per molecule. Scores reported include the Autodock free energy estimate as well as RF3 and VS-DUD-E v2 machine-learned rescoring models. Protein structure files and maps in the format input to Autodock-GPU are included. Literature Ref: Supercomputer-Based Ensemble Docking Drug Discovery Pipeline with Application to Covid-19, J. Chem. Inf. Model. 2020, 60(12): 5832–5852.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Linking climate change and human systems: a case study of Arctic pipelines

This case study estimates the potential economic risk from permafrost thaw on oil and gas pipelines in the Russian Arctic as part of a larger effort to better understand complex interactions between human and earth systems in the Arctic. Pan-Arctic simulations of permafrost thaw-depth from the Community Land Model version 4.5 and ground ice characteristics were used to generate ground subsidence projections over the period 2020 to 2040 with a quantification of uncertainty. Russian oil and gas transmission pipeline networks were then overlaid on the permafrost thaw projections in ArcGIS to identify pipelines vulnerable to damage from permafrost thaw. Recent pipeline construction costs were used to estimate the total replacement costs for at-risk pipelines under several thaw scenarios. The results indicate that permafrost thaw poses a major threat to pipeline infrastructure, especially gas pipelines, in the Russian Arctic. Over the twenty-year study period, total replacement costs for oil and gas pipelines were estimated at $\$$110 billion in 2020 USD. Reduced economic viability of pipelines under climate change will likely trigger major shifts in the Russian oil and gas industry, which would have impacts on markets, emissions, and geopolitics.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

A Self-Assembling Pfs230D1-Ferritin Nanoparticle Vaccine Has Potent and Durable Malaria Transmission-Reducing Activity

Malaria is caused by eukaryotic protozoan parasites of the genus Plasmodium. There are 249 million new cases and 608,000 deaths annually, and new interventions are desperately needed. Malaria vaccines can be divided into three categories: liver stage, blood stage, or transmission-blocking vaccines. Transmission-blocking vaccines prevent the transmission of disease by the mosquito vector from one human to another. Pfs230 is one of the leading transmission-blocking vaccine antigens for malaria. Here, we describe the development of a 24-copy self-assembling nanoparticle vaccine comprising domain 1 of Pfs230 genetically fused to H. pylori ferritin. The single-component Pfs230D1-ferritin construct forms a stable and homogenous 24-copy nanoparticle with good production yields. The nanoparticle is highly immunogenic, as two low-dose vaccinations of New Zealand White rabbits elicited a potent and durable antibody response with high transmission-reducing activity when formulated in two distinct adjuvants suitable for translation to human use. This single-component 24-copy Pfs230D1-ferritin nanoparticle vaccine has the potential to improve production pipelines and the cost of manufacturing a potent and durable transmission-blocking vaccine for malaria control.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Wildfire Smoke PM2.5 per Zipcode

This dataset contains daily aggregated measurements of daily PM2.5 from ambient wildfire smoke in the contiguous United States, spanning from 2006 to 2016. The data is sourced from a study by Childs et al. (2022), titled "Daily Local-Level Estimates of Ambient Wildfire Smoke PM2.5 for the Contiguous US" published in Environmental Science & Technology. To compute the standardized weight across different zip codes, we computed the weight calculation on a 10km grids. To compute the weight, we obtain area-weights that add up to 1 in each polygon of zipcodes. This enabled us to calculate the smoke values per zipcode for the aforementioned period. Those interested in replicating our data processing pipeline can access it at https://github.com/NSAPH-Data-Processing/smoke_aggregation.

PM2.5↗
DOE OSTI2025

Accelerating Control Systems with GitOps: A Path to Automation and Reliability

GitOps is a foundational approach for modernizing infrastructure by leveraging Git as the single source of truth for declarative configurations. The poster explores how GitOps transforms traditional control system infrastructure, services and applications by enabling fully automated, auditable, and version-controlled infrastructure management. Cloud-native and containerized environments are shifting the ecosystem not only in the IT industry but also within the computational science field, as is the case of CERN and Diamond Light Source among other Accelerator/Science facilities which are slowly shifting towards modern software and infrastructure paradigms. The ACORN project, which aims to modernize Fermilab’s control system infrastructure and software is implementing proven best-practices and cutting-edge technology standards including GitOps, containerization, infrastructure as code and modern data pipelines for control system data acquisition and the inclusion of AI/ML in our accelerator complex.

Gonzalez, M. [Fermilab]↗
DOE OSTI2023

Eight Up-Coming Biotech Tools to Combat Climate Crisis

Biotechnology has a high potential to substantially contribute to a low-carbon society. Several green processes are already well established, utilizing the unique capacity of living cells or their instruments. Beyond that, the authors believe that there are new biotechnological procedures in the pipeline which have the momentum to add to this ongoing change in our economy. Eight promising biotechnology tools were selected by the authors as potentially impactful game changers: (i) the Wood–Ljungdahl pathway, (ii) carbonic anhydrase, (iii) cutinase, (iv) methanogens, (v) electro-microbiology, (vi) hydrogenase, (vii) cellulosome and, (viii) nitrogenase. Some of them are fairly new and are explored predominantly in science labs. Others have been around for decades, however, with new scientific groundwork that may rigorously expand their roles. In the current paper, the authors summarize the latest state of research on these eight selected tools and the status of their practical implementation. We bring forward our arguments on why we consider these processes real game changers.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2012

Interactive 3D Mars Visualization

The Interactive 3D Mars Visualization system provides high-performance, immersive visualization of satellite and surface vehicle imagery of Mars. The software can be used in mission operations to provide the most accurate position information for the Mars rovers to date. When integrated into the mission data pipeline, this system allows mission planners to view the location of the rover on Mars to 0.01-meter accuracy with respect to satellite imagery, with dynamic updates to incorporate the latest position information. Given this information so early in the planning process, rover drivers are able to plan more accurate drive activities for the rover than ever before, increasing the execution of science activities significantly. Scientifically, this 3D mapping information puts all of the science analyses to date into geologic context on a daily basis instead of weeks or months, as was the norm prior to this contribution. This allows the science planners to judge the efficacy of their previously executed science observations much more efficiently, and achieve greater science return as a result. The Interactive 3D Mars surface view is a Mars terrain browsing software interface that encompasses the entire region of exploration for a Mars surface exploration mission. The view is interactive, allowing the user to pan in any direction by clicking and dragging, or to zoom in or out by scrolling the mouse or touchpad. This set currently includes tools for selecting a point of interest, and a ruler tool for displaying the distance between and positions of two points of interest. The mapping information can be harvested and shared through ubiquitous online mapping tools like Google Mars, NASA WorldWind, and Worldwide Telescope.

Powell, Mark W.↗
DOE OSTI2025

Sequence length scaling in vision transformers for scientific images on frontier

Vision Transformers (ViTs) are pivotal for foundational models in scientific imagery, including Earth science applications, due to their capability to process large sequence lengths. While transformers for text have inspired scaling sequence lengths in ViTs, adapting these for ViTs introduces unique challenges. We develop distributed sequence parallelism for ViTs, enabling them to handle up to 1M tokens. Our approach, leveraging DeepSpeed-Ulysses and Long-Sequence-Segmentation with model sharding, is the first to apply sequence parallelism in ViT training, achieving a 94% batch scaling efficiency on 2,048 AMD-MI250X GPUs. Evaluating sequence parallelism in ViTs, particularly in models up to 10B parameters, highlighted substantial bottlenecks. We countered these with hybrid sequence, pipeline, and flash attention strategies, to scale beyond single GPU memory limits. Our method significantly enhances climate modeling accuracy by 20% in temperature predictions, marking the first training of a vision transformer model to convergence with a sequence length of 188K tokens, using full self-attention.

Tsaris, Aristeidis (aris) [ORNL] (ORCID:0000000277↗
DOE OSTI2021

Integrated System and Application Continuous Performance Monitoring and Analysis Capability

Scientific applications run on high-performance computing (HPC) systems are critical for many national security missions within Sandia and the NNSA complex. However, these applications often face performance degradation and even failures that are challenging to diagnose. To provide unprecedented insight into these issues, the HPC Development, HPC Systems, Computational Science, and Plasma Theory & Simulation departments at Sandia crafted and completed their FY21 ASC Level 2 milestone entitled "Integrated System and Application Continuous Performance Monitoring and Analysis Capability." The milestone created a novel integrated HPC system and application monitoring and analysis capability by extending Sandia's Kokkos application portability framework, Lightweight Distributed Metric Service (LDMS) monitoring tool, and scalable storage, analysis, and visualization pipeline. The extensions to Kokkos and LDMS enable collection and storage of application data during run time, as it is generated, with negligible overhead. This data is combined with HPC system data within the extended analysis pipeline to present relevant visualizations of derived system and application metrics that can be viewed at run time or post run. This new capability was evaluated using several week-long, 290-node runs of Sandia's ElectroMagnetic Plasma In Realistic Environments ( EMPIRE ) modeling and design tool and resulted in 1TB of application data and 50TB of system data. EMPIRE developers remarked this capability was incredibly helpful for quickly assessing application health and performance alongside system state. In short, this milestone work built the foundation for expansive HPC system and application data collection, storage, analysis, visualization, and feedback framework that will increase total scientific output of Sandia's HPC users.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Integrated System and Application Continuous Performance Monitoring and Analysis Capability (Final)

Scientific applications run on high-performance computing (HPC) systems are critical for many national security missions within Sandia and the NNSA complex. However, these applications often face performance degradation and even failures that are challenging to diagnose. To provide unprecedented insight into these issues, the HPC Development, HPC Systems, Computational Science, and Plasma Theory & Simulation departments at Sandia crafted and completed their FY21 ASC Level 2 milestone entitled "Integrated System and Application Continuous Performance Monitoring and Analysis Capability." The milestone created a novel integrated HPC system and application monitoring and analysis capability by extending Sandia’s Kokkos application portability framework, Lightweight Distributed Metric Service (LDMS) monitoring tool, and scalable storage, analysis, and visualization pipeline. The extensions to Kokkos and LDMS enable collection and storage of application data during run time, as it is generated, with negligible overhead. This data is combined with HPC system data within the extended analysis pipeline to present relevant visualizations of derived system and application metrics that can be viewed at run time or post run. This new capability was evaluated using several week-long, 290-node runs of Sandia’s ElectroMagnetic Plasma In Realistic Environments (EMPIRE) modeling and design tool and resulted in 1TB of application data and 50TB of system data. EMPIRE developers remarked this capability was incredibly helpful for quickly assessing application health and performance alongside system state. In short, this milestone work built the foundation for expansive HPC system and application data collection, storage, analysis, visualization, and feedback framework that will increase total scientific output of Sandia’s HPC users.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
NASA NTRSDate not supplied

Blast from the Past: ASDC Curation for NASA Suborbital Legacy Missions to Promote Data Discovery and Accessibility

NASA has an extensive history of conducting suborbital field campaigns to further advances in atmospheric sciences. Beginning with the Chemical Instrument Test and Evaluation (CITE) conducted in 1983-1984, NASA has completed many suborbital campaigns over the past three decades. Since the early 2010s, suborbital missions are typically assigned to a NASA Distributed Active Archive Center (DAAC) prior to the mission for long-term archival and distribution. Efforts are being made by NASA’s Earth Science Data and Information System (ESDIS) Project and the Airborne Data Management Group (ADMG) to assign legacy missions to DAACs for permanent archival and distribution, so that these valuable datasets remain to be available to the scientific community. NASA’s Atmospheric Science Data Center (ASDC) has been named the assigned DAAC for nearly 20 atmospheric composition legacy missions, including missions conducted as part of the Global Tropospheric Experiment (GTE) and expects to be named the assigned DAAC for more of these missions over the next few years. The primary goal of the ASDC is to provide access to the datasets as they are currently formatted to the broad user community and enhance their findability and accessibility. However, data reporting standards have evolved significantly since 1983 and the datasets span a wide variety of file formats, including text, Ames, GTE, and ICARTT (International Consortium for Atmospheric Research on Transport and Transformation), and the amount of metadata and relevant information included in the files also varies greatly and can not be readily extracted without subject matter knowledge. This has caused challenges for the ASDC’s suborbital metadata extraction pipeline in ensuring that accurate and necessary metadata is being provided for the missions by all the ASDC’s existing search mechanisms. To make the data more findable and accessible, the ASDC has begun researching ways to further enhance the datasets, including distributing value-added products (i.e. consistent file format such as ICARTT or netCDF), adding standard names from the ESDIS Standards Coordination Office (ESCO)-approved Atmospheric Composition Variable Standard Names Convention (ACVSNC), and creating outreach materials such as ArcGIS StoryMaps, User Guides, and Micro Articles, providing overviews of the missions and what type of data was collected during the missions. These efforts also help support NASA’s Open-Source Science by enhancing the FAIRness of the legacy data products. This presentation will review the ASDC’s ongoing efforts, progress made, and future plans for legacy missions.

Megan Buzanowicz↗
DOE OSTI2022

ThunderSecure: deploying real-time intrusion detection for 100G research networks by leveraging stream-based features and one-class classification network

Nowadays, data generated by large-scale scientific experiments are on the scale of petabytes per month. These data are transferred through dedicated high-bandwidth networks (40/100G) across distributed sites for processing, storage, and analysis. Like general purpose networks, research networks experience intrusions. However, monitoring anomalies in such high-speed network traffics is challenging given current cyber-infrastructure. Moreover, traditional network intrusion detection systems (NIDS) are signature based. However, anomaly patterns are difficult to define and that rulesets are often not updated frequently enough to reflect the changes of attack behaviors. We present ThunderSecure, a high-throughput, unsupervised learning-based intrusions detection system for 100G research networks. ThunderSecure implements an efficient packet processing and detection pipeline using multi-cores and GPUs. It extracts statistical and temporal features from real-time network data streams and feeds them to a one-class anomaly detection network. A baseline of normal distribution will be created based on the training observation. Testing traffic deviated from the learned profile will be marked as anomalies. We trained ThunderSecure on hundreds of billions of science data packets mirrored from two 100G network connections at Fermi National Accelerator Laboratory. The detection performance was evaluated on traffic captured from the same research network days and weeks after the training with different types of attack flows injected. Results show that ThunderSecure can recognize science data traffic captured long after the training and made nearly certain detection on the segment of the streams where anomalous flows were injected.

100G research network↗
DOE OSTI2023

A streamlined approach to characterize microalgae strains for biomass productivity under dynamic climate simulation conditions

Screening microalgae strains under static light and temperature flask conditions cannot directly quantify the biomass productivities of algae growing in the dynamically fluctuating light and temperature conditions of outdoor ponds. In this effort, we describe a testing pipeline that screens for productivity under climate simulated conditions. A validated, miniaturized Laboratory Environmental Algae Pond Simulator (mini-LEAPS) photobioreactor was used to determine optimal medium salinities and biomass productivities of cold-tolerant microalgae collected from Arctic, subarctic, Antarctic, and subalpine habitats. Strains characterized in this effort include: Chlorella antarctica UTEX1959, Chlorella sp. UTEXSNO69, Chloromonas rosae UTEXSNO11, Phaeodactylum tricornutum UTEX646, and Stichococcus minutus CCALA727. Observed productivities of the characterized strains ranged from 1.74 ± 0.25 to 8.18 ± 0.81 g m –2 day –1 (as ash-free dry weight). For each strain, a temperature tolerance profile was generated to identify the most appropriate season (s) for cultivation. The two most promising strains, Chlorella sp. UTEX SNO69 and P. tricornutum UTEX646, were tested alongside the DISCOVR winter benchmark strain Monoraphidium minutum 26B-AM in outdoor open ponds at the PNNL Algae Testbed (PAT) in Arizona. Further, under cold-season outdoor pond conditions, Chlorella sp. UTEXSNO69 achieved average areal biomass productivities of 8.21 ± 0.50 g m –2 day –1 , not significantly different from that of the benchmark strain (8.52 ± 0.43 g m –2 day –1 , p > 0.05). Under spring outdoor pond conditions, P. tricornutum UTEX646 achieved average areal biomass productivities 10.34 ± 0.27 g m –2 day –1 , not significantly different from that of the benchmark (10.07 ± 0.50 g m –2 day –1 ) under the tested conditions (p > 0.05). The streamlined pipeline was thus demonstrated to successfully characterize productive microalgae strains for outdoor deployment by weeding out algae strains that were not productive under the tested dynamic light and temperature conditions.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Rational design and testing of abiotic stress‐inducible synthetic promoters from poplar cis ‐regulatory elements

Summary Abiotic stress resistance traits may be especially crucial for sustainable production of bioenergy tree crops. Here, we show the performance of a set of rationally designed osmotic‐related and salt stress‐inducible synthetic promoters for use in hybrid poplar. De novo motif‐detecting algorithms yielded 30 water‐deficit (SD) and 34 salt stress (SS) candidate DNA motifs from relevant poplar transcriptomes. We selected three conserved water‐deficit stress motifs (SD18, SD13 and SD9) found in 16 co‐expressed gene promoters, and we discovered a well‐conserved motif for salt response (SS16). We characterized several native poplar stress‐inducible promoters to enable comparisons with our synthetic promoters. Fifteen synthetic promoters were designed using various SD and SS subdomains, in which heptameric repeats of five‐to‐eight subdomain bases were fused to a common core promoter downstream, which, in turn, drove a green fluorescent protein (GFP) gene for reporter assays. These 15 synthetic promoters were screened by transient expression assays in poplar leaf mesophyll protoplasts and agroinfiltrated Nicotiana benthamiana leaves under osmotic stress conditions. Twelve synthetic promoters were induced in transient expression assays with a GFP readout. Of these, five promoters (SD18‐1, SD9‐2, SS16‐1, SS16‐2 and SS16‐3) endowed higher inducibility under osmotic stress conditions than native promoters. These five synthetic promoters were stably transformed into Arabidopsis thaliana to study inducibility in whole plants. Herein, SD18‐1 and SD9‐2 were induced by water‐deficit stress, whereas SS16‐1, SS16‐2 and SS16‐3 were induced by salt stress. The synthetic biology design pipeline resulted in five synthetic promoters that outperformed endogenous promoters in transgenic plants.

09 BIOMASS FUELS↗