Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Sources”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

KG-Hub—building and exchanging biological knowledge graphs

Knowledge graphs (KGs) are a powerful approach for integrating heterogeneous data and making inferences in biology and many other domains, but a coherent solution for constructing, exchanging, and facilitating the downstream use of KGs is lacking. Here we present KG-Hub, a platform that enables standardized construction, exchange, and reuse of KGs. Features include a simple, modular extract–transform–load pattern for producing graphs compliant with Biolink Model (a high-level data model for standardizing biological data), easy integration of any OBO (Open Biological and Biomedical Ontologies) ontology, cached downloads of upstream data sources, versioned and automatically updated builds with stable URLs, web-browsable storage of KG artifacts on cloud infrastructure, and easy reuse of transformed subgraphs across projects. Current KG-Hub projects span use cases including COVID-19 research, drug repurposing, microbial–environmental interactions, and rare disease research. KG-Hub is equipped with tooling to easily analyze and manipulate KGs. KG-Hub is also tightly integrated with graph machine learning (ML) tools which allow automated graph ML, including node embeddings and training of models for link prediction and node classification.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

TranSyT , an innovative framework for identifying transport systems

The importance and rate of development of genome-scale metabolic models have been growing for the last few years, increasing the demand for software solutions that automate several steps of this process. However, since TRIAGE’s release, software development for the automatic integration of transport reactions into models has stalled. Here, in this paper, we present the Transport Systems Tracker (TranSyT). Unlike other transport systems annotation software, TranSyT does not rely on manual curation to expand its internal database, which is derived from highly curated records retrieved from the Transporters Classification Database and complemented with information from other data sources. TranSyT compiles information regarding transporter families and proteins, and derives reactions into its internal database, making it available for rapid annotation of complete genomes. All transport reactions have GPR associations and can be exported with identifiers from four different metabolite databases. TranSyT is currently available as a plugin for merlin v4.0 and an app for KBase.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Automated annotation of scientific texts for ML-based keyphrase extraction and validation

Advanced omics technologies and facilities generate a wealth of valuable data daily; however, the data often lack the essential metadata required for researchers to find, curate, and search them effectively. The lack of metadata poses a significant challenge in the utilization of these data sets. Machine learning (ML)–based metadata extraction techniques have emerged as a potentially viable approach to automatically annotating scientific data sets with the metadata necessary for enabling effective search. Text labeling, usually performed manually, plays a crucial role in validating machine-extracted metadata. However, manual labeling is time-consuming and not always feasible; thus, there is a need to develop automated text labeling techniques in order to accelerate the process of scientific innovation. This need is particularly urgent in fields such as environmental genomics and microbiome science, which have historically received less attention in terms of metadata curation and creation of gold-standard text mining data sets. In this paper, we present two novel automated text labeling approaches for the validation of ML-generated metadata for unlabeled texts, with specific applications in environmental genomics. Our techniques show the potential of two new ways to leverage existing information that is only available for select documents within a corpus to validate ML models, which can then be used to describe the remaining documents in the corpus. The first technique exploits relationships between different types of data sources related to the same research study, such as publications and proposals. The second technique takes advantage of domain-specific controlled vocabularies or ontologies. In this paper, we detail applying these approaches in the context of environmental genomics research for ML-generated metadata validation. Our results show that the proposed label assignment approaches can generate both generic and highly specific text labels for the unlabeled texts, with up to 44% of the labels matching with those suggested by a ML keyword extraction algorithm.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2022

A Process-based Model with Temperature, Water, and Lab-derived Data Improves Predictions of Daily Culex pipiens/restuans Mosquito Density

While the number of human cases of mosquito-borne diseases has increased in North America in the last decade, accurate modeling of mosquito population density has remained a challenge. Longitudinal mosquito trap data over the many years needed for model calibration, and validation is relatively rare. In particular, capturing the relative changes in mosquito abundance across seasons is necessary for predicting the risk of disease spread as it varies from year to year. We developed a discrete, semi-stochastic, mechanistic process-based mosquito population model that captures life-cycle egg, larva, pupa, adult stages, and diapause for Culex pipiens (Diptera, Culicidae) and Culex restuans (Diptera, Culicidae) mosquito populations. This model combines known models for development and survival into a fully connected age-structured model that can reproduce mosquito population dynamics. Mosquito development through these stages is a function of time, temperature, daylight hours, and aquatic habitat availability. The time-dependent parameters are informed by both laboratory studies and mosquito trap data from the Greater Toronto Area. The model incorporates city-wide water-body gauge and precipitation data as a proxy for aquatic habitat. This approach accounts for the nonlinear interaction of temperature and aquatic habitat variability on the mosquito life stages. We demonstrate that the full model predicts the yearly variations in mosquito populations better than a statistical model using the same data sources. This improvement in modeling mosquito abundance can help guide interventions for reducing mosquito abundance in mitigating mosquito-borne diseases like West Nile virus.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

The H I content of red geyser galaxies

Red geysers are a specific type of quiescent galaxy, denoted by twin jets emerging from their galactic centres. These bisymmetric jets possibly inject energy and heat into the surrounding material, effectively suppressing star formation by stabilizing cool gas. In order to confirm the presence and evolutionary consequences of these jets, this paper discusses the scaling, stacking, and conversion of 21-cm H I flux data sourced from the H I -MaNGA survey into H I gas-to-stellar mass (G/S) spectra. Our samples were dominated by non-detections, or galaxies with weak H I signals, and consequently by H I upper limits. The stacking technique discussed successfully resolved emission features in both the red geyser G/S spectrum and the control sample G/S spectrum. From these stacked spectra, we find that on average, red geyser galaxies have G/S of 0.086 ± 0.011 (random) + 0.029 (systematic), while non-red geyser galaxies of similar stellar mass have a G/S ratio of 0.039 ± 0.018 (random) + 0.013 (systematic). Therefore, we find no statistically significant evidence that the H I content of red geysers is different from the general quiescent population.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Simulation-Guided Decision-Making for Enhancing Energy Resilience in a Remote Alaskan Community

The increasing frequency and severity of extreme weather events underscore the need to bolster the resilience of energy infrastructure in remote coastal communities exposed to climate hazards. In recent years, considerable effort has been made to harden the grid infrastructure of remote communities through investment in energy storage, advanced metering, renewable generation and energy-efficient loads. However, simulation-based studies are still needed to identify appropriate locations for investment and determine the adequacy of existing infrastructure in supporting new resources. Preparing the required models may often be challenging due to insufficient metering, disparate data sources and workforce limitations. This paper describes modeling efforts undertaken to represent, within a unified co-simulation platform: (a) the electric distribution network and (b) the thermal behavior of a community medical center, in the remote community of Cordova, Alaska. With the help of case-studies, it is shown how the developed simulation platform can help the local utility in making decisions regarding capital investment aimed at enhancing community resilience.

Microgrid, energy storage, resilience↗
DOE OSTI2022

Occlusion-Perturbed Deep Learning for Probabilistic Solar Forecasting via Sky Images

Solar forecasting is shifting to the probabilistic paradigm due to the inherent uncertainty within the solar resource. Input uncertainty quantification is one of the widely used and best-performing ways to model solar uncertainty. However, compared to other sources of inputs, such as numerical weather prediction models, pure sky image-based probabilistic solar forecasting lags behind. In this research, an occlusion-perturbed convolutional neural network, named the PSolarNet, is developed. The PSolarNet provides very short-term deterministic forecasts, forecast scenarios, and probabilistic forecasts of the global horizontal irradiance from sky image sequences. Case studies based on 6 years of open-source data show that the developed PSolarNet is able to generate accurate 10-minute ahead deterministic forecasts with a 5.62% normalized root mean square error, realistic and diverse forecast scenarios with a 0.966 average correlation with the actual time series, and reliable and sharp probabilistic forecasts with a 2.77% normalized continuous ranked probability score.

Bayesian model averaging↗
DOE OSTI2025

Identifying Adversarial Cyber-Activity in Operational Technology Environments Using Bayesian Networks

Critical infrastructure and other operational technology (OT) environments face increasing cybersecurity risks from adversarial behavior. This paper describes the development of a risk model using a Bayesian network to enhance the comprehension of observable cyber events caused by malicious activity in OT environments. The core of the Bayesian network is a process model that describes the stages of adversary behavior. The remainder of the model is based on the MITRE ATT&CK® for Industrial Control Systems (ICS) taxonomy, which includes tactics and techniques that may be used by the adversary. The observables provide evidence for adversary behavior through the intermediary technique and tactic nodes. One challenge in constructing this model is a lack of open-source data from cyber-attacks on OT systems. This paper discusses learning from limited data, the elicitation of expert opinion to construct the conditional probability tables when data is scarce, and the refinement of the most difficult conditional probabilities tables using several forms of sensitivity analyses. Finally, the Bayesian network is demonstrated using two historical case studies: the DarkSide ransomware attack on the Colonial Pipeline and the destructive cyberattack targeting the ThyssenKrupp blast furnace. Index Terms—Cybersecurity, industrial control systems, operational technology

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Moisture availability mediates the relationship between terrestrial gross primary production and solar-induced chlorophyll fluorescence: Insights from global-scale variations

Effective use of solar-induced chlorophyll fluorescence (SIF) to estimate and monitor gross primary production (GPP) in terrestrial ecosystems requires a comprehensive understanding and quantification of the relationship between SIF and GPP. To date, this understanding is incomplete and somewhat controversial in the literature. Here we derived the GPP/SIF ratio from multiple data sources as a diagnostic metric to explore its global-scale patterns of spatial variation and potential climatic dependence. We found that the growing season GPP/SIF ratio varied substantially across global land surfaces, with the highest ratios consistently found in boreal regions. Spatial variation in GPP/SIF was strongly modulated by climate variables. The most striking pattern was a consistent decrease in GPP/SIF from cold-and-wet climates to hot-and-dry climates. We propose that the reduction in GPP/SIF with decreasing moisture availability may be related to stomatal responses to aridity. Furthermore, we show that GPP/SIF can be empirically modeled from climate variables using a machine learning (random forest) framework, which can improve the modeling of ecosystem production and quantify its uncertainty in global terrestrial biosphere models. Finally, our results point to the need for targeted field and experimental studies to better understand the patterns observed and to improve the modeling of the relationship between SIF and GPP over broad scales.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Global root traits (GRooT) database

Motivation: Trait data are fundamental to the quantitative description of plant form and function. Although root traits capture key dimensions related to plant responses to changing environmental conditions and effects on ecosystem processes, they have rarely been included in large-scale comparative studies and global models. For instance, root traits remain absent from nearly all studies that define the global spectrum of plant form and function. Thus, to overcome conceptual and methodological roadblocks preventing a widespread integration of root trait data into large-scale analyses we created the Global Root Trait (GRooT) Database. GRooT provides readyto- use data by combining the expertise of root ecologists with data mobilization and curation. Specifically, we (a) determined a set of core root traits relevant to the description of plant form and function based on an assessment by experts, (b) maximized species coverage through data standardization within and among traits, and (c) implemented data quality checks. Main types of variables contained: GRooT contains 114,222 trait records on 38 continuous root traits. Spatial location and grain: Global coverage with data from arid, continental, polar, temperate and tropical biomes. Data on root traits were derived from experimental studies and field studies. Time period and grain: Data were recorded between 1911 and 2019. Major taxa and level of measurement: GRooT includes root trait data for which taxonomic information is available. Trait records vary in their taxonomic resolution, with subspecies or varieties being the highest and genera the lowest taxonomic resolution available. It contains information for 184 subspecies or varieties, 6,214 species, 1,967 genera and 254 families. Owing to variation in data sources, trait records in the database include both individual observations and mean values. Software format: GRooT includes two csv files. A GitHub repository contains the csv files and a script in R to query the database.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Continental Scale Hydrostratigraphy: Basin‐Scale Testing of Alternative Data‐Driven Approaches

Abstract Integrated hydrological modeling is an effective method for understanding interactions between parts of the hydrologic cycle, quantifying water resources, and furthering knowledge of hydrologic processes. However, these models are dependent on robust and accurate datasets that physically represent spatial characteristics as model inputs. This study evaluates multiple data‐driven approaches for estimating hydraulic conductivity and subsurface properties at the continental‐scale, constructed from existing subsurface dataset components. Each subsurface configuration represents upper (unconfined) hydrogeology, lower (confined) hydrogeology, and the presence of a vertical flow barrier. Configurations are tested in two large‐scale U.S. watersheds using an integrated model. Model results are compared to observed streamflow and steady state water table depth (WTD). We provide model results for a range of configurations and show that both WTD and surface water partitioning are important indicators of performance. We also show that geology data source, total subsurface depth, anisotropy, and inclusion of a vertical flow barrier are the most important considerations for subsurface configurations. While a range of configurations proved viable, we provide a recommended Selected National Configuration 1 km resolution subsurface dataset for use in distributed large‐and continental‐scale hydrologic modeling.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

In silico trials predict that combination strategies for enhancing vesicular stomatitis oncolytic virus are determined by tumor aggressivity

Background Immunotherapies, driven by immune-mediated antitumorigenicity, offer the potential for significant improvements to the treatment of multiple cancer types. Identifying therapeutic strategies that bolster antitumor immunity while limiting immune suppression is critical to selecting treatment combinations and schedules that offer durable therapeutic benefits. Combination oncolytic virus (OV) therapy, wherein complementary OVs are administered in succession, offer such promise, yet their translation from preclinical studies to clinical implementation is a major challenge. Overcoming this obstacle requires answering fundamental questions about how to effectively design and tailor schedules to provide the most benefit to patients. Methods We developed a computational biology model of combined oncolytic vaccinia (an enhancer virus) and vesicular stomatitis virus (VSV) calibrated to and validated against multiple data sources. We then optimized protocols in a cohort of heterogeneous virtual individuals by leveraging this model and our previously established in silico clinical trial platform. Results Enhancer multiplicity was shown to have little to no impact on the average response to therapy. However, the duration of the VSV injection lag was found to be determinant for survival outcomes. Importantly, through treatment individualization, we found that optimal combination schedules are closely linked to tumor aggressivity. We predicted that patients with aggressively growing tumors required a single enhancer followed by a VSV injection 1 day later, whereas a small subset of patients with the slowest growing tumors needed multiple enhancers followed by a longer VSV delay of 15 days, suggesting that intrinsic tumor growth rates could inform the segregation of patients into clinical trials and ultimately determine patient survival. These results were validated in entirely new cohorts of virtual individuals with aggressive or non-aggressive subtypes. Conclusions Based on our results, improved therapeutic schedules for combinations with enhancer OVs can be studied and implemented. Our results further underline the impact of interdisciplinary approaches to preclinical planning and the importance of computational approaches to drug discovery and development.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Directional Laplacian Centrality for Cyber Situational Awareness

Cyber operations is drowning in diverse, high-volume, multi-source data. To get a full picture of current operations and identify malicious events and actors, analysts must see through data generated by a mix of human activity and benign automated processes. Although many monitoring and alert systems exist, they typically use signature-based detection methods. We introduce a general method rooted in spectral graph theory to discover patterns and anomalies without a priori knowledge of signatures. We derive and propose a new graph-theoretic centrality measure based on the derivative of the graph Laplacian matrix in the direction of a vertex. To build intuition about our measure, we show how it identifies the most central vertices in standard network datasets and compare to other graph centrality measures. Finally, we focus our attention on studying its effectiveness in identifying important IP addresses in network flow data. Using both real and synthetic network flow data, we conduct several experiments to test our measure’s sensitivity to two types of injected attack profiles and show that vertices participating in injected attack profiles exhibit noticeable changes in our centrality measures, even when the injected anomalies are relatively small, and in the presence of simulated network dynamics.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2025

Geospatial Diffusion for Land Cover Imperviousness Change Forecasting

Land-use and land-cover (LULC) has a significant effect on several Earth system processes. For example, impervious surfaces reduce infiltration and speed water flow, impacting regional hydrology and flood risk. While Earth System models have improved forecasting hydrologic and atmospheric processes at higher resolutions, the ability to forecast LULC change has lagged behind. In this paper, we propose a new paradigm exploiting Generative AI (GenAI) for land cover change forecasting by framing it as a data synthesis problem conditioned on historical and auxiliary data-sources. To demonstrate the feasibility of our methodology, we perform experiments where a diffusion model is trained for decadal forecasting of imperviousness change across the entire United States. We find that our model yields MAE lower than a no-change baseline for resolutions ≥ 0.7 X 0.7km2 on average, demonstrating its ability to capture and project accurate spatiotemporal patterns. Finally, we discuss future research to incorporate Earth's physical properties and enabling scenario simulations via driver variables.

Varshney, Debvrat [ORNL] (ORCID:0000000188981736)↗
DOE OSTI2020

eBPF Community ID Calculation

The code titled “eBPF Community ID Calculation” allows easy correlation of monitoring logs with existing network forensics logs on high-performance computing (HPC) systems. This code implements the Community ID Flow Hashing standard to calculate community ID Flow identifiers. These identifiers will be used to correlate host forensics logs with network forensics logs. The correlation provides valuable insight and the ability to easily pivot between disparate data sources. The computer code removes the libpcap dependency from the code base.

Maerz, StefanA↗
DOE OSTI2021

NRIC Digital Engineering Ecosystem

The NRIC Digital Engineering Ecosystem is a software suite designed to eliminate procedural failures in the engineering lifecycle of complex projects. It focuses on improving the flow of scheduling data, safety information, engineering requirements, and CAD files among stakeholders of complex engineering projects. The project comprises software adapters that move engineering data from disparate software tools in and out of a central database. The ecosystem is designed to efficiently incorporate data sources from many different engineering toolsets, making it software agnostic, and adaptable to many different engineering applications.

Harris, BrennanK↗
DOE OSTI2021

webspinner

Python utilities for working with data source types used by NREL's dsgrid (Demand-Side Grid Model) project (i.e. AWS, PostgreSQL, and .parquet). https://www.nrel.gov/analysis/dsgrid.html

Hale, Elaine↗