Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “science data management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Los Alamos National Laboratory Meteorology Monitoring Program: 2019 Data Completeness (Quality Report)

This report summarizes data completeness by tower and by instrument for 2019 and compares that data with the Los Alamos National Laboratory (LANL) and the ANSI/ANS-3.11-2015 standard. This report is designed to make data users aware of data completeness and any data quality issues. LANL meteorology monitoring goals include 95% completeness for all measurements. The ANS 2015 standard requires 90% completeness for all measurements. This report documents instrument/tower issues as they impact data completeness.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Science and Technology Review (May 2021)

Lawrence Livermore has been on the forefront of cancer research for over 60 years. Early interest in cancer statistics stemmed from the nature of work, particularly how radiation affects humans. The Department of Energy funded research to investigate the effects of radiation on workers with long term exposure. This research quickly morphed into a wider breadth of cancer research topics, including the use of advanced computational models to investigate mutations in genes. Livermore is regarded as a leader in cancer research, from the Human Genome Center to its participation in the National Cancer Institute’s “Moonshot” project. The highly interdisciplinary Laboratory unites research in one more example: bringing together cancer biology, 3D printing, high-performance computing, big data, and materials science to address this pressing medical challenge.

36 MATERIALS SCIENCE↗
DOE OSTI2023

A National Infrastructure for Artificial Intelligence on the Grid (NI4AI) (Final Scientific/Technical Report)

Electric utilities have traditionally taken a very pragmatic yet myopic approach with grid sensors and the resulting collected data. Sensors are purchased and deployed to solve a specific, known problem that has risen to sufficient awareness as to justify the effort of deploying sensors and the needed capital investment. This sensor data flows into proprietary software packages with limited functionality intended only to address the initial problem. This approach aligns with the financial incentives of the utility to deploy capital into fixed hardware assets for which the corporations earn a rate of return. This mentality stands in stark contrast to the big data revolution that started nearly 25 years ago with the rise of Google. In this worldview, data is a fundamental business asset; successful organizations collect, store, explore, merge, and exploit as much data as possible to not only solve problems well understood today but also to tackle new problems that will inevitably rise tomorrow. The ARPA-E Open Innovation 2018 project entitled A National Infrastructure for Artificial Intelligence on the Grid or NI4AI for short was designed to demonstrate this alternative paradigm for using data. To do this, the project was composed of three key thrust areas. The first major component deployed a variety of high-frequency grid sensors and captured terabytes of both wide-scale and localized grid measurements, generating high-value datasets for grid research and algorithm development. The second aspect made available PingThings’ PredictiveGridTM, a horizontally scalable, cloud-based data management and AI platform built for time series data to explore and exploit the collected data. Finally, the project fostered a diverse and open research community composed of experts from numerous fields through focused educational content, code sharing, and data science competitions. Shifting away from “single use” sensors and closed data silos within electric utilities is a major benefit to the public at large. This legacy approach to data is incredibly (1) capital intensive (new sensors must be deployed for each new problem and problems tend to arise continuously) and (2) painfully slow (new problems must be identified first and then new sensors must be deployed to collect data to begin to address the issue). The transition to a carbon neutral grid requires a massive transformation of the existing grid infrastructure and will continue to challenge the legacy grid in unforeseen ways. The only way to make the energy transition cost effective is for utilities to abandon this dated data paradigm and adopt more contemporary approaches. NI4AI has shown that it is technically possible and economically feasible to ingest, explore, and exploit grid data collected from even very high frequency sensing, such as continuous point on wave sensors collecting measurements 10,000 times a second. In fact, the PredictiveGrid platform used is commercially available and deployed at several utilities in the United States. Project accomplishments were numerous and included (1) making available a state of the art time series platform to the community, (2) collecting over 520 streams of time series data from grid sensors totaling over 1 trillion grid measurements, and (3) developing and nurturing a community within the industry focused on the use of data to create value for utilities and, ultimately, end consumers.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Closing the Gap between FAIR Data Repositories and Hierarchical Data Formats

Many in the scientific community, particularly in publicly funded research, are pushing to adhere to more accessible data standards to maximize the findability, accessibility, interoperability, and reusability (FAIR) of scientific data, especially with the growing prevalence of machine learning augmented research. Online FAIR data repositories, such as the Open Science Framework (OSF), help facilitate the adoption of these standards by providing frameworks for storage, access, search, APIs, and other features that create organized hubs of scientific data. However, the wider acceptance of such repositories is hindered by the lack of support of hierarchical data formats, such as Technical Data Management Streaming (TDMS) and Hierarchical Data Format 5 (HDF5), that many researchers rely on to organize their datasets. Various tools and strategies should be used to allow hierarchical data formats, FAIR data repositories, and scientific organizations to work more seamlessly together. A pilot project at Los Alamos National Laboratory (LANL) addresses the disconnect between them by integrating the OSF FAIR data repository with hierarchical data renderers, extending support for additional file types in their framework. The multifaceted interactive renderer displays a tree of metadata alongside a table and plot of the data channels in the file. This allows users to quickly and efficiently load large and complex data files directly in the OSF webapp. Users who are browsing files can quickly and intuitively see the files in the way they or their colleagues structured the hierarchical form and immediately grasp their contents. This solution helps bridge the gap between hierarchical data storage techniques and FAIR data repositories, making both of them more viable options for scientific institutions like LANL which have been put off by the lack of integration between them.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Boundary spanning increases knowledge and action on invasive species in a changing climate

Abstract Challenges associated with global change stressors on ecosystems have prompted calls to improve actionable science, including through boundary‐spanning activities, which aim to build connections and communication between researchers and natural resource practitioners. By synthesizing and translating research and practitioner knowledge, boundary‐spanning activities could support proactive, research‐informed conservation practice, but the success of these efforts is rarely evaluated. Using repeat survey data from the Northeast Regional Invasive Species and Climate Change (NE RISCC) Management Network, a boundary‐spanning organization, we evaluate whether participating in NE RISCC affected practitioners' knowledge, actions and priorities related to invasive species management under a changing climate. Our survey results suggest that practitioners who participate in NE RISCC have greater knowledge about invasive species and climate change and are incorporating climate change in more ways into their invasive species management. We also found NE RISCC membership affected the perceived usefulness of informational resources, with NE RISCC members more frequently identifying research syntheses and targeted workshops (both are common products used by NE RISCC to translate science into practice and share manager knowledge) as useful compared to non‐members. Practitioners who participate in NE RISCC also identified somewhat different research priorities, with non‐members and short‐term members more frequently identifying range‐shifting neonative species and their impacts on native communities as higher priorities compared to long‐term NE RISCC members. NE RISCC research activities and outreach materials have consistently framed range‐shifting neonative species as comparatively low risk, suggesting that this information has influenced practitioner's perception of risk. Practical implication : Although real‐world impacts of applied ecology are notoriously difficult to quantify, this analysis illustrates that if research results are actively translated, they can affect the knowledge and actions of natural resource practitioners. These impacts illustrate the potential for boundary‐spanning efforts to address other global change challenges to conservation.

Evans, Annette E.↗
DOE OSTI2020

Meteorological services annual data report for 2019

This document presents the meteorological data collected at Brookhaven National Laboratory (BNL) by Meteorological Services (Met Services) for the calendar year 2019. The purpose is to publicize the data sets available to emergency personnel, researchers and facility operations. Met services has been collecting data at BNL since 1949. Data from 1994 to the present is available in digital format. Data is presented in monthly plots of one-minute data. This allows the reader the ability to peruse the data for trends or anomalies that may be of interest to them. Full data sets are available to BNL personnel and to a limited degree outside researchers. The full data sets allow plotting the data on expanded time scales to obtain greater details (e.g., daily solar variability, inversions, etc.).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Lost and Found: Rediscovering Microbiome-Associated Phenotypes that Reshape Agricultural Sustainability

Modern agriculture faces an urgent need to improve nutrient use efficiency while reducing environmental impacts. Here, we show that ancestral traits controlling rhizosphere microbiome functions can be reintroduced into elite maize through targeted teosinte introgressions. Using near-isogenic lines, we mapped microbiome-associated phenotypes (MAPs) derived from teosinte that suppress nitrification and denitrification—key microbial processes contributing to nitrogen loss. These introgressions altered root exudate chemistry, resulting in distinct microbial assemblies and enhanced nitrogen retention. We identified candidate loci and metabolites responsible for suppressive activity and demonstrated their functional effects in vitro. Our findings reveal a genetic and biochemical basis for rewilding microbiome-mediated ecosystem services in crops, offering a scalable path toward sustainable nutrient management in global agriculture. ---- These maize root exduate metabolomics data are a subset of this larger project and make up a phenotyping for candidate lines.

Favela, Alonso [School of Plant Sciences, Universi↗
DOE OSTI2023

FY23 Status Report of the Activated Materials Laboratory at the Advanced Photon Source

The Activated Materials Laboratory (AML) is a new radiological facility located at the Advanced Photon Source (APS) in Argonne National Laboratory (ANL), adjacent to the high-energy x-ray microscopy (HEXM) beamline in the long beamline building (LBB) constructed under the APS-upgrade (APS-U) project. The AML is a centralized facility to facilitate the safe conduct of experiments on activated materials at the APS. This report provides an overview of the status of the AML as a Nuclear Science User Facilities (NSUF) partner user facility in preparation for the general user access in 2024 upon the commissioning of the APS-U beamlines. Specifically, details are provided regarding the laboratory's scope, functionality, components, operational blueprint, and data management approach. The plans on augmenting the instrumentation, refining operational procedures and developing a robust data management strategy for FY24 and beyond are also discussed.

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

OpenCHAMI Developer Summit [Slides]

The mission of the OpenCHAMI consortium is to steward the collaborative development and continuous evolution of cloud-like software to manage High Performance Computing capacity regardless of the size or deployment platform. We are guided by the operators and practitioners who use modern tooling and concepts to address the needs of classical HPC applications and the growing AI/ML and Data Science community that wish to leverage HPC capacity within their own workflows, to meet their needs with their own tools.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

PanDA: Production and Distributed Analysis System

The Production and Distributed Analysis (PanDA) system is a data-driven workload management system engineered to operate at the LHC data processing scale. The PanDA system provides a solution for scientific experiments to fully leverage their distributed heterogeneous resources, showcasing scalability, usability, flexibility, and robustness. The system has successfully proven itself through nearly two decades of steady operation in the ATLAS experiment, addressing the intricate requirements such as diverse resources distributed worldwide at about 200 sites, thousands of scientists analyzing the data remotely, the volume of processed data beyond the exabyte scale, dozens of scientific applications to support, and data processing over several billion hours of computing usage per year. PanDA’s flexibility and scalability make it suitable for the High Energy Physics community and wider science domains at the Exascale. Beyond High Energy Physics, PanDA’s relevance extends to other big data sciences, as evidenced by its adoption in the Vera C. Rubin Observatory and the sPHENIX experiment. As the significance of advanced workflows continues to grow, PanDA has transformed into a comprehensive ecosystem, effectively tackling challenges associated with emerging workflows and evolving computing technologies. The paper discusses PanDA’s prominent role in the scientific landscape, detailing its architecture, functionality, deployment strategies, project management approaches, results, and evolution into an ecosystem.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Outcomes of PAX sapiens-Supported Global Wildlife Data Sharing Conferences for Enhanced One Health Security (GWDSC)

Across two consecutive Global Wildlife Data Sharing Conferences supported by PAX sapiens—Year 1 (May 2024) at Pacific Northwest National Laboratory and Year 2 (2025) in Ciudad Real, Spain—the initiative converted wildlife data sharing from aspiration into operational reality, producing measurable impacts in platform development, data mobilization, standards harmonization, and international partnership formation. The conferences addressed a critical gap in global health security: while 75% of emerging infectious diseases affect both humans and animals and over 60% originate in wildlife, wildlife health surveillance has historically lagged behind human and agricultural sectors due to fragmented databases, inconsistent terminology, uneven capacity, and limited cross-border coordination. By convening practitioners, government agencies, international organizations, academic institutions, and NGOs, the GWDSC catalyzed trust-based relationships and practical workflows that enable earlier detection, better risk assessment, and more effective prevention of threats at the wildlife–domestic animal–human–environment interface.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Improving future travel demand projections: a pathway with an open science interdisciplinary approach

Transport accounts for 24% of global CO 2 emissions from fossil fuels. Governments face challenges in developing feasible and equitable mitigation strategies to reduce energy consumption and manage the transition to low-carbon transport systems. To meet the local and global transport emission reduction targets, policymakers need more realistic/sophisticated future projections of transport demand to better understand the speed and depth of the actions required to mitigate greenhouse gas emissions. In this paper, we argue that the lack of access to high-quality data on the current and historical travel demand and interdisciplinary research hinders transport planning and sustainable transitions toward low-carbon transport futures. We call for a greater interdisciplinary collaboration agenda across open data, data science, behaviour modelling, and policy analysis. These advancemets can reduce some of the major uncertainties and contribute to evidence-based solutions toward improving the sustainability performance of future transport systems. The paper also points to some needed efforts and directions to provide robust insights to policymakers. We provide examples of how these efforts could benefit from the International Transport Energy Modeling Open Data project and open science interdisciplinary collaborations.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Data Science Techniques, Assumptions, and Challenges in Alloy Clustering and Property Prediction

Data analytics methods have been increasingly applied to understanding materials chemistry, processing due to the manufacturing approach, and uni-axial and cyclic property relationships in the highly complex space of alloy design. There are several benefits to applying data analytics to this space, including the ability to manage non-linearities in the responses of the alloy attributes and the resulting mechanical properties. However, key difficulties in applying and understanding the results of data analytics include the often lack of reported assumptions and data processing steps necessary to improve interpretation and reproducibility in derived results. In this work, the methods used to generate clustering and correlation analyses for experimental 9% Cr ferritic-martensitic steel data were investigated and the resulting implications for mechanical property predictions were assessed. This work uses principal component analysis, partitioning around medoids, t-SNE, and k-means clustering to investigate trends in composition, processing and microstructure information with creep and tensile properties, building on work done previously using a smaller version of the same dataset. The initial assumptions, preprocessing steps and methods are investigated and outlined in order to depict the fine level of detail required to convey the steps taken to process data and produce analytical results. Here, the variations in the resulting analyses are explored due to the influence of new and more varied data.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Science-informed Machine Learning to Increase Recovery Efficiency in Unconventional Reservoirs

Production of hydrocarbons from fractured, unconventional reservoirs is inherently inefficient. But machine learning offers a pathway both to increasing recovery efficiency at a site and to improving forecasts of production, thereby improving the economics of operations in unconventional reservoirs. Los Alamos—in partnership with DOE, NETL, and WVU—has been developing a science-informed workflow and platform for optimizing pressure-drawdown at a site, which will allow an operator to make reservoir-management decisions that optimize recovery in consideration of future production. This work relies on a hybridization of physics-based prediction and machine learning, whereby accurate synthetic data (in combination with available site data) can enable the application of machine learning methods for rapid forecasting and optimization. The physics-based prediction is built upon experimental and theoretical work to determine transport characteristics in shale at various scales, with an emphasis on materials from MSEEL-I; this fundamental shale R&D was conducted in partnership with DOE, NETL, and several other national labs. This work has resulted from a coordinated leveraging of developments across several projects within DOE FE30, along with internal investments from Los Alamos via LDRD. The development has utilized data from the MSEEL–I site for calibration and demonstration; however, the workflow and platform are readily extendable to operations at other sites, plays, and basins. This machine-learning method can aid operators to improve both recovery efficiency and competitiveness; to this end, future work would quantify processes for other plays/basins and integrate production details with economics.

04 OIL SHALES AND TAR SANDS↗
DOE OSTI2023

First detection of the BAO signal from early DESI data

We present the first detection of the baryon acoustic oscillations (BAOs) signal obtained using unblinded data collected during the initial 2 months of operations of the Stage-IV ground-based Dark Energy Spectroscopic Instrument (DESI). From a selected sample of 261 291 luminous red galaxies spanning the redshift interval 0.4 < z < 1.1 and covering 1651 square degrees with a 57.9 per cent completeness level, we report a ∼5σ level BAO detection and the measurement of the BAO location at a precision of 1.7 per cent. Using a bright galaxy sample of 109 523 galaxies in the redshift range 0.1 < z < 0.5, over 3677 square degrees with a 50.0 per cent completeness, we also detect the BAO feature at ∼3σ significance with a 2.6 per cent precision. These first BAO measurements represent an important milestone, acting as a quality control on the optimal performance of the complex robotically actuated, fibre-fed DESI spectrograph, as well as an early validation of the DESI spectroscopic pipeline and data management system. Based on these first promising results, we forecast that DESI is on target to achieve a high-significance BAO detection at sub-per cent precision with the completed 5-yr survey data, meeting the top-level science requirements on BAO measurements. This exquisite level of precision will set new standards in cosmology and confirm DESI as the most competitive BAO experiment for the remainder of this decade.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

High Energy Physics Network Requirements Review: One-Year Update

The Energy Sciences Network (ESnet) is the high-performance network user facility for the US Department of Energy (DOE) Office of Science (SC) and delivers highly reliable data transport capabilities optimized for the requirements of data-intensive science. In essence, ESnet is the circulatory system that enables the DOE science mission by connecting all its laboratories and facilities in the US and abroad. ESnet is funded and stewarded by the Advanced Scientific Computing Research (ASCR) program and managed and operated by the Scientific Networking Division at Lawrence Berkeley National Laboratory (LBNL). ESnet is widely regarded as a global leader in the research and education (R&E) networking community. In April 2022, ESnet and the Office of High Energy Physics (HEP) of the DOE SC organized an ESnet requirements review of HEP-supported activities. Preparation for the review included identification of key stakeholders: program and facility management, research groups, and technology providers. Each stakeholder group was asked to prepare formal case study documents about the group’s relationship to the HEP program to build a complete understanding of the current, near-term, and long-term status, expectations, and processes that will support the science going forward. A series of pre-planning meetings better prepared case study authors for this task, along with guidance on how the review would proceed in a virtual fashion.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Biological and Environmental Research Network Requirements Review (Final Report)

The Energy Sciences Network (ESnet) is the high-performance network user facility for the US Department of Energy (DOE) Office of Science (SC) and delivers highly reliable data transport capabilities optimized for the requirements of data-intensive science. In essence, ESnet is the circulatory system that enables the DOE science mission by connecting all its laboratories and facilities in the US and abroad. ESnet is funded and stewarded by the Advanced Scientific Computing Research (ASCR) program and managed and operated by the Scientific Networking Division at Lawrence Berkeley National Laboratory (LBNL). ESnet is widely regarded as a global leader in the research and education (R&E) networking community. Between August 2022 and April 2023, ESnet and the Office of Biological and Environmental Research (BER) of the DOE SC organized an ESnet requirements review of BER-supported activities. Preparation for these events included identification of key stakeholders: program and facility management, research groups, and technology providers. Each stakeholder group was asked to prepare formal case study documents about its relationship to the BER ESS program to build a complete understanding of the current, near-term, and long-term status, expectations, and processes that will support the science going forward. A series of pre-planning meetings better prepared case study authors for this task, along with guidance on how the review would proceed in a virtual fashion.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

KBase Credit Metadata Schema

As part of KBase’s commitment to promote open science, we offer users the ability to obtain a DOI (Digital Object Identifier) for their work, which can then be cited in an associated science publication. To further support the community-wide shift towards FAIR (Findable, Accessible, Interoperable, Reusable) data, KBase is expanding our data descriptors so that KBase DOIs have comprehensive citations for datasets, in addition to referencing publications or software used in the workflow. This helps encourage a culture of giving attribution for all research inputs and outputs; standard practice for literature, but still relatively new for software products or datasets. It also promotes open science by building trust that contributors get credit for their work, and accelerates knowledge discovery by supporting and incentivizing the release of data.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗