Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data integrity”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

Science Resource Office Peer Review and Metrics Factsheet [Slides]

The Science Resource Office-Peer Review and Metrics (SRO-PRM) Team hosts and maintains LANL's central repository for Science, Technology, and Engineering (STE) data. The Team tracks, integrates, analyzes, and reports qualitative and quantitative data measuring performance, quality, impact, and productivity. These metrics are indicators of the effectiveness and impact of STE efforts.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Progress toward a universal biomedical data translator

Clinical, biomedical, and translational science has reached an inflection point in the breadth and diversity of available data and the potential impact of such data to improve human health and well-being. However, the data are often siloed, disorganized, and not broadly accessible due to discipline-specific differences in terminology and representation. To address these challenges, the Biomedical Data Translator Consortium has developed and tested a pilot knowledge graph-based “Translator” system capable of integrating existing biomedical data sets and “translating” those data into insights intended to augment human reasoning and accelerate translational science. Having demonstrated feasibility of the Translator system, the Translator program has since moved into development, and the Translator Consortium has made significant progress in the research, design, and implementation of an operational system. Herein, we describe the current system’s architecture, performance, and quality of results. We apply Translator to several real-world use cases developed in collaboration with subject-matter experts. Finally, we discuss the scientific and technical features of Translator and compare those features to other state-of-the-art, biomedical graph-based question-answering systems.

60 APPLIED LIFE SCIENCES↗

Converging towards atomic and nuclear pressures (Final Report)

his report details the development of transformational tools and techniques, allowing the accurate characterization of matter at the most extreme conditions yet studied in the high energy density (HED) domain. Before this work, most experiments quantitatively mapping the nature of matter in the HED realm were performed using planar geometry, which allows for the isolation and measurement of variables in a single thermodynamic state. Such measurements include equation of state variables, optical conductivity, heat transport and more. However, due to a variety of plasma processes, such experiments are limited to below ~10 TPa (100 Mbar) pressures. To achieve higher pressures, convergent experiments are needed. Historically, convergent experiments have not been used for benchmark data because they are integral measurements. That is each part of a convergent target undergoes a time dependent wide range of states, making it difficult to accurately isolate any particular quantity for a given thermodynamic state. This effort developed innovative convergent HED platforms and techniques enabling the exploration of matter from atomic to nuclear scale pressures. This effort also performed pioneering experiments that yielded the first rigorous benchmark data at these extreme conditions. This funding award began with the overarching goal to understand the behavior of matter at extreme (atomic-to-nuclear scale) pressures. The motivation for these goals lie in the fact that every time scientists explore matter beyond the threshold of an atomic unit, there is a fundamental shift in science. The atomic unit for energy, mass, charge, length, and time have each been explored, and each time such a threshold was crossed, a new sequence of discoveries was made resulting in significant awards such as the Nobel Prize. The only unexplored atomic unit is pressure, and this effort set the course for exploring matter at and beyond such pressures. That most of the recently discovered extrasolar planets and stars, as well as matter in the late implosion stages of inertial fusion targets, have deep internal pressures at and beyond atomic pressures amplifies the importance of this effort. Much of the initial work in developing techniques to create these atomic-to-nuclear pressures already existed within the HED community, predominantly at large scale laser facilities such as the National Ignition Facility (NIF) and the Omega60 laser the University of Rochester and although these experiments were routinely performed the ability to extract information about the underlying physical states and processes remained elusive due to the complexity of the experiments, extreme scales in both time and space, and the integrated nature of all the measurements. This work built a rigorous framework so such measurements can routinely be made. This was done in part through the introduction of Bayesian inference techniques into the field of HED science. These techniques allow for the self-consistent extraction of the relevant variables and their explicit and implicit correlations, so as to make use of integrated experimental data to constrain physical models and provide accurate uncertainty bounds for the data. The techniques developed here are fully transparent and proved immediately useful providing quantitative rigorous benchmarks for physical states and processes at some of the most extreme conditions yet explored on Earth. This funding is directly or partly responsible for 7 publications in major peer-reviewed scientific journals, a doctoral thesis, 3 invited talks at major conferences, and the training of a post-doc, 2 graduate students, and 1 undergraduate student. Beyond the effort supported by this award launched the introduction of Bayesian inference into the HED physics community and helped push the usage if modern data-science techniques within the physics community at large.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

leapR: An R Package for Multiomic Pathway Analysis

A generalized goal of many high-throughput data studies is to identify functional mecha-nisms that underlie observed biological phenomena, whether disease outcomes or metabolic out-put. Increasingly, studies that rely on multiple sources of high-throughput data (genomic, tran-scriptomic, proteomic, metabolomic) are faced with a challenge of utilizing the data in a way that maximizes utility. However, methods for integration of multiple forms of molecular data into a biolog-ically coherent frameworks are needed. Furthermore, we have developed a framework to assess biological pathway activity that relates to phenotypic outcome using multi-source data. Availability and implementation: The leapR package with user manual and example workflow is available for download from GitHub (https://github.com/biodataganache/leapR).

59 BASIC BIOLOGICAL SCIENCES↗

Continental Scale Hydrostratigraphy: Basin‐Scale Testing of Alternative Data‐Driven Approaches

Abstract Integrated hydrological modeling is an effective method for understanding interactions between parts of the hydrologic cycle, quantifying water resources, and furthering knowledge of hydrologic processes. However, these models are dependent on robust and accurate datasets that physically represent spatial characteristics as model inputs. This study evaluates multiple data‐driven approaches for estimating hydraulic conductivity and subsurface properties at the continental‐scale, constructed from existing subsurface dataset components. Each subsurface configuration represents upper (unconfined) hydrogeology, lower (confined) hydrogeology, and the presence of a vertical flow barrier. Configurations are tested in two large‐scale U.S. watersheds using an integrated model. Model results are compared to observed streamflow and steady state water table depth (WTD). We provide model results for a range of configurations and show that both WTD and surface water partitioning are important indicators of performance. We also show that geology data source, total subsurface depth, anisotropy, and inclusion of a vertical flow barrier are the most important considerations for subsurface configurations. While a range of configurations proved viable, we provide a recommended Selected National Configuration 1 km resolution subsurface dataset for use in distributed large‐and continental‐scale hydrologic modeling.

54 ENVIRONMENTAL SCIENCES↗

Illuminating the Night: A Survey of Super-Resolution Methods for Nighttime Light Images

Nighttime Light (NTL) images provide critical insights into urbanization, disaster response, and energy consumption. The VIIRS Day/Night Band (DNB) sensor offers high-quality NTL imagery with daily revisit rates, but the available spatial resolution hinders fine-grained accurate analysis. Super-resolution techniques aim to increase the resolution of NTL images, enabling more detailed assessments of infrastructure, light pollution, economic activity, and power outages. However, existing state-of-the-art super-resolution methods designed for natural images struggle with the unique characteristics of NTL data. This work provides a comprehensive review of super-resolution methods across multiple image modalities, evaluates their effectiveness on VI-IRS DNB data, and proposes a multi-modal super-resolution approach tailored to NTL imagery. The proposed approach integrates VIIRS DNB data with road networks and land use information to improve reconstruction accuracy and spatial detail. Code is available for this project athttps://code.ornl.gov/viirs-sr/sr-demos.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Energy Emergency and Preparedness Data: Frequently Asked Questions (FAQs) and Quick Guidance on Crisis Communications

State Energy Offices and Public Utility Commissions rely on timely, accurate, and actionable information to perform their energy emergency response duties and execute their roles as state energy security planners. In support of this need, the National Association of State Energy Officials (NASEO) and the National Association of Regulatory Utility Commissions (NARUC) hosted an Energy Security and Data Analysis Workshop in Washington, DC to identify energy security response and planning data sources; and to share successful methods of data use and integration in state, federal, and private sector tools. Following the workshop, NASEO and NARUC hosted two topical data-centric webinars based on state priorities to identify best practices in Geographic Information Systems (GIS) and Crisis Communications programs leveraged in energy assurance planning and response. The Crisis Communications webinar covered best practice tactics for how states can respond during energy emergencies and other crises. Based on the workshop and webinars, this document summarizes commonly used data sources and includes frequently asked questions which may be used by state energy officials (i.e., consisting of staff from Public Utility Commissions and Governor-designated State Energy Offices) to help guide them in developing or improving their Crisis Communications capabilities. A strong public information program is a key crisis management tool. Timely and accurate information helps prevent confusion and uncertainty and encourages public support and cooperation. As energy subject matter experts, state energy officials are vital in the distilling, clarifying, and conveying energy sector information and implications to decision-makers and the public. Other participants in an effective public information program include the Governor’s Office, other state agencies, local governments, energy providers, local businesses, state legislature, and the federal government. It is essential to provide stakeholders and the public with information about the nature, severity, and duration of an emergency because inadequate understanding and awareness can lead to undesirable actions that could further exacerbate the situation. Before a state government can provide information to the public, it must gather information, describe the emergency accurately, and develop recommendations to manage the situation.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Illuminating the Night: A Survey of Super-Resolution Methods for Nighttime Light Images

Nighttime Light (NTL) images provide critical insights into urbanization, disaster response, and energy consumption. The VIIRS Day/Night Band (DNB) sensor offers high-quality NTL imagery with daily revisit rates, but the available spatial resolution hinders fine-grained accurate analysis. Super-resolution techniques aim to increase the resolution of NTL images, enabling more detailed assessments of infrastructure, light pollution, economic activity, and power outages. However, existing state-of-the-art super-resolution methods designed for natural images struggle with the unique characteristics of NTL data. This work provides a comprehensive review of super-resolution methods across multiple image modalities, evaluates their effectiveness on VIIRS DNB data, and proposes a multi-modal super-resolution approach tailored to NTL imagery. The proposed approach integrates VIIRS DNB data with road networks and land use information to improve reconstruction accuracy and spatial detail. Code is available for this project at https://code.ornl.gov/viirs-sr/sr-demos.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

The DeepLynx Data Warehouse

Digital Engineering and the development of digital twins necessitate the use of highly sophisticated tools and software. These methodologies and systems bring many benefits but rely on accomplishing challenging goals such as disparate data and systems integration into a single cohesive and holistic system. Idaho National Laboratory has recently released an open-source data warehouse – DeepLynx – to help in the planning, creation, execution, and management of projects in the digital engineering space, with an emphasis on supporting digital twins in an operational space.

97 MATHEMATICS AND COMPUTING↗

A Scalable Real-Time Data Assimilation Framework for Predicting Turbulent Atmosphere Dynamics

AI-based foundation models like FourCastNet, GraphCast are revolutionizing weather and climate predictions but are not yet ready for operational use. Their limitation lies in the absence of a data assimilation system to incorporate real-time Earth system observations, crucial for accurately forecasting events like tropical cyclones. To overcome these obstacles, we introduce a generic real-time data assimilation framework and demonstrate its end-to-end performance on the Frontier supercomputer. This framework comprises two primary modules: an ensemble score filter (EnSF), which significantly outperforms the state-of-the-art data assimilation method, and a vision transformer-based surrogate capable of real-time adaptation through the integration of observational data. We demonstrate both the strong and weak scaling of our framework up to 1024 GPUs on the Exascale supercomputer, Frontier. Our results not only illustrate the framework's exceptional scalability on high-performance computing systems, but also demonstrate the importance of supercomputers in real-time data assimilation for weather and climate predictions.

Lu, Dan↗

Knowledge Beacons: Web services for data harvesting of distributed biomedical knowledge

The continually expanding distributed global compendium of biomedical knowledge is diffuse, heterogeneous and huge, posing a serious challenge for biomedical researchers in knowledge harvesting: accessing, compiling, integrating and interpreting data, information and knowledge. In order to accelerate research towards effective medical treatments and optimizing health, it is critical that efficient and automated tools for identifying key research concepts and their experimentally discovered interrelationships are developed. As an activity within the feasibility phase of a project called “Translator” (https://ncats.nih.gov/translator) funded by the National Center for Advancing Translational Sciences (NCATS) to develop a biomedical science knowledge management platform, we designed a Representational State Transfer (REST) web services Application Programming Interface (API) specification, which we call a Knowledge Beacon. Knowledge Beacons provide a standardized basic API for the discovery of concepts, their relationships and associated supporting evidence from distributed online repositories of biomedical knowledge. This specification also enforces the annotation of knowledge concepts and statements to the NCATS endorsed the Biolink Model data model and semantic encoding standards (https://biolink.github.io/biolink-model/). Implementation of this API on top of diverse knowledge sources potentially enables their uniform integration behind client software which will facilitate research access and integration of biomedical knowledge.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Toward Drilling the Perfect Geothermal Well: An International Research Coordination Network for Geothermal Drilling Optimization Supported by Deep Machine Learning and Cloud Based Data Aggregation

The EDGE project, supported by the U.S. Department of Energy Geothermal Technologies Office under award DE-EE0008793, established a data-driven framework for improving the efficiency, cost-effectiveness, and reliability of geothermal well drilling. The project focused on developing scalable data infrastructure, advanced machine learning and probabilistic models, and integrated analytics tools to support continuous drilling optimization. A central objective was to reduce geothermal drilling costs by up to seventy percent while minimizing the risk of well failure through predictive diagnostics and adaptive planning. Over the project period, a comprehensive data repository was designed and deployed, incorporating records from over one hundred geothermal wells across varied geological settings. This repository supported both structured and unstructured data and adhered to FAIR data principles, enabling provenance tracking, quality control, and standardized metadata. The project introduced automated ingestion pipelines and a cloud-hosted platform that facilitated access to raw, processed, and derived datasets. This infrastructure served as the foundation for model development and analysis. Machine learning workflows were developed to predict key drilling metrics including rate of penetration, non-productive time, and total drilling costs. Self-organizing maps and dimensionality reduction methods were used to uncover operational patterns and outliers, while supervised learning algorithms such as random forests and deep neural networks were applied to forecast performance outcomes. The models were validated on heterogeneous datasets from both U.S. and Icelandic fields, demonstrating variable but significant predictive accuracy. The results indicated that finer temporal resolution, inclusion of lithological data, and consistency in operational annotations could substantially improve model performance. The project also implemented process mining techniques to reconstruct state-transition models from drilling event logs. These models enabled the identification of deviations from optimal workflows and provided insights into recurring failure modes. Analysis of non-productive time highlighted the impact of equipment failures, geological challenges, and human factors, offering opportunities for targeted mitigation strategies. The EDGE Dashboard was developed as a web-based expert system integrating data visualization, model outputs, and user-driven queries. It provided an accessible interface for operators to explore historical data, evaluate predicted outcomes, and compare drilling scenarios. Initial feedback from project partners suggested that the dashboard could serve as a foundation for more advanced advisory and optimization tools. Overall, the EDGE project demonstrated the feasibility and value of applying modern data science techniques to geothermal drilling. It delivered a set of interoperable tools and models that can support more efficient, lower-risk well development. The findings point toward a viable path for transitioning from advisory analytics to semi-autonomous drilling systems, contingent on continued collaboration, expanded datasets, and field validation. The project results have immediate relevance for drilling operations, data management practices, and future geothermal R&D efforts aimed at achieving reliable, cost-competitive geothermal energy at scale.

15 GEOTHERMAL ENERGY↗

DEIMoS: An Open-Source Tool for Processing High-Dimensional Mass Spectrometry Data

We present DEIMoS: Data Extraction for Integrated Multidimensional Spectrometry, a Python application programming interface and command-line tool for high-dimensional mass spectrometry data analysis workflows, offering ease of development and access to efficient algorithmic implementations. Functionality includes feature detection, feature alignment, collision cross section calibration, isotope detection, and MS/MS spectral deconvolution, with the output comprising detected features aligned across study samples and characterized by mass, CCS, tandem mass spectra, and isotopic signature. Notably, DEIMoS operates on N-dimensional data, largely agnostic to acquisition instrumentation: algorithm implementations utilize all dimensions simultaneously to (i) offer greater separation between features, improving detection sensitivity, (ii) increase alignment/feature matching confidence among datasets, and (iii) mitigate convolution artifacts in tandem mass spectra. We demonstrate DEIMoS with LC-IMS-MS/MS data, demonstrating the advantages of a multidimensional approach in each data processing step.

Colby, Sean M↗

Livewire: A Model Platform for Data Quality Assessment and AI Readiness Across DOE Missions

High-quality, well-governed data is essential for accelerating discovery and achieving operational excellence across DOE and national laboratory missions. The Livewire Data Platform is a DOE-supported platform that offers automated assessments of data quality, standardization, provenance, and Artificial Intelligence (AI) readiness. It allows researchers and data practitioners to systematically and easily evaluate datasets against established governance criteria and prepare them for advanced analytics. Livewire addresses critical challenges in DOE's data ecosystem with integrated capabilities for metadata validation, provenance tracking, and schema alignment. This platform's automated workflows assist users in identifying data quality gaps, enhancing interoperability between datasets collected from various stakeholders, and ensuring compliance with DOE data standards, all while reducing manual curation efforts. Additionally, we will discuss its AI readiness framework, which is being developed to prepare datasets for training models, developing advanced analytic tools, and machine learning applications. Using some of the more than one hundred tabular datasets on Livewire, processed with this open-source methodology, we will demonstrate how Livewire can serve as a model for scalable, standards-driven data management. This approach provides a pathway to leverage existing and future datasets within the DOE, boosting innovation and efficiency across national laboratories.

33 - ADVANCED PROPULSION SYSTEMS↗

Pipeline for Integrated Projects in Energy Systems (PIPES): A Tool for Integrated System Planning [Slides]

The Pipeline for Integrated Projects in Energy Systems (PIPES) is a comprehensive project, data, and workflow management tool designed for integrated modeling teams. PIPES facilitates the management of data requirements, tasks, and progress tracking, serving as a higher-level integration layer that works across various data and modeling software. This tool integrates models, data, and tools to perform large-scale, integrated analysis work at scale. PIPES is designed to streamline integrated modeling projects, enhance collaboration, and ensure the quality and efficiency of data management and workflow processes. This presentation introduces PIPES a multi-model tool for integrated system planning; it describes the underlying architecture, deep dives into common user workflows, and outlines the upcoming development roadmap beyond its current alpha state.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Dalton Project: A Python platform for molecular- and electronic-structure simulations of complex systems

The Dalton Project provides a uniform platform access to the underlying full-fledged quantum chemistry codes Dalton and LSDalton as well as the PyFraME package for automatized fragmentation and parameterization of complex molecular environments. The platform is written in Python and defines a means for library communication and interaction. Intermediate data such as integrals are exposed to the platform and made accessible to the user in the form of NumPy arrays, and the resulting data are extracted, analyzed, and visualized. Complex computational protocols that may, for instance, arise due to a need for environment fragmentation and configuration-space sampling of biochemical systems are readily assisted by the platform. The platform is designed to host additional software libraries and will serve as a hub for future modular software development efforts in the distributed Dalton community.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Micro on a macroscale: relating microbial-scale soil processes to global ecosystem function

ABSTRACT Soil microorganisms play a key role in driving major biogeochemical cycles and in global responses to climate change. However, understanding and predicting the behavior and function of these microorganisms remains a grand challenge for soil ecology due in part to the microscale complexity of soils. It is becoming increasingly clear that understanding the microbial perspective is vital to accurately predicting global processes. Here, we discuss the microbial perspective including the microbial habitat as it relates to measurement and modeling of ecosystem processes. We argue that clearly defining and quantifying the size, distribution and sphere of influence of microhabitats is crucial to managing microbial activity at the ecosystem scale. This can be achieved using controlled and hierarchical sampling designs. Model microbial systems can provide key data needed to integrate microhabitats into ecosystem models, while adapting soil sampling schemes and statistical methods can allow us to collect microbially-focused data. Quantifying soil processes, like biogeochemical cycles, from a microbial perspective will allow us to more accurately predict soil functions and address long-standing unknowns in soil ecology.

59 BASIC BIOLOGICAL SCIENCES↗

SNEWPY: A Data Pipeline from Supernova Simulations to Neutrino Signals

Current neutrino detectors will observe hundreds to thousands of neutrinos from a Galactic supernovae, and future detectors will increase this yield by an order of magnitude or more. With such a data set comes the potential for a huge increase in our understanding of the explosions of massive stars, nuclear physics under extreme conditions, and the properties of the neutrino. However, there is currently a large gap between supernova simulations and the corresponding signals in neutrino detectors, which will make any comparison between theory and observation very difficult. SNEWPY is an open-source software package which bridges this gap. The SNEWPY code can interface with supernova simulation data to generate from the model either a time series of neutrino spectral fluences at Earth, or the total time-integrated spectral fluence. Data from several hundred simulations of core-collapse, thermonuclear, and pair-instability supernovae is included in the package. This output may then be used by an event generator such as sntools or an event rate calculator such as SNOwGLoBES. Additional routines in the SNEWPY package automate the processing of the generated data through the SNOwGLoBES software and collate its output into the observable channels of each detector. In this paper we describe the contents of the package, the physics behind SNEWPY, the organization of the code, and provide examples of how to make use of its capabilities.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗