Results for “combined data integration” — Page 4

DOE OSTI2026

Near-Real-Time Material Tracking: Combining Vis–NIR Spectroscopy with Flow Sensing for Accurate Nd(III) Quantification

A fiber-optic visible–near-infrared (vis–NIR) absorption spectroscopy and flow sensor system has been developed for near-real-time tracking of Nd mass in the effluent stream from a column in a fume hood. The approach leverages two unique data streams and a partial least-squares regression (PLSR) model trained on vis–NIR absorption spectra of Nd(III) (0–1.5 M) in 1 M HNO 3 . In-line volumetric flow rate and vis–NIR spectra are measured in sequence after a chromatography column. The time stamps from each data stream are then synchronized, which allows integrated volumes to be combined with Nd(III) molarities predicted by a PLSR model to accurately calculate the Nd mass flowing through the column. This integrated measurement provides instantaneous mass flow and accumulates these data over time to obtain the total mass processed. The methodology developed in this study contributes critical technical infrastructure to improve monitoring capabilities to support chemical separations and the production of strategic materials and isotopes.

Irvine, Sawyer B. [Oak Ridge National Laboratory (↗

DOE OSTI2025

Machine Learned Empirical Numerical Integrator from Simulated Data

Recently, a number of state-of-the-art surrogate machine learning (ML) models have been designed for global weather and climate prediction, which have been trained using reanalysis data products. Reanalysis data products are constructed using numerical model simulations that combine numerical integration of partial differential equations and parameterization schemes. These products are typically only archived and made available using coarsened spatial and temporal resolutions. This study explores the impact of the numerical generation methods used to produce the training datasets and the temporal resolution of those datasets on machine learning surrogate models. Using the nonlinear vector autoregression (NVAR) machine as an explainable ML technique, simple dynamical systems are emulated with ML models trained on data produced by three classical numerical integration schemes. NVAR is validated as a skillful ML method, capable of producing accurate predictions and, more importantly, reconstructing both the underlying dynamics and the numerical integration scheme used to generate the training data. However, the machine fails to generalize predictions on unseen test data generated by different numerical integration schemes, despite the underlying dynamical system being the same. This result provides a word of caution for the growing field of machine learning emulation of weather and climate dynamics. Furthermore, we illustrate using NVAR that training on temporally coarsened data may increase the required complexity of ML models and potentially introduce new numerical challenges. Finally, we discover that empirical integration schemes with arbitrary time-stepping sizes can be constructed directly from the data, which implies a potential for the development of empirical numerical integration schemes.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Editorial: Achieving Water-Energy-Food Nexus Sustainability: A Science and Data Need or a Need for Integrated Public Policy?

The benefits of addressing the water, energy, and food sectors in an integrated manner is gaining significant recognition. An integrated approach can provide improved resource use efficiencies, more coherent environmental policies, and an overall strategy for achieving sustainability in the three sectors, as outlined in the United Nations Sustainable Development Goals (SDG) 2 (Food), 6 (Water), and 7 (Energy). Societies are concerned with ensuring food security, avoiding wars over water, and creating opportunity by ensuring access to energy. To be effective, however, this approach needs to be adopted at all levels of societies including government, private and civil society and reinforced by management and planning methods. This special issue identifies different approaches that are either being conceptualized or tested to support the Water-Energy-Food (WEF) Nexus approach. The articles contribute to answering the question, “Is achieving Water-Energy-Food (WEF) Nexus Sustainability a science and data need or an integrated public policy need?” In either case, both natural and social sciences will need to combine to support science issues or integrated policy issues. The papers explore the ways in which science, data, and policy development could help to define integrative principles and policies for the three sectors. This approach could expand beyond the water, energy, and food sectors to include health, environment, trade, commerce, and international assistance thereby providing broad support to the SDGs. Moreover, this issue demonstrates that data combined with new technologies (tools and models) can support better decision-making when adopted by governments and the sectors.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2022

Metagenome-assembled genome extraction and analysis from microbiomes using KBase

Uncultivated Bacteria and Archaea account for the vast majority of species on Earth, but obtaining their genomes directly from the environment, using shotgun sequencing, has only become possible recently. In order to realize the hope of capturing Earth’s microbial genetic complement and to facilitate the investigation of the functional roles of specific lineages in a given ecosystem, technologies that accelerate the recovery of high-quality genomes are necessary. We present a series of analysis steps and data products for the extraction of high-quality metagenome-assembled genomes (MAGs) from microbiomes using the U.S. Department of Energy Systems Biology Knowledgebase (KBase) platform (http://www.kbase.us/). Overall, these steps take about a day to obtain extracted genomes when starting from smaller environmental shotgun read libraries, or up to about a week from larger libraries. In KBase, the process is end-to-end, allowing a user to go from the initial sequencing reads all the way through to MAGs, which can then be analyzed with other KBase capabilities such as phylogenetic placement, functional assignment, metabolic modeling, pangenome functional profiling, RNA-Seq and others. While portions of such capabilities are available individually from other resources, the combination of the intuitive usability, data interoperability and integration of tools in a freely available computational resource makes KBase a powerful platform for obtaining MAGs from microbiomes. While this workflow offers tools for each of the key steps in the genome extraction process, it also provides a scaffold that can be easily extended with additional MAG recovery and analysis tools, via the KBase software development kit (SDK).

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2022

Active galactic nucleus feedback in NGC 3982

The energetic feedback from supermassive black holes can influence star formation at the centres of galaxies. Observational evidence for active galactic nucleus (AGN) impact on star formation can be searched for in galaxies by combining ultraviolet imaging and optical integral field unit data. The ultraviolet flux directly traces recent star formation, and the integral field unit data can reveal dust attenuation, gas ionisation mechanisms, and gas kinematics from the central regions of the galaxy disk. A pilot study on NGC 3982 shows star formation suppression in the central regions of the galaxy, likely due to negative AGN feedback, and enhanced star formation in the outer regions. The case of NGC 3982 could be observational evidence of AGN feedback operating in a Seyfert galaxy.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2022

Quantifying the regional stranded asset risks from new coal plants under 1.5 °C

Momentum to phase out unabated coal use is growing globally. This transition is critical to meeting the Paris climate goals but can potentially lead to large amounts of stranded assets, especially in regions with newer and growing coal fleets. Here we combine plant-level data with a global integrated assessment model to quantify changes in global stranded asset risks from coal-fired power plants across regions and over time. With new plant proposals, cancellations, and retirements over the past five years, global net committed emissions in 2030 from existing and planned coal plants declined by 3.3 GtCO 2 (25%). While these emissions are now roughly in line with initial Nationally Determined Contributions (NDCs) to the Paris Agreement, they remain far off track from longer-term climate goals. Progress made in 2021 towards no new coal can potentially avoid a 24% (503 GW) increase in capacity and a 55% ($520 billion) increase in stranded assets under 1.5 °C. Stranded asset risks fall disproportionately on emerging Asian economies with newer and growing coal fleets. Recent no new coal commitments from major coal financers can potentially reduce stranding of international investments by over 50%.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Genome Extraction from Shotgun Metagenome Sequence Data

Uncultivated Bacteria and Archaea comprise the vast majority of species on Earth, but obtaining their genomes directly from the environment, using shotgun sequencing, has only recently become possible. To realize the hope of capturing Earth’s microbial genetic complement, technologies that accelerate recovery of high-quality genomes are necessary. We present a series of analysis steps and data products for the extraction of high quality metagenome-assembled genomes (MAGs) from microbiomes using the U.S. Department of Energy Systems Biology Knowledgebase (KBase) platform (http://www.kbase.us/). In KBase, the process is end-to-end, allowing a user to go from the initial sequencing reads all the way through to MAG genomes, which can then be analyzed with other KBase capabilities such as phylogenetic placement, functional assignment, metabolic modeling, pangenome functional profiling, RNA-Seq, and others. While portions of such capabilities are individually available from other resources, the combination of the intuitive usability, data interoperability, and integration of tools in a freely available compute resource makes KBase a uniquely powerful platform for obtaining MAGs from microbiomes. While this workflow offers tools for each of the key steps in the genome extraction process, it also provides a scaffold that can be easily extended, with additional MAG recovery and analysis tools, via the KBase SDK (Software Development Kit).

Chivian, Dylan↗

DOE OSTI2021

Moab Desert Crust - Sample 4E

Uncultivated Bacteria and Archaea comprise the vast majority of species on Earth, but obtaining their genomes directly from the environment, using shotgun sequencing, has only recently become possible. To realize the hope of capturing Earth’s microbial genetic complement, technologies that accelerate recovery of high-quality genomes are necessary. We present a series of analysis steps and data products for the extraction of high quality metagenome-assembled genomes (MAGs) from microbiomes using the U.S. Department of Energy Systems Biology Knowledgebase (KBase) platform (http://www.kbase.us/). In KBase, the process is end-to-end, allowing a user to go from the initial sequencing reads all the way through to MAG genomes, which can then be analyzed with other KBase capabilities such as phylogenetic placement, functional assignment, metabolic modeling, pangenome functional profiling, RNA-Seq, and others. While portions of such capabilities are individually available from other resources, the combination of the intuitive usability, data interoperability, and integration of tools in a freely available compute resource makes KBase a uniquely powerful platform for obtaining MAGs from microbiomes. While this workflow offers tools for each of the key steps in the genome extraction process, it also provides a scaffold that can be easily extended, with additional MAG recovery and analysis tools, via the KBase SDK (Software Development Kit).

Chivian, Dylan↗

NASA NTRS1998

Satellite-Based Investigations of the Transition from an Oceanic to Continental Transform Margin

Detailed characterization of neotectonics evolution of the Valle de San Felipe and Arroyo Grande regions in northern Baja California. Reoccupied GEOMEX GPS sites, and occupied a regional GPS (Global Positioning System) network. The Baja California peninsula in Mexico offers a unique setting for studying the kinematic evolution of a complex, active strike-slip/rift plate boundary. We are currently conducting remote sensing, geologic, and geodetic studies of this boundary. The combined data sets will yield instantaneous and time integrated views of its evolution. This proposal solicits renewed funding from NASA to support remote sensing and geologic studies. During the late Cenozoic, Baja California has been the locus of changing fault geometry that has accommodated components of the relative motion between the North America and Pacific plates. Contemporary slip between the two plates occurs in a broad zone that encompasses much of southern California and the Baja California Peninsula. The transfer of slip across this zone in southern California is relatively well understood. South of the border, the geometry and role of specific faults and structural provinces in transferring plate margin deformation across the peninsula is enigmatic. Results We use Landsat Thematic Mapper imagery of the Baja California Peninsula to identify recent and active faults, and then conduct field studies that characterize the temporal and spatial structural evolution of the plate margin. These data address questions concerning the neotectonic development of the Gulf of California, the Baja California Peninsula, and their role in evolution of the post-Miocene Pacific - North American plate boundary. Moreover, these studies provide constraints on the geometry of active faults, allowing more exact understanding of the results of ongoing NASA-supported geodetic experiments. In addition, anticipated publication of the TM scenes will provide a widely available geological data base for relatively little-known peninsula California. Achievements include development of an ArcInfo data base of Landsat and SPOT imagery, detailed field studies of Neogene structures in northeastern Baja California, and new constraint on Pacific - North America plate motion at Baja California latitudes. These results are reported in maps, manuscripts and data products which are published or near completion.

Miller, M. Meghan↗

NASA NTRS2001

Earth: Earth Science and Health

A major new NASA initiative on environmental change and health has been established to promote the application of Earth science remote sensing data, information, observations, and technologies to issues of human health. NASA's Earth Sciences suite of Earth observing instruments are now providing improved observations science, data, and advanced technologies about the Earth's land, atmosphere, and oceans. These new space-based resources are being combined with other agency and university resources, data integration and fusion technologies, geographic information systems (GIS), and the spectrum of tools available from the public health community, making it possible to better understand how the environment and climate are linked to specific diseases, to improve outbreak prediction, and to minimize disease risk. This presentation is an overview of NASA's tools, capabilities, and research advances in this initiative.

Maynard, Nancy G.↗

NASA NTRS2007

The Influence of Sea Ice on Primary Production in the Southern Ocean: A Satellite Perspective

Sea ice in the Southern Ocean is a major controlling factor on phytoplankton productivity and growth, but the relationship is modified by regional differences in atmospheric and oceanographic conditions. We used the phytoplankton biomass (binned at 7-day intervals), PAR and cloud cover data from SeaWiFS, ice concentrations data from SSM/I and AMSR-E, and sea-surface temperature data from AVHRR, in combination with a vertically integrated model to estimate primary productivity throughout the Southern Ocean (south of 60"s). We also selected six areas within the Southern Ocean and analyzed the variability of the primary productivity and trends through time, as well as the relationship of sea ice to productivity. We found substantial interannual variability in productivity from 1997 - 2005 in all regions of the Southern Ocean, and this variability appeared to be driven in large part by ice dynamics. The most productive regions of Antarctic waters were the continental shelves, which showed the earliest growth, the maximum biomass, and the greatest areal specific productivity. In contrast, no large, sustained blooms occurred in waters of greater depth (> 1,000 m). We suggest that this is due to the slightly greater mixed layer depths found in waters off the continental shelf, and that the interactive effects of iron and irradiance (that is, increased iron requirements in low irradiance environments) result in the limitation of phytoplankton biomass over large regions of the Southern Ocean.

Smith, Walker O., Jr.↗

DOE OSTI2022

Gas-mapping 3D imager measurement techniques and method of data processing

Measurement approaches and data analysis methods are disclosed for combining 3D topographic data with spatially-registered gas concentration data to increase the efficiency of gas monitoring and leak detection tasks. Here, the metric for efficiency is defined as reducing the measurement time required to achieve the detection, or non-detection, of a gas leak with a desired confidence level. Methods are presented for localizing and quantifying detected gas leaks. Particular attention is paid to the combination of 3D spatial data with path-integrated gas concentration measurements acquired using remote gas sensing technologies, as this data can be used to determine the path-averaged gas concentration between the sensor and points in the measurement scene. Path-averaged gas concentration data is useful for finding and quantifying localized regions of elevated (or anomalous) gas concentration making it ideal for a variety of applications including: oil and gas pipeline monitoring, facility leak and emissions monitoring, and environmental monitoring.

Thorpe, Michael↗

NASA NTRS1993

Demonstration of the feasibility of an integrated x ray laboratory for planetary exploration

The identification of minerals and elemental compositions is an important component in the geological and exobiological exploration of the solar system. X ray diffraction and fluorescence are common techniques for obtaining these data. The feasibility of combining these analytical techniques in an integrated x ray laboratory compatible with the volume, mass, and power constraints imposed by many planetary missions was demonstrated. Breadboard level hardware was developed to cover the range of diffraction lines produced by minerals, clays, and amorphous; and to detect the x ray fluorescence emissions of elements from carbon through uranium. These breadboard modules were fabricated and used to demonstrate the ability to detect elements and minerals. Additional effort is required to establish the detection limits of the breadboard modules and to integrate diffraction and fluorescence techniques into a single unit. It was concluded that this integrated x ray laboratory capability will be a valuable tool in the geological and exobiological exploration of the solar system.

Franco, E. D.↗

NASA NTRS2010

Integrated Budget Office Toolbox

The Integrated Budget Office Toolbox (IBOT) combines budgeting, resource allocation, organizational funding, and reporting features in an automated, integrated tool that provides data from a single source for Johnson Space Center (JSC) personnel. Using a common interface, concurrent users can utilize the data without compromising its integrity. IBOT tracks planning changes and updates throughout the year using both phasing and POP-related (program-operating-plan-related) budget information for the current year, and up to six years out. Separating lump-sum funds received from HQ (Headquarters) into separate labor, travel, procurement, Center G&A (general & administrative), and servicepool categories, IBOT creates a script that significantly reduces manual input time. IBOT also manages the movement of travel and procurement funds down to the organizational level and, using its integrated funds management feature, helps better track funding at lower levels. Third-party software is used to create integrated reports in IBOT that can be generated for plans, actuals, funds received, and other combinations of data that are currently maintained in the centralized format. Based on Microsoft SQL, IBOT incorporates generic budget processes, is transportable, and is economical to deploy and support.

Rushing, Douglas A.↗

DOE OSTI2024

3D Multiresolution Velocity Model Fusion with Probability Graphical Models

ABSTRACT The variability in spatial resolution of seismic velocity models obtained via tomographic methodologies is attributed to many factors, including inversion strategies, ray-path coverage, and data integrity. Integration of such models, with distinct resolutions, is crucial during the refinement of community models, thereby enhancing the precision of ground-motion simulations. Toward this goal, we introduce the probability graphical model (PGM), combining velocity models with heterogeneous resolutions and nonuniform data point distributions. The PGM integrates data relations across varying resolution subdomains, enhancing detail within low-resolution (LR) domains by utilizing information and prior knowledge from high-resolution (HR) subdomains through a maximum posterior problem. Assessment of efficacy, utilizing both 2D and 3D velocity models—consisting of synthetic checkerboard models and a fault-zone model from Ridgecrest, California—demonstrates noteworthy improvements in accuracy, compared to state-of-the-art fusion techniques. Specifically, we find reductions of 30% and 44% in computed travel-time residuals for 2D and 3D models, respectively, as compared to conventional smoothing techniques. Unlike conventional methods, the PGM’s adaptive weight selection facilitates preserving and learning details from complex, nonuniform HR models and applies the enhancements to the LR background domain.

Geochemistry & Geophysics↗

DOE OSTI2026

Captan+X Data Converter Integration

Fermi National Accelerator Laboratory's CAPTAN (Compact And Programmable daTa Acquisition Node) series provides a flexible hardware platform for data acquisition across a range of experiments and facilities. The latest iteration, CAPTAN+X, is built around a Kintex-7 FPGA supporting four FPGA Mezzanine Card (FMC) connections. As part of a broader laboratory effort to bring facility systems under a Model-Based Systems Engineering (MBSE) framework, CAPTAN+X is one of several systems slated to be incorporated into this modeling environment in the near term. A necessary step toward that goal is incorporating the platform's core functionality, which centers on integration with the LXD31K4 FMC, a data converter module combining dual AD9652 analog-to-digital converters and dual AD9142A digital-to-analog converters. Achieving compatibility required resolving pin-mapping conflicts between the LXD31K4's High Pin Count connector and the CAPTAN+X's available pin types, adapting a Board Support Project originally written for an UltraScale-class evaluation board to the Kintex-7 architecture, replacing incompatible primitives, restructuring clock distribution, and manually configuring chip initialization in place of an unsupported soft-processor-based approach. Functional verification of the ADC and DAC channels, followed by closed-loop testing combining both converters with real-time filtering, confirmed correct operation of the integrated system. These results establish a working hardware and firmware baseline for the CAPTAN+X platform, positioning it for future inclusion in the laboratory's growing MBSE modeling effort.

Espinoza, David [Illinois U., Urbana (main)]↗

DOE OSTI2026

CAPTAN+X Data Converter Integration

Fermi National Accelerator Laboratory's CAPTAN (Compact And Programmable daTa Acquisition Node) series provides a flexible hardware platform for data acquisition across a range of experiments and facilities. The latest iteration, CAPTAN+X, is built around a Kintex-7 FPGA supporting four FPGA Mezzanine Card (FMC) connections. As part of a broader laboratory effort to bring facility systems under a Model-Based Systems Engineering (MBSE) framework, CAPTAN+X is one of several systems slated to be incorporated into this modeling environment in the near term. A necessary step toward that goal is incorporating the platform's core functionality, which centers on integration with the LXD31K4 FMC, a data converter module combining dual AD9652 analog-to-digital converters and dual AD9142A digital-to-analog converters. Achieving compatibility required resolving pin-mapping conflicts between the LXD31K4's High Pin Count connector and the CAPTAN+X's available pin types, adapting a Board Support Project originally written for an UltraScale-class evaluation board to the Kintex-7 architecture, replacing incompatible primitives, restructuring clock distribution, and manually configuring chip initialization in place of an unsupported soft-processor-based approach. Functional verification of the ADC and DAC channels, followed by closed-loop testing combining both converters with real-time filtering, confirmed correct operation of the integrated system. These results establish a working hardware and firmware baseline for the CAPTAN+X platform, positioning it for future inclusion in the laboratory's growing MBSE modeling effort.

Espinoza, David [Illinois U., Urbana (main)]↗

NASA NTRS2017

GPS/Optical/Inertial Integration for 3D Navigation Using Multi-Copter Platforms

In concert with the continued advancement of a UAS traffic management system (UTM), the proposed uses of autonomous unmanned aerial systems (UAS) have become more prevalent in both the public and private sectors. To facilitate this anticipated growth, a reliable three-dimensional (3D) positioning, navigation, and mapping (PNM) capability will be required to enable operation of these platforms in challenging environments where global navigation satellite systems (GNSS) may not be available continuously. Especially, when the platform's mission requires maneuvering through different and difficult environments like outdoor opensky, outdoor under foliage, outdoor-urban and indoor, and may include transitions between these environments. There may not be a single method to solve the PNM problem for all environments. The research presented in this paper is a subset of a broader research effort, described in [1]. The research is focused on combining data from dissimilar sensor technologies to create an integrated navigation and mapping method that can enable reliable operation in both an outdoor and structured indoor environment. The integrated navigation and mapping design is utilizes a Global Positioning System (GPS) receiver, an Inertial Measurement Unit (IMU), a monocular digital camera, and three short to medium range laser scanners. This paper describes specifically the techniques necessary to effectively integrate the monocular camera data within the established mechanization. To evaluate the developed algorithms a hexacopter was built, equipped with the discussed sensors, and both hand-carried and flown through representative environments. This paper highlights the effect that the monocular camera has on the aforementioned sensor integration scheme's reliability, accuracy and availability.

Dill, Evan T.↗