Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data infrastructure”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Analysis of the Feasibility of UAS-Based EMI Sensing for Underground Utilities Detection and Mapping

This paper investigates the feasibility of using a linear current sensing (LCS) technique integrated on an unmanned aerial system (UAS) for detecting and mapping underground infrastructure rapidly and cost-effectively. The LCS technique is based on data from a wide band of electromagnetic induction frequencies (50 kHz to 2 MHz) using a vector magnetic field gradiometer. This technique takes advantage of a slowly decaying secondary magnetic field in order to achieve greater standoff detection distance ($\frac{1}{R^2}$ vs. $\frac{1}{R^6}$ for compact metallic targets during EMI sensing, where R is the distance from a target to the sensor). These secondary magnetic fields are produced by the excite current on long conductors, allowing detection at a distance of 10 meters or more. The system operates between tens of kHz to a few MHz and uses either an active EMI source or existing EM fields to excite this linear current on a long metallic subsurface target. Once excited, these linear currents produce a secondary magnetic field that is detected with an above ground triaxial magnetic field gradiometer. By moving and tracking its geolocation, the system outputs rich datasets sufficient to support high-fidelity forward and inverse EMI models for estimating the depth and orientation of deep underground long linear metallic infrastructure. The system’s hardware and its integration to a UAS system are outlined, along with the formulation of LCS theory, and numerical and experimental data are presented. The results illustrate that the LCS technique offers large standoff detection, is adaptable to UAS, and could be used effectively for detecting deep underground infrastructure such as wires and pipes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

New Energy Infrastructure Outlook [Slides]

This report provides a perspective on energy infrastructure under development in the continental U.S. as of the end of 2025, focusing on those making significant progress toward achieving commercial operation. Infrastructures covered in this report include power plants, electric transmission, natural gas pipelines, liquefied natural gas terminals, and datacenters. Additionally, this report includes a section on stockpiled volumes of coal, natural gas, and petroleum.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

“Innervated” Pipelines: A New Technology Platform for In-Situ Repair and Embedded Intelligence

The overall vision pursued under the project would ultimately enable capability for real-time operational monitoring of natural gas (and other) pipeline infrastructures through the combination of in-situ repair and rehabilitation methods with embedded fiber optic sensing and associated data analytics methods and platform tools. Benefits to the public include more resilient and robust natural gas pipeline infrastructures with the potential to expand the applications of developed technologies under the program to other important areas of critical energy infrastructure in the future such as H2 pipelines and infrastructure, municipal and other civil infrastructure, as well as subsurface oil, gas, and geothermal infrastructure applications. The program has successfully demonstrated feasibility for all of the critical enabling elements and serves as a foundation for future technology maturation, deployment, and customization for other potential applications and high-priority needs into the future. Several underlying innovations have shown potential for commercial deployment and are the subject of continued development and technology transfer based upon patents submitted during the project duration.

02 PETROLEUM↗
DOE OSTI2024

High-Throughput Data Processing at FRIB Using ESnet

Real-time or nearly real-time (nearline) data processing methods are critical tools as detector technologies and data acquisition (DAQ) systems allow for higher data rates and volumes. The introduction of the energy sciences network (ESnet), a U.S. Department of Energy (DOE) supported high-speed network for scientific research, creates opportunities to leverage the computing power of DOE facilities like the National Energy Research Scientific Computing Center (NERSC). As a first step toward realizing a DOE Office of Science Integrated Research Infrastructure (IRI) pattern, an automated workflow was developed to remotely process data obtained from a nuclear physics experiment at the Facility for Rare Isotope Beams (FRIB) at NERSC with data transferred between FRIB and NERSC over ESnet. The workflow demonstrated the ability to process one week’s worth of experimental data in approximately 90 min and was used successfully for nearline analysis during a recently completed FRIB experiment. Here, a summary of the workflow development and results of recent demonstrations will be presented.

Data processing↗
DOE OSTI2026

ARM Lead Mentor Selection Process

The Atmospheric Radiation Measurement (ARM) Program was created in 1989 with funding from the U.S. Department of Energy (DOE) to develop several highly instrumented ground stations to study cloud-formation processes and their influence on radiative transfer. This scientific infrastructure provides for fixed sites, mobile facilities, an aerial facility, and a data archive available for use by scientists worldwide through the ARM Climate Research Facility—a scientific user facility. The ARM Climate Research Facility currently operates more than 300 instrument systems that provide ground-based observations of the atmospheric column. To keep ARM at the forefront of climate observations, the ARM infrastructure depends heavily on instrument scientists and engineers, known as Mentors. Mentors must have an excellent understanding of instrumentation theory and operation for their instrument areas and have comprehensive knowledge of critical scale-dependent atmospheric processes. They must also possess the technical and analytical skills to develop new data retrievals that provide innovative approaches for creating research-quality data sets. The ARM Facility seeks the best overall qualified candidate, or team when appropriate, that can fulfill Mentor requirements in a timely manner. The roles and responsibilities of the ARM Instrument Operations Manager are provided in Appendix A. The key role and responsibilities and detailed responsibilities of ARM Lead Mentors are provided in Appendix B and Appendix C, respectively.

47 OTHER INSTRUMENTATION↗
NASA NTRS2015

Enhancing Discovery, Search, and Access of NASA Hydrological Data by Leveraging GEOSS

An ongoing NASA-funded project has removed a longstanding barrier to accessing NASA data (i.e., accessing archived time-step array data as point-time series) for selected variables of the North American and Global Land Data Assimilation Systems (NLDAS and GLDAS, respectively) and other EOSDIS (Earth Observing System Data Information System) data sets (e.g., precipitation, soil moisture). These time series (data rods) are pre-generated. Data rods Web services are accessible through the CUAHSI Hydrologic Information System (HIS) and the Goddard Earth Sciences Data and Information Services Center (GES DISC) but are not easily discoverable by users of other non-NASA data systems. The Global Earth Observation System of Systems (GEOSS) is a logical mechanism for providing access to the data rods. An ongoing GEOSS Water Services project aims to develop a distributed, global registry of water data, map, and modeling services cataloged using the standards and procedures of the Open Geospatial Consortium and the World Meteorological Organization. The ongoing data rods project has demonstrated the feasibility of leveraging the GEOSS infrastructure to help provide access to time series of model grid information or grids of information over a geographical domain for a particular time interval. A recently-begun, related NASA-funded ACCESS-GEOSS project expands on these prior efforts. Current work is focused on both improving the performance of the generation of on-the-fly (OTF) data rods and the Web interfaces from which users can easily discover, search, and access NASA data.

GEOSS↗
DOE OSTI2023

A National Infrastructure for Artificial Intelligence on the Grid (NI4AI) (Final Scientific/Technical Report)

Electric utilities have traditionally taken a very pragmatic yet myopic approach with grid sensors and the resulting collected data. Sensors are purchased and deployed to solve a specific, known problem that has risen to sufficient awareness as to justify the effort of deploying sensors and the needed capital investment. This sensor data flows into proprietary software packages with limited functionality intended only to address the initial problem. This approach aligns with the financial incentives of the utility to deploy capital into fixed hardware assets for which the corporations earn a rate of return. This mentality stands in stark contrast to the big data revolution that started nearly 25 years ago with the rise of Google. In this worldview, data is a fundamental business asset; successful organizations collect, store, explore, merge, and exploit as much data as possible to not only solve problems well understood today but also to tackle new problems that will inevitably rise tomorrow. The ARPA-E Open Innovation 2018 project entitled A National Infrastructure for Artificial Intelligence on the Grid or NI4AI for short was designed to demonstrate this alternative paradigm for using data. To do this, the project was composed of three key thrust areas. The first major component deployed a variety of high-frequency grid sensors and captured terabytes of both wide-scale and localized grid measurements, generating high-value datasets for grid research and algorithm development. The second aspect made available PingThings’ PredictiveGridTM, a horizontally scalable, cloud-based data management and AI platform built for time series data to explore and exploit the collected data. Finally, the project fostered a diverse and open research community composed of experts from numerous fields through focused educational content, code sharing, and data science competitions. Shifting away from “single use” sensors and closed data silos within electric utilities is a major benefit to the public at large. This legacy approach to data is incredibly (1) capital intensive (new sensors must be deployed for each new problem and problems tend to arise continuously) and (2) painfully slow (new problems must be identified first and then new sensors must be deployed to collect data to begin to address the issue). The transition to a carbon neutral grid requires a massive transformation of the existing grid infrastructure and will continue to challenge the legacy grid in unforeseen ways. The only way to make the energy transition cost effective is for utilities to abandon this dated data paradigm and adopt more contemporary approaches. NI4AI has shown that it is technically possible and economically feasible to ingest, explore, and exploit grid data collected from even very high frequency sensing, such as continuous point on wave sensors collecting measurements 10,000 times a second. In fact, the PredictiveGrid platform used is commercially available and deployed at several utilities in the United States. Project accomplishments were numerous and included (1) making available a state of the art time series platform to the community, (2) collecting over 520 streams of time series data from grid sensors totaling over 1 trillion grid measurements, and (3) developing and nurturing a community within the industry focused on the use of data to create value for utilities and, ultimately, end consumers.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

E85 Fueling Infrastructure Trends: A Decade in Review

This report provides information on ethanol fueling infrastructure and industry trends over the last 10 years. It is informed primarily by ethanol fueling station location data collected through the U.S. Department of Energy's Alternative Fuels Data Center (AFDC) Station Locator from 2011 through 2021 (AFDC 2021a). Industry stakeholders, including the Renewable Fuels Association and Growth Energy, also provided data and additional context around trends seen in the data.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2024

Homomorphic Encryption for Electrical Metering Aggregation: Protecting the Privacy of Building Tenants

Electrical meters are devices that measure consumer electricity usage. The data collected by these meters is necessary for utility billing and electrical grid management but can also be used to assess the environmental impact of buildings. Prior research has found that unprotected metering data could potentially be used to infer some information about the behaviors of building tenants by detecting changes in electricity usage. For example, a period of low electricity usage could suggest that the tenants are not in the building. As smart metering becomes more common, there is a growing need for data privacy protections for metering data that do not negatively impact the quality and availability of data used for energy management and billing applications. To identify potential solutions, we developed a Python-based data aggregation platform to analyze the potential efficacy of privacy-enhancing technologies for energy metering applications. This platform aggregates groups of metering sites into virtual buildings, which could potentially detach changes in electrical activity from individual tenants, making it more difficult to track the activity of a specific tenant. To further protect data during analysis, this project utilizes homomorphic encryption as part of its initial approach. Homomorphic encryption offers a means of protecting energy consumption data while permitting mathematical operations to be performed without the need to know the data contents. This allows for data to be processed into usable statistics without revealing energy consumption information. A series of homomorphic encryption libraries were evaluated to determine their applicability and limitations in the context of metering data. The use of these techniques may help to reassure consumers and encourage further adoption of smart grid infrastructure.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Decision support for United States—Canada energy integration is impaired by fragmentary environmental and electricity system modeling capacity

The renewable energy transition is leading to increased electricity trade between the United States and Canada, with Canadian hydropower providing firm lower-carbon power and buffering variability of wind and solar generation in the U.S. However, long-term power purchase agreements and transborder transmission projects are controversial, with two of four proposed transmission lines between Quebec, Canada and the northeast U.S. cancelled since 2018. Here, we argue that controversies are exacerbated by a lack of open-source data and tools to understand tradeoffs of new hydropower generation and transmission infrastructure in comparison to alternatives. This gap includes impacts that incremental transmission and generation projects have on the economics of the entire system, for example, how new transmission projects affect exports to existing markets or incentivize new generation. We identify priority areas for data synthesis and model development, such as integrating linked hydropower and hydrologic interactions in energy system models and openly releasing (by utilities) or back-calculating (by researchers) hydropower generation and operational parameters. Publicly available environmental (e.g. streamflow, precipitation) and techno-economic (e.g. costs, reservoir size,) data can be used to parameterize freely usable and extensible models. Existing models have been calibrated with operational data from Canadian utilities that are not publicly available, limiting the range of scientific and commercial questions these tools have been used to answer and the range of parties that have been involved. Studies conducted using highly resolved, national-scale public data exist in other countries, notably, the United States, and demonstrate how greater transparency and extensibility can drive industry action. Improved data availability in Canada could facilitate approaches that (1) increase participation in decarbonization planning by a broader range of actors; (2) allow independent characterizations of environmental, health, and economic outcomes of interest to the public; and (3) identify decarbonization pathways consistent with community values.

13 HYDRO ENERGY↗
DOE OSTI2020

Mobility Data and Models Informing Smart Cities

This presentation explores the interactions of Emerging Technology, Changing Urban Environments, and Urban Travel Behavior on Mobility and Energy Impacts. Key findings include quantifying impacts of emerging mobility, access and infrastructure associated with new mobility choices and services in urban areas. The results demonstrate new data collection methods and capabilities to understand and identify key levers to improve energy productivity of future mobility systems and of quickly evolving MaaS and COVID-19 contexts to monitor rapidly shifting urban mobility patterns. Under development are mode choice models for new modes versus traditional modes. Initial estimates are developed on the potential of workforce mobility strategies in shaping future energy-efficient mobility system impacts. For mode replacement and workforce mobility, this presentation offers observability into the changes in number of transactions per mode, after ride-hailing/TNC/MaaS introduction and in origins of workforce to enable user need-driven reimagining of efficient mobility systems: Seattle (SEA-TAC) airport: for every 100 new TNC transactions for ground transportation, ~27% replaced transit, 35% replaced parking, 17% replaced car rentals, and 21% replaced taxis. Similarly, at Denver International (DEN), ride-hailing transactions replaced transit, parking, car rental and taxis at a rate of 34.7%, 39.0%, 16.6%, and 9.7%, respectively. A workforce mobility tool, analysis/visualization techniques, and capabilities to understand and identify key job commute needs, new choices in access to job opportunities, and affordability aspects as levers to improve energy productivity of future integrated urban mobility systems.

ADVANCED PROPULSION SYSTEMS,ENERGY PLANNING, POLIC↗
NASA NTRS2015

Intelligent Observation Strategies for Geosynchronous Remote Sensing for Natural Hazards

Geosynchronous satellites offer a unique perspective for monitoring environmental factors important to understanding natural hazards and supporting the disasters management life cycle, namely forecast, detection, response, recovery and mitigation. In the NASA decadal survey for Earth science, the GEO-CAPE mission was proposed to address coastal and air pollution events in geosynchronous orbit, complementing similar initiatives in Asia by the South Koreans and by ESA in Europe, thereby covering the northern hemisphere. In addition to analyzing the challenges of identifying instrument capabilities to meet the science requirements, and the implications of hosting the instrument payloads on commercial geosynchronous satellites, the GEO-CAPE mission design team conducted a short study to explore strategies to optimize the science return for the coastal imaging instrument. The study focused on intelligent scheduling strategies that took into account cloud avoidance techniques as well as onboard processing methods to reduce the data storage and transmission loads. This paper expands the findings of that study to address the use of intelligent scheduling techniques and near-real time data product acquisition of both the coastal water and air pollution events. The topics include the use of onboard processing to refine and execute schedules, to detect cloud contamination in observations, and to reduce data handling operations. Analysis of state of the art flight computing capabilities will be presented, along with an assessment of cloud detection algorithms and their performance characteristics. Tools developed to illustrate operational concepts will be described, including their applicability to environmental monitoring domains with an eye to the future. In the geostationary configuration, the payload becomes a networked thing with enough connectivity to exchange data seamlessly with users. This allows the full field of view to be sensed at very high rate under the control of ground infrastructure, resulting in improved efficiencies, accuracy and science benefits. Hence a remote sensing payload and its data may become one of millions of connected objects in the emerging Internet of Things (IoT), and be as easily accessible by a users smart phone as any other smart appliance.

0↗
DOE OSTI2026

Toward Unified Autonomous Scattering Experiments: A Cross-Facility Case Study at ALS and PETRA III

Autonomous experiments rely on the integration of control, data acquisition, analysis, and decision-making frameworks. While such systems have been demonstrated at individual facilities, adapting them to additional instruments remains challenging due to differences in local infrastructure. We present a modular workflow that connects existing open-source tools for data access (Tiled), workflow orchestration (Prefect), analysis and visualization (pyFAI, Plotly Dash), and Gaussian-process-based adaptive sampling (gpCAM) into a unified framework for autonomous scattering experiments. The same configuration operates across two synchrotron beamlines (ALS 7.3.3 and PETRA III P03) with only minimal facility-specific adjustments, as shown in proof-of-concept demonstrations. This validates that a consistent design emphasizing modularity and shared interfaces can ease deployment across diverse experimental environments. The resulting framework provides a flexible foundation for extending autonomous control and analysis capabilities beyond a single beamline or instrument.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Environmental sustainability in basic research: a perspective from HECAP+

The climate crisis and the degradation of the world's ecosystems require humanity to take immediate action. The international scientific community has a responsibility to limit the negative environmental impacts of basic research. The HECAP+ communities (High Energy Physics, Cosmology, Astroparticle Physics, and Hadron and Nuclear Physics) make use of common and similar experimental infrastructure, such as accelerators and observatories, and rely similarly on the processing of big data. Our communities therefore face similar challenges to improving the sustainability of our research. This document aims to reflect on the environmental impacts of our work practices and research infrastructure, to highlight best practice, to make recommendations for positive changes, and to identify the opportunities and challenges that such changes present for wider aspects of social responsibility.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS2013

Tethered Satellites as an Enabling Platform for Operational Space Weather Monitoring Systems

Tethered satellites offer the potential to be an important enabling technology to support operational space weather monitoring systems. Space weather "nowcasting" and forecasting models rely on assimilation of near-real-time (NRT) space environment data to provide warnings for storm events and deleterious effects on the global societal infrastructure. Typically, these models are initialized by a climatological model to provide "most probable distributions" of environmental parameters as a function of time and space. The process of NRT data assimilation gently pulls the climate model closer toward the observed state (e.g., via Kalman smoothing) for nowcasting, and forecasting is achieved through a set of iterative semi-empirical physics-based forward-prediction calculations. Many challenges are associated with the development of an operational system, from the top-level architecture (e.g., the required space weather observatories to meet the spatial and temporal requirements of these models) down to the individual instruments capable of making the NRT measurements. This study focuses on the latter challenge: we present some examples of how tethered satellites (from 100s of m to 20 km) are uniquely suited to address certain shortfalls in our ability to measure critical environmental parameters necessary to drive these space weather models. Examples include long baseline electric field measurements, magnetized ionospheric conductivity measurements, and the ability to separate temporal from spatial irregularities in environmental parameters. Tethered satellite functional requirements are presented for two examples of space environment observables.

Gilchrist, Brian E.↗
DOE OSTI2021

Manufacturing Management System Overview [Slides]

Vision: Institute a trusted manufacturing capability within the ALDWP Production Agency enabling digital product acceptance and access to digital manufacturing post-production activities. Mission: Establish a modern manufacturing infrastructure that ensures operator credentials, minimized human transcription errors, capable of managing all aspects of manufacturing including digital data acquisition, NCR resolution, and product acceptance, while providing an effective and intuitive user experience. Strategy: Constitute the modern manufacturing infrastructure to minimize risk and plant disruption while incrementally involving the capability.

42 ENGINEERING↗
DOE OSTI2024

Smart CO2 Transport-Route Planning Tool: Providing Data and Insights for Accelerating Carbon Transport & Storage Deployment

Overview presentation given at the 2024 FECM / NETL Carbon Management Research Project Review Meeting on NETL's Bipartisan Infrastructure Law-funded Smart CO2 Transport-Route Planning Tool and associated geodatabase. This machine learning informed, data-driven public resource was designed to inform regulators, industry, and researchers plan and develop safe and efficient transport routes across the country.

Romeo, Lucy↗
NASA NTRS2016

Explore Earth Science Datasets for STEM with the NASA GES DISC Online Visualization and Analysis Tool, Giovanni

The NASA Goddard Earth Sciences (GES) Data and Information Services Center(DISC) is one of twelve NASA Science Mission Directorate (SMD) Data Centers that provide Earth science data, information, and services to users around the world including research and application scientists, students, citizen scientists, etc. The GESDISC is the home (archive) of remote sensing datasets for NASA Precipitation and Hydrology, Atmospheric Composition and Dynamics, etc. To facilitate Earth science data access, the GES DISC has been developing user-friendly data services for users at different levels in different countries. Among them, the Geospatial Interactive Online Visualization ANd aNalysis Infrastructure (Giovanni, http:giovanni.gsfc.nasa.gov) allows users to explore satellite-based datasets using sophisticated analyses and visualization without downloading data and software, which is particularly suitable for novices (such as students) to use NASA datasets in STEM (science, technology, engineering and mathematics) activities. In this presentation, we will briefly introduce Giovanni along with examples for STEM activities.

precipitation↗