Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Sources”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Multimodal Data Fusion via Entropy Minimization

The use of gradient-based data-driven models to solve a range of real-world remote sensing problems can in practice be limited by the uniformity of available data. Use of data from disparate sensor types, resolutions, and qualities typically requires compromises based on assumptions that are made prior to model training and may not necessarily be optimal given over-arching objectives. For example, while deep neural networks (NNs) are state-of-the-art in a variety of target detection problems, training them typically requires either limiting the training data to a subset over which uniformity can be enforced or training independent models which subsequently require additional score fusion. The method we introduce here seeks to leverage the benefits of both approaches by allowing correlated inputs from different data sources to co-influence preferred model solutions, while maintaining flexibility over missing and mismatching data. In this work we propose a new data fusion technique for gradient updated models based on entropy minimization and experimentally validate it on a hyperspectral target detection dataset. We demonstrate superior performance compared to currently available techniques using a range of realistic data scenarios, where available data has limited spacial overlap and resolution.

97 MATHEMATICS AND COMPUTING↗

Carbon Calculator for Land Use and Land Management Change from Biofuels Production (CCLUB)

The Carbon Calculator for Land Use and Land Management Change from Biofuels Production (CCLUB) has been developed as an integral part of Argonne National Laboratory’s Greenhouse Gases, Regulated Emissions, and Energy use in Technologies (GREET) model to analyze greenhouse gas (GHG) emissions from land use change (LUC) and land management change (LMC) in the context of overall biofuel life-cycle analysis (LCA). CCLUB relies on i) biofuel production scenarios, ii) LUC and LMC scenarios, and iii) emission factors (EF) to generate GHG emissions of LUC and LMC for biofuel production in gram carbon dioxide equivalent (CO2e) per MJ of fuel produced. Figure 1 outlines the calculations and data sources within CCLUB that are described in this document and Table 1 identifies where these data are stored and used within CCLUB, which is built in Microsoft Excel.

09 BIOMASS FUELS↗

Operational Emissions Accounting for Commercial Buildings

Buildings account for 30% of greenhouse gas emissions in the US. In order to aid in better decisions that reduce emissions from building operations, accurate emissions accounting is important. This report reviews existing operational GHG emission accounting approaches, frameworks, and data sources. We present the results of testing emissions accounting frameworks and emission factors with example data from two buildings and provide recommendations while using an emissions accounting framework.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

An Efficient, Scalable IO Framework for Sparse Data: larcv3

Neutrino physics is one of the fundamental areas of research into the origins and properties of the Universe. Many experimental neutrino projects use sophisticated detectors to observe properties of these particles, and have turned to deep learning and artificial intelligence techniques to analyze their data. From this, we have developed \texttt{larcv}, a \texttt{C++} and \texttt{Python} based framework for efficient IO of sparse data with particle physics applications in mind. We describe in this paper the \texttt{larcv} framework and some benchmark IO performance tests. \texttt{larcv} is designed to enable fast and efficient IO of ragged and irregular data, at scale on modern HPC systems, and is compatible with the most popular open source data analysis tools in the Python ecosystem.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Explorative Visualization for Traffic Safety using Adaptive Study Areas

The pressing need to improve traffic safety has become a societal concern in many cities around the world. Many traffic accidents are not occurring as stand-alone events but as consequences of other road incidents and hazards. To capture the traffic safety indications from a holistic aspect, this paper presents a suite of visualization techniques to explore large traffic safety datasets collected from different sources using adaptive study areas which include the whole region (Hamilton County, Ohio, U.S.) as well as smaller sub-areas. In the present study, these data source include (1) Hamilton County’s 911 emergency response data, which includes traffic incidents as well as other types of incidents throughout the county, and (2) Tennessee crash data, which contains only vehicle crashes with more detail on the circumstances of each crash. We find that both abstract and spatial visualization techniques are used to derive a better understanding of traffic safety patterns for different traffic participants in various urban environments. In addition to the entire region of Hamilton County, safety is examined on the highways, in the downtown area, and in a shopping district east of the city center. It is possible to characterize incidents in the different areas, gain a better understanding of common incident patterns, and identify outliers in the data. Finally, a textured tile calendar is presented to compare spatiotemporal patterns.

99 GENERAL AND MISCELLANEOUS↗

Exploring MDSplus data-acquisition software and custom devices

MDSplus is a software tool designed for data acquisition, storage, and analysis of complex scientific experiments. Over the years, MDSplus has primarily been used for data management for fusion experiments. This paper demonstrates that MDSplus can be used for a much wider variety of systems and experiments. We present a step-by-step tutorial describing how to create a simple experiment, manage the data, and analyze it using MDSplus and Python. To this end, a custom example device was developed to be used as the data source. This device was built on an open-source electronic hardware platform, and it consists of a microcontroller and two sensors. Finally, we read data from these sensors, store it in MDSplus, and use JupyterLab to visualize and process it.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

ZENN: A thermodynamics-inspired computational framework for heterogeneous data–driven modeling

Traditional entropy-based methods—such as cross-entropy loss in classification problems—have long been essential tools for representing the information uncertainty and physical disorder in data and for developing artificial intelligence algorithms. However, the rapid growth of data across various domains has introduced new challenges, particularly the integration of heterogeneous datasets with intrinsic disparities. To address this, we introduce a zentropy-enhanced neural network (ZENN), extending zentropy theory into the data science domain via intrinsic entropy, enabling more effective learning from heterogeneous data sources. ZENN simultaneously learns both energy and intrinsic entropy components, capturing the underlying structure of multisource data. To support this, we redesign the neural network architecture to better reflect the intrinsic properties and variability inherent in diverse datasets. We demonstrate the effectiveness of ZENN on classification tasks and energy landscape reconstructions, showing its superior generalization capabilities and robustness-particularly in predicting high-order derivatives. In image and text classification tasks, ZENN demonstrates superior generalization by introducing a learnable temperature variable that models latent multisource heterogeneity, allowing it to surpass state-of-the-art models on CIFAR-10/100, BBC News, and AG News. As a practical application in materials science, we employ ZENN to reconstruct the Helmholtz energy landscape of Fe3Pt using data generated from density functional theory and capture key material behaviors, including negative thermal expansion and the critical point in the temperature–pressure space. Overall, this work presents a zentropy-grounded framework for data-driven machine learning, positioning ZENN as a versatile and robust approach for scientific problems involving complex, heterogeneous datasets.

36 MATERIALS SCIENCE↗

A Brief Survey of Data Streaming Technologies

Streaming data is data that is emitted at variable volumes in a continuous, incremental manner with the goal of low-latency processing often at a different physical location. Network infrastructure is used to facilitate the connection between data sources and sinks, and must be robust to handle the requirements of the workflow. The U.S. Department of Energy Office of Science (DOE SC) a federal agency supporting fundamental scientific research for energy and the Nation’s largest supporter of basic research in the physical sciences. DOE SC has the responsibility for operating $\mathbf{1 0}$ National Laboratories, and 28 scientific user facilities supporting advanced supercomputers, particle accelerators, large x-ray light sources, neutron scattering sources, and other specialized facilities for nanoscience and genomics. This paper investigates the state of streaming data workfows, and details some of the approaches to this challenging problem.

Kissel, Ezra↗

DEEPEN Data Catalog for Magmatic Geothermal Systems in the United States

This data catalog contains information related to the Training Site Analysis for the Geothermica project "DE-risking Exploration of geothermal Plays in magmatic ENvironments (DEEPEN)." The DEEPEN project aims to reduce exploration risk for geothermal fluids in magmatic systems by developing improved an improved framework for interpretation of exploration data using the Play Fairway Analysis (PFA) methodology. The Training Site Analysis performed for DEEPEN leverages existing datasets to develop a customized PFA approach to exploration for multiple geothermal resource types in magmatic systems (conventional hydrothermal resources, supercritical fluid and superheated steam resources, and superhot EGS resources). This data catalog contains links to publicly available data files related to 8 training sites in the United States. US training sites are: the Cascades/Aleutians PFA project; the Hawaii PFA project, the Oregon Cascades PFA project, the Snake River Plain, Idaho PFA project, the Washington State PFA project, Newberry Volcano, Coso Geothermal Field, and the Geysers Geothermal field. This database contains an overview of these training sites, data sources, and links to publicly available exploration datasets. For the five PFA projects, details on exploration data related to PFA components (heat, fluid, permeability, sometimes seal) are provided, including a summary of data weighting methodologies.

15 GEOTHERMAL ENERGY↗

SBML Level 3: an extensible format for the exchange and reuse of biological models

Systems biology has experienced dramatic growth in the number, size, and complexity of computational models. To reproduce simulation results and reuse models, researchers must exchange unambiguous model descriptions. We review the latest edition of the Systems Biology Markup Language (SBML), a format designed for this purpose. A community of modelers and software authors developed SBML Level 3 over the past decade. Its modular form consists of a core suited to representing reaction-based models and packages that extend the core with features suited to other model types including constraint-based models, reaction-diffusion models, logical network models, and rule-based models. The format leverages two decades of SBML and a rich software ecosystem that transformed how systems biologists build and interact with models. More recently, the rise of multiscale models of whole cells and organs, and new data sources such as single-cell measurements and live imaging, has precipitated new ways of integrating data with models. We provide our perspectives on the challenges presented by these developments and how SBML Level 3 provides the foundation needed to support this evolution.

59 BASIC BIOLOGICAL SCIENCES↗

Soil and Water Chemistry and Trace Metal Extractability and Speciation in Wetland Soils from Illinois and South Carolina and Stream Sediments from Tennessee

Dataset revised on October 15, 2021. This revision adds sulfur and iron X-ray absorption near-edge structure spectra for the wetland soils and stream sediments from the field areas. It also renames the sample locations in a way that is more intuitive to readers of the companion paper that is under review. Finally, the data filenames and organization have been updated in their labeling to parallel the data sources in the associated paper. The abstract text and methods were also revised to reflect the data that was added to the dataset.Trace metals are essential for microbially-mediated biogeochemical processes occurring in anoxic wetland soils and stream bed sediments, such as denitrification, methanogenesis, and mercury methylation. Low availability of these elements may potentially inhibit key components of anaerobic carbon and nitrogen cycling and contaminant transformation. The solid-phase speciation of trace metals likely plays an important role in controlling their bioavailability. Metal speciation is well studied in contaminated soils and sediments as well as those naturally elevated in trace metals. However, less is known regarding the chemical forms of trace metals in systems having concentrations similar to geological background levels, the very settings where metal limitations may be most prevalent. We have investigated trace metal concentrations, extractability, and solid-phase speciation in three freshwater subsurface aquatic systems: marsh wetland soils, riparian wetland soils, and the sediments of a streambed.Data are provided for marsh wetland soils at Argonne National Laboratory, riparian wetland soils in the Tims Branch watershed at Savannah River National Laboratory, and stream bed sediments from East Fork Poplar Creek near Oak Ridge National Laboratory. Soil and sediment elemental abundances, mineralogy, and extractable nutrients as well as dissolved major elements, anions, trace metals, and nutrients in the overlying surface waters are provided. In addition, the results of sequential chemical extraction for the trace metals cobalt, nickel, copper, and zinc from the soils and sediment are reported as well as X-ray absorption near-edge structure (XANES) spectra in these materials are reported. To aid interpretation of these data, XANES spectra of sulfur in the soils and sediments as well as both XANES and extended X-ray absorption fine structure (EXAFS) spectra of iron in these materials are reported. The data package also includes the XANES spectra of reference standards and a potential interferent in the measurements. All data are provided in text-based CSV format with header sections indicating the data contained in each file and the corresponding units. Note that "u" is used in place of Greek lower case mu to indicate the micro prefix on units.

54 ENVIRONMENTAL SCIENCES↗

November 2021 Operational Highlights

Completed: 1. the initial tests of document workflows for Titan on the Red, which included standing up a software encryption capability to test data ingestion; 2. a software encryption capability in order to ingest the first data source by the end of the month; 3. a stand-alone computer for classified ontology data entry. Titan on the Red is an artificial intelligence/machine learning system to make digitizing, cataloging, and searching NSRC collections easier and more efficient. Created Online Vault backups, with one copy stored at LANL and one shipped to Lawrence Livermore National Laboratory. The Online Vault is a classified, searchable library of LANL’s nuclear weapons design and test history. Imported new Laboratory Directed Research and Development (LDRD) documents based on revised access categories. Bulk ingested nearly 10,000 documents via java-based PowerLoader. This application ingests metadata and content into the Online Vault to meet the requirements for the NSRC collections. Rehoused 300 linear feet of weapons physics documents in archival, acid-free storage folders and boxes.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

WISP: Watching grid Infrastructure Stealthily through Proxies (Final Technical Report)

The complex interdependencies of cyber systems (sensors and communications), physical grids and associated electricity market operations make protecting electric power grids a significant challenge. The energy sector is constantly under new, targeted, advanced and dangerous cyber-attacks that have the potential to result in the loss of human life. These threats are further exacerbated by our need to modernize the grid. One focus of cyber security research in smart grids is the securing of the SCADA system through advanced intrusion detection systems (IDS) and bad data detection algorithms in state estimation. These methods either require full knowledge of the system topology and parameters or fail to understand the physical behaviors under attack. WISP (Watching grid Infrastructure Stealthily through Proxies) is designed to provide additional protection to the power grid using only publicly available data. In particular, WISP exploits the spatio-temporal nature of the real time locational marginal prices (LMPs), in conjunction with other information such as bids, weather, outages and load data to analyze anomalous power pricing behaviors and then correlate those observations to localize regions of interest and identify potential cyber events. WISP is non-intrusive as the tool is deployed as a service in the Cloud or on premise and provides reliable information to system operators for enhanced situational awareness, without impeding energy delivery functions. The WISP technology comprises three modules: the data-driven anomaly detection core, the vulnerability and risk analysis and the root cause analysis. The data-driven anomaly detection core performs the tasks of feature selection, anomaly detection and attack region localization. The vulnerability and risk analysis module provides system level information of the vulnerable variables and times, assisting the operators in selecting monitoring and protection nodes. The root cause analysis module takes the detection results and identifies potential operational conditions that contribute to the detected anomalies. In Phase I, we have demonstrated the feasibility and effectiveness of WISP. We developed a realistic electricity market simulator capable of generating normal and attack market data under various operational conditions. We developed a series of cyber-attack detection and analysis algorithms and evaluated them under multiple data sources. Finally, we integrated all modules into an end-to-end software, providing functions for data management, data analytics and visualization. Specifically, we have achieved: (i) real-time data acceptance from external utility interfaces with >99% acceptance rate; (ii) high performance anomaly detection algorithms with >98% detection accuracy and <0.1% false alarm rate; and (iii) ultra-low computing delay <50 milliseconds. Additionally, our team developed algorithms to identify the vulnerable variables in electricity market operations and root cause analysis functions to identify major contributors to the price spikes. These ancillary modules are necessary when deploying WISP in real world industry environment. In Phase II, we have demonstrated the effectiveness of WISP software on realistic largescale power systems. We performed red team testing for the Phase I WISP software and identified software vulnerabilities and implemented corresponding mitigation solutions. We adapted the electricity market simulator for the Texas synthetic 2000-bus system and generated datasets for the false data injection attacks. We created database and visualization interfaces for the Texas system and the ISO New England system. We performed software optimization in terms of operation efficiency, computing speed and detection accuracy. Finally, we tested the software on the Texas system and the ISO New England system and evaluated the detection performance. Overall, we achieved above 89% detection rate, below 3% false alarm rate and below 37 seconds of end-to-end detection delay.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Development and Preliminary Analysis of a U.S. Geothermal Heat Pump Installation Database

This paper seeks to addresses the significant gap in the literature regarding the installation and adoption of geothermal heat pump (GHP) systems in the United States. While the "2021 U.S. Geothermal Power Production and District Heating Market Report" published by the National Renewable Energy Laboratory (NREL) focused on direct-use geothermal district heating systems, it did not include an analysis of GHP installations (Robins et al. 2021). To bridge this gap, NREL has compiled a novel database currently containing 70,470 records of GHP installations, primarily sourced from state well permits and small-scale studies. Our methodology emphasizes the collection, cleaning, and standardization of data, addressing challenges such as inconsistent reporting formats and privacy concerns. Despite limitations in data on capacity, costs, and performance, our preliminary geospatial analysis reveals insights into the distribution of GHP systems across urban and rural areas and climate zones. The paper highlights the importance of publicly accessible data for advancing GHP technology adoption with a discussion of existing data sources and their limitations, advocating for improved collaboration between NREL and industry stakeholders.

data collection↗

Archi: Agentic Operations at the CMS Experiment

We present Archi, an open-source, end-to-end framework for scientific collaborations that combines the systematic ingestion and organization of heterogeneous data sources with the deployment of configurable, private, and extensible agents that retrieve and reason over them. An instance of Archi has been deployed for the Computing Operations team of the CMS experiment at CERN's LHC since February 2026 as a support agent for technical operators, offering retrieval and analysis capabilities by combining documentation, historical data, and live monitoring systems. We evaluate the system on operator feedback and a question set collected from production usage, graded by human and automated panels. The system proves effective at operational tasks, resolving real-world queries posed by CMS operators. We also observe that locally-hosted, open-weight models perform competitively, enabling fully private management of sensitive data.

Lugato, Pietro [MIT; CERN]↗

LCOC (Levelized Cost of Light-Duty EV Charging Calculator)

This code was developed to calculate the levelized cost of light-duty electric vehicle (EV) charging (LCOC) for the paper "Levelized Cost of Charging Electric Vehicles in the United States" by Borlaug et al.(https://doi.org/10.1016/j.joule.2020.05.013). The calculation takes inputs from a variety of publicly available data sources (e.g., utility tariffs from the Utility Rate Database; EV charging station locations from the Alternative Fuels Data Center; energy price forecasts from the Energy Information Administration) and produces the current LCOC, considering when, where, and how light-duty EVs are recharged. In addition, the lifetime fuel cost savings (LFCS) calculation estimates the discounted fuel cost savings for a new battery EV (BEV) or plug-in hybrid EV (PHEV) over a 15-year time horizon using state-level gasoline price and LCOC projections.

Borlaug, Brennan↗

Biofuels Induced Land Use Change Emissions: The Role of Implemented Land Use Emission Factors

Biofuels’ induced land-use change (ILUC) emissions have been widely studied over the past 15 years. Many studies have addressed uncertainties associated with these estimates. These studies have broadly examined uncertainties associated with the choice of economic models, their assumptions and parameters, and a few bio-physical variables. However, uncertainties in land-use emission factors that represent the soil and vegetation carbon contents of various land types across the world and are used to estimate carbon fluxes due to land conversions are mostly overlooked. This paper calls attention to this important omission. It highlights some important sources of uncertainty in land-use emissions factors, explores the range in these factors from established data sources, and compares the influence of their variability on ILUC emissions for several sustainable aviation fuel (SAF) pathways. The estimated land-use changes for each pathway are taken from a well-known computable general equilibrium model, GTAP-BIO. Two well-known carbon calculator models (CCLUB and AEZ-EF) that represent two different sets of emissions factors are used to convert the GTAP-BIO estimated land-use changes to ILUC emissions. The results show that the calculated ILUC emissions obtained from these carbon calculators for each examined SAF pathway are largely different, even for the same amortization time horizon. For example, the ILUC emissions values obtained from the AEZ-EF and CCLUB models for producing jet fuel from corn ethanol for a 25-year amortization period are 24.9 gCO 2 e/MJ and 15.96 gCO 2 e/MJ, respectively. This represents a 60% difference between the results of these two carbon calculators for the same set of land-use changes. The results show larger differences for other pathways as well.

09 BIOMASS FUELS↗

Smart sensors using artificial intelligence for on-detector electronics and ASICs

Cutting edge detectors push sensing technology by further improving spatial and temporal resolution, increasing detector area and volume, and generally reducing backgrounds and noise. This has led to a explosion of more and more data being generated in next-generation experiments. Therefore, the need for near-sensor, at the data source, processing with more powerful algorithms is becoming increasingly important to more efficiently capture the right experimental data, reduce downstream system complexity, and enable faster and lower-power feedback loops. In this paper, we discuss the motivations and potential applications for on-detector AI. Furthermore, the unique requirements of particle physics can uniquely drive the development of novel AI hardware and design tools. We describe existing modern work for particle physics in this area. Finally, we outline a number of areas of opportunity where we can advance machine learning techniques, codesign workflows, and future microelectronics technologies which will accelerate design, performance, and implementations for next generation experiments.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗