Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Open data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,333 records · Page 74

3DBFSVBF (3D BatFinder Smart Video BioFilter and Multi-class BatFinder Smart Video BioFilter) [SWR-22-88]

Bats are notoriously difficult to study, therefore, identifying specific behavioral trends and the precise environmental conditions at the time of collision requires a monitoring solution that can reliably collect relevant data. To date, thermal infrared video surveillance has been extensively applied to study bats and has proven to be a powerful yet cumbersome tool. Current analytical approaches are time consuming because data processing data has not been fully automated. In the past, steps have been taken to record avian and bat activity in conjunction with complicated image processing techniques that separate species from other moving objects within the field of view (i.e. clouds and portions of the wind turbine). Once the videos are collected, the post-processing does not allow real time monitoring and identification, leading to a delay in both studying the behavior of these species and determining the effectiveness of any impact reduction strategy being studied. Moreover, object identification capability is lacking, thus limiting the usefulness of video data. To resolve these issues, we are using open source 3D computer vision and machine learning techniques allowing for automatic detection of objects in real-time with the ability to correlate these objects with environmental variables and recording the flight paths of each object. The machine learning has been trained on 3D data and allows for automated real-time data collection, identification and tracking, thereby eliminating the need for long and tedious post-analysis processing of the videos. This machine learning model is an added feature to the previous BatFinder Smart Video BioFilter and increases the accuracy of that systems classification by increasing the accuracy of identifying bats (90% accuracy) and insects (69% accuracy) to a 97% accuracy. There are two object classifier machine learning models, Binary and multi-classification. Binary object classifier labeled BatFinder_Smart_Video_BioFilter.h5 distinguishes between biological objects and non-biological objects. The main goal of this object classifier is to ignore the turbine blades while detecting biological object flying withing the rotor swept area of the turbine. Non-biological objects have a probability of 0 and biological objects have a probability of 1. Multi-classifier labeled Multiclass_BatFinder_Smart_Video_BioFilter.h5 distinguishes between bats, birds, insects and non-biological.

Yarbrough, John↗

Open Power System Datasets and Open Simulation Engines: A Survey Toward Machine Learning Applications

A major factor behind the success of machine learning (ML) models in multiple domains is the availability and accessibility of large, labeled, and well-organized datasets for training and benchmarking. In comparison, power grid datasets face three major challenges: (i) real-world data is often restricted by regulatory constraints, privacy reasons, or security concerns, making it difficult to obtain and work with; (ii) synthetic datasets, which are created to address these limitations, often have incomplete information and are released using specialized tools, making them inaccessible to the broader community; and, (iii) input-output datasets are difficult to generate through simulation for non-experts because open-source simulators are not known outside the power system community. This survey addresses these challenges by serving as an entry point to publicly available datasets and simulators for researchers venturing in this area. We review the current landscape of open-source power network data, machine models, consumer demand profiles, renewable generation data, and inverter models. We also examine open-source power system simulators, which are crucial for generating high-quality, high-fidelity power grid datasets. We aim to provide a foundation for overcoming data scarcity and advance towards a structured web of datasets and simulators to support the development of ML for power systems.

42 ENGINEERING↗

Application of IR imaging for free-surface velocity measurement in liquid-metal systems

Measuring free-surface, liquid-metal flow velocity is challenging to do in a reliable and accurate manner. This paper presents a non-invasive, easily-calibrated method of measuring the surface velocities of open-channel liquid-metal flows using an IR camera. Unlike other spatially-limited methods, this IR camera particle tracking technique provides full field-of-view data that can be used to better understand open-channel flows and determine surface boundary conditions. This method could be implemented and automated for a wide range of liquid-metal experiments, even if they operate at high-temperatures or within strong magnetic fields.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Application of IR imaging for free-surface velocity measurement in liquid-metal systems

Measuring free-surface, liquid-metal flow velocity is challenging to do in a reliable and accurate manner. This paper presents a non-invasive, easily-calibrated method of measuring the surface velocities of open-channel liquid-metal flows using an IR camera. Unlike other spatially-limited methods, this IR camera particle tracking technique provides full field-of-view data that can be used to better understand open-channel flows and determine surface boundary conditions. This method could be implemented and automated for a wide range of liquid-metal experiments, even if they operate at high-temperatures or within strong magnetic fields.

Free surface↗

DataXray

Lab experiments involving digital signal processing tend to capture heterogeneous data that is binned into individual files. The structure of the whole experiment tends to get lost in this process, generating a "mess" of data that is difficult to summarize, and even more difficult to analyze in a consistent way. DataXray is a set of python routines that wraps publicly available open-source codes to create a consistent workflow for data and experiments, involving imaging, spectral and hyperspectral data. Routines are provided for data translation, slicing, visualization, multivariate statistics, integral transforms, feature extraction and reporting in the form of publication-grade figures.

Maksymovych, Petro↗

Mobile Ion Concentration Measurement and Open-Access Band Diagram Simulation Platform for Halide Perovskite Solar Cells

We propose two approaches to compute the band diagram of highly efficient perovskite solar cells, both based on the migration of a single-mobile ion (halide vacancies). The first is a full analytical approach to quickly calculate the main features of the perovskite band diagram and easily extract the mobile vacancy concentration from experimental data. The second approach is an online-open-access platform that can be used by anyone to accurately simulate their own band diagram. We combine the first approach with current transient measurements to extract the mobile ion concentration for six different perovskite compositions - including perovskite solar cells with power conversion efficiencies exceeding 19%. For the devices measured herein, we obtain ion concentrations in the range 7 x 10 16 -5 x 10 17 cm -3 . We use the second approach to quantitatively discuss the implications of the mobile ion concentrations we measured in terms of device performance and stability.

14 SOLAR ENERGY↗

Parallel k-means Clustering of Geospatial Data Sets Using Manycore CPU Architectures

The increasing availability of high-resolution geospatiotemporal data sets from sources such as observatory networks, remote sensing platforms, and computational Earth system models has opened new possibilities for knowledge discovery and mining of weather, climate, ecological, and other geoscientific data sets fused from disparate sources. Many of the standard tools used on individual workstations are impractical for the analysis and synthesis of data sets of this size; however, new algorithmic approaches that can effectively utilize the complex memory hierarchies and the extremely high levels of parallelism available in state-of-the-art high-performance computing platforms can enable such analysis. Here, we describe pKluster, an open-source tool we have developed for accelerated k-means clustering of geospatial and geospatiotemporal data, and discuss algorithmic modifications and code optimizations we have made to enable it to effectively use parallel machines based on novel CPU architectures—such as the Intel “Knights Landing” Xeon Phi and Skylake Xeon processors—with many cores and hardware threads, and employing significant single instruction, multiple data (SIMD) parallelism. We outline some applications of the code in ecology and climate science contexts and present a detailed discussion of the performance of the code for one such application, LiDAR-derived vertical vegetation structure classification.

Mills, Richard T↗

The Trip Itinerary Optimization Platform: A Framework for Personalized Travel Information

The New Concepts Incubator team at the National Renewable Energy Laboratory (NREL) developed a three-stage online platform for travel diary collection, personal travel plan optimization and travel itinerary visualization. In the first stage, users provide a travel diary for the previous day through an interactive map and calendar interface and survey for travel attitudes and behaviors. One or more days later, users are invited via email to engage in a second stage where they view a personal mobility dashboard displaying recommended travel itineraries generated from a novel framework that optimizes travel outcomes over a sequence of interrelated trips. A week or more after viewing these recommended travel itineraries on the dashboard, users are emailed again to engage in a third stage where they complete a final survey about travel attitudes and behaviors. A usability study of the platform conducted online showed that, in general, users found the system valuable for informing their travel decisions. A total of 274 individuals were recruited through Amazon Mechanical Turk, an online survey platform, to participate in a transportation study using this platform. On average, the platform distilled 65 feasible travel plans per individual into two recommended itineraries, each optimal according to one or more outcomes and dependent on the fixed times and locations from the travel diary. For 45 percent of users, the trip recommendation algorithm returned only a single, typically automobile-centric, itinerary because there were no other viable alternative transportation modes available. Platform users generally agreed that the dashboard was enjoyable and easy to use, and that it would be a helpful tool in adopting new travel behaviors. Users generally agreed most that the time, cost and user preferred recommendations 'made sense' to them, and were most willing to implement these itineraries. Platform users typically expressed low willingness to try the carbon and calories optimized itineraries. Of the platform users who viewed the dashboard, 13 percent reported changing their travel behavior, most adopting the time, calories or carbon optimized itineraries. While the algorithm incorporates a wealth of travel data obtained from online APIs pertaining to a travelers route such as historic traffic condition data, public transit time-tables, and bike path routes, open-ended responses from users expressed an interest in the integration of even more fine-grained traffic data and the ability to dynamically model the effect of changes in travel times. Users also commonly expressed concerns over the safety of walking and biking recommendations. Responses indicate that more information about the amenities available to cyclists and pedestrians (sidewalks, shade from trees, access to food) and routes that avoid areas of perceived elevated danger would reduce barriers to implementing these recommendations. More accurate representations of personal vehicle trips (based on vehicle make and model, implications of parking) and the identification of routes that optimize caloric intensity (seeking out elevation changes or longer walks to public transit) are promising avenues for future research.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Development of a New Analysis Tool for Evaluating and Correcting for Weather Conditions that Constrain Radiation Portal Monitor Performance

Researchers at Oak Ridge National Laboratory (ORNL) developed the Adaptable, Multiplatform, Real-Time Analysis Package (AMRAP) for the continuous measurement of environmental radionuclide decay. AMRAP is a completely open source visualization and analysis package capable of combining a variety of data streams into an array of real-time plots. Once acquired, data streams are analyzed to store static images and extract data based on previously defined thresholds. AMRAP is currently used at ORNL to combine data streams from an Ortec Detective high-purity germanium (HPGe) detector, a TSA Systems radiation portal monitor (RPM), and an Orion weather station. The combined data are used to study the rain-induced increase in RPM background radiation levels. RPMs experience an increase in background radiation during precipitation due to the deposition of atmospheric radionuclides on the ground. Using AMRAP results in a real-time analysis workstation specifically dedicated to the study of RPM background radiation levels. By means of an editable library of common inputs, AMRAP is adaptable to remote monitoring applications that would benefit from the real-time visualization and analysis of radiation measurements. To study rain-induced increases in background radiation levels observed in radiation portal monitors (RPMs), researchers at Oak Ridge National Laboratory (ORNL) developed a software package that allows data with different formats to be analyzed and plotted in near real time. The Adaptable, Multiplatform, Real-Time Analysis Package (AMRAP) was developed to operate in the background and capture plots of important data based on previously defined thresholds. After executing AMRAP, segments of a data stream can be captured without additional post-processing. AMRAP can also display previously recorded data to facilitate a detailed offline analysis. Without access to these capabilities in a single software package, analyzing multiple continuously recorded data streams with different formats is impractical. Commercially available acquisition software packages record and analyze radiation measurements but are not designed to perform real-time analysis in conjunction with data from other vendors. The lack of collaboration between vendors is problematic when research requires different data streams to be correlated in time and immediately analyzed. AMRAP was specifically developed to provide a solution to this problem. AMRAP is a completely open source visualization and analysis package capable of plotting and analyzing data from different vendors in near real time.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Semi-supervised graph neural networks for pileup noise removal

Abstract The high instantaneous luminosity of the CERN Large Hadron Collider leads to multiple proton–proton interactions in the same or nearby bunch crossings (pileup). Advanced pileup mitigation algorithms are designed to remove this noise from pileup particles and improve the performance of crucial physics observables. This study implements a semi-supervised graph neural network for particle-level pileup noise removal, by identifying individual particles produced from pileup. The graph neural network is firstly trained on charged particles with known labels, which can be obtained from detector measurements on data or simulation, and then inferred on neutral particles for which such labels are missing. This semi-supervised approach does not depend on the neutral particle pileup label information from simulation, and thus allows us to perform training directly on experimental data. The performance of this approach is found to be consistently better than widely-used domain algorithms and comparable to the fully-supervised training using simulation truth information. The study serves as the first attempt at applying semi-supervised learning techniques to pileup mitigation, and opens up a new direction of fully data-driven machine learning pileup mitigation studies.

43 PARTICLE ACCELERATORS↗

RCSB protein data Bank: Next‐generation advanced search for exploration of experimental structures and computed structure models

Abstract The Protein Data Bank (PDB), established in 1971, is the primary global, open‐access archive for experimentally determined 3D macromolecular structures (proteins, RNA, DNA). The research‐focused RCSB.org web‐portal provides access to these data alongside more than one million machine‐learning‐predicted structure models, greatly expanding the available structural landscape. Rapid growth of both experimental and computational structures has increased the need for powerful yet accessible search tools that serve a broad and diverse scientific community. Herein, we describe a redesigned RCSB Protein Data Bank RCSB.org Advanced Search capability that supports intuitive discovery of 3D structures through a unified interface. This interface integrates annotation‐, sequence‐, and 3D structure‐based searches, embeds an interactive 3D viewer, and incorporates curated biological knowledge, such as catalytic site definitions from Mechanism and Catalytic Site Atlas and ligand‐guided structural motifs, for constructing geometry‐driven queries. A new Chemical Search tool allows definition of chemical queries via an integrated drawing tool or standard identifiers, seamlessly combining them with annotation filters. By allowing query definition directly within spatial and chemical contexts, these search interfaces reduce the need for detailed knowledge of residue numbering, chain identifiers, or external cheminformatics software. This capability enables efficient exploration of structures, chemical diversity, and structure–function relationships across all life domains. The redesigned interfaces can be accessed directly at rcsb.org/search/advanced for Advanced Search and rcsb.org/search/chemical for Chemical Search.

Rose, Yana [Research Collaboratory for Structural ↗

Estimation of deformation and stiffness of fractures close to tunnels using data from single-hole hydraulic testing and grouting

Sealing of tunnels in fractured rocks is commonly performed by pre- or post-excavation grouting. The grouting boreholes are frequently drilled close to the tunnel wall, an area where rock stresses can be low and fractures can more easily open up during grout pressurization. In this paper we suggest that data from hydraulic testing and grouting can be used to identify grout-induced fracture opening, to estimate fracture stiffness of such fractures, and to evaluate its impact on the grout performance. A conceptual model and a method are presented for estimating fracture stiffness. The method is demonstrated using grouting data from four pre-excavation grouting boreholes at a shallow tunnel (50 m) in Nygard, Sweden, and two post-excavation grouting boreholes at a deep tunnel (450 m) in Aespoe HRL, Sweden. The estimated stiffness of intersecting fractures for the boreholes at the shallow Nygard tunnel are low (2-5 GPa/m) and in agreement with literature data from field experiments at other fractured rock sites. Higher stiffness was obtained for the deeper tunnel boreholes at Aespoe which is reasonable considering that generally higher rock stresses are expected at greater depths. Our method of identifying and evaluating the properties and impact of deforming fractures might be most applicable when grouting takes place in boreholes adjacent to the tunnel wall, where local stresses might be low and where deforming (opening) fractures may take most of the grout.

54 ENVIRONMENTAL SCIENCES↗

1000 Soils Pilot Dataset, version 8, May 2025

This record hosts data generated by the 1000 Soils Pilot. Data will be updated as more become available. Please see the most recent data upload for current data. A beta visualization tool is available for some data types at https://shinyproxy.emsl.pnnl.gov/app/1000soils. Please submit any suggestions or comments through the 'contact' tab. We are actively working to improve visualizations and value all feedback. Data completed include: Geochemistry, texture, respiration, and enzyme activities FTICR-MS organic matter chemistry Microbial biomass C and N TOC/TDN of water-extractable OM X-ray computed tomography (derived metrics available here, raw data available upon request) Metagenomes; a variety of data formats are available upon request Soil hydraulic properties Data in progress: LC-MS/MS in development, timeline TBD, inquire for status 1000S_processed_BGC_summary.csv contains all available biogeochemical data; microbial biomass C and N; and TOC/TDN of water-extractable OM; and 1000S_Tomography.xslx contains a summary of data generated via X-ray computed tomography. icr_v2_corems2.csv contains FTICR-MS data processed by CoreMS version 2. These data are merged by formula across instrument runs to enable cross-sample comparisons. Technical replicates are merged by retaining peaks present in 2 out of 3 replicates. 1000Soils_Metadata_Site_Mastersheet_v1.csv contains site information. Soil Hydraulics_corrected_02042025.xlsx contains soil hydraulics information. Readme File_v4.xlsx is the readme file. Please contact the MONet project (monet.emsl@pnnl.gov) or Emily Graham (emily.graham@pnnl.gov) with questions. The following file and all raw data are available upon request: icr_by_mass_for_single_sample_analysis_only.csv contains FTICR-MS data processed by CoreMS and is intended for usage in the calculation of biochemical transformations within samples only. These data are not acceptable for cross-sample comparison of masses because they are from multiple instrument runs. For more information, please see: https://www.emsl.pnnl.gov/monet and https://sc-data.emsl.pnnl.gov/monet Acknowledgment: Soil data were provided by the Molecular Observation Network (MONet) at the Environmental Molecular Sciences Laboratory (https://ror.org/04rc0xn13), a DOE Office of Science user facility sponsored by the Biological and Environmental Research program under Contract No. DE-AC05-76RL01830. The work (proposal: 10.46936/10.25585/60008970) conducted by the U.S. Department of Energy, Joint Genome Institute (https://ror.org/04xm1d337), a DOE Office of Science user facility, is supported by the Office of Science of the U.S. Department of Energy operated under Contract No. DE-AC02-05CH11231. The Molecular Observation Network (MONet) database is an open, FAIR, and publicly available compilation of the molecular and microstructural properties of soil. Data in the MONet open science database can be found at https://sc-data.emsl.pnnl.gov/.

biogeochemistry↗

Initial Process Planning of a Hybrid Multi-Tasking Platform

Abstract Applications of hybrid technology are expanding from refurbishment and repair to low quantity, specialty part production, which are staple characteristics in medical implant, energy, and aerospace industry sectors, among others. This expansion has led to the development of the Mazak VC-500A/5X AM HWD, a wire fed laser cladding unit equipped with a standard 5 axis CNC. This unit is capable of building near net geometry of complex medium to large parts within a profitable timeframe, due to its comparatively high rate of deposition to that of a powder fed hybrid system. In this study, deposition and machining capabilities of the VC-500A/5X AM HWD are assessed through the production of three different test geometries by different process plans. Production of these test geometries is supported by an open loop sensor package primarily for monitoring machine health, data collection, and machine operator aid. The viability of extended deposition followed by machining is evaluated against a more cyclical strategy of reoccurring deposition and machining operations. Lastly, common defects in as-built geometries are evaluated and addressed through revisions to original process plans and toolpaths, indicating the need for continued innovation in hybrid manufacturing specific CAM/CAD software, as well as closed loop machine monitoring and quality control.

DeWitte, Lisa N.↗

EXSAN: An Interactive Version of the Nuclear Cross Section Data Handbook - 25687

Neutron cross section measurements and data files have advanced significantly since 1989 when Los Alamos published 'A Nuclear Cross Section Data Handbook', a detailed compendium of point-wise cross section plots and pie charts of relative contributions of individual reactions to the total cross section for 129 isotopes. Other compendiums with similar data and analysis tools have also been published. The intent of this work is to develop a modern, open-source application for interactive exploration and analysis of Evaluated Nuclear Data File (ENDF) libraries that also allows users to create their own 'Nuclear Cross Section Data Handbooks'. EXSAN is an easy-to-use graphical user interface application for exploring ENDF photon and neutron cross sections developed in Python. In addition to interactive plotting, EXSAN includes methods for computing rank-order lists of cross section for any energy and calculating composite cross sections for isotopic and elemental compositions and additional batch automation features. (authors)

61 RADIATION PROTECTION AND DOSIMETRY↗

CROCUS High-Frequency Measurements of CO₂, H₂O, Wind, and Temperature at University of Illinois Chicago

As of April 9, 2026: this dataset is currently being versioned to include data up to March 31, 2026. Once the versioning process is complete, new data files will be available for access. The dataset metadata will also be updated to reflect the data availability of the new data being versioned. Raw atmospheric measurements collected at the University of Illinois Chicago (UIC) as part of the Community Research on Climate and Urban Science (CROCUS) project. The data includes high-frequency measurements of carbon dioxide (CO₂) concentration, water vapor (H₂O) concentration, wind speed (U, V, W components), temperature, and atmospheric pressure. These raw data are recorded by the LI-7500DS Open Path CO₂/H₂O Analyzer and a sonic anemometer at a 10 Hz acquisition frequency, providing the necessary inputs for calculating fluxes of CO₂, H₂O, heat, and momentum. In addition to gas concentration measurements, the dataset includes diagnostic information from the instruments, including absorptance, sample and reference signals, and diagnostic values. The data were collected to study urban atmospheric conditions and contribute to flux calculations for urban climate research. These measurements form the basis for calculating 30-minute average fluxes of key atmospheric variables using the eddy covariance method. This dataset provides critical raw input data for researchers interested in atmospheric fluxes, urban air quality, and the interaction between the urban environment and atmospheric processes. The data is part of the U.S. Department of Energy’s Biological and Environmental Research (BER) program, under the CROCUS Urban Integrated Field Laboratory (UIFL) project.

54 ENVIRONMENTAL SCIENCES↗

Synthesis of N-Guanidinium-Chitosan/Silica Hybrid Composites: Efficient Adsorbents for Anionic Pollutants

A new chitosan derivative, N-guanidinium chitosan acetate, has been synthesized by direct guanylation of chitosan by cyanamide in presence of scandium(III) triflate under mild acidic condition. Starting from this material, N-guanidinium chitosan/silica microhybrids were prepared via a sol gel method using 3-glycidoxypropyl trimethoxysilane as silica precursor. Both N-guanidinium chitosan and the N-guanidinium chitosan/silica hybrid were characterized by a range of analytical techniques such as {sup 29}Si/{sup 13}C solid state NMR, FT-IR, scanning electron microscopy, thermogravimetry and elemental analysis. The characterization of the chitosan/silica hybrid indicated that this material is a highly hydrophilic nanocomposite material containing an organic core and a highly condensed silica shell. The N-guanidinium chitosan/silica microhybrids display excellent adsorption properties for anionic dyes such as methyl orange (MO) with very high capacities up to 917 mg/g. The fixation of MO as anionic dye was investigated in detail as a function of contact time, pH and the MO concentration. The adsorption kinetics of MO on N-guanidinium chitosan/silica microhybrids was more accurately described by pseudo second-order model. Langmuir isotherm model exhibited a better fit with adsorption data than Freundlich isotherm model. This work opens new possibilities for using N-guanidinium chitosan as a reusable adsorbent for water purification. Graphical Abstract: .

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Evaluating grid stress and reliability in future electricity grids across a range of demand, generation mix, and weather trends

The reliability of power grids in the future will depend on how system planners account for the integration of new technologies, extreme weather events, and uncertainties in demand growth from increased electrification and data centers. This study introduces an open-source, multisectoral, multiscale modeling framework that projects grid stress and reliability trends between 2020 and 2055 in the Western Interconnection of the United States. The framework integrates global to national energy-water-land dynamics with power plant siting and hourly grid operations modeling. We analyze future wholesale electricity price shocks and unserved energy events across eight scenarios spanning a range of population growth and economic change, generation mixes, and weather conditions. Our results show future grids with high percentage of non-renewable generation and strong economic growth are characterized by higher reliability and lower wholesale electricity prices than lower growth scenarios because of larger reliance on dispatchable generators and lower fossil fuel extraction costs. Scenarios with high percentage of renewable resources have lower median but more volatile wholesale electricity prices as well as more frequent and severe unserved energy events compared to scenarios relying more on dispatchable generators. These events occur because higher proportion of solar and wind energy causes net demand curves to deepen during midday (duck curves get progressively severe), exacerbating the challenge of meeting demand during summer evening peaks. This study suggests that robust and co-optimized transmission and energy storage planning could help maintain low wholesale electricity prices and high reliability levels in future electricity grids across uncertainties in generation mixes.

Electric grid reliability↗