Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “File Systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38
All sourcesNASA NTRSDOE OSTI
DOE OSTI2016

Streaming Analytics and Data Engineering

SADE is a software package for rapidly assembling analytic pipelines to manipulate data. The packages consists of the engine that manages the data and coordinates the movement of data between the tasks performing a function, a set of core libraries consisting of plugins that perform common tasks, and a framework to extend the system supporting the development of new plugins. Currently through configuration files, a pipeline can be defined that maps the routing of data through a series of plugins. Pipelines can be run in a batch mode or can process streaming data; they can be executed from the command line or run through a Windows background service. There currently exists over a hundred plugins, over fifty pipeline configurations, and the software is now being used by about a half-dozen projects.

Source record↗
DOE OSTI2021

SARS-CoV2 Protein-Ligand Simulation Dataset: Layer 1 (Simulation Initial Conditions and Parameters)

A set of 24 protein structures/complexes from the SARS CoV-2 proteome and inputs prepared for simulation using the CHARMM36m forcefield in PDB and gromacs formats. Each system contains a pdb and gromacs top and related input files necessary for running a temperature replica-exchange simulation. In addition, we also include: charmm PSF files (generated from the gromacs topology), a list of temperatures at which replica-exchange simulations were done (tempRamp), example gromacs run input mdp files, and initial minimized structures where available (minimized.pdb).

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Putting error bars on density functional theory dataset

This dataset contains submission files and raw output files from high-throughput DFT simulations to analyze the systemic errors in lattice constant, bulk moduli and formation energy predictions for a range of binary and ternary oxides using four exchange correlation functionals (LDA, PBE, PBEsol and vdW-DF-C09). This data was then used as the basis for employing materials informatics methods to predict the expected errors in the lattice constants of the studied compounds. Predicted errors were also used to better the DFT-predicted lattice parameters. Our results emphasize the link between the computed errors and the electron density and hybridization errors of a functional. In essence, these results provide “error bars” for choosing a functional for the creation of high-accuracy, high-throughput datasets as well as avenues for the development of XC functionals with enhanced performance, thereby enabling the accelerated discovery and design of new materials.

36 MATERIALS SCIENCE↗
DOE OSTI2024

TEAMER: Performance mapping of Re Vision's Persistance PTO

Contains datasets from experimental measurements that were used to validate Re Vision's Persistence PTO's efficiency and performance. These measurements were obtained using a dynamometer test bench setup. The data includes open-circuit voltage and loss measurements to validate machine characteristics, efficiency mapping tests to determine the generator's performance mapping, and efficiency mapping tests to determine the converter's efficiency over the feasible operating range. This data was collected between June 2023 and September 2023. The data was collected at the National Renewable Energy Laboratory's Flatirons Campus, Colorado, United States. The data was collected using NREL's 5-kW dynamometer test bench, equipped with a torque sensor and various voltage and current sensors fed to a dedicated data acquisition system. Units for the data are included in the data file headers for each data series. A text editor or spreadsheet software such as Excel is required to view the *.csv data. The data are also provided in *.mat files. To view data plots, a Matlab script with *.mat files are provided.

16 TIDAL AND WAVE POWER↗
DOE OSTI2025

CO2 and CH4 leaf-level fluxes and soil porewater concentrations from common vegetation patches in Louisiana’s coastal wetlands

This dataset contains leaf-level flux and soil porewater concentration measurements of carbon dioxide (CO2) and methane (CH4 ) in plots in the footprint of Ameriflux sites US-LA2 and US-LA3. Leaf fluxes in US-LA2 were measured on patches dominated by Sagittaria lancifolia and co-dominated by Sagittaria lancifolia and Typha latifolia. In US-LA3, fluxes were measured from distinct Juncus roemerianus and Spartina alterniflora patches. The porewater concentrations were collected across a vertical profile (~50 cm depth) at centric locations within 25 m2 plots where we measured the leaf fluxes. US-LA3 included an additional set of measurements in open water spots. We aimed to evaluate differences in leaf fluxes and porewater pools of CO2 and CH4 of representative ecohydrological patches across a salinity gradient. We also used this dataset to help develop ELM-Wet, a more realistic representation of wetland carbon biogeochemical processes within the U.S. Department of Energy’s Energy Exascale Earth System Model (E3SM) Land Model version 1 (ELM v.1). The files can be opened with regular text editors or spreadsheet programs. Version 2.0 (8/26/2025): This is the latest version of this dataset. The update includes additional samples of soil porewater CH4/CO2 concentrations from June-2021 to November-2022, as well as minor adjustments made to V1 samples via changing Henry's solubility to account for porewater salinity. Additionally leaf-level measurments of spectral indices, PSRI, NDVI, and PRI have been added to complement Leaf-level flux measurements. All V1 data sets have been integrated into V2 sheets, ensuring data from the previous version is contained with the additional samples and consistent with V2 metadata.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

ENDF/B-VIII.0 Augmented Covariance Data The first iteration [Slides]

Nuclear data are necessary for reliable modeling and simulation of the next generation of nuclear reactors. However, the variation in the ratio of the computed to experimental values (C/E) for certain types of nuclear systems is much less than predicted by evaluated nuclear data file (ENDF)/B covariances. Figure 1 provides an example of a set of metal-plutonium-fueled, fast-spectrum (PU-MET-FAST) integral experiments from the International Criticality Safety Benchmark Evaluation Project (ICSBEP) in the Oak Ridge National Laboratory (ORNL) VALID database. The variation in the C/E values, shown with one standard deviation error bars, is 100% covered by both the SCALE and ENDB/VIII.0 covariance data. This is due to the comparisons to integral data that are essential during the evaluation process. However, the ENDF evaluations represent uncertainties and correlations in differential data only; they do not reflect the impact of the comparison to integral data in the covariance evaluations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2019

ENDF/B-VIII.0 Augmented Covariance Data The first iteration [Slides]

Nuclear data are necessary for reliable modeling and simulation of the next generation of nuclear reactors. However, the variation in the ratio of the computed to experimental values (C/E) for certain types of nuclear systems is much less than predicted by evaluated nuclear data file (ENDF)/B covariances. Figure 1 provides an example of a set of metal-plutonium-fueled, fast-spectrum (PU-MET-FAST) integral experiments from the International Criticality Safety Benchmark Evaluation Project (ICSBEP) in the Oak Ridge National Laboratory (ORNL) VALID database. The variation in the C/E values, shown with one standard deviation error bars, is 100% covered by both the SCALE and ENDB/VIII.0 covariance data. This is due to the comparisons to integral data that are essential during the evaluation process. However, the ENDF evaluations represent uncertainties and correlations in differential data only; they do not reflect the impact of the comparison to integral data in the covariance evaluations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2018

Calibrated Radar Wind Profiler Precipitation Observations and Vertical Velocity Retrievals

A radar wind profiler (RWP) data set collected during the 2-year Department of Energy Atmospheric Radiation Measurement (ARM) Observations and Modeling of the Green Ocean Amazon (GoAmazon2014/5) campaign is used to estimate vertical velocity, designate bulk meteorological echo classification (e.g., convective, stratiform), and provide calibrated radar reflectivity factor Z measurements (calibrated against collocated ground disdrometer and raingauge observations from T3). Additional fields include surface precipitation from rain gauge and ARM InterpolatedSonde streams utilized in the echo classification methods. This dataset follows methods established in Giangrande et al. [2013] and Giangrande et al. [2016] for informing on convective vertical velocities, mass flux and area coverage in Amazon convective cells from ARM RWP systems. If RWP datastreams were unavailable on a given date, files still contain raingauge and InterpolatedSonde information.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

ENDF/B-VIII.0 Augmented Covariance Data: The first iteration

Nuclear data are necessary for reliable modeling and simulation of the next generation of nuclear reactors. However, the variation in the ratio of the computed to experimental values (C/E) for certain types of nuclear systems is much less than predicted by evaluated nuclear data file (ENDF)/B covariances. Figure 1 provides an example of a set of metal-plutonium-fueled, fast-spectrum (PU-MET-FAST) integral experiments from the International Criticality Safety Benchmark Evaluation Project (ICSBEP) in the Oak Ridge National Laboratory (ORNL) VALID database. The variation in the C/E values, shown with one standard deviation error bars, is 100% covered by both the SCALE and ENDB/VIII.0 covariance data. This is due to the comparisons to integral data that are essential during the evaluation process. However, the ENDF evaluations represent uncertainties and correlations in differential data only; they do not reflect the impact of the comparison to integral data in the covariance evaluations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2017

ArrayBridge: Interweaving declarative array processing with high-performance computing

Scientists are increasingly turning to datacenter-scale computers to produce and analyze massive arrays. Despite decades of database research that extols the virtues of declarative query processing, scientists still write, debug and parallelize imperative HPC kernels even for the most mundane queries. This impedance mismatch has been partly attributed to the cumbersome data loading process; in response, the database community has proposed in situ mechanisms to access data in scientific file formats. Scientists, however, desire more than a passive access method that reads arrays from files. This paper describes ArrayBridge, a bi-directional array view mechanism for scientific file formats, that aims to make declarative array manipulations interoperable with imperative file-centric analyses. Our prototype implementation of ArrayBridge uses HDF5 as the underlying array storage library and seamlessly integrates into the SciDB open-source array database system. In addition to fast querying over external array objects, ArrayBridge produces arrays in the HDF5 file format just as easily as it can read from it. ArrayBridge also supports time travel queries from imperative kernels through the unmodified HDF5 API, and automatically deduplicates between array versions for space efficiency. Our extensive performance evaluation in NERSC, a large-scale scientific computing facility, shows that ArrayBridge exhibits statistically indistinguishable performance and I/O scalability to the native SciDB storage engine.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Transportation and Systems Analysis Collaborations in Support of a Federal Consolidated Interim Storage Facility

The U.S. Department of Energy’s Integrated Waste Management (IWM) program under the Office of Nuclear Energy is planning for the future transportation, storage, and eventual disposal of spent nuclear fuel (SNF) and high-level radioactive waste (HLW) from nuclear power plant sites across the United States. To better enable informed decision-making regarding the back end of the nuclear fuel cycle, the IWM program has been sponsoring the development and application of system analysis tools capable of analyzing various options for managing SNF and HLW. With these tools, integrated waste management system (IWMS) architecture analyses are being conducted to support the future deployment of a comprehensive nuclear waste management system that considers all major back-end aspects of the nuclear fuel cycle (i.e., transportation, storage, and disposal). System analyses and assessments typically use these modeling and simulation tools to investigate implications of changes in various assumptions and parameters such as acceptance rates, receipt logic, facility capacities and capabilities, use of standardized canisters, start and stop dates of facilities, etc. The Next Generation System Analysis Model (NGSAM) is an agent-based simulation toolkit that is used for a system-level simulation and analysis focused on SNF management in the United States. An analyst using NGSAM has the ability to define several factors like the number of storage facilities, capacity at each facility, transportation schedules, shipment rates, and other conditions. NGSAM’s primary purpose is to provide a system analyst with capabilities to model the IWMS and gain insights into SNF and HLW management alternatives including the impact of system choices, associated cost estimates, and development of integrated yet flexible approaches. IWM is also developing the Stakeholder Tool for Assessing Radioactive Transportation (START). START is a web-based geospatial tool developed to provide visualization and initial evaluation of transportation options associated with future SNF and HLW shipment planning and operations. This includes characterizing safety, economic, and environmental conditions on and in proximity to shipment origins as well as along prospective transportation routes. Information from the START tool can be presented/shared as maps, graphics, geospatial files, and tabular form to enable easy data representation and export functionality. The system analysis, NGSAM, and START teams had been working closely for several years before formalizing this collaboration. START provides the SNF routing information for use in NGSAM. System analysts use the NGSAM tool to generate results (schedule, costs, infrastructure acquisitions, shipment rates, etc.). Subject-matter experts and system analysts work together to inform how NGSAM should model the waste management system. Specifically, this paper discusses the collaborations between the system analysis, NGSAM, and START teams and their accomplishments over the past year. Some examples of these efforts include calibrating and adding data to the START output files to meet NGSAM needs, gaining a better understanding of START data used in NGSAM, as well as how updates in START data could result in an improved NGSAM analysis. Detailed examples of various tasks that have been performed by the team will be discussed in the full paper. Continued efforts in this direction are expected in the coming years.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

TEAMER: Triton Systems Oscillating Water Column Modeling Data and Report

This dataset provides the output of six Wave Energy Converter Simulator (WEC-Sim) simulations and accompanying documentation for the modeling of Triton Systems' oscillating water column (OWC) system at tank scale (validated using available data for tuning the model, Tests 1-2) and deployment scale (for which no validation data is available, Tests 4-6). Included are the output data in a MATLAB file structure, a comprehensive report on the modeling and design of the Triton OWC system, and a link to the WEC-Sim GitHub page. This work was supported by funding from TEAMER RFTS 5 (Request for Technical Support).

16 TIDAL AND WAVE POWER↗
DOE OSTI2018

IAEA CIELO Evaluation of Neutron-induced Reactions on 235 U and 238 U Targets

Evaluations of nuclear reaction data for the major uranium isotopes 238 U and 235 U were performed within the scope of the CIELO Project on the initiative of the OECD/NEA Data Bank under Working Party on Evaluation Co-operation (WPEC) Subgroup 40 coordinated by the IAEA Nuclear Data Section. Both the mean values and covariances are evaluated from 10 -5 eV up to 30 MeV. The resonance parameters of 238 U and 235 U were re-evaluated with the addition of newly available data to the existing experimental database. The evaluations in the fast neutron range are based on nuclear model calculations with the code EMPIRE–3.2 Malta above the resonance range up to 30 MeV. 235 U(n,f), 238 U(n,f), and 238 U(n,γ) cross sections and 235 U(n th ,f) prompt fission neutron spectrum (PFNS) were evaluated within the Neutron Standards project and are representative of the experimental state-of-the-art measurements. The Standards cross sections were matched in model calculations as closely as possible to guarantee a good predictive power for cross sections of competing neutron scattering channels. 235 U(n,γ) cross section includes fluctuations observed in recent experiments. 235 U(n,f) PFNS for incident neutron energies from 500 keV to 20 MeV were measured at Los Alamos Chi-Nu facility and re-evaluated using all available experimental data. While respecting the measured differential data, several compensating errors in previous evaluations were identified and removed so that the performance in integral benchmarks was restored or improved. Covariance matrices for 235 U and 238 U cross sections, angular distributions, spectra and neutron multiplicities were evaluated using the GANDR system that combines experimental data with model uncertainties. Unrecognized systematic uncertainties were considered in the uncertainty quantification for fission and capture cross sections above the thermal range, and for neutron multiplicities. Evaluated files were extensively benchmarked to ensure good performance in reactor calculations and fusion-related systems. New comprehensive evaluations show excellent agreement with available differential data and integral performance better than current evaluated data libraries, and represent a step forward in a quest for better nuclear data for applications.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

I/O in Machine Learning Applications on HPC Systems: A 360-degree Survey

Growing interest in Artificial Intelligence (AI) has resulted in a surge in demand for faster methods of Machine Learning (ML) model training and inference. This demand for speed has prompted the use of high performance computing (HPC) systems that excel in managing distributed workloads. Because data is the main fuel for AI applications, the performance of the storage and I/O subsystem of HPC systems is critical. In the past, HPC applications accessed large portions of data written by simulations or experiments or ingested data for visualizations or analysis tasks. ML workloads perform small reads spread across a large number of random files. This shift of I/O access patterns poses several challenges to modern parallel storage systems. In this paper, we survey I/O in ML applications on HPC systems, and target literature within a 6-year time window from 2019 to 2024. We define the scope of the survey, provide an overview of the common phases of ML, review available profilers and benchmarks, examine the I/O patterns encountered during offline data preparation, training, and inference, and explore I/O optimizations utilized in modern ML frameworks and proposed in recent literature. Lastly, we seek to expose research gaps that could spawn further R&D.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

SecPop Version 4: Sector Population Land Fraction and Economic Estimation Program: Users? Guide Model Manual and Verification Report.

In 1973 the U.S. Environmental Protection Agency (EPA) developed SecPop to calculate population estimates to support a study on air quality. The Nuclear Regulatory Commission (NRC) adopted this program to support siting reviews for nuclear power plant construction and license applications. Currently SecPop is used to prepare site data input files for offsite consequence calculations with the MELCOR Accident Consequence Code System (MACCS). SecPop enables the use of site-specific population, land use, and economic data for a polar grid defined by the user. Updated versions of SecPop have been released to use U.S. decennial census population data. SECPOP90 was released in 1997 to use 1990 population and economic data. SECPOP2000 was released in 2003 to use 2000 population data and 1997 economic data. This report describes the current code version, SecPop version 4.3, which uses 2010 population data and both 2007 and 2012 economic data. It is also compatible with 2000 census and 2002 economic data. At the time of this writing, the current version of SecPop is 4.3.0, and that version is described herein. This report contains guidance for the installation and use of the code as well as a description of the theory, models, and algorithms involved. This report contains appendices which describe the development of the 2010 census file, 2007 county file, and 2012 county file. Finally, an appendix is included that describes the validation assessments performed.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2017

Sewer System Management Plan.

A Sewer System Management Plan (SSMP) is required by the State Water Resources Control Board (SWRCB) Order No. 2006-0003-DWQ Statewide General Waste Discharge Requirements (WDR) for Sanitary Sewer Systems (General Permit). DOE, National Nuclear Security Administration (NNSA), Sandia Field Office has filed a Notice of Intent to be covered under this General Permit. The General Permit requires a proactive approach to reduce the number and frequency of sanitary sewer overflows (SSOs) within the State. SSMPs must include provisions to provide proper and efficient management, operation, and maintenance of sanitary sewer systems and must contain a spill response plan.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2021

Vadose and Saturated Zone Flow and Transport Model Package Report for the Active Trenches of the Low-Level Burial Grounds, Hanford Site, Washington

This model package report (MPR) documents the development of the integrated vadose and saturated zone flow and transport model developed for the performance assessment of Trenches 31 and 34 in the low-level burial grounds (LLBGs). This modeling capability is intended for use in addressing the analysis requirements outlined in DOE O 435.1, Chg 1, Radioactive Waste Management1. The overall objective of the modeling effort is to provide a basis for making informed disposal decisions pertinent to Trenches 31 and 34. The purpose of the MPR is to document the development of the three-dimensional numerical vadose zone and saturated flow and transport model test case and evaluate its adequacy to support the LLBG performance assessment. The purpose is not to present results for DOE 435.1 decision making. The use of the model to perform base case and sensitivity analysis for the LLBG performance assessment, including inputs and results, is documented separately in subsequent environmental calculation files. This report discusses the development and translation of the conceptual model for flow and contaminant transport into the LLBG performance assessment three-dimensional numerical flow and transport model evaluated using the Subsurface Transport Over Multiple Phases (STOMP©) simulator. The development of representative geologic framework is described along with the implementation of waste release models used to represent contaminant release from waste disposed in the trenches. The report also provides the technical basis for specific model parameters and boundary conditions, along with description of modeling assumptions. This MPR includes certain calculations that are necessary to demonstrate the soundness of the model. Results provided by the model include vadose zone and saturated zone flow fields, and estimates of the possible future concentration in groundwater of technetium-99 and iodine-129 as example test cases. As an evaluation of the test cases, the model estimates of current vadose conditions are compared to available and analogous field and laboratory data, and compared to the results from the original performance assessment model (WHC-EP-0645, Performance Assessment for the Disposal of Low-Level Waste in the 200 West Area Burial Grounds 2 ). The features, events, and processes applicable to vadose zone and saturated zone flow and transport model are identified, and representative initial estimates for various parameters are documented. Note that the parameter estimates presented in this MPR are for illustration purposes, and may or may not reflect values selected for eventual performance assessment. Several key topical discussions (i.e., basis for recharge estimates, basis for vadose zone modeling, basis for saturated zone model development, and calibration) are included, which serve as the groundwork for confidence building for the groundwater pathway modeling and results. Numerical simulation results based on an example test case are included to illustrate the use of the combined saturated-unsaturated model in performance assessment calculations. Sensitivity and uncertainty results are not included in this MPR. Those results will be included in future environmental calculation files. The inclusion of the trapezoidal trench geometry and construction details in the finite difference grid introduces some gross simplifications regarding the trench and liner systems. The model test case presented in this MPR includes the assumption that the trench liner system does not affect flow through or around the trenches after the liner system is assumed to fail. This MPR also includes results of other test cases that involve alternate assumptions about how to incorporate the hydraulic effects of the trenches into the vadose zone of the model. These alternate cases do not attempt to account for the presence of the liner system after its assumed failure either. None of these cases is considered to be the base case at this time. Analysis and alternate cases that attempt to account for the presence of the liner system in greater detail, and its effect on flow through and around it, are to be documented in subsequent environmental calculation files. Depending on the results of those analyses and alternate cases, the eventual base case may involve more detailed inclusion of the effects of the liner system hydraulics.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2022

PDFDataExtractor: A Tool for Reading Scientific Text and Interpreting Metadata from the Typeset Literature in the Portable Document Format

The layout of portable document format (PDF) files is constant to any screen, and the metadata therein are latent, compared to mark-up languages such as HTML and XML. No semantic tags are usually provided, and a PDF file is not designed to be edited or its data interpreted by software. However, data held in PDF files need to be extracted in order to comply with opensource data requirements that are now government-regulated. In the chemical domain, related chemical and property data also need to be found, and their correlations need to be exploited to enable data science in areas such as data-driven materials discovery. Such relationships may be realized using text-mining software such as the “chemistry-aware” natural-language-processing tool, ChemDataExtractor; however, this tool has limited data-extraction capabilities from PDF files. This study presents the PDFDataExtractor tool, which can act as a plug-in to ChemDataExtractor. It outperforms other PDF-extraction tools for the chemical literature by coupling its functionalities to the chemical-named entityrecognition capabilities of ChemDataExtractor. The intrinsic PDF-reading abilities of ChemDataExtractor are much improved. The system features a template-based architecture. This enables semantic information to be extracted from the PDF files of scientific articles in order to reconstruct the logical structure of articles. While other existing PDF-extracting tools focus on quantity mining, this template-based system is more focused on quality mining on different layouts. PDFDataExtractor outputs information in JSON and plain text, including the metadata of a PDF file, such as paper title, authors, affiliation, email, abstract, keywords, journal, year, document object identifier (DOI), reference, and issue number. With a self-created evaluation article set, PDFDataExtractor achieved promising precision for all key assessed metadata areas of the document text.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗