Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data systems standards”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

Datum: A Scientific Metadata Catalog

The data catalog market is currently flooded with a myriad of different products, but none serve the scientific community well. There are cloud-native tools like Databricks, Snowflake,to on-premise solutions like Collibra and Datahub. The common failing of all these tools however, is their inability to serve the scientific data community directly. Most catalogs are targeted towards financial, health, or user data - not sensor or scientific domain data. They also prioritize integrations that often don’t exist or are just starting to be used in the scientific realm - all while ignoring common scientific tools and file types. Datum is a catalog which targets the scientific data directly, including the tools and networks in which those tools are used. We work with the producers and consumers of the data where they are, targeting cloud and on-premise with a focus on classified networks. Datum is an Erlang/Elixir application. Technical Features Note: The features listed below are still under development and may change, slightly, upon final delivery of the product. File Formats - Datum has the ability to read additional metadata and provides processing pipelines for the following file formats: Plain Text, PDF, LaTeX, HTML, Open Document Format (.odt), XML, CSV/TSV (and other standard delimiters), OpenDocument Database and Spreadsheets, Geo-Referenced TIFF, Common Data Format, HDF/HDF5, LabView TDMS, Excel, DeltaTables, Parquet, Apache Iceberg, Apache Hudi and many others. Metadata Collection - Scanners for the local and networked file systems and cloud storage providers. Network integration with common databases such as MSSQL and MySQL. User Plugin System - Users are able to provide either file processing, metadata extraction, or sampling plugins in the programming language of their choice. Authentication/Authorization -: OIDC integration, SCIM provisioning and EntraID integration out of the box. Full user and group management system with a “least privilege” operating mode. Governance - Customizable data governance platform; dictate and enforce required metadata, enforce data embargos, and enforce user agreements and NDAs before data access. Ability to create health checks on data, rejecting abandoned or poorly curated data and automatically removing it from the search index. Ability for users to submit corrections. Search - Semantic search is a first class citizen. No licenses to expensive, external software required. Integrated use of vectors and vector-based search allows for AI agent integration at all levels of operation. Metadata Model - Display and control data’s lineage and connections to other data and data directories. Data is modeled after a filesystem - an organization instantly recognizable and navigable by most any user. CLI and SDK - Ships with a Command Line Interface (CLI) tool and with a fully-featured Python SDK. This allows for rapid and programmatic use of Datum by every level of user. Minimal Infrastructure - Datum ships as a single executable file and can be run on any operating system and most CPU architectures. Datum has no reliance on external databases, search indexing tools, or other outside services - and it runs equally well on edge computing devices, cloud services, or in a clustered HPC environment.

darrington, john↗

GAT (Grid Analysis Toolkit) [SWR-25-41]

Grid Analysis Toolkit (GAT) is a unified Python API and plotting for power system PCM and CEM results (Sienna, PLEXOS, ReEDS™). It's a toolkit for wrangling data for Bulk Grid Dispatch and Transmission Analysis. GAT aims to provide simplified access to PCM and CEM results in a standard format while also allowing raw data access to underlying datasets specific to the model. This software can also be found on PyPI at For plotting, GAT defaults to standard National Lab of the Rockies (NLR) color schemes and standard styles while allowing customization.

Webb, Micah [National Laboratory of the Rockies (N↗

Advancing Sea Ice Predictability in E3SM with Machine Learning

Focal area(s): To improve predictions of sea ice in E3SM we propose to develop a hierarchy of data-driven models using observational and simulation data to investigate the most important Earth system drivers of sea ice variability and loss, develop surrogates that build on the reduced parameter space of important drivers, and, where appropriate, couple machine learning models with standard PDE models to capture important physical behavior at different scales. This work falls under Focal Area 2. Predictive modeling through the use of AI techniques.

54 ENVIRONMENTAL SCIENCES↗

Stochastic Distribution Control Theory-Its Potential Application in Risk Management in Financial Systems

Stochastic Distribution Control (SDC) theory [1], originated by the author in 1996, aims at developing modeling and control strategies for dynamic and non-Gaussian stochastic systems by controlling the shape of the probability density functions of some concerned variables and parameters in stochastic systems. It generalizes the capability of standard stochastic differential equations and can therefore be applied to generic non-Gaussian systems. Since it was established in 1996, it has found a wide spectrum of applications in non-Gaussian stochastic system control, data mining, filtering and optimization for uncertain systems. In this short opinion article, discussions will be made on potential applications of SDC theory to financial systems in terms of risk analysis and management.

97 MATHEMATICS AND COMPUTING↗

State-Specific Prevalence of Inactivity, Self-Rated Health Status, and Severe Joint Pain Among Adults With Arthritis — United States, 2019

Arthritis is associated with joint pain, disability, and physical inactivity, potentially resulting in poor quality of life. The Centers for Disease Control and Prevention analyzed 2019 Behavioral Risk Factor Surveillance System data to estimate state-specific arthritis prevalence and, among adults with arthritis, the prevalence of physical inactivity, fair/poor self-rated health status, and severe joint pain. Among adults with arthritis, age-standardized prevalences of physical inactivity, fair/poor health status, and severe joint pain were high in all states and highest in southeastern states. Increased promotion and use of evidence-based public health interventions for arthritis may improve health-promoting behaviors and health outcomes among adults with arthritis.

59 BASIC BIOLOGICAL SCIENCES↗

Demonstration and performance of an online data selection algorithm for liquid argon time projection chambers using MicroBooNE

The MicroBooNE detector is a liquid argon time projection chamber (LArTPC) that produces three-dimensional images of particle interactions using ionization charge collected by anode wire plane arrays and scintillation light collected by a light detection system. In addition to testing long-standing experimental neutrino anomalies and performing measurements of neutrino interactions with argon nuclei using the Fermilab Booster Neutrino Beam, MicroBooNE aims to develop methodologies for rare beyond the Standard Model and off-beam physics searches. Looking ahead to the upcoming Deep Underground Neutrino Experiment (DUNE), with MicroBooNE serving as a valuable testbed, achieving high sensitivity and livetime for off-beam physics while satisfying data processing and storage constraints will require data-driven, intelligent, and online or real-time data selection techniques. These techniques are essential for reducing data rates and preserving rare signals with high accuracy. In this paper, we describe a fast data selection algorithm suitable for online execution to identify electrons from stopping cosmic ray muons in the MicroBooNE detector utilizing ionization charge information, and present its performance. This represents the first demonstration of online data selection in a LArTPC using real data and charge information exclusively and provides an important proof-of-principle for applying such techniques to other LArTPC experiments such as the Short-Baseline Near Detector and DUNE.

Abratenko, P. [Tufts U. (main)]↗

Visible to near-infrared spectral reflectance along the NGEE-Arctic tram transect, Utqiagvik (Barrow), Alaska, 2015-2018

Canopy spectral reflectance collected measured in 2015-2018 along the NGEE-Arctic tram located on the Barrow Environmental Observatory (BEO), Barrow, Alaska. Measurements were made using a PP-Systems UniSpec-DC spectrometer mounted on an automatically operated instrument cart. Spectra were collected at 137 stop points at 0.5 m intervals along the tram transect. Transect runs were collected daily, or multiple times per day, from April or May through to August or September each year. Downwelling radiance was measured using a 2 meter fiber optic cable connected to a cosine diffuser. Upwelling (i.e. reflected) radiance was measured using a 2 meter cable connected to a 12 degree field-of-view (FOV) lens. Canopy reflectance was calculated using the ratio of upwelling to downwelling radiance measured over a 99.99% reflectance Spectralon standard measured at the start of each measurement set. Unprocessed spectral data are presented in .spu files. Metadata are provided in csv files, and the instrument manual (pdf). The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a 15-year research effort (2012-2027) to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Agilent AgileBioFoundry CRADA (Final Report)

The mission of this CRADA with Agilent was to couple powerful MS platforms (QQQ, IM-QTOF-MS) with Agilent’s novel Ultra-High-Performance Liquid Chromatography (UHPLC) fast metabolomic workflows and perform ABF Machine Learning (ML) to generated datasets. Agilent transferred UHPLC methods to PNNL and LBNL and methods were implemented and demonstrated in both labs, achieving total acquisition times of < 10 min. Metabolites analyzed using Agilent’s shared methods included metabolites from central carbon metabolism, common across hosts, and metabolites unique to engineered strains. Standards were acquired in an UHPLC-Drift Tube Ion Mobility Mass Spectrometer (DTIMS) system for the first time within the context of ABF and methods were optimized based on Agilent’s protocols. Samples from ABF hosts Pseudomonas putida, Aspergillus pseudoterreus, Aspergillus niger and Rhodosporidium toruloides were analyzed using the UHPLC-DTIMS platform for a total of 276 runs. A data analysis workflow compatible with the Experimental Data Depot (EDD) and completely shareable was developed for the acquired UHPLC-DTIMS data. Samples were analyzed using a Data Independent Acquisition Approach (DIA), which for most of the standards provided more transitions therefore increasing detection confidence. Using the data acquired by PNNL, LBNL, and Agilent’s specifications from previous ML projects, SNL applied an ensemble ML strategy to pick the best performing model for automated LC-method selection. Finally, with the contribution of the participant labs and Agilent, SNL developed an Automated Method Selection (AMS) software tool to predict the best liquid chromatography method for analysis of any new molecules of interest. Samples with novel pathways and new metabolite targets of interest are generated at a high pace in the ABF. Therefore, our accomplishment in this CRADA improved the efficiency and accuracy of strain testing by developing and implementing fast analytical methods, robust processing tools, and software for predicting the best methods for UHPLC analysis.

97 MATHEMATICS AND COMPUTING↗

Development and implementation of high-throughput proteomic and metabolomics assays by using advanced chromatographic and mass spectrometric systems (CRADA Final Report)

The mission of this CRADA with Agilent was to couple powerful MS platforms (QQQ, IM-QTOFMS) with Agilent’s novel Ultra-High-Performance Liquid Chromatography (UHPLC) fast metabolomic workflows and perform ABF Machine Learning (ML) to generated datasets. Agilent transferred UHPLC methods to PNNL and LBNL and methods were implemented and demonstrated in both labs, achieving total acquisition times of < 10 min. Metabolites analyzed using Agilent’s shared methods included metabolites from central carbon metabolism, common across hosts, and metabolites unique to engineered strains. Standards were acquired in an UHPLC-Drift Tube Ion Mobility Mass Spectrometer (DTIMS) system for the first time within the context of ABF and methods were optimized based on Agilent’s protocols. Samples from ABF hosts Pseudomonas putida, Aspergillus pseudoterreus, Aspergillus niger and Rhodosporidium toruloides were analyzed using the UHPLC-DTIMS platform for a total of 276 runs. A data analysis workflow compatible with the Experimental Data Depot (EDD) and completely shareable was developed for the acquired UHPLC-DTIMS data. Samples were analyzed using a Data Independent Acquisition Approach (DIA), which for most of the standards provided more transitions therefore increasing detection confidence. Using the data acquired by PNNL, LBNL, and Agilent’s specifications from previous ML projects, SNL applied an ensemble ML strategy to pick the best performing model for automated LC-method selection. Finally, with the contribution of the participant labs and Agilent, SNL developed an Automated Method Selection (AMS) software tool to predict the best liquid chromatography method for analysis of any new molecules of interest. Samples with novel pathways and new metabolite targets of interest are generated at a high pace in the ABF. Overall, the project advanced rapid metabolomics by combining liquid chromatography, ion mobility spectrometry, and data-independent mass spectrometry with machine learning. This multidimensional approach uses retention time, collision cross-section, precursor mass, and fragment-ion information to distinguish chemically similar metabolites that can be difficult to resolve using conventional liquid- or gas-chromatography methods. The resulting workflow also provided automated metabolite-identification error estimates, addressing a recognized need for statistical confidence measures in metabolomics.

Petzold, Christopher [Lawrence Berkeley National L↗

A path to intelligent watersheds: coordinating the data to decision pipeline

Operations of multi-reservoir systems are challenged in-part by the interplay of complex physical processes functioning within the watershed. The employment of intelligent systems can be of aid by linking environmental sensing, information technology, data analytics, simulation and decision support to achieve a data-to-decision flow of information. A further challenge is that watershed resources are managed for multiple purposes requiring some level of coordination among numerous resource managers, asset operators and users. System intelligence in this context relies on shared community platforms (data portals, community models), and coordinated communication between decision makers. Opportunities to enrich watershed intelligence has been the subject of a roadmapping exercise for the Department of Energy’s Water Power Technologies Office which has relied on broad stakeholder engagement. Initial phases of engagement involved personal interviews and a series of virtual group meetings, which focused on identifying opportunities to improve the intelligence of the physical infrastructure within our watersheds—examples of feedback include improved sensing of snowpack and runoff, data standards for facilitated data sharing, and better forecasting tools. The latter phase of engagement involved the conduct of a case study in the Upper Colorado River basin where key stakeholders were interviewed to map how their decisions are informed by intelligence from other basin stakeholders. Our presentation will highlight the interdisciplinary flow of information in complex watershed systems and identify physical and institutional opportunities toward the strategic operation of water infrastructure.

Colorado River↗

Qualification of ANSI/HPS N13.1-2011 Mixing Criteria by Computational Fluid Dynamics Modeling for the 3430 Building Fan Addition and Increased Ventilation Capacity

Additional ventilation capacity has been designed for the 3430 Building filtered exhaust stack system. The updated system will increase the number of fans from two to three and include new ductwork with a larger diameter to integrate the new fan into the existing stack. Stack operations will involve running various fan combinations at any given time. The air monitoring system of the existing two-fan stack previously was found to comply with the American National Standards Institute/Health Physics Society (ANSI/HPS) N13.1-1999 standard. Full-scale, three-dimensional computational fluid dynamics (CFD) modeling was used to evaluate the modified three-fan system for compliance with the ANSI/HPS N13.1-2011 standard, which essentially is equivalent to the ANSI/HPS N13.1-1999 standard. The four mixing criteria evaluated are 1) flow angle, 2) velocity, 3) gas tracer, and 4) particle tracer. Benchmarking of the CFD modeling methodology showed good agreement with previous testing used to qualify the stack, and modeling of the existing two-fan system showed good agreement with test data collected from the 3430 Building stack. Modeling was performed to develop a suitable three-fan design. Initial modeling of the three-fan design and basic ductwork showed that flow angles and velocity uniformity were acceptable; however, the gas tracer and particle tracer mixing results were not acceptable. To meet ANSI/HPS N13.1-2011 criteria, an air blender was added to the stack design.

42 ENGINEERING↗

Risk Analysis for Remote Operation of Microreactors

Microreactors are a subset of advanced nuclear reactors that can be factory fabricated, transportable, and self-regulating. They have the potential to be used in microgrids, rural and remote areas, or emergency response applications, replacing fossil fuel sources like diesel generators and enabling sustainable energy generation. In order to make microreactor operation cost-effective, it is likely that remote communications will be needed to reduce the number of personnel required to be on site. While remote operation of energy generation and other industrial control systems is common in other industries, it is not yet adopted in the nuclear community and has many perceived and actual risks. In this paper, the severity of the risks introduced by remote operations for microreactors are explored. The primary changes in the operations involve the addition of a remote communications network and a certification system for data and controls. These changes lend themselves to considerations of cyber risks, whether unintentional or adversarial, but the assessment considers not just cyber risks introduced, but also how physical and human factors-based risks will impact the remote operations system and change the overall risk profile. This initial assessment indicates that there are standard cyber and mitigation measures that can be put in place so the risk of doing remote operations does not dramatically increase compared to local operations. This evaluation is a critical step in the process of evaluating if remote operations of microreactors is a suitable solution to meet future sustainable grid needs

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Harmonized Automatic Relay Mitigation of Nefarious Intentional Events (HARMONIE) - Special Protection Scheme (SPS)

The harmonized automatic relay mitigation of nefarious intentional events (HARMONIE) special protection scheme (SPS) was developed to provide adaptive, cyber-physical response to unpredictable disturbances in the electric grid. The HARMONIE-SPS methodology includes a machine learning classification framework that analyzes real time cyber-physical data and determines if the system is in normal conditions, cyber disturbance, physical disturbance, or cyber-physical disturbance. This classification then informs response, if needed and/or suitable, and included cyber-physical corrective actions. Beyond standard power system mitigations, a few novel approaches were developed that included a consensus algorithm-based relay voting scheme, an automated power system triggering condition and corrective action pairing algorithm, and a cyber traffic routing optimization algorithm. Both the classification and response techniques were tested within a newly integrated emulation environment composed of a real-time digital simulator (RTDS) and SCEPTRE™. This report details the HARMONIE-SPS methodology, highlighting both the classification and response techniques, and the subsequent testing results from the emulation environment.

24 POWER TRANSMISSION AND DISTRIBUTION↗

HTGR Validation: NEUP Survey and Database - Data Reporting Standard for HTGR Thermal-Fluid Experiments

Since 2009, the U.S. Department of Energy (DOE) Office of Nuclear Energy's Nuclear Energy University Program (NEUP) has been at the forefront of nuclear research, specifically concentrating on advancing high-temperature gas-cooled reactor (HTGR) technologies. By Fiscal Year 2024, NEUP has authorized 36 projects dedicated to HTGR research, each contributing significantly to the enhancement of our understanding of this technology. The outcomes of these diverse projects have been disseminated through final NEUP reports, peer-reviewed journal articles, and presentations at academic conferences, forming a comprehensive tapestry of knowledge. Despite the substantial value of these findings, their dissemination has been fragmented, posing challenges for accessibility to researchers and policymakers and leading to underutilization of DOE investments. Recognizing this critical gap and its potential consequences for the future of nuclear research, the Advanced Reactor Technologies (ART) Gas-Cooled Reactor (GCR) program conducted an extensive survey of completed and ongoing HTGR NEUP projects. This survey enabled the compilation of crucial data, resulting in the development of a specialized public-access database tailored for computational fluid dynamics and system code validation, specifically designed for HTGR applications. However, the data collection process revealed a significant challenge in central data organization due to individual researchers from different institutes employing varying logics and preferences for recording and documenting experimental data. Consequently, an urgent need has been identified to establish a standardized reporting format for HTGR experimental projects. Addressing this issue is essential for enhancing collaboration, maximizing the impact of DOE investments, and ensuring the seamless advancement of HTGR technologies in nuclear research.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A systematic literature review on residential demand response with a focus on opportunities for low-income communities

Demand Response improves efficiency and grid stability, reducing peak load and total system costs. It can potentially contribute to other societal aspects, including mitigating climate change and improving air quality, health, stress levels, and comfort. This paper reviewed the literature on residential demand response programs in the United States, through the lens of the five energy justice principles, identifying and categorizing a set of 165 papers from 1960 to 2024. As a result, we observe significant progress in distributive justice, however, mostly focused on increasing participation rather than attending specific needs of historically marginalized communities. Concordantly, recognition and procedural justice dimensions are lagging, while cosmopolitan justice studies are scarce, underscoring a need to improve the measurement of impacts resulting from the implementation of demand response programs. Future research opportunities include the consolidation of standardized definitions and metrics, to better understand burdens and needs of diverse residential users. In terms of policy, collection and transparent access to standardized data is required as a condition to the design of flexible, customizable, transparent, and easy to navigate demand response programs. As a result, a better understanding of and engagement with customers has the potential to increase adoption rates, persistence in the program, and overall impacts for the system, households, and society.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Validation of galvanomagnetic and thermomagnetic transport measurements using Standard Reference Material 3451

In the “method of four coefficients,” electrical resistivity (ρ), Seebeck coefficient (S), Hall coefficient (RH), and Nernst coefficient (Q) of a material are measured and typically fit or modeled with theoretical expressions based on Boltzmann transport theory to glean experimental insights into features of electronic structure and/or charge carrier scattering mechanisms in materials. Although well-defined and readily available reference materials exist for validating measurements of ρ and S, none currently exists for R H or Q. We show that measurements of all four transport coefficients—ρ, S, R H , and Q—can be validated using a single reference sample, namely, the low-temperature Seebeck coefficient Standard Reference Material® (SRM) 3451 (composition Bi 2 Te 3+x ) available from the National Institute for Standards and Technology (NIST) without the need for inter-laboratory sample exchange. Here, R H and Q data for NIST SRM 3451 reported here for the temperature range 80–400 K complement the data already available for ρ and S and will therefore be of interest to researchers desiring to validate new or existing galvanomagnetic and thermomagnetic transport properties measurement systems.

47 OTHER INSTRUMENTATION↗

Development of Data Reporting Standards for High-Temperature Gas-cooled Reactor (HTGR) Nuclear Energy University Program (NEUP) Thermal-Fluid Experiments

Since 2009, the U.S. Department of Energy (DOE) Office of Nuclear Energy's Nuclear Energy University Program (NEUP) has been at the forefront of nuclear research, specifically concentrating on advancing high-temperature gas-cooled reactor (HTGR) technologies. By Fiscal Year 2023, NEUP has authorized 35 projects dedicated to HTGR research, each contributing significantly to the enhancement of our understanding of this technology. The outcomes of these diverse projects have been disseminated through final NEUP reports, peer-reviewed journal articles, and presentations at academic conferences, forming a comprehensive tapestry of knowledge. Despite the substantial value of these findings, their dissemination has been fragmented, posing challenges for accessibility to researchers and policymakers and leading to underutilization of DOE investments. Recognizing this critical gap and its potential consequences for the future of nuclear research, the Advanced Reactor Technologies (ART) Gas-Cooled Reactor (GCR) program conducted an extensive survey of completed and ongoing HTGR NEUP projects. This survey enabled the compilation of crucial data, resulting in the development of a specialized public-access database tailored for computational fluid dynamics and system code validation, specifically designed for HTGR applications. However, the data collection process revealed a significant challenge in central data organization due to individual researchers from different institutes employing varying logics and preferences for recording and documenting experimental data. Consequently, an urgent need has been identified to establish a standardized reporting format for HTGR experimental projects. Addressing this issue is essential for enhancing collaboration, maximizing the impact of DOE investments, and ensuring the seamless advancement of HTGR technologies in nuclear research.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Recent evolution of risk analyses in atomic bomb survivor studies: new methods and applications

Abstract Several decades ago a dramatic leap forward occurred in the development and application of statistical methods for modeling radiation risk at the Radiation Effects Research Foundation (RERF). Poisson regression analysis for grouped person-year cohort data and the linear excess relative risk model were introduced, and subsequently a devoted software system, Epicure® (https://www.hirosoft.com), was developed by researchers at RERF and at the U.S. National Cancer Institute. Numerous advancements in understanding radiation effects on humans were made possible with these methods, which are still the state-of-the-art for risk assessment at RERF and have remained part of the standard toolbox for radiation—and other environmental—epidemiological studies worldwide. Nevertheless, as our understanding of radiation risk has increased, so have the breadth and depth of questions that require answers based on emerging data that are not amenable to these conventional methods. This overview briefly recounts the conventional methods and then describes our recent diversification into the use or development of new statistical approaches to meet the challenges of burgeoning biological data and emerging mechanistic information. We briefly discuss the development and application of new methods, current and planned, that are part of the RERF Statistics Department’s role in supporting institution-wide research, especially in our collaborations involving the Life Span Study, Adult Health Study, and First-generation Offspring Clinical Study. Some approaches to modeling and assessing radiation risk with newer methods mentioned herein have already been published, while some are still in development or are only beginning at the proposal stage.

Oncology↗