Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “research data management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

SULI Project Report: Mu2e otsdaq Documentation and Analytics

This report outlines the history of the CLFV puzzle, gives an overview of the Mu2e Experiment, and details the results of the DOE (Department of Energy)-funded SULI (Science Undergraduate Laboratory Internship) research completed over the summer 2024 on site at Fermilab. The project focused on the otsdaq software responsible for data acquisition. The project included drafting updated documentation for new users, including new procedures relevant for the Alma- Linux 9 operating system update, and the UPS package managing system replacement with Spack (scientific software package manager). A new art module (ReadTriggerCounts) to track trigger rates was created, with compatibility to be displayed via a Grafana server. The author also assisted in calorimeter cable installation in the detector hall.

Saarinen, Talia↗
DOE OSTI2026

Unlocking the benefits of transparent and reusable science for climate-risk management

People around the world seek climate-risk information to guide their decisions. For instance, projections about future flood risk inform where households choose to live, how lenders manage credit risks, and which communities receive federal funding. Yet data limitations and fundamental validation challenges raise important concerns about the reliability of such projections. The principles of transparency and reusability help address these concerns by enabling scrutiny of assumptions and methods, development of foundational data and tools, and consistent application of evaluation standards. While there is ongoing debate about how much transparency commercial climate-risk services should provide, many expect non-commercial actors to lead the way on operationalizing transparency and reusability to fulfill their knowledge-building role in the climate-risk ecosystem. However, despite prominent success stories, we find a substantial gap between principles and practice: only four percent of the most-cited peer-reviewed climate-risk studies in recent years fully share their data and code despite this being a widely accepted minimum standard for transparency. We highlight low-cost measures that non-commercial researchers can take now to improve transparency and reusability. We also emphasize that transformative progress requires substantial investment, cross-sector collaboration, and careful consideration of tradeoffs, data rights, and multiple perspectives on equity. We hope this perspective accelerates both immediate actions and longer-term conversations to improve the ability of science to effectively support timely, evidence-based, and sound climate-risk management.

Open Science↗
DOE OSTI2021

Classified library celebrates two-year anniversary print your own commemorative history posters

Today is the National Security Research Center’s second anniversary. These two years, though, have been eight decades in the making, said NSRC Director Riz Ali. “We opened our doors in 2019, but the Center’s beginnings date back to World War II when J. Robert Oppenheimer created the Lab in Los Alamos to develop the first-ever nuclear weapons,” Ali said. “An important part of opening the Lab included standing up a technical reports library. Since then, we have amassed millions of holdings and today we are one of the top research institutions in the country.” What had long-been a repository of classified archival materials is today a dynamic, vibrant library that outsizes the collections of other similar research libraries around the country. Today, the NSRC houses the Laboratory’s classified nuclear weapons research, data and reports, as well as unclassified historical artifacts – the stories, photos, films and more from the people who have been a part of the Lab from the start.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2022

Big Data Analysis of Synchrophasor Data: Outcomes of Research Activities Supported by DOE FOA 1861

This report describes the key outcomes of research activities sponsored by the Department of Energy’s Funding Opportunity Announcement (FOA) number 1861 that was aimed at advancing the state-of-the-art in big data analytics applied to transmission-level synchrophasor measurements. The FOA resulted in eight research grants where the awardees developed machine learning and artificial intelligence tools and approaches. The commonalities in tools and approaches used by the awardees are explored, and insights gained from how the project outcomes might be operationalized are discussed. This report does not seek to comprehensively summarize all research supported by the FOA, rather it focuses on enabling the fast dissemination of major findings to the broader power systems community.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2025

Building partnerships for development of sustainable energy systems with atmospheric measurements

Atmospheric dynamics often play a critical role in the sustainability and reliability of diverse forms of energy production. This is especially true for the growing number of renewable energy deployments that harness aspects of the environment for power production. While the University of Memphis has a strong research background in energy systems, we have little experience working with the Earth and Environmental Systems Science Division (EESSD) and their associated User Facilities. Of particular interest to us is the Atmospheric Science Research and the Atmospheric Radiation Measurement (ARM) user facility to address surface-boundary layer interactions and physical phenomena. One of the major challenges for understanding and developing energy systems and management platforms is accurate modeling/forecasting of atmospheric conditions across disparate spatial and temporal scales. These conditions are often required to understand the lowest levels of the atmospheric boundary layer, but are also important to understand higher atmospheric conditions where aerosols affect cloud development. The objective of this work was to develop partnerships with national laboratories for collaboration on environmental science and its intersection with sustainable energy systems, as well as to leverage the ARM user facility data repositories to enhance our research capabilities in energy systems and their inter-dependence on environmental systems for future engagement with EESSD. Specifically, we accomplished these objectives by (1) developing collaborations with Oakridge National Laboratory ARM Data Science and Integration Group which resulted in student internships, (2) employed ARM data to develope modeling of the atmospheric boundary layer optical turbulence, and (3) optimally-sized large-scale renewable energy systems and their associated energy storage systems with ARM repository data.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2020

ExpoKids: An R-based tool for characterizing aggregate chemical exposure during childhood

Background: Aggregate exposure, the combined exposures to a single chemical from all pathways, is a critical children’s health issue. Objective: The primary objective is to develop a tool to illustrate potential differences in aggregate exposure at various childhood lifestages and the adult lifestage. Methods: We developed ExpoKids (an R-based tool) using oral exposure estimates across lifestages generated by US EPA’s Exposure Factors Interactive Resource for Scenarios Tool (ExpoFIRST). Results: ExpoKids is applied to illustrate aggregate oral exposure, for ten media, as average daily doses (ADD) and lifetime average daily doses (LADD) in five graphs organized across seven postnatal childhood lifestages and the adult lifestage. This data visualization tool conveys ExpoFIRST findings, from available exposure data, to highlight the relative contributions of media and lifestages to chemical exposure. To evaluate the effectiveness of ExpoKids, three chemical case examples (di[2-ethylhexyl] phthalate [DEHP], manganese, and endosulfan) were explored. Data available from the published literature and databases for each case example were used to explore research questions regarding media and lifestage contributions to aggregate exposure. Significance: These illustrative case examples demonstrate ExpoKids’ versatile application to explore a diverse set of children’s health risk assessment and management questions by visually depicting specific media and lifestage contributions to aggregate exposure.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Network science can improve the sustainable development of solar energy

Abstract The recent emergence of agrivoltaic and ecovoltaic approaches to ground-mounted photovoltaic (PV) energy provides a much-needed alternative to the environmentally disruptive practices employed in utility-scale solar development. Research on such land-sharing approaches has grown rapidly, with an emphasis on characterizing how PV arrays impact ecosystem processes and agricultural productivity. Although these studies have done well to quantify a variety of dual-use solar practices by employing site-specific sampling designs, this approach has limited our ability to synthesize results across sites, regions, and globally. We call for a network science approach for improved cross-site synthesis of dual-use solar research. We contend that a common approach for data collection and synthesis will facilitate a more rigorous investigation of the agricultural and ecological impacts of PV development across space and over time. The products of this scientifically informed approach can be directly applied to improve sustainable land management.

Bacon, Taylor (ORCID:0009000518578569)↗
DOE OSTI2023

Reposcanner

SAND2023-05455O Reposcanner provides a highly modular, extensible framework for defining routines for mining data from software repositories and performing analyses on that data to yield valuable insights on team behaviors. Reposcanner features seamless support for different version control platforms like GitHub, Gitlab, and Bitbucket; smart parsing of URLs; intelligent credential management capabilities; and a comprehensive test suite. Reposcanner is connected to the Exascale Computing Project and is intended for research purposes.

Mundt, Miranda↗
DOE OSTI2026

HITMAN

HITMAN (Hermite Interpolation of Trajectories and Measurement Synthesis for Analysis of Navigators) interpolates—or estimates the unknown values between known values—flight trajectories and generates synthetic inertial measurement unit (IMU) data using Hermite splines. This Python library provides modeling and simulation capabilities to synthesize inertial measurements from discrete trajectory points, enabling researchers to create exemplar datasets for evaluating navigation algorithms in various applications, including consumer devices like smartphones and vehicles. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Walker II, Michael [Sandia National Lab. (SNL-CA),↗
DOE OSTI2020

A Comprehensive Review of Practical Issues for Interoperability Using the Common Information Model in Smart Grids

Smart grids with interoperability improve grid reliability by collecting system information and transferring it to an energy management system and associated applications through a seamless end-to-end connection. To achieve interoperability, it is required to exchange the semantic information within the different domains. The international electrotechnical commission has established the Common Information Model (CIM) tool, which is a standard application programming interface for the exchange of semantic information in power systems. CIM provides a robust framework for accurate data sharing, merging, and transformation into reusable information. However, as CIM provides a basic framework for information exchange, various practical issues arise in establishing an energy management system capable of exchanging information using CIM. This paper aims to offer a comprehensive understanding by summarizing and categorizing the research on the practical use of CIM for interoperability in smart grids. Many papers are analyzed and the issues are classified into CIM extension, harmonization, and validation to address the issues that arise when establishing an integrated information exchange system.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Feedstock Carbon Intensity Calculator (FD-CIC): Users’ Manual and Technical Documentation

The carbon intensities (CIs) of biofuels are determined with the life cycle analysis (LCA) technique, which accounts for the energy/material uses and emissions during the complete supply chain of biofuel including feedstock production and fuel conversion stages. Regulatory agencies such as California Air Resources Board (CARB) adopts LCA to calculate biofuel CIs. The Low Carbon Fuel Standard (LCFS) program developed by CARB allows individual biofuel conversion facilities to submit their own biofuel CIs with their facility input data and incentivizes the reduction in the CI specific to that particular facility compared to a reference fuel’s CI (Liu et al 2020). Such an incentive program has driven innovations in biorefineries to reduce their greenhouse gas (GHG) emissions by linking their revenue directly to its CI score through LCFS credit trading. Besides the biofuel conversion stage, different farming practices for feedstock growth can result in significant CI variations for feedstocks, thus for biofuels. To provide evidence-based research findings, the U.S. Department of Energy’s Advanced Research Projects Agency–Energy (ARPA-E) has supported the Systems Assessment Center of the Energy Systems and Infrastructure Analysis Division at Argonne National Laboratory to examine CI variations of different farming practices to grow agricultural crops for biofuel production. Meanwhile, the ARPA-E has launched the Systems for Monitoring and Analytics for Renewable Transportation Fuels from Agricultural Resources and Management (SMARTFARM) program to develop technologies and data platforms that enable an accurate measurement of key farming parameters that can help robust accounting of the GHG benefits of sustainable, low-carbon agronomic practices at farm level.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Subordinated Gaussian Processes for Solar Irradiance

Traditionally the power grid has been a one-way street with power flowing from large transmission-connected generators through the distribution network to consumers. This paradigm is changing with the introduction of distributed renewable energy resources (DERs), and with it, the way the grid is managed. There is currently a dearth of high fidelity solar irradiance datasets available to help grid researchers understand how expansion of DERs could affect future power system operations. Realistic simulations of by-the-second solar irradiances are needed to study how DER variability affects the grid. Irradiance data are highly non-stationary and non-Gaussian, and even modern time series models are challenged by their distributional properties. We develop a subordinated non-Gaussian stochastic model whose simulations realistically capture the distribution and dependence structure in measured irradiance. We illustrate our approach on a fine resolution dataset from Hawaii, where our approach outperforms standard nonlinear time series models.

MATHEMATICS AND COMPUTING,SOLAR ENERGY↗
DOE OSTI2024

Streaming Readout and Data-Stream Processing With ERSAP

With the exponential growth in the volume and complexity of data generated at high-energy physics and nuclear physics research facilities, there is an imperative demand for innovative strategies to process this data in real or near-real-time. Given the surge in the requirement for high-performance computing, it becomes pivotal to reassess the adaptability of current data processing architectures in integrating new technologies and managing streaming data. This paper introduces the ERSAP framework, a modern solution that synergizes flow-based programming with the reactive actor model, paving the way for distributed, reactive, and high performance in data stream processing applications. Additionally, we unveil a novel algorithm focused on time-based clustering and event identification in data streams. The efficacy of this approach is further exemplified through the data-stream processing outcomes obtained from the recent beam tests of the EIC prototype calorimeter at DESY.

Vardan, Gyurjyan↗
DOE OSTI2024

Investigation of fast and efficient lossless compression algorithms for macromolecular crystallography experiments

Structural biology experiments benefit significantly from state-of-the-art synchrotron data collection. One can acquire macromolecular crystallography (MX) diffraction data on large-area photon-counting pixel-array detectors at framing rates exceeding 1000 frames per second, using 200 Gbps network connectivity, or higher when available. In extreme cases this represents a raw data throughput of about 25 GB s −1 , which is nearly impossible to deliver at reasonable cost without compression. Our field has used lossless compression for decades to make such data collection manageable. Many MX beamlines are now fitted with DECTRIS Eiger detectors, all of which are delivered with optimized compression algorithms by default, and they perform well with current framing rates and typical diffraction data. However, better lossless compression algorithms have been developed and are now available to the research community. Here one of the latest and most promising lossless compression algorithms is investigated on a variety of diffraction data like those routinely acquired at state-of-the-art MX beamlines.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Scientific Data Management Beyond Traditional Computing Boundaries

Scientific data management is undergoing a fundamental transformation driven by the convergence of artificial intelligence (AI)/machine learning workflows, distributed computing and storage environments, and exponential data growth. Here, we analyze how these developments address current limitations while enabling new capabilities for cross-facility collaboration and AI-driven research.

Widener, Patrick [Oak Ridge National Laboratory (O↗
DOE OSTI2024

Mu2e otsdaq Documentation and Online Reconstruction Analytics

This report outlines the results of the DOE-funded SULI (Science Undergraduate Laboratory Internship) research completed over the summer 2024 on site at Fermilab. The project focused on the \textit{otsdaq} software responsible for data acquisition. The project included drafting updated documentation for new users including new procedures relevant for the Alma-Linux 9 operating system update, and the UPS package managing system replacement with spack (scientific software package manager). A new \textit{art} module (ReadTriggerCounts) to track trigger rates was created, with compatibility to be displayed via a Grafana server. The author also assisted in calorimeter cable installation in the detector hall.

Saarinen, Talia↗