Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data replication”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Keep CALM and CRDT On

Despite decades of research and practical experience, developers have few tools for programming reliable distributed applications without resorting to expensive coordination techniques. Conflict-free replicated datatypes (CRDTs) are a promising line of work that enable coordination-free replication and offer certain eventual consistency guarantees in a relatively simple object-oriented API. Yet CRDT guarantees extend only to data updates; observations of CRDT state are unconstrained and unsafe. We propose an agenda that embraces the simplicity of CRDTs, but provides richer, more uniform guarantees. We extend CRDTs with a query model that reasons about which queries are safe without coordination by applying monotonicity results from the CALM Theorem, and lay out a larger agenda for developing CRDT data stores that let developers safely and efficiently interact with replicated application state.

Computer Science↗
DOE OSTI2020

Computing for the DUNE Long-Baseline Neutrino Oscillation Experiment

This is a talk given at Computers in High Energy Physics in Adelaide, South Australia, Australia in November 2019. It is partially intended to explain the context of DUNE Computing for computing specialists. The DUNE collaboration consists of over 180 institutions from 33 countries. The experiment is in preparation now with commissioning of the first 10kT fiducial volume Liquid Argon TPC expected over the period 2025-2028 and a long data taking run with 4 modules expected from 2029 and beyond. An active prototyping program is already in place with a short test beam run with a 700T, 15,360 channel prototype of single-phase readout at the neutrino platform at CERN in late 2018 and tests of a similar sized dual-phase detector scheduled for mid-2019. The 2018 test beam run was a valuable live test of our computing model. The detector produced raw data at rates of up to ~2GB/s. These data were stored at full rate on tape at CERN and Fermilab and replicated at sites in the UK and Czech Republic. In total 1.2 PB of raw data from beam and cosmic triggers were produced and reconstructed during the six week test beam run. Baseline predictions for the full DUNE detector data, starting in the late 2020's are 30-60 PB of raw data per year. In contrast to traditional HEP computational problems, DUNE's Liquid Argon TPC data consist of simple but very large (many GB) 2D data objects which share many characteristics with astrophysical images. This presents opportunities to use advances in machine learning and pattern recognition as a frontier user of High Performance Computing facilities capable of massively parallel processing.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2019

Using Big Data Technologies for HEP Analysis

The HEP community is approaching an era were the excellent performances of the particle accelerators in delivering collision at high rate will force the experiments to record a large amount of information. The growing size of the datasets could potentially become a limiting factor in the capability to produce scientific results timely and efficiently. Recently, new technologies and new approaches have been developed in industry to answer to the necessity to retrieve information as quickly as possible to analyze PB and EB datasets. Providing the scientists with these modern computing tools will lead to rethinking the principles of data analysis in HEP, making the overall scientific process faster and smoother. In this paper, we are presenting the latest developments and the most recent results on the usage of Apache Spark for HEP analysis. The study aims at evaluating the efficiency of the application of the new tools both quantitatively, by measuring the performances, and qualitatively, focusing on the user experience. The first goal is achieved by developing a data reduction facility: working together with CERN Openlab and Intel, CMS replicates a real physics search using Spark-based technologies, with the ambition of reducing 1 PB of public data in 5 hours, collected by the CMS experiment, to 1 TB of data in a format suitable for physics analysis. The second goal is achieved by implementing multiple physics use-cases in Apache Spark using as input preprocessed datasets derived from official CMS data and simulation. By performing different end-analyses up to the publication plots on different hardware, feasibility, usability and portability are compared to the ones of a traditional ROOT-based workflow.

Cremonesi, Matteo↗
DOE OSTI2026

Dissolved Inorganic Carbon and Dissolved Organic Carbon Data for the East River Watershed, Colorado (2015-2025)

This data package contains mean values for dissolved organic carbon (DOC) and dissolved inorganic carbon (DIC) for water samples taken from the East River Watershed in Colorado. The East River is part of the Watershed Function Scientific Focus Area (WFSFA) located in the Upper Colorado River Basin, United States. DOC and DIC concentrations in water samples were determined using a TOC-VCPH analyzer (Shimadzu Corporation, Japan). DOC was analyzed as non-purgeable organic carbon (NPOC) by purging HCl-acidified samples with carbon-free air to remove DIC prior to measurement. After the acidified sample has been sparged, it is injected into a combustion tube filled with oxidation catalyst heated to 680 oC. The DOC in samples is combusted to CO2 and measured by a non-dispersive infrared (NDIR) detector. The peak area of the analog signal produced by the NDIR detector is proportional to the DOC concentration of the sample. DIC was determined by acidifying the samples with HCl first, and then purging with carbon-free air to release CO2 for analysis by NDIR detector. Total dissolved nitrogen (TDN) was analyzed using a Shimadzu Total Nitrogen Module (TNM-L) combined with the TOC-L analyzer (Shimadzu Corporation, Japan). TNM-L is a non-specific measurement of total nitrogen (TN). All nitrogen species in samples are combusted to nitrogen monoxide and nitrogen dioxide, then reacted with ozone to form an excited state of nitrogen dioxide. Upon returning to ground state, light energy is emitted. Then, TDN is measured using a chemiluminescence detector. All data reported are the mean values upon minimum of three replicate measurements, with a relative standard deviation < 3%. All samples were analyzed under a rigorous quality assurance and quality control (QA/QC) process. This data package contains (1) a zip file (dic_npoc_data_2014-2025.zip) containing a total of 337 files: 336 data files of DIC and NPOC data from across the Lawrence Berkeley National Laboratory (LBNL) Watershed Function Scientific Focus Area (SFA) which is reported in .csv files per location and a locations.csv (1 file) with latitude and longitude for each location; (2) a file-level metadata (v6_20250901_flmd.csv) file that lists each file contained in the dataset with associated metadata; (3) a data dictionary (v6_20250901_dd.csv) file that contains terms/column_headers used throughout the files along with a definition, units, and data type; and (4) PDF and docx files for the determiniation of Method Detection Limits (MDLs) for DIC and NPOC data, which has been updated in 2026-08. Missing values within the anion data files are noted as either "-9999" or "0.0" for not detectable (N.D.) data. There are a total of 113 locations containing DIC/NPOC data. Update on 2020-10-07: Updated the data files to remove times from the timestamps, so that only dates remain. The data values have not changed. Update on 2021-04-11: Added Determination of Method Detection Limits (MDLs) for DIC, NPOC and TDN Analyses document, which can be accessed as a PDF or with Microsoft Word.Update on 6/10/2022: versioned updates to this dataset was made along with these changes: (1) updated dissolved inorganic carbon and dissolved organic carbon data for all locations up to 2021-12-31, (2) removal of units from column headers in datafiles, (3) added row underneath headers to contain units of variables, (4) restructure of units to comply with CSV reporting format requirements, (5) added -9999 for empty numerical cells, and (6) the addition of the file-level metadata (flmd.csv) and data dictionary (dd.csv) were added to comply with the File-Level Metadata Reporting Format. Update on 2022-09-09: Updates were made to reporting format specific files (file-level metadata and data dictionary) to correct swapped file names, add additional details on metadata descriptions on both files, add a header_row column to enable parsing, and add version number and date to file names (v2_20220909_flmd.csv and v2_20220909_dd.csv). Update on 2023-08-08: Updates were made to both the data files and reporting format specific files. New available anion data was added, up until 2023-01-05. The file level metadata and data dictionary files were updated to reflect the additional data added. Update on 2024-03-11: Updates were made to both the data files and reporting format specific files. New available anion data was added, up until 2023-11-21. Further, revisions to the data files were made to remove incorrect data points (from 1970 and 2001). The reporting format specific files were updated to reflect the additional data added. Revised versions of the PDF and docx files for determination of MDLs for DIC and NPOC were added to replace previous versions. Update on 2025-05-15: Updates were made to both the data files and reporting format specific files. New available DIC and NPOC data was added, up until the end of WY2024 (September 30, 2024). International Generic Sample Numbers (IGSNs), when registered, were added to the data files. The reporting format specific files were updated to reflect the additional data added. Update on 2026-09-01: Updates were made to both the data files and reporting format specific files. New available DIC and NPOC data was added, up until the end of WY2025 (September 30, 2025). Updated versions, as of 2026-08-10, of the PDF and docx files for determination of MDLs for DIC and NPOC data were added to this dataset.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

Proteomic studies of bone and skeletal health outcomes

Proteins are an essential part of essentially all biological processes, and there is enormous variation in protein forms and concentrations that is not reflected in DNA or RNA. Recently there have been rapid advances in the ability to measure protein sequence, modification and concentration, particularly with methods based in mass spectrometry. Global measures of proteins in tissues or in the circulation provide a broad assessment of the proteome that can be extremely useful for discovery, and targeted proteomic measures can yield specific and sensitive assessments of specific peptides and proteins. While most proteomic measures are directed at the detection of consensus peptide sequences, mass spectrometry based proteomic methods also allow a detailed examination of the peptide sequence differences that result from genetic variants and that may have important effects on protein function. In evaluating proteomic data, a number of analytical considerations are important, including an understanding of missing data, the challenge of multiple testing and replication, and the use of rapidly evolving methods in systems biology. While proteomics has not yet had a major impact in skeletal research, interesting recent research has used these approaches in the study of bone cell biology and the discovery of biomarkers of skeletal disorders. Proteomics can be expected to have an increasing influence in the study of bone biology and pathophysiology

Proteomic, Bone↗
DOE OSTI2025

A Digital Twin for an Inverter-Based Resource Power Plant: Real-time data streaming unlocks situation awareness

Here, this study presents the development and successful implementation of a digital twin specifically designed for a grid-connected IBR power plant. By integrating a reduced-order model of the IBR system and dynamically updating the grid impedance with real-time data, the digital twin effectively captures and replicates the behavior of the physical system. Its accuracy and reliability are validated through critical test scenarios, including a three-phase fault and a line-tripping event. The results confirm that the digital twin closely emulates its physical counterpart, demonstrating its strong potential for real-time analysis, system monitoring, and predictive decision making in modern power systems.

Digital twins↗
DOE OSTI2023

Stem psychrometer and flux data from US-CdM

Cleaned midday and predawn water potential data from 14 stem psychrometers installed within the footprint of the US-CdM flux tower, from May-October 2021. These data were collected in order to link environmental drivers, vegetation responses to seasonal water stress, and ecosystem fluxes of carbon and water at a pinyon-juniper woodland in southeastern Utah.Data include a comma separated values file containing all water potential data used in the published paper. Data were first published in Kannenberg et al. 2023 Agricultural and Forest Meteorology (doi: 10.1016/j.agrformet.2022.109269). Flux data are publicly available from the AmeriFlux portal (doi: 10.17190/AMF/1865477). This data file and the AmeriFlux data are all that is necessary to replicate the analyses in Kannenberg et al. 2023 Agricultural and Forest Meteorology.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Local Resource Assessment: Beetle-Killed Spruce in Alaska

This report synthesizes forest inventory and spatial data from federal and state sources to present a snapshot of beetle-killed spruce across Southcentral and Interior Alaska. This natural resource is under investigation for use in cellulose-based products, particularly building insulation. Research funded by the Department of Energy's ARPA-E program, has successfully developed insulation - Celium - using beetle-killed spruce combined with mycelium, the root network of fungi. The resulting insulation product can be manufactured locally and used across all Alaskan climate zones for residential, commercial, and shipping applications. Removing standing dead wood also contributes to wildfire risk reduction and mitigates associated public health impacts. This Local Resource Assessment, funded by the Denali Commission, contextualizes and reconciles unaligned forestry data sources, establishing a pathway to refined, replicable analysis and, ultimately, presenting estimates of beetle-killed spruce biomass to inform the potential scale and development of a Celium industry.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS1977

Veterinary medical considerations for the use of nonhuman primates in space research

The validity of biomedical research using animal subjects is highly dependent on the use of 'normal' and healthy animals. The current costs of research programs dictate that a minimum number of animals and test replicates be used to obtain the desired data. The use of healthy and standardized animals increases the probability of obtaining valid data while also permitting greater economy by reducing the between-individual variation, thus allowing the use of fewer animals. Areas of concern when planning animal payloads include constraints of the flight on candidate species selection, screening for physiological and psychological normalcy, procedures for routine care and quarantine of new animals and those returning from space, ground-based studies to determine experimental protocol, selection of instrumentation, stress during transportation for flight operations, housing and care facilities at launch and recovery sites, and the overall veterinary program.

Simmonds, R. C.↗
NASA NTRS1985

Preliminary design of the redundant software experiment

The goal of the present experiment is to characterize the fault distributions of highly reliable software replicates, constructed using techniques and environments which are similar to those used in comtemporary industrial software facilities. The fault distributions and their effect on the reliability of fault tolerant configurations of the software will be determined through extensive life testing of the replicates against carefully constructed randomly generated test data. Each detected error will be carefully analyzed to provide insight in to their nature and cause. A direct objective is to develop techniques for reducing the intensity of coincident errors, thus increasing the reliability gain which can be achieved with fault tolerance. Data on the reliability gains realized, and the cost of the fault tolerant configurations can be used to design a companion experiment to determine the cost effectiveness of the fault tolerant strategy. Finally, the data and analysis produced by this experiment will be valuable to the software engineering community as a whole because it will provide a useful insight into the nature and cause of hard to find, subtle faults which escape standard software engineering validation techniques and thus persist far into the software life cycle.

Campbell, Roy↗
NASA NTRS1999

The HERO Program: High-Energy Replicated Optics for a Hard-X-Ray Balloon Payload

We are developing high-energy replicated optics for a balloon-borne hard-x-ray telescope. When completed, the telescope will have around 150 square cm of effective collecting area up to 65 keV, and an angular resolution of around 30 arc seconds, half power diameter. When used in conjunction with an array of focal plane imaging detectors, for which Gas Scintillation Proportional Counters are under development, the payload will provide unprecedented sensitivity for pointed observations in the hard-x-ray band. We will present an overview of the High Energy Replicated Optics (HERO) program together with test data from the first mirror units. The overall sensitivity of the full payload, when flown on long- and ultra-long-duration balloon flights, will be compared with past and planned satellite-borne hard-x-ray missions.

Ramsey, B. D.↗
NASA NTRS2011

Split-screen display system and standardized methods for ultrasound image acquisition and multi-frame data processing

A standardized acquisition methodology assists operators to accurately replicate high resolution B-mode ultrasound images obtained over several spaced-apart examinations utilizing a split-screen display in which the arterial ultrasound image from an earlier examination is displayed on one side of the screen while a real-time "live" ultrasound image from a current examination is displayed next to the earlier image on the opposite side of the screen. By viewing both images, whether simultaneously or alternately, while manually adjusting the ultrasound transducer, an operator is able to bring into view the real-time image that best matches a selected image from the earlier ultrasound examination. Utilizing this methodology, dynamic material properties of arterial structures, such as IMT and diameter, are measured in a standard region over successive image frames. Each frame of the sequence has its echo edge boundaries automatically determined by using the immediately prior frame's true echo edge coordinates as initial boundary conditions. Computerized echo edge recognition and tracking over multiple successive image frames enhances measurement of arterial diameter and IMT and allows for improved vascular dimension measurements, including vascular stiffness and IMT determinations.

Selzer, Robert H.↗
DOE OSTI2017

Chromatin organization regulates viral egress dynamics

Various types of DNA viruses are known to elicit the formation of a large nuclear viral replication compartment and marginalization of the cell chromatin. We used three-dimensional soft x-ray tomography, confocal and electron microscopy, combined with numerical modelling of capsid diffusion to analyse the molecular organization of chromatin in herpes simplex virus 1 infection and its effect on the transport of progeny viral capsids to the nuclear envelope. Our data showed that the formation of the viral replication compartment at late infection resulted in the enrichment of heterochromatin in the nuclear periphery accompanied by the compaction of chromatin. Random walk modelling of herpes simplex virus 1–sized particles in a three-dimensional soft x-ray tomography reconstruction of an infected cell nucleus demonstrated that the peripheral, compacted chromatin restricts viral capsid diffusion, but due to interchromatin channels capsids are able to reach the nuclear envelope, the site of their nuclear egress.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1996

The fragmentation of 510 MeV/nucleon iron-56 in polyethylene. II. Comparisons between data and a model

The results of a Monte Carlo model for calculating fragment fluences and LET spectra are compared to data taken with 600 MeV/nucleon iron ions incident on an accelerator beamline configured for irradiation of biological samples, with no target and with 2, 5 and 8 cm of polyethylene. The model uses a multi-generation nuclear fragmentation code, coupled with a formulation of ionization energy loss based on the Bethe-Bloch equation. In the region where the data are reliable and the experimental acceptance is well understood, many of the features of the experimental spectra are well replicated by the model. To obtain good agreement with the experimental data, the model must allow for at least two generations of fragment production in the target.

NASA Discipline Number 99-99↗
DOE OSTI2022

Data-Driven PMU Noise Emulation Framework using Gradient-Penalty-Based Wasserstein GAN

Availability of phasor measurement unit (PMUs) data has led to research on data-driven algorithms for event monitoring, control and ensuring stability of the grid. Unavailability of infrequent critical event field PMU data with component failures is driving the need to generate realistic synthetic PMU data for research. The synthetic data from power system simulation software often neglect noise profiles of received phasors, thus creating some discrepancies between real PMU data and synthetic ones. To address this issue, this work presents an initial study on the noise characteristics of PMUs, as well as presenting models for recreating their unique noise signatures. The proposed method, utilizing the Wasserstein generative adversarial network with gradient penalty (WGAN-GP) architecture, provides an excellent benchmark for matching the noise distribution. One can use a well-learned GAN model to draw noise signatures from a distribution that seemingly mirrors the real PMU noise distribution, while also being able to be detached from the PMU data once the training is done. Based on the observed results and employed data-driven methodology, it is expected that the proposed methods can be adapted to replicate the behavior of other sensors, providing research and other applications with a tool for data synthesis and sensor characterization.

PMU↗
DOE OSTI2015

Sequential data assimilation for single-molecule FRET photon-counting data

Data assimilation is a statistical method designed to improve the quality of numerical simulations in combination with real observations. Here, we develop a sequential data assimilation method that incorporates one-dimensional time-series data of smFRET (single-molecule Förster resonance energy transfer) photon-counting into conformational ensembles of biomolecules derived from “replicated” molecular dynamics (MD) simulations. A particle filter using a large number of “replicated” MD simulations with a likelihood function for smFRET photon-counting data is employed to screen the conformational ensembles that match the experimental data. We examine the performance of the method using emulated smFRET data and coarse-grained (CG) MD simulations of a dye-labeled polyproline-20. The method estimates the dynamics of the end-to-end distance from smFRET data as well as revealing that of latent conformational variables. The particle filter is also able to correct model parameter dependence in CG MD simulations. We discuss the applicability of the method to real experimental data for conformational dynamics of biomolecules.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Developing Low Noise, Rad-hard Detectors for Parity Violating Experiments

As parity-violating electron scattering (PVeS) experiments continue to push the frontiers of precision electro-weak asymmetry measurements, the demands on the experimental techniques and apparatus are also pushed. In particular, the need for higher resolution and radiation-hardness of the main integrating detectors has increased over the successive generations of PVeS experiments. The demand for precise measurement of GHz event rates has pushed the field toward the use of thin quartz Cerenkov light based detectors. We have been designing and testing such thin quartz detectors specifically for the upcoming experiments at Jefferson Lab, PREX-II and CREX, but this work also greatly influences the detector development for several future experiments including MOLLER at Jefferson Lab. These are all PVeS experiments that will use the new thin quartz Cerenkov detector design concept for their main asymmetry measurements (as well as for beam monitoring). The new design concept gives not only significant performance improvements compared to its predecessor from PREX-I, but also we have now thoroughly characterized its operational design and performance using a combination of test-beam data and detailed particle and optical Monte Carlo Geant4 simulations. These activities have culminated in the development and implementation of a "bench-marked" Monte Carlo package, QSIM, which constitutes a powerful design tool for present and future PVeS quartz detectors. The benchmarked simulation can replicate real photoelectron distributions (RMS and Mean) from testbeam data with ~5% precision – limited mainly by the systematic uncertainty of the PMT gain measurements.

Villarreal, Carlos Bula Villarreal↗
DOE OSTI2024

Variants in the MS4A cluster interact with soluble TREM2 expression on biomarkers of neuropathology

Recent evidence suggests that Alzheimer’s disease (AD) genetic risk variants (rs1582763 and rs6591561) of the MS4A locus are genome-wide significant regulators of soluble TREM2 levels such that the minor allele of the protective variant (rs1582763) is associated with higher sTREM2 and lower AD risk while the minor allele of (rs6591561) relates to lower sTREM2 and higher AD risk. Our group previously found that higher sTREM2 relates to higher Aβ 40 , worse blood–brain barrier (BBB) integrity (measured with the CSF/plasma albumin ratio), and higher CSF tau, suggesting strong associations with amyloid abundance and both BBB and neurodegeneration complicate interpretation. We expand on this work by leveraging these common variants as genetic tools to tune the interpretation of high CSF sTREM2, and by exploring the potential modifying role of these variants on the well-established associations between CSF sTREM2 as well as TREM2 transcript levels in the brain with AD neuropathology. Biomarker analyses leveraged data from the Vanderbilt Memory & Aging Project (n = 127, age = 72 ± 6.43) and were replicated in the Alzheimer’s Disease Neuroimaging Initiative (n = 399, age = 73 ± 7.39). Autopsy analyses were performed leveraging data from the Religious Orders Study and Rush Memory and Aging Project (n= 577, age = 89 ± 6.46). We found that the protective variant rs1582763 attenuated the association between CSF sTREM2 and Aβ 40 (β= -0.44, p-value= 0.017) and replicated this interaction in ADNI (β = -0.27, p = 0.017). We did not observe this same interaction effect between TREM2 mRNA levels and Aβ peptides in brain (Aβ total β = -0.14, p = 0.629; Aβ 1-38 , β = 0.11, p = 0.200). In contrast to the effects on Aβ, the minor allele of this same variant seemed to enhance the association with blood–brain barrier dysfunction (β = 7.0e-4, p = 0.009), suggesting that elevated sTREM2 may carry a much different interpretation in carriers vs. non-carriers of this allele. When evaluating the risk variant (rs6591561) across datasets, we did not observe a statistically significant interaction against any outcome in VMAP and observed opposing directions of associations in ADNI and ROS/MAP on Aβ levels. Together, our results suggest that the protective effect of rs1582763 may act by decoupling the associations between sTREM2 and amyloid abundance, providing important mechanistic insight into sTREM2 changes and highlighting the need to incorporate genetic context into the analysis of sTREM2 levels, particularly if leveraged as a clinical biomarker of disease in the future.

59 BASIC BIOLOGICAL SCIENCES↗