Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Missing data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Shifting Between Compute and Memory Bounds: A Compression-Enabled Roofline Model

In the evolving landscape of high-performance computing, especially to fight the end of Moore’s Law and Dennard’s Scaling, the ability to shift between compute-bound and memory-bound states is critical for enhancing adaptability and flexibility to diverse system and domain-specific architectures. Such capability is vital for optimizing performance across distinguished hardware configurations, such as accelerators, memory hierarchies, and cache systems. Despite that ad hoc optimization techniques, such as compressed/approximate computation, have been enabled for compute-/data-intensive computing for improved performance in distinct hardware settings, there lacks an understanding of 1) the rational behind performance improvement; 2) capability of different optimizations; 3) what optimization to respond to specific computational and memory demands. This work proposes a compression-enabled roofline model to facilitate this adaptability with data compression techniques to balance and transform between computational and memory demands. This model enables applications to adjust in response to the specific strengths and limitations of the underlying hardware and system to optimize resource utilization. The effectiveness of this approach is demonstrated with matrix multiplication kernels on different input sizes, with turning on/off various compression techniques, including 1) low-precision floating point; 2) sparse matrix formulation; and 3) compressed arrays with ZFP. By reducing memory transfer volumes and cache misses and increasing data locality and computational intensity through compression, the specific roofline model can transform between compute and memory bounds to align more efficiently with system capabilities. This advancement not only improves overall performance but also maximizes adaptability in diverse computing environments.

Naraparaju, Ramasoumya [University of Washington]↗
DOE OSTI2014

Metal artifact correction for x-ray computed tomography using kV and selective MV imaging

Purpose: The overall goal of this work is to improve the computed tomography (CT) image quality for patients with metal implants or fillings by completing the missing kilovoltage (kV) projection data with selectively acquired megavoltage (MV) data that do not suffer from photon starvation. When both of these imaging systems, which are available on current radiotherapy devices, are used, metal streak artifacts are avoided, and the soft-tissue contrast is restored, even for regions in which the kV data cannot contribute any information. Methods: Three image-reconstruction methods, including two filtered back-projection (FBP)-based analytic methods and one iterative method, for combining kV and MV projection data from the two on-board imaging systems of a radiotherapy device are presented in this work. The analytic reconstruction methods modify the MV data based on the information in the projection or image domains and then patch the data onto the kV projections for a FBP reconstruction. In the iterative reconstruction, the authors used dual-energy (DE) penalized weighted least-squares (PWLS) methods to simultaneously combine the kV/MV data and perform the reconstruction. Results: The authors compared kV/MV reconstructions to kV-only reconstructions using a dental phantom with fillings and a hip-implant numerical phantom. Simulation results indicated that dual-energy sinogram patch FBP and the modified dual-energy PWLS method can successfully suppress metal streak artifacts and restore information lost due to photon starvation in the kV projections. The root-mean-square errors of soft-tissue patterns obtained using combined kV/MV data are 10–15 Hounsfield units smaller than those of the kV-only images, and the structural similarity index measure also indicates a 5%–10% improvement in the image quality. The added dose from the MV scan is much less than the dose from the kV scan if a high efficiency MV detector is assumed. Conclusions: The authors have shown that it is possible to improve the image quality of kV CTs for patients with metal implants or fillings by completing the missing kV projection data with selectively acquired MV data that do not suffer from photon starvation. Numerical simulations demonstrated that dual-energy sinogram patch FBP and a modified kV/MV PWLS method can successfully suppress metal streak artifacts and restore information lost due to photon starvation in kV projections. Combined kV/MV images may permit the improved delineation of structures of interest in CT images for patients with metal implants or fillings.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2022

Informing Nature-based Climate Solutions for the United States with the best-available science

Nature-based Climate Solutions (NbCS) are managed alterations to ecosystems designed to increase carbon sequestration or reduce greenhouse gas emissions. While they have growing public and private support, the realizable benefits and unintended consequences of NbCS are not well understood. At regional scales where policy decisions are often made, NbCS benefits are estimated from soil and tree survey data that can miss important carbon sources and sinks within an ecosystem, and do not reveal the biophysical impacts of NbCS for local water and energy cycles. The only direct observations of ecosystem-scale carbon fluxes, for example, by eddy covariance flux towers, have not yet been systematically assessed for what they can tell us about NbCS potentials, and state-of-the-art remote sensing products and land-surface models are not yet being widely used to inform NbCS policymaking or implementation. As a result, there is a critical mismatch between the point- and tree-scale data most often used to assess NbCS benefits and impacts, the ecosystem and landscape scales where NbCS projects are implemented, and the regional to continental scales most relevant to policymaking. Here, we propose a research agenda to confront these gaps using data and tools that have long been used to understand the mechanisms driving ecosystem carbon and energy cycling, but have not yet been widely applied to NbCS. Furthermore, we outline steps for creating robust NbCS assessments at both local to regional scales that are informed by ecosystem-scale observations, and which consider concurrent biophysical impacts, future climate feedbacks, and the need for equitable and inclusive NbCS implementation strategies. We contend that these research goals can largely be accomplished by shifting the scales at which pre-existing tools are applied and blended together, although we also highlight some opportunities for more radical shifts in approach.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Performance Year 1 Technical Report - OPEN COG Grid: Extendable Coherent Models-Datasets for Cognitive Power Grids

The OPEN COG Grid project is a collaborative effort between LLNL, NREL, and Texas A&M University (TAMU) to develop synthetic power system datasets that (i) contain all technical information that would be available in a real system, allowing to conduct studies ranging from dynamic simulation to long term planning studies; ii) are accessible to researchers from the broader data sciences community, as oppossed to power system experts only; and (iii) This report summarizes the work conducted during the first 15 months of execution of the project. These activities encompassed: 1. Conduct a survey of existing open data sets and open source power systems simulators, their supported use cases, and accessibility (Chapter 1). 2. Define a new extensible specification for power system data, covering all parameters necessary for most computational use cases (Chapter 2). 3. Collecting real technical system data to complete missing parameters in existing open source datasets (Chapter 3). 4. Develop models that capture the behavior of emergent actors in power grids, neglected by existing datasets; aggregated residential demand response (Chapter 4) and demand response of cryptocurrency miners (Chapter 5). 5. Collect detailed spatial information on distributed energy resources, particular, solar photovoltaic facilities (Chapter 6). The following chapters provide detailed descriptions of these tasks, the assumptions taken, and their findings. In conducting these tasks, the project team produced: two (accepted) conference papers; one journal paper under submission; one draft journal paper pending submission; released one repository with the developed power system data specification, with documentation and examples; and one extended dataset for the Texas power grid under review for release. The team hopes these contributions will enhance access to power system data and remove barriers to the development of new computational techniques for power systems, particularly, those inspired by cognitive sciences.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Discovery of Signatures, Anomalies, and Precursors in Synchrophasor Data with Matrix Profile and Deep Recurrent Neural Networks (Final Project Report)

The widespread deployment of phasor measurement unit (PMU) across the U.S. together with the burgeoning machine learning technology made it possible to develop data-driven PMU data analytics to improve grid security and reliability in a more insightful and effective manner. Although PMU applications have been explored for over a decade, the representative PMU usage is limited to the bulk power system monitoring mainly due to the data integrity issues associated with PMUs (typically missing, fragmented, and wrongly amplified data). To forge a breakthrough on this stalemate and embrace PMUs for power system control and protection as well, we applied various advanced machine learning and big data analysis technology to the power system event detection and classification as the first step toward the power system control and protection pertaining to grid security enhancement.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2016

Analysis Capability and Data Needs Identified During the Evaluation of the SILENE CAAS Benchmarks

In October 2010, a series of benchmark experiments was conducted at the Commissariat a l'Energie Atomique et aux Energies Alternatives (CEA) Valduc SILENE facility. These experiments were a joint effort between the US Department of Energy (DOE) and the French CEA to create three benchmarks for verification and validation of radiation transport codes, as well as evaluated nuclear data, used to analyze criticality accident alarm systems (CAASs). Many preliminary details of these experiments and their evaluation have been discussed in previous publications. The first benchmark evaluation was published in 2015, and the second and third evaluations will be published at the end of 2016. During evaluation of the three benchmarks, differences were observed between the measured and calculated benchmark values, which was not surprising. Evaluators spent a great deal of time identifying the sources of these differences. This paper presents two of the most important and clearly identifiable differences, which the authors identify as needs for the criticality safety and shielding communities. The first need is the capability to easily produce and transport delayed neutrons and gammas within existing radiation transport codes without coupling to a separate decay and depletion code. The second need is to fill in missing gamma production data in the evaluated nuclear data libraries. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2018

Measurement of differential cross sections and W+/W- cross-section ratios for W boson production in association with jets at $$ \sqrt{s}=8 $$ TeV with the ATLAS detector

This paper presents a measurement of the W boson production cross section and the W + /W - cross-section ratio, both in association with jets, in proton-proton collisions at $\sqrt{s}$ = 8 with the ATLAS experiment at the Large Hadron Collider. The measurement is performed in final states containing one electron and missing transverse momentum using data corresponding to an integrated luminosity of 20.2 fb -1 . Differential cross sections for events with at least one or two jets are presented for a range of observables, including jet transverse momenta and rapidities, the scalar sum of transverse momenta of the visible particles and the missing transverse momentum in the event, and the transverse momentum of the W boson. For a subset of the observables, the differential cross sections of positively and negatively charged W bosons are measured separately. In the cross-section ratio of W + /W - the dominant systematic uncertainties cancel out, improving the measurement precision by up to a factor of nine. The observables and ratios selected for this paper provide valuable input for the up quark, down quark, and gluon parton distribution functions of the proton.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS2005

Wavelengths, f-Values, and Cross Sections in the UV Spectra of Astrophysical, Atoms, Ions, and Molecules

Data analysis for Fe III was completed in 2004. The new spectra give wavelengths and some energy levels for Fe III that are at least an order of magnitude more accurate than values in the literature. However, the data set is missing - because they are outside the wavelength range that we can study at Imperial College or with ancillary FT spectroscopy measurements at NIST - important transitions that would allow all energy levels to be determined with improved accuracy. We are assessing collaborations at other labs. We have made test runs with a number of cathodes (pure metals and alloys) in the Penning discharge source and selected four iron group (3d) elements, Cr, Mn, Co, and Ni, for further measurements. Cathodes of pure Cr and Co and an alloy of Ni were found to be best. Mn has not nm stably yet, and other cathode geometries or alloys may need to be assessed. Optimum Penning discharge (PD) lamp conditions (buffer gas, gas pressure, and current/voltage) were established for Co, and investigations are underway for Cr and Ni. Definitive measurements for Co await purchase of new mirrors and photomultiplier tubes that will improve signal to noise ratio. Our plan for the next year is to continue evaluating cathodes and operating conditions through March 05, and then to begin definitive measurements. The UV wavelength measurements made at Imperial College with the unique UV FT spectrometer will be complemented by visible and near IR range measurements at NIST in June and/or July. Approximately one year from now, we intend to visit Lund University to collaborate on lifetime measurements that will allow our branching ration data to be used to determine f-values.

Raymond, John C.↗
DOE OSTI2022

Estimation of conditional cumulative incidence functions under generalized semiparametric regression models with missing covariates, with application to analysis of biomarker correlates in vaccine trials

Herein, this article presents generalized semiparametric regression models for conditional cumulative incidence functions with competing risks data when covariates are missing by sampling design or happenstance. A doubly robust augmented inverse probability weighted (AIPW) complete-case approach to estimation and inference is investigated. This approach modifies IPW complete-case estimating equations by exploiting the key features in the relationship between the missing covariates and the phase-one data to improve efficiency. An iterative numerical procedure is derived to solve the nonlinear estimating equations. The asymptotic properties of the proposed estimators are established. A simulation study examining the finite-sample performances of the proposed estimators shows that the AIPW estimators are more efficient than the IPW estimators. The developed method is applied to the RV144 HIV-1 vaccine efficacy trial to investigate vaccine-induced IgG binding antibodies to HIV-1 as correlates of acquisition of HIV-1 infection while taking account of whether the HIV-1 sequences are near or far from the HIV-1 sequences represented in the vaccine construct.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

Quality of Life in Long-term Survivors of Muscle-Invasive Bladder Cancer

Purpose: Health-related quality of life (QOL) has not been well-studied in survivors of muscle-invasive bladder cancer (MIBC). The present study compared long-term QOL in MIBC patients treated with radical cystectomy (RC) versus bladder-sparing trimodality therapy (TMT). Methods and Materials: This cross-sectional bi-institutional study identified 226 patients with nonmetastatic cT2-cT4 MIBC, diagnosed in 1990 to 2011, who were eligible for RC and were disease free for ≥2 years. Six validated QOL instruments were administered: EuroQOL EQ-5D, European Organisation for Research and Treatment of Cancer (EORTC) Quality of Life Core Questionnaire and EORTC MIBC module, Expanded Prostate Cancer Index Composite bowel scale, Cancer Treatment and Perception Scale, and Impact of Cancer, version 2. Multivariable analyses of the mean QOL scores were conducted using propensity score matching. Results: The response rate was 77% (n=173). The median follow-up period was 5.6 years. Of the 173 patients, 64 received TMT and 109, RC. The median interval from diagnosis to questionnaire completion was 9 years after TMT and 7 years after RC (P=.009). No significant differences were found in age, gender, comorbidities, tobacco history, performance status, or tumor stage. On multivariable analysis, patients who received TMT had better general QOL by 9.7 points of 100 compared with those who had received RC (P=.001) and higher physical, role, social, emotional, and cognitive functioning by 6.6 to 9.9 points (P≤.04). TMT was associated with better bowel function by 4.5 points (P=.02) and fewer bowel symptoms by 2.7 to 7.1 points (P≤.05). The urinary symptom scores were similar. TMT was associated with better sexual function by 8.7 to 32.1 points (P≤.02) and body image by 14.8 points (P<.001). The patients who underwent TMT reported greater informed decision-making scores by 13.6 points (P=.01) and less concern about the negative effect of cancer by 6.8 points (P=.006). The study limitations included missing baseline QOL data and different follow-up times. Conclusions: Both TMT and RC result in good long-term QOL outcomes in MIBC survivors, supporting TMT as a good alternative to RC for selected patients. Whether TMT leads to superior QOL requires prospective validation.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2015

Diverse uncultivated ultra-small bacterial cells in groundwater

Bacteria from phyla lacking cultivated representatives are widespread in natural systems and some have very small genomes. Here we test the hypothesis that these cells are small and thus might be enriched by filtration for coupled genomic and ultrastructural characterization. Metagenomic analysis of groundwater that passed through a ~0.2-μm filter reveals a wide diversity of bacteria from the WWE3, OP11 and OD1 candidate phyla. Cryogenic transmission electron microscopy demonstrates that, despite morphological variation, cells consistently have small cell size (0.009±0.002 μm3). Ultrastructural features potentially related to cell and genome size minimization include tightly packed spirals inferred to be DNA, few densely packed ribosomes and a variety of pili-like structures that might enable inter-organism interactions that compensate for biosynthetic capacities inferred to be missing from genomic data. The results suggest that extremely small cell size is associated with these relatively common, yet little known organisms.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2015

The luminosity and stellar mass functions of GRB host galaxies: Insight into the metallicity bias

Long-duration gamma-ray bursts (GRBs) are powerful probes of the star formation history of the universe, but the correlation between the two depends on the highly debated presence and strength of a metallicity bias. To investigate this correlation, we use a phenomenological model that successfully describes star formation rates, luminosities, and stellar masses of star-forming galaxies and apply it to GRB production. We predict the luminosities, stellar masses, and metallicities of host galaxies depending on the presence (or absence) of a metallicity bias. Our best-fitting model includes a moderate metallicity bias, broadly consistent with the large majority of the long-duration GRBs in metal-poor environments originating from a collapsar (probability ∼83%, with [0.74;0.91] range at 90% confidence level), but with a secondary contribution (∼17%) from a metal-independent production channel, such as binary evolution. Because of the mass–metallicity relation of galaxies, the maximum likelihood model predicts that the metal-independent channel becomes dominant at z≲2, where hosts have higher metallicities and collapsars are suppressed. This possibly explains why some studies find no clear evidence of a metal bias based on low-z samples. However, while metallicity predictions match observations well at high redshift (z≳2), there is tension with low-redshift observations, since a significant fraction of GRB hosts are predicted to have (near) solar metallicity. This is in contrast to observations, unless obscured, metal-rich hosts are preferentially missed in current data sets, and suggests that lower efficiencies of the metal-independent GRB channel might be preferred following a comprehensive fit that includes metallicity of GRB hosts from complete samples. Overall, we are able to clearly establish the presence of a metallicity bias for GRB production, but continued characterization of GRB host galaxies is needed to quantify its strength. Tabulated model predictions are available in electronic format.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Adaptive Generation of Training Data for ML Reduced Model Creation

Machine learning proxy models are often used to speed up or completely replace complex computational models. The greatly reduced and deterministic computational costs enable new use cases such as digital twin control systems and global optimization. The challenge of building these proxy models is generating the training data. A naive uniform sampling of the input space can result in a non-uniform sampling of the output space of a model. This can cause gaps in the training data coverage that can miss finer scale details resulting in poor accuracy. While larger and larger data sets could eventually fill in these gaps, the computational burden of full-scale simulation codes can make this prohibitive. In this paper, we present an adaptive data generation method that utilizes uncertainty estimation to identify regions where training data should be augmented. By targeting data generation to areas of need, representative data sets can be generated efficiently. The effectiveness of this method will be demonstrated on a simple one-dimensional function and a complex multidimensional physics model.

Cianciosa, Mark↗
DOE OSTI2020

Reversible structural transformations in supercooled liquid water from 135 to 245 K

Water has many anomalous properties compared to “simple” liquids, and these anomalies are typically enhanced in supercooled water.1-3 While numerous models have been proposed, including the liquid-liquid critical point,4,5 the singularity-free scenario,6 and the stability limit conjecture,1 a molecular-level understanding remains elusive. The main difficulty in determining which, if any, of these models is correct is the limited amount of data in the relevant temperature and pressure ranges. For water at ambient pressures, which is the focus of this work, data is largely missing from 160 – 232 K (“No Man’s Land”) due to rapid crystallization.2,3 Whether rapid crystallization is just an experimental obstacle, or a fundamental problem signaling the inability of water to thermally equilibrate prior to crystallization is also a major unanswered question.5,7 Here, we investigate the structural transformations of transiently-heated, supercooled water with nanosecond time resolution using infrared vibrational spectroscopy. The experiments demonstrate three key results. First, water’s structure relaxes from its initial configuration to a “steady-state” configuration prior to the onset of crystallization over a wide temperature range. Second, water’s steady-state structure can be reproduced by a linear combination of two, temperature-independent structures that correspond to a “high-temperature liquid” and a “low-temperature liquid.” Third, the observed structural changes are reversible over the full temperature range. Taken together, these results show that supercooled water can equilibrate prior to crystallization for temperatures from the homogeneous nucleation temperature, TH ~232 K,3 down to the glass transition temperature (Tg ~ 136 K). Second, the results provide support for the hypothesis that supercooled water can be described as a mixture of two, structurally-distinct, interconvertible liquids from 135 K to 245 K.5,8-18

Kringle, Loni M.↗
DOE OSTI2019

KCMP Minnesota Tall Tower Ammonia Observations and Emission Estimates Dataset 2017-2018

This data set contains NH3 mixing ratios, net ecosystem NH3 exchange, and supporting information measured at a tall tower (KCMP, 244 meter) site near St. Paul, Minnesota, USA. The data include NH3 and H2O mixing ratios measured at the 100 meter level, as well as NH3 mixing ratio measured at the 56 meter level. Wind data was measured using a sonic anemometer at the 185 meter level. Also included in this data set are values of wet N and NH3 deposition from 2016 - 2018. This data was collected to improve understanding of the ammonia and reactive nitrogen budget for the region.Ammonia mixing ratios were filtered for periods when the NH3 analyzer measured anomalous (i.e. 10 mmol mol-1) water vapor mixing ratios based on comparison with the IRGA (LI7000). Further, we filtered out NH3 observations obtained during strongly condensing conditions. These periods were identified when the water vapor mixing ratio differences between the 100 m and 56 m levels were more negative than -0.5 mmol mol-1 (i.e. when the water vapor gradient was strong and directed toward the land surface). Finally, we filtered out NH3 fluxes when the atmosphere was strongly stable (i.e. when (z-d)/L exceeded a value of +4.5) and subject to decoupling from the surface fluxes. Approximately 35.1% of the hourly flux data were either missing due to instrument failure or filtered according to the above quality control procedures.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

State Machine Operation of Complex Systems

Operation of complex systems which depend on one or more other systems with many process variables often operate in more than one state. For each state there may be a variety of parameters of interest, and for each of these, one may require different alarm limits, different archiving needs, and have different critical parameters. Relying on operators to reliably change 10s-1000s of parameters for each system for each state is unreasonable. Not changing these parameters results in alarms being ignored or disabled, critical changes missed, and/or possible data archiving problems. To reliably manage the operation of complex systems, such as cryomodules (CMs), Fermilab is implementing state machines for each CM and an over-arching state machine for the PIP-II superconducting linac (SCL). The state machine transitions and operating parameters are stored/restored to/from a configuration database. Proper implementation of the state machines will not only ensure safe and reliable operation of the CMs, but will help ensure reliable data quality. A description of PIP-II SCL, details of the state machines, and lessons learned from limited use of the state machines in recent CM testing will be discussed.

43 PARTICLE ACCELERATORS↗
DOE OSTI2022

Introduction to Evolve Central Appalachia

The Evolve-CAPP project is developing and implementing strategies to enable the Central Appalachian basin to realize its full economic potential for producing high-value, non-fuel, carbon-ore (CO) products, rare earth elements (REE), and critical minerals (CM). The Basinal Assessment of CORE-CM Resources is a state-of-the-art geological model and comprehensive database that will be used to identify, locate, and quantify in-situ resources in the basin. Restrictive aspects of resource recovery, such as ownership and legal restrictions, are being considered in estimating recoverable resources. A gap analysis of missing or unavailable data that could not be fully integrated in the initial assessment due to budget, access, or other constraints during the assessment effort is planned. A characterization and data acquisition plan to fully characterize the basin’s CORE-CM potential will address gaps in data. The plan will be developed with input from project team members and relevant stakeholders, including land and mineral holding companies and coal operators, who maintain sampling programs as part of their normal operations.

Bishop, Richard↗
DOE OSTI2019

Using acoustic telemetry for high-resolution sablefish movement informing potential interactions with a tidal turbine

As the MHK industry moves forward to the commercial phase, knowledge of potential environmental effects need to be documented and established. At present, the potential for fish interactions and subsequent injury or mortality are a significant concern with instream turbines. Sensors, methodologies, and analyses need to be developed to detect collision or near-miss events. These data will reduce uncertainty of the likelihood of such events and provide information to regulators to make informed decisions on permitting and possible mitigation measures if needed. Acoustic telemetry is a primary method for studying fine-scale fish movements because it can remotely track fish in three dimensions with accuracy. The Juvenile Salmon Acoustic Telemetry System (JSATS) developed by Pacific Northwest National Laboratory has proven effective for fish passage estimates and fine-scale movement in river impoundments and near dams. Leveraging the success of previous JSATS applications and applying it to the marine environment, juvenile sablefish (Anoplopoma fimbria) were tagged and tracked using a fixed-position receiver array in a marine tidal channel for the first time. Applying this technology to future installations of MHK turbines will provide information on fish avoidance and evasion behavior as well as blade strike and potential injury and mortality.

Staines, Garrett J.↗