SEARCH · Engineering Papers

Results for “scientific data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Parameterizations of Entrainment-Mixing Mechanisms and their Effects on Cloud Droplet Spectral Width Based on Numerical Simulations

Entrainment-mixing mechanisms significantly affect cloud droplet number concentration, radius, and spectral shape. Quantitative examination of entrainment-mixing effects on cloud droplet spectral width is lacking. Here, we examine the effects of entrainment-mixing processes on cloud microphysics by 12,218 different setups, each simulated 10 times using the Explicit Mixing Parcel Model (EMPM) driven by the observational data from the Third Tibetan Plateau Atmospheric Scientific Experiment (TIPEX-III) campaign. Parameterizations of entrainment-mixing mechanisms are developed by relating homogeneous mixing degree to transition scale number that depends on the dissipation rate and droplet evaporation time scale. The correlation between relative dispersion of cloud droplet size distribution and homogeneous mixing degree changes from negative to positive with the decreasing homogeneous mixing degree. The different relationships are closely related to the competition between complete and partial droplet evaporation and the number concentration of small droplets, which are quantitatively described by two newly introduced dimensionless numbers. The competition is significantly affected by relative humidity and mixing fraction of entrained air as well as turbulence dissipation rate, but not much by cloud droplet number concentration. Especially, when relative humidity and dissipation rate are high, there is only a negative correlation. This study sheds new light on generalizing the homogeneous/inhomogeneous concept by considering relative dispersion, and also provides parameterizations of entrainment-mixing processes and relative dispersion for atmospheric models.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

A database of thermally activated delayed fluorescent molecules auto-generated from scientific literature with ChemDataExtractor

A database of thermally activated delayed fluorescent (TADF) molecules was automatically generated from the scientific literature. It consists of 25,482 data records with an overall precision of 82%. Among these, 5,349 records have chemical names in the form of SMILES strings which are represented with 91% accuracy; these are grouped in a subsidiary database. Each data record contains one of the following four properties: maximum emission wavelength (λ EM ), photoluminescence quantum yield (PLQY), singlet-triplet energy splitting (ΔE ST ), and delayed lifetime (τ D ). The databases were created through text mining using ChemDataExtractor, a chemistry-aware natural-language-processing toolkit, which has been adapted for TADF research. The text-mined corpus consisted of 2,733 papers from the Royal Society of Chemistry and Elsevier. To the best of our knowledge, these databases are the first databases that have been auto-generated for TADF molecules from existing publications. The databases have been publicly released for experimental and computational applications in the TADF research field.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2023

Planting a Lyman alpha forest on ABACUSSUMMIT

The full-shape correlations of the Lyman alpha (Ly$α$) forest contain a wealth of cosmological information through the Alcock Paczynski effect. However, these measurements are challenging to model without robustly testing and verifying the theoretical framework used for analyzing them. Here, we leverage the accuracy and volume of the $N$-body simulation suite ABACUSSUMMIT to generate high-resolution Ly$α$ skewers and quasi-stellar object (QSO) catalogs. One of the main goals of our mocks is to aid in the full-shape Ly$α$ analysis planned by the Dark Energy Spectroscopic Instrument (DESI) team. We provide optical depth skewers for six of the fiducial cosmology base-resolution simulations ($L$ box = 2 $h$ -1 Gpc, $N$ = 6912 3 ) at $z$ = 2.5. We adopt a simple recipe based on the Fluctuating Gunn-Peterson Approximation (FGPA) for constructing these skewers from the matter density in an $N$-body simulation and calibrate it against the 1D and 3D Ly$α$ power spectra extracted from the hydrodynamical simulation IllustrisTNG (TNG; $L$ box = 205 $h$ -1 Mpc, $N$ = 2500 3 ). As an important application, we study the non-linear broadening of the baryon acoustic oscillation (BAO) peak and show the cross-correlation between DESI-like QSOs and our Ly$α$ forest skewers. We find differences on small scales between the Kaiser approximation prediction and our mock measurements of the Ly$α$×QSO cross-correlation, which would be important to account for in upcoming analyses. The ABACUSSUMMIT Ly$α$ forest mocks open up the possibility for improved modelling of cross correlations between Ly$α$ and cosmic microwave background (CMB) lensing and Ly$α$ and QSOs, and for forecasts of the 3-point Ly$α$ correlation function. Furthermore, our catalogues and skewers are publicly available on Globus via the National Energy Research Scientific Computing Center (NERSC) (full link under Data Availability).

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2021

Interactive Supercomputing With Jupyter

Rich user interfaces like Jupyter have the potential to make interacting with a supercomputer easier and more productive, consequently attracting new kinds of users and helping to expand the application of supercomputing to new science domains. For the scientist-user, the ideal rich user interface delivers a familiar, responsive, introspective, modular, and customizable platform upon which to build, run, capture, document, re-run, and share analysis workflows. From the provider or system administrator perspective, such a platform would also be easy to configure, deploy securely, update, customize, and support. Jupyter checks most if not all of these boxes. But from the perspective of leadership computing organizations that provide supercomputing power to users, such a platform should also make the unique features of a supercomputer center more accessible to users and more composable with high performance computing (HPC) workflows. Project Jupyter’s core design philosophy of extensibility, abstraction, and agnostic deployment, has allowed HPC centers like NERSC to bring in advanced supercomputing capabilities that can extend the interactive notebook environment. This has enabled a rich scientific discovery platform, particularly for experimental facility data analysis and machine learning problems.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

iDDS: intelligent distributed dispatch and scheduling for workflow orchestration

The intelligent distributed dispatch and scheduling (iDDS) service is a versatile workflow orchestration system designed for large-scale, distributed scientific computing. iDDS extends traditional workload and data management by integrating data-aware execution, conditional logic, and programmable workflows, enabling automation of complex and dynamic processing pipelines. Originally developed for the ATLAS experiment at the large hadron collider, iDDS has evolved into an experiment-agnostic platform that supports both template-driven workflows and a Function-as-a-Task model for Python-based orchestration. This paper presents the architecture and core components of iDDS, highlighting its scalability, modular message-driven design, and integration with systems such as PanDA and Rucio. We demonstrate its versatility through real-world use cases: fine-grained tape resource optimization for ATLAS, orchestration of large Directed Acyclic Graph (DAG) workflows for the Rubin Observatory, distributed hyperparameter optimization for machine learning applications, active learning for physics analyses, and AI-assisted detector design at the electron–ion collider. By unifying workload scheduling, data movement, and adaptive decision-making, iDDS reduces operational overhead and enables reproducible, high-throughput workflows across heterogeneous infrastructures. We conclude with current challenges and future directions, including interactive, cloud-native, and serverless workflow support.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Characterization and identification of HPC applications at leadership computing facility

High Performance Computing (HPC) is an important method for scientific discovery via large-scale simulation, data analysis, or artificial intelligence. Leadership-class supercomputers are expensive, but essential to run large HPC applications. The Petascale era of supercomputers began in 2008, with the first machines achieving performance in excess of one petaflops, and with the advent of new supercomputers in 2021 (e.g., Aurora, Frontier), the Exascale era will soon begin. However, the high theoretical computing capability (i.e., peak FLOPS) of a machine is not the only meaningful target when designing a supercomputer, as the resources demand of applications varies. A deep understanding of the characterization of applications that run on a leadership supercomputer is one of the most important ways for planning its design, development and operation. In order to improve our understanding of HPC applications, user demands and resource usage characteristics, we perform correlative analysis of various logs for different subsystems of a leadership supercomputer. This analysis reveals surprising, sometimes counter-intuitive patterns, which, in some cases, conflicts with existing assumptions, and have important implications for future system designs as well as supercomputer operations. For example, our analysis shows that while the applications spend significant time on MPI, most applications spend very little time on file I/O. Combined analysis of hardware event logs and task failure logs show that the probability of a hardware FATAL event causing task failure is low. Combined analysis of control system logs and file I/O logs reveals that pure POSIX I/O is used more widely than higher level parallel I/O. Based on holistic insights of the application gained through combined and co-analysis of multiple logs from different perspectives and general intuition, we engineer features to "fingerprint" HPC applications. We use t-SNE (a machine learning technique for dimensionality reduction) to validate the explainability of our features and finally train machine learning models to identify HPC applications or group those with similar characteristic. To the best of our knowledge, this is the first work that combines logs on file I/O, computing, and inter-node communication for insightful analysis of HPC applications in production.

Liu, Zhengchun↗

DOE OSTI2022

kevinyager/SciTools

Collection of tools (Python scripts) for scientific experiments: SciAnalysis (analyze image-like data), SciControl (instrument control), and SciVis (visualize data).

Yager, Kevin [Brookhaven National Lab. (BNL), Upto↗

DOE OSTI2023

UWLi (Universal Workflow Language Interface) [SWR-24-12]

UWLi is a user interface for modifying Universal Workflow Language (UWL) files. UWL is a data format used to represent high fidelity scientific procedures in a generalized, field agnostic workflow format. See related publication: https://arxiv.org/pdf/2409.05899

Epps, Robert↗

DOE OSTI2026

BoBa

BoBa is a C++ software library for working with large matrices, tensors, and tensor decompositions. The library provides tools for dense matrix and tensor operations, tensor decompositions, and tensor decomposition methods that support modern CPU and GPU architectures. It includes portable abstractions for linear algebra, tensor algebra, and multidimensional computation. BoBa is intended for scientific computing applications that involve large multidimensional data sets or high dimensional mathematical models. Its capabilities support tasks such as data compression, linear algebra, efficient numerical computation, and the development of scalable algorithms for heterogeneous hardware. Tutorials, tests, and example applications are included to help users learn and apply the library.

Yao, Jin [Lawrence Livermore National Laboratory (↗

DOE OSTI2024

Large emissions of CO2 and CH4 due to active-layer warming in Arctic tundra: Supporting Data

Climate warming may accelerate decomposition of Arctic soil carbon, but few controlled experiments have manipulated the entire active layer. To determine surface-atmosphere fluxes of carbon dioxide and methane under anticipated end-of-century warming, we used heating rods to warm soil (by 3.8 °C) to the depth of permafrost in polygonal tundra over two growing seasons at the Barrow Environmental Observatory in Utqiaġvik (formerly Barrow), Alaska. This data product includes supporting data for the companion paper entitled "Large emissions of CO2 and CH4 due to active-layer warming in Arctic tundra", published in Nature Communications by Torn et al. This data package contains seven data files in csv format with corresponding data dictionaries and file-level metadata, describing vegetation biomass dry weight ("Utqiagvik_Vegetation_Biomass_2014.csv"), radiocarbon measurements of respired carbon dioxide ("Utqiagvik_Radiocarbon_2015_2016.csv"), surface-atmosphere fluxes of carbon dioxide and methane and associated soil temperature ("Utqiagvik_Fluxes_Temperature_2015_2016.csv"), and soil temperature measurements averaged every 15-min and 1-hr for 2015 and 2016 ("Utqiagvik_Temperature_15min_2015.csv", "Utqiagvik_Temperature_15min_2016.csv", "Utqiagvik_Temperature_1hr_2015.csv", "Utqiagvik_Temperature_1hr_2016.csv"). There are no specific software requirements to use these data. UIC Science Native Corporation facilitated our scientific research on the Barrow Environmental Observatory, which is Iñupiat land.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

PETSc Users Manual (Rev. 3.13)

This manual describes the use of PETSc for the numerical solution of partial differential equations and related problems on high-performance computers. The Portable, Extensible Toolkit for Scientific Computation (PETSc) is a suite of data structures and routines that provide the building blocks for the implementation of large-scale application codes on parallel (and serial) computers. PETSc uses the MPI standard for all message-passing communication. PETSc includes an expanding suite of parallel linear solvers, nonlinear solvers, and time integrators that may be used in application codes written in Fortran, C, C++, and Python. PETSc provides many of the mechanisms needed within parallel application codes, such as parallel matrix and vector assembly routines. The library is organized hierarchically, enabling users to employ the level of abstraction that is most appropriate for a particular problem. By using techniques of object-oriented programming, PETSc provides enormous flexibility for users. PETSc is a sophisticated set of software tools; as such, for some users it initially has a much steeper learning curve than a simple subroutine library. In particular, for individuals without some computer science background, experience programming in C, C++, python, or Fortran and experience using a debugger such as gdb or dbx, it may require a significant amount of time to take full advantage of the features that enable efficient software use. However, the power of the PETSc design and the algorithms it incorporates may make the efficient implementation of many application codes simpler than \rolling them" yourself.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Advancing Theory and Modeling Efforts in Heliophysics

Heliophysics theory and modeling build understanding from fundamental principles to motivate, interpret, and predict observations. Together with observational analysis, they constitute a comprehensive scientific program in heliophysics. As observations and data analysis become increasingly detailed, it is critical that theory and modeling develop more quantitative predictions and iterate with observations. Advanced theory and modeling can inspire and greatly improve the design of new instruments and increase their chance of success. In addition, in order to build physicsbased space weather forecast models, it is important to keep developing and testing new theories, and maintaining constant communications with theory and modeling. Maintaining a sustainable effort in theory and modeling is critically important to heliophysics. We recommend that all funding agencies join forces and consider expanding current and creating new theory and modeling programs–especially, 1. NASA should restore the HTMS program to its original support level to meet the critical needs of heliophysics science; 2. a Strategic Research Model program needs to be created to support model development for next-generation basic research codes; 3. new programs must be created for addressing mission-critical theory and modeling needs; and 4. enhanced programs are urgently required for training the next generation of theorists and modelers.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2023

Abbreviated Technical Report: Experimentally Interrogating Detonation Chemistry on Sub-Nanosecond to Nanosecond Timescales

Direct experimental measurement of chemical reactions during high explosive detonation remains challenging. Theory and modeling have long preceded experiment in the fundamental physical and chemical kinetic properties of detonation, and experimentation at the relevant timescales are needed to both validate models and provide fundamental understanding of detonation. In this LDRD-ER project, two approaches, x-ray diffraction and core-level x-ray Raman, were developed and used to further experimental capabilities to address this gap. We further developed dynamic x-ray diffraction to directly detect nanodiamond formation during detonation, providing experimental data towards resolving longstanding controversy in the scientific literature, and although the full kinetics have not yet been fully mapped, diamond diffraction appears on the same timescales as detonation soot formation. In the second research thrust, we have developed core-level x-ray Raman for use with high explosives. This technique provides information analogous to x-ray absorption spectroscopy and electron energy loss spectroscopy, but uses inelastic scattering of hard x-rays that can interrogate chemistry around light elements much deeper into the material. The low cross section and requisite high solid angle collection have hindered its use for ultra-fast spectroscopy. We developed and tested a high-q spectrometer which will substantially increase cross section and signal-to-noise, showing this method will also not dramatically alter, compared to x-ray absorption, the most discriminating spectral features of C, N, and O from various high explosives and expected detonation products. We have also used x-ray Raman combined with OCEAN electronic structure calculations to explore dynamic photodegradation mechanisms in PETN and CL-20 explosives. This provides a pathway towards implementing capability to dynamically explore chemistry at an x-ray free electron laser.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Mass Spectrometry Sample Submission Portal

Each step in the scientific process generates contextual information about the data that is important to consider when performing data integration, developing models of biological process, or training AI models. We will develop a flexible, template-driven tool that will log biological samples, capture metadata about those samples, and track the type(s) of analysis being performed by researchers providing samples for analysis by mass spectrometry.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

New Particle Formation and Growth in the Houston Atmosphere During TRACER (Final Report)

From 2020-2025, researchers from UC Irvine, UC Riverside, and Colorado State University collaborated on a Department of Energy-funded project to understand how airborne particles form and grow in urban atmospheres, conducting an intensive field campaign in Houston, Texas during summer 2022. Using advanced instruments to measure gas-phase chemicals, particle composition, and a specialized chamber to study particle growth, the team discovered that sulfur-containing compounds from industrial and power plant emissions are the dominant driver of new particle formation in Houston, with particles typically forming locally in the city and growing as air moves away in the urban plume. The research revealed an important methodological insight: measurements from fixed ground stations can be misleading when interpreting how particles actually evolve as air masses move, which has significant implications for how scientists worldwide interpret atmospheric observations. These findings improve understanding of urban air quality and help reduce uncertainties in climate models, since these particles play critical roles in cloud formation and Earth's radiation balance, while also providing detailed information about ultrafine particle composition relevant to public health. The project trained three doctoral students, developed enhanced computer models for urban particle formation, and made all data publicly available through the DOE Atmospheric Radiation Measurement data archive for use by the broader scientific community.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Materials Characterization, Prediction, and Control Project: Summary Report on Material Characterization, Part 1

The Pacific Northwest National Laboratory (PNNL) undertook the Materials Characterization, Prediction, and Control (MCPC) Laboratory Directed Research and Development Project to advance understanding of nuclear material processing and enable multifold acceleration in the development and qualification of new material systems in national security and advanced energy applications (Smith 2021). The MCPC Project executed research across three scientific vertices—material characterization, predictive modeling, and data analytics—with extensive support by a data curation and management team. The central technical objective in the MCPC Project was to improve the prediction and characterization of the process-structure-property relationships within the microstructurally refined region of stainless-steel samples prepared utilizing friction stir processing (FSP). Application of the FSP technique is well established at PNNL within the Solid Phase Processing capability through many years of investment across a range of materials and applications (PNNL 2024). Three distinct rounds of FSP experiments were performed by the experimental team, producing replicate samples utilizing across different nominal processing conditions (Condition IDs) listed in Table 1. The starting material on which FSP was applied was commercially available unprocessed stainless-steel type 316L material. Chosen processing conditions were very diverse, and some were intentionally chosen to produce defects. Several samples experienced tool breakage during experimentation, so a full set of three replicates was not produced for every nominal processing condition.

36 MATERIALS SCIENCE↗

DOE OSTI2024

Materials Characterization, Prediction, and Control Project: Summary Report on Material Characterization, Part 2

36 MATERIALS SCIENCE↗

DOE OSTI2024

Materials Characterization, Prediction, and Control Project: Summary Report on Material Characterization, Part 3

36 MATERIALS SCIENCE↗