Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Science”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71

Operator inference with roll outs for learning reduced models from scarce and low-quality data

Data-driven modeling has become a key building block in computational science and engineering. However, data that are available in science and engineering are typically scarce, often polluted with noise and affected by measurement errors and other perturbations, which makes learning the dynamics of systems challenging. Here, in this work, we propose to combine data-driven modeling via operator inference with the dynamic training via roll outs of neural ordinary differential equations. Operator inference with roll outs inherits interpretability, scalability, and structure preservation of traditional operator inference while leveraging the dynamic training via roll outs over multiple time steps to increase stability and robustness for learning from low-quality and noisy data. Numerical experiments with data describing shallow water waves and surface quasi-geostrophic dynamics demonstrate that operator inference with roll outs provides predictive models from training trajectories even if data are sampled sparsely in time and polluted with noise of up to 10%.

97 MATHEMATICS AND COMPUTING↗

EXFOR-NSR PDF database: a system for nuclear knowledge preservation and data curation

Current needs of nuclear science and technology include complete, well-documented, and easily verifiable nuclear data. The complete data records require supporting nuclear bibliography, presently stored in dedicated libraries, in addition, to actual data. Additionally, experimental nuclear reaction data (EXFOR) and Nuclear Science References (NSR) databases contain compilations based on primary (journals) and secondary (conference proceedings, theses, preprints, etc.) publications, and data received from authors via private communications. The secondary library materials and private communications often represent a bottleneck for nuclear data verification, compilation, evaluation, and dissemination activities. To address this issue, bibliographic materials were scanned into PDF (Portable Document Format) files and uploaded in a relational database. The traditional scope of nuclear databases that includes meta-data and numbers derived from data in specialized formats was broadened to accommodate the large volumes of original nuclear data publications. The complete PDF publication files were stored in a relational database as Binary Large OBjects (BLOB). This unique collection of nuclear data compilations and supporting publications generate many opportunities for machine learning applications. The Web interfaces for authorized and public access to the EXFOR-NSR nuclear publications database were implemented at the U.S. National Nuclear Data Center, https://www.nndc.bnl.gov/ and IAEA Nuclear Data Section, https://www-nds.iaea.org/ . The current system is complementary to major nuclear libraries and narrowly focused on nuclear data compilation and evaluation procedures. The contents of the PDF database, details of implementation, and Web interface are described. New capabilities for data curation, knowledge preservation, worldwide dissemination, and natural language processing (NLP) applications are given.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

From multivariate to functional data analysis: Fundamentals, recent developments, and emerging areas

Functional data analysis (FDA), which is a branch of statistics on modeling infinite dimensional random vectors resided in functional spaces, has become a major research area for Journal of Multivariate Analysis. We review some fundamental concepts of FDA, their origins and connections from multivariate analysis, and some of its recent developments, including multi-level functional data analysis, high-dimensional functional regression, and dependent functional data analysis. Here, we also discuss the impact of these new methodology developments on genetics, plant science, wearable device data analysis, image data analysis, and business analytics. Two real data examples are provided to motivate our discussions.

97 MATHEMATICS AND COMPUTING↗

The Calar Alto Legacy Integral Field Area survey: extended and remastered data release

ABSTRACT This paper describes the extended data release (eDR) of the Calar Alto Legacy Integral Field Area (CALIFA) survey. It comprises science-grade quality data for 895 galaxies obtained with the Potsdam Multi Aperture Spectograph/PPak instrument at the 3.5-m telescope at the Calar Alto Observatory along the last 12 yr, using the V500 setup [3700–7500 Å, 6 Å/full-width at half-maximum (FWHM)] and the CALIFA observing strategy. It includes galaxies of any morphological type, star formation stage, a wide range of stellar masses (∼107–1012 M⊙), at an average redshift of ∼0.015 (90 per cent within 0.005 < z < 0.05). Primarily selected based on the projected size and apparent magnitude, we demonstrate that it can be volume corrected resulting in a statistically limited but representative sample of the population of galaxies in the nearby Universe. All the data were homogeneous re-reduced, introducing a set of modifications to the previous reduction. The most relevant is the development and implementation of a new cube-reconstruction algorithm that provides with an (almost) seeing-limited spatial resolution (FWHMPSF ∼ 1.0 arcsec). To illustrate the usability and quality of the data, we extracted two aperture spectra for each galaxy (central 1.5 arcsec and fully integrated), and analyse them using pyFIT3D. We obtain a set of observational and physical properties of both the stellar populations and the ionized gas, that have been compared for the two apertures, exploring their distributions as a function of the stellar masses and morphologies of the galaxies, comparing with recent results in the literature.

Sánchez, S. F. (ORCID:0000000164449307)↗

Exploring High-Dimensional Data Space: Identifying Optimal Process Conditions in Photovoltaics: Preprint

We demonstrate how advanced exploratory data analysis coupled to data-mining techniques can be used to scrutinize the high-dimensional data space of photovoltaics in the context of thin films of Al-doped ZnO (AZO), which are essential materials as a transparent conducting oxide (TCO) layer in CuInxGa1-xSe2 (CIGS) solar cells. AZO data space, wherein each sample is synthesized from a differentprocess history and assessed with various characterizations, is transformed, reorganized, and visualized in order to extract optimal process conditions. The data-analysis methods used include parallel coordinates, diffusion maps, and hierarchical agglomerative clustering algorithms combined with diffusion map embedding.

14 SOLAR ENERGY↗

DISCOVERY OF A MULTIPLY LENSED SUBMILLIMETER GALAXY IN EARLY HerMES HERSCHEL/SPIRE DATA

We report the discovery of a bright (f(250 {mu}m)>400 mJy), multiply lensed submillimeter galaxy HERMES J105751.1+573027 in Herschel/SPIRE Science Demonstration Phase data from the HerMES project. Interferometric 880 {mu}m Submillimeter Array observations resolve at least four images with a large separation of {approx}9''. A high-resolution adaptive optics K{sub p} image with Keck/NIRC2 clearly shows strong lensing arcs. Follow-up spectroscopy gives a redshift of z = 2.9575, and the lensing model gives a total magnification of {mu} {approx} 11 {+-} 1. The large image separation allows us to study the multi-wavelength spectral energy distribution (SED) of the lensed source unobscured by the central lensing mass. The far-IR/millimeter-wave SED is well described by a modified blackbody fit with an unusually warm dust temperature, 88 {+-} 3 K. We derive a lensing-corrected total IR luminosity of (1.43 {+-} 0.09) x 10{sup 13} L{sub sun}, implying a star formation rate of {approx}2500 M{sub sun} yr{sup -1}. However, models primarily developed from brighter galaxies selected at longer wavelengths are a poor fit to the full optical-to-millimeter SED. A number of other strongly lensed systems have already been discovered in early Herschel data, and many more are expected as additional data are collected.

79 ASTRONOMY AND ASTROPHYSICS↗

A customizable data management framework for high-repetition-rate high-energy-density science

The high-energy-density (HED) physics community is moving toward a new paradigm of high-repetition-rate (HRR) operation. To fully leverage the scientific power of HRR HED facilities, all of the components of each subsystem (laser, targetry, and performance diagnostics) must be connected and synchronized in a reliable and robust manner while the data acquired are tagged and archived in real time. To this end, GA has begun developing a generalized NoSQL-database framework, the MongoDB repository for information and archiving. An organizational strategy has been developed that shifts HED data organization from a shot-based to a diagnostic-based approach in order to increase archival and retrieval efficiency that lends itself to optimization applications. This work is a first step in pushing HRR HED science toward data management solutions that emphasize machine actionability and aim to stimulate community engagement to define data standards in HED science.

Instruments & Instrumentation↗

Data-Driven Analysis Tool Plays Critical Role in Climate Neutral Buildings: Improving energy efficiency and reducing emissions

A new web application that advances the science of data-driven, remote building energy analysis to increase the speed and scale of retrofits worldwide could play a key role in reducing greenhouse gas (GHG) emissions and meeting the Paris Agreement's targets. Here, the multi-award-winning Building Efficiency Targeting Tool for Energy Retrofits (BETTER) is a public access web application (better.lbl.gov) sponsored by the U.S. Department of Energy (DOE) and developed by Lawrence Berkeley National Laboratory (Berkeley Lab) and Johnson Controls.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Systematics in the XENON1T data: The 15-keV anti-axion

The XENON1T collaboration Aprile et al. [2020] has found an excess of electron recoil events in their Science Run 1 data below ~7 keV with a spectral shape consistent with that expected from a solar-axion-induced signal. The claimed statistical significance of the solar-axion model over the null hypothesis is 3.5σ. In this work we provide suggestive evidence for mismodeling in the electron recoil data that may decrease the local significance of the axion model. To reach this conclusion, we search for a signal with the spectral template of the solar axion model, but shifted to higher (unphysical) energies above ~7 keV. We find that the distribution of significances found from this side-band analysis does not follow the expected chi-square distribution. For example, we find a high-significance feature in the data, with a global $p$-value $p≈0.026$, when the solar axion model is shifted upwards in energy by ~15 keV and allowed to have a negative normalization. We argue that such statistical tests, if performed a priori, provide a data-driven way to test and potentially account for systematic uncertainties on the background model in low-threshold dark matter experiments.

79 ASTRONOMY AND ASTROPHYSICS↗

Board on Research Data and Information

The Board on Research Data and Information (BRDI) has planned and undertaken numerous activities regarding data citation, attribution, management, policy, publishing, centers, access, curation, sharing, and infrastructure; and international collaboration and cooperation. Some of these activities resulted in National Research Council reports (For Attribution: Developing Data Attribution and Citation Practices and Standards (2012), The Case for International Scientific Data Sharing: A Focus on Developing Countries (2012), and The Future of Scientific Knowledge Discovery in Open Networked Environments (2012); and a peer-reviewed paper (Out of Cite, Out of Mind: The Current State of Practice, Policy, and Technology for the Citation of Data, 2013). BRDI held symposia, workshops and sessions in the U.S. and abroad on diverse topics such as global scientific data infrastructures, discovery of data online, privacy in a big data world, and data citation principles, among other timely data-related subjects. In addition, BRDI effects the representation of the United States before the International Council for Science’s International Committee on Data for Science and Technology (CODATA).

99 GENERAL AND MISCELLANEOUS↗

Network performance analysis for HPC datacenters (net_perf) v1.0

The software has two main features: (1) identify data movement trends in HPC data centers that use network flow monitoring (2) analyze the performance of individual data flows under the existing data movement management strategy and identify performance bottlenecks that impede timely data availability for science workflows. Its main advantage is that it is tailored for HPC network traffic by considering HPC data movement management intricacies.

Giannakou, Anna↗

ExaFEL: extreme-scale real-time data processing for X-ray free electron laser science

ExaFEL is an HPC-capable X-ray Free Electron Laser (XFEL) data analysis software suite for both Serial Femtosecond Crystallography (SFX) and Single Particle Imaging (SPI) developed in collaboration with the Linac Coherent Lightsource (LCLS), Lawrence Berkeley National Laboratory (LBNL) and Los Alamos National Laboratory. ExaFEL supports real-time data analysis via a cross-facility workflow spanning LCLS and HPC centers such as NERSC and OLCF. Our work therefore constitutes initial path-finding for the US Department of Energy's (DOE) Integrated Research Infrastructure (IRI) program. We present the ExaFEL team's 7 years of experience in developing real-time XFEL data analysis software for the DOE's exascale supercomputers. We present our experiences and lessons learned with the Perlmutter and Frontier supercomputers. Furthermore we outline essential data center services (and the implications for institutional policy) required for real-time data analysis. Finally we summarize our software and performance engineering approaches and our experiences with NERSC's Perlmutter and OLCF's Frontier systems. This work is intended to be a practical blueprint for similar efforts in integrating exascale compute resources into other cross-facility workflows.

59 BASIC BIOLOGICAL SCIENCES↗

Measurement of the free neutron lifetime in a magneto-gravitational trap with in situ detection

Here, in this study, we publish three years of data from the UCNτ experiment performed at the Los Alamos Ultracold Neutron Facility at the Los Alamos Neutron Science Center. These data are in addition to our previously published data. Our goals in this paper are to better understand and quantify systematic uncertainties and to improve the lifetime statistical precision. We previously reported a value from our 2017–2018 data for the neutron lifetime of 877.75 ± 0.28 (statistical) +0.22–0.16 (systematic) s. We have collected an additional three years of data reported here for the first time. When all the data from UCNτ are averaged for 2017, 2018, 2020, 2021, and 2022, we report an updated value for the lifetime of 877.83 ± 0.22 (statistical)+0.20–0.17 (systematic) s. We utilized improved monitor detectors, reduced our correction due to UCN upscattering on residual gas, and employed four different UCN detector geometries both to reduce the correction required for rate dependence and to explore potential contributions due to phase space evolution.

Cabibbo-Kobayashi-Maskawa matrix↗

A Python Module for Storing CCD Images with openPMD (openPMD-CCD) v0.1.0

openPMD is an open meta-data schema that provides meaning and self-description to data sets in science and engineering. The openPMD-CCD software module adds interfaces to organize camera (CCD) images in hierarchical data files. This software provides modern I/O storage formats from high-performance computing and provides bindings for integration into experimental control systems, e.g. via Python 3 and LabView 2020.

Gonsalves, AnthonyJ↗

NARSTO.ORG: Historical NARSTO Program Assessments and Website Contents, 1995-2010

This package contains the Historical NARSTO Program Assessments and Website Content. NARSTO was a public/private partnership dedicated to improving management of air quality in North America. It was established on February 13, 1995 when representatives of Canada, the United States, and Mexico signed the NARSTO Charter in a ceremony at the White House. (Originally North American Research Strategy for Tropospheric Ozone.) The NARSTO organization, having met the goals of its 1995 charter, was disbanded as of December 31, 2010. Since its founding, NARSTO has completed four major scientific Assessments of critical air quality management issues. NARSTO maintained the Quality Systems Science Center and the NARSTO Data Archive for storing data from NARSTO Affiliated Research Activities and making these data available to the scientific community. NARSTO also facilitated activities, such as the Reactivity Research Working Group, which provide critical reviews of the state of the science in areas of interest to air quality policy makers. NARSTO worked to improve collaboration between the air-quality and health-sciences research communities, to advance understanding of the scientific issues involved in effecting a multi-pollutant/multi-media approach to air quality management, and to increase understanding of the linkages between air quality and climate change.The NARSTO assessments and narsto.org website content are available at this data archive and may be downloaded in one .zip file. Data from NARSTO sponsored field campaigns will remain available through the Permanent Data Archive maintained by the NASA Langley Research Center Atmospheric Science Data Center (https://asdc.larc.nasa.gov/project/NARSTO).

54 ENVIRONMENTAL SCIENCES↗

Improving Ligand Geometry in Protein Data Bank Structures Computationally

Information about the three‐dimensional structures of complex biological molecules is an indispensable research tool for many fields of study, including biology, chemistry, pharmacology, and computer science. The Protein Data Bank (PDB) is an public digital archive providing access to structures of nucleic acids, proteins, and large macromolecular machines determined experimentally by X‐ray crystallography, nuclear magnetic resonance (NMR) spectroscopy, and 3‐dimensional electron microscopy (3DEM). PDB structures undergo validation for structural plausibility upon their deposition into the PDB using the program Mogul, which cross references each deposited structure against similar data in the Cambridge Structural Database (CSD). Ligands associated with PDB structures are a common source of structural inaccuracy. In this study, a programmatic pipeline was developed to determine if ligand geometric accuracy could be improved using known computational tools. Ligands with dubious geometry were identified through a Python mining code. A sample set of the identified structures was remodeled into minimum energy conformations using the molecular dynamics program AMBER and then fit to the original experimental density maps using the molecular modeling program Coot. The refined models were compared to the original models in the PDB as well as to similar structures in the CSD using the deposition statistical validation server. Preliminary results suggest that the pipeline effectively identifies and improves ligand structures that possess inaccurate geometry. This method can be used to evaluate and improve the accuracy of specific ligands in structures both archived and pending deposition. Support or Funding Information This work was supported by an NSF REU and the RCSB PDB [NSF (DBI‐1338415), NIH, and DOE.] This abstract is from the Experimental Biology 2019 Meeting. There is no full text article associated with this abstract published in The FASEB Journal .

Miller, Beck↗

Discharge data collected within the East River for the Lawrence Berkeley National Laboratory Watershed Function Science Focus Area (water years 2015-present)

Discharge data collected at the East River in the Upper Colorado River Basin for the Lawrence Berkeley National Laboratory's Watershed Function Scientific Focus Area. Files contain instantaneous observed discharge data, corrected 10 min and mean daily discharge. Several sites also contain temperature and transducer depth. Please contact Rosemary Carroll if you have any questions or wish to access the raw data.

54 ENVIRONMENTAL SCIENCES↗

The DES Science Verification weak lensing shear catalogues

Here, we present weak lensing shear catalogues for 139 square degrees of data taken during the Science Verification (SV) time for the new Dark Energy Camera (DECam) being used for the Dark Energy Survey (DES). We also describe our object selection, point spread function estimation and shear measurement procedures using two independent shear pipelines, IM3SHAPE and NGMIX, which produce catalogues of 2.12 million and 3.44 million galaxies, respectively. Furthermore, we detail a set of null tests for the shear measurements and find that they pass the requirements for systematic errors at the level necessary for weak lensing science applications using the SV data. Finally, we discuss some of the planned algorithmic improvements that will be necessary to produce sufficiently accurate shear catalogues for the full 5-yr DES, which is expected to cover 5000 square degrees.

79 ASTRONOMY AND ASTROPHYSICS↗