Results for “distributed databases” — Page 43

DOE OSTI2023

A Data Processing Pipeline for Socio-Technical Network Analysis [Slides]

With the rapid adoption of emerging technologies, there is a need to catalog and model sociotechnical interdependencies that have been historically used to influence the operation of Critical Infrastructure networks including the impacts of mergers and acquisitions, hostile takeovers, and foreign investment. Our research intends to address this need with two primary contributions. First, we have developed a data curation and processing pipeline to generate sociotechnical networks extracted from a variety of data sources including SEC filings and infrastructure asset databases. The pipeline, implemented in Apache Airflow, extracts and normalizes the representation of entities and relations, specified within ontologies. Second, networks produced by our pipeline enable the development of graph-theoretic metrics that consider the properties of network components in addition to its topology. Measures of network complexity, such as degree distribution, reachability analyses, temporal analysis, and community detection may be adapted to indicate adversarial organizational influence. Our intent is to provide an extensible, machine-actionable approach to quickly communicate such models, reproduce previous results, and adapt them to new, unanticipated situations.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Mesh-Sequenced Realizations for Evaluation of Subgrid-Scale Models for Turbulent Combustion

This paper develops a new approach for analysis of subgrid closures for turbulent combustion as modeled using direct quadrature (finite-rate chemistry) techniques. The approach, termed multiresolution analysis through mesh-sequenced realizations (MRA-MSR), conducts simultaneous, constrained large-eddy simulations on a set of hierarchically coarsened meshes. Furthermore, the availability of underlying fine-mesh (subgrid) data corresponding to coarse-mesh locations allows a clearer assessment of the effects of unresolved fluctuations on apparent reactivity. A key to MRA-MSR is the correlation of eddy structures at coarser mesh levels, which is facilitated by the transfer of filtered fine-mesh velocity information. A seven-mesh MRA-MSR hierarchy using three resolution levels is applied to one of the Sydney bluff-body stabilized methane–hydrogen flames. Analysis of the simultaneously evolved data at different resolution levels reveals several interesting trends. First, at high Damköhler numbers, there is clear evidence of attenuation of apparent reactivity due to the effects of unresolved fluctuations. Secondly, single-point, single-time filtered density functions of a normalized subgrid Damköhler number show a characteristic beta probability density function (PDF) form and display evidence of scale similarity. Interrogation of the MRA-MSR database also shows that the recently-proposed least-squares minimization (LSM) turbulence–chemistry interaction model can account for the observed diminishment in reactivity at high Damköhler numbers but cannot reduce scatter significantly. A new form of the LSM model, which makes use of the normalized subgrid Damköhler number beta PDF distribution, performs slightly better than the original model, illustrating the potential of MRA-MSR both in assessing existing closure concepts and in developing new ones.

42 ENGINEERING↗

NASA NTRS1987

Flowfield characteristics of an axisymmetric 180-degree turnaround duct

In an attempt to provide an experimental database for computational fluid dynamics turbulence code evaluation and development, an experiment was conducted using an annular axisymmetric 180-deg turnaround passage through which air flows at close to ambient conditions. Measurements made at a nominal gap Reynolds number of 100,000 are presented; these are the static and fluctuating wall pressure distributions and the one- and two-component velocity profiles at various stations upstream, through, and downstream of the bend. Because of the large favorable pressure gradients on the inner wall up to 51 degrees, the flow experiences a large acceleration close to the wall; enhanced mixing occurs close to the outer wall. Downstream of this location, the flow close to the inner wall experiences an adverse pressure gradient before separating at about 150 degrees.

Ostermier, B. J.↗

NASA NTRS1993

The Visible Human Project of the National Library of Medicine: Remote access and distribution of a multi-gigabyte data set

As part of the 1986 Long-Range Plan for the National Library of Medicine (NLM), the Planning Panel on Medical Education wrote that NLM should '...thoroughly and systematically investigate the technical requirements for and feasibility of instituting a biomedical images library.' The panel noted the increasing use of images in clinical practice and biomedical research. An image library would complement NLM's existing bibliographic and factual database services and would ideally be available through the same computer networks as are these current NLM services. Early in 1989, NLM's Board of Regents convened an ad hoc planning panel to explore possible roles for the NLM in the area of electronic image libraries. In its report to the Board of Regents, the NLM Planning Panel on Electronic Image Libraries recommended that 'NLM should undertake a first project building a digital image library of volumetric data representing a complete, normal adult male and female. This Visible Human Project will include digitized photographic images for cryosectioning, digital images derived from computerized tomography, and digital magnetic resonance images of cadavers.' The technologies needed to support digital high resolution image libraries, including rapid development; and that NLM encourage investigator-initiated research into methods for representing and linking spatial and textual information, structural informatics. The first part of the Visible Human Project is the acquisition of cross-sectional CT and MRI digital images and cross-sectional cryosectional photographic images of a representative male and female cadaver at an average of one millimeter intervals. The corresponding cross-sections in each of the three modalities are to be registerable with one another.

Ackerman, Michael J.↗

DOE OSTI2022

Global centroid moment tensor solutions in a heterogeneous earth: the CMT3D catalogue

SUMMARY For over 40 yr, the global centroid-moment tensor (GCMT) project has determined location and source parameters for globally recorded earthquakes larger than magnitude 5.0. The GCMT database remains a trusted staple for the geophysical community. Its point-source moment-tensor solutions are the result of inversions that model long-period observed seismic waveforms via normal-mode summation for a 1-D reference earth model, augmented by path corrections to capture 3-D variations in surface wave phase speeds, and to account for crustal structure. While this methodology remains essentially unchanged for the ongoing GCMT catalogue, source inversions based on waveform modelling in low-resolution 3-D earth models have revealed small but persistent biases in the standard modelling approach. Keeping pace with the increased capacity and demands of global tomography requires a revised catalogue of centroid-moment tensors (CMT), automatically and reproducibly computed using Green's functions from a state-of-the-art 3-D earth model. In this paper, we modify the current procedure for the full-waveform inversion of seismic traces for the six moment-tensor parameters, centroid latitude, longitude, depth and centroid time of global earthquakes. We take the GCMT solutions as a point of departure but update them to account for the effects of a heterogeneous earth, using the global 3-D wave speed model GLAD-M25. We generate synthetic seismograms from Green's functions computed by the spectral-element method in the 3-D model, select observed seismic data and remove their instrument response, process synthetic and observed data, select segments of observed and synthetic data based on similarity, and invert for new model parameters of the earthquake’s centroid location, time and moment tensor. The events in our new, preliminary database containing 9382 global event solutions, called CMT3D for ‘3-D centroid-moment tensors’, are on average 4 km shallower, about 1 s earlier, about 5 per cent larger in scalar moment, and more double-couple in nature than in the GCMT catalogue. We discuss in detail the geographical and statistical distributions of the updated solutions, and place them in the context of earlier work. We plan to disseminate our CMT3D solutions via the online ShakeMovie platform.

58 GEOSCIENCES↗

NASA NTRS1990

An analysis of space power system masses

Various space electrical power system masses are analyzed with particular emphasis on the power management and distribution (PMAD) portion. The electrical power system (EPS) is divided into functional blocks: source, interconnection, storage, transmission, distribution, system control and load. The PMAD subsystem is defined as all the blocks between the source, storage and load, plus the power conditioning equipment required for the source, storage and load. The EPS mass of a wide range of spacecraft is then classified as source, storage or PMAD and tabulated in a database. The intent of the database is to serve as a reference source for PMAD masses of existing and in-design spacecraft. The PMAD masses in the database range from 40 kg/kW to 183 kg/kW across the spacecraft systems studied. Factors influencing the power system mass are identified. These include the total spacecraft power requirements, total amount of load capacity and physical size of the spacecraft. It is found that a new utility class of power systems, represented by Space Station Freedom, is evolving.

Kenny, Barbara H.↗

NASA NTRS1990

An analysis of space power system masses

Various space electrical power system masses are analyzed with particular emphasis on the power management and distribution (PMAD) portion. The electrical power system (EPS) is divided into functional blocks: source, interconnection, storage, transmission, distribution, system control and load. The PMAD subsystem is defined as all the blocks between the source, storage and load, plus the power conditioning equipment required for the source, storage and load. The EPS mass of a wide range of spacecraft is then classified as source, storage or PMAD and tabulated in a database. The intent of the database is to serve as a reference source for PMAD masses of existing and in-design spacecraft. The PMAD masses in the database range from 40 kg/kW to 183 kg/kW across the spacecraft systems studied. Factors influencing the power system mass are identified. These include the total spacecraft power requirements, total amount of load capacity and physical size of the spacecraft. It is found that a new utility class of power systems, represented by Space Station Freedom, is evolving.

Kenny, Barbara H.↗

NASA NTRS1992

A passive microwave algorithm for tropical oceanic rainfall

This study discusses a rainfall algorithm utilizing six channels of microwave radiance data from the Nimbus-7 Scanning Multifrequency Microwave Radiometer. The algorithm is intended for short-term climate studies over the ocean at low latitudes. To find a set of functional relationships, rain rates are regressed on brightness temperatures for each channel. Next, these functions are integrated over a class of rain-rate distributions to find relations between mean brightness temperatures and mean rain rates. This step accounts for beam filling. Finally, weights are obtained for combining the rain rates from the individual channels. The weights vary with the rain rates, so that the optimum combination of channels is always used. Results are stored in a database grid 1 deg latitude x 1 deg longitude by one month. To test the algorithm, three years (1979-81) of data from the Indian Ocean are processed.

Hinton, Barry B.↗

NASA NTRS2007

A Comprehensive Plan for the Long-Term Calibration and Validation of Oceanic Biogeochemical Satellite Data

The primary objective of this planning document is to establish a long-term capability and validating oceanic biogeochemical satellite data. It is a pragmatic solution to a practical problem based primarily o the lessons learned from prior satellite missions. All of the plan's elements are seen to be interdependent, so a horizontal organizational scheme is anticipated wherein the overall leadership comes from the NASA Ocean Biology and Biogeochemistry (OBB) Program Manager and the entire enterprise is split into two components of equal sature: calibration and validation plus satellite data processing. The detailed elements of the activity are based on the basic tasks of the two main components plus the current objectives of the Carbon Cycle and Ecosystems Roadmap. The former is distinguished by an internal core set of responsibilities and the latter is facilitated through an external connecting-core ring of competed or contracted activities. The core elements for the calibration and validation component include a) publish protocols and performance metrics; b) verify uncertainty budgets; c) manage the development and evaluation of instrumentation; and d) coordinate international partnerships. The core elements for the satellite data processing component are e) process and reprocess multisensor data; f) acquire, distribute, and archive data products; and g) implement new data products. Both components have shared responsibilities for initializing and temporally monitoring satellite calibration. Connecting-core elements include (but are not restricted to) atmospheric correction and characterization, standards and traceability, instrument and analysis round robins, field campaigns and vicarious calibration sites, in situ database, bio-optical algorithm (and product) validation, satellite characterization and vicarious calibration, and image processing software. The plan also includes an accountability process, creating a Calibration and Validation Team (to help manage the activity), and a discussion of issues associated with the plan's scientific focus.

Hooker, Stanford B.↗

NASA NTRSDate not supplied

TPSAS-NF1676L-21193-DND

Researchers at NASA Langley Research Center have been developing an automated pattern recognition algorithm to identify overshooting convective cloud tops (OTs) in support of the GOES-R satellite program. This algorithm identify regions of overshooting at the individual 1-4 km geostationary satellite pixel scale using visible (during daytime only) and infrared channel imagery and numerical weather analysis data. The algorithm has been developed based upon analysis of 0.25-1 km spatial resolution Aqua MODIS imagery, using a database of over 2000 manually identified OT features throughout the world in storms with varying intensity and morphology. The OT database includes storms ranging from small, warm topped cells in Alaska and Mongolia, tornadic supercells over the U.S. Central Plains and Europe, large tropical mesoscale convective systems, and overshooting in the eyewalls and spiral bands of category 5 tropical cyclones. This database is available for use by the research community. The algorithm is designed to operate on data from any current and historical satellite imager, allowing for development of a highly accurate global OT detection climatology that extends back into the 1990's at up to a 15-30 min temporal resolution throughout the diurnal cycle. As members of the McIDAS Users Group, NASA LaRC has immediate access to the full global archive of geostationary imager data which would allows rapid development of OT climatologies and short-term databases. This type of capability has never been available within the weather and climate research community. Regional geostationary OT databases have been already developed over CONUS during SEAC4RS, for 18-years over the Eastern U.S., and for 5-10 years over Australia, Europe, Southeast Asia, and East Africa among many other regions. Some of these datasets are being used by climate researchers and private industry to examine UTLS-penetrating storm spatial distributions and their temporal variability, in addition to weather hazards associated with these storms at unprecedented spatial detail. This presentation will describe the OT pattern recognition algorithm and highlight recent product applications.

Kristopher Bedka↗

NASA NTRS2019

Decomposition of Electron Ionization Mass Spectra for Space Application Using a Monte-Carlo approach

Rationale: Quadrupole mass spectrometers equipped with an electron ionization (EI) sources have been widely used in space exploration to investigate the composition of planetary surfaces and atmospheres. However, the complexity of the samples and the minimal calibration for the fragmentation of molecules in the ionization chambers have prevented the deconvolution of the majority of the mass spectra obtained at different targets, thus limiting the determination of the exact composition of the samples analyzed. We propose a Monte‐Carlo approach to solve this issue mathematically. Methods: We decomposed simulated mass spectra of mixtures acquired with unit resolving power mass spectrometers and EI sources into the sum of the single components fragmentation patterns weighted by their relative concentration using interior‐point least‐square fitting. To fit compounds with poorly known fragmentation patterns, we used a Monte‐Carlo method to vary the intensity of individual fragment ions. We then decomposed the spectrum thousands of times to obtain a statistical distribution. Results: By performing the deconvolution on a mixture of seven different molecules with interfering fragmentation patterns (H2O, O2, CH4, Ar, N2, C2H4, and C2H6) we show that this approach retrieves the mixing ratio of the individual components more accurately than regular mass spectra decomposition methods that rely on fragmentation patterns from general databases. It also provides the probability density function for each species's mixing ratio. Conclusions: By removing the solution degeneracy in the decomposition of mass spectra, the method described herein could significantly increase the scientific retrieval from archived space flight mass spectrometry data, where calibration of the ionization source is no longer an option.

Thomas Gautier↗

NASA NTRSDate not supplied

Comparison of Bimodal Ice Shapes on Full-Chord and Hybrid CRM Midspan Models

An ice shape database has been created to document ice accretions on a full-chord length and hybrid versions of a 65 percent scale size of the mid-span section of the Common Research Model resulting from an exposure to a Super-cooled Large Drop (SLD) icing cloud with a bimodal drop size distribution. The ice shapes created were documented with photographs, laser scanned surface measurements over a section of the model span, and measurement of the ice mass over the same section of each ice accretion. Drop distribution effects were evaluated by using the same IRT icing conditions except with either monomodal or bimodal drop distributions. Ice shapes resulting from the bimodal distribution as well as from monomodal distributions of identical cloud droplet Median Volume Diameter (MVD) were obtained and compared. Results indicated that the ice shapes resulting from the monomodal and bimodal drop size distributions have similar 2D Maximum Combined Cross Section, or MCCS, ice shape around the model leading edge region and equivalent ice mass measurement per unit span to within the IRT SLD cloud calibration uncertainty, as expected with this approach, but the bimodal distributions have distinctly larger ice feathers that extended further back on the chord of the model. For most test conditions, the overall size and shape of the main ice accretions compared well between the full-chord and hybrid models.

Icing↗

NASA NTRSDate not supplied

Comparison of Bimodal Ice Shapes on Full-Chord and Hybrid CRM Midspan Models

An ice shape database has been created to document ice accretions on a full-chord length and hybrid versions of a 65 percent scale size of the mid-span section of the Common Research Model resulting from an exposure to a Super-cooled Large Drop (SLD) icing cloud with a bimodal drop size distribution. The ice shapes created were documented with photographs, laser scanned surface measurements over a section of the model span, and measurement of the ice mass over the same section of each ice accretion. Drop distribution effects were evaluated by using the same IRT icing conditions except with either monomodal or bimodal drop distributions. Ice shapes resulting from the bimodal distribution as well as from monomodal distributions of identical cloud droplet Median Volume Diameter (MVD) were obtained and compared. Results indicated that the ice shapes resulting from the monomodal and bimodal drop size distributions have similar 2D Maximum Combined Cross Section, or MCCS, ice shape around the model leading edge region and equivalent ice mass measurement per unit span to within the IRT SLD cloud calibration uncertainty, as expected with this approach, but the bimodal distributions have distinctly larger ice feathers that extended further back on the chord of the model. For most test conditions, the overall size and shape of the main ice accretions compared well between the full-chord and hybrid models

Icing , Simulation, Validation↗

NASA NTRSDate not supplied

Comparison of Bimodal Ice Shapes on Full-Chord and Hybrid CRM Midspan Models

An ice shape database has been created to document ice accretions on a full-chord length and hybrid versions of a 65 percent scale size of the mid-span section of the Common Research Model resulting from an exposure to a Super-cooled Large Drop (SLD) icing cloud with a bimodal drop size distribution. The ice shapes created were documented with photographs, laser scanned surface measurements over a section of the model span, and measurement of the ice mass over the same section of each ice accretion. Drop distribution effects were evaluated by using the same IRT icing conditions except with either monomodal or bimodal drop distributions. Ice shapes resulting from the bimodal distribution as well as from monomodal distributions of identical cloud droplet Median Volume Diameter (MVD) were obtained and compared. Results indicated that the ice shapes resulting from the monomodal and bimodal drop size distributions have similar 2D Maximum Combined Cross Section, or MCCS, ice shape around the model leading edge region and equivalent ice mass measurement per unit span to within the IRT SLD cloud calibration uncertainty, as expected with this approach, but the bimodal distributions have distinctly larger ice feathers that extended further back on the chord of the model. For most test conditions, the overall size and shape of the main ice accretions compared well between the full-chord and hybrid models.

Icing↗

DOE OSTI2024

AI-assisted detector design for the EIC (AID(2)E)

Artificial Intelligence is poised to transform the design of complex, large-scale detectors like ePIC at the future Electron Ion Collider. Featuring a central detector with additional detecting systems in the far forward and far backward regions, the ePIC experiment incorporates numerous design parameters and objectives, including performance, physics reach, and cost, constrained by mechanical and geometric limits. This project aims to develop a scalable, distributed AI-assisted detector design for the EIC (AID(2)E), employing state-of-the-art multiobjective optimization to tackle complex designs. Supported by the ePIC software stack and using G EANT 4 simulations, our approach benefits from transparent parameterization and advanced AI features. The workflow leverages the PanDA and iDDS systems, used in major experiments such as ATLAS at CERN LHC, the Rubin Observatory, and sPHENIX at RHIC, to manage the compute intensive demands of ePIC detector simulations. Tailored enhancements to the PanDA system focus on usability, scalability, automation, and monitoring. Ultimately, this project aims to establish a robust design capability, apply a distributed AI-assisted workflow to the ePIC detector, and extend its applications to the design of the second detector (Detector-2) in the EIC, as well as to calibration and alignment tasks. Additionally, we are developing advanced data science tools to efficiently navigate the complex, multidimensional trade-offs identified through this optimization process.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Scaling Ensembles of Data-Intensive Quantum Chemical Calculations for Millions of Molecules

Deep learning models are efficient computational tools that can accelerate the inverse design of molecules with desired functional properties by generating predictions at a fraction of the time required by traditional quantum chemical approaches. To ensure that a model maintains accuracy and transferability across broad regions of the chemical space explored during the inverse design, it must be trained on massively large volumes of simulation data. This requires running large-scale ensemble quantum chemical calculations on high-performance computing (HPC) systems for data collection. However, the efficient execution of such large ensemble calculations and the management of large volumes of output data require tools that can judiciously utilize computational resources and manage metadata overhead on the file system. Therefore, we present a high-performance, scalable, ensemble management framework for performing data-intensive quantum chemical electronic structure calculations for organic molecules. This framework provides abstractions to plug different ab initio, first principles, and first principles-based semi-empirical methods and executes them efficiently at large scale on HPC systems. It dynamically distributes tasks to resources and uses tiered storage for managing large collections of files. We employed this framework to process over ten million organic molecules and generate open-source datasets that provide UV-vis absorption spectra by running time-dependent density-functional tight-binding calculations. It is the largest database containing molecular optical spectra that were simulated with quantum chemical methods in a consistent manner.

Mehta, Kshitij↗

NASA NTRS1983

Constraints on gamma-ray bursters from soft X-ray transients

The Columbia Astrophysics Laboratory's Einstein imaging proportional counter database has been searched for possible X-ray counterparts to gamma ray bursts. The limiting sensitivity was about 10 to the 10th erg/sq cm with a total exposure of about 3 x 10 to the 6th s divided among about 1000 1 deg x 1 deg fields. Four events with a pointlike spatial distribution were detected but their extremely soft spectra makes them unlikely candidates for gamma ray burst counterparts. The results are used to place limits on the X-ray and gamma ray luminosity ratio and log(number)N-log(flux)S relation for gamma ray bursts. The constraints placed on models for their origin are commented on.

Helfand, D. J.↗

NASA NTRS1989

Methodology for analysis and simulation of large multidisciplinary problems

The Integrated Structural Modeling (ISM) program is being developed for the Air Force Weapons Laboratory and will be available for Air Force work. Its goal is to provide a design, analysis, and simulation tool intended primarily for directed energy weapons (DEW), kinetic energy weapons (KEW), and surveillance applications. The code is designed to run on DEC (VMS and UNIX), IRIS, Alliant, and Cray hosts. Several technical disciplines are included in ISM, namely structures, controls, optics, thermal, and dynamics. Four topics from the broad ISM goal are discussed. The first is project configuration management and includes two major areas: the software and database arrangement and the system model control. The second is interdisciplinary data transfer and refers to exchange of data between various disciplines such as structures and thermal. Third is a discussion of the integration of component models into one system model, i.e., multiple discipline model synthesis. Last is a presentation of work on a distributed processing computing environment.

Russell, William C.↗