Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Distribution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Recent Experience with the CMS Data Management System

The CMS[1] experiment manages a large-scale data infrastructure, currently handling over 200 PB of disk and 500 PB of tape storage and transferring more than 1 PB of data per day on average between various WLCG[2] sites. Utilizing Rucio[3] for high-level data management, FTS[4] for data transfers, and a variety of storage and network technologies at the sites, CMS confronts inevitable challenges due to the system’s growing scale and evolving nature. Key challenges include managing transfer and storage failures, optimizing data distribution across different storages based on production and analysis needs, implementing necessary technology upgrades and migrations, and efficiently handling user requests. The data management team has established comprehensive monitoring to supervise this system and has successfully addressed many of these challenges. The team’s efforts aim to ensure data availability and protection, minimize failures and manual interventions, maximize transfer throughput and resource utilization, and provide reliable user support. This paper details the operational experience of CMS with its data management system in recent years, focusing on the encountered challenges, the effective strategies employed to overcome them and the ongoing challenges as we prepare for future demands.

Öztürk, Hasan [CERN]↗
DOE OSTI2022

A High-Throughput Computing Infrastructure to Generate Custom, Open Community Geothermal Datasets

The most significant challenge facing geothermal research, development, and deployment is a lack of comprehensive datasets describing the geological and economical properties of North America. Automated knowledge base construction, the process of designing algorithms to analyze text and images to programmatically build new datasets, is one possible solution to this problem. The xDD library of full-text scientific articles (https://xdd.wisc.edu) is one of the largest collections of open and controlled-access scientific documents available for knowledge base construction in the world, but it has been underutilized by experts in geothermal research. The xDD development team attributed the lack of engagement by software developers and geothermal researchers to two perceived shortcomings of the system. First, the workflow for obtaining data from xDD for local development and testing of data mining applications was unnecessarily abstruse and required significant manual intervention by xDD systems administrators. Second, although xDD already held articles from a broad cross-section of scientific literature with an emphasis on the geosciences, it did not have an explicit set of geothermal research documents that could serve as the nucleus of a geothermal data mining application. To address these issues, the Automated Data Extraction PlaTform (ADEPT) was proposed to extend the data distribution capabilities of the xDD system. The ADEPT extension added the following four key features to xDD: 1) integration of National Geothermal Data System (NGDS) documents into the xDD library to provide an explicitly geothermally-themed collection; 2) improved RESTful (i.e., https-protocol driven) web services for external partners to access xDD data for machine learning application development; 3) a web platform for end-users and xDD administrators to coordinate the development of data mining applications from the initial step of browsing available documents to the final stage of deploying a production-quality machine learning application on high-throughput computing infrastructure; and 4) the development of demonstration data mining applications to illustrate the new workflow to potential collaborators. A total of 21,674 geothermal documents from NGDS were fully ingested into the xDD library and the associated metadata is publicly available through the xDD web services; furthermore, the ADEPT web platform is now publicly accessible and fully live at https://xdd.wisc.edu/adept/.

15 GEOTHERMAL ENERGY↗
NASA NTRS1973

Lunar rocks as meteoroid detectors

About 5000 microcraters on seven lunar rocks recovered during the Apollo 12 mission have been systematically studied using a stereomicroscope. Based on comparisons with laboratory cratering experiments, at least 95 percent of all millimeter sized craters observed were formed by impacts in which the impact velocity exceeded 10 km/s. The dynamics of particle motion near the moon and the distribution of microcraters on the rocks require an extralunar origin for these impacting particles. The microcrater population on at least one side of all rocks studied was in equilibrium for millimeter sized craters; i.e., statistically, craters a few millimeters in diameter and smaller were being removed by the superposition of new craters at the same rate new craters were being formed. The population of craters on such a surface is directly related to the total population of particles impacting that surface. Crater size distribution data together with an experimentally determined relationship between the crater size and the physical parameters of the impacting particle, yield the mass distribution of interplanetary dust at 1 AU.

Hartung, J. B.↗
NASA NTRS1986

Statistics of the geomagnetic secular variation for the past 5Ma

A new statistical model is proposed for the geomagnetic secular variation over the past 5Ma. Unlike previous models, the model makes use of statistical characteristics of the present day geomagnetic field. The spatial power spectrum of the non-dipole field is consistent with a white source near the core-mantle boundary with Gaussian distribution. After a suitable scaling, the spherical harmonic coefficients may be regarded as statistical samples from a single giant Gaussian process; this is the model of the non-dipole field. The model can be combined with an arbitrary statistical description of the dipole and probability density functions and cumulative distribution functions can be computed for declination and inclination that would be observed at any site on Earth's surface. Global paleomagnetic data spanning the past 5Ma are used to constrain the statistics of the dipole part of the field. A simple model is found to be consistent with the available data. An advantage of specifying the model in terms of the spherical harmonic coefficients is that it is a complete statistical description of the geomagnetic field, enabling us to test specific properties for a general description. Both intensity and directional data distributions may be tested to see if they satisfy the expected model distributions.

Constable, C. G.↗
NASA NTRS1988

Statistics of the geomagnetic secular variation for the past 5 m.y

A new statistical model is proposed for the geomagnetic secular variation over the past 5Ma. Unlike previous models, the model makes use of statistical characteristics of the present day geomagnetic field. The spatial power spectrum of the non-dipole field is consistent with a white source near the core-mantle boundary with Gaussian distribution. After a suitable scaling, the spherical harmonic coefficients may be regarded as statistical samples from a single giant Gaussian process; this is the model of the non-dipole field. The model can be combined with an arbitrary statistical description of the dipole and probability density functions and cumulative distribution functions can be computed for declination and inclination that would be observed at any site on Earth's surface. Global paleomagnetic data spanning the past 5Ma are used to constrain the statistics of the dipole part of the field. A simple model is found to be consistent with the available data. An advantage of specifying the model in terms of the spherical harmonic coefficients is that it is a complete statistical description of the geomagnetic field, enabling us to test specific properties for a general description. Both intensity and directional data distributions may be tested to see if they satisfy the expected model distributions.

Constable, C. G.↗
NASA NTRS1999

Monitoring and Modeling Astronaut Occupational Radiation Exposures in Space: Recent Advances

In 1982 astronauts were declared to be radiation workers by OSHA, and as such were subject to the rules and regulations applied to that group. NASA was already aware that space radiation was a hazard to crewmembers and had been studying and monitoring astronaut doses since 1962 at the Johnson Space Center. It was quickly realized NASA would not be able to accomplish all of its goals if the astronauts were subject to the ground based radiation worker limits, and thus received a waiver from OSHA to establish independent limits. As part of the stipulation attached to setting new limits, OSHA included a requirement to perform preflight dose projections for each crew and inform them of the associated risks. Additional requirements included measuring doses from various sources during the flight, making every effort to prevent a crewmember from exceeding the new limits, and keeping all exposures As Low As Reasonably Achievable (a.k.a. ALARA - a common health physics principle). The assembly of the International Space Station (ISS) and its initial manned operations will coincide with the 4-5 year period of high space weather activity at the next maximum in the solar cycle. For the first time in NASA's manned program, US astronauts will be in orbit continuously throughout a solar maximum period. During this period, crews are at risk of significantly increased radiation exposures due to solar particle events and trapped electron belt enhancements following geomagnetic storms. The problem of protecting crews is compounded by the difficulty of providing continuous real-time monitoring over a period of a decade in an era of tightly constrained budgets. In order to prepare for ISS radiological support needs, the NASA Space Radiation Analysis Group and the NOAA Space Environment Center have undertaken a multiyear effort to improve and automate ground-based space weather monitoring systems and real-time radiation analysis tools. These improvements include a coupled, automated space weather monitoring and alarm system--SPE exposure analysis system, an advanced space weather data distribution and display system, and a high-fidelity space weather simulation system. In addition, significant new real-time space weather data sets, which will enhance the forecasting and now-casting of near-Earth space environment conditions, are being made available through unique NASA-NOAA-USAF collaborations. These new data sets include coronal mass ejection monitoring by the Solar and Heliospheric Observatory (SOHO) and in-situ plasma and particle monitoring at the L1 libration point by the Solar Wind Monitor (SWIM) and Advanced Composition Explorer (ACE) spacecraft. Advanced real-time radiation monitoring data from charged particle telescopes and tissue equivalent proportional counters will also be available to assist crew and flight controllers in monitoring the external and intravehicular radiation environment.

Weyland, Mark↗
DOE OSTI2022

A Modern Ethernet Data Acquisition Architecture for Fermilab Beam Instrumentation

The Fermilab Accelerator Division, Instrumentation Department is adopting an open-source framework to replace our embedded VME-based data acquisition systems. Utilizing an iterative methodology, we first moved to embedded Linux, removing the need for VxWorks. Next, we adopted Ethernet on each data acquisition module eliminating the need for the VME backplane in addition to communicating with a rack mount server. Development of DDCP (Distributed Data Communications Protocol), allowed for an abstraction between the firmware and software layers. Each data acquisition module was adapted to read out using 1 GbE and aggregated at a switch which up linked to a 10 GbE network. Current development includes scaling the system to aggregate more modules, to increase bandwidth to support multiple systems and to adopt MicroTCA as a crate technology. The architecture was utilized on various beamlines around the Fermilab complex including PIP2IT, FAST/IOTA and the Muon Delivery Ring. In summary, we were able to develop a data acquisition framework which incrementally replaces VxWorks & VME hardware as well as increases our total bandwidth to 10 Gbit/s using off the shelf Ethernet technology.

43 PARTICLE ACCELERATORS↗
NASA NTRS2011

Network-Capable Application Process and Wireless Intelligent Sensors for ISHM

Intelligent sensor technology and systems are increasingly becoming attractive means to serve as frameworks for intelligent rocket test facilities with embedded intelligent sensor elements, distributed data acquisition elements, and onboard data acquisition elements. Networked intelligent processors enable users and systems integrators to automatically configure their measurement automation systems for analog sensors. NASA and leading sensor vendors are working together to apply the IEEE 1451 standard for adding plug-and-play capabilities for wireless analog transducers through the use of a Transducer Electronic Data Sheet (TEDS) in order to simplify sensor setup, use, and maintenance, to automatically obtain calibration data, and to eliminate manual data entry and error. A TEDS contains the critical information needed by an instrument or measurement system to identify, characterize, interface, and properly use the signal from an analog sensor. A TEDS is deployed for a sensor in one of two ways. First, the TEDS can reside in embedded, nonvolatile memory (typically flash memory) within the intelligent processor. Second, a virtual TEDS can exist as a separate file, downloadable from the Internet. This concept of virtual TEDS extends the benefits of the standardized TEDS to legacy sensors and applications where the embedded memory is not available. An HTML-based user interface provides a visual tool to interface with those distributed sensors that a TEDS is associated with, to automate the sensor management process. Implementing and deploying the IEEE 1451.1-based Network-Capable Application Process (NCAP) can achieve support for intelligent process in Integrated Systems Health Management (ISHM) for the purpose of monitoring, detection of anomalies, diagnosis of causes of anomalies, prediction of future anomalies, mitigation to maintain operability, and integrated awareness of system health by the operator. It can also support local data collection and storage. This invention enables wide-area sensing and employs numerous globally distributed sensing devices that observe the physical world through the existing sensor network. This innovation enables distributed storage, distributed processing, distributed intelligence, and the availability of DiaK (Data, Information, and Knowledge) to any element as needed. It also enables the simultaneous execution of multiple processes, and represents models that contribute to the determination of the condition and health of each element in the system. The NCAP (intelligent process) can configure data-collection and filtering processes in reaction to sensed data, allowing it to decide when and how to adapt collection and processing with regard to sophisticated analysis of data derived from multiple sensors. The user will be able to view the sensing device network as a single unit that supports a high-level query language. Each query would be able to operate over data collected from across the global sensor network just as a search query encompasses millions of Web pages. The sensor web can preserve ubiquitous information access between the querier and the queried data. Pervasive monitoring of the physical world raises significant data and privacy concerns. This innovation enables different authorities to control portions of the sensing infrastructure, and sensor service authors may wish to compose services across authority boundaries.

Figueroa, Fernando↗
NASA NTRS1989

Pressure Distribution and Air Data System for the Aeroassist Flight Experiment

The Aeroassist Flight Experiment (AFE) is designed to provide critical flight data necessary for the design of future Aeroassist Space Transfer Vehicles (ASTV). This flight experiment will provide aerodynamic, aerothermodynamic, and environmental data for verification of experimental and computational flow field techniques. The Pressure Distribution and Air Data System (PD/ADS), one of the measurement systems incorporated into the AFE spacecraft, is designed to provide accurate pressure measurements on the windward surface of the vehicle. These measurements will be used to determine the pressure distribution and air data parameters (angle of attack, angle of sideslip, and free-stream dynamic pressure) encountered by the blunt-bodied vehicle over an altitude range of 76.2 km to 94.5 km. Design and development data are presented and include: measurement requirements, measurement heritage, theoretical studies to define the vehicle environment, flush-mounted orifice configuration, pressure transducer selection and performance evaluation data, and pressure tubing response analysis.

Gibson, Lorelei S.↗
NASA NTRS1992

National Space Science Data Center data archive and distribution service (NDADS) automated retrieval mail system user's guide

The National Space Science Data Center (NSSDC) has developed an automated data retrieval request service utilizing our Data Archive and Distribution Service (NDADS) computer system. NDADS currently has selected project data written to optical disk platters with the disks residing in a robotic 'jukebox' near-line environment. This allows for rapid and automated access to the data with no staff intervention required. There are also automated help information and user services available that can be accessed. The request system permits an average-size data request to be completed within minutes of the request being sent to NSSDC. A mail message, in the format described in this document, retrieves the data and can send it to a remote site. Also listed in this document are the data currently available.

Perry, Charleen M.↗
NASA NTRS1975

The Large Area Crop Inventory Experiment (LACIE). Part 3: A systematic approach to the practical application of remote-sensing technology

The application of remote sensing technology by the U.S. Department of Agriculture (USDA) is examined. The activities of the USDA Remote-Sensing User Requirement Task Force which include cataloging USDA requirements for earth resources data, determining those requirements that would return maximum benefits by using remote sensing technology and developing a plan for acquiring, processing, analyzing, and distributing data to satisfy those requirements are described. Emphasis is placed on the large area crop inventory experiment and its relationship to the task force.

Murphy, J. D.↗
NASA NTRS1990

Fairness problems at the media access level for high-speed networks

Most lower speed (approx. 10 Mbps) local area networks use adaptive or random access protocols like Ethernet. Others at higher speed use demand assignment like token or slotted rings. These include Cambridge ring and electronic token ring systems. Fairness issues in representatives of such protocols are discussed. In particular, Fiber Distributed Data Interface (FDDI) was selected as a demand access protocol using tokens, Carrier Sensed Multiple Access/Ring Network (CSMA/RN) a random access protocol, and Distributed Queue Dual Bus (DQDB) a demand access protocol using reservations. Fairness at the media access level was the focus, i.e., attaining access or being excessively delayed when a message is queued to be sent as a function of network location. Within that framework, the essential fairness of FDDI was observed along with severe fairness problems in DQDB and some problems for CSMA/RN. Several modifications were investigated and their ameliorative effect is shown. Finally, a unified presentation which allows comparisons of the three protocols' fairness when normalized to their capacity is given.

Maly, Kurt J.↗
NASA NTRS1972

On the application of Rice's exceedance statistics to atmospheric turbulence.

Discrepancies produced by the application of Rice's exceedance statistics to atmospheric turbulence are examined. First- and second-order densities from several data sources have been measured for this purpose. Particular care was paid to each selection of turbulence that provides stationary mean and variance over the entire segment. Results show that even for a stationary segment of turbulence, the process is still highly non-Gaussian, in spite of a Gaussian appearance for its first-order distribution. Data also indicate strongly non-Gaussian second-order distributions. It is therefore concluded that even stationary atmospheric turbulence with a normal first-order distribution cannot be considered a Gaussian process, and consequently the application of Rice's exceedance statistics should be approached with caution.

Chen, W. Y.↗
DOE OSTI2020

Updates to the n+ 63,65 Cu Evaluations in the Resolved Resonance Region [Slides]

This presentation discusses the motivation and background of the n+ 63,65 Cu Evaluations in the Resolved Resonance Region which is to study the interaction of neutrons with copper as it is important in nuclear applications since critical assembly configurations include metallic copper as reflector. In support to the U.S. Department of Energy (DOE) Nuclear Criticality Safety Program (NCSP), measurements and related evaluations of 63,65 Cu isotopes were selected to improve the agreement with the benchmarks and to assess the importance of the angular distribution data for reactor calculations. Previous and current evaluation work is supported by an experimental campaign initiated before 2010, the 63,65 Cu R-matrix analysis generated resonance parameters up to 300 keV. However, due to outstanding issues in the benchmark performance, ENDF/B-VIII.0 library released a truncated set of resonance parameters up to 100 keV. The goal of this work is to generate an updated set of resonance parameters in the 100-300 keV range to improve the benchmark performance of 63,65 Cu isotopes. In conclusion, R-matrix analysis to update 63,65 Cu evaluations was performed to simultaneously improve benchmark performance and extend the RRR to 300 keV. The benchmark calculations suggest the increased capture cross sections are beneficial, however, further investigation of the measured capture data is needed to understand the large normalization scaling factor needed to improve the reactivity. Also, the copper-reflected benchmarks indicate the need to further investigate angular distributions and extension of RRR to 300 keV is aided well by level statistics considerations. Work to refine the fit of individual resonances is ongoing.

07 ISOTOPE AND RADIATION SOURCES↗
NASA NTRS2005

Lunar and Planetary Science XXXVI, Part 1

Contents include the following: Observations with Near Infrared Spectrometer for Hayabusa Mission in the Cruising Phase. First Results of Quadrantid Meteor Spectrum. Compositional Investigation of Binary Near-Earth Asteroid 66063 (1998 RO1): A Potentially Undifferentiated Assemblage. Impact-induced Hydrothermal Activity on Early Mars. HRTEM and EFTEM Studies of Phyllosilicate-Organic Matter Associations in Matrix and Dark Inclusions in the EET92042 CR2 Carbonaceous Chondrite. Volumetric Analysis of Martian Rampart Craters. High Pressure Melting of H-Chondrite: A Match for the Martian Basalt Source Mantle. MERView: A New Computer Program for Easy Display of MER-acquired M ssbauer Data. Distribution, Exchange, and Topographic Control of Subsurface Ice on Mars. Shock-induced Damage Beneath Normal and Oblique Impact Craters. Amphitrites Patera Studied from the Mars Express HRSC Data. Oxygen Isotope Microanalysis of Enveloping Compound Chondrules in CV3 and LL3 Chondrites. Gamma-Ray Irradiation in the Early Solar System and the Conundrum of the Lu-176 Decay Constant. Magnesium Isotope Mapping of Silica-rich Grains Having. Extreme Oxygen Isotope Anomalies Extreme Oxygen Isotopic Anomalies from Irradiation in the Early Solar System, Re-Examining the Role of Chondrules in Producing the Elemental Fractionations in Chondrites. Meteorite Data on the Solar Modulation of Galactic Cosmic Rays and an Inference on the Solar Activity Influence on Climate of the Earth. Volatiles Enrichments and Composition of Jupiter. Thinking Like a Wildcatter Prospecting for Methane in Arabia Terra, Mars. Size Distribution of Genesis Solar Wind Array Collector Fragments. Initial Subdivision of Genesis Early Science Polished Aluminum Collector. Presolar Graphite and Its Noble Gases. Young Pb-Isotopic Ages of Chondrules in CB Carbonaceous Chondrites. Fe Isotopic Composition of Martian Meteorites. Petrology and Geochemistry of Nakhlite MIL 03346: A New Martian Meteorite from Antarctica.

Source record↗
NASA NTRS1979

Seasat low-rate data system

The Seasat low-rate data system, an end-to-end data-processing and data-distribution system for the four low-rate sensors (radar altimeter, Seasat-A scatterometer system, scanning multichannel microwave radiometer, and visible and infrared radiometer) carried aboard the satellite, is discussed. The function of the distributed, nonreal-time, magnetic-tape system is to apply necessary calibrations, corrections, and conversions to yield geophysically meaningful products from raw telemetry data. The algorithms developed for processing data from the different sensors are described, together with the data catalogs compiled.

Brown, J. W.↗
DOE OSTI2024

Synthesizing realistic sand assemblies with denoising diffusion in latent space

Abstract The shapes and morphological features of grains in sand assemblies have far‐reaching implications in many engineering applications, such as geotechnical engineering, computer animations, petroleum engineering, and concentrated solar power. Yet, our understanding of the influence of grain geometries on macroscopic response is often only qualitative, due to the limited availability of high‐quality 3D grain geometry data. In this paper, we introduce a denoising diffusion algorithm that uses a set of point clouds collected from the surface of individual sand grains to generate grains in the latent space. By employing a point cloud autoencoder, the three‐dimensional point cloud structures of sand grains are first encoded into a lower‐dimensional latent space. A generative denoising diffusion probabilistic model is trained to produce synthetic sand that maximizes the log‐likelihood of the generated samples belonging to the original data distribution measured by a Kullback‐Leibler divergence. Numerical experiments suggest that the proposed method is capable of generating realistic grains with morphology, shapes and sizes consistent with the training data inferred from an F50 sand database. We then use a rigid contact dynamic simulator to pour the synthetic sand in a confined volume to form granular assemblies in a static equilibrium state with targeted distribution properties. To ensure third‐party validation, 50,000 synthetic sand grains and the 1542 real synchrotron microcomputed tomography (SMT) scans of the F50 sand, as well as the granular assemblies composed of synthetic sand grains are made available in an open‐source repository.

Vlassis, Nikolaos N.↗
DOE OSTI2026

Continual Learning for Particle Accelerators

Particle accelerators operate under dynamically changing conditions, which often lead to data distribution drifts. These drifts pose significant challenges for Machine Learning (ML) models, which typically fail to maintain performance when faced with such non-stationary data. In particle accelerators, the primary sources of these data drifts include changes in accelerator settings and non-measured parameters such as machine degradation and environmental factors. Previous research has proposed conditional models to handle multiple beam configurations effectively; however, it is challenging to train the ML models on all possible configuration settings. Additionally, conditional models alone can not address performance degradation caused by drifts due to non-measured factors. These limitations contribute to a significant gap between ML development and its deployment in real-world operational settings. To bridge this gap, in this paper, we identify some of the key areas within particle accelerators where continual learning can help mitigate drift-induced performance degradation. In addition, we present a practical use case where a conditional Auto-Encoder model coupled with memory-based continual learning has been employed to demonstrate stable performance even when underlying data drifts.

Schram, Malachi [Thomas Jefferson National Acceler↗