Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

The Iterative Processing Framework: A New Paradigm for Automatic Event Building

Abstract In a traditional data-processing pipeline, waveforms are acquired, a detector makes the signal detections (i.e., arrival times, slownesses, and azimuths) and passes them to an associator. The associator then links the detections to the fitting-event hypotheses to generate an event bulletin. Most of the time, this traditional pipeline requires substantial human-analyst involvement to improve the quality of the resulting event bulletin. For the year 2017, for instance, International Data Center (IDC) analysts rejected about 40% of the events in the automatic bulletin and manually built 30% of the legitimate events. Here, we introduce an iterative processing framework (IPF) that includes a new data-processing module that incorporates automatic analyst behaviors (auto analyst [AA]) into the event-building pipeline. In the proposed framework, through an iterative process, the AA takes over many of the tasks traditionally performed by human analysts. These tasks can be grouped into two major processes: (1) evaluating small events with a low number of location-defining arrival phases to improve their formation; and (2) scanning for and exploiting unassociated arrivals to form potential events missed by previous association runs. To test the proposed framework, we processed a two-week period (15–28 May 2010) of the signal-detections dataset from the IDC. Comparison with an expert analyst-reviewed bulletin for the same time period suggests that IPF performs better than the traditional pipelines (IDC and baseline pipelines). The majority of the additional events built by the AA are low-magnitude events that were missed by these traditional pipelines. The AA also adds additional signal detections to existing events, which saves analyst time, even if the event locations are not significantly affected.

58 GEOSCIENCES↗

Adapt: A Weather Radar Data Analysis and Nowcasting Platform for Informed Adaptive Scanning

SF-26-021 Adapt is a data processing platform for real-time data analysis, short term prediction of targets convective cells and tracking for archived data. It provides tools for downloading, processing, segmenting, projecting, analyzing, and visualizing storm cell data from weather radar. The pipeline includes cell detection, motion estimation using optical flow, cell property extraction, and persistence to NetCDF and SQLite/Parquet for guiding adaptive scanning.

Raut, Bhupendra Ashokrao [Argonne National Laborat↗

Extreme-Scale Distribution-Based Data Analysis

Scientists overview and identify regions of interest by transforming data into compact information descriptors that characterize simulation results and allow detailed analysis on demand. Among many existing feature descriptors, statistical information derived from data samples is a promising approach to taming the big data avalanche because data distributionscomputed from a population can compactly describe the presence and characteristics of salient data features with minimal data movement. The ability to computationally summarize and process data using distributions also provides an efficient and representative capture of information that can adjust to size and resource constraints, with the added benefit that uncertainty associated with results can be quantified and communicated. In this project, we have developed a distribution-based data analysis and visualization framework for optimizing in situ processing and analysis of extreme-scale scientific data.

97 MATHEMATICS AND COMPUTING↗

The orbits of the uranian satellites and rings, the gravity field of the uranian system, and the orientation of the pole of Uranus

French et al. determined the orbits of the Uranian rings, the orientation of the pole of Uranus, and the gravity harmonics of Uranus from Earth-based and Voyager ring occultations. Jacobson et al. determined the orbits of the Uranian satellites and the masses of Uranus and its satellites from Earth-based astrometry and observations acquired with the Voyager 2 spacecraft; they used the gravity harmonics and pole from French et al. Jacobson and Rush reconstructed the Voyager 2 trajectory and redetermined the Uranian system gravity parameters, satellite orbits, and ring orbits in a combined analysis of the data used previously augmented with additional Earth-based astrometry. Here we report on an extension of that work that incorporates additional astrometry and ring occultations together with improved data processing techniques.

79 ASTRONOMY AND ASTROPHYSICS↗

Active workflow system for near real-time extreme-scale science. In: PPAA '14 Proceedings of the first workshop on Parallel programming for analytics applications

In recent years, streaming-based data processing has been gaining substantial traction for dealing with overwhelming data generated by real-time applications, from both enterprise sources and scientific computing. In this work, however, we look at an emerging class of scientific data with Near Real-Time (NRT) requirement, in which data is typically generated in a bursty fashion with the near real-time constraints being applied primarily between bursts, rather than within a stream. A key challenge for this types of data sources is that the processing time per data element is not uniform, and not always feasible to predict. Given the observations on the increasing unpredictability of compute load and system dynamics, this work looks to adapt streaming-based approach to the context of this new class of large experiments and simulations that have complex run-time control and analysis issues. In particular, we deploy a novel two-tier scheme for handling the increasing unpredictability of runtime behaviors: Instead of relying on determining what and where to run the scientific workflows beforehand or partial dynamically, the decision will also be adaptively enhanced online according to system runtime status. This is enabled by embedding workflow along with data streams. Specifically, we break data outputs generated from experiments or simulations into multiple self-describing "chunks", which we call active data objects. As such, if there is a transient hotspot observed, a data object with unfinished workflow pipeline can break its previous schedule and search for a least loaded location to continue the execution. Our preliminary experiment results based on synthetic workloads demonstrate the proposed active workflow system as a very promising solution by outperforming the state-of-the-art semi-dynamic workflow schedulers with an improved workflow completion time, as well as a good scalability.

Zhang, Yanwei↗

Development of a portable mechanical hysteresis measurement and imaging system for impact characterization in honeycomb sandwich structures

Honeycomb sandwich materials are commonly used for aero-structures, but because the outer skins are typically thin, 2-10 plys, the structures are susceptible to impact damage. NDI methods such as tap tests, bond testers and TTU ultrasound are successfully deployed to find impact damage, but identifying the type/degree of damage is troublesome. As the type/degree of impact damage guides decisions by the maintenance, repair and overhaul (MRO) community regarding repair, the ability to characterize impacts is of interest. Previous work demonstrated that additional impact characterization may be gleaned from hysteresis loop area, as determined from an out-of-plane load-vs-displacement plot, where this parameter shows a correlation with impact energy. This presentation reports on current work involving the development of a portable hysteresis measurement and imaging system based on an instrumented tapper. Data processing and analysis methods that allow production of the load/displacement data from a single accelerometer are discussed, with additional reporting of tests of software to automatically vary pixel size during scanning to decrease C-scans inspection time.

36 MATERIALS SCIENCE↗

Toward CO 2 Multimeasurement Geophysical Monitoring in the North Dakota CarbonSAFE Project

Paper presented at 16th International Conference on Greenhouse Gas Control Technologies (GHGT-16), October 23–27, 2022, Lyon, France. Overcoming data acquisition challenges associated with a lake in the study area, electrical infrastructure around the plant, noise from mine activities, complex near-surface conditions associated with reclaimed mine land, high wind speed, and extremely cold temperatures, data processing, modeling, and inversion of the baseline geophysical data demonstrated the importance of high-quality data for a CO 2 geophysical monitoring program. Implementing more advanced data acquisition and processing techniques in future monitoring surveys can further improve confidence in interpretations of geophysical survey data.

20 FOSSIL-FUELED POWER PLANTS↗

VisIt: An End-User Tool for Visualizing and Analyzing Very Large Data

VisIt is a popular open source tool for visualizing and analyzing data. It owes its success to its foci of increasing data understanding, large data support, and providing a robust and usable product, as well as its underlying design that fits today's supercomputing landscape. In this short paper, we describe the VisIt project and its accomplishments. The VisIt project's three focal points - understanding data, large data, and delivering a product - together form a powerful environment for analyzing data from HPC simulations. It is used in varied ways: it enables visualization scientists, computational code developers, and the physicists that run these codes to perform a broad range of data understanding activities, including debugging, making movies, and exploring data. The user interface portion of its design provides a powerful paradigm for analyzing data while the data processing portion of its design is well suited for big data. This in turn has led to many successes: in scaling up to high levels of concurrency and large data sizes, in providing a 'home' for large data algorithms, in understanding how to best use supercomputers, and, most importantly, in helping users understand their data. Further, despite significant upcoming changes in supercomputing architecture, VisIt's future appears bright, as it enjoys vibrant user and developer communities.

99 GENERAL AND MISCELLANEOUS↗

Components in the Pipeline

Scientists commonly describe their data processing systems metaphorically as software pipelines. These pipelines input one or more data sources and apply a sequence of processing steps to transform the data and create useful results. While conceptually simple, pipelines often adopt complex topologies and must meet stringent quality of service requirements that place stress on the software infrastructure used to construct the pipeline. In this paper we describe the MeDICi Integration Framework, which is a component-based framework for constructing complex software pipelines. The framework supports composing pipelines from distributed heterogeneous software components and provides mechanisms for controlling qualities of service to meet demanding performance, reliability and communication requirements.

99 GENERAL AND MISCELLANEOUS↗

Field evaluation of remote wind sensing technologies: Shore-based and buoy mounted LIDAR systems

In developing a national energy strategy, the United States has a number of objectives, including increasing economic growth, improving environmental quality, and enhancing national energy security. Wind power contributes to these objectives through the deployment of clean, affordable and reliable domestic energy. To achieve U.S. wind generation objectives, the Wind and Water Power Program within the Department of Energy’s (DOE) Office of Energy Efficiency and Renewable Energy (EERE) instituted the U.S. Offshore Wind: Removing Market Barriers Program in FY 2011. Accurate and comprehensive information on offshore wind resource characteristics across a range of spatial and temporal scales is one market barrier that needs to be addressed through advanced research in remote sensing technologies. There is a pressing need for reliable offshore wind-speed measurements to assess the availability of the potential wind energy resource in terms of power production and to identify any frequently occurring spatial variability in the offshore wind resource that may impact the operational reliability and lifetime of wind turbines and their components and to provide a verification program to validate the “bankability” of the output of these alternative technologies for use by finance institutions for the financing of offshore wind farm construction. The application of emerging remote sensing technologies is viewed as a means to cost-effectively meet the data needs of the offshore wind industry. In particular, scanning and buoy mounted LIDAR have been proposed as a means to obtain accurate offshore wind data at multiple locations without the high cost and regulatory hurdles associated with the construction of offshore meteorological towers. However; before these remote sensing technologies can be accepted the validity of the measured data must be evaluated to ensure their accuracy. The proposed research will establish a unique coastal ocean test-bed in the Mid-Atlantic for the evaluation of LIDAR-based wind measurement systems to validate the accuracy of remotely measured wind data in marine applications. Specifically, the test-bed will be utilized to systematically evaluate the capability of emerging scanning LIDAR and buoy mounted vertically profiling LIDAR by: (1) Evaluating a fixed scanning LIDAR against land-based 50 and 60 meter high meteorological masts fitted with research quality cup-vane and/or sonic anemometers; (2) Evaluating a buoy mounted vertically profiling LIDAR fixed on land and floating in a sheltered bay against a co-located 60 meter high meteorological mast fitted with a research quality cup-vane and/or sonic anemometers and the fixed scanning LIDAR; and (3) Offshore field evaluation of both LIDAR platforms through a comparison of the fixed scanning LIDAR data and data obtained by the buoy mounted LIDAR located 10 miles offshore. The proposed research will systematically validate Light Detection and Ranging (LIDAR) based wind measurement systems and assess the temporal and spatial variability of the offshore wind resource in the Mid-Atlantic east of New Jersey. The goal of the proposed project is to address the technical and commercial challenges of the offshore wind energy industry by validating and assessing cost-effective, over ocean wind resource characterization technologies. The objective is to systematically evaluate the capability of both scanning and vertically profiling LIDARs to accurately measure 3D wind fields through comparison with fixed met masts and intercomparison among LIDAR platforms. Once validated, data collected by both buoy mounted vertically profiling LIDARs and shore-based, pulsed horizontally scanning LIDARs can be used to accurately assess offshore wind resources and to quantify the spatial and temporal variability in the offshore wind fields. One of the fundamental research questions to be addressed in phase 1 is the assessment of various measurement and data processing schemes to retrieve accurate wind vectors in the marine environment over large sampling ranges (10 to 12 km) and varying atmospheric aerosol levels. Atmospheric conditions and aerosol content within the coastal ocean region of the Mid-Atlantic seaboard of the US can vary significantly over short time periods in response to frontal passages and extratropical and tropical low pressure system passage offshore of the coast. Since aerosols provide the scattering medium for the determination of LIDAR Doppler shifts in the atmosphere the accuracy and range of LIDAR derived velocity measurements as a function of variation in aerosol content in the marine environment is a key research question to be addressed. In phase 1, it is desired to capture as much variation in atmospheric conditions and aerosol content as possible. To this end, collocated measurements of LIDAR and standard anemometer wind fields will be captured by the project PIs over all four seasons and during specific events (e.g., coastal low pressure system passage) in year 1. Additionally, since the meteorological masts are permanent structures, additional events can be captured over the three year duration of the field research project. All research instruments are owned by Fishermen’s Energy and made available to the PIs though a lease agreement as part of the DOE grant. Energy Fishermen’s Energy will be responsible for the operation and maintenance of the scanning LIDAR and met mast anemometers. On a daily basis, environmental data and systems performance indicators will be transmitted from each measurement station to the Fishermen’s project team consisting of both in-house personnel and equipment manufacturer engineers. Data sets include compiled LIDAR files as well as data sets from ancillary sensors. Diagnostic parameters to be monitored include standard deviations of measured values, battery levels and charging systems output, and the operational status. Once data have been confirmed as complete and reliable, files will be transferred to the Garrad Hassan (a subcontractor to Fishermen’s Energy) for incorporation in to the validation database, which is accessible to other scientific team members. Data collection times and durations will be determined by the PI and Co-PIs in consultation with instrument engineers to ensure the capture of data representative of the expected range of mid-Atlantic atmospheric conditions (e.g., temperature, moisture, coastal low pressure systems, tropical systems, rain, snow, fog). The collection and processing of the data is a function of site specific measurement requirements (Kelley et.al. 2007; Hannon et.al. 2008). To determine the optimal profiles of wind speed and direction from the LIDAR radial velocities as a function of azimuth angle, rigorous estimates of the bias and random error of each radial velocity estimate are required. Lockheed Martin Coherent Technologies, Inc., under contract with Fishermen’s Energy, will provide analyses of raw and processed data using various scan patterns to determine optimal performance settings for the pulsed scanning LIDAR. Once optimized, appropriate processing and analyses techniques will be evaluated by Garrad Hassan for use in validating the accuracy of the LIDAR wind field measurements against the standard anemometer measurements from the meteorological masts. The most attractive capability of the scanning LIDAR is the ability to provide high spatial resolution observations in a three-dimensional volume which provides superior statistical accuracy due to the large number of samples obtained. Each radial scan provides measurements in 100 range gates over a distance of 10 to 12 km at an update rate of 5 to 10 Hz and rotation of 2.5° per second. Each rotation at a fixed azimuth requires 2.4 minutes. Depending on the number of azimuths desired a complete scan can take up to 10 minutes or longer to complete. Once collected the radial velocities are processed to produce vector wind velocity estimates based on a set of data distributed in angle and range around points of interest, typically a standard grid within the radial wind map. To calculate wind vectors over a limited spatial area of interest for the comparison of data with other measurement platforms a localized least-squares approach has been applied by Hannon et.al. (2008) and a Variation Assimilation (VAR) processing technique has been applied by Chan and al Assimilation (VAR) processing technique has been applied by Chan and Shao (2006). Additionally, Kelley et.al. (2007) applied a “stare” technique that fixed a scanning LIDAR in both azimuth and elevation angles to measure over collocated sampling volumes of the LIDAR and a 3D sonic anemometer mounted to a fixed mast. Although the stare technique is limited to wind directions aligned with the sampling radial of the LIDAR, it does provide a direct comparison of sampling volumes. Each of the processing techniques described above (and possibly others) will be evaluated to determine the validity of the LIDAR derived wind fields in the marine environment. Numerical methods such as linear regression and comparison of probability density functions of wind fields measured by each instrument platform will be used to assess the processing techniques. Linear regression has the advantage of directly evaluating corresponding pairs of wind data measured by each instrument and can lend insight into deviations and bias between instruments as a function of wind speed. Assessment of the coherency between the probability density function of the wind measured by each instrument provides insight into processes that may not be accurately resolved by each instrument at specific frequencies. Once processed and assessed the most appropriate technique will be utilized to provide valid wind measurements from the pulsed scanning LIDAR. A detailed analysis of the measurement data from the LIDAR and the three meteorological towers and comparison of the coastal wind characteristics from the different systems will be performed by the CO_PI at NREL. This analysis will evaluate how the WT LIDAR performance and measurement of the wind characteristics vary with distance from the LIDAR and by atmospheric conditions; using the tower measurements at different distances (4.8, 9.6, and 19 km) from the LIDAR as a reference. The comparative analysis will include, to the extent possible, evaluation of parameters such as wind speed and direction distributions, wind shear, turbulence intensity and their variations by atmospheric conditions, month or season, and time of day.

17 WIND ENERGY↗

Utah FORGE Well 78B-32 Daily Drilling Reports and Logs

This data set includes the daily drilling reports and Pason data for well 78B-32 and Schlumberger logs acquired after drilling completion. This well was drilled between June 27th and July 31st of 2021. Also included is raw and processed data for a variety of well data metrics including temperature, porosity, density, and sonic data. This data was taken at the Utah FORGE site as part of the Utah FORGE project.

15 GEOTHERMAL ENERGY↗

Methods and algorithms for computer synthesis of holographic elements to obtain a complex impulse response of optical information processing systems based on modern spatial light modulators

The possibilities of designing optical devices for data processing and imaging based on the manipulation of coherent light beams by means of spatial light modulators (SLMs) are investigated. A review of commercially available SLMs is presented and the limitations of their complex modulation characteristics are analysed. The main problem of using present-day SLMs is the lack of the ability to modulate directly all states within a unit circle in the complex plane. In this regard, the characteristics of current methods for the synthesis of holographic elements are described that implement a given complex impulse response of the optical system and are optimal for using SLMs with purely amplitude, purely phase, and hybrid amplitude – phase modulation. (paper)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Myna: Connecting powder bed fusion build data to simulation tools for digital twin applications

Additive manufacturing (AM), as a digital process, can generate a detailed digital thread linking a part’s design and manufacturing to its operational performance. As AM systems advance, an increasing amount of process data is stored in manufacturing databases. In principle, this data can be utilized by simulation-based digital twin approaches, such as real-time process control and asynchronous post-processing guidance. However, few tools currently exist for systematically integrating digital thread data with computational tools. Here, in this study, we propose a software package, called Myna, for connecting data from powder bed fusion processes to simulation tools. The utility of such a platform is demonstrated using build data from the Oak Ridge National Laboratory Manufacturing Demonstration Facility “Peregrine v2023-10” public dataset to automatically configure and run 54 semi-analytical 3DThesis melt pool simulations, 78 numerical Additive FOAM melt pool simulations, and 3 ExaCA microstructure simulations. The simulated, spatially registered microstructures are then compared directly with electron backscatter diffraction characterization of the corresponding as-built part locations. The resulting simulated microstructure showed variation as a function of process parameters, particularly stripe width; however, the experimental data had little variation between the microstructure texture and grain size resulting from different processing conditions. Analysis of the discrepancies suggest that it is possible a two-phase ferritic-austenitic solidification model is needed to accurately predict grain size and texture for certain stainless steel 316L feedstock compositions under powder bed fusion conditions, providing direction for future research. As illustrated here, due to the number and complexity of the simulations involved in AM process-structure–property predictions, automated methods to connect process data and simulations will remain necessary tools for testing hypotheses and implementing digital twin applications.

Knapp, Gerald L. [Oak Ridge National Laboratory (O↗

The R -process Alliance: Fifth Data Release from the Search for R -process-enhanced Metal-poor Stars in the Galactic Halo with the GTC

Understanding the abundance pattern of metal-poor stars and the production of heavy elements through various nucleosynthesis processes offers crucial insights into the chemical evolution of the Milky Way, revealing primary sites and major sources of rapid neutron-capture process (r-process) material in the Universe. In this fifth data release from the R-Process Alliance (RPA), we present the detailed chemical abundances of 41 faint (down to V = 15.8) and extremely metal-poor (down to [Fe/H] = -3.3) halo stars selected from the RPA. We obtained high-resolution spectra for these objects with the HORuS spectrograph on the Gran Telescopio Canarias. We measure the abundances of light, α, Fe-peak, and neutron-capture elements. We report the discovery of five carbon-enhanced metal-poor, one limited-r, three r-I, and four r-II stars, and six Mg-poor stars. We also identify one star of a possible globular cluster origin at an extremely low metallicity at [Fe/H] = -3.0. This adds to the growing evidence of a lower-limit metallicity floor for globular cluster abundances. We use the abundances of Fe-peak elements and the α-elements to investigate the contributions from different nucleosynthesis channels in the progenitor supernovae. We find the distribution of [Mg/Eu] as a function of [Fe/H] to have different enrichment levels, indicating different possible pathways and sites of their production. We also reveal differences in the trends of the neutron-capture element abundances of Sr, Ba, and Eu of various r-I and r-II stars from the RPA data releases, which provide constraints on their nucleosynthesis sites and subsequent evolution.

79 ASTRONOMY AND ASTROPHYSICS↗

Experimental methods for laboratory measurements of helium spectral line broadening in white dwarf photospheres

White Dwarf (WD) stars are the most common stellar remnant in the universe. WDs usually have a hydrogen or helium atmosphere, and helium WD (called DB) spectra can be used to solve outstanding problems in stellar and galactic evolution. DB origins, which are still a mystery, must be known to solve these problems. DB masses are crucial for discriminating between different proposed DB evolutionary hypotheses. Current DB mass determination methods deliver conflicting results. The spectroscopic mass determination method relies on line broadening models that have not been validated at DB atmosphere conditions. We performed helium benchmark experiments using the White Dwarf Photosphere Experiment (WDPE) platform at Sandia National Laboratories' Z-machine that aims to study He line broadening at DB conditions. Using hydrogen/helium mixture plasmas allows investigating the importance of He Stark and van der Waals broadening simultaneously. Accurate experimental data reduction methods are essential to test these line-broadening theories. In this paper, we present data calibration methods for these benchmark He line shape experiments. We give a detailed account of data processing, spectral power calibrations, and instrument broadening measurements. Uncertainties for each data calibration step are also derived. We demonstrate that our experiments meet all benchmark experiment accuracy requirements: WDPE wavelength uncertainties are <1 Å, spectral powers can be determined to within 15%, densities are accurate at the 20% level, and instrumental broadening can be measured with 20% accuracy. Fulfilling these stringent requirements enables WDPE experimental data to provide physically meaningful conclusions about line broadening at DB conditions.

79 ASTRONOMY AND ASTROPHYSICS↗

Atmospheric Radiation Measurement Program Climate Research Facility Operations Quarterly Report October 1–December 31, 2009

Individual raw datastreams from instrumentation at the Atmospheric Radiation Measurement (ARM) Climate Research Facility fixed and mobile sites are collected and sent to the Data Management Facility (DMF) at Pacific Northwest National Laboratory (PNNL) for processing in near real-time. Raw and processed data are then sent approximately daily to the ARM Data Archive, where they are made available to users. For each instrument, we calculate the ratio of the actual number of data records received daily at the Archive to the expected number of data records. The results are tabulated by (1) individual datastream, site, and month for the current year and (2) site and fiscal year (FY) dating back to 1998.

54 ENVIRONMENTAL SCIENCES↗

Atmospheric Radiation Measurement Program Climate Research Facility Operations Quarterly Report April 1–June 30, 2010

Individual raw datastreams from instrumentation at the Atmospheric Radiation Measurement (ARM) Climate Research Facility fixed and mobile sites are collected and sent to the Data Management Facility (DMF) at Pacific Northwest National Laboratory (PNNL) for processing in near real-time. Raw and processed data are then sent approximately daily to the ARM Archive, where they are made available to users. For each instrument, we calculate the ratio of the actual number of data records received daily at the Archive to the expected number of data records. The results are tabulated by (1) individual datastream, site, and month for the current year and (2) site and fiscal year (FY) dating back to 1998.

54 ENVIRONMENTAL SCIENCES↗