Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Intensive Science”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
NASA NTRS1992

Functional requirements document for the Earth Observing System Data and Information System (EOSDIS) Scientific Computing Facilities (SCF) of the NASA/MSFC Earth Science and Applications Division, 1992

Five scientists at MSFC/ESAD have EOS SCF investigator status. Each SCF has unique tasks which require the establishment of a computing facility dedicated to accomplishing those tasks. A SCF Working Group was established at ESAD with the charter of defining the computing requirements of the individual SCFs and recommending options for meeting these requirements. The primary goal of the working group was to determine which computing needs can be satisfied using either shared resources or separate but compatible resources, and which needs require unique individual resources. The requirements investigated included CPU-intensive vector and scalar processing, visualization, data storage, connectivity, and I/O peripherals. A review of computer industry directions and a market survey of computing hardware provided information regarding important industry standards and candidate computing platforms. It was determined that the total SCF computing requirements might be most effectively met using a hierarchy consisting of shared and individual resources. This hierarchy is composed of five major system types: (1) a supercomputer class vector processor; (2) a high-end scalar multiprocessor workstation; (3) a file server; (4) a few medium- to high-end visualization workstations; and (5) several low- to medium-range personal graphics workstations. Specific recommendations for meeting the needs of each of these types are presented.

Botts, Michael E.↗
DOE OSTI2012

Radiation modeling using the Uintah heterogeneous CPU/GPU runtime system. In: XSEDE '12 Proceedings of the 1st Conference of the Extreme Science and Engineering Discovery Environment: Bridging from the eXtreme to the campus and beyond, Article No. 4

The Uintah Computational Framework was developed to provide an environment for solving fluid-structure interaction problems on structured adaptive grids on large-scale, long-running, data-intensive problems. Uintah uses a combination of fluid-flow solvers and particle-based methods for solids, together with a novel asynchronou task-based approach with fully automated load balancing. Uintah demonstrates excellent weak and strong scalability at full machine capacity on XSEDE resources such as Ranger and Kraken, and through the use of a hybrid memory approach based on a combination of MPI and Pthreads, Uintah now runs on up to 262k cores on the DOE Jaguar system. In order to extend Uintah to heterogeneous systems, with ever-increasing CPU core counts and additional on-node GPUs, a new dynamic CPU-GPU task scheduler is designed and evaluated in this study. This new scheduler enables Uintah to fully exploit these architectures with support for asynchronous, out-of-order scheduling of both CPU and GPU computational tasks. A new runtime system has also been implemented with an added multi-stage queuing architecture for efficient scheduling of CPU and GPU tasks. This new runtime system automatically handles the details of asynchronous memory copies to and from the GPU and introduces a novel method of pre-fetching and preparing GPU memory prior to GPU task execution. In this study this new design is examined in the context of a developing, hierarchical GPU-based ray tracing radiation transport model that provides Uintah with additional capabilities for heat transfer and electromagnetic wave propagation. The capabilities of this new scheduler design are tested by running at large scale on the modern heterogeneous systems, Keeneland and TitanDev, with up to 360 and 960 GPUs respectively. On these systems, we demonstrate significant speedups per GPU against a standard CPU core for our radiation problem.

Humphrey, Alan↗
NASA NTRS2016

Using Citizen Science Reports to Define the Equatorial Extent of Auroral Visibility

An aurora may often be viewed hundreds of kilometers equatorward of the auroral oval owing to its altitude. As such, the NOAA Space Weather Prediction Center (SWPC) Aurora Forecast product provides a "view line" to demonstrate the equatorial extent of auroral visibility, assuming that it is sufficiently bright and high in altitude. The view line in the SWPC product is based upon the latitude of the brightest aurora, for each hemisphere, as specified by the real-time oval variation, assessment, tracking, intensity, and online nowcasting (OVATION) Prime (2010) aurora precipitation model. In this study, we utilize nearly 500 citizen science auroral reports to compare with the view line provided by an updated SWPC aurora forecast product using auroral precipitation data from OVATION Prime (2013). The citizen science observations were recorded during March and April 2015 using the Aurorasaurus platform and cover one large geomagnetic storm and several smaller events. We find that this updated SWPC view line is conservative in its estimate and that the aurora is often viewable further equatorward than Is indicated by the forecast. By using the citizen reports to modify the scaling parameters used to link the OVATION Prime (2013) model to the view line, we produce a new view line estimate that more accurately represents the equatorial extent of visible aurora. An OVATION Prime (2013) energy flux-based equatorial boundary view line is also developed and is found to provide the best overall agreement with the citizen science reports, with an accuracy of 91 percent.

Case, N. A.↗
DOE OSTI2025

PSTN-056: Survey Cadence Optimization Committee's Phase 3 Recommendations

We present the final planned comprehensive recommendation for Rubin Observatory the Legacy Survey of Space and Time (LSST) survey strategy ahead of the start of LSST. This recommendation is the product of a many-years-long iterative process where community recommendations to maximize the scientific impact of LSST across domains of astrophysics were reviewed, synthesized, aggregated, and merged to define the overall plan for 10 years of LSST observations. The current recommendation builds on Phase 1 (PSTN-053) and Phase 2 recommendations (PSTN-055) and, together, they define a 10-year plan for observing. Here we answer questions left open in PSTN-055, refine additional survey details, and describe the scope of future activities of the SCOC.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2014

Petascale Application of a Coupled CPU-GPU Algorithm for Simulation and Analysis of Multiphase Flow Solutions in Porous Medium Systems, In: 2014 IEEE 28th International Parallel and Distributed Processing Symposium

Large-scale simulation can provide a wide range of information needed to develop and validate theoretical models for multiphase flow in porous medium systems. In this paper, we consider a coupled solution in which a multiphase flow simulator is coupled to an analysis approach used to extract the interfacial geometries as the flow evolves. This has been implemented using MPI to target heterogeneous nodes equipped with GPUs. The GPUs evolve the multiphase flow solution using the lattice Boltzmann method while the CPUs compute up scaled measures of the morphology and topology of the phase distributions and their rate of evolution. Our approach is demonstrated to scale to 4,096 GPUs and 65,536 CPU cores to achieve a maximum performance of 244,754 million-lattice-node updates per second (MLUPS) in double precision execution on Titan. In turn, this approach increases the size of systems that can be considered by an order of magnitude compared with previous work and enables detailed in situ tracking of averaged flow quantities at temporal resolutions that were previously impossible. Furthermore, it virtually eliminates the need for post-processing and intensive I/O and mitigates the potential loss of data associated with node failures.

Computer Science↗
DOE OSTI2015

Applying the cold plasma dispersion relation to whistler mode chorus waves: EMFISIS wave measurements from the Van Allen Probes

Most theoretical wave models require the power in the wave magnetic field in order to determine the effect of chorus waves on radiation belt electrons. However, researchers typically use the cold plasma dispersion relation to approximate the magnetic wave power when only electric field data are available. In this study, the validity of using the cold plasma dispersion relation in this context is tested using Electric and Magnetic Field Instrument Suite and Integrated Science (EMFISIS) observations of both the electric and magnetic spectral intensities in the chorus wave band (0.1–0.9 f ce ). Results from this study indicate that the calculated wave intensity is least accurate during periods of enhanced wave activity. For observed wave intensities >10⁻³ nT², using the cold plasma dispersion relation results in an underestimate of the wave intensity by a factor of 2 or greater 56% of the time over the full chorus wave band, 60% of the time for lower band chorus, and 59% of the time for upper band chorus. Hence, during active periods, empirical chorus wave models that are reliant on the cold plasma dispersion relation will underestimate chorus wave intensities to a significant degree, thus causing questionable calculation of wave-particle resonance effects on MeV electrons.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Generic and ML Workloads in an HPC Datacenter: Node Energy, Job Failures, and Node-Job Analysis

HPC datacenters offer a backbone to the modern digital society. Increasingly, they run Machine Learning (ML) jobs next to generic, compute-intensive workloads, supporting science, business, and other decision-making processes. However, understanding how ML jobs impact the operation of HPC datacenters, relative to generic jobs, remains desirable but understudied. In this work, we leverage long-term operational data, collected from a national-scale production HPC datacenter, and statistically compare how ML and generic jobs can impact the performance, failures, resource utilization, and energy consumption of HPC datacenters. Our study provides key insights, e.g., ML-related power usage causes GPU nodes to run into temperature limitations, median/mean runtime and failure rates are higher for ML jobs than for generic jobs, both ML and generic jobs exhibit highly variable arrival processes and resource demands, significant amounts of energy are spent on unsuccessfully terminating jobs, and concurrent jobs tend to terminate in the same state. We open-source our cleaned-up data traces on Zenodo (https://doi. org/10.5281/zenodo.13685426), and provide our analysis toolkit as software hosted on GitHub (https://github.com/atlarge-research/2024-icpads-hpc-workload-characterization). This study offers multiple benefits for data center administrators, who can improve operational efficiency, and for researchers, who can further improve system designs, scheduling techniques, etc.

crossanalysis↗
NASA NTRS2010

Automation of Cassini Support Imaging Uplink Command Development

"Support imaging" is imagery requested by other Cassini science teams to aid in the interpretation of their data. The generation of the spacecraft command sequences for these images is performed by the Cassini Instrument Operations Team. The process initially established for doing this was very labor-intensive, tedious and prone to human error. Team management recognized this process as one that could easily benefit from automation. Team members were tasked to document the existing manual process, develop a plan and strategy to automate the process, implement the plan and strategy, test and validate the new automated process, and deliver the new software tools and documentation to Flight Operations for use during the Cassini extended mission. In addition to the goals of higher efficiency and lower risk in the processing of support imaging requests, an effort was made to maximize adaptability of the process to accommodate uplink procedure changes and the potential addition of new capabilities outside the scope of the initial effort.

Ly-Hollins, Lisa↗
NASA NTRS2019

Machine Learning-Based Atmospheric Phenomena Detection Platform

As the number of Earth pointing satellites has increased over the last several decades, the data volume retrieved from instruments onboard these satellites has also increased. It is expected that this trend will continue as more data intensive missions and small satellite constellations are launched. Currently, feature detection - namely atmospheric phenomena - in these datasets is performed manually and is thus not scalable with the growing data archives. Recent advancements in computational efficiency allow for the Earth science community to leverage machine learning to identify interesting atmospheric phenomena. Given the wide range of distinctive features in various atmospheric phenomena, a specialized machine learning model is required for accurate detection of these phenomena independently. The Phenomena Portal, developed at NASA IMPACT, is designed to provide visualization for the output from these machine learning models. In addition, detected events for each atmospheric phenomena are stored in a database that can be used to more easily use/subset larger spatiotemporal datasets. The user interface also incorporates additional features to enhance the user experience including spatiotemporal analysis, multiple base layer images, and a slider to filter events with lower probabilities of positive detection. Each detection supports user feedback on whether the detection is true or false that can then be stored and used to improve the machine learning model performance.

Gurung, Iksha↗
DOE OSTI2019

Nucleosynthesis for Science and Security: Preparing for a Nuclear and Chemical Sciences Program at FRIB

Nuclear reactions are vital to nuclear science and its many applications: they are the mechanism for forging elements in the cosmos, the source of energy for both stars and nuclear weapons, the principal probes used to study nuclear properties, and the primary diagnostic signatures for stockpile stewardship and nuclear forensics. Yet, most reaction experiments have been confined to the small fraction of all nuclei that are stable, and a theoretical foundation for reactions with a true predictive capability is lacking. The Facility for Rare Isotope Beams (FRIB), the flagship U.S. facility in low-energy nuclear science, will offer the opportunity to rectify the long-standing gap in understanding reactions on radioactive nuclei. The work performed in this LDRD project brought together the experimental nuclear physics, radiochemistry, nuclear theory, and high-performance computing expertise of the Nuclear and Chemical Sciences Division to develop new techniques that will be needed to exploit FRIB beams to better understand nuclear reactions. Novel isotope-harvesting techniques were developed to demonstrate that samples could be collected at the National Superconducting Cyclotron Laboratory (NSCL) at Michigan State University (the facility which FRIB builds upon) for direct measurements of long-lived radioisotopes. For isotopes too short lived for direct measurements, indirect approaches were developed that would ultimately be used with high-intensity FRIB radioactive beams. Finally, to better interpret experimental results and reliably extend predictions beyond the available data, a foundation was established for a fully microscopic and unified description of the structure, interactions, and dynamics of two reacting nuclei that moves beyond empirical models. This work has positioned the team for a leadership role at FRIB, enabling LLNL to maintain a world-class nuclear science program and to compete for future talent and funding, both of which are vital for continuing support of the laboratory’s stockpile stewardship mission.

42 ENGINEERING↗
NASA NTRS1988

A solar-wind 'trigger' for the outer heliosphere radio emissions and the distance to the terminal shock

The solar wind data from the plasma science experiment on the Voyager spacecraft are examined to search for the source of the 2 to 3 kHz radio noise detected in the outer heliosphere. It is found that two anomalous high speed streams passed Voyager 2 before the noise was initially observed. It is suggested that the interaction of these streams with the terminal shock is responsible for the more intense emission. Using a time-of-flight argument, the distance to the shock is estimated at about 70 AU-140 AU. The larger value is consistent with an estimate using Voyager data and a standard pressure-balance argument.

Mcnutt, Ralph L., Jr.↗
DOE OSTI2025

RTN-095: The Vera C. Rubin Observatory Data Preview 1

We present Rubin Data Preview 1 (DP1), the first release of data from the NSF-DOE Vera C. Rubin Observatory, consisting of raw and calibrated single-epoch images, coadds, difference images, detection catalogs, and other derived data products. DP1 is based on 1792 science-grade optical/near-infrared exposures acquired over 48 distinct nights by the Rubin Commissioning Camera, LSSTComCam, on the Simonyi Survey Telescope at the Summit Facility on Cerro Pachón, Chile during the first on-sky commissioning campaign in late 2024. DP1 covers a total of ~15 sq. deg. over seven roughly equally-sized non-contiguous fields, each independently observed in six broad photometric bands, ugrizy, spanning a range of stellar densities and latitudes and overlapping with external reference datasets. The median image quality across all bands, measured by the FWHM of the point-spread function, is approximately 1.13 arcseconds, with the sharpest images reaching about 0.65 arcseconds. DP1 contains approximately 2.3 million distinct astrophysical objects, of which 1.6 million are extended in at least one band, and 431 solar system objects, of which 93 are new discoveries. DP1 is approximately 3.5 TB in size and available to Rubin data rights holders via the Rubin Science Platform, a cloud-based environment for the analysis of petascale astronomical data. While small compared to future LSST releases, its high quality and diversity of data support a broad range of early science investigations across all four LSST themes, providing a valuable opportunity to engage with Rubin data ahead of the start of full operations in late 2025.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2019

Mathematical modelling the pathway of genomic instability in lung cancer

Genomic instability plays a significant role in lung cancer. Although substantial research has been conducted using both clinical and theoretical studies, it is still a hotly debated issue to whether genomic instability is necessary or whether genomic instability precedes oncogenes activation and tumor suppressor genes inactivation for lung cancer. In response to this issue, we come up with a mathematical model incorporating effects of genomic instability to investigate the genomic instability pathway of human lung cancer. The presented model are applied to match the incidence rate data of lung cancer from the Life Span Study cohort of the atomic bomb survivors in Nagasaki and Hiroshima and the Surveillance Epidemiology and End Results registry in the United States. Model results suggest that genomic instability is necessary in the tumorigenesis of lung cancer, and genomic instability has no significant impact on the net proliferation rate of cells by statistical criteria. By comparing the results of the LSS data to those of the SEER data, we conclude that the genomic instability pathway exhibits a sensitivity to radiation exposure, more intensive in male patients.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

CROCUS Urban Canyons - Space Science and Engineering Center (SPARC) Doppler lidar data

This is the netCDF format output from the Halo Photonics Streamline XR Doppler lidar that was deployed next to the Space Science and Engineering Center (SPARC) trailer at the University of Illnois-Chicago greenhouse parking lot during CROCUS Urban Canyons. The purpose of collecting this dataset is to provide vertical and horizontal wind profiles for studying the characteristics of turbulence over the urban canyon of Chicago. This data contains the radial velocity, intensity, and backscatter from the vertical profile, range height indicator, and sector scans that were performed over both Intensive Operating Period 1 and 2 of CROCUS Urban Canyons. There are four different types of files: * The Range Height Indicator (RHI) files contain scans that are along a constant azimuth, spanning the entire hemisphere of elevation values above the surface. * The Velocity Azimuth Display (VAD) files contain the raw radial velocity data from the 6-beam, 60 degree scans. * The User1 files contain stacked Plan Position Indicator scans over a 45 degree quadrant over downtown Chicago. * The Stare files contain vertically pointing scans. These are standard netCDF files that can be opened using xarray. The VAD scans can be processed from their raw radial velocities to horizontal wind speeds with the Atmospheric data Community Toolkit (https://arm-doe.github.io/ACT/).

EARTH SCIENCE > ATMOSPHERE > ATMOSPHERIC WINDS↗
NASA NTRS1974

The application of natural science data to land management decision-making

A natural environmental analysis process which allows the decision maker to know the probable consequences of a decision prior to the act is developed. Emphasis is placed on the fit between the natural environment and the social, economic, and functional attributes of man's communities and the transition from nature in its present state to various forms and intensities of development. Applications of the analysis are examined. It is concluded that the analysis is a workable system for land use management.

Williams, D. L.↗
NASA NTRS1991

A search for periodicity in the x ray spectrum of black hole candidate A0620-00

The archived data from the SAS-3 observations of the X-ray nova A0620-00, the best of the stellar blackhole candidates, were exhaustively examined for evidence of variable phenomena correlated with the orbital motion of the binary system of which it is a member. The original analysis of these data was completed before discovery of the binary companion and determination of the orbital period of the system. New interest was drawn to the task of a reexamination of the archive data by the recent discovery of the massive nature of the X-ray source through analysis of the Doppler variations and ellipsoidal light variations of the faint K-star companion by McClintock and Remillard. The archive research, carried out under the supervision of the principal investigator, was the topic of the thesis submitted to the MIT Department of Physics by Kenneth Plaks in partial fulfillment of the requirements for the degree of Master of Science. Plaks' effort was focused on the elimination of fluctuations in the data due to errors in attitude solutions and other extraneous causes. The first products of his work were long-term light curves of the X-ray intensities in the various energy channels as functions of time during the time from outbursts in August 1975 to quiescence approximately 6 months later. These curves, are refined versions of the preliminary results published in 1976 (Matilsky et al. 1976). Smooth exponentials were fitted to these long term light curves to provide the basis for detrending the data, thereby permitting a calculation of residuals derived by subtracting the fitted curve from the data. The residuals were then analyzed by Fourier analysis to search for variations with the period of the binary orbit, namely 7.75 hours. No evidence of an orbital periodicity was found. However, the refined light curve provides a much clearer picture of the outburst and subsequent decay of the X-ray luminosity. In fact, there were two outbursts, each followed by an exponential decay with similar time constants of about 25 days. Previous evidence of a three-oscillation variation with a 7.8 day period were confirmed. Substantial theoretical effort has been devoted to attempts to account for the decay characteristics as the result of the gradual eating up of an accretion disk by a stellar-mass blackhole (e.g., Huang and Wheeler 1989). The improved decay curves will provide significant new constraints on the theoretical analyses.

Clark, George W.↗