SEARCH · Engineering Papers

Results for “Scientific visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

All sources NASA NTRS DOE OSTI

DOE OSTI2025

TR-XPS Realtime Analysis Tool (ArroyoXPS) v0.1

The ALS has developed a Time-Resolved X-ray Photoelectron Spectroscopy (TR-XPS) technique, which involves applying a specific pattern of voltage curves to a sample while measuring XPS peaks. This pattern is repeated over multiple cycles, and changes in the material's response provide valuable scientific insights. Traditionally, file-based analysis workflows have been used: scans are run for a predetermined time, and after one or more scans are complete, calculations are made. ArroyoXPS changes this by offering in-experiment scan and analysis, allowing researchers to gain insights before a scan is finished. This enables them to adjust experimental parameters quickly, potentially saving valuable beamtime. ArroyoXPS includes tools for integrating with beamline control systems, performing analysis, and visualizing scan data in a web browser.

McReynolds, Dylan [Lawrence Berkeley National Labo↗

DOE OSTI2022

CALORIE: A Constraint Language and Optimizing Runtime for Exascale Power Management (Final Report)

This final technical report summarizes the key accomplishments on the CALORIE project, a DOE Early Career award received by PI Henry Hoffmann at the University of Chicago. CALORIE’s main goal was to create principled methodologies, tools, and practices to help scientists and high-performance computing (HPC) operators maximize the performance and insights obtained from scientific computing applications in the face of exascale power constraints. The project accomplished these goals by completing the following objectives: • Designing a language for describing application goals (including constraints and objectives) and system capabilities. The application goals will include things like which simulations or simulations plus in situ analysis will be run together, what the power constraints are, and what requirements there are for in situ analysis (for example, a desired frame rate for visualization). The system capabilities include all components that can be adjusted to tradeoff power and performance. • Designing a runtime system that takes specified goals and capabilities and dynamically determines what capabilities to use to meet the goals. This runtime adapts to changes in goals, application behavior, or available capabilities to automatically maintain the goals despite unexpected disturbances. • Developing a foundational understanding of how power constraints affect the problem of scheduling applications in large-scale systems. This report provides an overview of the accomplishments related to each of these key objectives.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

MODE: A Web Application for Interactive Visualization and Exploration of Omics Data

Studies generating transcriptomics, proteomics, lipidomics, and metabolomics (colloquially referred to as “omics”) data allow researchers to find biomarkers or molecular targets, or understand complex biological structures and functions by identifying changes in biomolecule abundance and expression between experimental conditions. Omics data is multi-dimensional and oftentimes summarization techniques such as principal component analysis (PCA) are used to identify high-level patterns in data. Though useful, these summaries don’t allow exploration of detailed patterns in omics data that may have biological relevance. The use of interactive HTML displays with plots allows researchers to interact with omics data at a detailed level, but building these displays requires significant coding expertise. To overcome this barrier, the software MODE was built to empower users to build their own interactive HTML displays to support scientific discovery. These displays are easily shareable, do not depend on a specific operating system, and allow users to effortlessly sort and filter plots by categorical or numerical variables. MODE allows users to build and share these displays with several options for plot design and meta selection. In conclusion, the MODE web application and its capabilities are presented and then demonstrated on lipidomics data from a leaf wounding study.

lipidomics↗

DOE OSTI2022

Optimizing Error-Bounded Lossy Compression for Scientific Data With Diverse Constraints

Vast volumes of data are produced by today's scientific simulations and advanced instruments. These data cannot be stored and transferred efficiently because of limited I/O bandwidth, network speed, and storage capacity. Error-bounded lossy compression can be an effective method for addressing these issues: not only can it significantly reduce data size, but it can also control the data distortion based on user-defined error bounds. In practice, many scientific applications have specific requirements or constraints for lossy compression, in order to guarantee that the reconstructed data are valid for post hoc analysis. For example, some datasets contain irrelevant data that should be isolated in particular and users often have intuition regarding value ranges, geospatial regions, and other data subsets that are crucial for subsequent analysis. Existing state-of-the-art error-bounded lossy compressors, however, do not consider these constraints during compression, resulting in inferior compression ratios with respect to user's post hoc analysis, due to the fact that the data itself provides little or no value for post hoc analysis. In this work we address this issue by proposing an optimized framework that can preserve diverse constraints during the error-bounded lossy compression, e.g., cleaning the irrelevant data, efficiently preserving different precision for multiple value intervals, and allowing users to set diverse precision over both regular and irregular regions. We perform our evaluation on a supercomputer with up to 2,100 cores. Experiments with six real-world applications show that our proposed diverse constraints based error-bounded lossy compressor can obtain a higher visual quality or data fidelity on reconstructed data with the same or even higher compression ratios compared with the traditional state-of-the-art compressor SZ. Furthermore, our experiments also demonstrate very good scalability in compression performance compared with the I/O throughput of the parallel file system.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2019

GeoNEX: A Cloud Gateway for Near Real-time Processing of Geostationary Satellite Products

The emergence of a new generation of geostationary satellite sensors provides land andatmosphere monitoring capabilities similar to MODIS and VIIRS with far greater temporal resolution (5-15 minutes). However, processing such large volume, highly dynamic datasets requires computing capabilities that (1) better support data access and knowledge discovery for scientists; (2) provide resources to enable real-time processing for emergency response (wildfire, smoke, dust, etc.); and (3) provide reliable and scalable services for the broader user community. This paper presents an implementation of GeoNEX (Geostationary NASA-NOAA Earth Exchange) services that integrate scientific algorithms with Amazon Web Services (AWS) to provide near realtime monitoring (~5 minute latency) capability in a hybrid cloud-computing environment. It offers a user-friendly, manageable and extendable interface and benefits from the scalability provided by Amazon Web Services. Four use cases are presented to illustrate how to (1) search and access geostationary data; (2) configure computing infrastructure to enable near real-time processing; (3) disseminate and utilize research results, visualizations, and animations to concurrent users; and (4) use a Jupyter Notebook-like interface for data exploration and rapid prototyping. As an example of (3), the Wildfire Automated Biomass Burning Algorithm (WF_ABBA) was implemented on GOES-16 and -17 data to produce an active fire map every 5 minutes over the conterminous US. Details of the implementation strategies, architectures, and challenges of the use cases are discussed.

GeoNEX↗

NASA NTRS2024

The Spectral Characteristics of Lunar Agglutinates: Visible-Near-Infrared Spectroscopy of Apollo Soil Separates

The lunar surface evolves over time due to space weathering, and the visible–near-infrared spectra of more mature (i.e., heavily weathered) soils are lower in reflectance and steeper in spectral slope (i.e., darker and redder) than their immature counterparts. These spectral changes have traditionally been attributed to the space-weathered rims of soil grains (and particularly nanophase iron therein). However, understudied thus far is the spectral role of agglutinates—the agglomerates of mineral and lithic fragments, nanophase iron, and glass that are formed by micrometeoroid impacts and are ubiquitous in mature lunar soils. We separated agglutinates and non-agglutinates from six lunar soils of varying maturity and composition, primarily from the 125–250 μm size fraction, and measured their visible–near-infrared reflectance spectra. For each soil, the agglutinate spectra are darker, redder, and have weaker absorption bands than the corresponding non-agglutinate and unsorted soil spectra. Moreover, greater soil maturity corresponds to darker agglutinate spectra with weaker absorption bands. These findings suggest that agglutinates (rather than solely the space-weathered rims) play an important role in both the darkening and reddening of mature soils—at least for the size fractions examined here. Comparisons with analog soils suggest that high nanophase iron abundance in agglutinates is likely responsible for their low reflectance and spectrally red slope. Additional studies of agglutinates are needed both to more comprehensively characterize their spectral properties (across size fractions and in mixing with non-agglutinates) and to assess the relative roles of agglutinates and rims in weathering-associated spectral changes. Plain Language Summary - In scientific study of the Moon, one key focus is surface processes: how do physical and chemical properties of the Moon’s surface change over time due to weathering (e.g., bombardment by micrometeoroids and by particles from the Sun)? Such investigations provide valuable insights into the Moon’s history (such as the ages of impact craters) that are often deduced from measurements of reflected light; as a soil is weathered it reflects light differently, which manifests visually as a progressive darkening of the soil. This phenomenon had primarily been attributed to weathering-associated development of rims on individual soil grains, but in this work we explored an alternative cause: soil particles known as agglutinates (misshapen, vesicular agglomerates of mineral fragments, iron, and glass that form due to weathering processes). We isolated agglutinates of six soil samples from the Moon and measured how they reflect light. We find that they reflect light in patterns reminiscent of how the Moon’s surface does when weathered. These findings suggest that agglutinates play a more important role than previously thought in determining the light-reflecting properties of the Moon’s surface, thus warranting greater and more nuanced consideration in future studies of how the Moon’s surface changes over time.

spectroscopy↗

DOE OSTI2025

Evaluating HPC Scheduling Strategies for Urgent Workloads

Scientific computing centers increasingly face workloads with diverse urgency requirements, driven by applications that demand rapid or even immediate execution. Appropriately configured scheduling policies can significantly improve both user satisfaction and overall cluster utilization. In this work, we present a systematic analysis of scheduler configurations under scenarios where a fraction of jobs have urgent computing needs. We evaluate multiple job scheduling simulators, develop a lightweight job-submission emulation framework, and create tools to analyze and visualize the resulting scheduling data. Our study identifies key trade-offs between responsiveness, fairness, and efficiency, and offers a set of practical scheduling configurations (particularly for Slurm) that can be tailored to HPC environments supporting mixed-urgency workloads.

Maheshwari, Ketan [ORNL] (ORCID:000000033800662X)↗

NASA NTRS2005

Development of an IUE Time Series Browser

The International Ultraviolet Explorer (IUE) satellite operated successfully for more than 17 years. Its archive of more than 100,000 science exposures is widely acknowledged as an invaluable scientific resource that will not be duplicated in the foreseeable future. We have searched this archive for objects which were observed 10 or more times with the same spectral dispersion and wavelength coverage over the lifetime of IUE. Using this definition of a time series, we find that roughly half of the science exposures are members of such time series. This paper describes a WEB-based IUE time series browser which enables the user to visually inspect the repeated observations for variability and to examine each member spectrum individually. Further, if the researcher determines that a specific data set is worthy of further investigation, it can be easily downloaded for further, detailed analysis.

Massa, Derck↗

NASA NTRS1992

Functional requirements document for the Earth Observing System Data and Information System (EOSDIS) Scientific Computing Facilities (SCF) of the NASA/MSFC Earth Science and Applications Division, 1992

Five scientists at MSFC/ESAD have EOS SCF investigator status. Each SCF has unique tasks which require the establishment of a computing facility dedicated to accomplishing those tasks. A SCF Working Group was established at ESAD with the charter of defining the computing requirements of the individual SCFs and recommending options for meeting these requirements. The primary goal of the working group was to determine which computing needs can be satisfied using either shared resources or separate but compatible resources, and which needs require unique individual resources. The requirements investigated included CPU-intensive vector and scalar processing, visualization, data storage, connectivity, and I/O peripherals. A review of computer industry directions and a market survey of computing hardware provided information regarding important industry standards and candidate computing platforms. It was determined that the total SCF computing requirements might be most effectively met using a hierarchy consisting of shared and individual resources. This hierarchy is composed of five major system types: (1) a supercomputer class vector processor; (2) a high-end scalar multiprocessor workstation; (3) a file server; (4) a few medium- to high-end visualization workstations; and (5) several low- to medium-range personal graphics workstations. Specific recommendations for meeting the needs of each of these types are presented.

Botts, Michael E.↗

NASA NTRS1991

Coordinating Council. Sixth Meeting: Who Are Our Key Users?

This NASA Scientific and Technical Information Program Coordinating Council meeting deals with the topic 'Who are our key users?' Presentations were made on the following subtopics: Key users: Who uses the system the most, Who orders the most documents, Users: What do we know about them?, NASA/DOD Aerospace Knowledge Diffusion research project on 'Potential key users', How we meet the user's needs, and STI Council user requirements update. Summaries of discussions after the presentations are included along with visuals for the presentations.

Source record↗

NASA NTRS1997

Sustainable Biosphere Initiative Project

The goal of the Advanced Technology in Ecological Sciences project is to gain broad participation within the environmental scientific community in developing a research agenda addressing the development and refinement of technologies instrumental to research that responds to these challenges (e.g. global climate change, unsustainable resource use, and threats to biological diversity). The following activities have been completed: (1) A listserve 'eco-tech was set up to serve as a clearinghouse of information about activities and events relating to advanced technologies; (2) A series of conference calls were organized on specific topics including data visualization and spatial analysis, and remote sensing; and (3) Two meetings were organized at the 19% ESA Annual Meeting in Providence, Rhode Island. Topics covered included concerns about tool and data sharing; interest in expanded development of ground-based remote sensing technologies for monitoring; issues involved in training for using new technologies and increasing data streams, and- associated implications of data processing capabilities; questions about how to develop appropriate standards (i.e. surface morphology classification standards) that facilitate the exchange and comparison of analytical results; and some thoughts about remote sensing platforms and vehicles.

Source record↗

NASA NTRSDate not supplied

From Wind Tunnels to Flight Vehicles: Visualization and quantitative measurements supporting NASA’s space program

NASA’s Space Launch System (SLS) and Orion Crew Module have been studied in wind tunnels using the planar laser-induced fluorescence (PLIF) technique for flow visualization and quantitative thermometry and in flight using high-resolution imagery and quantitative infrared surface heating measurements. This paper reviews both types of measurements. OCIS codes: (120.1740) Combustion diagnostics; (300.2530) Fluorescence, laser-induced; (110.3080) Infrared imaging.

Planar Laser-Induced Fluorescence (PLIF)↗

NASA NTRS2020

Harnessing Big Data to Support the Conservation and Rehabilitation of Mangrove Forests Globally

Mangrove forests are found on sheltered coastlines in tropical, subtropical, and some warm temperate regions. These forests support unique biodiversity and provide a range of benefits to coastal communities, but as a result of large-scale conversion for aquaculture, agriculture, and urbanization, mangroves are considered increasingly threatened ecosystems. Scientific advances have led to accurate and comprehensive global datasets on mangrove extent, structure, and condition, and these can support evaluation of ecosystem services and stimulate greater conservation and rehabilitation efforts. To increase the utility and uptake of these products, in this Perspective we provide an overview of these recent and forthcoming global datasets and explore the challenges of translating these new analyses into policy action and on-the-ground conservation. We describe a new platform for visualizing and disseminating these datasets to the global science community, non-governmental organizations, government officials, and rehabilitation practitioners and highlight future directions and collaborations to increase the uptake and impact of large-scale mangrove research.

mangrove↗

DOE OSTI2024

3D Optical Coherence Tomography image processing in BISCAP: characterization of biofilm structure and properties

Abstract Motivation BISCAP is a state-of-the-art tool for automatically characterizing biofilm images obtained from Optical Coherence Tomography. Limited availability of other software tools is reported in the field. BISCAP’s first version processes 2D images only. Processing 3D images is a problem of greater scientific relevance since it deals with the entire structure of biofilms instead of their 2D slices. Results Building on the image-processing principles and algorithms proposed earlier for 2D images, these were adapted to the 3D case, and a more general implementation of BISCAP was developed. The primary goal concerns the extension of the initial methodology to incorporate the depth axis in 3D images; multiple improvements were also made to boost computational performance. The calculation of structural properties and visual outputs was extended to offer new insights into the 3D structure of biofilms. BISCAP was tested using 3D images of biofilms with different morphologies, consistently delivering accurate characterizations of 3D structures in a few minutes using standard laptop machines. Low user dependency is required for image analysis. Availability and implementation BISCAP is available from https://github.com/diogonarciso/BISCAP. All images used in the tutorials and the validation examples are available from https://web.fe.up.pt/∼fgm/biscap3d.

Narciso, Diogo A. C. (ORCID:0000000227767477)↗

DOE OSTI2023

Conquering Data Chaos: Research Data Management with Kubernetes

Managing massive volumes of data and effectively making it accessible to researchers poses significant challenges and is a barrier to scientific discovery. In many cases, critical data is locked up in unwieldy file formats or one-off databases and is too large to effectively process on a single machine. This talk explores the role of Kubernetes, an open-source container orchestration platform, in addressing research data management challenges. I will discuss how we are using a set of publicly available open-source and home-grown tools in the National Renewable Energy Lab (NREL) Data, Analysis, and Visualization (DAV) group to help researchers overcome data-related bottlenecks. The talk will begin by providing an overview of the data challenges faced in research data management, including data storage, processing, and analysis. I will highlight Kubernetes' ability to handle large-scale data by leveraging containerization and distributed computing, including distributed storage. Kubernetes allows researchers to encapsulate data processing infrastructure and workflows into portable containers, enabling reproducibility and ease of deployment. Kubernetes can then schedule and manage the resource allocation of these containers to enable efficient utilization of limited computing resources, leading to more efficient data processing and analysis. I will discuss some limitations of traditional, siloed approaches to dealing with data and emphasize the need for solutions which foster collaboration. I will highlight how we are using Kubernetes at NREL to facilitate data sharing and cooperation among research teams. Kubernetes' flexible architecture enables the deployment of shared computing environments, such as Apache Superset, where researchers can seamlessly access and analyze shared datasets. Providing the ability to have one research team easily consume data generated by another, utilizing Kubernetes' as a central data platform, is one of the major wins we've encountered by adopting the platform. Finally, I will showcase real-world use cases from NREL where we have used Kubernetes to solve some persistent data challenges involving large volumes of sensor and monitoring data. I will discuss the challenges we encountered when creating our cluster and making it available as a production-ready resource. I will also discuss the specific suite of tools, including Postgres and Apache Druid for columnar and timeseries data, and Redpanda Kafka for streaming data we have deployed in our infrastructure, and the process that went into the selection of these tools.

collaborative environment↗

DOE OSTI2024

Atomic-scale investigations of Ti 3 C 2 T x MXene surfaces

The family of two-dimensional (2D) carbides and/or nitrides, also known as MXenes, has generated great excitement within the scientific community and has been proposed for a wide variety of applications since its discovery. Despite this attention, there have been only limited studies of the atomically resolved local electronic and physical structure of MXene surfaces strongly affecting the physicochemical properties of these materials. Here, in this study, we report local structural, spectroscopic, and chemical investigations of the surfaces of Ti 3 C 2 T x flakes using scanning tunneling microscopy and spectroscopy, closely coupled to theoretical studies. Terminal groups are visualized and characterized, along with surface TiO 2 clusters formed upon exposure to air. Fundamental insight into the local electronic and chemical properties associated with different terminal groups on MXenes and their oxidation products is presented.

36 MATERIALS SCIENCE↗

NASA NTRS1986

Fracture analysis of radial scientific instrument module registration fittings of the space telescope

Various pieces of the registration fittings for the Radial Scientific instrument (SI) module of the Space Telescope were examined from a fracture mechanics point of view and deemed to be fail-safe or else have had maximum allowable flaw sizes specified for them. The results of these analyses are summarized in tabular form. In many instances the applied stress levels were so low that the threshold stress intensity factor range was never reached. In most of the others the allowable flaw sizes were large enough to be detected by visual inspection. However, for some parts, such as the flexures connecting the aluminum cover to the ball retainer in the fitting at point A, the flaw sizes were rather small. Eddy current tests are capable of detecting flaws of this size (0.022 inches x 0.1 inches), so for those which have been so tested these small flaws should represent no danger of going undetected. In every instance approximations were made to err on the conservative side. These were pointed out in the discussions of the analyses for each fitting. One conservative approximation that was not mentioned, however, is the fact that retardation was not included in the crack propagation computations.

Springfield, C. W., Jr.↗

NASA NTRS2001

Earth and Space Science Electronic Theater: State-of-the-Art Visualization from the Latest Remote Sensing Observations. High Definition Television on the SMM IMAX Screen with Ultra High Performance Projector

Fritz Hasler (NASA/Goddard) will demonstrate the latest Blue Marble Digital Earth technology. We will fly in from space through Terra, Landsat 7, to 1 m Ikonos "Spy Satellite" data to Washington, NYC, Chicago, and LA. You will see animations using the new 1 km global datasets from the EOS Terra satellite. Spectacular new animations from Terra, Landsat 7, and SeaWiFS will be presented. See the latest animations of the super hurricanes like, Floyd, Luis, and Mitch, from GOES & TRMM. See movies assembled using new low cost HDTV nonlinear editing equipment that is revolutionizing the way we communicate scientific results. See climate change in action with Global Land & Ocean productivity changes over the last 20 years. Remote sensing observations of ocean SST, height, winds, color, and El Nino from GOES, AVHRR, SSMI & SeaWiFS are put in context with atmospheric and ocean simulations. Compare symmetrical equatorial eddies observed by GOES with the simulations.

Hasler, A. F.↗