Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,657 records · Page 92

2008 ALCF annual report.

The word 'breakthrough' aptly describes the transformational science and milestones achieved at the Argonne Leadership Computing Facility (ALCF) throughout 2008. The number of research endeavors undertaken at the ALCF through the U.S. Department of Energy's (DOE) Innovative and Novel Computational Impact on Theory and Experiment (INCITE) program grew from 9 in 2007 to 20 in 2008. The allocation of computer time awarded to researchers on the Blue Gene/P also spiked significantly - from nearly 10 million processor hours in 2007 to 111 million in 2008. To support this research, we expanded the capabilities of Intrepid, an IBM Blue Gene/P system at the ALCF, to 557 teraflops (TF) for production use. Furthermore, we enabled breakthrough levels of productivity and capability in visualization and data analysis with Eureka, a powerful installation of NVIDIA Quadro Plex S4 external graphics processing units. Eureka delivered a quantum leap in visual compute density, providing more than 111 TF and more than 3.2 terabytes of RAM. On April 21, 2008, the dedication of the ALCF realized DOE's vision to bring the power of the Department's high performance computing to open scientific research. In June, the IBM Blue Gene/P supercomputer at the ALCF debuted as the world's fastest for open science and third fastest overall. No question that the science benefited from this growth and system improvement. Four research projects spearheaded by Argonne National Laboratory computer scientists and ALCF users were named to the list of top ten scientific accomplishments supported by DOE's Advanced Scientific Computing Research (ASCR) program. Three of the top ten projects used extensive grants of computing time on the ALCF's Blue Gene/P to model the molecular basis of Parkinson's disease, design proteins at atomic scale, and create enzymes. As the year came to a close, the ALCF was recognized with several prestigious awards at SC08 in November. We provided resources for Linear Scaling Divide-and-Conquer Electronic Structure Calculations for Thousand Atom Nanostructures, a collaborative effort between Argonne, Lawrence Berkeley National Laboratory, and Oak Ridge National Laboratory that received the ACM Gordon Bell Prize Special Award for Algorithmic Innovation. The ALCF also was named a winner in two of the four categories in the HPC Challenge best performance benchmark competition.

59 BASIC BIOLOGICAL SCIENCES↗

F-18 high alpha research vehicle surface pressures: Initial in-flight results and correlation with flow visualization and wind-tunnel data

Pressure distributions measured on the forebody and the leading-edge extensions (LEX's) of the NASA F-18 high alpha research vehicle (HARV) were reported at 10 and 50 degree angles of attack and at Mach 0.20 to 0.60. The results were correlated with HARV flow visualization and 6-percent scale F-18 wind-tunnel-model test results. The general trend in the data from the forebody was for the maximum suction pressure peaks to first appear at an angle of attack (alpha) of approximately 19 degrees and increase in magnitude with angle of attack. The LEX pressure distribution general trend was the inward progression and increase in magnitude of the maximum suction peaks up to vortex core breakdown and then the decrease and general flattening of the pressure distribution beyond that. No significant effect of Mach number was noted for the forebody results. However, a substantial compressibility effect on the LEX's resulted in a significant reduction in vortex-induced suction pressure as Mach number increased. The forebody primary and the LEX secondary vortex separation lines, from surface flow visualization, correlated well with the end of pressure recovery, leeward and windward, respectively, of maximum suction pressure peaks. The flight to wind-tunnel correlations were generally good with some exceptions.

Fisher, David F.↗

P4: Portable Parallel Processing Pipelines for Interactive Information Visualization

We present P4, an information visualization toolkit that combines declarative design specification and GPU computing for building high-performance interactive systems. Most of the existing information visualization toolkits do not harness the power of parallel processors in today's mainstream computers. P4 leverages GPU computing to accelerate both data processing and visualization rendering for interactive visualization applications. P4's programming interface offers a declarative visualization grammar for rapid specifications of data transformations, visual encodings, and interactions. By simplifying the development of GPU-accelerated visualization systems while supporting a high degree of flexibility and customization for design specification, P4 narrows the gap between expressiveness and scalability in information visualization toolkits. Through a range of examples and benchmark tests, we demonstrate that P4 provides high efficiency for creating interactive visualizations and offers drastic performance improvement over current state-of-the-art toolkits.

97 MATHEMATICS AND COMPUTING↗

Liquid propulsion turbomachinery model testing

For the past few years an extensive experimental program to understand the fluid dynamics of the Space Shuttle Main Engine hot gas manifold has been in progress. This program includes models of the Phase II and II+ manifolds for each of the air and water flow facilities, as well as two different turbine flow paths and two simulated power levels for each manifold. All models are full-scale (geometric). The water models are constructed partially of acrylic to allow flow visualization. The intent of this paper is to discuss the concept, including the test objectives, facilities, and models, and to summarize the data for an example configuration, including static pressure data, flow visualization, and the solution of a specific flow problem.

Mcdaniels, David M.↗

Circular Trajectory Approach for Online Sinusoidal Signal Distortion Monitoring and Visualization

The increasing complexity and uncertainties of modern power systems are placing significant demands on signal monitoring techniques. This work proposes the Circular Trajectory Approach (CTA) for online sinusoidal signal distortion monitoring and visualization. CTA can detect distortions of a sinusoidal signal. Compared with existing waveform anomaly detection techniques, CTA is faster in detection and less computation intensive. It thus supports edge devices and online applications. CTA also offers a new means of sinusoidal signal distortion visualization. It can reveal the distorted sections in a sinusoidal cycle and clearly display the distortions. The proposed approach is tested on real data from an open source EPRI dataset.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Exploring our Changing Planet through NASA’s Earth Information Center and Novel Methods for Earth Science Communication

In June 2023, NASA unveiled the Earth Information Center (EIC), an interagency initiative which invites the global community to explore how our planet is changing through interactive installations, captivating visualizations, and novel storytelling. Existing in both physical and virtual space, the EIC serves as a gateway to actionable information collected through an expanding fleet of Earth observing satellites and sensors. The EIC features data driven visualizations, near real-time information, immersive experiences, and curated stories that highlight the applications of publicly available data to address environmental challenges across nine thematic areas: agriculture, biodiversity, disasters, greenhouse gases, air quality, sea level rise, sustainable energy, water resources, and wildfires. Designed by an interdisciplinary team, EIC exhibits are developed to reach a wide base of end-users across multiple learning modalities. During the first year of operation, the inaugural location of the EIC at NASA Headquarters in Washington, DC, welcomed an estimated 24,000 visitors, hosted over 145 tours for domestic and international organizations, supported NASA’s Earth Day 2024 programming, and led six STEM programs for diverse student communities. With lessons learned from the first year of being open to the public and a variety of novel science communication tools in development, the EIC is expanding the mission’s reach by collaborating with museums and visitor centers. Through these collaborations, we aim to inform a broader demographic about the unprecedented changes observed in Earth’s climate and inspire communities to learn more about their one and only home, planet Earth.

Nicole Ramberg-Pihl↗

Lake-Effect Snowstorm Events and Associated Snowfall Totals Integrated from NOAA Storm Reports, ERA5, and HRRR for the Laurentian Great Lakes (1997–2024)

Lake-effect snowstorms are localized, impactful winter weather phenomena that can generate substantial snowfall totals and pose significant challenges for forecasting, transportation, and regional infrastructure. To support the analysis and modeling of these events, this dataset compiles observational reports of lake-effect snowstorms alongside corresponding snowfall estimates derived from gridded atmospheric datasets. The observational component of the data originates from the National Weather Service (NWS) winter storm report, subset to lake-effect snow event type, covering 1997–2024. For each lake-effect snow event, this data provides the impacted county, event start and end datetimes at an hourly resolution, as well as relevant storm narratives. The complementary reanalysis-derived data is sourced from European Centre for Medium-Range Weather Forecasts (ECMWF) Reanalysis 5 (ERA5) and High-Resolution Rapid Refresh (HRRR) gridded data. For both gridded datasets, the maximum total snowfall (in units mm) was extracted, constrained by the county and datetimes specified by the observational report. ERA5 data covers the entire observational period (1997–2024), whereas HRRR data is only available from November 2016 – December 2024. Three CSV files are provided here: (1) the observational lake-effect snow event report, (2) ERA5 maximum snowfall detections for each event, and (3) HRRR maximum snowfall detections for each event. Relevant data from the observational files, such as impacted state and county, event datetimes, and event IDs, were included for convenience. Users can inspect and visualize the data using tools such as Microsoft Excel and Python pandas/matplotlib packages. This dataset may support a variety of applications, including climatological analyses of lake-effect snowfall, evaluation of snowfall representation in atmospheric datasets and numerical weather prediction models, and the development of machine learning approaches for detecting or predicting lake-effect snowfall events.

EARTH SCIENCE > ATMOSPHERE > PRECIPITATION > SOLID↗

Another Set of Python Tools for Visualizing and Manipulating Small-Angle Neutron Scattering Data: Descriptions and Examples

The GP-SANS, Bio-SANS and EQ-SANS instruments at ORNL utilize drtsans for data reduction. drtsans is built on Python, and it can be run using python scripts and Jupyter notebooks. The flexibility afforded by Python makes it possible to incorporate additional actions into the scripts used for data reduction, such as analysis and visualization. Here, a new set of tools for visualizing and manipulating SANS data that can be incorporated into the data reduction scripts for the ORNL SANS instruments, or employed during post–processing, is presented that expands the capabilities of the two previously-released tool sets.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Improve Data Mining and Knowledge Discovery Through the Use of MatLab

Data mining is widely used to mine business, engineering, and scientific data. Data mining uses pattern based queries, searches, or other analyses of one or more electronic databases/datasets in order to discover or locate a predictive pattern or anomaly indicative of system failure, criminal or terrorist activity, etc. There are various algorithms, techniques and methods used to mine data; including neural networks, genetic algorithms, decision trees, nearest neighbor method, rule induction association analysis, slice and dice, segmentation, and clustering. These algorithms, techniques and methods used to detect patterns in a dataset, have been used in the development of numerous open source and commercially available products and technology for data mining. Data mining is best realized when latent information in a large quantity of data stored is discovered. No one technique solves all data mining problems; challenges are to select algorithms or methods appropriate to strengthen data/text mining and trending within given datasets. In recent years, throughout industry, academia and government agencies, thousands of data systems have been designed and tailored to serve specific engineering and business needs. Many of these systems use databases with relational algebra and structured query language to categorize and retrieve data. In these systems, data analyses are limited and require prior explicit knowledge of metadata and database relations; lacking exploratory data mining and discoveries of latent information. This presentation introduces MatLab(R) (MATrix LABoratory), an engineering and scientific data analyses tool to perform data mining. MatLab was originally intended to perform purely numerical calculations (a glorified calculator). Now, in addition to having hundreds of mathematical functions, it is a programming language with hundreds built in standard functions and numerous available toolboxes. MatLab's ease of data processing, visualization and its enormous availability of built in functionalities and toolboxes make it suitable to perform numerical computations and simulations as well as a data mining tool. Engineers and scientists can take advantage of the readily available functions/toolboxes to gain wider insight in their perspective data mining experiments.

Shaykhian, Gholam Ali↗

Improve Data Mining and Knowledge Discovery through the use of MatLab

Data mining is widely used to mine business, engineering, and scientific data. Data mining uses pattern based queries, searches, or other analyses of one or more electronic databases/datasets in order to discover or locate a predictive pattern or anomaly indicative of system failure, criminal or terrorist activity, etc. There are various algorithms, techniques and methods used to mine data; including neural networks, genetic algorithms, decision trees, nearest neighbor method, rule induction association analysis, slice and dice, segmentation, and clustering. These algorithms, techniques and methods used to detect patterns in a dataset, have been used in the development of numerous open source and commercially available products and technology for data mining. Data mining is best realized when latent information in a large quantity of data stored is discovered. No one technique solves all data mining problems; challenges are to select algorithms or methods appropriate to strengthen data/text mining and trending within given datasets. In recent years, throughout industry, academia and government agencies, thousands of data systems have been designed and tailored to serve specific engineering and business needs. Many of these systems use databases with relational algebra and structured query language to categorize and retrieve data. In these systems, data analyses are limited and require prior explicit knowledge of metadata and database relations; lacking exploratory data mining and discoveries of latent information. This presentation introduces MatLab(TradeMark)(MATrix LABoratory), an engineering and scientific data analyses tool to perform data mining. MatLab was originally intended to perform purely numerical calculations (a glorified calculator). Now, in addition to having hundreds of mathematical functions, it is a programming language with hundreds built in standard functions and numerous available toolboxes. MatLab's ease of data processing, visualization and its enormous availability of built in functionalities and toolboxes make it suitable to perform numerical computations and simulations as well as a data mining tool. Engineers and scientists can take advantage of the readily available functions/toolboxes to gain wider insight in their perspective data mining experiments.

Shaykahian, Gholan Ali↗

Global Variability in Sonic Boom Exposure due to Macroscopic Effects

Supersonic flight over land has been prohibited since 1973 due to the loudness of sonic booms. NASA is building the X-59 aircraft as part of its Quesst mission to demonstrate low-loudness shaped sonic booms, or “sonic thumps.” The Quesst mission will gather human perception data via a series of community noise surveys across the USA. The noise dose and perceptual response data will be provided to the International Civil Aviation Organization (ICAO) and the Federal Aviation Administration for use in determining potential future supersonic aircraft noise certification standards, effectively changing the prohibition from a speed limit to a noise limit. These noise regulations must be globally effective, as long travel distances see the largest benefit to supersonic flight. The state of the atmosphere through which a sonic boom travels affects the size of the region exposed to sound, the “carpet width” (CW), as well as the loudness. The focus of this dissertation is to understand and quantify the expected loudness and CW of sonic booms due to the macroscopic atmospheric effects around the world. A pair of large-scale propagation simulation studies were conducted using the NASA PCBoom code to compare predicted sonic boom loudness and CW statistics first across the USA and then across the world. For the USA study, near-field data of the X-59 in steady cruise was propagated at 4 cardinal headings at 138 locations through 5 years of Climate Forecast System Version 2 (CFSv2) atmospheric profiles. Results of a bootstrap forest predictor screening model indicated the importance of climate zone, latitude, ground elevation, season, and heading. It also noted the unimportance of time of day for predicting loudness and CW. The data is visualized in aggregate, and then broken out geographically, by season and heading, and by climate zone. Multiple linear regression models were fit to the data from the 138 locations so that estimates of the loudness and CW can be produced anywhere in the US. The results can aid in planning when and where to fly the X-59. For the global study, near-field data from three aircraft, the X-59 in a quiet and loud configuration, B-58, and Concorde, were propagated at four cardinal headings through data from three atmospheric models, the CFSv2, the Global Forecast System (GFS), and the ECMWF Reanalysis Version 5 (ERA5), at 100 global locations over 1 year. Results of a bootstrap forest predictor screening model indicated the importance of climate zone, ground elevation, season, and heading. Similar to the US study, the model indicated time of day was not an important predictor. The model also indicated that choice of weather model was not important, so the atmospheric model data are effectively interchangeable. The ERA5 model was chosen for use in an extension of the study to include 18 additional locations to ensure sampling of every climate zone. Loudness and CW results are shown in aggregate, and split geographically and by heading, season, and climate. Multiple linear regression models were fit to the data from the 118 locations so that estimates of loudness and CW can be produced around the world. N-waves and shaped booms did not have the same global variability. Koppen-Geiger climate zones were used as the climate zone definition for the global study. These are available as present-day and future climate projections. Making use of the multiple linear regression models, the future climate zones were input to estimate the effect of the changing climate on sonic boom loudness and CW. Results indicate that a changing climate would have little impact on the effectiveness of noise regulations.

X-59↗

Using NASA Earth Observations to Identify Trends in Harmful Algal Blooms in Narragansett Bay

Narragansett Bay in Rhode Island is known for its quahog, or hard-shell clam, shellfisheries. However, increased levels in harmful algal blooms (HABs) have posed threats to quahog populations and raised public health concerns due to shellfishery closures resulting from contamination with neurotoxins released by phytoplankton. NASA DEVELOP partnered with the Environmental Protection Agency’s National Health and Environmental Effects Research Laboratory and Rhode Island’s Department of Environmental Management to use Earth observations and the partners’ in-situ data to visualize phytoplankton bloom events within the bay. The team used Sentinel-3 Ocean and Land Color Instrument (OLCI), Landsat 8 Operational Land Imager (OLI), and Landsat 9 OLI-2 to track proposed proxies for phytoplankton from June 2016 to October 2023. Multiple sensors and datasets were employed for more accurate results due to the small spatial extent of Narragansett Bay. Chlorophyll-a and total suspended solids were determined to be accurate parameters to monitor HAB events. Although complications could arise due to the relatively small size of the bay and small-scale of the bloom events, which may be difficult to visualize via remote sensing, Earth observations have proven to help strengthen HAB research, monitoring, and prediction and will complement the extensive in-situ data in Narragansett Bay.

Isabella Giordano↗

Determining Trends in Impervious Cover for the Mobile Bay, AL Region for 1974-2008, Based on a Landsat Time Series

This presentation will discuss the development and use of Landsat-based impervious cover products in conjunction with land use land cover change products to assess multi-decadal urbanization across the Mobile Bay region at regional and watershed scales. This nationally important coastal region has undergone a variety of ephemeral and permanent land use land cover change since the mid-1970s, including gradual but consequential increases in urban surface cover. This urban sprawl corresponds with increased regional percent impervious cover. The region s coastal zone managers are concerned about the increasing percent impervious cover, since it can negatively influence water quality and is an important consideration for coastal conservation and restoration work. In response, we processed multi-temporal Landsat data to compute maps of percent impervious cover for multiple dates from 1974 through 2008, roughly at 5-year intervals. Each year of product was classified using one single date of leaf-on and leaf-off Landsat data in conjunction with Cubist software. We are assessing Landsat impervious cover product accuracy through comparisons to available reference data, including available NLCD impervious cover products from the USGS, raw Landsat data, plus higher spatial resolution aerial and satellite data. In particular, we are quantitatively comparing the 2008 Landsat impervious cover products to those from QuickBird 2.4-meter multispectral data. Initial visual comparisons with the QuickBird impervious cover product suggest that the 2008 Landsat product tends to underestimate impervious cover for high density urban areas and to overestimate impervious cover in established residential subdivisions mixed with forested cover. Landsat TM and ETM data appears to produce more accurate impervious cover products compared to those using lower resolution Landsat MSS data. Although imperfect, these Landsat impervious cover products have helped the Mobile Bay National Estuary Program visualize basic urbanization trends for multiple HUC-12 watersheds of concern to them and their constituents

Spruce, Joseph P.↗

BLDAP Intro to Python/Data Science Curriculum v1

The Github repository contains the Jupyter notebooks for the intro to Python / Data Science course for Berkeley Lab Director's Apprenticeship Program (BLDAP). This course is designed for students with little to no experience in coding to learn skills in Python necessary for data science. Students utilize Jupyter notebooks throughout the course. The overall goal is for students to learn how to use Python to clean, analyze, and visualize large data sets in order to communicate effectively their conclusions about the data set. Students apply the skills they learned on actual data sets provided by researchers in Berkeley Lab.

Hales, Laurel [Lawrence Berkeley National Laborato↗

Using GES DISC Data to Study Kilauea Volcano of 2018

Kilauea volcano in Hawaii which erupted in early May 2018 injected massive amount of SO2 and ash into the atmosphere. The lava flow during the eruption destroyed many home and neighborhoods. The SO2 plume during the eruption of Kilauea volcano is analyzed from May to August 2018 using multiple satellite products such as Level 2 TROPspheric Monitoring Instrument (TROPOMI) and Level 3 Ozone Monitoring Instrument (OMI) from the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC). GES DISC hosts multi-disciplinary Earth science data sets that can be used to analyze natural disasters, such as the Kilauea volcano. Additionally, GES DISC's Giovanni tool can be used to visualize these data. We acquired OMI through the subsetting function, which is processed by the GES DISC in-house developed backend software Level3/4 Regrider and Subsetter (L34RS) and TROPOMI using OPeNDAP.Data from the OMI OMSO2e product showed elevated levels of SO2 amounts during the eruption between May to August 2018. Similarly, ground-based stations at Hawaii Volcanoes National Park recorded higher SO2 concentrations during the same time period. This study uses wind direction from Modern-Era Retrospective analysis for Research and Applications, version 2 (MERRA-2) to analyze the transport and dispersion of SO2 plume and map lava flows from the volcano using thermal images from Visible Infrared Imaging Radiometer Suite (VIIRS). Furthermore, satellite observations combined with socioeconomic and public health data are used to analyze its impact in public health.

KC, Binita↗

Narragansett Bay Water Resources: Using Earth Observations to Identify Trends in Harmful Algal Blooms in Narragansett Bay

Narragansett Bay in Rhode Island is known for its quahog, or hard-shell clam, shellfisheries. However, increased levels in harmful algal blooms (HABs) and high phytoplankton biomass events pose threats to quahog populations, creating conditions that limit quahog growth and reproduction. Quahog shortages, along with public health concerns associated with contamination of shellfish from HAB-produced neurotoxins, have contributed to shellfishery closures. NASA DEVELOP partnered with the Environmental Protection Agency’s National Health and Environmental Effects Research Laboratory and Rhode Island’s Department of Environmental Management to use Earth observations and the partners’ in-situ data to visualize phytoplankton bloom events within the bay. We used Sentinel-3 Ocean and Land Color Instrument (OLCI), Landsat 8 and 9 Operational Land Imager (OLI)data to track several proxies of phytoplankton biomass from June 2016 to October 2023. Multiple sensors and in situ datasets were used to assess the feasibility of monitoring phytoplankton biomass accurately in the relatively small sized Narragansett Bay. We determined that Phytoplankton fluorescence line height was the best parameter to monitor phytoplankton biomass in the bay. Although the relatively small size of the bay and the optical complexity of these nearshore waters can pose a challenge, this assessment showed that Earth observations can be a useful complement to the in-situ monitoring of phytoplankton biomass in Narragansett Bay.

Sentinel-3↗

Piloting the Use of Energy Policy Data to Drive Market Action

Information is only useful when put to use. Across the U.S., an ever-growing number of state and local jurisdictions are implementing building performance reporting laws regarding building energy and water use in the commercial and multifamily sectors. This wealth of performance information is not yet being deployed to its full potential to drive smarter business decisions and increase energy savings. Recognizing that this information can help advance energy efficiency in cities, in 2015 the Institute for Market Transformation (IMT) partnered with New York City and the District of Columbia and local groups, NYCEEC and the District of Columbia Sustainable Energy Utility, on a three-year project to understand and document how, exactly, this data can and should be integrated to reap an array of benefits for cities, energy efficiency service providers, utilities, and building owners. This paper examines how local governments, utilities, and program implementers can replicate the success of DC and NYC. It gathers the findings from the Cities’ and their partners’ efforts to fully understand the datasets, overcome integration challenges, and apply the data to visual engagement, strategic outreach, evidence-based policymaking, and retrofit project identification and deployment. The paper goes beyond theoretical discussion by outlining practical application of data using specific examples from NYC and DC, summarizing challenges and findings, and highlighting next steps for other jurisdictions to learn from and build off the work done in those jurisdictions.

Cities↗