Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data exploration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Modeling freight mode choice using machine learning classifiers: a comparative study using Commodity Flow Survey (CFS) data

This study explores the usefulness of machine learning classifiers for modeling freight mode choice. We investigate eight commonly used machine learning classifiers, namely Naïve Bayes, Support Vector Machine, Artificial Neural Network, K-Nearest Neighbors, Classification and Regression Tree, Random Forest, Boosting and Bagging, along with the classical Multinomial Logit model. US 2012 Commodity Flow Survey data are used as the primary data source; we augment it with spatial attributes from secondary data sources. The performance of the classifiers is compared based on prediction accuracy results. The current research also examines the role of sample size and training-testing data split ratios on the predictive ability of the various approaches. In addition, the importance of variables is estimated to determine how the variables influence freight mode choice. The results show that the tree-based ensemble classifiers perform the best. Specifically, Random Forest produces the most accurate predictions, closely followed by Boosting and Bagging. With regard to variable importance, shipment characteristics, such as shipment distance, industry classification of the shipper and shipment size, are the most significant factors for freight mode choice decisions.

42 ENGINEERING↗
DOE OSTI2026

RCSB protein data Bank: Next‐generation advanced search for exploration of experimental structures and computed structure models

Abstract The Protein Data Bank (PDB), established in 1971, is the primary global, open‐access archive for experimentally determined 3D macromolecular structures (proteins, RNA, DNA). The research‐focused RCSB.org web‐portal provides access to these data alongside more than one million machine‐learning‐predicted structure models, greatly expanding the available structural landscape. Rapid growth of both experimental and computational structures has increased the need for powerful yet accessible search tools that serve a broad and diverse scientific community. Herein, we describe a redesigned RCSB Protein Data Bank RCSB.org Advanced Search capability that supports intuitive discovery of 3D structures through a unified interface. This interface integrates annotation‐, sequence‐, and 3D structure‐based searches, embeds an interactive 3D viewer, and incorporates curated biological knowledge, such as catalytic site definitions from Mechanism and Catalytic Site Atlas and ligand‐guided structural motifs, for constructing geometry‐driven queries. A new Chemical Search tool allows definition of chemical queries via an integrated drawing tool or standard identifiers, seamlessly combining them with annotation filters. By allowing query definition directly within spatial and chemical contexts, these search interfaces reduce the need for detailed knowledge of residue numbering, chain identifiers, or external cheminformatics software. This capability enables efficient exploration of structures, chemical diversity, and structure–function relationships across all life domains. The redesigned interfaces can be accessed directly at rcsb.org/search/advanced for Advanced Search and rcsb.org/search/chemical for Chemical Search.

Rose, Yana [Research Collaboratory for Structural ↗
NASA NTRS2020

Exploring the Limits of the Data-Model-Theory Synergy: “Hot” MW Transitions for Rovibrational IR Studies

In order to further improve the accuracy of rovibrational IR line lists generated from the “Best Theory +Reliable High-resolution Experiment” (BTRHE) strategy from 0.01-0.05 cm-1, or 300-1500 MHz, to ~10 MHz, we explore the current limits of the Data-Model-Theory synergy by examining the accuracy and consistency of existing data, then propose that “hot” bands in microwave (MW) spectra is the solution we need for future enhancements. The Ames SO2 J=0-20 rovibrational energy levels computed on the semi-empirically refined Ames-2 potential energy surface (PES) are fit to the Effective Hamiltonian (EH) model regularly used in the experimental infrared (IR) analysis for SO2 isotopologues. In the fitted EH(Ames) model, the rotational constants A/B/C and all 5 quartic centrifugal distortion constants display clear, systematic, and consistent patterns along the vibrational state energy or quanta. Such consistent patterns may facilitate the vibrational assignments for MW hot bands and extract more information from high temperature MW spectra. Some EH(Expt) analyses were carried out with the lowest order Coriolis Coupling term, C1. Their constants should not be directly compared with other EH(Expt) and EH(Ames) results. After excluding them, our  = EH(Ames)- EH(Expt) analyses for 5 isotopologues (626, 636, 646, 628 and 828) indicates some loss of accuracy and consistency starting from vibrational states as low as 22 or 1000 cm-1. Some EH parameters, e.g. K, may have relative deviations as large as 50-100% and totally lose any recognizable patterns. This simply means that current EH(Expt) models do not have the system-wide consistency we need to further refine the EH(Ames) and Ames rovibrational IR line lists. A large part of such defects are probably inherited from the limited precision of experimental line positions, i.e. 1E-3 ~ 1E-4 cm-1, or 3-30 MHz. This is confirmed in a series of truncation tests using the Ames data. Although the EH(Ames) consistency may help identify unreliable rovibrational EH(Expt) parameters, and make reliable predictions for minor isotopologues and unobserved vibrational bands, we believe only the highly accurate “hot” MW transitions can provide real enhancements for EH(Expt) accuracy and consistency. “Hot” MW spectra should play a more significant role in the future synergy of Data, Model, and Theory in the field of rovibrational IR studies.

Xinchuan Huang↗
DOE OSTI2021

Hyper Suprime-Cam Legacy Archive

Abstract We present the launch of the Hyper Suprime-Cam Legacy Archive (HSCLA), a public archive of processed, science-ready data from the Hyper Suprime-Cam (HSC). HSC is an optical wide-field imager installed at the prime focus of the Subaru Telescope and has been in operation since 2014. While ∼1/3 of the total observing time of HSC has been used for the Subaru Strategic Program (SSP), the remainder of the time is used for Principal Investigator (PI)-based programs. We have processed the data from these PI-based programs and make the processed, high-quality data available to the community through HSCLA. The current version of HSCLA includes data taken in the first year of science operation, 2014. We provide both individual and coadd images as well as photometric catalogs. The photometric catalog from the coadd is loaded to the database, which offers a fast access to the large catalog. There are other online tools such as an image browser and an image cutout tool and they will be useful for science analyses. The coadd images reach 24–27th magnitudes at 5σ for point sources and cover approximately 580 square degrees in at least one filter with 150 million objects in total. We perform extensive quality assurance tests and verify that the photometric and astrometric quality of the data is good enough for most scientific explorations. However, the data are not without problems and users are referred to the list of known issues before exploiting the data for science. All the data and documentations can be found at the data release site, 〈https://hscla.mtk.nao.ac.jp/〉.

Tanaka, Masayuki↗
DOE OSTI2022

Residential Solar-Adopter Income and Demographic Trends: 2021 Update [Slides]

The report describes income, demographic, and other socio-economic trends among U.S. residential rooftop solar adopters. The report is based on data for roughly 1.9 million residential rooftop solar systems installed through 2019, representing 82% of all U.S. systems. With its unique size, geographic scope, and level of detail, this report is intended to serve as a foundational reference document for policy-makers, industry stakeholders, and researchers. Key findings include the following: Solar adopters generally skew towards higher incomes, though that trend continues to diminish over time. Solar adopter incomes vary considerably and encompass many low-to-moderate income (LMI) households. Solar-adopter incomes are consistently higher for systems paired with battery storage, for host-owned systems, and for systems installed on single-family homes. Solar adopters differ from the broader U.S. population in terms of a variety of other demographic and socioeconomic measures. State-level comparisons indicate that solar-adopters tend to live in neighborhoods with relatively high non-Hispanic White and Asian populations, and with relatively low Hispanic and Black populations. In conjunction with the report, Berkeley Lab has published an updated accompanying set of online data visualizations that allow users to further explore the underlying data. Berkeley Lab is also offering related analytical support to states, local agencies, and other organizations on issues related to solar adoption among low-to-moderate income households.

14 SOLAR ENERGY↗
DOE OSTI2022

Residential Solar-Adopter Income and Demographic Trends: November 2022 Update [Slides]

The report describes income, demographic, and other socio-economic trends among U.S. residential rooftop solar adopters. The report is based on address-level data for roughly 2.8 million residential rooftop solar systems installed through 2021, representing 86% of all U.S. systems. With its unique size, geographic scope, and level of detail, this report is intended to serve as a foundational reference document for policy-makers, industry stakeholders, and researchers. Key findings include the following: -Median solar adopter income was about $\$110$k/year in 2021, compared to a U.S. median of about $\$63$k/year for all households and $\$79$k/year for all owner-occupied households -The degree of income skew varies significantly across all states, but all states exhibit some positive income skew, with median solar-adopter incomes ranging from 131-168% of the respective county-median income for all households -Notwithstanding the fact that solar adopter incomes skew high, a substantial share of adopters could be considered low-to-moderate income (LMI), with 22% of all 2021 adopters earning less than 80% of area median income, and an additional 21% between 80% and 120% of area median income. -Solar-adopter incomes are declining over time, with median incomes dropping from $\$129$k in 2010 to $\$110$k in 2021, as adoption becomes more proportionately distributed across the population and has started to broaden into low- and middle-income states since 2016. -Solar-adopter incomes are consistently higher for systems paired with battery storage, for host-owned systems, and for systems installed on single-family homes; higher income adopters also consistently install larger systems. -Solar adopters tend to live in Census Tracts not identified as “disadvantaged communities” (using the U.S. Department of Energy’s interim definitions developed March 2022), making up 11% of adopters compared to 18% of U.S. households. -Compared to the broader population, solar adopters tend to: identify as Non-Hispanic White, be primarily English-speaking, have higher education levels, be middle-aged, work in business and finance-related occupations, and live in higher-value homes In conjunction with the report, Berkeley Lab has published an updated accompanying set of online data visualizations that allow users to further explore the underlying data. Berkeley Lab is also offering related analytical support to states, local agencies, and other organizations on issues related to solar adoption among low-to-moderate income households; requests for analytical support may be submitted through this online form.

13 HYDRO ENERGY↗
DOE OSTI2023

Residential Solar-Adopter Income and Demographic Trends: 2023 Update [Slides]

The report describes income, demographic, and other socio-economic trends among U.S. residential rooftop solar adopters. The report is based on address-level data for roughly 3.4 million residential rooftop solar systems installed through 2022, representing 86% of all U.S. systems. With its unique size, geographic scope, and level of detail, this report is intended to serve as a foundational reference document for policy-makers, industry stakeholders, and researchers. Key findings include the following: (1) Median solar adopter income was about $\$117$k/year in 2022, compared to a U.S. median of about $\$69$k/year for all households and $\$86$k/year for all owner-occupied households; (2) The degree of income skew varies significantly across all states, but all exhibit some positive income skew relative to all households in the state, with median solar-adopter incomes ranging from 108-180% of the respective state-median income for all households; (3) Roughly 45% of solar adopters in 2022 had incomes below 120% of their area median income (AMI), a threshold sometimes used to define “low-and-moderate income” (or LMI), while 23% were below 80% of AMI, often used to define “low-income”; (4) Solar adoption continues to shift toward less affluent households, with the median current income of solar adopters dropping from $\$140$k for households that installed systems in 2010 to $\$117$k in 2022; (5) PV systems installed in 2022 by households earning less than $50k had a median size of 6.1 kW, 34% were third-party owned, and 5% included battery storage, compared to corresponding values of 7.6%, 17%, and 15% for households earning more than 200 dollars k; and (6) Compared to all households in their respective state, solar adopters tend to be negligibly more rural; have higher home values; and are more likely to be college educated, identify as non-Hispanic white, live outside a disadvantaged community (DAC), be middle-aged, work in a business or financial occupation, and own a single-family home In conjunction with the report, Berkeley Lab has published an updated accompanying set of online data visualizations that allow users to further explore the underlying data. Berkeley Lab is also offering related analytical support to states, local agencies, and other organizations on issues related to solar adoption among low-to-moderate income households.

14 SOLAR ENERGY↗
DOE OSTI2024

Residential Solar-Adopter Income and Demographic Trends: 2024 Update [Slides]

The report describes income, demographic, and other socio-economic trends among U.S. residential rooftop solar adopters. The report is based on address-level data for roughly 4.1 million residential rooftop solar systems installed through 2023, representing 87% of all U.S. systems. With its unique size, geographic scope, and level of detail, this report is intended to serve as a foundational reference document for policy-makers, industry stakeholders, and researchers. Key findings include the following: -The median income of households that installed solar in 2023 was about $\$$115k/year, compared to a U.S. median of $\$$75k/year for all households and $\$$94k/year for all U.S. owner-occupied households. -Compared to owner-occupied households in the same state, 2023 solar-adopter incomes were 7% higher in the median case, and in 10 states, median solar-adopter incomes were below the corresponding median income for all owner-occupied households. -Roughly 49% of solar adopters in 2023 had incomes below 120% of their area median income (AMI), a threshold sometimes used to define “low-and-moderate income” (or LMI), while 26% were below 80% of AMI, often used to define “low-income”. -Solar adoption continues to shift toward less affluent households over time, with the median present-day income of solar adopters dropping from $\$$141k for households that installed systems in 2010 to $\$$115k in 2023. -PV systems installed in 2023 by households earning less than $\$$50k had a median size of 6.4 kW, 33% were third-party owned, and 6% included battery storage, compared to corresponding values of 8.0 kW, 18%, and 14% for households earning more than $\$$200k. -Compared to all households in their respective state, solar adopters in 2023 were slightly more likely to be college educated and to live in rural areas; had higher home values; and were more likely to live outside a disadvantaged community (DAC), be middle-aged, identify as non-Hispanic white, work in a business or financial occupation, and own a single-family home. In conjunction with the report, Berkeley Lab has published an updated accompanying set of online data visualizations that allow users to further explore the underlying data. Berkeley Lab is also offering related analytical support to states, local agencies, and other organizations on issues related to solar adoption among low-to-moderate income households; requests for analytical support may be submitted through this online form.

14 SOLAR ENERGY↗
NASA NTRS1977

Skylab explores the Earth

Data from visual observations are integrated with results of analyses of approxmately 600 of the nearly 2000 photographs taken of Earth during the 84-day Skylab 4 mission to provide additional information on (1) Earth features and processes; (2) operational procedures and constraints in observing and photographing the planet; and (3) the use of man in real-time analysis of oceanic and atmospheric phenomena.

Source record↗
NASA NTRS1984

The measured motions inside equatorial plasma bubbles

A preliminary study of the vertical and north-south horizontal ion motions in plasma bubbles in the near-equatorial ionosphere utilizing drift meter data from Atmosphere Explorer E is presented. High-resolution data show that the vertical ion velocity in some bubbles increases approximately linearly with (N(0)-N)/N, where N(0) is the background ion concentration and N is the bubble ion concentration. At sufficiently large N(0)/N the vertical ion velocity saturates, but often at a value substantially larger than the ratio of the gravitational acceleration to the ion neutral collision frequency. These larger than nominal velocities may result from background eastward electric fields and/or from a vertically elongated bubble cross section. The unanticipated observation that large poleward horizontal drifts accompany these vertical drifts seems to follow naturally from a redistribution of plasma along flux tubes as the plasma convects from the bottomside of the F region to high altitudes.

Hanson, W. B.↗
NASA NTRS1985

The earth's surface studied from space; Proceedings of Workshop II of the COSPAR 25th Plenary Meeting, Graz, Austria, June 25-July 7, 1984

Consideration is given to: Landsat image data quality studies; a preliminary evaluation of Landsat-4 Thematic Mapper (TM) data for mineral exploration; and the early evaluation of TM data for mapping forest, agricultural and soil resources. Among other topics discussed are: shortwave infrared detection of vegetation; SPOT image quality and post-launch assessment; an evaluation of SPOT HRV simulation data for Corps of Engineers applications; and the application potential of SPOT imagery for topographic mapping. Consideration is also given to: verification studies of MOS-1 sensors; multiple sensor geocoded data; and the utility of proposed sensors for coastal engineering studies.

Ungar, S. G.↗
NASA NTRS1991

SAR data compression: Application, requirements, and designs

The feasibility of reducing data volume and data rate is evaluated for the Earth Observing System (EOS) Synthetic Aperture Radar (SAR). All elements of data stream from the sensor downlink data stream to electronic delivery of browse data products are explored. The factors influencing design of a data compression system are analyzed, including the signal data characteristics, the image quality requirements, and the throughput requirements. The conclusion is that little or no reduction can be achieved in the raw signal data using traditional data compression techniques (e.g., vector quantization, adaptive discrete cosine transform) due to the induced phase errors in the output image. However, after image formation, a number of techniques are effective for data compression.

Curlander, John C.↗
NASA NTRS2005

NASA Intelligent Systems Project: Results, Accomplishments and Impact on Science Missions

The Intelligent Systems Project was responsible for much of NASA's programmatic investment in artificial intelligence and advanced information technologies. IS has completed three major project milestones which demonstrated increased capabilities in autonomy, human centered computing, and intelligent data understanding. Autonomy involves the ability of a robot to place an instrument on a remote surface with a single command cycle. Human centered computing supported a collaborative, mission centric data and planning system for the Mars Exploration Rovers and data understanding has produced key components of a terrestrial satellite observation system with automated modeling and data analysis capabilities. This paper summarizes the technology demonstrations and metrics which quantify and summarize these new technologies which are now available for future Nasa missions.

Coughlan, Joseph C.↗
NASA NTRSDate not supplied

Study the Vertical Structure and Transportation of the Extreme African Dust Storms using MERRA-2 Data

The Modern-Era Retrospective Analysis for Research and Application, Version 2 (MERRA-2) provides the first long-term global reanalysis to assimilate space-based observations of aerosols and represents their interactions with other physical processes in the climate system. In this study, we have examined the variations of atmospheric aerosols for the last 20 years since 2002 using the sub-daily MERRA-2 data and found seven extreme African dust storms that were transported westward across the Atlantic Ocean from the Sahara, crossing 70o-80oW. In particular, the well-known ‘Godzilla’ dust storm occurred in June 2020, and its dust cloud, with the highest-on-record aerosol optical depths, was transported toward the Americas. This storm greatly degraded air quality over large areas of the Caribbean Basin and the United States. The air quality index reached unhealthy levels for sensitive groups in more than ten U.S. states. In our study, the vertical structure and transport characteristics of the dust layers during this extreme dust event are investigated. The geopotential height and temperature were found anomalously low (around 600 hPa) over the Atlantic Ocean off northwest Africa before the June 2020 dust storm. This anomalous circulation pattern was persistent for more than 12 days starting from around May 30, breaking the regular easterly waves that transport dust from the Sahara Desert to the west. To verify the data quality, daily MERRA-2 PM2.5 data were calculated and compared with PM2.5 observations from the U.S. Environmental Protection Agency (EPA) at several selected ground stations in Florida. We provide this case study to illustrate how to effectively use various MERRA-2 data services at Goddard Earth Sciences Data and Information Services Center (GES DISC) where MERRA-2 data are archived, hoping to help data users in exploring their own topics of interest using data services at GES DISC.

data management, reanalysis↗
DOE OSTI2023

A National Infrastructure for Artificial Intelligence on the Grid (NI4AI) (Final Scientific/Technical Report)

Electric utilities have traditionally taken a very pragmatic yet myopic approach with grid sensors and the resulting collected data. Sensors are purchased and deployed to solve a specific, known problem that has risen to sufficient awareness as to justify the effort of deploying sensors and the needed capital investment. This sensor data flows into proprietary software packages with limited functionality intended only to address the initial problem. This approach aligns with the financial incentives of the utility to deploy capital into fixed hardware assets for which the corporations earn a rate of return. This mentality stands in stark contrast to the big data revolution that started nearly 25 years ago with the rise of Google. In this worldview, data is a fundamental business asset; successful organizations collect, store, explore, merge, and exploit as much data as possible to not only solve problems well understood today but also to tackle new problems that will inevitably rise tomorrow. The ARPA-E Open Innovation 2018 project entitled A National Infrastructure for Artificial Intelligence on the Grid or NI4AI for short was designed to demonstrate this alternative paradigm for using data. To do this, the project was composed of three key thrust areas. The first major component deployed a variety of high-frequency grid sensors and captured terabytes of both wide-scale and localized grid measurements, generating high-value datasets for grid research and algorithm development. The second aspect made available PingThings’ PredictiveGridTM, a horizontally scalable, cloud-based data management and AI platform built for time series data to explore and exploit the collected data. Finally, the project fostered a diverse and open research community composed of experts from numerous fields through focused educational content, code sharing, and data science competitions. Shifting away from “single use” sensors and closed data silos within electric utilities is a major benefit to the public at large. This legacy approach to data is incredibly (1) capital intensive (new sensors must be deployed for each new problem and problems tend to arise continuously) and (2) painfully slow (new problems must be identified first and then new sensors must be deployed to collect data to begin to address the issue). The transition to a carbon neutral grid requires a massive transformation of the existing grid infrastructure and will continue to challenge the legacy grid in unforeseen ways. The only way to make the energy transition cost effective is for utilities to abandon this dated data paradigm and adopt more contemporary approaches. NI4AI has shown that it is technically possible and economically feasible to ingest, explore, and exploit grid data collected from even very high frequency sensing, such as continuous point on wave sensors collecting measurements 10,000 times a second. In fact, the PredictiveGrid platform used is commercially available and deployed at several utilities in the United States. Project accomplishments were numerous and included (1) making available a state of the art time series platform to the community, (2) collecting over 520 streams of time series data from grid sensors totaling over 1 trillion grid measurements, and (3) developing and nurturing a community within the industry focused on the use of data to create value for utilities and, ultimately, end consumers.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1978

Review of rate coefficients of ionic reactions determined from measurements made by the atmosphere explorer satellites

The large data base of aeronomic parameters measured by the Atmosphere Explorer C, D, and E satellites since December 1973 has been used to determine a number of reaction rate coefficients highly relevant to our understanding of thermospheric chemistry. In this paper the results are reviewed for ionic rate coefficients for recombination of NO(+), O2(+), for reactions of O(+) + N2, N2(+) + O, and O(++) + O, and for various reactions involving O(+)(2D) and O(+)(2P) ions with O and N2.

Torr, D. G.↗