SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
The software provides machine learning analysis and visualization to detect patterns in epigenetic data, including conventional machine learning and statistical methods, and open-source packages like pyBigWig (https://github.com/deeptools/pyBigWig) for data processing. The software is written in python, it uses some python libraries.
This report describes the Data Archive and Portal (DAP), a key capability of the U.S. Department of Energy's Atmosphere to Electron (A2e) initiative. The DAP Thrust Area Planning Group was organized to develop a plan for deploying this capability. Primarily, the report focuses on a distributed system--a DOE Wind Cloud--that functions as a repository for all A2e data. The Wind Cloud will be accessible via an open, easy-to-navigate user interface that facilitates community data access, interaction, and collaboration. DAP management will work with the community, industry, and international standards bodies to develop standards for wind data and to capture important characteristics of all data in the Wind Cloud.
The purpose of this data services request was to demonstrate integration of the Atmospheric Radiation Measurement (ARM) User Facility’s “met” datastreams with time series data from other earth science data sources using the BASIN-3D data synthesis software tool. BASIN-3D is an open-source Python library that enables researchers to integrate data across configured public and private data sources. It provides a common query language for researchers to request measurement locations and time series data based on specified locations, variables, time period, statistics, aggregation, and data quality. BASIN-3D acquires the data that match the query from each configured data source and translates the results into harmonized vocabularies, thus reducing researchers' data-wrangling effort. In addition, because the queries are executed on demand, researchers can easily regenerate their synthesized data sets as new data and/or data updates become available, eliminating one-off data products. BASIN-3D can output data using a variety of different data structures for end-user applications including Python pandas data frames and hdf5 output formats.
Abstract. The CF (Climate and Forecast) metadata conventions are designed to promote the creation, processing, and sharing of climate and forecasting data using Network Common Data Form (netCDF) files and libraries. The CF conventions provide a description of the physical meaning of data and of their spatial and temporal properties, but they depend on the netCDF file encoding which can currently only be fully understood and interpreted by someone familiar with the rules and relationships specified in the conventions documentation. To aid in development of CF-compliant software and to capture with a minimal set of elements all of the information contained in the CF conventions, we propose a formal data model for CF which is independent of netCDF and describes all possible CF-compliant data. Because such data will often be analysed and visualised using software based on other data models, we compare our CF data model with the ISO 19123 coverage model, the Open Geospatial Consortium CF netCDF standard, and the Unidata Common Data Model. To demonstrate that this CF data model can in fact be implemented, we present cf-python, a Python software library that conforms to the model and can manipulate any CF-compliant dataset.
Graphical abstract: The open aperture Z-scan traces of Pt doped TiO{sub 2} nanoparticles at different Pt concentrations were carried out at an irradiation wavelength of 532 nm. It was numerically found that, two photon absorption (TPA) type process gives the best fit to the obtained open aperture Z-scan data. The nonlinear transmission was found to be of third order as it fits to a two-photon absorption. The optical limiting performances of nanoparticles were greatly enhanced with increased volume ratio of Pt. Increasing particle size reduced the limiting threshold and enhanced the optical limiting performance. - Highlights: • Pt doped TiO{sub 2} nanoparticles with different concentrations of Pt have been synthesized by sol–gel method. • The average fluorescence lifetime decreases as the volume fraction of Pt dopant increases. • The effects of Pt content on the optical limiting property were investigated by open aperture Z-scan measurements done at 532 nm using 5 ns laser pulses. • The values of the third-order nonlinearities of nanoparticles are interesting from the application point of view which could be used as a potential candidate for the application of nonlinear optical device. - Abstract: Pt doped TiO{sub 2} nanoparticles with different concentrations of Pt were prepared by sol–gel method. X-ray diffraction (XRD) study reveals that the samples have a homogeneous anatase phase tetragonal system and the lattice parameter analysis indicates that Pt ions substitute into the lattice of TiO{sub 2}. The addition of dopant increases the growth of TiO{sub 2} grains, agglomerates them and shifts the absorption band of TiO{sub 2} from ultraviolet to visible region. The incorporation of Pt in TiO{sub 2} is also confirmed by fluorescence quenching and the fluorescence lifetime decreases as the volume fraction of Pt dopant increases. Open aperture Z-scan measurements done at 532 nm using 7 ns laser pulses show nonlinear absorption which arises from an effective two photon absorption process. The nonlinear optical properties are characterized by using fluence dependent transmittance measurements in order to reveal the optical limiting effects. It is found that the optical limiting performances of nanoparticles were greatly enhanced with increased concentration of Pt.
Abstract A spectral-energy distribution (SED) model for Type Ia supernovae (SNe Ia) is a critical tool for measuring precise and accurate distances across a large redshift range and constraining cosmological parameters. We present an improved model framework, SALT3, which has several advantages over current models—including the leading SALT2 model (SALT2.4). While SALT3 has a similar philosophy, it differs from SALT2 by having improved estimation of uncertainties, better separation of color and light-curve stretch, and a publicly available training code. We present the application of our training method on a cross-calibrated compilation of 1083 SNe with 1207 spectra. Our compilation is 2.5× larger than the SALT2 training sample and has greatly reduced calibration uncertainties. The resulting trained SALT3.K21 model has an extended wavelength range 2000–11,000 Å (1800 Å redder) and reduced uncertainties compared to SALT2, enabling accurate use of low- z I and iz photometric bands. Including these previously discarded bands, SALT3.K21 reduces the Hubble scatter of the low- z Foundation and CfA3 samples by 15% and 10%, respectively. To check for potential systematic uncertainties, we compare distances of low (0.01 < z < 0.2) and high (0.4 < z < 0.6) redshift SNe in the training compilation, finding an insignificant 3 ± 14 mmag shift between SALT2.4 and SALT3.K21. While the SALT3.K21 model was trained on optical data, our method can be used to build a model for rest-frame NIR samples from the Roman Space Telescope. Our open-source training code, public training data, model, and documentation are available at https://saltshaker.readthedocs.io/en/latest/ , and the model is integrated into the sncosmo and SNANA software packages.
The overall goal of this project was to extend the existing Gaggle and Firegoose systems to develop an open-source technology that runs over the web and links desktop applications with many databases and software applications. This technology would enable researchers to incorporate workflows for data analysis that can be executed from this interface to other online applications. The four specific aims were to (1) provide one-click mapping of genes, proteins, and complexes across databases and species; (2) enable multiple simultaneous workflows; (3) expand sophisticated data analysis for online resources; and enhance open-source development of the Gaggle-Firegoose infrastructure. Gaggle is an open-source Java software system that integrates existing bioinformatics programs and data sources into a user-friendly, extensible environment to allow interactive exploration, visualization, and analysis of systems biology data. Firegoose is an extension to the Mozilla Firefox web browser that enables data transfer between websites and desktop tools including Gaggle. In the last phase of this funding period, we have made substantial progress on development and application of the Gaggle integration framework. We implemented the workspace to the Network Portal. Users can capture data from Firegoose and save them to the workspace. Users can create workflows to start multiple software components programmatically and pass data between them. Results of analysis can be saved to the cloud so that they can be easily restored on any machine. We also developed the Gaggle Chrome Goose, a plugin for the Google Chrome browser in tandem with an opencpu server in the Amazon EC2 cloud. This allows users to interactively perform data analysis on a single web page using the R packages deployed on the opencpu server. The cloud-based framework facilitates collaboration between researchers from multiple organizations. We have made a number of enhancements to the cmonkey2 application to enable and improve the integration within different environments, and we have created a new tools pipeline for generating EGRIN2 models in a largely automated way.
Time series load and PV data from an IEEE123 bus system. An example electrical system, named the OEDI SI feeder, is used to test the workflow in a co-simulation. The system used is the IEEE123 test system, which is a well studied test system (see link below to IEEE PES Test Feeder), but some modifications were made to it to add some solar power modules and measurements on the system. The aim of this project is to create an easy-to-use platform where various types of analytics can be performed on a wide range of electrical grid datasets. The aim is to establish an open-source library of algorithms that universities, national labs and other developers can contribute to which can be used on both open-source and proprietary grid data to improve the analysis of electrical distribution systems for the grid modeling community. OEDI Systems Integration (SI) is a grid algorithms and data analytics API created to standardize how data is sent between different modules that are run as part of a co-simulation. The readme file included in the S3 bucket provides information about the directory structure and how to use the algorithms. The sensors.json file is used to define the measurement locations.
Given the tremendous volume of accessible Earth Observation (EO) data, there is a need to develop scalable Geospatial Artificial Intelligence (GeoAI) solutions for time-sensitive applications. Scalability in this context refers to rapidly processing large-scale EO data using high performance computing resources. Accurate mapping of the built environment from remote sensing (RS) imagery has been one of the crucial components in GeoAI workflows for a wide spectrum of humanitarian applications. Derived vector data of built environment is often leveraged for disaster preparedness and response activities. However, factors such as differences in ortho-rectification, atmospheric conditions and human error, results in spatial misalignment between vector data and the timely available RS imagery. Model training for downstream tasks such as object detection, change analysis, etc., is negatively impacted due to such spatial misalignment. Although there has been progress towards automatic alignment of vector data, the lack of scalability remains an open research challenge. This paper proposes to leverage parallel computing to optimize an automatic vector data alignment workflow. It further employs CPU-level multi-core parallelism for improving the performance of the workflow for scalable built environment mapping. We report observations and discuss findings from the preliminary experiments performed on the Summit Supercomputer.
In this paper, a big data visualization platform is designed to discover the hidden useful knowledge for smart grid (SG) operation, control and situation awareness. The spawn of smart sensors at both grid side and customer side can provide large volume of heterogeneous data that collect information in all time spectrums. Extracting useful knowledge from this big-data poll is still challenging. In this paper, the Apache Spark, an open source cluster computing framework, is used to process the big-data to effectively discover the hidden knowledge. A high-speed communication architecture utilizing the Open System Interconnection (OSI) model is designed to transmit the data to a visualization platform. This visualization platform uses Google Earth, a global geographic information system (GIS) to link the geological information with the SG knowledge and visualize the information in user defined fashion. The University of Denver's campus grid is used as a SG test bench and several demonstrations are presented for the proposed platform.
The NREL-developed Modular Ocean Data Acquisition (MODAQ) system is built from open-source hardware and software. The tool can both collect and store data and even share curated information through the cloud. Marine energy developers can work with NREL's engineers to design their own customized MODAQ and capture high-quality field data to help monitor and improve their technology designs. For example, users could assess how much power their device produces at sea, analyze the durability of a specific device component, or even control their device from a desk halfway around the world.
Experimental Particle Physics has been at the forefront of analyzing the world's largest datasets for decades. The HEP community was among the first to develop suitable software and computing tools for this task. In recent times, new toolkits and systems for distributed data processing, collectively called "Big Data" technologies have emerged from industry and open source projects to support the analysis of Petabyte and Exabyte datasets in industry. While the principles of data analysis in HEP have not changed (filtering and transforming experiment-specific data formats), these new technologies use different approaches and tools, promising a fresh look at analysis of very large datasets that could potentially reduce the time-to-physics with increased interactivity. Moreover these new tools are typically actively developed by large communities, often profiting of industry resources, and under open source licensing. These factors result in a boost for adoption and maturity of the tools and for the communities supporting them, at the same time helping in reducing the cost of ownership for the end-users. In this talk, we are presenting studies of using Apache Spark for end user data analysis. We are studying the HEP analysis workflow separated into two thrusts: the reduction of centrally produced experiment datasets and the end-analysis up to the publication plot. Studying the first thrust, CMS is working together with CERN openlab and Intel on the CMS Big Data Reduction Facility. The goal is to reduce 1 PB of official CMS data to 1 TB of ntuple output for analysis. We are presenting the progress of this 2-year project with first results of scaling up Spark-based HEP analysis. Studying the second thrust, we are presenting studies on using Apache Spark for a CMS Dark Matter physics search, comparing Spark's feasibility, usability and performance to the ROOT-based analysis.
Abstract Large language models (LLMs) are sophisticated AI-driven models trained on vast sources of natural language data. They are adept at generating responses that closely mimic human conversational patterns. One of the most notable examples is OpenAI's ChatGPT, which has been extensively used across diverse sectors. Despite their flexibility, a significant challenge arises as most users must transmit their data to the servers of companies operating these models. Utilizing ChatGPT or similar models online may inadvertently expose sensitive information to the risk of data breaches. Therefore, implementing LLMs that are open source and smaller in scale within a secure local network becomes a crucial step for organizations where ensuring data privacy and protection has the highest priority, such as regulatory agencies. As a feasibility evaluation, we implemented a series of open-source LLMs within a regulatory agency’s local network and assessed their performance on specific tasks involving extracting relevant clinical pharmacology information from regulatory drug labels. Our research shows that some models work well in the context of few- or zero-shot learning, achieving performance comparable, or even better than, neural network models that needed thousands of training samples. One of the models was selected to address a real-world issue of finding intrinsic factors that affect drugs' clinical exposure without any training or fine-tuning. In a dataset of over 700 000 sentences, the model showed a 78.5% accuracy rate. Our work pointed to the possibility of implementing open-source LLMs within a secure local network and using these models to perform various natural language processing tasks when large numbers of training examples are unavailable.
Existing ice and trash sluiceways are commonly used to pass juvenile salmonids downstream at hydropower dams through a benign, non-turbine route. At The Dalles Dam on the Columbia River, managers undertook optimizing operations of sluiceway weirs to maximize survival of juvenile salmonids at the powerhouse. We applied fixed-location hydroacoustic methods to compare fish passage rates and sluiceway efficiencies for two weir configurations during 2004 and 2005: three weirs versus six weirs, located at the mid- versus east powerhouse, respectively. We also analyzed horizontal distributions of passage at the sluiceway and turbines and the effects of operating turbines beneath open sluiceway gates to provide supporting data relevant to operations optimization. Based on the findings, we recommend the following for long-term operations for the sluiceway at The Dalles Dam: open six rather than three sluiceway weirs to take advantage of the maximum hydraulic capacity of the sluiceway; open the three weirs above the western-most operating main turbine unit (MU) and the three weirs at MU 8 where turbine passage rates are relatively high; operate the turbine units below open sluiceway weirs as a standard procedure; operate the sluiceway 24 h/d year-round to maximize its benefits to juvenile salmonids; and use the same operations for spring and summer emigrants. These operational concepts are transferable to dams where sluiceway surface flow outlets are used protect downstream migrating fishes.
We present meteorology and snow observation data collected at sites in the southwestern Colorado Rocky Mountains (USA) over three consecutive water years with different amounts of snow water equivalent (SWE) accumulation: A year with above average SWE (2019), a year with average SWE (2020), and a year with below average SWE (2021). This data set is distinguished by its emphasis on paired open-forest sites in a continental snow climate. Approximately once a month during February–May, we collected data from 15 to 20 snow pits and took 8 to 19 snow depth transects. Our sampling sites were in open and adjacent forested areas at 3,100 m and in a lower elevation aspen (3,035 m) and higher elevation conifer stand (3,395 m). In total, we recorded 270 individual snow pit density and temperature profiles and over 4,000 snow depth measurements. These data are complimented by continuous meteorological measurements from two weather stations: One in the open and one in the adjacent forest. Meteorology data—including incoming shortwave and longwave radiation, outgoing shortwave radiation, relative humidity, wind speed, snow depth, and air and infrared surface temperature—were quality controlled and the forcing data were gap-filled. These data are available to download from Bonner, Smyth, et al. at three levels of processing, including a level with downscaled, adjusted precipitation based on data assimilation using observed snow depth and a process-based snow model. We demonstrate the utility of these data with a modeling experiment that explores open-forest differences and identifies opportunities for improvements in model representation.
We present cosmological constraints from the Dark Energy Camera All Data Everywhere (DECADE) cosmic shear analysis. This work uses shape measurements for 107 million galaxies measured through Dark Energy Camera (DECam) imaging of $5,\!412$ deg$^2$ of sky that is outside the Dark Energy Survey (DES) footprint. We derive constraints on the cosmological parameters $S_8 = 0.791^{+0.027}_{-0.032}$ and $Ω_{\rm m} =0.269^{+0.034}_{-0.050}$ for the $Λ$CDM model, which are consistent with those from other weak lensing surveys and from the cosmic microwave background. We combine our results with cosmic shear results from DES Y3 at the likelihood level, since the two datasets span independent areas on the sky. The combined measurements, which cover $\approx\! 10,\!000$ deg$^2$, prefer $S_8 = 0.791 \pm 0.023$ and $Ω_{\rm m} = 0.277^{+0.034}_{-0.046}$ under the $Λ$CDM model. These results are the culmination of a series of rigorous studies that characterize and validate the DECADE dataset and the associated analysis methodologies (Anbajagane et. al 2025a,b,c). Overall, the DECADE project demonstrates that the cosmic shear analysis methods employed in Stage-III weak lensing surveys can provide robust cosmological constraints for fairly inhomogeneous datasets. This opens the possibility of using data that have been previously categorized as ``unusable'' for cosmic shear analyses, thereby increasing the statistical power of upcoming weak lensing surveys.
This dataset represents the open-air tests for the drones when testing different flight scenarios. For some flights we created and tested with a set of onboard sensors. For others we used the native logs for the drones. We recorded relevant conditions for each of the flights to examine environmental issues and weight impacts. We also looked at segmentations of flights to investigate the energy used in each type of flight.
Understanding hydraulic fracturing is crucial to improving the stimulation of unconventional reservoirs and increasing fluid production. This study develops a novel seismic monitoring technology using distributed acoustic sensing (DAS) and surface orbital vibrators (SOV) to capture fracture seismic response and mechanical properties at high temporal intervals. We analyze continuous time-lapse vertical seismic profiling (VSP) data acquired every hour during the first nine days of treatment of an unconventional reservoir in the Austin Chalk/Eagle Field Laboratory. The VSP data contain clear seismic signals scattered from the activated fractures. The spatiotemporal changes of the fracture reflectivity revealed by the SOV/DAS data correlate well with the observations of fracture locations inferred from low-frequency DAS data. These results capture the fracture opening and closure processes, as well as highlight potential prestage activations of the fractures due to hydraulic connectivity with preexisting fracture systems. Therefore, analysis of the presented data set provides a unique opportunity to understand fracture initiation and subsequent evolution, not only in the context of unconventional resources but also in enhanced geothermal systems.