Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data engineering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

2024 Workshop - Remote Sensing and Fluxes Upscaling for Real-world Impact - Tutorial v1

The software-tutorial was developed within the 2024 Remote Sensing and Fluxes Upscaling for Real-world Impact workshop as part of the hands-on session. The workshop was supported by AmeriFlux, National Ecological Observatory Network (NEON) and CarbonDew. The software provides basic tools to perform the following tasks: - gather remote sensing images using Google Earth Engine API; - gather flux data; - perform basic functions, such as plotting time-series, perform QA of the data, compute vegetation indices; - perform correlation analysis between flux data and remote sensing data; - perform flux predictions based on remote sensing data integrated in different modalities.

Falco, Nicola [Lawrence Berkeley National Laborato↗

Data for L-Malic Acid Production from Xylose by Engineered Saccharomyces cerevisiae

L-malic acid is widely used in the food, chemical, and pharmaceutical industries. Here, we report on production of malic acid from xylose, the second most abundant sugar in lignocellulosic hydrolysates, by engineered Saccharomyces cerevisiae . To enable malic acid production in a xylose-assimilating S. cerevisiae , we overexpressed PYC1 and PYC2, coding for pyruvate carboxylases, a truncated MDH3 coding for malate dehydrogenase, and SpMAE1, coding for a Schizosaccharomyces pombe malate transporter. Additionally, both the ethanol- and glycerol-producing pathways were blocked to enhance malic acid production. The resulting strain produced malic acid from both glucose and xylose, but it produced much higher titers of malic acid from xylose than glucose. Interestingly, the engineered strain had higher malic acid yield from lower concentrations (10 g L‒1) of xylose, with no ethanol production, than from higher xylose concentrations (20 and 40 g L‒1). As such, a fed-batch culture maintaining xylose concentrations at low levels was conducted and 61.2 g L‒1 of malic acid was produced, with a productivity of 0.32 g L‒1 h. These results represent successful engineering of S. cerevisiae for the production of malic acid from xylose, confirming that that xylose offers the efficient production of various biofuels and chemicals by engineered S. cerevisiae .

Conversion↗

Modelling of Wastewater Heat Recovery Heat Pump Systems

Wastewater heat recovery is currently an underutilized technology that could be part of solving the climate crisis. A large portion of the heat that leaves a building in the form of wastewater is potentially recoverable for pre-heating domestic hot water or other service water systems. While there are several different approaches to wastewater heat recovery, this project focused on creating detailed, integrated building models for wastewater heat recovery heat pump systems. EnergyPlus models were developed featuring inputs and assumptions corresponding to manufacturers’ specifications, performance lab test data and feedback from engineering consultants. EnergyPlus’s supervisory control Energy Management System objects were heavily relied upon to overcome modelling challenges. The developed EnergyPlus model was integrated into U.S. Department of Energy New Construction Reference Building models for various climate zones and building types to assess potential energy use, energy cost and greenhouse gas emission reductions.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Coaxial laser absorption and optical emission spectroscopy of high-pressure aluminum monoxide

This work advances laser absorption spectroscopy with measurements of aluminum monoxide (AlO) temperature and column density in extreme pressure ( P > 60 bar) and temperature ( T > 4000 K) environments. Measurements of the AlO A 2 Π i – X 2 Σ + transition are made using a microelectromechanical system, tunable vertical cavity surface emitting laser (MEMS-VCSEL). Simultaneous emission measurements of the AlO B 2 Σ + – X 2 Σ + transition are made along a line of sight that is coaxial with the laser absorption. Absorption temperature fits agree with emission spectra for a T = 3200 K, P = 9 bar case. In cases with T > 4000 K, P > 60 bar, absorption fits match the ambient temperature while emission fits over-estimate it, owing to high optical depths. These data juxtapose passive and active spectroscopic methods and demonstrate the versatility of AlO laser absorption in high-pressure and high-temperature environments where experimental data remain scarce, and engineering models will benefit from refined measurements.

Daniel, K. A.↗

Hindsight logging for model training

In modern Machine Learning, model training is an iterative, experimental process that can consume enormous computation resources and developer time. To aid in that process, experienced model developers log and visualize program variables during training runs. Exhaustive logging of all variables is infeasible, so developers are left to choose between slowing down training via extensive conservative logging, or letting training run fast via minimalist optimistic logging that may omit key information. As a compromise, optimistic logging can be accompanied by program checkpoints; this allows developers to add log statements post-hoc, and "replay" desired log statements from checkpoint---a process we refer to as hindsight logging. Unfortunately, hindsight logging raises tricky problems in data management and software engineering. Done poorly, hindsight logging can waste resources and generate technical debt embodied in multiple variants of training code. In this paper, we present methodologies for efficient and effective logging practices for model training, with a focus on techniques for hindsight logging. Our goal is for experienced model developers to learn and adopt these practices. To make this easier, we provide an open-source suite of tools for Fast Low-Overhead Recovery (flor) that embodies our design across three tasks: (i) efficient background logging in Python, (ii) adaptive periodic checkpointing, and (iii) an instrumentation library that codifies hindsight logging for efficient and automatic record-replay of model-training. Model developers can use each flor tool separately as they see fit, or they can use flor in hands-free mode, entrusting it to instrument their code end-to-end for efficient record-replay. Our solutions leverage techniques from physiological transaction logs and recovery in database systems. Evaluations on modern ML benchmarks demonstrate that flor can produce fast checkpointing with small user-specifiable overheads (e.g. 7%), and still provide hindsight log replay times orders of magnitude faster than restarting training from scratch.

Computer Science↗

SUSTAINABLE REMEDIATION SOFTWARE TOOL EXERCISE AND EVALUATION

The goal of this study was to examine two different software tools designed to account for the environmental impacts of remediation projects. Three case studies from the Savannah River Site (SRS) near Aiken, SC were used to exercise SiteWise (SW) and Sustainable Remediation Tool (SRT) by including both traditional and novel remediation techniques, contaminants, and contaminated media. This study combined retrospective analysis of implemented projects with prospective analysis of options that were not implemented. Input data were derived from engineering plans, project reports, and planning documents with a few factors supplied from calculations based on Life Cycle Assessment (LCA). Conclusions drawn from software output were generally consistent within a tool; both tools identified the same remediation options as the 'best' for a given site. Magnitudes of impacts varied between the two tools, and it was not always possible to identify the source of the disagreement. The tools differed in their quantitative approaches: SRT based impacts on specific contaminants, media, and site geometry and modeled contaminant removal. SW based impacts on processes and equipment instead of chemical modeling. While SW was able to handle greater variety in remediation scenarios, it did not include a measure of the effectiveness of the scenario.

99 GENERAL AND MISCELLANEOUS↗

Hydroacoustic Evaluation of Juvenile Salmonid Passage and Distribution at Detroit Dam, 2011

Pacific Northwest National Laboratory evaluated juvenile salmonid passage and distribution at Detroit Dam (DET) on the North Santiam River, Oregon for the U.S. Army Corps of Engineers (USACE) to provide data to support decisions on long-term measures to enhance downstream passage at DET and others dams in USACE’s Willamette Valley Project. This study was conducted in response to regulatory requirements necessitated by the listing of Upper Willamette River Spring Chinook salmon (Oncorhynchus tshawytscha) and Upper Willamette River steelhead (O. mykiss) as threatened under the Endangered Species Act. The goal of the study was to provide information of juvenile salmonid passage and distribution at DET from February 2011 through February 2012. The results of the hydroacoustic study provide new and, in some cases, first-ever data on passage estimates, run timing, distributions, and relationships between fish passage and environmental variables at the dam. This information will inform management decisions on the design and development of surface passage and collection devices to help restore Chinook salmon populations in the North Santiam River watershed above DET. During the entire study period, an estimated total of 182,526 smolt-size fish (±4,660 fish, 95% CI) passed through turbine penstock intakes. Run timing peaked in winter and early spring months. Passage rates were highest during late fall, winter and early spring months and low during summer. Horizontal distribution for hours when both turbine units were operated simultaneously indicated Unit 2 passed almost twice as much fish as Unit 1. Diel distribution for smolt-size fish during the study period was fairly uniform, indicating fish were passing the turbines at all times of the day. A total of 5,083 smolt-size fish (± 312 fish, 95% CI) were estimated passed via the spillway when it was open between June 23 and September 27, 2011. Daily passage was low at the spillway during the June-August period, and increased somewhat in September 2011. When the spillway was operated simultaneously with the turbines, spillway efficiency (efficiency is estimated as spillway passage divided by total project passage) was 0.72 and effectiveness (fish:flow ratio—proportion fish passage at a route (e.g., spillway) divided by proportion water through that route out of the total project) was 2.69. That is, when the spillway was open, 72% of the fish passing the dam used the spillway and 28% passed into the turbine penstocks. Diel distribution for smolt-size fish at the spillway shows a distinct peak in passage between mid-morning and mid-afternoon and low passage at night. We estimated that 23,339 smolt-size fish (± 572 fish, 95% CI) passed via the Regulating Outlet (RO) when it was open from October 29 through November 12, 2011, January 2-6, and January 20 through February 3, 2012. During the October–November period, RO passage peaked at 1,086 fish on November 5, with a second peak on November 7 (1,075 fish). When the RO was operated simultaneously with the turbines, RO efficiency was 0.33 and effectiveness was 0.89. In multiple regression analyses, a relatively parsimonious model was selected that predicted the observed fish passage data well. The best model included forebay temperature at depth, forebay elevation, total discharge, hours of daylight, and the operation period. The vertical distribution of fish in the forebay near the face of the dam where the transducers sampled showed fish were generally distributed throughout the water column during all four operational periods. During the refill and full pool periods, vertical distribution was bi-modal with surface-layer and mid-water modes. Patterns for day and night distributions were variable. Fish were distributed above and below the thermocline when it was present (full pool and drawdown periods).

Hydroacoustics↗

Department of Energy’s ARM Climate Research Facility External Data Center Operations Plan Located At Brookhaven National Laboratory

The External Data Center (XDC) Operations Plan describes the activities performed to manage the XDC, located at Brookhaven National Laboratory (BNL), for the Department of Energy’s Atmospheric Radiation Measurement (ARM) Climate Research Facility. It includes all ARM infrastructure activities performed by the Data Management and Software Engineering Group (DMSE) at BNL. This plan establishes a baseline of expectation within the ARM Operations Management for the group managing the XDC.

54 ENVIRONMENTAL SCIENCES↗

Methodology for assessing the safety of Hydrogen Systems: HyRAM 1.1 technical reference manual

The HyRAM software toolkit provides a basis for conducting quantitative risk assessment and consequence modeling for hydrogen infrastructure and transportation systems. HyRAM is designed to facilitate the use of state-of-the-art science and engineering models to conduct robust, repeatable assessments of hydrogen safety, hazards, and risk. HyRAM is envisioned as a unifying platform combining validated, analytical models of hydrogen behavior, a stan- dardized, transparent QRA approach, and engineering models and generic data for hydrogen installations. HyRAM is being developed at Sandia National Laboratories for the U. S. De- partment of Energy to increase access to technical data about hydrogen safety and to enable the use of that data to support development and revision of national and international codes and standards. This document provides a description of the methodology and models contained in the HyRAM version 1.1. HyRAM 1.1 includes generic probabilities for hydrogen equipment fail- ures, probabilistic models for the impact of heat flux on humans and structures, and computa- tionally and experimentally validated analytical and first order models of hydrogen release and flame physics. HyRAM 1.1 integrates deterministic and probabilistic models for quantifying accident scenarios, predicting physical effects, and characterizing hydrogen hazards (thermal effects from jet fires, overpressure effects from deflagrations), and assessing impact on people and structures. HyRAM is a prototype software in active development and thus the models and data may change. This report will be updated at appropriate developmental intervals.

97 MATHEMATICS AND COMPUTING↗

Methodology for assessing the safety of Hydrogen Systems: HyRAM 1.0 technical reference manual

The HyRAM software toolkit provides a basis for conducting quantitative risk assessment and consequence modeling for hydrogen infrastructure and transportation systems. HyRAM is designed to facilitate the use of state-of-the-art science and engineering models to conduct robust, repeatable assessments of hydrogen safety, hazards, and risk. HyRAM is envisioned as a unifying platform combining validated, analytical models of hydrogen behavior, a standardized, transparent QRA approach, and engineering models and generic data for hydrogen installations. HyRAM is being developed at Sandia National Laboratories for the U. S. Department of Energy to increase access to technical data about hydrogen safety and to enable the use of that data to support development and revision of national and international codes and standards. This document provides a description of the methodology and models contained in the HyRAM version 1.0. HyRAM 1.0 includes generic probabilities for hydrogen equipment failures, probabilistic models for the impact of heat flux on humans and structures, and computationally and experimentally validated analytical and first order models of hydrogen release and flame physics. HyRAM 1.0 integrates deterministic and probabilistic models for quantifying accident scenarios, predicting physical effects, and characterizing hydrogen hazards (thermal effects from jet fires, overpressure effects from deflagrations), and assessing impact on people and structures. HyRAM is a prototype software in active development and thus the models and data may change. This report will be updated at appropriate developmental intervals.

08 HYDROGEN↗

Combinatorial Evaluation of Physical Feature Engineering, Classical Machine Learning, and Deep Learning Models for Synchrophasor Data at Scale

A major objective of the project was to train and evaluate the effectiveness of multiple event and anomaly detection, identification and classification deep temporal learning models for processing of real-time phasor measurement unit (PMU) data streams. A vast dataset, consisting of two years of phasor measurements from all three U.S. Interconnections, was curated and released by the Department of Energy (DOE) through Pacific Northwest National Laboratory (PNNL). The dataset also included an event log that provided event times and types (e.g. generator trips, line trips, planned service events, transformer operations, etc.). Our analysis of this dataset addressed six (6) of the eleven (11) research priorities identified in Funding Opportunity Announcement (FOA) DE-FOA-0001861 “Big Data Analysis of Synchrophasor Data” (FOA 1861). Rather than being limited to pre-determined specific algorithms, this project relied on the uniquely structured, highly performant underlying time series database capabilities of the PredictiveGrid platform to assess the vast dataset utilizing a wide variety of algorithms.

24 POWER TRANSMISSION AND DISTRIBUTION↗

VERAView User's Manual

VERAView has been developed as an interactive graphical interface for the visualization and engineering analyses of output data from VERA. The Python-based software is easy to install, intuitive to use, and provides instantaneous 2D and 3D images, 1D plots, and alpha-numeric data from VERA multi-physics simulations. This document provides a brief overview of the software and some description of the major features of the application, including examples of each of the encapsulated “widgets” that have been implemented thus far. VERAView is still under major development and large changes in the software and this document are still anticipated.

97 MATHEMATICS AND COMPUTING↗

Science &Technology Review (October/November 2022)

Livermore researchers seek to understand the disease mechanism of amyotrophic lateral sclerosis (ALS) and, with that knowledge, identify therapies to cure this always-fatal disease. As the article beginning on p. 4 describes, the ALS research effort combines Laboratory core competencies in bioscience, engineering, computational modeling, and data science.

36 MATERIALS SCIENCE↗

Integrated Off-Gas System Tests on the DM1200 Melter with RPP-WTP LAW Sub-Envelope Bl Simulants, VSL-03R3851-1, Rev. 0 (Oct 2003)

The report documents melter and off-gas performance results obtained on the DM1200 melter during processing of LAW Sub-Envelope B1 feed. The principal objectives of the DM1200 melter testing were to demonstrate suitable processing and production rates for LAW B1 feed; characterize the glass product for elemental composition; measure elemental emission rates and decontamination factors (DFs) across the melter and off-gas treatment components; and provide additional data on the performance of the thermal catalytic oxidation and selective catalytic reduction (TCO/SCR) unit efficiency in treating organic emissions. The feed was spiked with organic compounds for part of the testing duration. All data were collected for use in engineering and system design purposes. No sampling and analysis to collect environmental data was performed during these tests.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Protection of Inverter-Dependent Transmission Systems (PROTECT-IT)

This presentation highlights the overall objectives of the SETO funded protection project. The main technical approaches are also highlighted. This high impact project produces multiple innovative outcomes, including comprehensive impact study of how IBR affects protection elements, simplified low-order IBR model for protection engineers, enhanced and data-driven protection design, co-design concept for coordination protection and IBRs.

14 SOLAR ENERGY↗

Magnetic Liquids in Manufacturing Systems

Theoretical and experimental principles are outlined for the creation of equipment and manufacturing systems that employ magnetic fluids, for use in the auto industry and elsewhere.

36 MATERIALS SCIENCE↗

A historical analysis of the co-evolution of gasoline octane number and spark-ignition engines

In our work, the authors reviewed engine, vehicle, and fuel data since 1925 to examine the historical and recent coupling of compression ratio and fuel antiknock properties (i.e., octane number) in the U.S. light-duty vehicle market. The analysis identified historical timeframes, trends, and illustrated how three factors: consumer preferences, technical capabilities, and regulatory legislation, affect personal mobility. Data showed that throughout history these three factors have a complex and time sensitive interplay. Long term trends in the data were identified where interaction and evolution between all three factors was observed. Transportation efficiency per unit power (gal/ton-mi/hp) was found to be a good metric to integrate technical, societal, and regulatory effects into the evolutional pathway of personal mobility. From this framework, discussions of future evolutionary changes to personal mobility are also presented.

33 ADVANCED PROPULSION SYSTEMS↗