Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data engineering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Cyote-attack Chain Estimator

Attack Chain Estimator (ACE) Application Overview The Attack Chain Estimator (ACE) Application is a sophisticated tool designed for the ingestion, classification, sequencing, and enrichment of cybersecurity threat reports. This application leverages advanced machine learning models and extensive historical data to provide comprehensive insights into cyber threats, specifically targeting Industrial Control Systems (ICS). Purpose The primary functions of the ACE Application include: Ingestion of Cybersecurity Threat Reporting: Capable of ingesting text-based threat reports in markdown or text file format. Supports ingestion of structured data from other sources in STIX/JSON format. Classification of Report’s Text-Based Events: Utilizes a DeBERTa classifier, specifically trained on cybersecurity data, to map the events to MITRE ATT&CK for ICS Tactics and Techniques. Classification is performed using multiple Jupyter notebooks and machine learning workflows hosted as FastAPI microservices: regex_data deberta_base_35_train_hft_classifier_mlflow.ipynb hft_regex_classifier_mlflow.ipynb param_train_hft_classifier_mlflow.ipynb regex_tactic_tech.ipynb Ordering of Tactics, Techniques, and Observable Events: Sequences the identified tactics, techniques, and events to form a coherent attack chain. Enrichment with Historical Attack Chain Details: Enhances the attack chain with details from historical attacks using a Markov model developed from CyOTE Precursor Analysis Report data. The Markov model is available as a FastAPI endpoint for seamless integration. Enrichment with Adversary Emulation Capabilities Data: Integrates adversary emulation capabilities data using MITRE Caldera for OT adversary abilities UUIDs. Export of Output Files: Provides options to export the enriched attack chain in JSON or CSV formats. Routing of Output to Other Applications: Facilitates routing of output to various platforms and applications, including: Threat Intelligence Platforms COREII Scout for Threat Intelligence Analysis COREII Modeling and Simulation for Adversary Emulation Technical Description The ACE Application is an advanced cybersecurity tool designed to provide detailed threat analysis and sequence generation. It is built on a robust architecture that integrates natural language processing, machine learning, and historical data modeling. Key Components: Data Ingestion Module: Handles the input of threat reports and data from various formats, ensuring flexibility in data sources. Classification Engine: Employs DeBERTa-based classifiers hosted as FastAPI microservices to analyze and classify threat report events in accordance with the MITRE ATT&CK framework for ICS. Sequence Generator: Orders the classified events into a logical attack chain, providing clear insight into the sequence of tactics and techniques used in the threat. Enrichment Engine: Integrates historical data and adversary emulation capabilities to enhance the attack chain with valuable context and additional details. The historical data enrichment is powered by a Markov model, which is available as a FastAPI endpoint. Export and Routing Module: Facilitates the export of the enriched attack chain in multiple formats and routes the output to designated applications for further analysis or emulation.

Paul, Tony [Idaho National Laboratory (INL), Idaho↗

Educational Consortium for Energy-related Data Science & Computation in Building Engineering Programs

The project spearheaded by Pennsylvania State University aims to address the growing need for integrating energy-focused computation and data science into building engineering education. As the demand for energy-efficient building designs and operations increases, the educational sector must adapt to equip future engineers with the necessary skills. This initiative responds to this need by developing a consortium that unites multiple institutions to enhance curriculum development, dataset curation, and resource sharing, thereby ensuring students are well-prepared for the evolving energy sector. The primary goal of the project is to establish a consortium that will develop and disseminate educational materials and training programs focused on energy-related data science and computation. Key accomplishments include the creation of a beta website for resource sharing, the development of training programs and standalone modules, and the curation of datasets accessible to the public. This effort will culminate in a curriculum that incorporates advanced modeling technologies and data science skills into building engineering programs.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Expanding Robust HCCI Operation with Advanced Valve and Fuel Control Technologies

Delphi Automotive Systems and ORNL established this CRADA to advance the commercialization potential of the homogeneous charge compression ignition (HCCI) advanced combustion strategy for gasoline engine platforms. HCCI combustion has been shown by others to produce high diesel-like efficiency on a gasoline engine platform while simultaneously producing low NOX and particulate matter emissions. However, the commercialization barriers that face HCCI combustion are significant, with requirements for a more active engine control system, likely with next-cycle closed-loop feedback control, and with advanced valve train technologies to enable negative valve overlap conditions. In the partnership between Delphi and ORNL, each organization brought a unique and complementary set of skills to the project. Delphi has made a number of breakthroughs with production-intent valve train technologies and controls in recent years to make a part time production-intent HCCI engine plausible. ORNL has extensive knowledge and expertise with HCCI combustion, and also has a versatile research engine with hydraulic valve actuation (HVA) that is useful for guiding production of a cam-based HCCI system. Partnering these knowledge bases and capabilities was essential towards making progress to better understand HCCI combustion and the commercialization barriers that it faces. ORNL and Delphi maintained strong collaboration throughout the project. Meetings were held regularly, with additional reports, presentations, and meetings as necessary to maintain progress. Delphi provided guidance to ORNL regarding operational strategies to investigate on their single-cylinder research engine with HVA and data from their experimental multi-cylinder engine for modeling. ORNL provided single-cylinder engine data and modeling results.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Explainable and trustworthy artificial intelligence for correctable modeling in chemical sciences

Data science has primarily focused on big data, but for many physics, chemistry, and engineering applications, data are often small, correlated and, thus, low dimensional, and sourced from both computations and experiments with various levels of noise. Typical statistics and machine learning methods do not work for these cases. Expert knowledge is essential, but a systematic framework for incorporating it into physics-based models under uncertainty is lacking. Here, we develop a mathematical and computational framework for probabilistic artificial intelligence (AI)–based predictive modeling combining data, expert knowledge, multiscale models, and information theory through uncertainty quantification and probabilistic graphical models (PGMs). We apply PGMs to chemistry specifically and develop predictive guarantees for PGMs generally. Our proposed framework, combining AI and uncertainty quantification, provides explainable results leading to correctable and, eventually, trustworthy models. The proposed framework is demonstrated on a microkinetic model of the oxygen reduction reaction.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Development of hybrid 3-D hydrological modeling for the NCAR Community Earth System Model (CESM)

This is the Final Report of our four-year (3-year plus one-year no cost extension) collaborative project between the University of Arizona (UA) and the National Center for Atmospheric Research (NCAR). The overall objective of our project is to develop and evaluate the first hybrid 3-D hydrological model with a horizontal grid spacing of 1 km for the NCAR Community Earth System Model (CESM). We have made substantial progress in model development and evaluation, computational efficiencies and software engineering, and data development and evaluation, as discussed in Sections 2-4. Section 5 presents our success in data dissemination, while Section 6 discusses the scientific impacts of our work. Section 7 discusses education and mentoring success of our project, while Section 8 lists our relevant DOE services. All peer-reviewed papers that acknowledged this project are listed in Section 9. Highlights of our achievements include: • We have finished 20 papers (most published already) on model development and evaluation, computational efficiencies and software engineering, and data development and evaluation • The global datasets developed under this project have been permanently archived and publicly available • Some of our research results have already been implemented in WRF and CLM • Patrick Broxton and Michael Brunke have received their Ph.D. • PI Zeng has served on DOE proposal review panels and DOE lab scientific focus area (SFA) review panels

58 GEOSCIENCES↗

COTS Data Analytics Software User Manual: Version 1.0

Large volumes of data are being collected by Sandia National Laboratories as part of an active commercial-off-the-shelf (COTS) part testing and surveillance program. This user manual documents Python-based COTS Data Analytics software that has been developed for standardizing, displaying, visualizing, and analyzing the resulting COTS part testing and surveillance data. It is the objective of these software tools to streamline the analysis of COTS testing and surveillance data and improve the efficiency with which test engineers and data analytics experts can pinpoint possible performance and reliability problems in COTS parts.

42 ENGINEERING↗

Deep data analytics for genetic engineering of diatoms linking genotype to phenotype via machine learning

Abstract Genome engineering for materials synthesis is a promising avenue for manufacturing materials with unique properties under ambient conditions. Biomineralization in diatoms, unicellular algae that use silica to construct micron-scale cell walls with nanoscale features, is an attractive candidate for functional synthesis of materials for applications including photonics, sensing, filtration, and drug delivery. Therefore, controllably modifying diatom structure through targeted genetic modifications for these applications is a very promising field. In this work, we used gene knockdown in Thalassiosira pseudonana diatoms to create modified strains with changes to structural morphology and linked genotype to phenotype using supervised machine learning. An artificial neural network (NN) was developed to distinguish wild and modified diatoms based on the SEM images of frustules exhibiting phenotypic changes caused by a specific protein (Thaps3_21880), resulting in 94% detection accuracy. Class activation maps visualized physical changes that allowed the NNs to separate diatom strains, subsequently establishing a specific gene that controls pores. A further NN was created to batch process image data, automatically recognize pores, and extract pore-related parameters. Class interrelationship of the extracted paraments was visualized using a multivariate data visualization tool, called CrossVis, and allowed to directly link changes in morphological diatom phenotype of pore size and distribution with changes in the genotype.

59 BASIC BIOLOGICAL SCIENCES↗

Comparing Global Spray Combustion Characteristics and Local Shot-to-Shot Variations in a Reacting n -Heptane Spray

In support of efforts to develop improved models of turbulent spray behavior and combustion in diesel engines, experimental data and analysis must be obtained for guidance and validation. For Reynolds-averaged Navier–Stokes (RANS)-based Computational fluid dynamics (CFD) modeling approaches, representative ensemble average experimental results are important. For high-fidelity models such as large eddy simulations (LES)-based CFD, precise individual experimental results are desirable. However, making comparisons between a given experiment and LES is a challenge since local parameters cannot be directly compared. In this work, an optically accessible constant pressure flow rig (CPFR) is utilized to acquire diesel-like fuel injection and reaction behavior simultaneously with three optical diagnostic techniques: rainbow Schlieren deflectometry (RSD), OH* chemiluminescence (OH*), and two-color pyrometry (2CP). The CPFR allows a large number of repeated injection experiments to be performed for statistical analysis and convergence using ensemble-averaging techniques, while maintaining highly repeatable test conditions. Even for stable test conditions, variations in local turbulent fuel–air mixing introduce variability, which manifests as significant differences in OH* and 2CP results. Experimental measurements of characteristic parameters including liquid and vapor jet penetration, liftoff length, soot temperature and concentration, and turbulent flame speed, along with the shot-to-shot variability of each dataset, are presented and discussed. Finally, a statistical method is utilized to analyze the extent of this variability, and to identify superlative injections within the dataset for discussion and analysis of shot-to-shot variations.

42 ENGINEERING↗

Combining simulations and data with deep learning and uncertainty quantification for advanced energy modeling

A novel and modern framework for energy modeling is developed in this paper with a focus on nuclear energy modeling and simulation. The framework combines multiphysics simulations and real data, with validation by uncertainty quantification tasks and facilitation by machine and deep learning methods. The hybrid framework is built on the basis of a wide range of physical models, real data, mathematical and statistical methods, and artificial intelligence techniques. The framework is demonstrated in different applications, including quantifying uncertainties in computer simulations, multiphysics coupling, analysis of variance using machine learning surrogate models, deep learning of time series phenomena, and propagating parametric uncertainties of nuclear data. The applications demonstrated are oriented to nuclear engineering simulations, even though majority of the methods are applicable to other energy sources (eg, renewable). Efficient utilization of this framework is expected to yield a much better understanding of the physical phenomena analyzed as well as an improvement in the performance of the energy design/model under construction.

42 ENGINEERING↗

Data for Tolerance of Engineered Rhodosporidium toruloides to Sorghum Hydrolysates During Batch and Fed-Batch Lipid Production

Oleaginous yeasts are a promising candidate for the sustainable conversion of lignocellulosic feedstocks into fuels and chemicals, but their growth on these substrates can be inhibited as a result of upstream pretreatment and enzymatic hydrolysis conditions. Previous studies indicate a high citrate buffer concentration during hydrolysis inhibits downstream cell growth and ethanol fermentation in Saccharomyces cerevisiae . In this study, an engineered Rhodosporidium toruloides strain with enhanced lipid accumulation was grown on sorghum hydrolysate with high and low citrate buffer concentrations. Both hydrolysis conditions resulted in similar sugar recovery rates and concentrations. No significant differences in cell growth, sugar utilization rates, or lipid production rates were observed between the two citrate buffer conditions during batch fermentation of R. toruloides . Under fed-batch growth on low-citrate hydrolysate a lipid titer of 16.7 g/L was obtained. Citrate buffer was not found to inhibit growth or lipid production in this engineered R. toruloides strain, nor did reducing the citrate buffer concentration negatively affect sugar yields in the hydrolysate. As this process is scaled-up, $131 per ton of hydrothermally pretreated biomass can be saved by use of the lower citrate buffer concentration during enzymatic hydrolysis.

Conversion↗

Operator inference with roll outs for learning reduced models from scarce and low-quality data

Data-driven modeling has become a key building block in computational science and engineering. However, data that are available in science and engineering are typically scarce, often polluted with noise and affected by measurement errors and other perturbations, which makes learning the dynamics of systems challenging. Here, in this work, we propose to combine data-driven modeling via operator inference with the dynamic training via roll outs of neural ordinary differential equations. Operator inference with roll outs inherits interpretability, scalability, and structure preservation of traditional operator inference while leveraging the dynamic training via roll outs over multiple time steps to increase stability and robustness for learning from low-quality and noisy data. Numerical experiments with data describing shallow water waves and surface quasi-geostrophic dynamics demonstrate that operator inference with roll outs provides predictive models from training trajectories even if data are sampled sparsely in time and polluted with noise of up to 10%.

97 MATHEMATICS AND COMPUTING↗

An Integrated Approach to Coal Gasifier Testing, Modeling, and Process Optimization

Gasification is an important method of converting coal into clean burning fuels and high-value industrial chemicals. However, gasifier reliability can be severely limited by rapid degradation of the refractory lining in hot-wall gasifiers. The Pacific Northwest National Laboratory (PNNL) is performing multidisciplinary research to provide the experimental data and the engineering models needed to control gasifier operation for extended refractory life. Our experimental program includes prediction of slag viscosity using empirical viscosity models encompassing US coals, characterization of selected slag-refractory interaction including transport of slag/refractory components at the slag-refractory interface, and measurement of slag penetration into refractories as a function of time and temperature. The experimental data is used in slag flow, slag penetration, and refractory damage models to predict the operating temperature limits for increased refractory life. A simplified entrained flow gasifier model is also being developed to simulate one-dimensional axial flow with average axial velocity, coal devolatilization, and combustion kinetics. Combining the slag flow, refractory degradation, and gasifier models will provide a powerful tool to predict the coal and oxidant feed rates and control the gasifier operation to balance coal conversion efficiency with increased refractory life. A research scale gasifier has also been constructed at PNNL to provide syngas for coal conversion and carbon sequestration research, and also valuable datasets on operating conditions for validating the modeling results.

01 COAL, LIGNITE, AND PEAT↗

ALFA Non-linear Ocean Waves and PTO Control Strategy

Data from Advanced Laboratory and Field Arrays (ALFA) Non-linear Ocean Waves and Power Take-Off (PTO). Control Strategy project conducted at the O.H. Hinsdale Wave Research Laboratory (HWRL) at Oregon State University in 2019/2020. Contains two zip files (ALFANL.zip, ALFANL2.zip) from two phases of testing with data in engineering units and a report detailing the testing. This data collected by HWRL. A readme file in the docs folder explains the data collection and format. Six zip files (foswec-1 to foswec-6) data recorded by the Floating Oscillating Surge Wave Energy Converter (FOSWEC). Data organized by date and time and report describes data. A test report (ALFA Non-linear Ocean Waves Test Report.docx) details the experiments and data recording.

16 TIDAL AND WAVE POWER↗