Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Technology data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Offshore Wind Technology Data Update (2019) [Slides]

The 2019 Offshore Wind Technology Data Update compiles information from peer-reviewed literature, market reports, press releases, industry news reports, manufacturer specification sheets, and offshore wind project announcements to provide a comprehensive snapshot of the state of the global wind industry in 2019. These data, including capacity projections, project characteristics, technology trends, and cost estimates, are categorized, tabulated, and plotted to provide easily recognizable and understandable summaries. A particular focus is given to the United States offshore wind project pipeline, including project announcements, state procurements, deployment timelines, infrastructure investments, grid interconnections, and other related developments. The update is intended to be used as a reference document by researchers, analysts, industry practitioners, and government officials.

17 WIND ENERGY↗

FY 2025 Multidimensional Data Correlation Platform: Unified Software Architecture for Advanced Materials and Manufacturing Technologies Data Management and Processing

The Advanced Materials and Manufacturing Technologies (AMMT) program continues to advance a data-driven approach to demonstrate the utility of additive manufacturing for fabricating components for nuclear applications. A key scientific goal is to leverage data to better understand manufacturing outcomes and thereby improve the performance, reliability, and lifespan of nuclear components. Ultimately, this effort supports the development of standards for certification and qualification of additively manufactured components, enabling broader industry adoption. In support of this objective, the AMMT program is building and deploying a data management platform to record, index, analyze, and make available the manufacturing data generated across the AMMT program. In FY 2023, the team conceptualized the architecture of the platform and, in FY 2024, deployed the first functional version at the Oak Ridge National Laboratory (ORNL) Manufacturing Demonstration Facility (MDF). In FY 2025, the platform was officially opened to all AMMT members. To enable this expansion, core modifications and enhancements were developed, including improvements to the user interface and workflows for data entry and retrieval. Most notably, robust security and access control mechanisms were implemented to protect data and manage information sharing. This effort featured a logging system, protected views, and controlled access mechanisms. This report documents these enhancements and the transition of the platform into program-wide use.

36 MATERIALS SCIENCE↗

Electrification Futures Study Technology Data

This data supplements the "Electrification Futures Study: End-Use Electric Technology Cost and Performance Projections through 2050" report. The data included here consist of the cost and performance estimates for electric end-use technologies developed for the three sensitivity cases in the Electrification Futures Study: Slow Advancement, Moderate Advancement, and Rapid Advancement.

buildings↗

Unified Software Architecture for Advanced Materials and Manufacturing Technologies Data Management and Processing: FY 2023 Multidimensional Data Correlation Platform

This report details the various digital manufacturing activities ongoing at ORNL as part of the Advanced Materials and Manufacturing Technologies (AMMT) program. The AMMT program is exploring a data-driven approach to demonstrate the use of AM for the fabrication of components for nuclear applications, with the goal of providing a greater understanding of manufacturing quality outcomes that would pave the way toward the development of standards for certification and qualification. The objective of this work package is to establish a digital manufacturing discipline common to all participants of the AMMT program to improve the performance, reliability, and lifetime of nuclear components. As part of this effort, we will develop a unified software architecture for AMMT data management and processing, deploy the digital platform across AMMT participants’ facilities, and generate pedigreed datasets in a common format across multiple labs and facilities. To this end, the MDDC work package has focused on three activities during FY23. First, the MDF Digital Tool was overhauled to better serve the needs of the AMMT program. Next, multiple laser powder bed fusion (L-PBF) systems at the MDF were upgraded to a common sensor package for collecting comparable in situ data across machines. Finally, various improvements relevant to the AMMT program were implemented in the ORNL-developed software tool, Peregrine. This report marks the completion of FY23 milestone M3CR-22OR0403051: Report Describing the Architecture of the Digital Platform to Support AMMT Activities.

36 MATERIALS SCIENCE↗

Using Big Data Technologies for HEP Analysis

The HEP community is approaching an era were the excellent performances of the particle accelerators in delivering collision at high rate will force the experiments to record a large amount of information. The growing size of the datasets could potentially become a limiting factor in the capability to produce scientific results timely and efficiently. Recently, new technologies and new approaches have been developed in industry to answer to the necessity to retrieve information as quickly as possible to analyze PB and EB datasets. Providing the scientists with these modern computing tools will lead to rethinking the principles of data analysis in HEP, making the overall scientific process faster and smoother. In this paper, we are presenting the latest developments and the most recent results on the usage of Apache Spark for HEP analysis. The study aims at evaluating the efficiency of the application of the new tools both quantitatively, by measuring the performances, and qualitatively, focusing on the user experience. The first goal is achieved by developing a data reduction facility: working together with CERN Openlab and Intel, CMS replicates a real physics search using Spark-based technologies, with the ambition of reducing 1 PB of public data in 5 hours, collected by the CMS experiment, to 1 TB of data in a format suitable for physics analysis. The second goal is achieved by implementing multiple physics use-cases in Apache Spark using as input preprocessed datasets derived from official CMS data and simulation. By performing different end-analyses up to the publication plots on different hardware, feasibility, usability and portability are compared to the ones of a traditional ROOT-based workflow.

Cremonesi, Matteo↗

Deactivation and decommissioning web log analysis using big data technology - 15710

The D and D Knowledge Management Information Tool (D and D KM- IT) is a web-based knowledge management information tool built for the D and D user community. Big data is a massive volume of structured and unstructured datasets which is so large that it's difficult to process using traditional database techniques. Web logs are the repository of files which are generated automatically for any operation on the web site. Web log files generated from the D and D KM-IT will be processed using the Apache Hadoop Framework to extract meaningful data. Hadoop is an open-source software framework for storing and processing big data in a distributed environment on large clusters of commodity hardware. Hadoop framework consists of two main layers: Hadoop distributed file system (HDFS) and the Execution engine (MapReduce). Automatic parallelization and distribution; clean and simple programming abstraction. Implementation: Web log files from the D and D KM-IT server are fetched using Apache Flume and loaded into the Hadoop distributed file system. Using the Apache Hcatalog tool, the web log data is parsed and converted into a structured table format. A Pig program is developed to query the tables to retrieve and store the significant information onto the HDFS. The extracted data is fed to business visualization tools such as Microsoft Excel for analysis and reporting. Results The reports generated through the web log data processing will be analyzed to improve the usability and performance of the D and D KM-IT. Conclusion/Future Work: User keyword information can be explored to add new trending topics to the D and D KM-IT application. Statistics generated can be compared to analysis reports from existing analytical tools.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Kira: Processing Astronomy Imagery Using Big Data Technology

Scientific analyses commonly compose multiple single-process programs into a dataflow. An end-to-end dataflow of single-process programs is known as a many-task application. Typically, HPC tools are used to parallelize these analyses. In this work, we investigate an alternate approach that uses Apache Spark-a modern platform for data intensive computing-to parallelize many-task applications. We implement Kira, a flexible and distributed astronomy image processing toolkit, and its Source Extractor (Kira SE) application. Using Kira SE as a case study, we examine the programming flexibility, dataflow richness, scheduling capacity and performance of Apache Spark running on the Amazon EC2 cloud. By exploiting data locality, Kira SE achieves a 4.1× speedup over an equivalent C program when analyzing a 1TB dataset using 512 cores on the Amazon EC2 cloud. Furthermore, Kira SE on the Amazon EC2 cloud achieves a 1.8× speedup over the C program on the NERSC Edison supercomputer. A 128-core Amazon EC2 cloud deployment of Kira SE using Spark Streaming can achieve a second-scale latency with a sustained throughput of 800 MB/s. Our experience with Kira demonstrates that data intensive computing platforms like Apache Spark are a performant alternative for many-task scientific applications.

97 MATHEMATICS AND COMPUTING↗

Wind Technology Data and Trends: Land-Based Focus (Update 2020) [Slides]

The purpose of this presentation is to summarize publicly available data on key trends in U.S. wind power sector. In scope, the presentation focuses on land-based wind turbines over 100 kW in size, separates DOE-funded data collection efforts on distributed and offshore wind, and focuses on historical data, with some emphasis on the previous year.

17 WIND ENERGY↗

A Brief Survey of Data Streaming Technologies

Streaming data is data that is emitted at variable volumes in a continuous, incremental manner with the goal of low-latency processing often at a different physical location. Network infrastructure is used to facilitate the connection between data sources and sinks, and must be robust to handle the requirements of the workflow. The U.S. Department of Energy Office of Science (DOE SC) a federal agency supporting fundamental scientific research for energy and the Nation’s largest supporter of basic research in the physical sciences. DOE SC has the responsibility for operating $\mathbf{1 0}$ National Laboratories, and 28 scientific user facilities supporting advanced supercomputers, particle accelerators, large x-ray light sources, neutron scattering sources, and other specialized facilities for nanoscience and genomics. This paper investigates the state of streaming data workfows, and details some of the approaches to this challenging problem.

Kissel, Ezra↗

A review on technologies and their usage in solid waste monitoring and management systems: Issues and challenges

Highlights: • Classification of available technologies for SWM system in four core category. • Organization of technology based SWM systems in three main groups. • Summary of SWM systems with target application, methodology and functional domain. • Issues and challenges are highlighted for further design of a sustainable system. - Abstract: In the backdrop of prompt advancement, information and communication technology (ICT) has become an inevitable part to plan and design of modern solid waste management (SWM) systems. This study presents a critical review of the existing ICTs and their usage in SWM systems to unfold the issues and challenges towards using integrated technologies based system. To plan, monitor, collect and manage solid waste, the ICTs are divided into four categories such as spatial technologies, identification technologies, data acquisition technologies and data communication technologies. The ICT based SWM systems classified in this paper are based on the first three technologies while the forth one is employed by almost every systems. This review may guide the reader about the basics of available ICTs and their application in SWM to facilitate the search for planning and design of a sustainable new system.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Data Management Technology Survey and Recommendation

The Data Management Plan (DMP) document already released describes the architecture and plan for developing the data management framework needed by the Carbon Capture Simulation Initiative (CCSI) toolset. The CCSI toolset includes: experimental data, physical property methods and parameters, empirical correlations, validation data set, models, simulation inputs and outputs, reduced-order models, cost models, risk models, uncertainty estimation, etc. Each tool in the toolset requires and generates data, and the data management system organizes and stores the data. The data management framework will be driven by end-users and interact with CCSI workflow components such as Turbine. This document reports on the technology survey completed as the first step in the Data Management Plan. It also provides recommendations for a path forward based on the survey results.

97 MATHEMATICS AND COMPUTING↗

Sustainable Data Evolution Technology (SDET) for Power Grid Optimization (Final Report)

This project develops an innovative sustainable data evolution technology (SDET) to create open-access power grid datasets and facilitate updates to these datasets by the power grid community. The lack of open-access, realistic large-scale datasets significantly limits the ability of researchers, developers and ultimately end users to develop, benchmark and compare new methods and tools for optimizing the operation and planning of the grid, which leads to slow adoption by end users. Available open datasets include the IEEE sponsored 14-300 bus transmission test cases and distribution test feeders, the Edinburgh Power Systems Test Case Archive (39-2224 buses), and the Polish cases (2383-3375 buses) available with MATPOWER. These datasets serve certain purposes, but for power grid optimization, they are insufficient in one or more of these aspects: 1) they are too small; 2) they are incomplete in both models and scenarios for optimization purposes; and 3) they are static and are not keeping up with grid needs. The SDET technology delivers large-scale realistic datasets and data-creation tools capable of generating new datasets. We work closely with the Category-2 data repository project awarded by the same GRID DATA program. The generated datasets and data creation tools are compatible with and available through the data repository. The objective is to make this a sustained effort within and beyond the ARPA-E GRID DATA program so that the datasets can evolve over time and meet the current and future needs for power grid optimization and potentially other applications in power grid operation and planning. The novel and disruptive features of SDET differentiate itself from prior work in the following aspects: 1) SDET derives features and metrics for both transmission and distribution (T&D) systems by analyzing many public and private datasets provided by our industry partners National Rural Electric Cooperative Association (NRECA) and PJM Interconnection (PJM). 2) SDET develops data-creation tools and use these tools to generate large-scale open-access realistic datasets that comply with the metrics for both T&D systems. 3) SDET validates the created datasets using industry tools provided by our vendor partner GE Energy Solution. The data creation tools, as well as the created datasets, are integrated into the data repository (DR. POWER) funded by ARPA-E GRID DATA program in Category 2. Users can use the datasets and access these data creation tools to create and update datasets, thus datasets can evolve per user requirements and power grid development. The SDET is a novel and disruptive technology compared to current ad hoc and static dataset generation. It is expected the SDET technology will fundamentally enhance the development, assessment, and adoption of new methods and tools for power grid optimization and other applications, which in turn would significantly improve the reliability, resiliency, and efficiency of the power grid – a major ARPA-E mission objective.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Applications of data mining technology to enhance O and M: automatic planning of electrical isolation with deep learning - 255

Data mining technology is now readily available, thanks to high powered, low cost computing resource and useful coding tools. We study several applications of data mining to enhance operation and maintenance (O and M), such as abnormality prediction, efficiency diagnosis, document traceability, image recognition, etc. In field support, we try automatic planning of electrical isolation with deep learning. Currently, a skilled engineer plans electrical isolation procedure with hundreds of the circuit diagrams and the related documents, taking man-hours. If this task becomes automatic, it is very efficient. The automatic planning has two issues. One is much calculation time of electrical circuit simulator, searching billions of electrical conducting paths. The other is interpretation of human fuzzy information, such as ease of work. Deep learning is helpful to resolve them. We performed a model case study of the electrical isolation. We applied a deep neural network (DNN) for dropping in the calculation time. We trained the circuit diagrams and the responses of the circuit simulator to the DNN, constructing an efficient path search algorithm in the DNN. The calculation time of the DNN was shorter by a factor of 32 for the model case, compared with that of the electrical circuit simulator. We applied a deep Q-network (DQN) for the interpretation of fuzzy information. The DQN optimized isolation procedure from the viewpoint of the work load with the equipment layout, related doses, and values of wet bulb globe temperature (WBGT) to prevent heatstroke. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Adoption of ROOT RNTuple for the next main event data storage technology in the ATLAS production framework Athena

Since the start of LHC in 2008, the ATLAS experiment has relied on ROOT to provide storage technology for all its processed event data. Internally, ROOT files are organized around TTree structures that are capable of storing complex C++ objects. The capabilities of TTrees developed over the years and are now offering support for advanced concepts like polymorphism, schema evolution and user defined collections and ATLAS makes use of these features to handle its EDM. But some original TTrees concepts, like the POSIX file model and sequential writing, remain unchanged since the beginning and could be an obstacle to achieving the performance required for High Luminosity LHC. With the HL-LHC performance goals in mind, the ROOT project developed a new storage format - the RNTuple. RNTuple, with its accompanying user API, is now in the final development stage and is planned to be production-ready at the end of 2024. Soon after that, the TTree will become a legacy format. ATLAS intends to have its main Event processing framework Athena ready to use RNTuple in the production environment as early as possible. The work on adopting RNTuple as another ROOT storage technology in Athena started already in 2021 and is now nearly complete. Although the initial goal was to focus on derived-AOD products (PHYS and PHYSLITE), with a little added effort all ATLAS data products: RDO, HITS, ESD, AOD and DAOD can be now stored in RNTuple format and transparently read back. In this paper we will describe the current state of RNTuple adoption in the Athena framework and explain the ATLAS EDM requirements that had to be met on the ROOT side to successfully integrate both environments. We will demonstrate the ability to run standard ATLAS production workflows, based on RNTuple as the Event data storage technology, and point out key advantages of the new format.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Utah FORGE: Sanvean Technologies Drilling Data from Well 16B(78)-32

Included here is Sanvean Technologies bit sensor data amalgamated with data from National Oilwell Varco's (NOV) BlackBox tool for Reed Hycalog bits used during drilling of Well 16B(78)-32. The dataset contains information collected at the bit while drilling including rate of penetration (ROP), top drive torque, and bit box temperature. The data was recorded at the bit box and top sub of the motor. RPM was measured by onboard gyro recording continuously in each sensor, and shock levels were also recorded on X, Y and Z axis. This data was merged with EDR in time format and saved in file sets (the zipped files) then output into CSV files. Please note: fields in the CSV files, such as the date field, may need to be formatted to display properly. There is an additional zipped folder in each dataset that is password protected. Sanvean GameChanger Viewer software must be used to view this password protected data. Information on how to use and download this free software is also included here.

15 GEOTHERMAL ENERGY↗