Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Science”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,333 records · Page 74

Leading magnetic fusion energy science into the big-and-fast data lane

To crack the code of unlimited clean energy from magnetic fusion, researchers collaborate among numerous facilities that are scattered around the globe. Probing hot fusion plasmas with sophisticated diagnostics, they routinely generate fast streams of high-dimensional time-series data. We present the adaptation of a production code-base for a plasma diagnostic to the big-and-fast data lane. The new code-base is used to stream measurements, made in Korea, into a Top-15 computing facility in the US for remote analysis. We discuss software and design choices made for this new HPC-enabled scientific workflow.

Kube, Ralph↗

Outlook for artificial intelligence and machine learning at the NSLS-II

Abstract We describe the current and future plans for using artificial intelligence and machine learning (AI/ML) methods at the National Synchrotron Light Source II (NSLS-II), a scientific user facility at the Brookhaven National Laboratory. We discuss the opportunity for using the AI/ML tools and techniques developed in the data and computational science areas to greatly improve the scientific output of large scale experimental user facilities. We describe our current and future plans in areas including from detecting and recovering from faults, optimizing the source and instrument configurations, streamlining the pipeline from measurement to insight, through data acquisition, processing, analysis. The overall strategy and direction of the NSLS-II facility in relation to AI/ML is presented.

97 MATHEMATICS AND COMPUTING↗

ARM Data Integrator

The Atmospheric Radiation Measurement (ARM) Data Integrator (ADI) streamlines the development of scientific algorithms and analysis of time-series NetCDF data, and improves the content and consistency of the output data products produced by these algorithms. The framework automates the process of retrieving and preparing data for analysis, and allows users to design output data products through a graphical interface. It also provides a modular, flexible software development architecture that scientists can use to generate C, Python, and IDL source code templates that embed the pre and post processing logic allowing the scientist to focus on only their science. The input data, preprocessing, and output data specifications of algorithms are defined through a graphical interface and stored in a database. ADI implements workflow for data integration and supports user access to data through a library of software modules. Data preprocess capabilities supported include automated retrieval of data from input files, merging the retrieved data into appropriately sized chunks, and transformation of the data onto a common coordinate system grid. Through the graphical interface, users can view the details of both their data products and those in the ARM catalog and allows developers to use existing data product to build new data products. Views of the output data products include an overlay of how the design meets ARM archive's data standards providing the user with a visual cue indicating where their output violates an archive standard. The ADI libraries access the information provided through the GUI via a Postgres database. The ADI framework and its supporting components can significantly decrease the time and cost of implementing scientific algorithms while improving the ability of scientists to disseminate their results.

Source record↗

ARM Data Integrator

The Atmospheric Radiation Measurement (ARM) Data Integrator (ADI) streamlines the development of scientific algorithms and analysis of time-series NetCDF data, and improves the content and consistency of the output data products produced by these algorithms. The framework automates the process of retrieving and preparing data for analysis, and allows users to design output data products through a graphical interface. It also provides a modular, flexible software development architecture that scientists can use to generate C, Python, and IDL source code templates that embed the pre and post processing logic allowing the scientist to focus on only their science. The input data, preprocessing, and output data specifications of algorithms are defined through a graphical interface and stored in a database. ADI implements workflow for data integration and supports user access to data through a library of software modules. Data preprocess capabilities supported include automated retrieval of data from input files, merging the retrieved data into appropriately sized chunks, and transformation of the data onto a common coordinate system grid. Through the graphical interface, users can view the details of both their data products and those in the ARM catalog and allows developers to use existing data product to build new data products. Views of the output data products include an overlay of how the design meets ARM archive's data standards providing the user with a visual cue indicating where their output violates an archive standard. The ADI libraries access the information provided through the GUI via a Postgres database. The ADI framework and its supporting components can significantly decrease the time and cost of implementing scientific algorithms while improving the ability of scientists to disseminate their results.

Source record↗

Completing the Link between Exposure Science and Toxicology for Improved Environmental Health Decision Making: The Aggregate Exposure Pathway Framework

Driven by major scientific advances in analytical methods, biomonitoring, and computational exposure assessment, and a newly articulated vision for a greater impact in public health, the field of exposure science is undergoing a rapid transition from a field of observation to a field of prediction. Deployment of an organizational and predictive framework for exposure science analogous to the computationally enabled “systems approaches” used in the biological sciences is a necessary step in this evolution. Here we propose the aggregate exposure pathway (AEP) concept as the natural and complementary companion in the exposure sciences to the adverse outcome pathway (AOP) concept in the toxicological sciences. The AEP framework offers an intuitive approach to successful organization of exposure science data within individual units of prediction common to the field, setting the stage for exposure forecasting. Looking farther ahead, we envision direct linkages between aggregate exposure pathway and adverse outcome pathways, completing the source to outcome continuum and setting the stage for more efficient integration of exposure science and toxicity testing information. Together these frameworks form and inform a decision making framework with the flexibility for risk-based, hazard-based or exposure-based decisions.

Teeguarden, Justin G.↗

MultiSector Dynamics: Advancing the Science of Complex Adaptive Human-Earth Systems

The field of MultiSector Dynamics (MSD) explores the dynamics and co-evolutionary pathways of human and Earth systems with a focus on critical goods, services, and amenities delivered to people through interdependent sectors. This commentary lays out core definitions and concepts, identifies MSD science questions in the context of the current state of knowledge, and describes ongoing activities to expand capacities for open science, leverage revolutions in data and computing, and grow and diversify the MSD workforce. Central to our vision is the ambition of advancing the next generation of complex adaptive human-Earth systems science to better address interconnected risks, increase resilience, and improve sustainability. This will require convergent research and the integration of ideas and methods from multiple disciplines. Understanding the tradeoffs, synergies, and complexities that exist in coupled human-Earth systems is particularly important in the context of energy transitions and increased future shocks.

Reed, Patrick↗

Joint Measurement of Lensing-Galaxy Correlations Using SPT and DES SV Data

We measure the correlation of galaxy lensing and cosmic microwave background lensing with a set of galaxies expected to trace the matter density field. The measurements are performed using pre-survey Dark Energy Survey (DES) Science Verification optical imaging data and millimeter-wave data from the 2500 square degree South Pole Telescope Sunyaev-Zel’dovich (SPT-SZ) survey. The two lensing-galaxy correlations are jointly fit to extract constraints on cosmological parameters, constraints on the redshift distribution of the lens galaxies, and constraints on the absolute shear calibration of DES galaxy lensing measurements. We show that an attractive feature of these fits is that they are fairly insensitive to the clustering bias of the galaxies used as matter tracers. The measurement presented in this work confirms that DES and SPT data are consistent with each other and with the currently favored ΛCDM cosmological model. It also demonstrates that joint lensing-galaxy correlation measurement considered here contains a wealth of information that can be extracted using current and future surveys.

cosmic background radiation↗

The 2022 Plasma Roadmap: low temperature plasma science and technology

Abstract The 2022 Roadmap is the next update in the series of Plasma Roadmaps published by Journal of Physics D with the intent to identify important outstanding challenges in the field of low-temperature plasma (LTP) physics and technology. The format of the Roadmap is the same as the previous Roadmaps representing the visions of 41 leading experts representing 21 countries and five continents in the various sub-fields of LTP science and technology. In recognition of the evolution in the field, several new topics have been introduced or given more prominence. These new topics and emphasis highlight increased interests in plasma-enabled additive manufacturing, soft materials, electrification of chemical conversions, plasma propulsion, extreme plasma regimes, plasmas in hypersonics, data-driven plasma science and technology and the contribution of LTP to combat COVID-19. In the last few decades, LTP science and technology has made a tremendously positive impact on our society. It is our hope that this roadmap will help continue this excellent track record over the next 5–10 years.

plasma diagnostics↗

Weak-lensing magnification as a probe for the dark Universe

This Thesis is devoted to the analysis of weak-lensing magnification on the Dark Energy Survey. Two analysis with different goals each are made on different data-sets: the Science Verification (DES-SV) and the Year 1 (DES-Y1). The DES-SV analysis aims the development of techniques to detect the weak-lensing number count magnification signal and the mitigation of systematic errors. The DES-Y1 analysis employs the methods used with the DES-SV data to measure the convergence profile of the emptiest regions of the Universe –voids and troughs–to use them as a new cosmological probe.

79 ASTRONOMY AND ASTROPHYSICS↗

A Binary Offset Effect in CCD Readout and Its Impact on Astronomical Data

We have discovered an anomalous behavior of CCD readout electronics that affects their use in many astronomical applications. An offset in the digitization of the CCD output voltage that depends on the binary encoding of one pixel is added to pixels that are read out one, two, and/or three pixels later. One result of this effect is the introduction of a differential offset in the background when comparing regions with and without flux from science targets. Conventional data reduction methods do not correct for this offset. We find this effect in 16 of 22 instruments investigated, covering a variety of telescopes and many different front-end electronics systems. The affected instruments include LRIS and DEIMOS on the Keck telescopes, WFC3 UVIS and STIS on HST, MegaCam on CFHT, SNIFS on the UH88 telescope, GMOS on the Gemini telescopes, HSC on Subaru, and FORS on VLT. The amplitude of the introduced offset is up to 4.5 ADU per pixel, and it is not directly proportional to the measured ADU level. We have developed a model that can be used to detect this "binary offset effect" in data, and correct for it. Understanding how data are affected and applying a correction for the effect is essential for precise astronomical measurements.

79 ASTRONOMY AND ASTROPHYSICS↗

The Dark Energy Survey Data Management System

The Dark Energy Survey (DES) is a project with the goal of building, installing and exploiting a new 74 CCD-camera at the Blanco telescope, in order to study the nature of cosmic acceleration. It will cover 5000 square degrees of the southern hemisphere sky and will record the positions and shapes of 300 million galaxies up to redshift 1.4. The survey will be completed using 525 nights during a 5-year period starting in 2012. About O(1 TB) of raw data will be produced every night, including science and calibration images. The DES data management system has been designed for the processing, calibration and archiving of these data. It is being developed by collaborating DES institutions, led by NCSA. In this contribution, we describe the basic functions of the system, what kind of scientific codes are involved and how the Data Challenge process works, to improve simultaneously the Data Management system algorithms and the Science Working Group analysis codes.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Scalable Data Center Capacity for DOE's AI Prototype: A Rapidly Available Gigawatt Data Center for DOE

The multilaboratory Gigawatt Data Center working group was commissioned to identify approaches to rapidly establish federal data centers with scalable capacities up to 1,000 MW. These state-of-the-art facilities will serve as hubs for interdisciplinary collaboration, industry partnerships, and transformative applications of artificial intelligence. The proposed strategic shift includes facilitating multilaboratory collaboration, prioritizing operational efficiency, expanding public–private partnerships, optimizing investments, ensuring long-term contractual flexibility, supporting open science and secure data enclaves, and exploiting high-speed national networks. Owing to their extensive experience and best practices, the US Department of Energy national laboratories are uniquely positioned to lead this initiative. We recommend conducting a feasibility analysis to rapidly identify the optimal sites for this initiative, and the effort will likely involve private industry for design, construction, financing, and operational integration. We also propose establishing multiple geographically diverse sites to ensure energy resilience, high operational reliability, and a diverse user base, thereby effectively addressing the nation’s critical needs.

42 ENGINEERING↗

Reasons for 2011 Release of the Evaluated Nuclear Data Library (ENDL2011.0)

LLNL's Computational Nuclear Physics Group and Nuclear Theory and Modeling Group have collaborated to create the 2011 release of the Evaluated Nuclear Data Library (ENDL2011). ENDL2011 is designed to sup- port LLNL's current and future nuclear data needs. This database is currently the most complete nuclear database for Monte Carlo and deterministic transport of neutrons and charged particles, surpassing ENDL2009.0 [1]. The ENDL2011 release [2] contains 918 transport-ready eval- uations in the neutron sub-library alone. ENDL2011 was assembled with strong support from the ASC program, leveraged with support from NNSA science campaigns and the DOE/Offce of Science US Nuclear Data Pro- gram.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Ecobuoys for Scalable Oceanography

An approach to scalable surface-drifting buoys is needed to enable the high spatial and temporal resolution of oceanographic data that the science and meteorological communities are asking for. With the number of active buoys predicted to increase by a factor of 100 or more, the impact on the environment becomes even more important. Here, we present a pathway to a scalable and sustainable generation of buoys. We identify the main criteria to be used when developing such buoys to be low cost, with reliable data and neutral or even positive environmental impact. For each buoy subsystem—hull, electronics, energy generation and storage, sensors, and communication system—cutting-edge technological solutions are presented, many of them from emerging research in marine or other disciplines. We then assess the potential solutions against the design criteria and plot a path toward small, environmentally friendly, low-cost, and low-power buoys.

54 ENVIRONMENTAL SCIENCES↗

Atmospheric Radiation Measurement Climate Research Facility (ACRF) Annual Report 2008

The Importance of Clouds and Radiation for Climate Change: The Earth’s surface temperature is determined by the balance between incoming solar radiation and thermal (or infrared) radiation emitted by the Earth back to space. Changes in atmospheric composition, including greenhouse gases, clouds, and aerosols, can alter this balance and produce significant climate change. Global climate models (GCMs) are the primary tool for quantifying future climate change; however, there remain significant uncertainties in the GCM treatment of clouds, aerosol, and their effects on the Earth’s energy balance. In 1989, the U.S. Department of Energy (DOE) Office of Science created the Atmospheric Radiation Measurement (ARM) Program to address scientific uncertainties related to global climate change, with a specific focus on the crucial role of clouds and their influence on the transfer of radiation in the atmosphere. To reduce these scientific uncertainties, the ARM Program uses a unique twopronged approach: • The ARM Climate Research Facility, a scientific user facility for obtaining long-term measurements of radiative fluxes, cloud and aerosol properties, and related atmospheric characteristics in diverse climate regimes; and • The ARM Science Program, focused on the analysis of ACRF and other data to address climate science issues associated with clouds, aerosols, and radiation, and to improve GCMs. This report provides an overview of each of these components and a sample of achievements for each in fiscal year (FY) 2008.

54 ENVIRONMENTAL SCIENCES↗

PanDA: Production and Distributed Analysis System

The Production and Distributed Analysis (PanDA) system is a data-driven workload management system engineered to operate at the LHC data processing scale. The PanDA system provides a solution for scientific experiments to fully leverage their distributed heterogeneous resources, showcasing scalability, usability, flexibility, and robustness. The system has successfully proven itself through nearly two decades of steady operation in the ATLAS experiment, addressing the intricate requirements such as diverse resources distributed worldwide at about 200 sites, thousands of scientists analyzing the data remotely, the volume of processed data beyond the exabyte scale, dozens of scientific applications to support, and data processing over several billion hours of computing usage per year. PanDA’s flexibility and scalability make it suitable for the High Energy Physics community and wider science domains at the Exascale. Beyond High Energy Physics, PanDA’s relevance extends to other big data sciences, as evidenced by its adoption in the Vera C. Rubin Observatory and the sPHENIX experiment. As the significance of advanced workflows continues to grow, PanDA has transformed into a comprehensive ecosystem, effectively tackling challenges associated with emerging workflows and evolving computing technologies. The paper discusses PanDA’s prominent role in the scientific landscape, detailing its architecture, functionality, deployment strategies, project management approaches, results, and evolution into an ecosystem.

97 MATHEMATICS AND COMPUTING↗