Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “interdisciplinary collaboration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

LinkML: an open data modeling framework

Background Scientific research relies on well-structured, standardized data; however, much of it is stored in formats such as free-text lab notebooks, nonstandardized spreadsheets, or data repositories. This lack of structure challenges interoperability, making data integration, validation, and reuse difficult. Findings LinkML (Linked Data Modeling Language) is an open framework that simplifies the process of authoring, validating, and sharing data. LinkML can describe a range of data structures, from flat, list-based models to complex, interrelated, and normalized models that utilize polymorphism and compound inheritance. It offers an approachable syntax that is not tied to any one technical architecture and can be integrated seamlessly with many existing frameworks. The LinkML syntax provides a standard way to describe schemas, classes, and relationships, allowing modelers to build well-defined, stable, and optionally ontology-aligned data structures. Once defined, LinkML schemas may be imported into other LinkML schemas. These key features make LinkML an accessible platform for interdisciplinary collaboration and a reliable way to define and share data semantics. Conclusions LinkML helps reduce heterogeneity, complexity, and the proliferation of single-use data models while simultaneously enabling compliance with FAIR (Findable, Accessible, Interoperable, and Reusable) data standards. LinkML has seen increasing adoption in various fields, including biology, chemistry, biomedicine, microbiome research, finance, electrical engineering, transportation, and commercial software development. In short, LinkML makes implicit models explicitly computable and allows data to be standardized at their origin. LinkML documentation and code are available at https://linkml.io/.

AI-ready data↗

Open Hardware in Science: The Benefits of Open Electronics

Abstract Openly shared low-cost electronic hardware applications, known as open electronics, have sparked a new open-source movement, with much untapped potential to advance scientific research. Initially designed to appeal to electronic hobbyists, open electronics have formed a global “maker” community and are increasingly used in science and industry. In this perspective article, we review the current costs and benefits of open electronics for use in scientific research ranging from the experimental to the theoretical sciences. We discuss how user-made electronic applications can help (I) individual researchers, by increasing the customization, efficiency, and scalability of experiments, while improving data quantity and quality; (II) scientific institutions, by improving access to customizable high-end technologies, sustainability, visibility, and interdisciplinary collaboration potential; and (III) the scientific community, by improving transparency and reproducibility, helping decouple research capacity from funding, increasing innovation, and improving collaboration potential among researchers and the public. We further discuss how current barriers like poor awareness, knowledge access, and time investments can be resolved by increased documentation and collaboration, and provide guidelines for academics to enter this emerging field. We highlight that open electronics are a promising and powerful tool to help scientific research to become more innovative and reproducible and offer a key practical solution to improve democratic access to science.

Oellermann, Michael (ORCID:0000000153926737)↗

DLSIA: Deep Learning for Scientific Image Analysis

DLSIA (Deep Learning for Scientific Image Analysis) is a Python-based machine learning library that empowers scientists and researchers across diverse scientific domains with a range of customizable convolutional neural network (CNN) architectures for a wide variety of tasks in image analysis to be used in downstream data processing. DLSIA features easy-to-use architectures, such as autoencoders, tunable U-Nets and parameter-lean mixed-scale dense networks (MSDNets). Additionally, this article introduces sparse mixed-scale networks (SMSNets), generated using random graphs, sparse connections and dilated convolutions connecting different length scales. For verification, several DLSIA-instantiated networks and training scripts are employed in multiple applications, including inpainting for X-ray scattering data using U-Nets and MSDNets, segmenting 3D fibers in X-ray tomographic reconstructions of concrete using an ensemble of SMSNets, and leveraging autoencoder latent spaces for data compression and clustering. As experimental data continue to grow in scale and complexity, DLSIA provides accessible CNN construction and abstracts CNN complexities, allowing scientists to tailor their machine learning approaches, accelerate discoveries, foster interdisciplinary collaboration and advance research in scientific image analysis.

97 MATHEMATICS AND COMPUTING↗

Knowledge gaps for neuromorphic ionic computing

BACKGROUND Neuromorphic computing, inspired by the human brain’s ability to process information efficiently, represents a transformative approach to computation. In this Review, we explore the emerging field of neuromorphic ionic computing, which leverages ionic conduction and coupling to mimic neural processes, and identify critical knowledge gaps that must be addressed to realize its full potential. A central theme of the discussion is energy efficiency, a challenge that is both a limitation and an opportunity for this technology. Although complementary metal-oxide semiconductor (CMOS)–based neuromorphic technologies have made strides in scaling to billions of neurons and are increasingly applied in artificial intelligence and numerical computing, they remain orders of magnitude behind the human brain in terms of connectivity and energy efficiency. Neuromorphic ionic computing promises to overcome these limitations by leveraging the distinct architectural and operational principles of the brain. Our brains achieve this energy efficiency by combining several key features: using the same network elements to store and process information; using an incredibly complex and massively interconnected three-dimensional (3D) network of locally active elements that enables sparsity, robustness in the presence of noise, adaptation, and life-long learning; computing at comparatively low voltage and frequency; and last, taking advantage of a plethora of ions and small molecules as information carriers. Here, we propose that ionic computing systems can take advantage of similar features to achieve substantial gains in energy efficiency. ADVANCES Since the first reports of neuromorphic ionic behavior in nanofluidic channels, we have witnessed an explosion of reports that used ionic devices to produce synaptomimetic behaviors. However, achieving the goals of ionic computing requires not only implementation of much more sophisticated device functionality but also overcoming fundamental barriers in materials science, device architecture, and system integration. Current ionic devices, even those incorporating state-of-the-art materials, still suffer from limited functionality and stability, which restrict their performance and increase energy demands. Developing new materials with enhanced ionic properties is essential to overcome these limitations. Similarly, the design of neuromorphic devices must evolve to leverage the particular advantages of ionic processes. Existing architectures often follow a single-information-carrier logic of conventional electronics or are constructed of mesoscale fluidics, failing to capitalize on the energy-efficient mechanisms inherent to ionic systems or implement the multiple-information-carrier paradigm. Current neuromorphic chips focus on large-scale networks of analog memory elements based on mechanisms such as charge trap (flash), filamentary, phase change, or spin, which are built on top of a network of artificial CMOS neurons. Although such prototype networks have achieved impressive performance, it is difficult to envision how they can implement the key features such as massive connectivity, sophisticated plasticity, adaptability, sparsity, and “multichromatic” computing. Although small-scale devices have demonstrated promising results, integrating them, maintaining energy efficiency, and implementing temperature control as systems grow in complexity and size to computationally relevant scale remain major hurdles. Furthermore, interfacing neuromorphic ionic devices with existing computing technologies presents technical and conceptual challenges that will require innovative approaches that combine insights from neuroscience, materials science, and engineering. OUTLOOK Despite these challenges, the potential impact of neuromorphic ionic computing is profound with potential applications ranging from artificial intelligence to robotics and beyond. We also argue that neuromorphic ionic computing systems should not, at least in the beginning, compete with CMOS technologies but rather should focus on applications that require extreme energy efficiency with chemical and/or biological compatibility, such as biomedical applications (for example, brain-computer interfaces), environmental monitoring, and agricultural and food applications. Ultimately, this Review highlights the crucial role of interdisciplinary collaboration in advancing the field. Neuromorphic ionic computing is not merely a technological innovation; it represents a substantial step toward sustainable computation, aligning with the growing demand for energy-conscious solutions in a world that is increasingly reliant on data and computation.

Neuromorphic↗

A 15-Year Retrospective on Immersive Visualization Lessons from the Applied Visualization Laboratory

This article shares the experiences of operating an immersive visualization laboratory over a 15-year period. The paper discusses valuable insights into the lessons learned from various projects, including the challenges they faced, such as technical difficulties, user adoption, and opportunities, and practical solutions for overcoming them. One crucial element for successful immersive visualization projects is interdisciplinary collaboration. The paper presents the advantages of immersive visualization technology, such as improved data comprehension, enhanced communication, and increased engagement in complex scenarios. We present the dynamic realm of virtual and augmented truth (VR/AR) technology in the context of a immersive laboratory system. We spotlight rising trends inside the integration of VR/AR tools for visualization. We also present our experience in dealing with the hardware and software additives in an immersive VR/AR labs, dropping light on the demanding situations and successes encountered throughout everyday operations. Furthermore, it offers practical knowledge and guidance based on years of experience in the field, which can help you overcome challenges and achieve success in your project.

99 GENERAL AND MISCELLANEOUS↗

Computational Modeling to Advance Novel Medical Isotopes for Radiotheranostics: A DOE-NIH Joint Workshop Executive Summary

The DOE-NIH Joint Workshop on Computational Modeling to Advance Novel Medical Isotopes for Radiotheranostics, held on September 27, 2024, brought together experts from government, academia, and industry to address critical challenges in radionuclide production and clinical translation. Here, the workshop emphasized interdisciplinary collaboration, particularly between the Department of Energy (DOE) and the National Institutes of Health (NIH), to strengthen the domestic isotope supply, streamline regulatory pathways, and further integrate computational tools into radiopharmaceutical therapy (RPT). Key discussions explored the role of AI-driven modeling, machine learning, and digital twin technologies in optimizing dosimetry, dynamically personalizing treatments, and reducing time to clinical adoption. Advances in predictive computational modeling were highlighted as essential for improving radionuclide yield, purity, and synthesis efficiency. Regulatory considerations and equitable access were central themes, with participants advocating for harmonized global standards, adaptive trial designs, and expanded infrastructure for clinical implementation. DOE computational and production infrastructure was emphasized. Future priorities identified include increased investment in radionuclide production infrastructure, expanded workforce development in radiopharmaceutical sciences and computational modeling, and the creation of robust public-private partnerships. The workshop concluded that continued strategic collaboration and sustained resources will be vital for advancing next-generation radiotheranostics, ensuring safe and effective therapies accessible to all patients.

digital twins↗

The Thermodynamics of Crystallization and Phase-Separation in Melt-Derived Nuclear Waste Forms

This project aimed to gain detailed and fundamental understanding of the stability of glass waste forms to be used for safe and reliable encapsulation of nuclear waste. The focus was to understand thermodynamic and structural properties involved in crystallization and phase separation in melt-derived waste form glasses and glass-ceramics by studying a baseline glass composition with varying additives. This was achieved by combining neutron total scattering, advanced calorimetric measurements, and extensive modeling study. This project harnessed diverse and complementary approaches and expertise from four collaborating interdisciplinary institutions (two universities, one national laboratory, and one UK university partner). Samples were prepared at the national laboratory and exchanged with the two university institutions. The thermodynamic data obtained by various advanced calorimetry techniques were linked to the underlying short-range structure of waste forms measured by state-of-the-art neutron total scattering experiments. An important element of this project was extensive modeling to interpret and fundamentally understand the experimental results.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Using probability distribution function as a scaling approach to incorporate soil heterogeneity into biogeochemical models for greenhouse gas predictions (Final Technical Report)

The project investigated biogeochemical processes at terrestrial-aquatic interfaces (TAIs), focusing on soil microsite heterogeneity and its impact on greenhouse gas (GHG) fluxes. Using laboratory experiments, modeling, and data integration, researchers explored redox-driven microbial processes under fluctuating hydrological conditions. Key advancements included modifying the DAMM-GHG model to incorporateelectron acceptor availability and enhancing the AquaMEND model for improved microbial metabolism representation. Results highlighted microsite redox variability as a key driver of GHG fluxes, informing Earth system models. The project fostered interdisciplinary collaborations, student training, and the development of novel modeling frameworks to improve Earth'senergy budget.

54 ENVIRONMENTAL SCIENCES↗

Scalable Data Center Capacity for DOE's AI Prototype: A Rapidly Available Gigawatt Data Center for DOE

The multilaboratory Gigawatt Data Center working group was commissioned to identify approaches to rapidly establish federal data centers with scalable capacities up to 1,000 MW. These state-of-the-art facilities will serve as hubs for interdisciplinary collaboration, industry partnerships, and transformative applications of artificial intelligence. The proposed strategic shift includes facilitating multilaboratory collaboration, prioritizing operational efficiency, expanding public–private partnerships, optimizing investments, ensuring long-term contractual flexibility, supporting open science and secure data enclaves, and exploiting high-speed national networks. Owing to their extensive experience and best practices, the US Department of Energy national laboratories are uniquely positioned to lead this initiative. We recommend conducting a feasibility analysis to rapidly identify the optimal sites for this initiative, and the effort will likely involve private industry for design, construction, financing, and operational integration. We also propose establishing multiple geographically diverse sites to ensure energy resilience, high operational reliability, and a diverse user base, thereby effectively addressing the nation’s critical needs.

42 ENGINEERING↗

Science of Scale-Up: Accelerating chemical manufacturing technology development workshop report

The Science of Scale-Up: Accelerating chemical manufacturing technology development workshop report outlines key insights and actionable recommendations for accelerating the scale-up of disruptive chemical manufacturing technologies. Convened in October 2024, the workshop brought together approximately fifty experts from academia, industry, national laboratories, and government agencies to address the barriers and solutions for maturing technologies from proof-of-concept to commercialization. The report identifies seven critical themes for enabling faster scale-up. These themes were explored through general discussions and breakout sessions focused on three specific chemical manufacturing technologies—electrochemical, thermochemical, and biological conversion processes. The findings emphasize the importance of interdisciplinary collaboration, robust funding mechanisms, and shared resources to overcome technical barriers and accelerate technology deployment. The report also highlights technology-specific challenges and opportunities, including the need for advanced materials, scalable manufacturing processes, and integrated testing environments. For electrochemical manufacturing processes, durability and material optimization are key priorities, while thermochemical processes require novel reactor designs and better supply chain integration. Biological conversion processes face hurdles in strain engineering, reactor design, and process integration. Across all technologies, the workshop emphasized the importance of leveraging computational tools, standardized protocols, and collaborative networks to address knowledge gaps and technical barriers. By acting on these insights, stakeholders can reduce the timeline for scaling up critical chemical manufacturing technologies, ensuring their timely impact on manufacturing competitiveness, and environmental sustainability.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Application of Quantum Machine Learning to High Energy Physics Analysis at LHC Using Quantum Computer Simulators and Quantum Computer Hardware

Machine learning enjoys widespread success in High Energy Physics (HEP) analyses at LHC. However the ambitious HL-LHC program will require much more computing resources in the next two decades. Quantum computing may offer speed-up for HEP physics analyses at HL-LHC, and can be a new computational paradigm for big data analyses in High Energy Physics.We have successfully employed three methods (1) Variational Quantum Classifier (VQC) method, (2) Quantum Support Vector Machine Kernel (QSVM-kernel) method and (3) Quantum Neural Network (QNN) method for two LHC flagship analyses: ttH (Higgs production in association with two top quarks) and H->mumu (Higgs decay to two muons, the second generation fermions). We shall address the progressive improvements in performance from method (1) to method (3).We will present our experiences and results of a study on LHC High Energy Physics data analyses with IBM Quantum Simulator and Quantum Hardware (using IBM Qiskit framework), Google Quantum Simulator (using Google Cirq framework), and Amazon Quantum Simulator (using Amazon Braket cloud service). The work is in the context of a Qubit platform (a gate-model quantum computer). Taking into account the present limitation of hardware access, different quantum machine learning methods are studied on simulators and the results are compared with classical machine learning methods (BDT, classical Support Vector Machine and classical Neural Network). Furthermore, we do apply quantum machine learning on IBM quantum hardware to compare performance between quantum simulator and quantum hardware. The work is performed by an international and interdisciplinary collaboration with the Department of Physics and Department of Computer Sciences of University of Wisconsin, CERN Quantum Technology Initiative, IBM Research Zurich, IBM T.J. Watson Research Center, Fermilab Quantum Institute, BNL Computational Science Initiative, State University of New York at Stony Brook, and Quantum Computing and AI Research of Amazon Web Services. This work pioneers a close collaboration of academic institutions with industrial corporations in the High Energy Physics analyses effort. Though the size of event samples in future HL-LHC physics and the limited number of qubits pose some challenges to the Quantum Machine learning studies for High Energy Physics, more advanced quantum computers with larger number of qubits, reduced noise and improved running time (as envisioned by IBM and Google) may outperform classical machine learning in both classification power and in speed.Although the era of efficient quantum computing may still be years away, we have made promising progress and obtained preliminary results in applying quantum machine learning to High Energy Physics. A PROOF OF PRINCIPLE.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Hydrological connectivity: a review and emerging strategies for integrating measurement, modeling, and management

This review synthesizes methods for measuring, modeling, and managing hydrologic connectivity, offering pathways to improve practices and address environmental challenges (e.g., climate change) and sustainability. As a key driver of water movement and nutrient cycling, hydrologic connectivity influences flood mitigation, water quality regulation, and biodiversity conservation. However, traditional field-based methods (e.g., dye tracing), indirect measurements (e.g., runoff analysis), and remote sensing techniques (e.g., InSAR) often struggle to capture the complexity of catchment-scale interactions. Similarly, modeling approaches—including process-based and percolation theory-based models, graph theory, and entropy-based metrics—face limitations in fully representing these interconnected processes. Both modeling and measurement techniques are constrained by inadequate spatial and temporal coverage, high data demands, computational complexity, and difficulties in representing subsurface connectivity. Subsequently, we critique current management practices that prioritize isolated variables (e.g., streamflow, sediment transport) over system-wide strategies and emphasize the need for adaptive, connectivity-based approaches in water resource planning and restoration. Moving forward, we highlight the importance of interdisciplinary collaboration, technological innovations (e.g., AI-driven modeling, real-time monitoring), and integrated frameworks to improve connectivity measurement, modeling, and adaptive management to restore fragmented hydrologic networks. This integrated approach sets the stage for transformative water resource management, fostering proactive policy development and stakeholder engagement.

Dwivedi, Dipankar↗

Pulsar’s Application in Energy Systems: Review of Current Status, Challenges, and Opportunities

To accelerate progress toward the realization of advanced energy systems, this review explores the potential of pulsar technology to create a more stable, economical, and environmentally friendly energy infrastructure. Pulsars, with their precise and reliable timing characteristics, have emerged as a promising tool for enhancing energy systems. This review begins by examining the development history of pulsar technology, shedding light on its evolution and the milestones achieved. It then provides a comprehensive summary of the current state of research, highlighting recent advancements and breakthroughs in this field. It also explores transformative pulsar applications in energy systems, including improved grid stability, advanced energy synchronization, and efficient energy storage management. However, implementing pulsar-related technologies presents significant technical, economic, and operational challenges. This review examines these hurdles and proposes strategies to overcome them, emphasizing the need for innovation, interdisciplinary collaboration, and supportive policies to fully integrate pulsar technologies into sustainable energy systems.

application↗

Wearable Technology and Its Influence on Motor Development and Biomechanical Analysis

The convergence among biomechanics, motor development, and wearable technology redefines our understanding of human movement. These technologies allow for the continuous monitoring of motor development and the state of motor abilities from infancy to old age, enabling early and personalized interventions to promote healthy motor skills. For athletes, they offer valuable insights to optimize technique and prevent injuries, while in old age, they help maintain mobility and prevent falls. Integration with artificial intelligence further extends these capabilities, enabling sophisticated data analysis. Wearable technology is transforming the way we approach motor development and maintenance of motor skills, offering unprecedented possibilities for improving health, performance, and quality of life at every stage of life. The promising future of these technologies paves the way for an era of more personalized and effective healthcare, driven by innovation and interdisciplinary collaboration.

Morouço, Pedro (ORCID:0000000259569790)↗

Changing Microbiomes: A Symposium Hosted by the Microbiome Center at the Pennsylvania State University

The first “Changing Microbiomes” conference was successfully held at the Pennsylvania State University from May 31st – June 3rd, 2022. The overall goal of the symposium was to provide space for researchers to connect, exchange knowledge, and partner to advance our understanding of the mechanisms and applications of ecological and evolutionary changes in microbiomes across systems. The symposium spanned terrestrial and aquatic contexts and host-associated and free-living microbial communities. As such, the symposium will enable cross-disciplinary knowledge and idea exchange to promote future interdisciplinary collaborations. In addition, the program allowed formal and informal interactions between and among students, postdocs, PIs, and industry scientists.

54 ENVIRONMENTAL SCIENCES↗

40th Eastern Regional Photosynthesis Conference

Photosynthesis has shaped global biochemistry and geochemistry in its production of almost all atmospheric oxygen, and almost every electron that supports the processes of life on Earth was extracted from water by the light-dependent reactions, many of which were then used to fix carbon in the dark reactions. To humans, that fixed carbon is the originator of all fossil fuels and a critical step in conversion of solar photons to human-usable energy. The Eastern Regional Photosynthesis Conference (ERPC) serves as a forum for advancement of science in this field. As a regional-level conference, it specializes in providing developmental opportunities for early-career researchers from undergraduates to pre-tenure professors, as well as broadening the field in terms of participating scholars and research approaches to produce new interdisciplinary collaborations. Funding from the Department of Energy is used to mitigate registration and attendance costs for junior (non-PI) researchers. The ERPC is one of the three regional conferences in the field of photosynthesis research in the United States, alongside the Western Photosynthesis Conference (currently in California) and the Midwestern Photosynthesis Conference (Turkey Run, Indiana). A longstanding incubator for scientific discourse, discovery, and collaborations, this conference has spawned many collaborations which led to Department of Energy-funded projects and brought two full generations of scientists into the field. In 2023 the landmark 40th such conference was held at the Woods Hole Marine Biological Laboratory in Massachusetts. The conference was held April 14th-16th, 2023. The majority of the total attendees are traditionally undergraduates, graduate students, and postdoctoral researchers, whose scientific development greatly benefits from conferences like these. Almost all talks besides the ones given by invited speakers were given by young scientists who benefited from this award. Many posters presented at this conference were also the work of junior scientists. This conference is many young scientists' first exposure to the photosynthesis research community and its primary goal is to provide a positive atmosphere for those attendees, as exemplified by the three poster sessions and dedicated interactions between senior and junior scientists. Additionally, this was the first year of a successful equitable outreach and speaker recruitment plan to provide fair representation at the conference in line with Department of Energy policies and mission. The central focus of the ERPC is the understanding of energy flow from photons to usable chemical products in both natural and artificial photosynthesis. We support the DOE-BES aim of understanding of the biochemical/biophysical processes of photosynthesis to inform new technology development and field applications. This year’s theme, “Photosynthesis Across Scales,” reflected the scope of work being done from the individual exciton to the crop scale. This research encompasses applied biology, chemistry, physics, and materials engineering. The aim of this conference is to present new discoveries, techniques, and questions which can be sourced from any of these disciplines and provide an audience which is broadly qualified to use or respond to these developments.

08 HYDROGEN↗

Expanding Collaborative Capacity to Address Climate Resiliency in the Great Lakes Region

U.S. Department of Energy (DOE), Office of Science, Award DE-SC0023215, Expanding Collaborative Capacity to Address Climate Resiliency in the Great Lakes Region, supported capacity and partnership building between researchers at Central Michigan University (CMU) and scientists at DOE laboratories. The work involved identifying potential collaborations both internal to CMU and between CMU researchers and DOE staff, developing collaborative research proposals, and partnering on pilot-scale research projects focused on enhancing resilience of Great Lakes communities, ecosystems, and infrastructure to global change and environmental stressors. DOE funds supported travel, time to develop collaborations, investigate new research pathways, and draft grant proposals, and a loan of DOE equipment to collect pilot data in support of future work. The project achieved its goal of strengthening research collaborations between interdisciplinary researchers at CMU and establishing new collaborations and partnerships between CMU and DOE scientists. These collaborations resulted in 5 pre-applications and 4 full applications for funding to DOE BER Funding Opportunities, a successfully funded DOE BER award (DE-SC0025260), a new pilot project that leveraged DOE resources (AquaBOT) to improve understanding of water quality conditions in Michigan rivers, and two presentations of preliminary results at national scientific conferences. This project’s outcomes will benefit the Great Lakes Region via new lines of collaborative research focused on improving the resilience of Michigan communities, ecosystems, and infrastructure.

58 GEOSCIENCES↗

The Astronomy Commons Platform: A Deployable Cloud-based Analysis Platform for Astronomy

Abstract We present a scalable, cloud-based science platform solution designed to enable next-to-the-data analyses of terabyte-scale astronomical tabular data sets. The presented platform is built on Amazon Web Services (over Kubernetes and S3 abstraction layers), utilizes Apache Spark and the Astronomy eXtensions for Spark for parallel data analysis and manipulation, and provides the familiar JupyterHub web-accessible front end for user access. We outline the architecture of the analysis platform, provide implementation details and rationale for (and against) technology choices, verify scalability through strong and weak scaling tests, and demonstrate usability through an example science analysis of data from the Zwicky Transient Facility’s 1Bn+ light-curve catalog. Furthermore, we show how this system enables an end user to iteratively build analyses (in Python) that transparently scale processing with no need for end-user interaction. The system is designed to be deployable by astronomers with moderate cloud engineering knowledge, or (ideally) IT groups. Over the past 3 yr, it has been utilized to build science platforms for the DiRAC Institute, the ZTF partnership, the LSST Solar System Science Collaboration, and the LSST Interdisciplinary Network for Collaboration and Computing, as well as for numerous short-term events (with over 100 simultaneous users). In a live demo instance, the deployment scripts, source code, and cost calculators are accessible. 4 4 http://hub.astronomycommons.org/

79 ASTRONOMY AND ASTROPHYSICS↗