Ghidra 101
Ghidra 101 is a collection of tutorials and example programs given to summer interns, intended as an initial introduction to using Ghidra and reverse engineering binaries.
Mast, RyanA [Lawrence Livermore National Laborator↗
SEARCH · Engineering Papers
Results for “tutorial”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
BoBa
BoBa is a C++ software library for working with large matrices, tensors, and tensor decompositions. The library provides tools for dense matrix and tensor operations, tensor decompositions, and tensor decomposition methods that support modern CPU and GPU architectures. It includes portable abstractions for linear algebra, tensor algebra, and multidimensional computation. BoBa is intended for scientific computing applications that involve large multidimensional data sets or high dimensional mathematical models. Its capabilities support tasks such as data compression, linear algebra, efficient numerical computation, and the development of scalable algorithms for heterogeneous hardware. Tutorials, tests, and example applications are included to help users learn and apply the library.
Yao, Jin [Lawrence Livermore National Laboratory (↗
Coupling of the Liquid Sampling–Atmospheric Pressure Glow Discharge to Orbitrap Mass Analyzers for Uranium Isotope Ratio Analysis: Evolution of the Methodology and Implications to the Field
Just over a decade ago, a truly outside-of-the-box approach to isotope ratio mass spectrometry (IRMS) was undertaken between research groups at Clemson University and the Pacific Northwest National Laboratory. The original motivation dealt with projections as to whether or not microplasmas could be developed into practical elemental ionization sources, perhaps for transportable analysis applications. In particular, the use of the liquid sampling–atmospheric pressure glow discharge (LS-APGD) was pursued. Its interfacing to an ultra-high resolution Orbitrap platform, proved not only facile, but opened up a wealth of potential applications. Here, we lay out a historical, tutorial description of the interfacing and the evolution of the methodology regarding IRMS of uranium. Practical challenges and opportunities are described, which hopefully provide guidance to further applications in high resolution IRMS. It is hoped that, while detailed and lengthy, the didactic nature of the presentation provides experimental insights and tips, and also serves as an homage to our very good friend, Professor Gary M. Hieftje, whose scientific inspiration and comradery have been immeasurably important in our own careers.
Koppenaal, David W.↗
BinaRena: a dedicated interactive platform for human-guided exploration and binning of metagenomes
Background: Exploring metagenomic contigs and “binning” them into metagenome-assembled genomes (MAGs) are essential for the delineation of functional and evolutionary guilds within microbial communities. Despite the advances in automated binning algorithms, their capabilities in recovering MAGs with accuracy and biological relevance are so far limited. Researchers often find that human involvement is necessary to achieve representative binning results. This manual process however is expertise demanding and labor intensive, and it deserves to be supported by software infrastructure. Results: We present BinaRena, a comprehensive and versatile graphic interface dedicated to aiding human operators to explore metagenome assemblies via customizable visualization and to associate contigs with bins. Contigs are rendered as an interactive scatter plot based on various data types, including sequence metrics, coverage profiles, taxonomic assignments, and functional annotations. Various contig-level operations are permitted, such as selection, masking, highlighting, focusing, and searching. Binning plans can be conveniently edited, inspected, and compared visually or using metrics including silhouette coefficient and adjusted Rand index. Completeness and contamination of user-selected contigs can be calculated in real time. In demonstration of BinaRena’s usability, we show that it facilitated biological pattern discovery, hypothesis generation, and bin refinement in a complex tropical peatland metagenome. It enabled isolation of pathogenic genomes within closely related populations from the gut microbiota of diarrheal human subjects. It significantly improved overall binning quality after curating results of automated binners using a simulated marine dataset. Conclusions: BinaRena is an installation-free, dependency-free, client-end web application that operates directly in any modern web browser, facilitating ease of deployment and accessibility for researchers of all skill levels. The program is hosted at https://github.com/qiyunlab/binarena, together with documentation, tutorials, example data, and a live demo. It effectively supports human researchers in intuitive interpretation and fine tuning of metagenomic data.
59 BASIC BIOLOGICAL SCIENCES↗
Deep data analysis via physically constrained linear unmixing: universal framework, domain examples, and a community-wide platform
Abstract Many spectral responses in materials science, physics, and chemistry experiments can be characterized as resulting from the superposition of a number of more basic individual spectra. In this context, unmixing is defined as the problem of determining the individual spectra, given measurements of multiple spectra that are spatially resolved across samples, as well as the determination of the corresponding abundance maps indicating the local weighting of each individual spectrum. Matrix factorization is a popular linear unmixing technique that considers that the mixture model between the individual spectra and the spatial maps is linear. Here, we present a tutorial paper targeted at domain scientists to introduce linear unmixing techniques, to facilitate greater understanding of spectroscopic imaging data. We detail a matrix factorization framework that can incorporate different domain information through various parameters of the matrix factorization method. We demonstrate many domain-specific examples to explain the expressivity of the matrix factorization framework and show how the appropriate use of domain-specific constraints such as non-negativity and sum-to-one abundance result in physically meaningful spectral decompositions that are more readily interpretable. Our aim is not only to explain the off-the-shelf available tools, but to add additional constraints when ready-made algorithms are unavailable for the task. All examples use the scalable open source implementation from https://github.com/ramkikannan/nmflibrary that can run from small laptops to supercomputers, creating a user-wide platform for rapid dissemination and adoption across scientific disciplines.
47 OTHER INSTRUMENTATION↗
Storage and Read-Optimized Data Placement Structures for High-Performance Analysis [Book Chapter]
Here, we present state-of-art structures and methods for efficient data preparation and representation for analysis. Our intent is to introduce the data science and analytics communities to open source data placements, structures, and methods. These practices can make the foundational processes of data preparation and access dramatically more efficient than typical raw file or database representations and use more conservative storage. To illustrate this, we introduce two highly efficient data placement structures. We then present a tutorial, supported by step-by-step examples, of how to create, use, and access data, structured by Parquet or ORC (Optimized Row Columnar), using Apache Spark. Finally, we illustrate the benefits of using these structures with computational and storage volume benchmarks.
97 MATHEMATICS AND COMPUTING↗
The Virtual Test Bed (VTB) repository: a library of multiphysics reference reactor models using NEAMS tools
With the next generation of nuclear reactors under development, modeling and simulation (MS) tools are being developed by the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program in order to support their design, licensing, and future operation. Mirroring the physical test beds currently under construction (i.e., EBR-II and ZPPR), the Virtual Test Bed (VTB) was launched by the National Reactor Innovation Center (NRIC) in collaboration with NEAMS to support the advanced reactor community. This collaborative effort, which involves multiple teams at both Idaho National Laboratory and Argonne National Laboratory aims to use NEAMS tools to model a wide range of reactor designs. Those models are automatically tested to ensure their continued functionality as the tools are further developed. Examples are extensively documented, each acting as a tutorial for applying the relevant NEAMS tools to that reactor design. Currently, five advanced reactor types (with a total of eight specific design variants) are simulated by a variety of different models. These models range from steady-state, core multiphysics simulations to integrated plant analysis during loss-of flow transients. (authors)
21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
A method for achieving complete microbial genomes and improving bins from metagenomics data
Metagenomics facilitates the study of the genetic information from uncultured microbes and complex microbial communities. Assembling complete genomes from metagenomics data is difficult because most samples have high organismal complexity and strain diversity. Some studies have attempted to extract complete bacterial, archaeal, and viral genomes and often focus on species with circular genomes so they can help confirm completeness with circularity. However, less than 100 circularized bacterial and archaeal genomes have been assembled and published from metagenomics data despite the thousands of datasets that are available. Circularized genomes are important for (1) building a reference collection as scaffolds for future assemblies, (2) providing complete gene content of a genome, (3) confirming little or no contamination of a genome, (4) studying the genomic context and synteny of genes, and (5) linking protein coding genes to ribosomal RNA genes to aid metabolic inference in 16S rRNA gene sequencing studies. We developed a semi-automated method called Jorg to help circularize small bacterial, archaeal, and viral genomes using iterative assembly, binning, and read mapping. In addition, this method exposes potential misassemblies from k-mer based assemblies. We chose species of the Candidate Phyla Radiation (CPR) to focus our initial efforts because they have small genomes and are only known to have one ribosomal RNA operon. In addition to 34 circular CPR genomes, we present one circular Margulisbacteria genome, one circular Chloroflexi genome, and two circular megaphage genomes from 19 public and published datasets. We demonstrate findings that would likely be difficult without circularizing genomes, including that ribosomal genes are likely not operonic in the majority of CPR, and that some CPR harbor diverged forms of RNase P RNA. Code and a tutorial for this method is available at https://github.com/lmlui/Jorg and is available on the DOE Systems Biology KnowledgeBase as a beta app.
59 BASIC BIOLOGICAL SCIENCES↗
Phenopacket-tools: Building and validating GA4GH Phenopackets
The Global Alliance for Genomics and Health (GA4GH) is a standards-setting organization that is developing a suite of coordinated standards for genomics. The GA4GH Phenopacket Schema is a standard for sharing disease and phenotype information that characterizes an individual person or biosample. The Phenopacket Schema is flexible and can represent clinical data for any kind of human disease including rare disease, complex disease, and cancer. It also allows consortia or databases to apply additional constraints to ensure uniform data collection for specific goals. We present phenopacket-tools, an open-source Java library and command-line application for construction, conversion, and validation of phenopackets. Phenopacket-tools simplifies construction of phenopackets by providing concise builders, programmatic shortcuts, and predefined building blocks (ontology classes) for concepts such as anatomical organs, age of onset, biospecimen type, and clinical modifiers. Phenopacket-tools can be used to validate the syntax and semantics of phenopackets as well as to assess adherence to additional user-defined requirements. The documentation includes examples showing how to use the Java library and the command-line tool to create and validate phenopackets. We demonstrate how to create, convert, and validate phenopackets using the library or the command-line application. Source code, API documentation, comprehensive user guide and a tutorial can be found at https://github.com/phenopackets/phenopacket-tools. The library can be installed from the public Maven Central artifact repository and the application is available as a standalone archive. The phenopacket-tools library helps developers implement and standardize the collection and exchange of phenotypic and other clinical data for use in phenotype-driven genomic diagnostics, translational research, and precision medicine applications.
59 BASIC BIOLOGICAL SCIENCES↗
Building high throughput permissioned blockchain fabrics: challenges and opportunities
Since the introduction of Bitcoin---the first widespread application driven by blockchains---the interest in the design of blockchain-based applications has increased tremendously. At the core of these applications are consensus protocols that securely replicate client requests among all replicas, even if some replicas are Byzantine faulty. Unfortunately, these consensus protocols typically have low throughput, and this lack of performance is often cited as the reason for the slow wider adoption of blockchain technology. Consequently, many works focus on designing more efficient consensus protocols to increase throughput of consensus. We believe that this focus on consensus protocols only explains part of the story. To investigate this belief, we raise a simple question: Can a well-crafted system using a classical consensus protocol outperform systems using modern protocols? In this tutorial, we answer this question by diving deep into the design of blockchain systems. Further, we take an in-depth look at the theory behind consensus, which can help users select the protocol that best-fits their requirements. Finally, we share our vision of high-throughput blockchain systems that operate at large scales.
97 MATHEMATICS AND COMPUTING↗
Comminty Geothermal: Planning and Design of a Heating and Cooling System in Framingham, Massachusetts
These reports, plans, and drawings review the achievements of Home Energy Efficiency Team (HEET) and its partners to plan and design a network of interconnected ground-source heat pump systems, or geothermal network, in an area encompassing multiple environmental justice (EJ) neighborhoods in the City of Framingham, MA. The materials provided in this dataset include, a) stakeholder and design best practices, b) study on optimal method to interconnect geothermal loops, c) guidelines for monitoring and metering, d) operations and maintenance plans, e) permitting guidelines and f) 10-day driller tutorial curriculum. These materials can guide the efficient and ethical design of future geothermal networks nationwide. The capacity of the system is estimated at 217 tons and is designed to provide 100% of heating and cooling needs for the buildings connected to the loop. In this project, 80 boreholes are used as the main thermal resources, the distribution system (or loop) consists of 0.61 miles of an 8-inch single-pipe at ambient temperature, with the capacity to connect 44 buildings, including 13 apartment buildings from the Framingham Housing Authority, one transitional home, one school building and 29 single family homes. While Framingham already has a geothermal network loop that is currently in the commissioning stage, our proposed project is unique because it is the first utility-led expansion loop (2nd loop) project that will connect to an adjacent existing geothermal loop (1st loop) in a pre-existing neighborhood. Both the 1st and 2nd loops are being installed, owned and operated by Eversource Energy, the utility Deployment Partner.
15 GEOTHERMAL ENERGY↗
Wave Energy Converter SIMulator (WEC-SIM) Support for an Adaptive Wave Energy Converter by Ocean Motion Technologies
Scripts from project git repo + tutorial slide deck generated for the TEAMER RFTS 1 collaborative project between Ocean Motion Technologies, Inc. and Sandia National Laboratories + National Renewable Energy Laboratory. The project simulates an adaptive wave energy converter through CAD, FEA, and analysis code. All materials in this submission are considered proprietary subject to terms and conditions detailed in the CRADA Agreement.
16 TIDAL AND WAVE POWER↗
Atomic-precision advanced manufacturing for Si quantum computing
Abstract A materials synthesis method that we call atomic-precision advanced manufacturing (APAM), which is the only known route to tailor silicon nanoelectronics with full 3D atomic precision, is making an impact as a powerful prototyping tool for quantum computing. Quantum computing schemes using atomic ( 31 P) spin qubits are compelling for future scale-up owing to long dephasing times, one- and two-qubit gates nearing high-fidelity thresholds for fault-tolerant quantum error correction, and emerging routes to manufacturing via proven Si foundry techniques. Multiqubit devices are challenging to fabricate by conventional means owing to tight interqubit pitches forced by short-range spin interactions, and APAM offers the required (Å-scale) precision to systematically investigate solutions. However, applying APAM to fabricate circuitry with increasing numbers of qubits will require significant technique development. Here, we provide a tutorial on APAM techniques and materials and highlight its impacts in quantum computing research. Finally, we describe challenges on the path to multiqubit architectures and opportunities for APAM technique development. Graphic Abstract
36 MATERIALS SCIENCE↗
Offshore CO2 Saline Storage Calculator
The Offshore CO2 Saline Storage Calculator is a data-driven tool that applies the adapted DOE CO2 Methodology to calculate all potential distributions of offshore storage efficiency and resource potential at multiple spatial scales for saline formations. The tailored methodology include accounting for changing CO2 density with the overlying water column and sediment differences in unlithified, porous, and permeable offshore saline formations. The latest release of the tool and a tutorial are available in the tools public GitHub repository. We recommend testing out this application using data from the Petrophysical Well Log Interpretation Dataset, which spans the northern Gulf of Mexico and is available on EDX here: https://edx.netl.doe.gov/dataset/petrophysical-well-log-interpretation-dataset
calculator↗
IDAES-PSE 2.3.0 Release
The Institute for the Design of Advanced Energy Systems (IDAES) Integrated Platform is a versatile computational environment offering extensive process systems engineering (PSE) capabilities for optimizing the design and operation of complex, interacting technologies and systems. IDAES enables users to efficiently search vast, complex design spaces to discover the lowest cost, most environmentally sustainable solutions while supporting the full process modeling lifecycle, from conceptual design to dynamic optimization and control. The extensible, open platform empowers users to create models of novel processes and rapidly develop custom analyses, workflows, and end-user applications.. New Features and Models • New diagnostics toolboxes and examples o Tutorial for using the DiagnosticsToolbox o Methods to identify potential evaluation errors in models o SVDToolbox for performing singular value decomposition analysis on models to identify possible degeneracies and poor scaling o DegeneracyHunter for identifying irreducible degenerate sets in models • Model for solid-liquid separation which takes two inputs (solid and liquid streams) and produces three outlets (solids, liquid entrained with solids and pure liquid) • Example of temperature swing adsorption in models_extra Deprecation Warnings • With the update to Pyomo 6.7.0, the plate heat exchanger model has begun failing tests on some CI platforms. If this is not addressed by the February release, this model may be removed due to failing tests. See #1294. Offers to help identify the cause and fix this issue are welcome. Improvements and bug fixes • Fixed oversight which precluded using Mixer and Separator models when inherent reactions were present in property package • Added reporting methods to the MSContactor model • Minor corrections in some examples where values were being fixed outside of declared variable bounds
DiagnosticsToolbox,IDAES,PSE,Process Systems Engin↗
CCSI Toolset 3.18 Release
CCSI Toolset 3.18 Release Highlights FOQUS was updated to allow installation for users using MacOS on Apple silicon. FOQUS Cloud support was added for user plugins. The Optimality-Based Design of Experiments tutorials were updated to reflect the latest changes in the user interface flow. The plot discrete sliders were fixed for CDF and 3D plots within Uncertainty Quantification, which were not working due to a matplotlib depreciation. The installation was updated to set the default location for the PSUADE executable if found in the environment. Updates were made to allow compatibility with NumPy 1.25. Additional documentation changes were made to fix typographical errors and fix a broken link to optional software.
AS↗
easyaccess: Enhanced SQL command line interpreter for astronomical surveys
easyaccess is an enhanced command line interpreter and Python package created to facilitate access to astronomical catalogs stored in SQL Databases. It provides a custom interface with custom commands and was specifically designed to access data from the Dark Energy Survey Oracle database, including autocompletion of tables, columns, users and commands, simple ways to upload and download tables using csv, fits and HDF5 formats, iterators, search and description of tables among others. It can easily be extended to another surveys or SQL databases. The package was completely written in Python and support customized addition of commands and functionalities. Visit https://github.com/mgckind/easyaccess to view installation instructions, tutorials, and the Python source code for easyaccess.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
Performance Refactoring of Instrumentation, Measurement, and Analysis Technologies for Petascale Computing. The PRIMA Project
The growing number of cores provided by today’s high-end computing systems present substantial challenges to application developers in their pursuit of parallel efficiency. To find the most effective optimization strategy, application developers need insight into the runtime behavior of their code. The University of Oregon (UO) and the Juelich Supercomputing Centre of Forschungszentrum Juelich (FZJ) develop the performance analysis tools TAU and Scalasca, respectively, which allow high-performance computing (HPC) users to collect and analyze relevant performance data – even at very large scales. TAU and Scalasca are considered among the most advanced parallel performance systems available, and are used extensively across HPC centers in the U.S., Germany, and around the world. The TAU and Scalasca groups share a heritage of parallel performance tool research and partnership throughout the past fifteen years. Indeed, the close interactions of the two groups resulted in a cross-fertilization of tool ideas and technologies that pushed TAU and Scalasca to what they are today. It also produced two performance systems with an increasing degree of functional overlap. While each tool has its specific analysis focus, the tools were implementing measurement infrastructures that were substantially similar. Because each tool provides complementary performance analysis, sharing of measurement results is valuable to provide the user with more facets to understand performance behavior. However, each measurement system was producing performance data in different formats, requiring data interoperability tools to be created. A common measurement and instrumentation system was needed to more closely integrate TAU and Scalasca and to avoid the duplication of development and maintenance effort. The PRIMA (Performance Refactoring of Instrumentation, Measurement, and Analysis) project was proposed over three years ago as a joint international effort between UO and FZJ to accomplish these objectives: (1) refactor TAU and Scalasca performance system components for core code sharing and (2) integrate TAU and Scalasca functionality through data interfaces, formats, and utilities. As presented in this report, the project has completed these goals. In addition to shared technical advances, the groups have worked to engage with users through application performance engineering and tools training. In this regard, the project benefits from the close interactions the teams have with national laboratories in the United States and Germany. We have also sought to enhance our interactions through joint tutorials and outreach. UO has become a member of the Virtual Institute of High-Productivity Supercomputing (VI-HPS) established by the Helmholtz Association of German Research Centres as a center of excellence, focusing on HPC tools for diagnosing programming errors and optimizing performance. UO and FZJ have conducted several VI-HPS training activities together within the past three years.
97 MATHEMATICS AND COMPUTING↗