MindIE SD

MindIE SD is an Ascend-focused inference acceleration toolkit for Stable Diffusion and related multimodal generation workloads. It provides Ascend-oriented fused operators, compilation paths, caching strategies, quantization features, and multi-card execution capabilities for production-oriented inference workflows.

Getting Started

• Quick Start
  • Prerequisites
  • Run inference
  • Acceleration results
• Installation Guide
  • Option 1: Container image installation
  • Option 2: Bare-metal installation
• Architecture
  • Design goals
  • Core capabilities
  • High-level structure
• Environment Variable Configuration

Feature Guides

• Cache-Based Acceleration Features
  • DiTCache
  • AttentionCache
  • Timestep optimization
• Compilation Features
  • Overview
  • Usage
  • Support matrix
  • Troubleshooting tips
• Dynamic EPLB Acceleration
  • DyEPLB
  • Class initialization and interface reference
• Graphics Memory Optimization Features
  • Tensor Parallel
  • Memory sharing
  • Asynchronous offload
  • Quantization
• Compute Optimization Features
  • CV Parallel
  • Multi-instance
  • CFG fusion
  • Operator fusion
• Multi-Card Parallel Acceleration Features
  • Tensor Parallel
  • Ring Sequence Parallel
  • Ulysses Sequence Parallel
  • CFG Parallel
• Lightweight Algorithm Acceleration Features
  • Linear Quantization
  • FA sparsity
• Model and Framework Support Matrix
  • Model support
  • vLLM Omni features and model performance
  • Cache DiT + diffusers features and model performance
  • Modelers community feature combinations and model performance

Developer Docs

• Build Guide
  • Overview
  • Environment Preparation
  • Image-Based Installation
  • Container or Bare-Metal Installation
  • Build and Install
  • Upgrade
  • Uninstall
• Test Guide
  • CPU-Friendly Unit Tests
  • Full Test Entry
  • LA Operator Accuracy Test
  • Common Exceptions
• Developer Tooling and Docs
  • Documentation Build
  • Development Image Build
  • Lint and Pre-Commit Checks

Appendix

• Environment Variables
• File and Directory Permission Requirements

Community

• Governance