Swift Package Index

Packages for keyword “inference”

These packages are available as a package collection, usable in Xcode or SwiftPM.

• argmax-oss-swift

  On-device Speech AI for Apple Silicon

  • argmaxinc/argmax-oss-swift
  • Active 6 days ago
  • 6,455 stars

• DesertAnt

  On-device AI SDKs for iOS, macOS, Android, and the web. Small, focused models that run fully offline in Swift, Kotlin, and JavaScript with Core ML, LiteRT, and WebAssembly.

  • Desert-Ant-Labs/desert-ant-core
  • Active 9 days ago
  • 453 stars

• alpaca.swift

  Swift-native LLM inference engine for Apple Silicon

  • torinriley/alpaca
  • Active 4 days ago
  • 22 stars

• KVCacheEstimator

  Size an LLM's KV cache from its config.json (Swift): GQA-aware, head_dim-aware, fp16/fp8/int4

  • ml0x-com/KVCacheEstimator
  • Active 19 days ago
  • 0 stars

• swift-llama

  Run LLMs natively in Swift. Actor-safe. Streaming. Tool-calling. Metal-accelerated.

  • profclaw/swift-llama
  • Active 7 months ago
  • 2 stars

5 packages.