Tag

Regex vs On-Device LLM for PII Detection: A 25-Case Benchmark

A comprehensive benchmark comparing regex pattern matching against Apple's on-device Foundation Models for PII detection — 52% F1 vs 100% F1, and why binary classification beats extraction.

On-Device vs Cloud LLM: A Practical Benchmark

Benchmarking Apple's on-device Foundation Models against cloud LLMs across commit message generation, code review, and text classification — latency, quality, cost, and privacy tradeoffs.