Update README.md

This commit is contained in:
remsky 2025-01-08 04:40:43 -07:00 committed by GitHub
parent e7ffcf49f5
commit 0bd4eb3e9b
No known key found for this signature in database
GPG key ID: B5690EEEBB952194

View file

@ -229,8 +229,9 @@ for chunk in response.iter_content(chunk_size=1024):
Key Streaming Metrics:
- First token latency @ chunksize
- ~300ms (GPU) @ 400
- ~3500ms (CPU) @ 200
- ~300ms (GPU) @ 400
- ~3500ms (CPU) @ 200 (older i7)
- ~<1s (CPU) @ 200 (M3 Pro)
- Adjustable chunking settings for real-time playback
*Note: Artifacts in intonation can increase with smaller chunks*