ModelRouter

mirror of https://gitcode.com/JianFeeeee/ModelRouter.git synced 2026-09-20 00:48:00 +00:00

Files

JianFeeeee 690f55c6f1 feat: proactive rate limiting (RPM) + 429 short cooldown for sources

- config.go: Source add RPM field (requests-per-minute cap, 0=unlimited)
- provider.go: RecordRateLimit() — 429 uses fixed 30s cooldown, not exponential
- provider.go: Throttle() — token-bucket proactive rate limiter, spaces requests
  at 60s/RPM interval, respects context cancellation
- provider.go: ReportStatus() — 429 -> RecordRateLimit, 5xx -> RecordFailure
- provider.go: Chat/ChatStream — wire Throttle after TryAcquire
- api.go: sourcePayload + RPM, buildSource passes RPM through
- ui/index.html: add RPM input field in source editor, bilingual i18n labels
- deploy.sh: backup old binary + rollback on healthcheck failure
- provider_test.go: TestModelStateRateLimitShortCooldown, TestThrottleSpacingAndCancel
- config.yaml: sensenova rpm: 12

2026-08-24 02:00:25 +08:00

feat: proactive rate limiting (RPM) + 429 short cooldown for sources

2026-08-24 02:00:25 +08:00

api.go

feat: proactive rate limiting (RPM) + 429 short cooldown for sources

2026-08-24 02:00:25 +08:00

chat.go

fix(gateway): pass through upstream token usage in streams for all adapters

2026-08-18 23:24:01 +08:00

gateway_test.go

feat: config.yaml only, OpenRouter free models, remove runtime.json config

2026-08-13 10:18:19 +08:00