Search results

OpenAI streaming TTFT silently lost when going through axum-based routers (e.g. blitz-router): strict 'data: ' prefix + role-chunk over-counting

Status: Open.

#26 In blitz-serving/request-sim;

· Healthcliff-Ding opened on May 8, 2026

feat: enhanced feedback loop with AIMD controller and real-time metrics

Status: Open.

#19 In blitz-serving/request-sim;

· Healthcliff-Ding opened on Mar 26, 2026

feat: introduce three request modes — trace-replay, random-process, feedback

Status: Open.

#17 In blitz-serving/request-sim;

· Healthcliff-Ding opened on Mar 25, 2026

feat: in-memory tmpfs to break through request throughput bottleneck

Status: Open.

#15 In blitz-serving/request-sim;

· Healthcliff-Ding opened on Mar 17, 2026

[Rel-w-Debug] Run an offline testing to validate no time drift in request generation, leaving an Release-with-Debug branch

bugSomething isn't workingSomething isn't working

enhancementNew feature or requestNew feature or request

Status: Open.

Feature

#14 In blitz-serving/request-sim;

· Healthcliff-Ding opened on Oct 27, 2025

client.rs line166 panic when pending queue is too large

Status: Open.

#6 In blitz-serving/request-sim;

· Chasingdreams6 opened on Aug 15, 2024

send error when the reqeust rate is 90

bugSomething isn't workingSomething isn't working

Status: Open.

#3 In blitz-serving/request-sim;

· Chasingdreams6 opened on Aug 14, 2024

Support real timestamp BurstGPT & MoonCake trace replay

enhancementNew feature or requestNew feature or request

Status: Open.

#2 In blitz-serving/request-sim;

· Healthcliff-Ding opened on Aug 14, 2024

Mismatch about Distserve's LLama7b tokenizer and request-sim's tokenizer

questionFurther information is requestedFurther information is requested

Status: Open.

#1 In blitz-serving/request-sim;

· Chasingdreams6 opened on Aug 14, 2024