Skip to content

[Refactor] implement the guidellm.mock_server package #341

@markurtz

Description

@markurtz

Add a new mock_server for testing and performance validations of the GuideLLM system with a Sanic server that mocks the common OpenAI/vLLM routes

Metadata

Metadata

Assignees

Labels

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions