[draft] Add foundation for llm rest endpoint tests

[draft] Add foundation for llm rest endpoint tests #388