LLM server coverage by agent exported as microservices #244
Description
Checklist
- I have searched the existing issues for similar feature requests.
- I added a descriptive title and summary to this issue.
Summary
Templates export for SpringAI (OpenAI API compliant/MCP) and LangChain(MCP) support is limited to OpenAI or OLLAMA LLM server providers.
For on-premises deployment at scale, OpenAI-Compat API, as well as HuggingFaceEndpointEmbeddings and and CompatOpenAIEmbeddings API should be supported to have an vLLM/TEI/TGI production deployment.
Why?
No response
How?
No response
Additional Context
No response