Skip to content

for embeddibg model does hugginface model support #1909

@anshulpwappgo

Description

@anshulpwappgo

in config.yaml

type: embedder
provider: litellm_embedder
models:
  # We are now using the direct Hugging Face provider via LiteLLM.
  - model: huggingface/sentence-transformers/all-MiniLM-L6-v2
    alias: default
    api_key: ${HF_TOKEN}
    timeout: 600

i got the error of unauthorization 401

and in docker-compose.yaml:

  wren-ai-service:
    image: ghcr.io/canner/wren-ai-service:${WREN_AI_SERVICE_VERSION}
    restart: on-failure
    platform: ${PLATFORM}
    expose:
      - ${WREN_AI_SERVICE_PORT}
    ports:
      - ${AI_SERVICE_FORWARD_PORT}:${WREN_AI_SERVICE_PORT}
    # We now manually list every variable EXCEPT HF_TOKEN to prevent the startup crash.
    environment:
      PYTHONUNBUFFERED: 1
      CONFIG_PATH: /app/config.yaml
      GROQ_API_KEY: ${GROQ_API_KEY}
      LANGFUSE_SECRET_KEY: ${LANGFUSE_SECRET_KEY}
      LANGFUSE_PUBLIC_KEY: ${LANGFUSE_PUBLIC_KEY}
      # Notice HF_TOKEN is MISSING from this list.
    # We REMOVED the env_file directive.
    volumes:
      - ${PROJECT_DIR}/config.yaml:/app/config.yaml:ro
      - ${PROJECT_DIR}/data:/app/data:ro
    networks:
      - wren
    depends_on:
      - qdrant

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions