Added BLOOM-560M Language Model Template

[Vijaykv5]

Template 1 - BLOOM Language Model

This template deploys the BLOOM-560M language model using vLLM, providing powerful multilingual text generation and understanding capabilities through an OpenAI-compatible API.

JOB URL: https://dashboard.nosana.com/jobs/DyusTt6LbS43t1n9bH4j34GuChsGmP6Y9wXnmXHd3Pps

Features

• High-performance 560M parameter multilingual LLM
• Optimized for efficiency on smaller GPUs (16GB VRAM)
• OpenAI-compatible API via vLLM serving
• Strong multilingual capabilities (supports 46 languages)
• Excellent performance on reasoning and instruction following tasks
• Low-latency inference

Configuration

• Port: 9000
• GPU: Required (minimum 16GB VRAM)
• Default Model: bigscience/bloom-560m