Welcome to LLMariner Documentation!

Transform your GPU clusters into a powerhouse for generative AI workloads

Do you want an API compatible with OpenAI to leverage the extensive GenAI ecosystem? If so, LLMariner is what you need. It instantly builds a software stack that provides an OpenAI-compatible API for inference, fine-tuning, and model management. Please see the presentation below to learn more:


Overview

A high-level introduction to LLMariner.

Getting Started

Get LLMariner running based on your resources and needs.

Features

LLMariner features

Integration

Integrate with other projects

Development

Documents related to development

Last modified October 28, 2024: docs: add overview pages (#49) (7f356f6)