LM Studio OpenAI API Proxy

📋 What is LM Studio?

LM Studio is a desktop application that enables you to run large language models locally on your computer. Beyond its chat interface, LM Studio includes a built-in local server that exposes an OpenAI-compatible API, making it an excellent choice for developers who want to prototype, test, and develop AI applications without incurring cloud API costs or sharing data externally.

The application supports a wide variety of open-source models from Hugging Face, including Llama, Mistral, Phi, Gemma, and many others. Its user-friendly interface makes model downloading, configuration, and deployment accessible even to developers without deep ML expertise, while the OpenAI-compatible server enables seamless integration with existing codebases.

⚙️ Setup Guide

🔧 Server Configuration

# Configure OpenAI SDK for LM Studio
from openai import OpenAI

# Initialize client pointing to LM Studio
client = OpenAI(
    base_url="http://localhost:1234/v1",
    api_key="lm-studio"  # Any string works
)

# Test the connection
def test_connection():
    try:
        models = client.models.list()
        print("Available models:")
        for model in models.data:
            print(f"  - {model.id}")
        return True
    except Exception as e:
        print(f"Connection failed: {e}")
        return False

# Make a completion request
response = client.chat.completions.create(
    model="local-model",  # Model name from LM Studio
    messages=[
        {"role": "user", "content": "Hello, how are you?"}
    ],
    temperature=0.7,
    max_tokens=500
)

print(response.choices[0].message.content)

🔌 SDK Integration Examples

LM Studio's OpenAI-compatible API works with all major OpenAI SDK implementations. Below are examples demonstrating integration with different programming languages and frameworks commonly used in AI application development.

// Node.js integration with LM Studio
import OpenAI from 'openai';

const client = new OpenAI({
    baseURL: 'http://localhost:1234/v1',
    apiKey: 'lm-studio'
});

// Streaming completion
const stream = await client.chat.completions.create({
    model: 'local-model',
    messages: [
        { role: 'system', content: 'You are a helpful coding assistant.' },
        { role: 'user', content: 'Write a Python function to sort a list.' }
    ],
    stream: true
});

for await (const chunk of stream) {
    process.stdout.write(chunk.choices[0]?.delta?.content || '');
}

LM Studio vs Cloud APIs

📦 Recommended Models

LM Studio supports a wide range of models suitable for different use cases. Selecting the right model depends on your hardware capabilities, quality requirements, and specific use case. Here are some recommendations based on common scenarios and available hardware configurations.

🔍 Common Issues