LLM Farm vs. Enchanted LLM Utilizzo e statistiche

LLMFarm is an iOS and MacOS app to work with large language models (LLM). It allows you to load different LLMs with certain parameters. # Features * Various inferences * Various sampling methods * Metal * Model setting templates # Inferences * LLaMA * GPTNeoX * Replit * GPT2 + Cerebras * Starcoder(Santacoder) * RWKV * Falcon * MPT * Bloom * StableLM-3b-4e1t * Qwen * Gemma * Phi * Mamba * Others # Multimodal * LLaVA 1.5 models * Obsidian * Bunny * MobileVLM 1.7B/3B models Note: For Falcon, Alpaca, GPT4All, Chinese LLaMA / Alpaca and Chinese LLaMA-2 / Alpaca-2, Vigogne (French), Vicuna, Koala, OpenBuddy (Multilingual), Pygmalion/Metharme, WizardLM, Baichuan 1 & 2 + derivations, Aquila 1 & 2, Mistral AI v0.1, Refact, Persimmon 8B, MPT, Bloom select llama inferece in model settings. Sampling methods * Temperature (temp, tok-k, top-p) * Locally Typical Sampling * Mirostat * Greedy * Grammar

App Store di Apple
Gratis
Strumenti per gli sviluppatori

Classifica degli store

- -

Enchanted LLM

Enchanted is chat app for LLM researchers to chat with self hosted models. Enchanted supports Ollama API and all ecosystem models. It is necessary to have a running Ollama server to use this app and specify the server endpoint in app settings. Enchanted supports streaming and latest Chat API with conversation context. You can quickly switch between your models to test your prompts. Enchanted supports Markdown, therefore tables, lists and code will be nicely formatted. The app is in early days, but had a long roadmap to be leading tool for LLM community running self hosted models.