local-llm-tool

Solid

Local LLM execution tool for text generation and chat through Ollama or vLLM endpoints. Use when: running on-prem inference, calling a local GPU model, or summarizing with a self-hosted LLM.

AI & Automation 235 stars 37 forks Updated today Apache-2.0

Install

View on GitHub

Quality Score: 88/100

Stars 20%
79
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
56
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Local LLM Tool External tool for text generation and chat via local LLM (Ollama/vLLM). ## Invocation via Bash Use **Bash** with `animaworks-tool local_llm <subcommand> [args]`. See Actions below for syntax. ## Actions ### generate — Text generation ```json {"tool_name": "local_llm", "action": "generate", "args": {"prompt": "prompt text", "system": "system prompt (optional)", "temperature": 0.7, "max_tokens": 2048}} ``` ### chat — Multi-turn chat ```json {"tool_name": "local_llm", "action": "chat", "args": {"messages": [{"role": "user", "content": "question"}], "system": "system prompt (optional)"}} ``` ### models — List available models ```json {"tool_name": "local_llm", "action": "models", "args": {}} ``` ### status — Server status ```json {"tool_name": "local_llm", "action": "status", "args": {}} ``` ## CLI Usage (S/C/D/G-mode) ```bash animaworks-tool local_llm generate "prompt" [-S "system prompt"] animaworks-tool local_llm list animaworks-tool local_llm status ``` ## Notes - Ollama or vLLM server must be running - Use -s/--server to specify server URL - Use -m/--model to specify model

Details

Author
xuiltul
Repository
xuiltul/animaworks
Created
3 months ago
Last Updated
today
Language
Python
License
Apache-2.0

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category