Local Server (Server Mode)

To activate “server mode,” simply open PowerShell and enter:

flm serve llama3.2:1b

You can choose to change the server port (default is 11434) by going to System Properties → Environment Variables, then modifying the value of FLM_SERVE_PORT.

⚠️ Be cautious: If you update this value, be sure to change any higher-level port settings in your application as well to ensure everything works correctly.

---

Table of contents

• Local LLM Server Basics
• OpenAI API Standard
• Open WebUI + FastFlowLM
• Microsfot AI Toolkit + FastFlowLM
• Build RAG with LangChain
• Websearch with LangChain