Install and test a free AI agent on your PC in 5 minutes
Run a local open-source AI agent (Ollama + AnythingLLM) to automate document workflows without internet access.
- 1.Go to the Ollama website and download the installer for your operating system (Windows or macOS). Install the program like any regular app.
Ollama runs in the background and lets you run language models directly on your computer without sending data to the internet.
Ollama ↗About this tool - 2.Open a terminal (Command Prompt on Windows / Terminal on macOS) and enter the command to download the AI model.
The model downloads once (about 4-5 GB) and then runs locally. When the input prompt appears, you can close the terminal - the model is already installed on your system.
Promptollama run llama3.1
What this prompt doesThis command downloads the open-source Llama 3.1 model and runs it locally. - 3.Download and install the AnythingLLM Desktop app - a free, open-source visual interface for building AI agents.
The app uses your PC's resources. Your data stays on your computer, ensuring full privacy.
AnythingLLM ↗ - 4.On first launch of AnythingLLM, in the setup window select LLM Provider: 'Ollama'. In the model field enter 'llama3.1'. Leave the Vector Database at its default (LanceDB) and finish setup.
This connects the AnythingLLM interface to the Ollama engine you installed earlier.
AnythingLLM ↗ - 5.In the app, create a new Workspace, click 'Add Files', and upload any text document (for example, work notes or meeting minutes), then click 'Save and Embed'.
The agent will process the document and use this knowledge to answer your questions.
- 6.In the chat inside your Workspace, send the agent a prompt to automate routine text analysis, replacing the text in brackets with your own.
The agent will analyze the uploaded document and produce a structured response, saving you reading time.
PromptAnalyze the provided document and create a concise summary for [target_audience]. Extract all mentioned tasks and create a bulleted action item list for [project_name].
What this prompt doesThe prompt asks the AI to summarize the document for [target_audience] and create a task list for [project_name]. Replace the bracketed values with your own (e.g., your team and project name).
- freeOllamaCompletely free open-source software that runs locally on your PC.
- freeAnythingLLM DesktopFree open-source desktop app with no usage limits.
Why today
AI services change fast - interfaces and free limits may differ from what's described.