{"id":73255,"date":"2025-02-03T21:00:44","date_gmt":"2025-02-03T13:00:44","guid":{"rendered":"https:\/\/www.hongkiat.com\/blog\/?p=73255"},"modified":"2025-01-31T19:24:32","modified_gmt":"2025-01-31T11:24:32","slug":"run-offline-chat-assistant","status":"publish","type":"post","link":"https:\/\/www.hongkiat.com\/blog\/run-offline-chat-assistant\/","title":{"rendered":"How to Run Chat Assistant that Works Offline"},"content":{"rendered":"<p>AI chat assistants have become essential tools for productivity and creativity. They can help with many things, from answering questions to doing some tasks automatically. But most of these tools need to connect to services, like OpenAI and Claude, which means you always need internet access. While it is convenient, it also raises concerns about privacy, data security, and reliance on external servers.<\/p>\n<p>If you want to use <a href=\"https:\/\/www.hongkiat.com\/blog\/create-chatbot-with-openai\/\">AI chat assistants<\/a> without these concerns, you can host and run your own AI models on your local machine or server. This allows you to have full control over your data, as well as the ability to customize the models to suit your needs.<\/p>\n<p>In this article, we\u2019ll show you how to host and use AI chat assistants using <strong><a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/openwebui.com\/\">Open WebUI<\/a><\/strong> that work on your local machine or server, and could also work offline.<\/p>\n<hr>\n<div class=\"su-box su-box-style-default su-box-v7\" id=\"\" style=\"border-color:#000000;border-radius:3px\">\n<div class=\"su-box-title\" style=\"background-color:#333333;color:#FFFFFF;border-top-left-radius:1px;border-top-right-radius:1px\">Table of Contents<\/div>\n<div class=\"su-box-content su-u-clearfix su-u-trim\" style=\"border-bottom-left-radius:1px;border-bottom-right-radius:1px\">\n<ul>\n<li><a href=\"#what-is-open-webui\">What is Open WebUI<\/a><\/li>\n<li><a href=\"#system-prerequisites\">System Prerequisites<\/a><\/li>\n<li><a href=\"#system-requirements\">System Requirements<\/a><\/li>\n<li><a href=\"#installation-process\">Installation Process<\/a><\/li>\n<li><a href=\"#creating-an-account\">Creating an Account<\/a><\/li>\n<li><a href=\"#selecting-a-model\">Selecting a Model<\/a><\/li>\n<li><a href=\"#model-comparison-guide\">Model Comparison Guide<\/a><\/li>\n<li><a href=\"#interacting-with-the-chat-assistant\">Interacting with the Chat Assistant<\/a><\/li>\n<li><a href=\"#troubleshooting-guide\">Troubleshooting Guide<\/a><\/li>\n<li><a href=\"#advanced-features\">Advanced Features<\/a><\/li>\n<li><a href=\"#leveraging-multimodal-capabilities\">Leveraging Multimodal Capabilities<\/a><\/li>\n<li><a href=\"#wrapping-up\">Wrapping Up<\/a><\/li>\n<\/ul>\n<\/div>\n<\/div>\n<hr>\n<h2 id=\"what-is-open-webui\">What is Open WebUI<\/h2>\n<p><strong>Open WebUI<\/strong> is an open-source web interface designed for interacting with various Large Language Models (LLMs).<\/p>\n<p>It comes with a number of features such as Retrieval Augmented Generation (RAG) support, image generation, Markdown and Latex support, web search support with <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/github.com\/searxng\/searxng\">SearXNG<\/a>, Role-based Access Control, and a lot more which makes it comparable to popular services like ChatGPT and Claude.<\/p>\n<hr>\n<h2 id=\"system-prerequisites\">System Prerequisites<\/h2>\n<p>To get the Open WebUI up and running, you\u2019ll need the following:<\/p>\n<ul>\n<li><strong><a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.docker.com\/\">Docker<\/a><\/strong>: In this article we are going to use Docker to run <strong>Open WebUI<\/strong>. This way the application is contained and does not interfere directly with your computer system.<\/li>\n<li><strong>Ollama<\/strong>: You will also need Ollama to run the models. Ollama is a tool that allows you to orchestrate multiple models. It is used to run the models in the Open WebUI. Follow the instructions on our article <a href=\"#\">Getting Started with Ollama<\/a> to install and set up Ollama in your computer.<\/li>\n<\/ul>\n<p>After you have installed Docker and Ollama, make sure that you have Ollama running with the API accessible at <code>127.0.0.1:11434<\/code> or <code>localhost:11434<\/code>. You can check this by running the following command to get the version of Ollama:<\/p>\n<pre>\r\ncurl http:\/\/localhost:11434\/api\/version\r\n<\/pre>\n<p>If it returns a version number, Ollama is running correctly and we are ready to proceed with the installation of Open WebUI.<\/p>\n<hr>\n<h2 id=\"system-requirements\">System Requirements<\/h2>\n<p>Before installing Open WebUI and Ollama, ensure your system meets these minimum requirements:<\/p>\n<h3>Hardware Requirements:<\/h3>\n<table>\n<thead>\n<tr>\n<th>Component<\/th>\n<th>Requirements<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td><strong>CPU<\/strong><\/td>\n<td>Modern multi-core processor (4+ cores recommended)<\/td>\n<\/tr>\n<tr>\n<td><strong>RAM<\/strong><\/td>\n<td>Minimum 8GB, 16GB or more recommended for larger models<\/td>\n<\/tr>\n<tr>\n<td><strong>Storage<\/strong><\/td>\n<td>At least 10GB free space for base installation, plus additional space for models:\n<ul>\n<li>llama3.2: ~4GB<\/li>\n<li>llama3.2-vision: ~8GB<\/li>\n<li>Additional models: 4-15GB each depending on model size<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<tr>\n<td><strong>GPU<\/strong><\/td>\n<td>Optional but recommended for better performance:\n<ul>\n<li>NVIDIA GPU with CUDA support (8GB+ VRAM recommended)<\/li>\n<li>Or AMD GPU with ROCm support<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h3>Software Requirements:<\/h3>\n<table>\n<thead>\n<tr>\n<th>Component<\/th>\n<th>Requirements<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td><strong>Operating System<\/strong><\/td>\n<td>\n<ul>\n<li>Linux (Ubuntu 20.04 or newer recommended)<\/li>\n<li>macOS 12 or newer (including M1\/M2 support)<\/li>\n<li>Windows 10\/11 with WSL2<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<tr>\n<td><strong>Docker<\/strong><\/td>\n<td>Latest stable version<\/td>\n<\/tr>\n<tr>\n<td><strong>Browser<\/strong><\/td>\n<td>Modern web browser (Chrome, Firefox, Safari, or Edge)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>Note: These requirements are for running basic models. More demanding models or concurrent usage may require more powerful hardware.<\/p>\n<hr>\n<h2 id=\"installation-process\">Installation Process<\/h2>\n<p>To install and run Open WebUI, you can run the following command:<\/p>\n<pre>\r\ndocker run -d -p 3000:8080 --add-host=host.docker.internal:host-gateway -v open-webui:\/app\/backend\/data --name open-webui --restart always ghcr.io\/open-webui\/open-webui:main\r\n<\/pre>\n<p>If this is the first run, this command will download the <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/github.com\/open-webui\/open-webui\/pkgs\/container\/open-webui\">open-webui<\/a> Docker image. It may take a while but subsequent runs will be faster. Once the image is downloaded, it will start the container and you can access the Open WebUI at <code>localhost:3000<\/code> in your browser.<\/p>\n<p>Note, that if you see an error when loading it in the browser, wait a bit for a few minutes. It may still be initializing and downloading some resources in the background to complete the setup.<\/p>\n<p>When you see the following screen, you have successfully installed Open WebUI and <strong>ready to get started<\/strong>.<\/p>\n<figure><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/assets.hongkiat.com\/uploads\/run-offline-chat-assistant\/openweb-ui-start.jpg\" alt=\"Open WebUI start screen showing setup interface\" width=\"1000\" height=\"640\"><\/figure>\n<hr>\n<h2 id=\"creating-an-account\">Creating an Account<\/h2>\n<p>When you first access the Open WebUI, you will be prompted to create an admin account. You will need to input your name, email, and password.<\/p>\n<figure><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/assets.hongkiat.com\/uploads\/run-offline-chat-assistant\/openweb-ui-create-account.jpg\" alt=\"Open WebUI account creation form\" width=\"1000\" height=\"640\"><\/figure>\n<p>After you have created an account, you will be immediately logged in and see the following interface.<\/p>\n<figure><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/assets.hongkiat.com\/uploads\/run-offline-chat-assistant\/openweb-ui-chat-interface.jpg\" alt=\"Open WebUI chat interface dashboard\" width=\"1000\" height=\"640\"><\/figure>\n<hr>\n<h2 id=\"selecting-a-model\">Selecting a Model<\/h2>\n<p>At this point, we still can\u2019t interact with the chat assistant because we haven\u2019t selected a model yet.<\/p>\n<p>To download the model, you can click on the top <strong>\u201cSelect a model\u201d<\/strong> option. Type in the model name e.g. llama3.2 and select the <strong>\u201cPull \u2018llama3.2\u2019 from Ollama.com\u201d<\/strong>, as you can see below.<\/p>\n<figure><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/assets.hongkiat.com\/uploads\/run-offline-chat-assistant\/openweb-ui-pull-model.jpg\" alt=\"Open WebUI model pull dialog showing llama3.2 selection\" width=\"1000\" height=\"640\"><\/figure>\n<p>Alternatively, since the model is downloaded from the Ollama library, we can also download it directly with the Ollama CLI. In our case, to download the <strong>\u201cllama3.2\u201d<\/strong> model, we can run:<\/p>\n<pre>\r\nollama pull llama3.2\r\n<\/pre>\n<p>Again, this process will take some time to download the model. Once it is downloaded, you can select the model from the <strong>\u201cSelect a model\u201d<\/strong> option.<\/p>\n<figure><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/assets.hongkiat.com\/uploads\/run-offline-chat-assistant\/openweb-ui-select-model.jpg\" alt=\"Open WebUI model selection dropdown menu\" width=\"1000\" height=\"480\"><\/figure>\n<hr>\n<h2 id=\"model-comparison-guide\">Model Comparison Guide<\/h2>\n<p>Open WebUI supports various models through Ollama. Here\u2019s a comparison of commonly used models to help you choose the right one for your needs:<\/p>\n<table>\n<thead>\n<tr>\n<th>Model<\/th>\n<th>Size<\/th>\n<th>Key Features<\/th>\n<th>Best For<\/th>\n<th>Limitations<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>llama3.2<\/td>\n<td>~4GB<\/td>\n<td>\n<ul>\n<li>General text generation<\/li>\n<li>Code completion<\/li>\n<li>Analysis tasks<\/li>\n<\/ul>\n<\/td>\n<td>\n<ul>\n<li>General chat<\/li>\n<li>Writing assistance<\/li>\n<li>Code help<\/li>\n<\/ul>\n<\/td>\n<td>\n<ul>\n<li>No image processing<\/li>\n<li>Knowledge cutoff in 2023<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<tr>\n<td>llama3.2-vision<\/td>\n<td>~8GB<\/td>\n<td>\n<ul>\n<li>Image understanding<\/li>\n<li>Visual analysis<\/li>\n<li>Multi-modal tasks<\/li>\n<\/ul>\n<\/td>\n<td>\n<ul>\n<li>Image analysis<\/li>\n<li>Visual QA<\/li>\n<li>Image-based tasks<\/li>\n<\/ul>\n<\/td>\n<td>\n<ul>\n<li>Larger resource requirements<\/li>\n<li>Slower response times<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>When choosing a model, consider these factors:<\/p>\n<ul>\n<li><strong>Hardware Capabilities:<\/strong> Ensure your system can handle the model\u2019s requirements<\/li>\n<li><strong>Use Case:<\/strong> Match the model\u2019s capabilities to your specific needs<\/li>\n<li><strong>Response Time:<\/strong> Larger models generally have slower response times<\/li>\n<li><strong>Storage Space:<\/strong> Consider the available disk space for model storage<\/li>\n<\/ul>\n<hr>\n<h2 id=\"interacting-with-the-chat-assistant\">Interacting with the Chat Assistant<\/h2>\n<p>Once you have selected the model, you can start interacting with the chat assistant. You can type in your questions or prompts in the chat box and the chat assistant will respond accordingly.<\/p>\n<p>The response would work best if you ask questions or prompts that are related to the model you have selected. For example, if you have selected the <strong>\u201cllama3.2\u201d<\/strong> model, you can ask questions related to general knowledge, trivia, or any other topic that the model is trained on.<\/p>\n<p>For example, you can ask questions like:<\/p>\n<ul>\n<li>What is the capital of Indonesia?<\/li>\n<li>Who is the author of the book \u201cLord of the Ring\u201d?<\/li>\n<li>What is the boiling point of water?<\/li>\n<\/ul>\n<figure><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/assets.hongkiat.com\/uploads\/run-offline-chat-assistant\/openweb-ui-chat-assistant.jpg\" alt=\"Open WebUI chat assistant conversation interface\" width=\"1000\" height=\"640\"><\/figure>\n<p>Keep in mind though the \u201cllama3.2\u201d may not be answering accurately for real-time events since the model is only trained with the data up to 2023.<\/p>\n<hr>\n<h2 id=\"troubleshooting-guide\">Troubleshooting Guide<\/h2>\n<p>When using Open WebUI, you might encounter some common issues. Here\u2019s how to resolve them:<\/p>\n<h3>Docker Container Won\u2019t Start<\/h3>\n<ul>\n<li><strong>Symptom:<\/strong> Docker container fails to start or crashes immediately<\/li>\n<li>Check if port 3000 is already in use:\n<pre>lsof -i :3000<\/pre>\n<p>    If in use, either stop the conflicting service or change the port in the docker run command <\/p><\/li>\n<li>Verify Docker daemon is running:\n<pre>systemctl status docker<\/pre>\n<\/li>\n<li>Check Docker logs:\n<pre>docker logs open-webui<\/pre>\n<\/li>\n<\/ul>\n<h3>Connection to Ollama Failed<\/h3>\n<ul>\n<li><strong>Symptom:<\/strong> \u201cCannot connect to Ollama\u201d error message<\/li>\n<li>Verify Ollama is running:\n<pre>curl http:\/\/localhost:11434\/api\/version<\/pre>\n<\/li>\n<li>Check if Ollama is accessible from Docker:\n<pre>docker exec open-webui curl http:\/\/host.docker.internal:11434\/api\/version<\/pre>\n<\/li>\n<li>Restart both services:\n<pre>systemctl restart ollama\r\ndocker restart open-webui<\/pre>\n<\/li>\n<\/ul>\n<h3>Model Download Issues<\/h3>\n<ul>\n<li><strong>Symptom:<\/strong> Model download fails or times out<\/li>\n<li>Check available disk space:\n<pre>df -h<\/pre>\n<\/li>\n<li>Try downloading through Ollama CLI:\n<pre>ollama pull modelname<\/pre>\n<\/li>\n<li>Clear Ollama cache and retry:\n<pre>rm -rf ~\/.ollama\/models\/*<\/pre>\n<\/li>\n<\/ul>\n<hr>\n<h2 id=\"advanced-features\">Advanced Features<\/h2>\n<h3>Using RAG (Retrieval Augmented Generation)<\/h3>\n<p>RAG allows you to enhance the model\u2019s responses with your own knowledge base. Here\u2019s how to set it up:<\/p>\n<p><strong>1. Prepare Your Documents<\/strong>\n  Your knowledge base can include PDF, TXT, DOCX, and MD files. Simply place these documents in the designated knowledge base directory, making sure they\u2019re properly formatted and readable.<\/p>\n<p><strong>2. Configure RAG Settings<\/strong><\/p>\n<pre>\r\n{\r\n    \"rag_enabled\": true,\r\n    \"chunk_size\": 500,\r\n    \"chunk_overlap\": 50,\r\n    \"document_lang\": \"en\"\r\n}<\/pre>\n<h3>Setting Up Web Search with SearXNG<\/h3>\n<p>Integrate web search capabilities into your chat assistant:<\/p>\n<pre>\r\ndocker run -d \\\r\n  --name searxng \\\r\n  -p 8080:8080 \\\r\n  -v searxng-data:\/etc\/searxng \\\r\n  searxng\/searxng\r\n<\/pre>\n<p>Then configure Open WebUI to use SearXNG:<\/p>\n<ol>\n<li>Go to Settings > Advanced<\/li>\n<li>Enable Web Search<\/li>\n<li>Enter SearXNG URL: <code>http:\/\/localhost:8080<\/code><\/li>\n<li>Configure search parameters (optional)<\/li>\n<\/ol>\n<h3>Role-based Access Control<\/h3>\n<p>Configure different user roles and permissions:<\/p>\n<table>\n<thead>\n<tr>\n<th>Role<\/th>\n<th>Permissions<\/th>\n<th>Use Case<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Admin<\/td>\n<td>Full system access<\/td>\n<td>System management<\/td>\n<\/tr>\n<tr>\n<td>Power User<\/td>\n<td>Model management, RAG configuration<\/td>\n<td>Advanced users<\/td>\n<\/tr>\n<tr>\n<td>Basic User<\/td>\n<td>Chat interaction only<\/td>\n<td>Regular users<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<hr>\n<h2 id=\"leveraging-multimodal-capabilities\">Leveraging Multimodal Capabilities<\/h2>\n<p>Open WebUI also supports multimodal capabilities, which means you can generate images along with text or use an image as part of your prompt inputs.<\/p>\n<p>To do so, however, you\u2019d need a model with multimodal capabilities. In this example, we can use the <strong>\u201cllama3.2-vision\u201d<\/strong>. You can download the model from the Open WebUI interface as we did before or use the Ollama CLI to download it directly:<\/p>\n<pre>\r\nollama pull llama3.2-vision\r\n<\/pre>\n<p>After it\u2019s downloaded, select the model and upload an image to the chat assistant. You can do this by clicking on the <kbd>+<\/kbd> button and submit it along with your prompt.<\/p>\n<p>In this example, I\u2019d use an image, <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/openverse.org\/image\/a9e0bff3-3272-4c3a-bbd4-92e542e1f41a?q=bicycle&p=7\">The Red Bicycle from Openverse<\/a> and ask <strong><q>What\u2019s the primary focus of this picture?<\/q><\/strong>.<\/p>\n<p>Indeed, it is able to answer the question, and it even knows the color of the bicycle, as we can see below.<\/p>\n<figure><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/assets.hongkiat.com\/uploads\/run-offline-chat-assistant\/openweb-ui-multimodal-model.jpg\" alt=\"Open WebUI multimodal chat interface showing image analysis of a red bicycle\" width=\"1000\" height=\"640\"><\/figure>\n<hr>\n<h2 id=\"wrapping-up\">Wrapping Up<\/h2>\n<p>Open WebUI is a powerful tool that allows you to host and use AI chat assistants on your local machine or server. It provides a user-friendly interface for interacting with various Large Language Models (LLMs).<\/p>\n<p>It\u2019s a perfect tool for those who are concerned about privacy, data security, and reliance on external servers. With Open WebUI, you can have full control over your data and privacy, as well as the ability to customize the models to suit your needs.<\/p>\n<p>It is also a great tool for developers who want to experiment with AI chat assistants and build their own custom models. With Open WebUI, you can easily host and run your models, and interact with them using a simple and intuitive interface.<\/p>\n<hr>","protected":false},"excerpt":{"rendered":"<p>AI chat assistants have become essential tools for productivity and creativity. They can help with many things, from answering questions to doing some tasks automatically. But most of these tools need to connect to services, like OpenAI and Claude, which means you always need internet access. While it is convenient, it also raises concerns about&hellip;<\/p>\n","protected":false},"author":113,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[3398],"tags":[3545],"topic":[],"class_list":["entry-content","is-maxi"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v22.8 (Yoast SEO v27.9) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>How to Run Chat Assistant that Works Offline - Hongkiat<\/title>\n<meta name=\"description\" content=\"AI chat assistants have become essential tools for productivity and creativity. They can help with many things, from answering questions to doing some\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.hongkiat.com\/blog\/run-offline-chat-assistant\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How to Run Chat Assistant that Works Offline\" \/>\n<meta property=\"og:description\" content=\"AI chat assistants have become essential tools for productivity and creativity. They can help with many things, from answering questions to doing some\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.hongkiat.com\/blog\/run-offline-chat-assistant\/\" \/>\n<meta property=\"og:site_name\" content=\"Hongkiat\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/hongkiatcom\" \/>\n<meta property=\"article:published_time\" content=\"2025-02-03T13:00:44+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/assets.hongkiat.com\/uploads\/run-offline-chat-assistant\/openweb-ui-start.jpg\" \/>\n<meta name=\"author\" content=\"Thoriq Firdaus\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@tfirdaus\" \/>\n<meta name=\"twitter:site\" content=\"@hongkiat\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Thoriq Firdaus\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"9 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/run-offline-chat-assistant\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/run-offline-chat-assistant\\\/\"},\"author\":{\"name\":\"Thoriq Firdaus\",\"@id\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/#\\\/schema\\\/person\\\/e7948c7a175d211496331e4b6ce55807\"},\"headline\":\"How to Run Chat Assistant that Works Offline\",\"datePublished\":\"2025-02-03T13:00:44+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/run-offline-chat-assistant\\\/\"},\"wordCount\":1608,\"publisher\":{\"@id\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/run-offline-chat-assistant\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/assets.hongkiat.com\\\/uploads\\\/run-offline-chat-assistant\\\/openweb-ui-start.jpg\",\"keywords\":[\"Artificial Intelligence\"],\"articleSection\":[\"Internet\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/run-offline-chat-assistant\\\/\",\"url\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/run-offline-chat-assistant\\\/\",\"name\":\"How to Run Chat Assistant that Works Offline - Hongkiat\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/run-offline-chat-assistant\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/run-offline-chat-assistant\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/assets.hongkiat.com\\\/uploads\\\/run-offline-chat-assistant\\\/openweb-ui-start.jpg\",\"datePublished\":\"2025-02-03T13:00:44+00:00\",\"description\":\"AI chat assistants have become essential tools for productivity and creativity. They can help with many things, from answering questions to doing some\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/run-offline-chat-assistant\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/run-offline-chat-assistant\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/run-offline-chat-assistant\\\/#primaryimage\",\"url\":\"https:\\\/\\\/assets.hongkiat.com\\\/uploads\\\/run-offline-chat-assistant\\\/openweb-ui-start.jpg\",\"contentUrl\":\"https:\\\/\\\/assets.hongkiat.com\\\/uploads\\\/run-offline-chat-assistant\\\/openweb-ui-start.jpg\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/run-offline-chat-assistant\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How to Run Chat Assistant that Works Offline\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/\",\"name\":\"Hongkiat\",\"description\":\"Tech and Design Tips\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/#organization\",\"name\":\"Hongkiat.com\",\"url\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/wp-content\\\/uploads\\\/hkdc-logo-rect-yoast.jpg\",\"contentUrl\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/wp-content\\\/uploads\\\/hkdc-logo-rect-yoast.jpg\",\"width\":1200,\"height\":799,\"caption\":\"Hongkiat.com\"},\"image\":{\"@id\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/hongkiatcom\",\"https:\\\/\\\/x.com\\\/hongkiat\",\"https:\\\/\\\/www.pinterest.com\\\/hongkiat\\\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/#\\\/schema\\\/person\\\/e7948c7a175d211496331e4b6ce55807\",\"name\":\"Thoriq Firdaus\",\"description\":\"Thoriq is a writer for Hongkiat.com with a passion for web design and development. He is the author of Responsive Web Design by Examples, where he covered his best approaches in developing responsive websites quickly with a framework.\",\"sameAs\":[\"https:\\\/\\\/thoriq.com\",\"https:\\\/\\\/x.com\\\/tfirdaus\"],\"jobTitle\":\"Web Developer\",\"url\":\"https:\\\/\\\/www.hongkiat.com\\\/blog\\\/author\\\/thoriq\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"How to Run Chat Assistant that Works Offline - Hongkiat","description":"AI chat assistants have become essential tools for productivity and creativity. They can help with many things, from answering questions to doing some","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.hongkiat.com\/blog\/run-offline-chat-assistant\/","og_locale":"en_US","og_type":"article","og_title":"How to Run Chat Assistant that Works Offline","og_description":"AI chat assistants have become essential tools for productivity and creativity. They can help with many things, from answering questions to doing some","og_url":"https:\/\/www.hongkiat.com\/blog\/run-offline-chat-assistant\/","og_site_name":"Hongkiat","article_publisher":"https:\/\/www.facebook.com\/hongkiatcom","article_published_time":"2025-02-03T13:00:44+00:00","og_image":[{"url":"https:\/\/assets.hongkiat.com\/uploads\/run-offline-chat-assistant\/openweb-ui-start.jpg","type":"","width":"","height":""}],"author":"Thoriq Firdaus","twitter_card":"summary_large_image","twitter_creator":"@tfirdaus","twitter_site":"@hongkiat","twitter_misc":{"Written by":"Thoriq Firdaus","Est. reading time":"9 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.hongkiat.com\/blog\/run-offline-chat-assistant\/#article","isPartOf":{"@id":"https:\/\/www.hongkiat.com\/blog\/run-offline-chat-assistant\/"},"author":{"name":"Thoriq Firdaus","@id":"https:\/\/www.hongkiat.com\/blog\/#\/schema\/person\/e7948c7a175d211496331e4b6ce55807"},"headline":"How to Run Chat Assistant that Works Offline","datePublished":"2025-02-03T13:00:44+00:00","mainEntityOfPage":{"@id":"https:\/\/www.hongkiat.com\/blog\/run-offline-chat-assistant\/"},"wordCount":1608,"publisher":{"@id":"https:\/\/www.hongkiat.com\/blog\/#organization"},"image":{"@id":"https:\/\/www.hongkiat.com\/blog\/run-offline-chat-assistant\/#primaryimage"},"thumbnailUrl":"https:\/\/assets.hongkiat.com\/uploads\/run-offline-chat-assistant\/openweb-ui-start.jpg","keywords":["Artificial Intelligence"],"articleSection":["Internet"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.hongkiat.com\/blog\/run-offline-chat-assistant\/","url":"https:\/\/www.hongkiat.com\/blog\/run-offline-chat-assistant\/","name":"How to Run Chat Assistant that Works Offline - Hongkiat","isPartOf":{"@id":"https:\/\/www.hongkiat.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.hongkiat.com\/blog\/run-offline-chat-assistant\/#primaryimage"},"image":{"@id":"https:\/\/www.hongkiat.com\/blog\/run-offline-chat-assistant\/#primaryimage"},"thumbnailUrl":"https:\/\/assets.hongkiat.com\/uploads\/run-offline-chat-assistant\/openweb-ui-start.jpg","datePublished":"2025-02-03T13:00:44+00:00","description":"AI chat assistants have become essential tools for productivity and creativity. They can help with many things, from answering questions to doing some","breadcrumb":{"@id":"https:\/\/www.hongkiat.com\/blog\/run-offline-chat-assistant\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.hongkiat.com\/blog\/run-offline-chat-assistant\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.hongkiat.com\/blog\/run-offline-chat-assistant\/#primaryimage","url":"https:\/\/assets.hongkiat.com\/uploads\/run-offline-chat-assistant\/openweb-ui-start.jpg","contentUrl":"https:\/\/assets.hongkiat.com\/uploads\/run-offline-chat-assistant\/openweb-ui-start.jpg"},{"@type":"BreadcrumbList","@id":"https:\/\/www.hongkiat.com\/blog\/run-offline-chat-assistant\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.hongkiat.com\/blog\/"},{"@type":"ListItem","position":2,"name":"How to Run Chat Assistant that Works Offline"}]},{"@type":"WebSite","@id":"https:\/\/www.hongkiat.com\/blog\/#website","url":"https:\/\/www.hongkiat.com\/blog\/","name":"Hongkiat","description":"Tech and Design Tips","publisher":{"@id":"https:\/\/www.hongkiat.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.hongkiat.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.hongkiat.com\/blog\/#organization","name":"Hongkiat.com","url":"https:\/\/www.hongkiat.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.hongkiat.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.hongkiat.com\/blog\/wp-content\/uploads\/hkdc-logo-rect-yoast.jpg","contentUrl":"https:\/\/www.hongkiat.com\/blog\/wp-content\/uploads\/hkdc-logo-rect-yoast.jpg","width":1200,"height":799,"caption":"Hongkiat.com"},"image":{"@id":"https:\/\/www.hongkiat.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/hongkiatcom","https:\/\/x.com\/hongkiat","https:\/\/www.pinterest.com\/hongkiat\/"]},{"@type":"Person","@id":"https:\/\/www.hongkiat.com\/blog\/#\/schema\/person\/e7948c7a175d211496331e4b6ce55807","name":"Thoriq Firdaus","description":"Thoriq is a writer for Hongkiat.com with a passion for web design and development. He is the author of Responsive Web Design by Examples, where he covered his best approaches in developing responsive websites quickly with a framework.","sameAs":["https:\/\/thoriq.com","https:\/\/x.com\/tfirdaus"],"jobTitle":"Web Developer","url":"https:\/\/www.hongkiat.com\/blog\/author\/thoriq\/"}]}},"jetpack_featured_media_url":"https:\/\/","jetpack_shortlink":"https:\/\/wp.me\/p4uxU-j3x","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.hongkiat.com\/blog\/wp-json\/wp\/v2\/posts\/73255","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.hongkiat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.hongkiat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.hongkiat.com\/blog\/wp-json\/wp\/v2\/users\/113"}],"replies":[{"embeddable":true,"href":"https:\/\/www.hongkiat.com\/blog\/wp-json\/wp\/v2\/comments?post=73255"}],"version-history":[{"count":2,"href":"https:\/\/www.hongkiat.com\/blog\/wp-json\/wp\/v2\/posts\/73255\/revisions"}],"predecessor-version":[{"id":73257,"href":"https:\/\/www.hongkiat.com\/blog\/wp-json\/wp\/v2\/posts\/73255\/revisions\/73257"}],"wp:attachment":[{"href":"https:\/\/www.hongkiat.com\/blog\/wp-json\/wp\/v2\/media?parent=73255"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.hongkiat.com\/blog\/wp-json\/wp\/v2\/categories?post=73255"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.hongkiat.com\/blog\/wp-json\/wp\/v2\/tags?post=73255"},{"taxonomy":"topic","embeddable":true,"href":"https:\/\/www.hongkiat.com\/blog\/wp-json\/wp\/v2\/topic?post=73255"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}