Posts

Showing posts from May, 2024

Run ChatGPT-Like LLM Models offline on your PC

       Ever since ChatGPT hyped the use of AI, everyone wanted to try similar AI models on their devices for daily queries. These are powerful AI models capable of executing high-level tasks. Now with the help of customized tools, users can install various Large Language Models (LLMs) on their computers for offline use. If you want to make your computer an AI chat tool that you can access anytime you want, then the answer is the tool that allows users to install various AI models such as Llama 3, Phi 3, Falcon, Gemma, Replit, and more. Let’s now see the steps to get these tools and setup AI Models. M inimum Requirements: Apple Silicon Mac (M1/M2/M3) with macOS 13.6 or newer Windows / Linux PC with a processor that supports AVX2 (typically newer PCs) 16GB+ of RAM is recommended. For PCs, 6GB+ of VRAM is recommended NVIDIA/AMD GPUs supported Note: You can follow this guide for Windows, Mac, and Linux platforms. AI Models use a high amount of RAM, CPU, and GPU. I...