📌 GPU minimum specs?

To fully utilize AutoRAG, we recommend a computer with a CUDA GPU.

Specifically, we recommend a GTX 1000 or higher GPU.

LLM also requires a system with RTX 3090 and 4090 class GPUs with at least 20GB of VRAM if you want to run it on AutoRAG.

• If you don't have CUDA : It may be difficult to run various reranker modules. → Use of API modules such as OpenAI is recommended.
• GTX 1000 or higher GPU (CUDA) : Can run reranker modules. Cannot run LLM locally.
• 3090 and above : All functions can be run.