leafspark
/
AutoGGUF
mirror of https://github.com/leafspark/AutoGGUF
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
Page: System Requirements
Pages
Backend Selection Contributing Dynamic KV Overrides FAQ Home Input Output Path Installation Introduction Issues Plugins Quick Start Resource Monitor System Requirements
1 System Requirements
leafspark edited this page 2024-08-04 16:19:42 -07:00
Table of Contents

RAM and CPU Usage

The system requirements for AutoGGUF depend on the size of the models you're working with. For optimal performance:

  • RAM: At least 16GB, with 32GB or more recommended for larger models
  • CPU: Multi-core processor, preferably with AVX2 or AVX-512 support

Software Dependencies

AutoGGUF requires:

  • Python 3.8 or higher
  • CUDA-compatible GPU for faster processing (optional but recommended)
  • Necessary Python libraries (requirements will be listed in the installation section)