Mervin Praison Reviews Edge0-145B Local AI Model
Mervin Praison reviewed Edge0-145B, a free local AI from Edge0, detailing its performance, resource needs, and setup steps.
- Mervin Praison reviewed Edge0-145B, which is a free-to-download local AI model from Edge0.
- Edge0 states the model needs a 16 GB graphics card and 20 GB of memory.
- The model download is nearly 100 GB, consisting of weights and other files.
- Mervin Praison measured the model's speed at about 23 to 31 tokens per second on an Nvidia DGX Spark.
- The Edge0 Community Model License 1.0 allows personal, research, and internal use.
Who it affects This affects people who want to run a large AI model locally for free on their own computer.
What to do
Builders can use the steps provided in the review to install and test the Edge0-145B model locally.
Source: youtube.com ·