Discover reviews on "best computer that is able to run large genai models" based on Reddit discussions and experiences.
Last updated: September 4, 2024 at 07:57 PM
Query: "best computer that is able to run large genai models"
Open Assistant Project
- LAION is working on an open-sourced version of ChatGPT for which the users are gathering datasets.
- The project is in the early stages using established research in applying reinforcement learning-based human feedback technology to large language models.
- Open Assistant will be free to use and modify with code and models licensed under Apache 2.0.
- The training data will be released under CC BY 4.0.
- The project will be runnable on Consumer Hardware.
Other AI Models
- Bloom AI: Comparable to ChatGPT and runs chat models locally but requires significant GPU power.
- Petals Project: Utilizes distributed computing to train models and improve them.
- KoboldAI: An automatic UI for running open-source models locally.
- Bing Chat: Mentioned as a nerfed AI model due to Bing Chat.
- SD Platform: Described as a desired platform for neutral replies and fact-checking of AI-generated responses.
Hardware Recommendations
- Raspberry Pi: Suitable for running AI models if the intended usage is not heavy.
- HP Microserver Gen8: Utilized for vSphere hosting with vSAN and can handle multiple active VMs.
- Thin Clients: Cost-effective and can run Linux and desktop applications with ease.
- AI Prof's Cost Estimate: ChatGPT may cost around $100k a day to run, totaling $36 million annually.
- Consumer Hardware: Mentioned for running open-source models.
Ethical Considerations
- AI Capabilities: AI may struggle with breakthrough innovations and original creative ideas.
- Stupidity: Some believe replicating the randomness of human stupidity would be challenging for AI models.
- Scams and Misuse: Concern expressed over scams and fake donation scams potentially fueled by AI advancements.
Individual Projects and Tips
- Running AI language models often involves dealing with output biases and failures to comprehend prompts accurately.
- Role-playing and community involvement are suggested for finetuning language models.