Dark Light
Reddit Scout Logo

Reddit Scout

Discover reviews on "best computer that is able to run large genai models" based on Reddit discussions and experiences.

Last updated: September 4, 2024 at 07:57 PM
Go Back

Query: "best computer that is able to run large genai models"

Open Assistant Project

  • LAION is working on an open-sourced version of ChatGPT for which the users are gathering datasets.
  • The project is in the early stages using established research in applying reinforcement learning-based human feedback technology to large language models.
  • Open Assistant will be free to use and modify with code and models licensed under Apache 2.0.
  • The training data will be released under CC BY 4.0.
  • The project will be runnable on Consumer Hardware.

Other AI Models

  • Bloom AI: Comparable to ChatGPT and runs chat models locally but requires significant GPU power.
  • Petals Project: Utilizes distributed computing to train models and improve them.
  • KoboldAI: An automatic UI for running open-source models locally.
  • Bing Chat: Mentioned as a nerfed AI model due to Bing Chat.
  • SD Platform: Described as a desired platform for neutral replies and fact-checking of AI-generated responses.

Hardware Recommendations

  • Raspberry Pi: Suitable for running AI models if the intended usage is not heavy.
  • HP Microserver Gen8: Utilized for vSphere hosting with vSAN and can handle multiple active VMs.
  • Thin Clients: Cost-effective and can run Linux and desktop applications with ease.
  • AI Prof's Cost Estimate: ChatGPT may cost around $100k a day to run, totaling $36 million annually.
  • Consumer Hardware: Mentioned for running open-source models.

Ethical Considerations

  • AI Capabilities: AI may struggle with breakthrough innovations and original creative ideas.
  • Stupidity: Some believe replicating the randomness of human stupidity would be challenging for AI models.
  • Scams and Misuse: Concern expressed over scams and fake donation scams potentially fueled by AI advancements.

Individual Projects and Tips

  • Running AI language models often involves dealing with output biases and failures to comprehend prompts accurately.
  • Role-playing and community involvement are suggested for finetuning language models.

Sourced from these Posts

Sitemap | Privacy Policy

Disclaimer: This website may contain affiliate links. As an Amazon Associate, I earn from qualifying purchases. This helps support the maintenance and development of this free tool.