Open Source ChatBots

 

  1. ChatGPT  2022/11/30.   This was not open source but a challenge to the open source community.
  2. LLaMA 2023/02/23   Meta/Facebook.   You need to fill out some paperwork and get approved to download this code.  If you use a torrent and only want 13B be sure not to download the others as it gets huge.
  3.  Alpaca  2023/03/13  Stanford.  Created from LLaMA using training against ChatGPT.   The training cost was about $600.
  4.  GPT4ALL 2023/03   This has all the files needed to run and is open source.   A bit over 4GB for the download.
  5. OpenChatKit 2023/03
  6. ColossalAI 2023/03 is another open source chatbot recently released.
  7. Dolly - 2023/03/24 trained on one machine in 30 minutes.   Dolly was the name of a cloned sheep.  
  8. Guanaco 2023/03 
  9. Raven-RWKV-7B  This uses RNN, or Recurrent Neural Network and not transformers like most LLMs.
  10. OpenAsisstant  To release Apr 15, 2023. Demo
  11. Vicuna 2023/03   You can try Vicuna here.  The paper on Vicuna explains that they trained on sample chat conversations found at ShareGPT.  The training cost was about $300. This project is by students from UC Berkeley, CMU, Stanford, and UC San Diego.   They used ChatGPT to rate answers from Vicuna against LLaMA and Alpaca and it rated Vicuna higher.  Also using the name FastChat.  Released the trained weight values as deltas from LLaMA weights on 2023/04/03.  It can run in 60GB of CPU RAM or in 24 GB of GPU RAM.   
  12. ChatGLM6b   Using int4 can run on 6GB GPU  video   demo  Chinese/English
  13. Cerebras-GPT-13B    Download   Announcement   
  14. MiniGPT4   Enhancing Vision-language Understanding with Advanced Large Language Models   demo
  15. LLaVA  2023/04/17  Large Language and Vision Assistant   demo
  16. StabilityLM 2023/04/20  Announcement   demo
  17. BabyAGI    Readme   Twitter
  18. AutoGPT    Readme   Discord
  19. Jarvis    Readme  HuggingGPT: Solving AI Tasks with ChatGPT and
    its Friends in Hugging Face
  20. Red Pajama
  21. Hyena  Hyena, a subquadratic drop-in replacement for attention
  22. HugginChat 2023/04/26  demo    OpenAssistant/oasst-sft-6-llama-30b
  23. FastChat-V5  2023/04/28 fastchat-t5-3b-v1.0
  24. Stable-Vicuna-13b -  2023/04/28   
  25. StarCoder-15B  2023/05/04  Good at writing programs
  26. MPT-7B 2023/05/05  Trained on MosaicML platform in 9.5 days  ~$200k
  27. CodeT5+  2023/05/16 best open source LLM at coding

This is very rapid activity in open source chatbots.  Given the low training costs we expect many more chatbots to be released in the coming years with impressive performance progress.  Open Source makes public each new idea and invention.  It could evolve and progress very quickly.

In some sense AI is already being used to train AI, so The Singularity may be starting.

We will be trying out some of these chatbots.   Our current test machine is a HP Envy with 16 core i9-12900K CPU, 128GB Ram and Nvidia GeForce RTX 3060.  This was about $3,000 on Amazon when we bought it recently. 

It seems running on your own computer is now "running locally" or "self hosted", as opposed to running in the cloud.  We are interested in chatbots that can be run locally.   

We downloaded and installed GPT4ALL.  When running it only used about 4GB of RAM.   It answered questions but was clearly not as good as GPT4 or Vicuna.

We downloaded Dolly and it was around 20GB so it could have all that is needed.  Did not get it running yet. 

Vicuna install is two posts after this.

Comments

Post a Comment

Popular posts from this blog

Chatbot Arena and Leaderboard

Image
   The people at lmsys.org have Chatbot Arena   where you can give a question, see answers from two different bots and rate them.   Only after are you told which bots they were.    Using these human rated competitions between random bots, they can give ratings to the different bots.  As of May 3rd 2023 this is what their Leaderboard looked like: I do think that Vicuna is the best of these.   So I think the results are right.   And I like the method.   Hope they keep doing this.   It will make it easier to tell which is the best open source bot quickly.  Also interesting is their open source leaderboard .     
Read more

Vicuna Install

  Get Linux on Windows The official instructions for vicuna are here .   We had some trouble on Windows so the first thing we did was get Linux onto our Windows machine.   In a Power Window type:    wsl --install    After this we had to reboot the computer and then it will ask for a Linux user name and password.    After this the terminal icon will have an Ubuntu option for starting terminals.    Start a linux terminal and continue with everything below in linux. Get Vicuna git clone https://github.com/lm-sys/ FastChat.git cd FastChat pip3 install --upgrade pip  pip3 install -e . Get Weights cd mkdir vicuna.weights Use browser to go to https://huggingface.co/ eachadea/vicuna-13b/resolve/ main/ Click download next to each file.  Put these in directory vicuna.weights (note really saved to Windows directory and then moved from /mnt/c/..) Run Vicuna cd cd FastChat python3 -m fastchat.serve.cli --model-name ~/vicuna.weights --device cpu Results This got it running on our CPU.   We would
Read more