Open Source LLM Gaining

 

The following is claimed to have been leaked from a Google internal memo.

It seems interesting.


 


 

Comments

Post a Comment

Popular posts from this blog

Chatbot Arena and Leaderboard

Image
   The people at lmsys.org have Chatbot Arena   where you can give a question, see answers from two different bots and rate them.   Only after are you told which bots they were.    Using these human rated competitions between random bots, they can give ratings to the different bots.  As of May 3rd 2023 this is what their Leaderboard looked like: I do think that Vicuna is the best of these.   So I think the results are right.   And I like the method.   Hope they keep doing this.   It will make it easier to tell which is the best open source bot quickly.  Also interesting is their open source leaderboard .     
Read more

Amazingly easy to run LLMs with Ollama

Image
  There is a new tool called Ollama that makes it really easy to try out different LLMs on your local machine.   Here are several youtube videos about this.   Ollama - Local Models on your machine Sam Witteveen Running Mistral AI on your machine with Ollama Learn Data with Mark Ollama: The Easiest Way to RUN LLMs Locally Prompt Engineering Ollama on Linux: Easily Install Any LLM on Your Server Ian Wootten   It is so easy to run models with Ollama! To install Ollama on our Windows machine we opened a Windows/Linux terminal and entered:   curl https://ollama.ai/install.sh | sh   Then to run a model we can do things like:  ollama run llama2:70b   At https://ollama.ai/library you can see what models are available. After you click on a model you can click "tags" to see all the  different versions. Then you can click to copy the command to run that model.  I look for the largest one that fits in my 48 GB GPU.    At https://ollama.ai/library/llama2/tags there are different model
Read more

Orca

  A new LLM called Orca is getting near GPT4 with only 13B model.   It is based on Meta/Facebook 13B LLaMA model.   They plan to release the diffs in weights and so make the model open source.  Once this is done we plan to try it out.  It seems like the new BestBot and it is really amazing that it is so small.  Might be 1% of the size of GPT4 (don't really know the size of GPT4 so just a guess).
Read more