A new LLM called Orca is getting near GPT4 with only 13B model. It is based on Meta/Facebook 13B LLaMA model. They plan to release the diffs in weights and so make the model open source. Once this is done we plan to try it out. It seems like the new BestBot and it is really amazing that it is so small. Might be 1% of the size of GPT4 (don't really know the size of GPT4 so just a guess).