There's free Open Source LLM's. Why Should I Care?

Because anyone can fine-tune LLaMA and Falcon!

These two LLM's are great because they're open source but they can be improved!

LLaMA has not been fine-tuned for conversation like ChatGPT or Bing.

That means you can train a LLM for whatever you have in mind and then it becomes a next level super awesome AI. *mind blown emoji*

Fine-Tuning with LoRA

One of the tools developers can use to fine-tune LLaMA is LoRA (Low-Rank Adaptation of Large Language Models), which is available for free on Microsoft’s GitHub account.

Fine-tuned LLM's try to accomplish one of these features:

  • Generation

  • Extraction

  • Summarization

  • Rewriting

  • Classification

  • Question Answering

There are many open-source fine-tuned models to choose from. Alpaca, Cerebras-GPT, Vicuna, Samantha, Guanaco, etc have all been released in the past few months. Most of them are built on top of LLaMA!

You can find the most recent list of fine tuned LLM's here :

https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard

Conclusion

The free and open-source Large Language Models (LLMs) called LLaMA and Falcon are really cool because developers and AI fans can customize and make them even better. It's like giving them superpowers to do different things.

There are tools available to make these models even more powerful. With more models being created, AI is getting smarter and can do lots of amazing things.

It's an exciting time for AI and opens up new possibilities for the future.

Last updated