14/01/2024
๐ Introducing "GotongRoyong" - Revolutionizing Indonesian Language AI ๐
I'm thrilled to announce the world's first large language model focused on the Indonesian language, "GotongRoyong"! ๐ฎ๐ฉ This groundbreaking model combines the power of Mixture of Experts (MoE) with cutting-edge architectures to unlock new possibilities in natural language understanding. ๐
๐ Model Details:
GotongRoyong comprises two incredible series models, each designed to elevate the Indonesian language AI landscape.
1๏ธโฃ Series Model: azale-ai/GotongRoyong-MixtralMoE-7Bx4-v1.0
Architecture: mistralai/Mistral-7B-v0.1
MoE Base Model: fblgit/UNA-TheBeagle-7b-v1
Expert Models: azale-ai/Starstreak-7b-alpha, Ichsan2895/Merak-7B-v4, robinsyihab/Sidrap-7B-v2, Obrolin/Kesehatan-7B-v0.1
URL: https://huggingface.co/azale-ai/GotongRoyong-MixtralMoE-7Bx4-v1.0
2๏ธโฃ Series Model: azale-ai/GotongRoyong-LlaMixtralMoE-7Bx4-v1.0
Architecture: meta-llama/Llama-2-7b
MoE Base Model: ricpolewski/AIRIC-The-Mistral
Expert Models: asyafiqe/Merak-7B-v3-Mini-Orca-Indo, SeaLLMs/SeaLLM-7B-Chat, Ichsan2895/Merak-7B-v2, azale-ai/DukunLM-7B-V1.0-Uncensored-sharded
URL: https://huggingface.co/azale-ai/GotongRoyong-LlaMixtralMoE-7Bx4-v1.0
๐ License: CC BY-NC-ND 4.0 DEED
CC BY-NC-ND 4.0 DEED license for GotongRoyong models means that users are free to share and use the models for non-commercial purposes, but they must give appropriate credit and cannot modify or create derivative works based on the original models without explicit permission. This licensing approach encourages collaboration, knowledge sharing, and responsible use while preserving the integrity of the original work.
๐ก Applications:
Natural Language Processing: Boost your NLP tasks with models finely tuned for Indonesian, delivering state-of-the-art performance.
Content Generation: Unleash creativity with a language model that adapts to your writing style, from casual conversations to formal documents.
Innovation in AI Research: GotongRoyong empowers researchers to delve into the intricacies of the Indonesian language, propelling advancements in AI and language understanding.
๐ Join the GotongRoyong Community!
GotongRoyong is more than just a model; it's a community-driven initiative to elevate the Indonesian language AI landscape. Join us on this exciting journey by exploring the models, providing feedback, and contributing to the vibrant ecosystem.
Let's shape the future of Indonesian language modeling together! ๐โจ
https://huggingface.co/collections/azale-ai/gotongroyong-65a36d4581a46e7dd95f4ff9
GotongRoyong is a series of language models focused on Mixture of Experts (MoE), made with the following models using LazyMergekit and cg123/mergekit.