Meta-Llama-3.1-405B-FP8
Multi language large-scale language model, optimizing dialogue and text generation.
- Supports 8 languages: English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai.
- Use Grouped Query Attention (GQA) technology to improve inference scalability.
- Provide basic pre training models and instruction adjustment models, suitable for diverse natural language generation tasks.
- Optimized in terms of security and usefulness, reducing the burden on developers to deploy secure AI systems.
- Support commercial and research purposes, allowing model outputs to be used to improve other models, including synthetic data generation and distillation.
- Comply with the Llama 3.1 Community License Agreement to ensure lawful and compliant use.
Product Details
Meta Llama 3.1 is a series of pre trained and instruction adjusted multilingual large language models (LLMs), including models of three sizes: 8B, 70B, and 405B, optimized specifically for multilingual dialogue use cases and performing excellently in industry benchmark tests. The model utilizes an optimized transformer architecture and further aligns with human preferences through supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to ensure its usefulness and safety.
