llama-agentic-system
System level proxy component of Llama 3.1 model
- Support multi-step reasoning and task decomposition
- The ability to call tools for built-in and zero sample learning
- System level security assessment, using Llama Guard for input and output filtering
- Support custom virtual environment and dependency installation
- Support real-time FP8 quantization to improve performance
- Provide a command-line interface (CLI) to assist users in downloading models, configuring inference servers, and running proxy system applications
- Provide sample scripts and UI interfaces for users to quickly get started
Product Details
Llama agentic system is a system level agent component based on the Llama 3.1 model, capable of performing multi-step inference and using built-in tools such as search engines or code interpreters. The system also emphasizes security assessment, using Llama Guard for input and output filtering to ensure that security requirements are met in different usage scenarios.
