[Feature] Advanced Agent Capabilities in v1.3

[joshuayao]

Priority

P1-Stopper

OS type

Ubuntu

Hardware type

Xeon-GNR

Running nodes

Single Node

Description

The umbrella feature request for all the enhancements of Agent in v1.3.

Components

• [Feature] update react_llama/rag_llama/sql_llama agents to include thought process in AIMessage.content for better streaming on UI #1183
• [Feature] improve agent's capability to process multi-turn messages and use history stored in memory/persistance #1184

Evaluation

• [Feature] add TAG-bench for agent_eval, publish TAG-bench results for sql agent llama GenAIEval#224
• [Feature] refactor HELMET: support OH, vllm-gaudi for agent related benchmark GenAIEval#225
• [Task] Test AgentCompany benchmark: reproduce, run on gaudi for Agents. GenAIEval#232

Examples

• [Feature] Code agent (CodeGen/CodeTrans) GenAIExamples#1534
• [Feature] Update k8s HELM chart for AgentQnA: align with v1.2 GenAIExamples#1535
• [Feature] UI to support assistants API and streaming - show messages/agent managements GenAIExamples#1440
• [Feature] Multimodal Agent #1283

Finance Agent

• [Feature][FinAgent] agent optimized on Financebench GenAIExamples#1536
• [Feature] [FinAgent] Agent optimized on Financial summarization (aiera ECTsum) GenAIExamples#1537
• [Feature] [FinAgent] Agent optimized on Financial research benchmark GenAIExamples#1538
• [Feature] [FinAgent] Finance Agent example GenAIExamples#1539
• [Feature] [FinAgent] UI for finance agent: support multiturn GenAIExamples#1541