Language Technology Lab at Alibaba DAMO Academy

All

47 repositories

VideoLLaMA3
Public
Frontier Multimodal Foundation Models for Image and Video Understanding
Jupyter Notebook
•
Apache License 2.0
•16•276•9•2•Updated Feb 1, 2025Feb 1, 2025
VideoRefer
Public
The code for "VideoRefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLM"
video-understanding mllm pixel-understanding sam2
Python
•6•139•2•0•Updated Jan 26, 2025Jan 26, 2025
VideoLLaMA2
Public
VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs
Python
•
Apache License 2.0
•69•1k•66•0•Updated Jan 23, 2025Jan 23, 2025
multimodal_textbook
Public
The official repository for "2.5 Years in Class: A Multimodal Textbook for Vision-Language Pretraining"
Python
•
Apache License 2.0
•15•133•3•1•Updated Jan 18, 2025Jan 18, 2025
Inf-CLIP
Public
The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for Contrastive Loss". A super memory-efficiency CLIP training scheme.
memory-efficient clip contrastive-learning flash-attention ring-attention infinite-batch-size
Python
•
Apache License 2.0
•9•220•2•0•Updated Jan 16, 2025Jan 16, 2025
CoI-Agent
Public
Official code for paper: Chain of Ideas: Revolutionizing Research via Novel Idea Development with LLM Agents
Python
•
Apache License 2.0
•27•423•4•0•Updated Jan 15, 2025Jan 15, 2025
LLM-R2
Public
Python
•6•38•4•0•Updated Nov 26, 2024Nov 26, 2024
SeaExam
Public
SeaExam: Benchmarking LLMs for Southeast Aisa languages with Human Exam Questions
Python
•0•6•0•0•Updated Nov 26, 2024Nov 26, 2024
SeaBench
Public
Python
•0•2•0•0•Updated Nov 22, 2024Nov 22, 2024
multilingual_analysis
Public
[NeurIPS 2024] How do Large Language Models Handle Multilingualism?
Python
•0•18•8•0•Updated Nov 8, 2024Nov 8, 2024
DiGIT
Public
[NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective
transformer image-generation gpt language-model autoregressive fairseq neurips
Python
•
MIT License
•2•59•2•0•Updated Oct 31, 2024Oct 31, 2024
reasoning-paths-optimization
Public
[EMNLP 2024] Reasoning Paths Optimization: Learning to Reason and Explore From Diverse Paths
reasoning llm
Python
•
Apache License 2.0
•0•8•0•0•Updated Oct 30, 2024Oct 30, 2024
CMM
Public
✨✨The Curse of Multi-Modalities (CMM): Evaluating Hallucinations of Large Multimodal Models across Language, Visual, and Audio
Python
•2•38•1•0•Updated Oct 17, 2024Oct 17, 2024
VCD
Public
[CVPR 2024 Highlight] Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding
Python
•
Apache License 2.0
•13•232•14•1•Updated Oct 7, 2024Oct 7, 2024
Auto-Arena-LLMs
Public
Jupyter Notebook
•
Apache License 2.0
•1•36•2•0•Updated Oct 7, 2024Oct 7, 2024
WebDesignAgent
Public
WebDesignAgent : Towards Effortless Website Creation
Python
•
Apache License 2.0
•27•244•4•0•Updated Sep 20, 2024Sep 20, 2024
LLM-argumentation
Public
[ACL2024] Exploring the Potential of Large Language Models in Computational Argumentation
argument-mining argument-generation computational-argumentation llm
Python
•1•15•1•0•Updated Aug 21, 2024Aug 21, 2024
DAMO-SeaLLMs
Public
[ACL 2024 Demo] SeaLLMs - Large Language Models for Southeast Asia
JavaScript
•14•158•9•0•Updated Jul 30, 2024Jul 30, 2024
Video-LLaMA
Public
[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
llama large-language-models video-language-pretraining vision-language-pretraining cross-modal-pretraining blip2 minigpt4 multi-modal-chatgpt
Python
•
BSD 3-Clause "New" or "Revised" License
•266•2.9k•60•6•Updated Jun 4, 2024Jun 4, 2024
chain-of-knowledge
Public
[ICLR2024] Chain-of-Knowledge: Grounding Large Language Models via Dynamic Knowledge Adapting over Heterogeneous Sources
Python
•
MIT License
•9•61•2•0•Updated Jun 3, 2024Jun 3, 2024
Multipurpose-Chatbot
Public
A chatbot UI for RAG, multimodal, text completion. (support Transformers, llama.cpp, MLX, vLLM)
chatbot-application gradio-interface llm-inference gradio-python-llm
Python
•
Apache License 2.0
•4•19•0•0•Updated Apr 18, 2024Apr 18, 2024
AdamergeX
Public
Python
•0•10•1•0•Updated Apr 2, 2024Apr 2, 2024
LLM_summeval
Public
use gpt-turbo-3.5 to evaluate abstractive summaries
Python
•1•7•0•0•Updated Mar 20, 2024Mar 20, 2024
HierEncDec
Public
code and data for "A Hierarchical Encoding-Decoding Scheme for Abstractive Multi-document Summarization"
Python
•1•9•2•0•Updated Mar 20, 2024Mar 20, 2024
CLEX
Public
[ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models
large-language-models rotary-position-embedding long-context-modeling
Python
•
MIT License
•11•76•4•0•Updated Mar 12, 2024Mar 12, 2024
multilingual-safety-for-LLMs
Public
[ICLR 2024]Data for "Multilingual Jailbreak Challenges in Large Language Models"
multilingual jailbreak safety llm
MIT License
•6•65•0•0•Updated Mar 7, 2024Mar 7, 2024
CaRing
Public
Neuro-Symbolic Integration Brings Causal and Reliable Reasoning Proofs
Python
•
MIT License
•5•34•0•0•Updated Feb 15, 2024Feb 15, 2024
SOUL
Public
[EMNLP 2023] Code and Data for "SOUL: Towards Sentiment and Opinion Understanding of Language"
natural-language-processing sentiment-analysis
Python
•
MIT License
•2•6•0•0•Updated Jan 17, 2024Jan 17, 2024
TempReason
Public
Python
•2•29•2•0•Updated Jan 11, 2024Jan 11, 2024
CAST
Public
CAST - ACL 2023 Findings
Python
•0•3•1•0•Updated Jan 11, 2024Jan 11, 2024