Awesome Multimodal Time Series Analysis

A curated list of paper, code, data, and other resources focus on multimodal time series analysis.

🚀 This repo will be continuously updated.
⭐️ Please Star it if you find it helpful!
🤝 Feel free to submit a PR or open an issue with suggestions or improvements.

---

Table of Contents

• Time Series Forecasting
• Time Series Reasoning
• Time Series Captioning
• Time Series Alignment

---

Time Series Forecasting

Title	Venue	Month	Code
Explainable Multi-modal Time Series Prediction with LLM-in-the-Loop	arXiv	2025.03	None
Evaluating System 1 vs. 2 Reasoning Approaches for Zero-Shot Time-Series Forecasting: A Benchmark and Insights	arXiv	2025.02	Github
TimeCAP: Learning to Contextualize, Augment, and Predict Time Series Events with Large Language Model Agents	AAAI	2025.02	None
Language in the Flow of Time: Time-Series-Paired Texts Weaved into a Unified Temporal Narrative	arXiv	2025.02	None
ChatTime: A Unified Multimodal Time Series Foundation Model Bridging Numerical and Textual Data	AAAI	2024.12	Github
Multi-Modal Forecaster: Jointly Predicting Time Series and Textual Data	arXiv	2024.11	Github
Context is Key: A Benchmark for Forecasting with Essential Textual Information	arXiv	2024.10	Github
From News to Forecast: Integrating Event Analysis in LLM-Based Time Series Forecasting with Reflection	NeurIPS	2024.09	Github
Time-MMD: Multi-Domain Multimodal Dataset for Time Series Analysis	NeurIPS	2024.06	Github
Beyond Trend and Periodicity: Guiding Time Series Forecasting with Textual Cues	arXiv	2024.05	Github
Language Models Still Struggle to Zero-shot Reason about Time Series	arXiv	2024.04	Github
Towards Explainable Traffic Flow Prediction with Large Language Models	arXiv	2024.04	Github
GPT4MTS: Prompt-Based Large Language Model for Multimodal Time-Series Forecasting	AAAI	2024.03	Github

Time Series Reasoning

Title	Venue	Month	Code
Time-MQA: Time Series Multi-Task Question Answering with Context Enhancement	arXiv	2025.02	None
Position: Empowering Time Series Reasoning with Multimodal LLMs	arXiv	2025.02	None
ChatTime: A Unified Multimodal Time Series Foundation Model Bridging Numerical and Textual Data	AAAI	2024.12	Github
ChatTS: Aligning Time Series with LLMs via Synthetic Data for Enhanced Understanding and Reasoning	arXiv	2024.12	Github
A Picture is Worth A Thousand Numbers: Enabling LLMs Reason about Time Series via Visualization	arXiv	2024.11	Github
TimeSeriesExam: A Time Series Understanding Exam	arXiv	2024.10	HuggingFace
Can LLMs Understand Time Series Anomalies?	ICLR	2024.10	Github
Beyond Forecasting: Compositional Time Series Reasoning for End-to-End Task Execution	arXiv	2024.10	None
Towards Time Series Reasoning with LLMs	arXiv	2024.09	None
Evaluating Large Language Models on Time Series Feature Understanding: A Comprehensive Taxonomy and Benchmark	arXiv	2024.04	None
Language Models Still Struggle to Zero-shot Reason about Time Series	arXiv	2024.04	Github

Time Series Captioning

Title	Venue	Month	Code
Time Series Language Model for Descriptive Caption Generation	arXiv	2025.01	None
Decoding Time Series with LLMs: A Multi-Agent Framework for Cross-Domain Annotation	arXiv	2024.10	None
Towards Time Series Reasoning with LLMs	arXiv	2024.09	None

Time Series Alignment

Title	Venue	Month	Code
CLaSP: Learning Concepts for Time-Series Signals from Natural Language Supervision	arXiv	2024.11	None