This is an official repository for "Harnessing Vision Models for Time Series Analysis: A Survey".
See the codeThis repository tracks the latest paper on Vision Models for Time series Analysis and serves as the official repository for Harnessing Vision Models for Time Series Analysis: A Survey. This repository is actively maintained by D2I Group@UH. We will update our reposititory and survey regularly.
🌟 [News] Our survey paper is accepted by IJCAI 2025 survey track!
🌟 You're welcome to suggest new Vision4TS papers by contacting jni7 [at] uh [dot] edu!
🌟 Please consider citing our survey paper if you find it helpful :), and feel free to share this repository with others!
🏆 Contribution | 📌 Taxonomy | ⚙️ Package | 🔗 Citation
Time series analysis has witnessed the inspiring development from traditional autoregressive models, deep learning models, to recent Transformers and Large Language Models (LLMs). Efforts in leveraging vision models for time series analysis have also been made along the way but are less visible to the community due to the predominant research on sequence modeling in this domain. However, the discrepancy between continuous time series and the discrete token space of LLMs, and the challenges in explicitly modeling the correlations of variates in multivariate time series have shifted some research attentions to the equally successful Large Vision Models (LVMs) and Vision Language Models (VLMs). To fill the blank in the existing literature, this survey discusses the advantages of vision models over LLMs in time series analysis and provides a comprehensive and in-depth overview of the existing methods.
Taxonomy are proposed as a dual view of Time Series to Image Transformation and Imaged Time Series Modeling. For the former, primary methods for imaging UTS or MTS are described and remarked on their pros and cons. For the latter, the existing methods are classified by conventional vision models, Large Vision Models (LVMs) and Large Multimodal Models (LMMs).
The overall structure of our survey follows the general process of applying vision models for time series analysis as delineated in Figure 1. Based on the proposed dual view taxonomy, primary imaging methods on time series in Figure 2 and imaged modelling solutions in Figure 3, are reviewed in this survey, followed by the discussion including pre- & post-processing involved in this framework and future directions in this promising field.
This package provides the common visualization methods for time series, including Line Plot, Heatmap, Spectrogram (STFT, Wavelet Transform, Filterbank), GAP and RP. We have uploaded our code package to PyPI, run the following command for installation.
pip install time2img
Our code is compatible with all common benchmarks found in Google Drive. You can run example to reproduce our illustration of different time series imaging methods (Figure 2) in the paper.
🗓️ 2026 ---
🗓️ 2025 ---
🗓️ 2024 ---
🗓️ 2023 ---
🗓️ 2022 ---
🗓️ 2021 ---
🗓️ 2020 ---
🗓️ Before 2020 ---
TS-Recover denotes recovering time series from predicted images. $*$: the method has been used to model the individual UTSs of an MTS. $^{\natural}$ : a new pre-trained model was proposed in the work. $^{\flat}$ : when pre-trained models were unused, Fine-tune refers to train a task-specific model from scratch.
| Method | TS-Type | Imaging | Multimodal | Model | Pre-trained | Fine-tune | Prompt | TS-Recover | Task | Domain | Code |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Kumar et al., 2005 | UTS | TS-Bitmap | ✘ | Multiple | ✘ | ✘ | ✘ | ✘ | Multiple | General | ✘ |
| Silva et al., 2013 | UTS | RP | ✘ | K-NN | ✘ | ✘ | ✘ | ✘ | Classification | General | ✘ |
| Souza et al., 2014 | UTS | RP | ✘ | SVM | ✘ | $✔^\flat$ | ✘ | ✘ | Classification | General | ✘ |
| Wang and Oates, 2015a | UTS | GAF | ✘ | CNN | ✘ | $✔^\flat$ | ✘ | $✔$ | Classification | General | ✘ |
| Wang and Oates, 2015b | UTS | GAF | ✘ | CNN | ✘ | $✔^\flat$ | ✘ | $✔$ | Classification & Imputation | General | ✘ |
| Ma et al., 2017 | MTS | Heatmap | ✘ | CNN | ✘ | $✔^\flat$ | ✘ | $✔$ | Forecasting | Traffic | ✘ |
| Hatami et al., 2018 | UTS | RP | ✘ | CNN | ✘ | $✔^\flat$ | ✘ | ✘ | Classification | General | ✘ |
| Yazdanbakhsh and Dick, 2019 | MTS | Heatmap | ✘ | CNN | ✘ | $✔^\flat$ | ✘ | ✘ | Classification | General | ✔ |
| MSCRED | MTS | Other | ✘ | ConvLSTM | ✘ | $✔^\flat$ | ✘ | ✘ | Anomaly | General | ✔ |
| Li et al., 2020 | UTS | RP | ✘ | CNN | $✔$ | $✔$ | ✘ | ✘ | Forecasting | General | ✔ |
| Cohen et al., 2020 | UTS | LinePlot | ✘ | Ensemble | ✘ | $✔^\flat$ | ✘ | ✘ | Classification | Finance | ✘ |
| Barra et al., 2020 | UTS | GAF | ✘ | CNN | ✘ | $✔^\flat$ | ✘ | ✘ | Classification | Finance | ✘ |
| VisualAE | UTS | LinePlot | ✘ | CNN | ✘ | $✔^\flat$ | ✘ | $✔$ | Forecasting | Finance | ✘ |
| Zeng et al., 2021 | MTS | Heatmap | ✘ | CNN, LSTM | ✘ | $✔^\flat$ | ✘ | $✔$ | Forecasting | Finance | ✘ |
| AST | UTS | Spectrogram | ✘ | DeiT | $✔$ | $✔$ | ✘ | ✘ | Classification | Audio | ✔ |
| TTS-GAN | MTS | Heatmap | ✘ | ViT | ✘ | $✔^\flat$ | ✘ | $✔$ | Ts-Generation | Health | ✔ |
| SSAST | UTS | Spectrogram | ✘ | ViT | $✔^\natural$ | $✔$ | ✘ | ✘ | Classification | Audio | ✔ |
| MAE-AST | UTS | Spectrogram | ✘ | MAE | $✔^\natural$ | $✔$ | ✘ | ✘ | Classification | Audio | ✔ |
| AST-SED | UTS | Spectrogram | ✘ | SSAST, GRU | $✔$ | $✔$ | ✘ | ✘ | EventDetection | Audio | ✘ |
| Jin et al., 2023 | UTS | LinePlot | ✘ | CNN | $✔$ | $✔$ | ✘ | ✘ | Classification | Physics | ✘ |
| ForCNN | UTS | LinePlot | ✘ | CNN | ✘ | $✔^\flat$ | ✘ | ✘ | Forecasting | General | ✘ |
| Vit-num-spec | UTS | Spectrogram | ✘ | ViT | ✘ | $✔^\flat$ | ✘ | ✘ | Forecasting | Finance | ✘ |
| ViTST | MTS | LinePlot | ✘ | Swin | $✔$ | $✔$ | ✘ | ✘ | Classification | General | ✔ |
| MV-DTSA | UTS* | LinePlot | ✘ | CNN | ✘ | $✔^\flat$ | ✘ | $✔$ | Forecasting | General | ✔ |
| TimesNet | MTS | Heatmap | ✘ | CNN | ✘ | $✔^\flat$ | ✘ | $✔$ | Multiple | General | ✔ |
| ITF-TAD | UTS | Spectrogram | ✘ | CNN | $✔$ | ✘ | ✘ | ✘ | Anomaly | General | ✘ |
| Kaewrakmuk et al., 2024 | UTS | GAF | ✘ | CNN | $✔$ | $✔$ | ✘ | ✘ | Classification | Sensing | ✘ |
| HCR-AdaAD | MTS | RP | ✘ | CNN, GNN | ✘ | $✔^\flat$ | ✘ | ✘ | Anomaly | General | ✘ |
| FIRTS | UTS | Other | ✘ | CNN | ✘ | $✔^\flat$ | ✘ | ✘ | Classification | General | ✔ |
| CAFO | MTS | RP | ✘ | CNN, ViT | ✘ | $✔^\flat$ | ✘ | ✘ | Explanation | General | ✔ |
| ViTime | UTS* | LinePlot | ✘ | ViT | $✔^\natural$ | $✔$ | ✘ | $✔$ | Forecasting | General | ✔ |
| ImagenTime | MTS | Other | ✘ | CNN | ✘ | $✔^\flat$ | ✘ | $✔$ | Ts-Generation | General | ✔ |
| TimEHR | MTS | Heapmap | ✘ | CNN | ✘ | $✔^\flat$ | ✘ | $✔$ | Ts-Generation | Health | ✔ |
| VisionTS | UTS* | Heatmap | ✘ | MAE | $✔$ | $✔$ | ✘ | $✔$ | Forecasting | General | ✔ |
| InsightMiner | UTS | LinePlot | $✔$ | LLaVA | $✔$ | $✔$ | $✔$ | ✘ | Txt-Generation | General | ✘ |
| Wimmer and Rekabsaz, 2023 | MTS | LinePlot | $✔$ | CLIP, LSTM | $✔$ | $✔$ | ✘ | ✘ | Classification | Finance | ✘ |
| Dixit et al., 2024 | UTS | Spectrogram | $✔$ | GPT4o, Gemini & Claude3 | $✔$ | ✘ | $✔$ | ✘ | Classification | Audio | ✘ |
| Daswani et al., 2024 | MTS | LinePlot | $✔$ | GPT4o, Gemini | $✔$ | ✘ | $✔$ | ✘ | Multiple | General | ✘ |
| TAMA | UTS | LinePlot | $✔$ | GPT4o | $✔$ | ✘ | $✔$ | ✘ | Anomaly | General | ✘ |
| Prithyani et al., 2024 | MTS | LinePlot | $✔$ | LLaVA | $✔$ | $✔$ | $✔$ | ✘ | Classification | General | ✔ |
@inproceedings{ni2025harnessing,
title={Harnessing Vision Models for Time Series Analysis: A Survey},
author={Ni, Jingchao and Zhao, Ziming and Shen, ChengAo and Tong, Hanghang and Song, Dongjin and Cheng, Wei and Luo, Dongsheng and Chen, Haifeng},
booktitle={IJCAI},
year={2025}
}
Python
100.0%
This is an official repository for "Harnessing Vision Models for Time Series Analysis: A Survey".
See the codeThis repository tracks the latest paper on Vision Models for Time series Analysis and serves as the official repository for Harnessing Vision Models for Time Series Analysis: A Survey. This repository is actively maintained by D2I Group@UH. We will update our reposititory and survey regularly.
🌟 [News] Our survey paper is accepted by IJCAI 2025 survey track!
🌟 You're welcome to suggest new Vision4TS papers by contacting jni7 [at] uh [dot] edu!
🌟 Please consider citing our survey paper if you find it helpful :), and feel free to share this repository with others!
🏆 Contribution | 📌 Taxonomy | ⚙️ Package | 🔗 Citation
Time series analysis has witnessed the inspiring development from traditional autoregressive models, deep learning models, to recent Transformers and Large Language Models (LLMs). Efforts in leveraging vision models for time series analysis have also been made along the way but are less visible to the community due to the predominant research on sequence modeling in this domain. However, the discrepancy between continuous time series and the discrete token space of LLMs, and the challenges in explicitly modeling the correlations of variates in multivariate time series have shifted some research attentions to the equally successful Large Vision Models (LVMs) and Vision Language Models (VLMs). To fill the blank in the existing literature, this survey discusses the advantages of vision models over LLMs in time series analysis and provides a comprehensive and in-depth overview of the existing methods.
Taxonomy are proposed as a dual view of Time Series to Image Transformation and Imaged Time Series Modeling. For the former, primary methods for imaging UTS or MTS are described and remarked on their pros and cons. For the latter, the existing methods are classified by conventional vision models, Large Vision Models (LVMs) and Large Multimodal Models (LMMs).
The overall structure of our survey follows the general process of applying vision models for time series analysis as delineated in Figure 1. Based on the proposed dual view taxonomy, primary imaging methods on time series in Figure 2 and imaged modelling solutions in Figure 3, are reviewed in this survey, followed by the discussion including pre- & post-processing involved in this framework and future directions in this promising field.
This package provides the common visualization methods for time series, including Line Plot, Heatmap, Spectrogram (STFT, Wavelet Transform, Filterbank), GAP and RP. We have uploaded our code package to PyPI, run the following command for installation.
pip install time2img
Our code is compatible with all common benchmarks found in Google Drive. You can run example to reproduce our illustration of different time series imaging methods (Figure 2) in the paper.
🗓️ 2026 ---
🗓️ 2025 ---
🗓️ 2024 ---
🗓️ 2023 ---
🗓️ 2022 ---
🗓️ 2021 ---
🗓️ 2020 ---
🗓️ Before 2020 ---
TS-Recover denotes recovering time series from predicted images. $*$: the method has been used to model the individual UTSs of an MTS. $^{\natural}$ : a new pre-trained model was proposed in the work. $^{\flat}$ : when pre-trained models were unused, Fine-tune refers to train a task-specific model from scratch.
| Method | TS-Type | Imaging | Multimodal | Model | Pre-trained | Fine-tune | Prompt | TS-Recover | Task | Domain | Code |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Kumar et al., 2005 | UTS | TS-Bitmap | ✘ | Multiple | ✘ | ✘ | ✘ | ✘ | Multiple | General | ✘ |
| Silva et al., 2013 | UTS | RP | ✘ | K-NN | ✘ | ✘ | ✘ | ✘ | Classification | General | ✘ |
| Souza et al., 2014 | UTS | RP | ✘ | SVM | ✘ | $✔^\flat$ | ✘ | ✘ | Classification | General | ✘ |
| Wang and Oates, 2015a | UTS | GAF | ✘ | CNN | ✘ | $✔^\flat$ | ✘ | $✔$ | Classification | General | ✘ |
| Wang and Oates, 2015b | UTS | GAF | ✘ | CNN | ✘ | $✔^\flat$ | ✘ | $✔$ | Classification & Imputation | General | ✘ |
| Ma et al., 2017 | MTS | Heatmap | ✘ | CNN | ✘ | $✔^\flat$ | ✘ | $✔$ | Forecasting | Traffic | ✘ |
| Hatami et al., 2018 | UTS | RP | ✘ | CNN | ✘ | $✔^\flat$ | ✘ | ✘ | Classification | General | ✘ |
| Yazdanbakhsh and Dick, 2019 | MTS | Heatmap | ✘ | CNN | ✘ | $✔^\flat$ | ✘ | ✘ | Classification | General | ✔ |
| MSCRED | MTS | Other | ✘ | ConvLSTM | ✘ | $✔^\flat$ | ✘ | ✘ | Anomaly | General | ✔ |
| Li et al., 2020 | UTS | RP | ✘ | CNN | $✔$ | $✔$ | ✘ | ✘ | Forecasting | General | ✔ |
| Cohen et al., 2020 | UTS | LinePlot | ✘ | Ensemble | ✘ | $✔^\flat$ | ✘ | ✘ | Classification | Finance | ✘ |
| Barra et al., 2020 | UTS | GAF | ✘ | CNN | ✘ | $✔^\flat$ | ✘ | ✘ | Classification | Finance | ✘ |
| VisualAE | UTS | LinePlot | ✘ | CNN | ✘ | $✔^\flat$ | ✘ | $✔$ | Forecasting | Finance | ✘ |
| Zeng et al., 2021 | MTS | Heatmap | ✘ | CNN, LSTM | ✘ | $✔^\flat$ | ✘ | $✔$ | Forecasting | Finance | ✘ |
| AST | UTS | Spectrogram | ✘ | DeiT | $✔$ | $✔$ | ✘ | ✘ | Classification | Audio | ✔ |
| TTS-GAN | MTS | Heatmap | ✘ | ViT | ✘ | $✔^\flat$ | ✘ | $✔$ | Ts-Generation | Health | ✔ |
| SSAST | UTS | Spectrogram | ✘ | ViT | $✔^\natural$ | $✔$ | ✘ | ✘ | Classification | Audio | ✔ |
| MAE-AST | UTS | Spectrogram | ✘ | MAE | $✔^\natural$ | $✔$ | ✘ | ✘ | Classification | Audio | ✔ |
| AST-SED | UTS | Spectrogram | ✘ | SSAST, GRU | $✔$ | $✔$ | ✘ | ✘ | EventDetection | Audio | ✘ |
| Jin et al., 2023 | UTS | LinePlot | ✘ | CNN | $✔$ | $✔$ | ✘ | ✘ | Classification | Physics | ✘ |
| ForCNN | UTS | LinePlot | ✘ | CNN | ✘ | $✔^\flat$ | ✘ | ✘ | Forecasting | General | ✘ |
| Vit-num-spec | UTS | Spectrogram | ✘ | ViT | ✘ | $✔^\flat$ | ✘ | ✘ | Forecasting | Finance | ✘ |
| ViTST | MTS | LinePlot | ✘ | Swin | $✔$ | $✔$ | ✘ | ✘ | Classification | General | ✔ |
| MV-DTSA | UTS* | LinePlot | ✘ | CNN | ✘ | $✔^\flat$ | ✘ | $✔$ | Forecasting | General | ✔ |
| TimesNet | MTS | Heatmap | ✘ | CNN | ✘ | $✔^\flat$ | ✘ | $✔$ | Multiple | General | ✔ |
| ITF-TAD | UTS | Spectrogram | ✘ | CNN | $✔$ | ✘ | ✘ | ✘ | Anomaly | General | ✘ |
| Kaewrakmuk et al., 2024 | UTS | GAF | ✘ | CNN | $✔$ | $✔$ | ✘ | ✘ | Classification | Sensing | ✘ |
| HCR-AdaAD | MTS | RP | ✘ | CNN, GNN | ✘ | $✔^\flat$ | ✘ | ✘ | Anomaly | General | ✘ |
| FIRTS | UTS | Other | ✘ | CNN | ✘ | $✔^\flat$ | ✘ | ✘ | Classification | General | ✔ |
| CAFO | MTS | RP | ✘ | CNN, ViT | ✘ | $✔^\flat$ | ✘ | ✘ | Explanation | General | ✔ |
| ViTime | UTS* | LinePlot | ✘ | ViT | $✔^\natural$ | $✔$ | ✘ | $✔$ | Forecasting | General | ✔ |
| ImagenTime | MTS | Other | ✘ | CNN | ✘ | $✔^\flat$ | ✘ | $✔$ | Ts-Generation | General | ✔ |
| TimEHR | MTS | Heapmap | ✘ | CNN | ✘ | $✔^\flat$ | ✘ | $✔$ | Ts-Generation | Health | ✔ |
| VisionTS | UTS* | Heatmap | ✘ | MAE | $✔$ | $✔$ | ✘ | $✔$ | Forecasting | General | ✔ |
| InsightMiner | UTS | LinePlot | $✔$ | LLaVA | $✔$ | $✔$ | $✔$ | ✘ | Txt-Generation | General | ✘ |
| Wimmer and Rekabsaz, 2023 | MTS | LinePlot | $✔$ | CLIP, LSTM | $✔$ | $✔$ | ✘ | ✘ | Classification | Finance | ✘ |
| Dixit et al., 2024 | UTS | Spectrogram | $✔$ | GPT4o, Gemini & Claude3 | $✔$ | ✘ | $✔$ | ✘ | Classification | Audio | ✘ |
| Daswani et al., 2024 | MTS | LinePlot | $✔$ | GPT4o, Gemini | $✔$ | ✘ | $✔$ | ✘ | Multiple | General | ✘ |
| TAMA | UTS | LinePlot | $✔$ | GPT4o | $✔$ | ✘ | $✔$ | ✘ | Anomaly | General | ✘ |
| Prithyani et al., 2024 | MTS | LinePlot | $✔$ | LLaVA | $✔$ | $✔$ | $✔$ | ✘ | Classification | General | ✔ |
@inproceedings{ni2025harnessing,
title={Harnessing Vision Models for Time Series Analysis: A Survey},
author={Ni, Jingchao and Zhao, Ziming and Shen, ChengAo and Tong, Hanghang and Song, Dongjin and Cheng, Wei and Luo, Dongsheng and Chen, Haifeng},
booktitle={IJCAI},
year={2025}
}
Python
100.0%