Captioning Deep Learning Based Encoder-Decoder through Long Short-Term Memory (LSTM)

International Journal of Scientific Innovation (forthcoming)
  Copy   BIBTEX

Abstract

This work demonstrates the implementation and use of an encoder-decoder model to perform a many-to-many mapping of video data to text captions. The many-to-many mapping occurs via an input temporal sequence of video frames to an output sequence of words to form a caption sentence. Data preprocessing, model construction, and model training are discussed. Caption correctness is evaluated using 2-gram BLEU scores across the different splits of the dataset. Specific examples of output captions were shown to demonstrate model generality over the video temporal dimension. Predicted captions were shown to generalize over video action, even in instances where the video scene changed dramatically. Model architecture changes are discussed to improve sentence grammar and correctness

Links

PhilArchive

External links

  • This entry has no external links. Add one.
Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Deep Learning Based Video Captioning through Encoder-Decoder Based Long Short-Term Memory (LSTM).Grimsby Chelsea - forthcoming - International Journal of Advance Computer Science and Application.
Deep Learning Based Video Captioning through Encoder-Decoder Based Long Short-Term Memory (LSTM).Grimsby Chelsea - forthcoming - International Journal of Advanced Computer Science and Applications:1-6.
The Effects of Dance Movement Therapy in the Treatment of Depression.Xing Zhao - 2023 - European Journal for Philosophy of Religion 15 (4):388-402.

Analytics

Added to PP
2024-03-13

Downloads
103 (#174,175)

6 months
103 (#48,203)

Historical graph of downloads
How can I increase my downloads?

Author's Profile

Chelsea Grimsby
ESPAM FORMATION UNIVERSITY

Citations of this work

No citations found.

Add more citations