SCIENCE CHINA Information Sciences, Volume 63 , Issue 7 : 174101(2020) https://doi.org/10.1007/s11432-018-9908-4

Recursive narrative alignment for movie narrating

More info
  • ReceivedDec 24, 2018
  • AcceptedMay 6, 2019
  • PublishedSep 16, 2019


There is no abstract available for this article.


This work was partly funded by National Natural Science Foundation of China (Grant Nos. 61872225, 61876098, 61573219), Natural Science Foundation of Shandong Province (Grant No. ZR2015FM010), Project of Science and Technology Plan of Shandong Higher Education Institutions Program (Grant No. J15LN20), and Project of Shandong Province Medical and Health Technology Development Program (Grant No. 2016WS0577).


Videos and other supplemental documents.


[1] Johnson J, Hariharan B, van der Maaten L, et al. Inferring and executing programs for visual reasoning. In: Proceedings of IEEE International Conference on Computer Vision (ICCV), 2017. Google Scholar

[2] Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. 2014,. arXiv Google Scholar

[3] Ren S, He K, Girshick R. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks.. IEEE Trans Pattern Anal Mach Intell, 2017, 39: 1137-1149 CrossRef PubMed Google Scholar

[4] Zhu Y K, Kiros R, Zemel R, et al. Aligning books and movies: towards story-like visual explanations by watching movies and reading books. In: Proceedings of IEEE International Conference on Computer Vision (ICCV), 2015. Google Scholar

[5] Sutskever I, Vinyals O, Le Q V. Sequence to sequence learning with neural networks. 2014,. arXiv Google Scholar

[6] Sharma S, Asri L E, Schulz H, et al. Relevance of unsupervised metrics in task-oriented dialogue for evaluating natural language generation. 2017,. arXiv Google Scholar

  • Figure 1

    (Color online) Our recursive narrative alignment framework comprises three modules: visual cue alignment, story context alignment, and emotive style alignment. The framework recursively generates sentences to span the movie narrative in a film shot of unlimited size.