Cross-Modal Translation: A Study of English Subtitle Translation from the Perspective of Multimodal Interaction

Rongbin Wang; Yaoqin Xue; Haizhen Wei

doi:doi:10.11648/j.ijalt.20220801.11

| Peer-Reviewed

Cross-Modal Translation: A Study of English Subtitle Translation from the Perspective of Multimodal Interaction

Rongbin Wang, Yaoqin Xue, Haizhen Wei

Published in International Journal of Applied Linguistics and Translation (Volume 8, Issue 1)

Received: 7 December 2021 Accepted: 27 December 2021 Published: 8 January 2022

Views: Downloads:

Download PDF

Share This Article

Twitter
Linked In
Facebook

Abstract

Under the guidance of the Systemic-functional synthetic framework for multimodal discourse analysis, this paper collects multimodal corpus from the classical American TV show Friends and undertakes a thorough qualitative analysis of how cross-modal relations influence the Chinese translation of English subtitles. As is shown, in order to give Chinese viewers a better understanding of English subtitles in multimodal contexts, different translational approaches should be used for the translation of subtitles that are in different cross-modal relations, which are categorized into two general types, that is, complementary relation on the one hand and non-complementary relation on the other hand. The qualitative analysis in this paper finds that though strategies of translation that are appropriate to make use of in the process of English translation into Chinese include amplification, paraphrasing, annotation, direct translation, free translation, and linear translation, the choice of translation approach is directly influenced by cross-modal relations. For example, for subtitles that belong to multimodal discourse of reinforcing complementary relation, it is advisable for translators to make use of translational strategies of amplification, paraphrasing and annotation to highlight the foregrounded meaning expressed by the dominant modality on the one hand, and on the other hand to explicitly and verbally express the background information provided by the backgrounded modality if discourses of two modalities in the same scene form a relation of highlighting. As cross-modal communication becomes continuously widespread and the popularity of English shows keep arising in China, this paper endeavors to provide some useful implications for the translation of English subtitles, which as verbal and auditory discourse is part of a larger multimodal discourse in films.

Published in	International Journal of Applied Linguistics and Translation (Volume 8, Issue 1)
DOI	10.11648/j.ijalt.20220801.11
Page(s)	1-9
Creative Commons	This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution and reproduction in any medium or format, provided the original work is properly cited.
Copyright	Copyright © The Author(s), 2024. Published by Science Publishing Group

Keywords

Multimodal Interaction, Subtitles, Chinese Translation

References

[1]	Christine, G. (2012). Reading the visual: Using Kress and van Leeuwen for a framework. Metaphor, 28-34.
[2]	Chen, HY. (2011). Multi-modal Subtitle Translation: A Case Study of Gone With the Wind. Film Review, 19, 71-73.
[3]	Guo, JZ. (2009). Foreignization and Domestication: Moral Attitude and Discourse Strategy-A Review of the Second Edition of Venuti's Translator's Invisibility. Chinese Translators Journal, 194 (2): 34-38.
[4]	Hu, MX, & Li, ZZ. (2018). Multimodal Speech: Conceptual Analysis and Research Prospects. Journal of PLA Foreign Languages University, 41 (03): 10-18.
[5]	Kan, F. (2014). Film Subtitle Translation from the Perspective of Multi-modal Discourse Analysis. Qiqihar University.
[6]	Liu, CL. (2016). An Interpretation of Domestication and Foreignization Strategies in Film and Television Subtitle Translation-A Case Study of Confessions of a Shopaholic and Friends. Journal of Hunan First Normal University, 16 (6): 91-95.
[7]	Li, XT. (2019). Research on Multimodal Interaction and Chinese Multimodal Interaction. Language Teaching and Research, 4, 45-49.
[8]	Li, YX. (2001). The Strategies of Subtitle Translation. Chinese Translators Journal, 4, 38-40.
[9]	Lv, JY. (2008). Strategies of Film Subtitle Translation-Taking English Film Translation as an example. Film Literature, 5, 109-110.
[10]	Wang, RB & Zhang, JY. (2020). An Empirical Study of the Development of 4-8-year-old Children’s Verbal-gestural Acts. Foreign Language Education, 41 (4): 69-74.
[11]	Wei, QH. (2008). On the Overall Meaning Construction of Multimodal Discourse-Discourse Analysis Based on Multimodal Media Discourse. Journal of Tianjin Foreign Languages University, 6, 16-21.
[12]	Xu, MJ. (2017). A Review of Multi-modal Translation Studies in China. Journal of Guangdong University of Foreign Studies, 28 (2): 40-46.
[13]	Yuan, FL. (2010). Strategies for Translating Subtitles into Chinese-A Case Study of the American Sitcom Friends. Journal of Tianshui Normal University, 30 (1): 126-128.
[14]	Zhang, DL. (2009). Research on Comprehensive Theoretical Framework of Multimodal Discourse Analysis. Chinese Foreign Languages, 6 (1): 24-30.
[15]	Zhang, DL. (2018). A Comprehensive Framework for Multimodal Discourse Analysis from the Perspective of Systemic Functional Theory. Modern Foreign Languages, 41 (6): 731-743.

Cite This Article

Plain Text BibTeX RIS

APA Style

Rongbin Wang, Yaoqin Xue, Haizhen Wei. (2022). Cross-Modal Translation: A Study of English Subtitle Translation from the Perspective of Multimodal Interaction. International Journal of Applied Linguistics and Translation, 8(1), 1-9. https://doi.org/10.11648/j.ijalt.20220801.11

Copy | Download

ACS Style

Rongbin Wang; Yaoqin Xue; Haizhen Wei. Cross-Modal Translation: A Study of English Subtitle Translation from the Perspective of Multimodal Interaction. Int. J. Appl. Linguist. Transl. 2022, 8(1), 1-9. doi: 10.11648/j.ijalt.20220801.11

Copy | Download

AMA Style

Rongbin Wang, Yaoqin Xue, Haizhen Wei. Cross-Modal Translation: A Study of English Subtitle Translation from the Perspective of Multimodal Interaction. Int J Appl Linguist Transl. 2022;8(1):1-9. doi: 10.11648/j.ijalt.20220801.11

Copy | Download

@article{10.11648/j.ijalt.20220801.11,
  author = {Rongbin Wang and Yaoqin Xue and Haizhen Wei},
  title = {Cross-Modal Translation: A Study of English Subtitle Translation from the Perspective of Multimodal Interaction},
  journal = {International Journal of Applied Linguistics and Translation},
  volume = {8},
  number = {1},
  pages = {1-9},
  doi = {10.11648/j.ijalt.20220801.11},
  url = {https://doi.org/10.11648/j.ijalt.20220801.11},
  eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.ijalt.20220801.11},
  abstract = {Under the guidance of the Systemic-functional synthetic framework for multimodal discourse analysis, this paper collects multimodal corpus from the classical American TV show Friends and undertakes a thorough qualitative analysis of how cross-modal relations influence the Chinese translation of English subtitles. As is shown, in order to give Chinese viewers a better understanding of English subtitles in multimodal contexts, different translational approaches should be used for the translation of subtitles that are in different cross-modal relations, which are categorized into two general types, that is, complementary relation on the one hand and non-complementary relation on the other hand. The qualitative analysis in this paper finds that though strategies of translation that are appropriate to make use of in the process of English translation into Chinese include amplification, paraphrasing, annotation, direct translation, free translation, and linear translation, the choice of translation approach is directly influenced by cross-modal relations. For example, for subtitles that belong to multimodal discourse of reinforcing complementary relation, it is advisable for translators to make use of translational strategies of amplification, paraphrasing and annotation to highlight the foregrounded meaning expressed by the dominant modality on the one hand, and on the other hand to explicitly and verbally express the background information provided by the backgrounded modality if discourses of two modalities in the same scene form a relation of highlighting. As cross-modal communication becomes continuously widespread and the popularity of English shows keep arising in China, this paper endeavors to provide some useful implications for the translation of English subtitles, which as verbal and auditory discourse is part of a larger multimodal discourse in films.},
 year = {2022}
}

Copy | Download

TY  - JOUR
T1  - Cross-Modal Translation: A Study of English Subtitle Translation from the Perspective of Multimodal Interaction
AU  - Rongbin Wang
AU  - Yaoqin Xue
AU  - Haizhen Wei
Y1  - 2022/01/08
PY  - 2022
N1  - https://doi.org/10.11648/j.ijalt.20220801.11
DO  - 10.11648/j.ijalt.20220801.11
T2  - International Journal of Applied Linguistics and Translation
JF  - International Journal of Applied Linguistics and Translation
JO  - International Journal of Applied Linguistics and Translation
SP  - 1
EP  - 9
PB  - Science Publishing Group
SN  - 2472-1271
UR  - https://doi.org/10.11648/j.ijalt.20220801.11
AB  - Under the guidance of the Systemic-functional synthetic framework for multimodal discourse analysis, this paper collects multimodal corpus from the classical American TV show Friends and undertakes a thorough qualitative analysis of how cross-modal relations influence the Chinese translation of English subtitles. As is shown, in order to give Chinese viewers a better understanding of English subtitles in multimodal contexts, different translational approaches should be used for the translation of subtitles that are in different cross-modal relations, which are categorized into two general types, that is, complementary relation on the one hand and non-complementary relation on the other hand. The qualitative analysis in this paper finds that though strategies of translation that are appropriate to make use of in the process of English translation into Chinese include amplification, paraphrasing, annotation, direct translation, free translation, and linear translation, the choice of translation approach is directly influenced by cross-modal relations. For example, for subtitles that belong to multimodal discourse of reinforcing complementary relation, it is advisable for translators to make use of translational strategies of amplification, paraphrasing and annotation to highlight the foregrounded meaning expressed by the dominant modality on the one hand, and on the other hand to explicitly and verbally express the background information provided by the backgrounded modality if discourses of two modalities in the same scene form a relation of highlighting. As cross-modal communication becomes continuously widespread and the popularity of English shows keep arising in China, this paper endeavors to provide some useful implications for the translation of English subtitles, which as verbal and auditory discourse is part of a larger multimodal discourse in films.
VL  - 8
IS  - 1
ER  -

Copy | Download

Author Information

Rongbin Wang

School of Foreign Language Shanxi University, Taiyuan, China
Yaoqin Xue

School of Foreign Language Shanxi University, Taiyuan, China
Haizhen Wei

School of Foreign Language Shanxi University, Taiyuan, China

Download PDF

Sections

Plain Text BibTeX RIS

APA Style

Rongbin Wang, Yaoqin Xue, Haizhen Wei. (2022). Cross-Modal Translation: A Study of English Subtitle Translation from the Perspective of Multimodal Interaction. International Journal of Applied Linguistics and Translation, 8(1), 1-9. https://doi.org/10.11648/j.ijalt.20220801.11

Copy | Download

ACS Style

Rongbin Wang; Yaoqin Xue; Haizhen Wei. Cross-Modal Translation: A Study of English Subtitle Translation from the Perspective of Multimodal Interaction. Int. J. Appl. Linguist. Transl. 2022, 8(1), 1-9. doi: 10.11648/j.ijalt.20220801.11

Copy | Download

AMA Style

Rongbin Wang, Yaoqin Xue, Haizhen Wei. Cross-Modal Translation: A Study of English Subtitle Translation from the Perspective of Multimodal Interaction. Int J Appl Linguist Transl. 2022;8(1):1-9. doi: 10.11648/j.ijalt.20220801.11

Copy | Download

@article{10.11648/j.ijalt.20220801.11,
  author = {Rongbin Wang and Yaoqin Xue and Haizhen Wei},
  title = {Cross-Modal Translation: A Study of English Subtitle Translation from the Perspective of Multimodal Interaction},
  journal = {International Journal of Applied Linguistics and Translation},
  volume = {8},
  number = {1},
  pages = {1-9},
  doi = {10.11648/j.ijalt.20220801.11},
  url = {https://doi.org/10.11648/j.ijalt.20220801.11},
  eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.ijalt.20220801.11},
  abstract = {Under the guidance of the Systemic-functional synthetic framework for multimodal discourse analysis, this paper collects multimodal corpus from the classical American TV show Friends and undertakes a thorough qualitative analysis of how cross-modal relations influence the Chinese translation of English subtitles. As is shown, in order to give Chinese viewers a better understanding of English subtitles in multimodal contexts, different translational approaches should be used for the translation of subtitles that are in different cross-modal relations, which are categorized into two general types, that is, complementary relation on the one hand and non-complementary relation on the other hand. The qualitative analysis in this paper finds that though strategies of translation that are appropriate to make use of in the process of English translation into Chinese include amplification, paraphrasing, annotation, direct translation, free translation, and linear translation, the choice of translation approach is directly influenced by cross-modal relations. For example, for subtitles that belong to multimodal discourse of reinforcing complementary relation, it is advisable for translators to make use of translational strategies of amplification, paraphrasing and annotation to highlight the foregrounded meaning expressed by the dominant modality on the one hand, and on the other hand to explicitly and verbally express the background information provided by the backgrounded modality if discourses of two modalities in the same scene form a relation of highlighting. As cross-modal communication becomes continuously widespread and the popularity of English shows keep arising in China, this paper endeavors to provide some useful implications for the translation of English subtitles, which as verbal and auditory discourse is part of a larger multimodal discourse in films.},
 year = {2022}
}

Copy | Download

TY  - JOUR
T1  - Cross-Modal Translation: A Study of English Subtitle Translation from the Perspective of Multimodal Interaction
AU  - Rongbin Wang
AU  - Yaoqin Xue
AU  - Haizhen Wei
Y1  - 2022/01/08
PY  - 2022
N1  - https://doi.org/10.11648/j.ijalt.20220801.11
DO  - 10.11648/j.ijalt.20220801.11
T2  - International Journal of Applied Linguistics and Translation
JF  - International Journal of Applied Linguistics and Translation
JO  - International Journal of Applied Linguistics and Translation
SP  - 1
EP  - 9
PB  - Science Publishing Group
SN  - 2472-1271
UR  - https://doi.org/10.11648/j.ijalt.20220801.11
AB  - Under the guidance of the Systemic-functional synthetic framework for multimodal discourse analysis, this paper collects multimodal corpus from the classical American TV show Friends and undertakes a thorough qualitative analysis of how cross-modal relations influence the Chinese translation of English subtitles. As is shown, in order to give Chinese viewers a better understanding of English subtitles in multimodal contexts, different translational approaches should be used for the translation of subtitles that are in different cross-modal relations, which are categorized into two general types, that is, complementary relation on the one hand and non-complementary relation on the other hand. The qualitative analysis in this paper finds that though strategies of translation that are appropriate to make use of in the process of English translation into Chinese include amplification, paraphrasing, annotation, direct translation, free translation, and linear translation, the choice of translation approach is directly influenced by cross-modal relations. For example, for subtitles that belong to multimodal discourse of reinforcing complementary relation, it is advisable for translators to make use of translational strategies of amplification, paraphrasing and annotation to highlight the foregrounded meaning expressed by the dominant modality on the one hand, and on the other hand to explicitly and verbally express the background information provided by the backgrounded modality if discourses of two modalities in the same scene form a relation of highlighting. As cross-modal communication becomes continuously widespread and the popularity of English shows keep arising in China, this paper endeavors to provide some useful implications for the translation of English subtitles, which as verbal and auditory discourse is part of a larger multimodal discourse in films.
VL  - 8
IS  - 1
ER  -

Copy | Download