profile picture

Fengmao Lv

Associate Professor

Education

Ph.D. in Computer Science

University of Electronic Science and Technology of China
2013 - 2018

B.E. in Computer Science

University of Electronic Science and Technology of China
2009 - 2013

About me

I am currently an Associate Professor at the School of Computing and Artificial Intelligence, Southwest Jiaotong University, China. My research interests are in multimodal deep learning, transfer learning and their applications in computer vision, natural language processing and social network analysis.

I have openings for self-motivated undergraduate students, master students and PhD students (co-supervised). Feel free to contact me if you are interested in my research area.

Research Interests

  • Multimodal Deep Learning: multimodal fusion, multimodal recognition
  • Transfer Learning: domain adaptation, zero-shot leaning, few-shot learning
  • Computer Vision: semantic segmentation, video understanding, medical imaging analysis
  • Natural Language Processing: sentiment analysis, aspect term extraction
  • Data Mining: social media analysis, sentiment analysis

    • Selected Publications

  • Attribute-formed class-specific concept space: endowing language bottleneck model with better interpretability and scalability
    • Jianyang Zhang, Qianli Luo, Guowu Yang, Wenjing Yang, Weide Liu, Guosheng Lin, Fengmao Lv*
    IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2025, accepted.
  • MSTI-Plus: Introducing non-sarcasm reference materials to enhance multimodal sarcasm target identification
    • Fengmao Lv, Mengting Xiong, Junlin Fang, Lingli Zhang, Tianze Luo, Weichao Liang and Tianrui Li
    The Web Conference (WWW), 2025, accepted, oral paper.
  • Damage analysis via bidirectional multi-task cascaded multimodal fusion
    • Tao Liang, Siying Wu, Junfeng Fang, Guowu Yang, Wenya Wang, Fengmao Lv*
    The Web Conference (WWW), 2025, accepted, oral paper.
  • Enhancing multi-robot semantic navigation through multimodal chain-of-thought score collaboration
    • Zhixuan Shen, Haonan Luo, Kexun Chen, Fengmao Lv, Tianrui Li
    AAAI Conference on Artificial Intelligence (AAAI), 2025, accepted, oral paper.
  • Adaptive multi-scale language reinforcement for multimodal named entity recognition
    • Enping Li, Tianrui Li, Huaishao Luo, Jielei Chu, Lixin Duan, Fengmao Lv*
    IEEE Transactions on Multimedia, 2025, accepted.
  • Segmenting anything in the dark via depth perception
    • Peng Liu, Jinhong Deng, Lixin Duan, Wen Li, and Fengmao Lv*
    IEEE Transactions on Multimedia, 2025, accepted.
  • Multi-scale CNN-Transformer hybrid network for rail fastener defect detection
    • Jin He, Wei Wang, Fengmao Lv, Haonan Luo, Gexiang Zhang, Zhenghua Chen
    IEEE Transactions on Intelligent Transportation Systems, 2025, accepted.
  • Progressive multimodal pivot learning: towards semantic discordance understanding as humans
    • Junlin Fang, Wenya Wang, Tianze Luo, Yanyong Huang, Fengmao Lv*
    ACM International Conference on Information and Knowledge Management (CIKM), 2024, accepted.
  • Rethinking the effect of uninformative class name in prompt learning
    • Fengmao Lv, Changru Nie, Jianyang Zhang, Guowu Yang, Guosheng Lin, Xiao Wu and Tianrui Li
    ACM International Conference on Multimedia (ACM MM), 2024, accepted.
  • Sentiment-oriented sarcasm integration for video sentiment analysis enhancement with sarcasm assistance
    • Junlin Fang, Wenya Wang, Guosheng Lin, Fengmao Lv*
    ACM International Conference on Multimedia (ACM MM), 2024, accepted.
  • Unified view imputation and feature selection learning for incomplete multi-view data
    • Yanyong Huang, Zongxin Shen, Tianrui Li, Fengmao Lv*
    International Joint Conference on Artificial Intelligence (IJCAI), 2024, accepted.
  • CAFA: Cross-modal attentive feature alignment for cross-domain urban scene segmentation
    • Peng Liu, Yanqi Ge, Lixin Duan, Wen Li, Fengmao Lv*
    IEEE Transactions on Industrial Informatics, 2024, accepted.
  • Transferring multi-modal domain knowledge to uni-modal domain for urban scene segmentation
    • Peng Liu, Yanqi Ge, Lixin Duan, Wen Li, Haonan Luo, Fengmao Lv*
    IEEE Transactions on Intelligent Transportation Systems, 2024, accepted.
  • Pixel is all you need: adversarial spatio-temporal ensembles active learning for salient object detection
    • Zhenyu Wu, Wei Wang, Lin Wang, Yacong Li, Fengmao Lv, Qing Xia, Chenglizhao Chen, Aimin Hao, Shuo Li
    IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024, accepted.
  • C2T-HR3D: Cross-fusion of CNN and transformer for high-speed railway dropper defect detection
    • Jin He, Fengmao Lv, Jun Liu, Shiping Wang, Min Wu, Badong Chen
    IEEE Transactions on Instrumentation and Measurement, 2024, accepted.
  • Source-free domain adaptation with unrestricted source hypothesis
    • Jiujun He, Liang Wu, Chaofan Tao, Fengmao Lv*
    Pattern Recognition, 2024, accepted.
  • Semantic consistent embedding for domain adaptive zero-shot learning
    • Jianyang Zhang, Guowu Yang, Ping Hu, Guosheng Lin, Fengmao Lv*
    IEEE Transactions on Image Processing, 2023, accepted.
  • C2IMUFS: Complementary and consensus learning-based incomplete multi-view unsupervised feature selection
    • Yanyong Huang, Zongxin Shen, Yuxin Cai, Xiuwen Yi, Dongjie Wang, Fengmao Lv, Tianrui Li
    IEEE Transactions on Knowledge and Data Engineering, 2023, accepted.
  • Learning cross-domain semantic-visual relationships for transductive zero-shot learning
    • Fengmao Lv, Jianyang Zhang, Guowu Yang, Lei Feng, Yufeng Yu, Lixin Duan
    Pattern Recognition, 2023, accepted.
  • Self-training vision language BERTs with a unified conditional model
    • Xiaofeng yang, Fengmao Lv, Fayao Liu, Guosheng Lin
    IEEE Transactions on Circuits and Systems for Video Technology, 2023, accepted.
  • Curriculum knowledge distillation for emoji-supervised cross-lingual sentiment analysis
    • Jianyang Zhang, Tao Liang, Mingyang Wan, Guowu Yang, Fengmao Lv*
    Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022, accepted, oral paper.
  • Progressive multi-granularity information propagation for coupled aspect-opinion extraction
    • Fengmao Lv, Tao Liang, Zhihui Fei, Wenya Wang
    IEEE Transactions on Neural Networks and Learning Systems, 2022, accepted.
  • Partial label learning with semantic label representations
    • Shuo He, Lei Feng, Fengmao Lv, Wen Li, Guowu Yang
    ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), 2022, accepted.
  • Expanding large pre-trained unimodal models with multimodal information injection for image-text multimodal classification
    • Tao Liang, Guosheng Lin, Mingyang Wan, Tianrui Li, Guojun Ma, Fengmao Lv*
    IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2022, accepted.
  • Attention is not enough: mitigating the distribution discrepancy in asynchronous multimodal sequence fusion
    • Tao Liang, Guosheng Lin, Lei Feng, Yan Zhang, Fengmao Lv*
    IEEE International Conference on Computer Vision (ICCV), 2021, accepted.
  • Weakly-supervised domain adaptation for aspect term extraction via multi-level interaction transfer
    • Tao Liang, Wenya Wang, Fengmao Lv*
    IEEE Transactions on Neural Networks and Learning Systems, 2021, accepted.
  • Progressive modality reinforcement for human multimodal emotion recognition from unaligned multimodal sequences
    • Fengmao Lv, Xiang Chen, Yanyong Huang, Lixin Duan, Guosheng Lin
    IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2021, accepted.
  • Weakly-supervised cross-domain road scene segmentation via multi-level curriculum adaptation
    • Fengmao Lv, Guosheng Lin, Peng Liu, Guowu Yang, Sinno Jialin Pan, Lixin Duan
    IEEE Transactions on Circuits and Systems for Video Technology, 2021, accepted.
  • TRRNet: tiered relation reasoning for compositional visual question answering
    • Xiaofeng Yang, Guosheng Lin, Fengmao Lv, Fayao Liu
    Proceedings of the European Conference on Computer Vision (ECCV), 2020:414-430.
  • Can cross entropy loss be robust to label noise
    • Lei Feng, Senlin Shu, Zhuoyi Lin, Fengmao Lv, Li Li, Bo An
    Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), 2020:2206-2212.
  • Cross-domain semantic segmentation via domain-invariant interactive relation transfer
    • Fengmao Lv, Tao Liang, Xiang Chen, Guosheng Lin
    Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2020:4334-4343.
  • Constructing self-motivated pyramid curriculums for cross-domain semantic segmentation: a non-adversarial approach
    • Qing Lian, Fengmao Lv, Lixin Duan, Boqing Gong.
    Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2019:6758-6767.

    Service

    Conference PC Member AAAI 2021, CVPR 2021, ICCV 2021, CIKM 2021, AAAI 2022, CVPR 2022, ECCV 2022, AAAI 2023.
    Journal Reviewer IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), IEEE Transactions on Image Processing (TIP), IEEE Transactions on Neural Networks and Learning Systems (TNNLS), IEEE Transactions on Geoscience and Remote Sensing (TGRS), IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), IEEE Transactions on Instrumentation and Measurement (TIM), ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Pattern Recognition (PR), Computer Vision and Image Understanding (CVIU), Knowledge-Based Systems (KBS), Expert Systems With Applications (ESWA), Multimedia Tools and Applications (MTA), IET Computer Vision (IET-CVI), IET Intelligent Transport Systems (IET-ITS), Security and Communication Networks (SCN).

    Group

    Jianyang Zhang, Phd student (From Jul. 2019, co-advised from UESTC)
    Peng Liu, Phd student (From Sept. 2021, co-advised from UESTC)
    Enping Li, Phd student (From Apr. 2022)
    Tao Liang, Research assistant (From Apr. 2019)
    Xiang Chen, Research assistant (From Sept. 2019)
    Changru Nie, Master student (From Sept. 2022)
    Mengting Xiong, Master student (From Sept. 2022)
    Boyu Lu, Master student (From Sept. 2022)
    Junlin Fang, Undergraduate student (From Jan. 2022)
    Zhantao Cao, Phd student (From May. 2019 to Jun. 2020, co-advised from UESTC)
    Defu Liu, Phd student (From Sept. 2019 to Jun. 2022, co-advised from UESTC)
    Jiayi Zhao, Undergraduate student (From Oct. 2019 to Jun. 2020, graduated from SWUFE. Now - Master student @ Yale University, USA)
    Xinyu Zhang, Undergraduate student (From Oct. 2019 to Jun. 2021, graduated from SWUFE. Now - Master student @ Yale University, USA)