| mplug-owl: Modularization empowers large language models with multimodality Q Ye, H Xu, G Xu, J Ye, M Yan, Y Zhou, J Wang, A Hu, P Shi, Y Shi, C Li, ... arXiv preprint arXiv:2304.14178, 2023 | 805 | 2023 |
| mplug-owl2: Revolutionizing multi-modal large language model with modality collaboration Q Ye, H Xu, J Ye, M Yan, A Hu, H Liu, Q Qian, J Zhang, F Huang Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern …, 2024 | 319 | 2024 |
| X-clip: End-to-end multi-grained contrastive learning for video-text retrieval Y Ma, G Xu, X Sun, M Yan, J Zhang, R Ji Proceedings of the 30th ACM International Conference on Multimedia, 638-647, 2022 | 262 | 2022 |
| mplug-2: A modularized multi-modal foundation model across text, image and video H Xu, Q Ye, M Yan, Y Shi, J Ye, Y Xu, C Li, B Bi, Q Qian, W Wang, G Xu, ... International Conference on Machine Learning, 38728-38748, 2023 | 124 | 2023 |
| mplug: Effective and efficient vision-language learning by cross-modal skip-connections C Li, H Xu, J Tian, W Wang, M Yan, B Bi, J Ye, H Chen, G Xu, Z Cao, ... arXiv preprint arXiv:2205.12005, 2022 | 118 | 2022 |
| mplug-docowl: Modularized multimodal large language model for document understanding J Ye, A Hu, H Xu, Q Ye, M Yan, Y Dan, C Zhao, G Xu, C Li, J Tian, Q Qi, ... arXiv preprint arXiv:2307.02499, 2023 | 106 | 2023 |
| Ureader: Universal ocr-free visually-situated language understanding with multimodal large language model J Ye, A Hu, H Xu, Q Ye, M Yan, G Xu, C Li, J Tian, Q Qian, J Zhang, Q Jin, ... arXiv preprint arXiv:2310.05126, 2023 | 104 | 2023 |
| Evaluation and analysis of hallucination in large vision-language models J Wang, Y Zhou, G Xu, P Shi, C Zhao, H Xu, Q Ye, M Yan, J Zhang, J Zhu, ... arXiv preprint arXiv:2308.15126, 2023 | 104 | 2023 |
| Semi-autoregressive neural machine translation C Wang, J Zhang, H Chen arXiv preprint arXiv:1808.08583, 2018 | 96 | 2018 |
| An llm-free multi-dimensional benchmark for mllms hallucination evaluation J Wang, Y Wang, G Xu, J Zhang, Y Gu, H Jia, M Yan, J Zhang, J Sang arXiv preprint arXiv:2311.07397, 2023 | 77 | 2023 |
| mplug-docowl 1.5: Unified structure learning for ocr-free document understanding A Hu, H Xu, J Ye, M Yan, L Zhang, B Zhang, C Li, J Zhang, Q Jin, F Huang, ... arXiv preprint arXiv:2403.12895, 2024 | 73 | 2024 |
| Shifting more attention to visual backbone: Query-modulated refinement networks for end-to-end visual grounding J Ye, J Tian, M Yan, X Yang, X Wang, J Zhang, L He, X Lin Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern …, 2022 | 73 | 2022 |
| Hitea: Hierarchical temporal-aware video-language pre-training Q Ye, G Xu, M Yan, H Xu, Q Qian, J Zhang, F Huang Proceedings of the IEEE/CVF International Conference on Computer Vision …, 2023 | 72 | 2023 |
| AliMeKG: Domain knowledge graph construction and application in e-commerce FL Li, H Chen, G Xu, T Qiu, F Ji, J Zhang, H Chen Proceedings of the 29th ACM International Conference on Information …, 2020 | 71 | 2020 |
| Hallucination augmented contrastive learning for multimodal large language model C Jiang, H Xu, M Dong, J Chen, W Ye, M Yan, Q Ye, J Zhang, F Huang, ... Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern …, 2024 | 66 | 2024 |
| A deep cascade model for multi-document reading comprehension M Yan, J Xia, C Wu, B Bi, Z Zhao, J Zhang, L Si, R Wang, W Wang, ... Proceedings of the AAAI conference on artificial intelligence 33 (01), 7354-7361, 2019 | 64 | 2019 |
| Cvalues: Measuring the values of chinese large language models from safety to responsibility G Xu, J Liu, M Yan, H Xu, J Si, Z Zhou, P Yi, X Gao, J Sang, R Zhang, ... arXiv preprint arXiv:2307.09705, 2023 | 62 | 2023 |
| Rosita: Enhancing vision-and-language semantic alignments via cross-and intra-modal knowledge integration Y Cui, Z Yu, C Wang, Z Zhao, J Zhang, M Wang, J Yu Proceedings of the 29th ACM International Conference on Multimedia, 797-806, 2021 | 62 | 2021 |
| Mobile-agent: Autonomous multi-modal mobile device agent with visual perception J Wang, H Xu, J Ye, M Yan, W Shen, J Zhang, F Huang, J Sang arXiv preprint arXiv:2401.16158, 2024 | 58 | 2024 |
| CAT-MNER: multimodal named entity recognition with knowledge-refined cross-modal attention X Wang, J Ye, Z Li, J Tian, Y Jiang, M Yan, J Zhang, Y Xiao 2022 IEEE international conference on multimedia and expo (ICME), 1-6, 2022 | 47 | 2022 |
Fei HuangCarnegie Mellon University, IBM Research, Facebook, Alibaba DAMO AcademyVerified email at alibaba-inc.com
