cfh3c pic

Fuhai Chen (陈福海)
Emails: chenfuhai3c AT 163.com (best), fhchen AT cs.hku.hk

I am currently a postdoctoral fellow in the Department of Computer Science of the University of Hong Kong, working with Prof. Wenping Wang. Before that, I received the PH.D. Degree from the Department of Artificial Intelligence of Xiamen University in 2020, supervised by Prof. Rongrong Ji in Media Analysis and Computing Lab (MAC). I joint the Department of Computer Science of National University of Singapore in the same year, working with A/Prof. Angela Yao. Earlier, I received the B.S. Degree from the Department of Cognitive Science and Technology (now renamed as Department of Artificial Intelligence) of Xiamen University in 2014. I obtained the M.S.-Ph.D. qualification and finished my M.S. career in Xiamen University in 2016.

My research interests are on computer vision, multimedia, natural language processing, and machine learning, especially on vision-language content understanding, multi-modal structured semantic modeling, diverse semantic inference, causal semantic inference, as well as their applications, including image/video captioning, multimedia sentiment analysis, image-sentence retrieval, human-computer interaction, sentence grounding in video, and medical diagnostic report analysis.

Pre-print

  1. Chengpeng Dai#, Fuhai Chen#, Xiaoshuai Sun*, Rongrong Ji, Qixiang Ye, Yongjian Wu. Global2Local: A Joint-Hierarchical Attention for Video Captioning. ArXiv:2203.06663.
  2. Fuhai Chen, Rongrong Ji*, Chengpeng Dai, Xuri Ge, Shengchuang Zhang, Xiaojing Ma, Yue Gao. Factored Attention and Embedding for Unstructured-view Topic-related Ultrasound Report Generation. ArXiv:2203.06458.
  3. Fuhai Chen, Xuri Ge, Xiaoshuai Sun, Yue Gao, Jianzhuang Liu, Fufeng Chen, Wenjie Li. Differentiated Relevances Embedding for Group-based Referring Expression Comprehension. ArXiv:2203.06382.
  4. Fuhai Chen, Rongrong Ji*, Chengpeng Dai, Xiaoshuai Sun, Chia-Wen Lin, Jiayi Ji, Baochang Zhang, Feiyue Huang, Liujuan Cao. Semantic-aware Image Deblurring. ArXiv:1910.03853.
  5. Chen Shen, Rongrong Ji*, Fuhai Chen, Xiangming Li. Scene-based Factored Attention for Image Captioning. ArXiv:1908.02632.

Publication

  1. Xuri Ge, Fuhai Chen*, Songpei Xu, Fuxiang Tao. Cross-modal Semantic Enhanced Interaction for Image-Sentence Retrieval. Winter Conference on Applications of Computer Vision, 2023 (WACV 2023) [Accepted].
  2. Xuri Ge, Fuhai Chen, Joemon Jose, Zhilong Ji, Zhongqin Wu, Xiao Liu. Structured Multi-modal Feature Embedding and Alignment for Image-Sentence Retrieval. ACM International Conference on Multimedia (ACM MM), 2021.
  3. Haotong Zhang, Fuhai Chen, Angela Yao. Weakly-Supervised Dense Action Anticipation. The British Machine Vision Conference (BMVC 2021), 2021.
  4. Mingliang Xu, Fuhai Chen, Lu Li, Chen Shen, Pei Lv, Bing Zhou, Rongrong Ji*. Bio-Inspired Deep Attribute Learning Towards Facial Aesthetic Prediction. IEEE Transactions on Affective Computing (TAC), 2021.
  5. Jiayi Ji, Yunpeng Luo, Xiaoshuai Sun, Fuhai Chen, Gen Luo, Yongjian Wu, Yue Gao, Rongrong Ji*. Improving Image Captioning by Leveraging Intra- and Inter-layer Global Representation in Transformer Network. Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2021.
  6. Jiayi Ji, Rongrong Ji*, Yiyi Zhou, Xiaoshuai Sun, Fuhai Chen, Jianzhuang Liu, Qi Tian. Attacking Image Captioning Towards Accuracy-Preserving Target Words Removal. ACM International Conference on Multimedia (ACM MM), 2020.
  7. Fuhai Chen, Rongrong Ji*, Jiayi Ji, Xiaoshuai Sun, Baochang Zhang, Xuri Ge, Yongjian Wu, Feiyue Huang, Yan Wang. Variational Structured Semantic Inference for Diverse Image Captioning. Advances in Neural Information Processing Systems (NeurIPS), 2019.
  8. Rongrong Ji, Fuhai Chen, Liujuan Cao*, Yue Gao*. Cross-Modality Microblog Sentiment Prediction via Bi-Layer Multimodal Hypergraph Learning. IEEE Transactions on Multimedia (TMM), 2019.
  9. Xuri Ge, Fuhai Chen, Chen Shen, Rongrong Ji*. Colloquial Image Captioning. IEEE International Conference on Multimedia and Expo (ICME), 2019.
  10. Zongyue Liu, Fuhai Chen, Jinsong Su, Chen Shen, Rongrong Ji*. Topic-Guided Automatical Human-Simulated Tweeting System. Pacific Rim International Conference on Artificial Intelligence (PRICAI), 2018.
  11. Fuhai Chen, Rongrong Ji*, Xiaoshuai Sun, Yongjian Wu, Jinsong Su. GroupCap: Group-based Image Captioning with Structured Relevance and Diversity Constraints. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
  12. Fuhai Chen, Rongrong Ji*, Jinsong Su, Donglin Cao, and Yue Gao. Predicting Microblog Sentiments via Weakly Supervised Multi-Modal Deep Learning. IEEE Transactions on Multimedia (TMM), 2018.
  13. Fuhai Chen, Rongrong Ji*, Jinsong Su, Yongjian Wu, Yunsheng Wu. StructCap: Structured Semantic Embedding for Image Captioning. ACM International Conference on Multimedia (ACM MM), 2017.
  14. Rongrong Ji, Donglin Cao*, Yiyi Zhou, Fuhai Chen. Survey of visual sentiment prediction for social media analysis. Frontiers of Computer Science, 2016.
  15. Yue Gao, Weizhi Nie, Anan Liu, Yuting Su, Qionghai Dai, Le An, Fuhai Chen, et al. 3D object retrieval with multimodal views. Eurographics Workshop on 3D Object Retrieval, 2016.
  16. Fuhai Chen, Rongrong Ji*, Liujuan Cao. Multimodal learning for view-based 3D object classification. Neurocomputing, 2016.
  17. Chao Chen, Fuhai Chen, Donglin Cao, Rongrong Ji*. A cross-media sentiment analytics platform for microblog. ACM International Conference on Multimedia (ACM MM), 2015.
  18. Fuhai Chen, Yue Gao, Donglin Cao, Rongrong Ji*. Multimodal hypergraph learning for microblog sentiment prediction. IEEE International Conference on Multimedia and Expo (ICME), 2015. (Listed in the top papers)
  19. Fei Chao, Fuhai Chen, Yunhang Shen, Wenli He, Yan Sun, Zhengshuai Wang, Changle Zhou, Min Jiang. Robotic free writing of Chinese characters via human-robot interactions. International journal of humanoid robotics, 2014.

Activities

  1. Developing Cross-media Sentiment Analysis System (First Version, Chinese) (2014).
  2. Interdiscipline research participations: MRI Data based MCI identification with A/Prof. Yue Gao (2014), financial sentiment dictionary construction with Prof. Jiaquan Yao (2016), policy uncertainty estimation with A/Prof. Juanjuan Huang (2017), and real-time CEO facial expression classification with Dr. Lefu Wang (2017).
  3. Organizing committee of AutoGen-CDR19 challenge in MICCAI 2019 (Link).
  4. Teaching assistant of Pattern Recognition, Spring 2019, Xiamen University.
  5. Research intern at Peng Cheng Laboratory (PCL) (2019.5 ~ 2019.11).
  6. Reviewer: IEEE TMM, ACM TOMM, Pattern Recognition, Neural Processing Letters, NCIG.
  7. Editor: Electronics.

Talks

  1. StructCap: Structured Semantic Embedding for Image Captioning, The 27th ACM International Conference on Multimedia (ACM MM 2017), Mountain View, USA, 2017.
  2. Automatic Generation of Cardiovascular Diagnostic Report, The 22th Medical Image Computing Computer Assisted Intervention (MICCAI 2019), Shenzhen, China, 2019.

Honors and Awards

National Scholarship, China, 2011
Outstanding Merit Student Award, Xiamen University, 2011
National "Freescale Cup" Smart Car Competition (South China division, Captain, 2nd class), 2012
Merit Student Award, Xiamen University, 2013
National "Huawei Cup" Intelligent Design Competition (Captain, 1st class), 2013
Academic Innovation Scholarship, Xiamen University, 2014
Award of Innovation and Entrepreneurship Training Project (Leader), Xiamen University, 2014
Academic Excellence Scholarship, Xiamen University, 2014
Best Graduate, Xiamen University, 2014
Highlights in SHREC 2015 Track "3D Object Retrieval with Multimodal Views" (Link)
National Scholarship, China, 2018