Jinbin Bai

Hi, I am Jinbin Bai, a graduate student in Department of Computer Science at National Univeristy of Singapore (NUS), supervised by Prof. Hanwang Zhang and Prof. Shuicheng Yan. Before that, I work closely with Dr. Zhen Dong from UC Berkeley. I also receive lots of help from Dr. Yi Zhang from Nanjing University.

I am working on controllable conditional image synthesis and multi-modal foundation model. More generally, I am interested in interactive content creation, multimedia processing technologies for computational art and design. My goal is to design algorithms and build tools to make it easier for artists and designers to create cool things.

We are looking for motivated collaborators and support from industry partners.

Email  /  Google Scholar /  Github  /  Hugging Face  /  Twitter

profile photo

Education
  • M.S. in Computer Science at National University of Singapore, 2024
    • Thesis: Towards Controllable Content Creation
    • Research Intern at Skywork AI, Singapore, 2024
    • Research Intern at Collov AI, San Francisco Bay Area, 2023
    • Research Intern at Kuaishou MMU, Beijing, 2022
  • B.S. in Computer Science at Nanjing University, 2021
    • Thesis: Semantic-aware Cartoon Style Transfer
    • Outstanding Graduate of Nanjing University, 2021
    • Outstanding Student of Nanjing University, 2019
  • The Affiliated High School of Shanxi University, 2017

What I'm Up To

News
  • 2024-04   One paper accepted by IJCAI 2024.
  • 2023-08   One paper accepted by BMVC 2023.
  • 2023-07   Two papers accepted by ACM MM 2023.
  • 2023-07   Two papers accepted by ICCV 2023.
  • 2023-06   Taming Diffusion Models for Music-driven Conducting Motion Generation accepted by AAAI 2023 Summer Symposium, with Best Paper Award.
  • 2023-05   One paper accepted by ICIP 2023.
  • 2023-02   Translating natural language to planning goals with large-language models now on arxiv.
  • 2022-11   One paper accepted by ACCV 2022.
  • 2022-06   LaT: Latent Translation with Cycle-Consistency for Video-Text Retrieval now on arxiv.
  • 2021-03   Awarded as Outstanding Graduate by Nanjing University.
  • 2019-03   Awarded as Outstanding Student by Nanjing University.

Professional Services
  • Reviewer:  ECCV 2022, ACCV 2022, CVPR 2023, ICCV 2023, ACM MM 2023, EMNLP 2023, ICASSP 2024, CVPR 2024, ICPR 2024, Artificial Intelligence Review, ECCV 2024, ACM MM 2024, COLM 2024, NeurIPS 2024, ICASSP 2025, ICLR 2025, AISTATS 2025
  • Program Committee Member:  AAAI 2023, AAAI 2024, AAAI 2025
  • ACM Professional Member

Selected Publications

Full List
LaT


Meissonic: Revitalizing Masked Generative Transformers for Efficient High-Resolution Text-to-Image Synthesis
Jinbin Bai*, Tian Ye*, Wei Chow, Enxin Song, Qing-Guo Chen, Xiangtai Li, Zhen Dong, Lei Zhu, Shuicheng Yan
Technical Report, 2024
[Paper][Model] [Code] [Demo]
Meissonic is a non-autoregressive mask image modeling text-to-image synthesis model that can generate high-resolution images. It is designed to run on consumer graphics cards. The left figure is generated by Meissonic.

LaT


ViewControl: Intergrating View Conditions for Image Synthesis
Jinbin Bai, Zhen Dong, Aosong Feng, Xiao Zhang, Tian Ye, Kaicheng Zhou
Technical Report, 2023
[Paper][Code]
This paper presents a novel framework that enhances existing models with awareness of viewpoint information, thereby enabling improved control over text-to-image diffusion models.

LaT


LaT: Latent Translation with Cycle-Consistency for Video-Text Retrieval
Jinbin Bai, Chunhui Liu, Feiyue Ni, Haofan Wang, Mengying Hu, Xiaofeng Guo, Lele Cheng
Technical Report, 2022
[Paper]
A novel latent translation framework for solving the modality gap problem. With this framework, we can align two modalities with only a translation network, without fine-tuning the encoder.

Cartoon Style Transfer


Semantic-aware Cartoon Style Transfer
Jinbin Bai
Technical Report, 2021
[Paper]
A new semantic-aware framework by matching the same semantic regions for cartoon style transfer.

Miscellaneous
  • Many deep learning researchers choose research over classes prematurely. In my view, attending classes is akin to cultivating inner strength and broadening one's breadth of knowledge, while research merely pertains to external skills. You may be interested in courses I've taken.
  • I am a huge fan of Cities: Skylines and I love designing and simulating cities. I can't wait for the release of Cities: Skylines II on Oct 24th, 2023! And, I've attended World Cities Summit (WCS) 2024 Conference!
  • My favorite movies in recent years is Free Guy, and I dream of designing a game like this.
  • In my leisure moments, I delight in playing the piano surrounded by abundant greenery, finding peace and emotional comfort in the solitude.

Last updated on Nov. 2022