[03/2023] OpenAI: ChatGPT plugins are tools designed specifically for language models with safety as a core principle,…

：ChatGPT plugins allow ChatGPT to access up-to-date information, run computations, or use third-party services.

[03/2023] Google Research: Bard is an early experiment that lets you collaborate with generative AI, powered by a…

[03/2023] OpenAI: GPT-4 is a large multimodal model (accepting image and text inputs, emitting text outputs) that,…

Announcement of GPT-4, a large multimodal model. OpenAI blog, March 14, 2023.

[03/2023] Google Research: PaLM-E is a new generalist robotics model that overcomes these issues by transferring…

[03/2023] OpenAI: ChatGPT and Whisper APIs, developers can now integrate ChatGPT and Whisper models into their apps…

[02/2023] MSR: Kosmos-1 is a multimodal large language model (MLLM) that is capable of perceiving multimodal input,…

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

[01/2023] Google Research: 2022 & beyond: Language, vision and generative models, a post of a series in which…

[11/2022] OpenAI: ChatGPT is a sibling model to InstructGPT, which is trained to follow an instruction in a prompt and…

Announcement of ChatGPT, a conversational model trained to answer follow-up questions, admit mistakes, challenge incorrect premises, and reject inappropriate requests. OpenAI blog, November 30, 2022.

[04/2022] OpenAI: DALL·E 2 is a new AI system that can create realistic images and art from a description in natural…

DALL·E 2 by OpenAI is a new AI system that can create realistic images and art from a description in natural language.

[05/2021] Google: MuM, a new AI milestone for understanding information.

by Google.

[03/2021] OpenAI: Multimodal Neurons in Artificial Neural Networks, which may explain CLIP’s accuracy in classifying…

[01/2021] OpenAI: CLIP maps images into categories described in text, and DALL-E creates new images from text. A step…

Social Intelligence in Humans and Robots

, ICRA 2021

LANTERN 2021

The Third Workshop Beyond Vision and LANguage: inTEgrating Real-world kNowledge, EACL 2021

Advances in Language and Vision Research (ALVR)

, NAACL 2021

Visually Grounded Interaction and Language (ViGIL)

, NAACL 2021

Wordplay: When Language Meets Games

, NeurIPS 2020

NLP Beyond Text

, EMNLP 2020

International Challenge on Compositional and Multimodal Perception

, ECCV 2020

Multimodal Video Analysis Workshop and Moments in Time Challenge

, ECCV 2020

Video Turing Test: Toward Human-Level Video Story Understanding

, ECCV 2020

Grand Challenge and Workshop on Human Multimodal Language

, ACL 2020

Workshop on Multimodal Learning

, CVPR 2020

Language & Vision with applications to Video Understanding

, CVPR 2020

International Challenge on Activity Recognition (ActivityNet)

, CVPR 2020

The End-of-End-to-End A Video Understanding Pentathlon

, CVPR 2020

Towards Human-Centric Image/Video Synthesis, and the 4th Look Into Person (LIP) Challenge

, CVPR 2020

Visual Question Answering and Dialog

, CVPR 2020

Tutorials on Multimodal Machine Learning

, CVPR 2022 && NAACL 2022

Multi-modal Information Extraction from Text, Semi-structured, and Tabular Data on the Web (Cutting-edge)

, ACL 2020

Achieving Common Ground in Multi-modal Dialogue (Cutting-edge)

, ACL 2020

Recent Advances in Vision-and-Language Research

, CVPR 2020

Neuro-Symbolic Visual Reasoning and Program Synthesis

, CVPR 2020

Large Scale Holistic Video Understanding

, CVPR 2020

A Comprehensive Tutorial on Video Modeling

, CVPR 2020