Selected Publications
*
Optimistic Agent: Accurate Graph-Based Value Estimation for More Successful Visual Navigation
Reasoning on the Relation: Enhancing Visual Representation for Visual Question Answering and Cross-modal Retrieval
DAM: Deliberation- Abandon and Memory Networks for Generating Detailed and Non-repetitive Responses in Visual Dialogue
Give Me Something to Eat: Referring Expression Comprehension with Commonsense Knowledge
Language-guided Navigation via Cross-Modal Grounding and Alternate Adversarial Learning
Mucko: Multi-Layer Cross-Modal Knowledge Reasoning for Fact-based Visual Question Answering
Say As You Wish: Fine-grained Control of Image Caption Generation with Abstract Scene Graphs
DualVD: An Adaptive Dual Encoding Model for Deep Visual Understanding in Visual Dialogue
Attend and Imagine: Multi-label Image Classification with Visual Attention and Recurrent Neural Networks
Gold Seeker: Information Gain from Policy Distributions for Goal-oriented Vision-and-Langauge Reasoning
Mind Your Neighbours: Image Annotation with Metadata Neighbourhood Graph Co-Attention Networks
Image Captioning and Visual Question Answering Based on Attributes and Their Related External Knowledge
Asking the Difficult Questions: Goal-Oriented Visual Question Generation via Intermediate Rewards
Are You Talking to Me? Reasoned Visual Dialog Generation through Adversarial Learning
Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environments
Parallel Attention: A Unified Framework for Visual Object Discovery through Dialogs and Queries
Kill Two Birds With One Stone: Weakly-Supervised Neural Network for Image Annotation and Tag Refinement
The VQA-Machine: Learning How to Use Existing Vision Algorithms to Answer New Questions
Ask Me Anything: Free-form Visual Question Answering Based on Knowledge from External Sources
