image captioning
Pragmatically Informative Image Captioning with Character Level Inference
... neural image captioner with a Rational Speech Acts (RSA) model to make a system that is pragmatically informative: its objective is to produce captions that are not merely true but also distinguish their inputs ...
5
Deliberate Attention Networks for Image Captioning
... for image captioning, and inspired by the success of reinforcement learning, in this paper, we introduce a novel architecture, Deliberate Residual Attention Network for im- age ...tended image ...
8
English to Hindi Multi modal Neural Machine Translation and Hindi Image Captioning
... only image captioning and text-only transla- tion for English to Hindi ...extract image features and attention-based Neural Machine Translation (NMT) system for ...
6
Guided Open Vocabulary Image Captioning with Constrained Beam Search
... Our approach to out-of-domain image captioning could be applied to any existing CNN-RNN cap- tioning model that can be decoding using beam search, e.g., (Donahue et al., 2015; Mao et al., 2015; Karpathy and ...
10
Hierarchical Attention Network for Image Captioning
... Since features from different attention networks are in dif- ferent modalities, it is necessary to explore a multimodal embedding strategy to combine them. However, most ex- isting image captioning models ...
8
Object Counts! Bringing Explicit Detections Back into Image Captioning
... We believe that it is timely to again start explor- ing the use of explicit object detections for image captioning. Explicit detections offer rich semantic information, which can be used to model the enti- ...
14
Image Captioning using Multimodal Embedding
... Image captioning still remains a conundrum as it not only focuses on extraction of the visual semantics of a given image but also on combination techniques from the domain of natural language ...of ...
6
Can Neural Image Captioning be Controlled via Forced Attention?
... neural image captioning model intro- duces an interesting new research direction for natural language generation, which will allow re- searchers to handle and understand the complexi- ties of these models ...
5
On the Role of Scene Graphs in Image Captioning
... help image captioning system to produce more descriptive outputs versus using only the image as ...cent captioning approaches rely on ad-hoc ap- proaches to obtain graphs for ...the ...
6
REO Relevance, Extraness, Omission: A Fine grained Evaluation for Image Captioning
... evaluating image cap- tioning systems, such as BLEU and CIDEr, provide a single score to gauge the system’s overall ...of image captioning sys- ...
6
Attacking Visual Language Grounding with Adversarial Examples: A Case Study on Neural Image Captioning
... We use ADAM to minimize our loss functions and set the learning rate to 0.005. The number of iterations is set to 1, 000. All the experiments are performed on a single Nvidia GTX 1080 Ti GPU. For targeted caption and ...
11
Aesthetic Image Captioning from Weakly Labelled Photographs
... natural image captioning (NIC) [81] where the goal is to factually describe the image ...other captioning variants such as visual question answering [5], visual storytelling [38], stylized ...
11
Nonparametric Method for Data driven Image Captioning
... Image captioning is a relatively novel task for which the most compelling applications are prob- ably not yet ...age captioning focuses on generating captions that concretely describe detected ...
7
Language Models for Image Captioning: The Quirks and What Works
... Recent progress in automatic image captioning has shown that an image-conditioned language model can be very effective at generating captions. Two leading approaches have been explored for this task. ...
6
Re evaluating Automatic Metrics for Image Captioning
... area, image captioning aims at generating natural descriptions of a given image (Bernardi et ...deep image captioning studies follow this interpretation and model the ...
11
Improving Image Captioning with Conditional Generative Adversarial Nets
... used image captioning model is the so-called encoder-decoder ...the image captioning framework to further improve the performance of the gener- ator, which is the initial design spirit of our ...
9
Temporal difference Learning with Sampling Baseline for Image Captioning
... for image captioning usually train the language model under the cross entropy loss, which results in the exposure bias and inconsistency of evaluation ...the image captioning model. ...
8
Informative Image Captioning with External Sources of Information
... Automatic image captioning can help alleviate this problem, but its usefulness is directly proportional to how much information an automatically-produced caption can ...age captioning (in terms of ...
10
Conceptual Captions: A Cleaned, Hypernymed, Image Alt text Dataset For Automatic Image Captioning
... Alt-text image descriptions (see Alt-text in ...the image captioning ...RNN-based captioning model (see Section 4) on non-hypernymized Alt-text data and present an output example in ...
10
A Survey on Biomedical Image Captioning
... the image) assigns attention scores to the vi- sual feature vectors, and the weighted sum of the visual feature vectors (weighted by their attention scores) becomes a visual ‘context’ vector, specify- ing which ...
11