Google Research Datasets

Repositories

• Objectron

  Objectron is a dataset of short, object-centric video clips. In addition, the videos also contain AR session metadata including camera poses, sparse point-clouds and planes. In each video, the camera moves around and above the object and captures it from different views. Each object is annotated with a 3D bounding box. The 3D bounding box descri…

  python machine-learning ai computer-vision deep-learning neural-network tensorflow
  Jupyter Notebook 32 403 1 0 Updated Nov 13, 2020

• RxR

  Room-across-Room (RxR) is a large-scale, multilingual dataset for Vision-and-Language Navigation (VLN) in Matterport3D environments. It contains 126k navigation instructions in English, Hindi and Telugu, and 126k navigation following demonstrations. Both annotation types include dense spatiotemporal alignments between the text and the visual per…
  HTML CC-BY-4.0 0 31 0 0 Updated Nov 10, 2020

• gap-coreference

  GAP is a gender-balanced dataset containing 8,908 coreference-labeled pairs of (ambiguous pronoun, antecedent name), sampled from Wikipedia for the evaluation of coreference resolution in practical applications.
  Python Apache-2.0 67 172 2 1 Updated Nov 10, 2020

• poem-sentiment

  Poem Sentiment is a sentiment dataset of poem verses from Project Gutenberg. This dataset can be used for tasks such as sentiment classification or style transfer for poems.
  0 0 0 0 Updated Nov 9, 2020

• aquamuse

  AQuaMuSe is a novel scalable approach to automatically mine dual query based multi-document summarization datasets for extractive and abstractive summaries using question answering dataset (Google Natural Questions) and large document corpora (Common Crawl)
  0 1 0 0 Updated Nov 4, 2020

• ToTTo

  ToTTo is an open-domain English table-to-text dataset with over 120,000 training examples that proposes a controlled generation task: given a Wikipedia table and a set of highlighted table cells, produce a one-sentence description. We hope it can serve as a useful research benchmark for high-precision conditional text generation.
  5 118 0 0 Updated Nov 2, 2020

• Taskmaster

  Please see the readme file as well as our 2019 EMNLP paper linked here -->
  29 110 2 0 Updated Nov 1, 2020

• dstc8-schema-guided-dialogue

  The Schema-Guided Dialogue Dataset

  dialogue assistant dataset nlp-machine-learning dialogue-systems
  CC-BY-SA-4.0 64 258 2 0 Updated Oct 30, 2020

• TF-IDF-IIF-top100-wordlists

  These are lists for a variety of languages containing words that are distinctive to each language.
  1 1 0 0 Updated Oct 29, 2020

• turkish-treebanks

  A human-annotated morphosyntactic treebank for Turkish.
  Python Apache-2.0 0 7 0 0 Updated Oct 27, 2020

• KELM-corpus
  0 8 0 0 Updated Oct 24, 2020

• Zari

  A series of BERT and Albert model checkpoints trained to reduce gendered correlations in pre-training
  Apache-2.0 0 3 0 0 Updated Oct 22, 2020

• i3-video

  Human annotation of "is-it-instructional" for a random sample of videos from YouTube8M.
  0 1 0 0 Updated Oct 16, 2020

• Google-Open-Images-Mutual-Gaze-dataset

  This dataset consists of images along with annotations that specify whether two faces in the photo are looking at each other. This dataset is intended to aid researchers working on topics related to social behavior, visual attention, etc.
  0 1 0 0 Updated Oct 13, 2020

• circa

  Circa (meaning ‘approximately’) dataset aims to help machine learning systems to solve the problem of interpreting indirect answers to polar questions. The dataset contains pairs of yes/no questions and indirect answers, together with annotations for the interpretation of the answer. The data is collected in 10 different social conversation situ…
  2 2 0 0 Updated Oct 8, 2020

• common-crawl-domain-names

  Corpus of domain names scraped from Common Crawl and manually annotated to add word boundaries (e.g. "commoncrawl" to "common crawl").
  MIT 0 3 0 0 Updated Oct 2, 2020

• natural-questions

  Natural Questions (NQ) contains real user questions issued to Google search, and answers found from Wikipedia by annotators. NQ is designed for the training and evaluation of automatic question answering systems.
  Python Apache-2.0 108 555 11 2 Updated Oct 1, 2020

• Textual-Entailment-New-Protocols

  This data release is meant to accompany and document the paper: https://arxiv.org/abs/2004.11997 Collecting Entailment Data for Pretraining: New Protocols and Negative Results by Samuel R. Bowman, Jennimaria Palomaki, Livio Baldini Soares, and Emily Pitler
  1 12 0 0 Updated Sep 29, 2020

• QED

  QED: A Framework and Dataset for Explanations in Question Answering
  Python 13 49 2 0 Updated Sep 15, 2020

• Crisscrossed-Captions

  Extended Intramodal and Intermodal Semantic Similarity Judgments for MS-COCO
  Python 0 1 0 0 Updated Sep 3, 2020

• bam
  Python Apache-2.0 5 26 1 0 Updated Aug 29, 2020

• seq2act

  This repository contains the opensource version of the datasets were used for different parts of training and testing of models that ground natural language to UI actions as described in the paper: "Mapping Natural Language Instructions to Mobile UI Action Sequences" by Yang Li, Jiacong He, Xin Zhou, Yuan Zhang, and Jason Baldridge, which is acc…
  0 0 0 0 Updated Aug 20, 2020

• great

  The dataset for the variable-misuse task, used in the ICLR 2020 paper 'Global Relational Models of Source Code' [https://openreview.net/forum?id=B1lnbRNtwr]
  3 10 0 0 Updated Aug 19, 2020

• eth_py150_open

  A redistributable subset of the ETH Py150 corpus [https://www.sri.inf.ethz.ch/py150], introduced in the ICML 2020 paper 'Learning and Evaluating Contextual Embedding of Source Code' [https://proceedings.icml.cc/static/paper_files/icml/2020/5401-Paper.pdf].
  0 7 0 0 Updated Aug 11, 2020

• MultiReQA

  We are creating a challenging new benchmark MultiReQA: A Cross-Domain Evaluation for Retrieval Question Answering Models. Retrieval question answering (ReQA) is the task of retrieving a sentence-level answer to a question from an open corpus. MultiReQA is a new multi-domain ReQA evaluation suite composed of eight retrieval QA tasks drawn from pu…
  1 13 0 0 Updated Jul 9, 2020

• xsum_hallucination_annotations

  Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (https://www.aclweb.org/anthology/2020.acl-main.173.pdf).
  1 18 2 0 Updated Jul 9, 2020

• NewSHead

  The NewSHead dataset is a multi-doc headline dataset used in NHNet for training a headline summarization model.
  1 9 0 0 Updated Jun 9, 2020

• tydiqa

  TyDi QA contains 200k human-annotated question-answer pairs in 11 Typologically Diverse languages, written without seeing the answer and without the use of translation, and is designed for the training and evaluation of automatic question answering systems. This repository provides evaluation code and a baseline system for the dataset.
  Python Apache-2.0 24 124 0 1 Updated May 28, 2020

• dakshina

  The Dakshina dataset is a collection of text in both Latin and native scripts for 12 South Asian languages. For each language, the dataset includes a large collection of native script Wikipedia text, a romanization lexicon of words in the native script with attested romanizations, and some full sentence parallel data in both a native script of t…
  10 103 0 0 Updated May 27, 2020

• discofuse
  3 21 0 0 Updated May 21, 2020