Datasets !
Here are some Datasets that I played a major role in curating. This Video is a good summary of how I collect datasets, please take a look! (sorry for the mumblings, I was really jet-lagged).
mmmCAD : Multi-modal Modification of CAD
Small scale data from Communicating Design Intent Using Drawing and Text. [~100 man-hours] One participant (Designer) communicate with another (Maker) to collaboratively re-create a precise 2D CAD design. The Designer is given a target design, and must use drawing and language to communicate to the maker, who makes the design using a CAD interface.
LARC : Language-complete Abstract Reasoning Corpus
From Communicating Natural Programs to Humans and Machines. [~350 man-hours] One participant (Describer) describes an abstract transformation of grids from the ARC corpus to another (Builder) using language. The builder applies the transformation on a new input grid to produce an output grid. Access the dataset here.
DARC: A Recursive Decomposition Dataset of ARC Tasks
From ANPL: Towards Natural Programming with Interactive Decomposition . [~440 man-hours] A corpus of 227 ARC tasks, recursively decomposed and grounded as Python code. Access the dataset here
DiffVL100
From DiffVL: Scaling Up Soft Body Manipulation using Vision-Language Driven Differentiable Physics. [~50 man-hours] 100 soft-body manipulation tasks inspired by real-life scenarios from online videos. Access the dataset here