RefCOCO+ 数据集是一个引用表达生成 (REG)数据集,用于理解引用图像中特定对象的自然语言表达的相关任务
立即下载
资源介绍:
标注方式上:
RefCOCOg采用的是非交互式标注法,选定区域请人标注,再请另外一批人根据标注的expression选择对应的region;
RefCOCO和RefCOCO+采用的是双人游戏 (Refer it game)的方式.
数据划分方式上:
RefCOCO和RefCOCO+包含train, val, testA, testB。testA的图片包含多个人;testB的图片包含多个除人之外的物体。同一个图片的object-expression样本对要么全在训练集,要么全在验证\测试集。
RefCOCOg包含train, val, test。是按照object进行划分的,同一个图片的object-expression样本对集合可能会在训练集一部分,在验证\测试集另一部分。
图片选择上:
RefCOCO:图像包含同一类别的多个物体。
RefCOCO+:图像包含同一类别的多个物体,并且expression不能有绝对位置(e.g., left)的词。
RefCOCOg:图像包含同一类别的2-4个物体,覆盖面积超过图片面积的5%
{"info": {"description": "This is stable 1.0 version of the 2014 MS COCO dataset.", "url": "http://mscoco.org", "version": "1.0", "year": 2014, "contributor": "Microsoft COCO group", "date_created": "2015-01-27 09:11:52.357475"}, "images": [{"license": 1, "file_name": "COCO_train2014_000000098304.jpg", "coco_url": "http://mscoco.org/images/98304", "height": 424, "width": 640, "date_captured": "2013-11-21 23:06:41", "flickr_url": "http://farm6.staticflickr.com/5062/5896644212_a326e96ea9_z.jpg", "id": 98304}, {"license": 3, "file_name": "COCO_train2014_000000052461.jpg", "coco_url": "http://mscoco.org/images/52461", "height": 484, "width": 640, "date_captured": "2013-11-17 10:55:11", "flickr_url": "http://farm9.staticflickr.com/8157/7574894824_3cdc8163d9_z.jpg", "id": 52461}, {"license": 1, "file_name": "COCO_train2014_000000131074.jpg", "coco_url": "http://mscoco.org/images/131074", "height": 428, "width": 640, "date_captured": "2013-11-21 01:03:06", "flickr_url": "http://farm9.staticflickr.com/8308/7908210548_33e532d119_z.jpg", "id": 131074}, {"license": 3, "file_name": "COCO_train2014_000000524291.jpg", "coco_url": "http://mscoco.org/images/524291", "height": 426, "width": 640, "date_captured": "2013-11-18 09:59:07", "flickr_url": "http://farm2.staticflickr.com/1045/934293170_d1b2cc58ff_z.jpg", "id": 524291}, {"license": 5, "file_name": "COCO_train2014_000000425988.jpg", "coco_url": "http://mscoco.org/images/425988", "height": 498, "width": 640, "date_captured": "2013-11-17 01:50:39", "flickr_url": "http://farm5.staticflickr.com/4028/4453365777_c89a9835ec_z.jpg", "id": 425988}, {"license": 3, "file_name": "COCO_train2014_000000458762.jpg", "coco_url": "http://mscoco.org/images/458762", "height": 427, "width": 640, "date_captured": "2013-11-17 16:01:51", "flickr_url": "http://farm8.staticflickr.com/7180/7094140905_2d859f947b_z.jpg", "id": 458762}, {"license": 2, "file_name": "COCO_train2014_000000194438.jpg", "coco_url": "http://mscoco.org/images/194438", "height": 396, "width": 640, "date_captured": "2013-11-18 07:21:45", "flickr_url": "http://farm4.staticflickr.com/3790/9307020129_c16e0a0907_z.jpg", "id": 194438}, {"license": 4, "file_name": "COCO_train2014_000000294925.jpg", "coco_url": "http://mscoco.org/images/294925", "height": 480, "width": 640, "date_captured": "2013-11-18 07:08:45", "flickr_url": "http://farm7.staticflickr.com/6190/6081772851_e86c0b2e94_z.jpg", "id": 294925}, {"license": 6, "file_name": "COCO_train2014_000000327694.jpg", "coco_url": "http://mscoco.org/images/327694", "height": 480, "width": 640, "date_captured": "2013-11-15 03:04:09", "flickr_url": "http://farm1.staticflickr.com/33/48472082_2497b0fb1a_z.jpg", "id": 327694}, {"license": 1, "file_name": "COCO_train2014_000000060077.jpg", "coco_url": "http://mscoco.org/images/60077", "height": 500, "width": 375, "date_captured": "2013-11-21 20:06:21", "flickr_url": "http://farm1.staticflickr.com/21/98244553_fc0cfdabdb_z.jpg", "id": 60077}, {"license": 3, "file_name": "COCO_train2014_000000217046.jpg", "coco_url": "http://mscoco.org/images/217046", "height": 415, "width": 640, "date_captured": "2013-11-18 04:07:16", "flickr_url": "http://farm4.staticflickr.com/3766/9838911496_30d4a49b0e_z.jpg", "id": 217046}, {"license": 4, "file_name": "COCO_train2014_000000294933.jpg", "coco_url": "http://mscoco.org/images/294933", "height": 480, "width": 640, "date_captured": "2013-11-15 04:00:22", "flickr_url": "http://farm3.staticflickr.com/2444/3795350996_5711533f32_z.jpg", "id": 294933}, {"license": 3, "file_name": "COCO_train2014_000000229398.jpg", "coco_url": "http://mscoco.org/images/229398", "height": 341, "width": 500, "date_captured": "2013-11-18 12:47:27", "flickr_url": "http://farm1.staticflickr.com/17/20175683_127fa88e6e_z.jpg", "id": 229398}, {"license": 1, "file_name": "COCO_train2014_000000017065.jpg", "coco_url": "http://mscoco.org/images/17065", "height": 406, "width": 640, "date_captured": "2013-11-18 06:03:04", "flickr_url": "http://farm8.staticflickr.com/7004/6621186401_d0cb64b3a8_z.jpg", "id": 17065}, {"license": 4, "file_name": "COCO_train2014_000000557081.jpg", "coco_url": "http://mscoco.org/images/557081", "height": 428, "width": 640, "date_captured": "2013-11-21 23:09:07", "flickr_url": "http://farm2.staticflickr.com/1162/1354998471_63aa67eb44_z.jpg", "id": 557081}, {"license": 1, "file_name": "COCO_train2014_000000524314.jpg", "coco_url": "http://mscoco.org/images/524314", "height": 428, "width": 640, "date_captured": "2013-11-24 21:29:33", "flickr_url": "http://farm3.staticflickr.com/2370/2320994673_eaff4665f9_z.jpg", "id": 524314}, {"license": 3, "file_name": "COCO_train2014_000000065564.jpg", "coco_url": "http://mscoco.org/images/65564", "height": 427, "width": 640, "date_captured": "2013-11-16 13:21:17", "flickr_url": "http://farm9.staticflickr.com/8034/8049230697_865736b2a2_z.jpg", "id": 65564}, {"license": 3, "file_name": "COCO_train2014_000000294942.jpg", "coco_url": "http://mscoco.org/images/294942", "height": 480, "width": 640, "date_captured": "2013-11-14 22:24:40", "flickr_url": "http://farm8.staticflickr.com/7185/6865657952_5ea1222e8f_z.jpg", "id": 294942}, {"license": 3, "file_name": "COCO_train2014_000000524320.jpg", "coco_url": "http://mscoco.org/images/524320", "height": 640, "width": 480, "date_captured": "2013-11-14 17:12:57", "flickr_url": "http://farm5.staticflickr.com/4112/5004009687_ede04560d4_z.jpg", "id": 524320}, {"license": 6, "file_name": "COCO_train2014_000000393251.jpg", "coco_url": "http://mscoco.org/images/393251", "height": 640, "width": 480, "date_captured": "2013-11-20 21:18:14", "flickr_url": "http://farm9.staticflickr.com/8531/8493863691_c41814406f_z.jpg", "id": 393251}, {"license": 3, "file_name": "COCO_train2014_000000262180.jpg", "coco_url": "http://mscoco.org/images/262180", "height": 480, "width": 640, "date_captured": "2013-11-19 18:51:54", "flickr_url": "http://farm3.staticflickr.com/2747/4456844960_3757c741db_z.jpg", "id": 262180}, {"license": 7, "file_name": "COCO_train2014_000000376838.jpg", "coco_url": "http://mscoco.org/images/376838", "height": 377, "width": 500, "date_captured": "2013-11-16 04:37:44", "flickr_url": "http://farm4.staticflickr.com/3181/2677558151_0a22104546_z.jpg", "id": 376838}, {"license": 3, "file_name": "COCO_train2014_000000410266.jpg", "coco_url": "http://mscoco.org/images/410266", "height": 500, "width": 375, "date_captured": "2013-11-23 05:40:21", "flickr_url": "http://farm1.staticflickr.com/65/199638539_2035ec4609_z.jpg", "id": 410266}, {"license": 4, "file_name": "COCO_train2014_000000229415.jpg", "coco_url": "http://mscoco.org/images/229415", "height": 427, "width": 640, "date_captured": "2013-11-16 12:56:28", "flickr_url": "http://farm9.staticflickr.com/8375/8505620041_be73c38a0c_z.jpg", "id": 229415}, {"license": 1, "file_name": "COCO_train2014_000000126832.jpg", "coco_url": "http://mscoco.org/images/126832", "height": 480, "width": 640, "date_captured": "2013-11-17 20:44:18", "flickr_url": "http://farm4.staticflickr.com/3356/3340482500_f889576fe6_z.jpg", "id": 126832}, {"license": 3, "file_name": "COCO_train2014_000000376839.jpg", "coco_url": "http://mscoco.org/images/376839", "height": 480, "width": 640, "date_captured": "2013-11-18 11:25:33", "flickr_url": "http://farm7.staticflickr.com/6123/5940176648_40ceebb9ef_z.jpg", "id": 376839}, {"license": 5, "file_name": "COCO_train2014_000000327724.jpg", "coco_url": "http://mscoco.org/images/327724", "height": 418, "width": 640, "date_captured": "2013-11-20 19:58:06", "flickr_url": "http://farm8.staticflickr.com/7363/9324299621_e37e323c43_z.jpg", "id": 327724}, {"license": 1, "file_name": "COCO_train2014_000000486066.jpg", "coco_url": "http://mscoco.org/images/486066", "height": 480, "width": 640, "date_captured": "2013-11-18 11:39:15", "flickr_url": "http://farm1.staticflickr.com/93/235191929_2420aa36f8_z.jpg", "id": 486066}, {"license": 4, "file_name": "COCO_train2014_000000557102.jpg", "coco_url": "http://mscoco.org/images/557102", "height