🎉🎉 We have released the first version of our dataset, which includes 11,264 real and 90,000 synthetic infographic charts, with over 14 million bounding box annotations.

👉 Access the full InfoDet dataset on Hugging Face 🤗! 👈

InfoDet comprises a diverse collection of infographics from two sources: 1) real infographics collected from 7 online platforms, and 2) synthetic infographics programmatically created from 1,072 design templates. To effectively annotate the infographics, we combine the model-in-the-loop and programmatic methods.

The effectiveness of InfoDet is demonstrated through three applications:

We construct a Thinking-with-Boxes scheme to enhance VLMs by explicitly providing grounded annotations of texts, charts, and HROs along with additional layered infographic images. For more details, please refer to this folder.

We compare 11 object detection models on InfoDet to assess their performance in detecting charts and HROs. The following figure shows detection results of evaluated object detection models: (a) zero-shot prompting with DINO-X; (b) 4-shot prompting with T-Rex2; (c) 4-shot fine-tuning with Co-DETR; (d) fine-tuning on InfoDet with Co-DETR. Bounding boxes in colors are the predictions for charts and HROs. For more details, please refer to this folder.

To demonstrate the broader applicability of InfoDet, we evaluate its effectiveness on graphic layout detection tasks by applying the InternImage-based model. For more details, please refer to this folder.

This project is released under the Apache 2.0 license.

• igraphicdet@outlook.com