2023 AI City Challenge

AI City is all about applying AI to improve the efficiency of operations in all physical environments. This manifests itself in reducing friction in retail and warehouse environments supporting speedier check-outs. It also manifests itself in improving transportation outcomes by making traffic more efficient and making roads safer. The common thread in all these diverse uses of AI is the extraction of actionable insights from a plethora of sensors through real-time streaming and batch analytics of the vast volume and flow of sensor data, such as those from cameras. The AI City Challenge Workshop at CVPR 2023 will specifically focus on problems in two domains where there is tremendous unlocked potential at the intersection of computer vision and artificial intelligence – the brick and mortar retail business and Intelligent Traffic Systems (ITS).

Problems of interest in retail stores include:

Multi-camera people tracking
Automated checkout

Problems of interest in ITS include:

Tracked Vehicle Retrieval by Natural Language
Naturalistic driver data analytics
Traffic Safety

We solicit original contributions in these and related areas where computer vision, natural language processing, and deep learning have shown promise in achieving large-scale practical deployment that will help make our environments smarter and safer.

To accelerate the research and development of techniques, the 7th edition of this Challenge will push the research and development in multiple directions. We will release a brand new dataset for multi-camera people tracking where a combination of real and synthetic data will be provided for training and evaluation. The synthetic data will be generated by the NVIDIA Omniverse Platform that creates highly realistic characters and environments as well as a variety of random lighting, perspectives, avatars, etc. We are also expanding the diversity of Traffic related tasks such as helmet safety and the diversity of datasets including data from traffic cameras in India.

We provide five challenges this year. Participants can compete in one or more of the five challenges.

To participate, please fill out this online AI City Challenge Datasets Request Form.

Important Dates

~~Data sets shared with participants: 1/23/2023~~
~~Evaluation server open to submissions: 02/20/2023~~
~~Challenge track submissions due: 03/25/2023 (6:00 PM, Pacific Time)~~
~~Workshop papers due: 04/07/2023 (6:00 PM, Pacific Time)~~
~~Final papers due: 04/14/2023 (6:00 PM, Pacific Time)~~
~~Open source on GitHub (training code + testing code + additional annotation) due: 04/21/2023~~
~~Presentation of papers and announcement of awards: Monday, June 19th, 2023~~

ORGANIZING COMMITTEE

CITATIONS

Please cite the following papers accordingly if you choose to work with our datasets or refer to the previous challenge results:

2023 challenge summary paper – The 7th AI City Challenge

@InProceedings{Naphade23AIC23,

author = {Milind Naphade and Shuo Wang and David C. Anastasiu and Zheng Tang and Ming-Ching Chang and Yue Yao and Liang Zheng and Mohammed Shaiqur Rahman and Meenakshi S. Arya and Anuj Sharma and Qi Feng and Vitaly Ablavsky and Stan Sclaroff and Pranamesh Chakraborty and Sanjita Prajapati and Alice Li and Shangru Li and Krishna Kunadharaju and Shenxin Jiang and Rama Chellappa},

title = {The 7th AI City Challenge},

booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops},

month = {June},

year = {2023},

}

2022 challenge summary paper – The 6th AI City Challenge

@InProceedings{Naphade22AIC22,
author = {M. Naphade and S. Wang and D. C. Anastasiu and Z. Tang and M. Chang and Y. Yao and L. Zheng and M. Shaiqur Rahman and A. Venkatachalapathy and A. Sharma and Q. Feng and V. Ablavsky and S. Sclaroff and P. Chakraborty and A. Li and S. Li and R. Chellappa},
title = {The 6th AI City Challenge},
booktitle = {2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)},
month = {June},
year = {2022},pages = {3346-3355},doi = {10.1109/CVPRW56347.2022.00378},publisher = {IEEE Computer Society}
}

2021 challenge summary paper – The 5th AI City Challenge

@InProceedings{Naphade21AIC21,
author = {Milind Naphade and Shuo Wang and David C. Anastasiu and Zheng Tang and Ming-Ching Chang and Xiaodong Yang and Yue Yao and Liang Zheng and Pranamesh Chakraborty and Christian E. Lopez and Anuj Sharma and Qi Feng and Vitaly Ablavsky and Stan Sclaroff},
title = {The 5th AI City Challenge},
booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops},
month = {June},
year = {2021},
}

2020 challenge summary paper – The 4th AI City Challenge

@InProceedings{Naphade20AIC20,
author = {Milind Naphade and Shuo Wang and David C. Anastasiu and Zheng Tang and Ming-Ching Chang and Xiaodong Yang and Liang Zheng and Anuj Sharma and Rama Chellappa and Pranamesh Chakraborty},

title = {The 4th AI City Challenge},

booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops},
month = {June},
year = {2020},

pages = {2665–2674}

}

2019 challenge summary paper – The 2019 AI City Challenge

@InProceedings{Naphade19AIC19,
author = {Milind Naphade and Zheng Tang and Ming-Ching Chang and David C. Anastasiu and Anuj Sharma and Rama Chellappa and Shuo Wang and Pranamesh Chakraborty and Tingting Huang and Jenq-Neng Hwang and Siwei Lyu},
title = {The 2019 AI City Challenge},
booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops},
month = {June},
year = {2019},
pages = {452–460}
}

2018 challenge summary paper – The 2018 AI City Challenge

@inproceedings{Naphade18AIC18,
author={Milind Naphade and Ming-Ching Chang and Anuj Sharma and David C. Anastasiu and Vamsi Jagarlamudi and Pranamesh Chakraborty and Tingting Huang and Shuo Wang and Ming-Yu Liu and Rama Chellappa and Jenq-Neng Hwang and Siwei Lyu},
title = {The 2018 NVIDIA AI City Challenge},
booktitle = {Proc. CVPR Workshops},
pages = {53-–60},
year = 2018
}

2017 challenge summary paper – The NVIDIA AI City Challenge

@inproceedings{Naphade17AIC17,

author={Milind Naphade and David C. Anastasiu and Anuj Sharma and Vamsi Jagrlamudi and Hyeran Jeon and Kaikai Liu and Ming-Ching Chang and Siwei Lyu and Zeyu Gao},

title={The NVIDIA AI City Challenge},

booktitle = {Prof. SmartWorld},

address = {Santa Clara, CA, USA},

year = 2017

}

Natural language-based vehicle retrieval dataset: CityFlow-NL: Tracking and Retrieval of Vehicles at City Scale by Natural Language Descriptions

@InProceedings{Feng21CityFlowNL,
author={Qi Feng and Vitaly Ablavsky and Stan Sclaroff},
title = {CityFlow-NL: Tracking and Retrieval of Vehicles at City Scale by Natural Language Descriptions},
howpublished = {arXiv:2101.04741},
year = {2021}
}

Vehicle MTMC tracking & re-identification dataset – CityFlow: A City-Scale Benchmark for Multi-Target Multi-Camera Vehicle Tracking and Re-Identification

@InProceedings{Tang19CityFlow,
author = {Zheng Tang and Milind Naphade and Ming-Yu Liu and Xiaodong Yang and Stan Birchfield and Shuo Wang and Ratnesh Kumar and David Anastasiu and Jenq-Neng Hwang},

title = {CityFlow: A City-Scale Benchmark for Multi-Target Multi-Camera Vehicle Tracking and Re-Identification},
booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2019},

pages = {8797–8806}
}

Synthetic 3D vehicle dataset – Simulating Content Consistent Vehicle Datasets with Attribute Descent

@InProceedings{Yao20VehicleX,
author={Yue Yao and Liang Zheng and Xiaodong Yang and Milind Naphade and Tom Gedeon},

title = {Simulating Content Consistent Vehicle Datasets with Attribute Descent},
booktitle = {The European Conference on Computer Vision (ECCV)},

month = {August},
year = {2020},

pages = {775–791}
}