Introduction

The 3D world around us is composed of a rich variety of objects: buildings, bridges, trees, cars, rivers, and so forth, each with distinct appearance, morphology, and function. Giving machines the ability to precisely segment and label these diverse objects is of key importance to allow them to interact competently within our physical world, for applications such as scene-level robot navigation, autonomous driving, and even large-scale urban 3D modeling, which is critical for the future of smart city planning and management.

Over the past years, remarkable advances in techniques for 3D point cloud understanding have greatly boosted performance. Although these approaches achieve impressive results for object recognition and semantic segmentation, almost all of them are limited to extremely small 3D point clouds, and are difficult to be directly extended to large-scale point clouds. [Bilibili Live] [YouTube Live]

The 2nd Challenge on Large Scale Point-cloud Analysis for Urban Scenes Understanding (Urban3D) at ECCV 2022 aims to establish new benchmarks for 3D semantic and instance segmentation on urban-scale point clouds. In particular, we prime the challenge with both SensatUrban and STPLS3D datasets. SensatUrban consists of large-scale subsections of multiple urban areas in the UK. With the high quality of per-point annotations and the diverse distribution of semantic categories. STPLS3D is composed of both real-world and synthetic environments which cover more than 17 km2 of the city landscape in the U.S. with up to 18 fine-grained semantic classes and 14 instance classes. These two datasets are complementary to each other and allow us to explore a number of key research problems and directions for 3D semantic and instance learning in this workshop. We aspire to highlight the challenges faced in 3D segmentation on extremely large and dense point clouds of urban environments, sparking innovation in applications such as smart cities, digital twins, autonomous vehicles, automated asset management of large national infrastructures, and intelligent construction sites. We hope that our datasets, and this workshop could inspire the community to explore the next level of 3D learning. Specifically, We encourage researchers from a wide range of background to participate in our challenge, the topics including but not limited to:

  • Semantic segmentation of large-scale 3D point clouds.
  • Instance segmentation of 3D point clouds.
  • Weakly supervised learning in 3D point clouds analysis.
  • Learning from imbalanced 3D point clouds.
  • 3D point cloud acquisition & visualization.
  • 3D object detection & reconstruction.
  • Semi-/weak-/un-/self- supervised learning methods for 3D point clouds.
We will be hosting 2 invited speakers and holding 2 parallel challenges (i.e., semantic and instance segmentation), and 1 panel discussion session for the topic of point cloud segmentation. More information will be provided as soon as possible.


Call for Contributions

Urban3D Challenges@ECCV'2022

The Urban3D Challenges are hosted on Codalab, and can be found at:


We are thankful to our sponsor for providing the following prizes. The prize award will be granted to the Top 3 individuals and teams for Each Challenge Track on the leaderboard that provide a valid submission.

    • 1st Place:
$1,500 USD courtesy of
    • 2nd Place:
$1,000 USD courtesy of
    • 3rd Place:
$500 USD courtesy of


Important Dates


Workshop Proposal Accepted March 26, 2022
Competition Starts May 12, 2022
Competition Ends October 10, 2022 (23:59 Pacific time)
Notification to Participants October 15, 2022
Finalized Workshop Program (Half Day) October 23, 2022 (8:30-12:00 EDT)


Preliminary Program Outline


08:30-08:35 Welcome Introduction
08:35-09:20 Invited Talk (Talk 1)
09:20-10:05 Invited Talk (Talk 2)
10:05-10:10 Coffee break
10:10-10:20 Awarding ceremony
10:20-10:40 Winner Talk (Track 1) + Q&A
10:40-11:00 Winner Talk (Track 2) + Q&A
11:00-11:20 Winner Talk (Track 3) + Q&A
11:20-11:55 Panel Discussion
11:55-12:00 Closing Remarks


Invited Keynote Speakers


3D point cloud classification with an eye on daily applications


Biography (click to expand/collapse)

Fabio Remondino is the head of the 3D Optical Metrology research unit at FBK - Bruno Kessler Foundation, a public research center in Trento, Italy. He received a PhD in Photogrammetry from ETH Zurich in 2006. His main research interests are in the field of reality-based 3D surveying and modeling, sensor and data fusion and 3D data classification. He is working in all automation aspects of the entire 3D reconstruction pipeline for applications in the industrial, environmental and heritage field. He is author of more than 200 articles in journals and conferences. He is involved in knowledge and technology transfer, organizing more than 30 conferences, 20 summer schools and 5 tutorials. Fabio is currently serving as Vice-President of EuroSDR and he was President of ISPRS Technical Commission V and II (2012-2021) as well as vice-President of CIPA Heritage Documentation (2015 to 2019).

Beyond Sliding Windows: Scaling Up 3D Deep Learning


Biography (click to expand/collapse)

Loic Landrieu received his PhD from INRIA and ENPC. He has since been a researcher at IGN, the French mapping agency, and focuses on developing new machine learning approaches for problems with spatial and temporal structures, such as the analysis of 3D point clouds or satellite time series. He is the main investigator of the ANR Ready3D on dynamic 3D analysis for autonomous driving. Committed to open and reproducible research, he has participated in several open-source projects and released open-access large-scale benchmarks.

Invited Panel Speakers

Hengshuang Zhao
The University of Hong Kong (HKU)
Tolga Birdal
Stanford University
Yue Wang
Massachusetts Institute of Technology
Songyou Peng
ETH Zurich and Max Planck Institute
Nina Singer
University of Dayton



Organizers

Qingyong Hu
University of Oxford
Meida Chen
University of Southern California - Institute for Creative Technologies
Ta-Ying Cheng
University of Oxford
Sheikh Khalid
Sensat LTD.
Bo Yang
The Hong Kong Polytechnic University


Ronarld Clark
Imperial College London
Jiahui Chen
Sun Yat-sen University
Leying Zhang
Sun Yat-sen University
Rongkun Yang
Sun Yat-sen University
Yulan Guo
National University of Defense Technology


Aleš Leonardis
University of Birmingham
Niki Trigoni
University of Oxford
Andrew Markham
University of Oxford


Workshop sponsored by:


Previous years' workshops: