Results

Valid submissions both for the point cloud and the 3D mesh can be found in table 1 and table 2. For ranking the results we rely on the individual F1 score per class, the mean F1 (mF1) score and the Overall Accuracy (OA) rounded to two decimals. In case of the mesh, the evaluation metrics are weighted according to the covered area of correctly / incorrectly classified faces. You can rank results by each column by clicking the respective column header. If you wish to see further details about one specific contribution, click the participant’s ID in order to show the normalized confusion matrix and two exemplary renderings of the point cloud / mesh. Further information is directly provided by the participants and is accessible via the icon.

 

Point Cloud

 F1-scores in % 
ParticipantAC00C01C02C03C04C05C06C07C08C09C10mF1OA
ifp-RF21022390.3688.5566.8951.5596.0678.4767.2595.9147.9159.7380.6574.8587.43
ifp-SCN21022392.3188.1463.5157.1796.8683.1968.5996.9844.8178.2073.6176.6788.42
Gao-KPConv21042288.5788.9382.1063.8997.1385.1375.2497.3842.6880.870.0072.9087.69
Gao-PN++21042278.1172.0731.7813.6573.9847.7928.3471.809.6521.674.3941.2068.50

 

 

3D Mesh

 F1-scores in % 
ParticipantAC00C01C02C03C04C05C06C07C08C09C10mF1OA
ifp-RF21022389.3589.0661.3857.6593.2982.1669.2796.0948.8562.5876.4375.1086.53
ifp-SCN21022389.8283.6661.0552.2487.0981.0159.7595.0651.0056.6170.2271.5983.73
Tang21040687.7986.7441.4349.1088.2275.4157.4591.0553.9178.3169.3070.7983.26

 

C00   Low Vegetation
C01   Impervious Surface
C02   Vehicle
C03   Urban Furniture
C04   Roof
C05   Facade
C06   Shrub
C07   Tree
C08   Soil/Gravel
C09   Vertical Surface
C10   Chimney
Logo

 

Logo

Useful External Links

Our Contact

University of Stuttgart
Institute for Photogrammetry
Geschwister-Scholl-Str. 24D
70174 Stuttgart
GERMANY
Email: info@ifp.uni-stuttgart.de