Skip to main content
placeholder image

Visual Map-Based Localization for Intelligent Vehicles from Multi-View Site Matching

Journal Article


Abstract


  • Accurate localization is a crucial step for intelligent vehicles (IVs). And vision-based localization methods are promising due to its good accuracy and low cost. However, vision-based methods are usually not robust enough due to the errors of matching similar road scenarios. In this paper, we proposed a visual map-based localization method, called multi-view site matching (MVSM). We proposed using two camera views (i.e., downward-view and front-view) to construct visual map. The visual map consists of a serial of nodes. Each node encodes the features of the road, the 2D structure, and the poses of the vehicle. Based on the constructed visual map, we proposed a multi-scale method for accurate vehicle localization. In coarse localization, we adopt a topological model to obtain a set of candidate nodes from visual map. Furthermore, holistic features from front view are matched within the candidates such that the best matched node is determined for image-level localization. In metric localization, the best matched is first verified with the local features from downward view. And the vehicle pose is finally computed by utilizing the 2D structure from the verified nodes in the map. In the experiment, the proposed MVSM method has been tested with actual field data covering different pavement types in different seasons. The proposed MVSM method can achieve less than 0.20m mean localization errors. Compared to existing vision-based methods, the proposed method utilizes two views to enhance image-level localization and 2D pavement structure to improve metric localization so as to greatly improve the overall localization performance.

UOW Authors


  •   Li, Zhixiong (external author)

Publication Date


  • 2021

Citation


  • Li, Y., Hu, Z., Cai, Y., Wu, H., Li, Z., & Sotelo, M. A. (2021). Visual Map-Based Localization for Intelligent Vehicles from Multi-View Site Matching. IEEE Transactions on Intelligent Transportation Systems, 22(2), 1068-1079. doi:10.1109/TITS.2019.2962183

Scopus Eid


  • 2-s2.0-85100536717

Start Page


  • 1068

End Page


  • 1079

Volume


  • 22

Issue


  • 2

Place Of Publication


Abstract


  • Accurate localization is a crucial step for intelligent vehicles (IVs). And vision-based localization methods are promising due to its good accuracy and low cost. However, vision-based methods are usually not robust enough due to the errors of matching similar road scenarios. In this paper, we proposed a visual map-based localization method, called multi-view site matching (MVSM). We proposed using two camera views (i.e., downward-view and front-view) to construct visual map. The visual map consists of a serial of nodes. Each node encodes the features of the road, the 2D structure, and the poses of the vehicle. Based on the constructed visual map, we proposed a multi-scale method for accurate vehicle localization. In coarse localization, we adopt a topological model to obtain a set of candidate nodes from visual map. Furthermore, holistic features from front view are matched within the candidates such that the best matched node is determined for image-level localization. In metric localization, the best matched is first verified with the local features from downward view. And the vehicle pose is finally computed by utilizing the 2D structure from the verified nodes in the map. In the experiment, the proposed MVSM method has been tested with actual field data covering different pavement types in different seasons. The proposed MVSM method can achieve less than 0.20m mean localization errors. Compared to existing vision-based methods, the proposed method utilizes two views to enhance image-level localization and 2D pavement structure to improve metric localization so as to greatly improve the overall localization performance.

UOW Authors


  •   Li, Zhixiong (external author)

Publication Date


  • 2021

Citation


  • Li, Y., Hu, Z., Cai, Y., Wu, H., Li, Z., & Sotelo, M. A. (2021). Visual Map-Based Localization for Intelligent Vehicles from Multi-View Site Matching. IEEE Transactions on Intelligent Transportation Systems, 22(2), 1068-1079. doi:10.1109/TITS.2019.2962183

Scopus Eid


  • 2-s2.0-85100536717

Start Page


  • 1068

End Page


  • 1079

Volume


  • 22

Issue


  • 2

Place Of Publication