g

FogBEV: Degradation-Aware Bird's-Eye-View Fusion for Autonomous Driving in Dense Fog

Authors

  • Ravi Iyer

    Department of Computer Science, Purdue University, West Lafayette, IN 47907, USA,
    Author
  • Megan Wang*

    Department of Computer Science, Purdue University, West Lafayette, IN 47907, USA
    Author

DOI:

https://doi.org/10.71465/jgs62

Keywords:

autonomous driving, dense fog, bird's-eye view, gated imaging, LiDAR, sensor fusion, uncertainty estimation, synthetic benchmark

Abstract

Dense fog is a persistent failure mode for autonomous-driving perception because optical contrast is reduced by atmospheric scattering while range sensors may suffer from sparsification, backscatter and unstable returns. This paper presents FogBEV, a degradation-aware bird's-eye-view fusion framework that combines gated/NIR image evidence with LiDAR evidence in a shared BEV representation. Unlike fixed camera-LiDAR fusion, FogBEV estimates per-modality reliability from feature contrast, point-density and false-return cues, then uses these reliabilities to adjust fusion weights before BEV detection. The design is motivated by the strong gated vision and LiDAR integration framework, but moves the adaptation from image/point features into a BEV-centric formulation that is directly compatible with modern planning stacks. To avoid fabricated results, this draft reports only a lightweight synthetic BEV fog benchmark generated by the accompanying code. The benchmark simulates three meteorological optical range levels, 200 m, 80 m and 40 m, and evaluates BEV occupancy average precision over three random seeds. FogBEV improves dense-fog BEV AP from 0.471 for fixed fusion and 0.561 for magnitude-based fusion to 0.670, while shifting the mean LiDAR weight below 0.01 in dense fog. The results support the central claim that degradation-aware weighting can prevent corrupted range evidence from suppressing visible gated structures. The paper also clearly states the remaining need for full validation on real adverse-weather datasets such as SeeingThroughFog/DENSE before any safety deployment claim is made.

References

M. Hahner, C. Sakaridis, M. Bijelic, F. Heide, F. Yu, D. Dai, and L. Van Gool, 'LiDAR Snowfall Simulation for Robust 3D Object Detection,' in Proc. IEEE/CVF CVPR, 2022, pp. 16364-16374.

[2] D. Teng, "TEAS: Token- and Energy-Aware Autoscaling for Cost-Efficient LLM Serving," AI and Data Science Journal, 2025.

[3] T. Gruber, F. Julca-Aguilar, M. Bijelic, and F. Heide, 'Gated2Depth: Real-Time Dense Lidar From Gated Images,' in Proc. IEEE/CVF ICCV, 2019, pp. 1506-1516.

[4] A. Walia, S. Walz, M. Bijelic, F. Mannan, F. Julca-Aguilar, M. Langer, W. Ritter, and F. Heide, 'Gated2Gated: Self-Supervised Depth Estimation From Gated Images,' in Proc. IEEE/CVF CVPR, 2022, pp. 2811-2821.

[5] M. Laurenzis, F. Christnacher, D. Monnin, and T. Scholz, 'Investigation of Range-Gated Imaging in Scattering Environments,' Optical Engineering, vol. 51, no. 6, 061303, 2012.

[6] M. Kutila, P. Pyykonen, H. Holzhuter, M. Colomb, and P. Duthon, 'Automotive LiDAR Performance Verification in Fog and Rain,' in Proc. IEEE ITSC, 2018, pp. 1695-1701.

[7] R. H. Rasshofer, M. Spies, and H. Spies, 'Influences of Weather Phenomena on Automotive Laser Radar Systems,' Advances in Radio Science, vol. 9, pp. 49-60, 2011.

[8] F. Zhang, Z. Guo, J. Ding, J. Yang, and W. Liu, 'Adaptive Sensor Fusion for Robust Perception in Dense Fog: A Gated Vision and LiDAR Integration Framework,' Sensors, vol. 26, no. 12, 3728, 2026.

[9] C. Sakaridis, D. Dai, and L. Van Gool, 'Semantic Foggy Scene Understanding With Synthetic Data,' International Journal of Computer Vision, vol. 126, pp. 973-992, 2018.

[10] C. Sakaridis, D. Dai, and L. Van Gool, 'ACDC: The Adverse Conditions Dataset With Correspondences for Semantic Driving Scene Understanding,' in Proc. IEEE/CVF ICCV, 2021, pp. 10765-10775.

[11] A. Geiger, P. Lenz, and R. Urtasun, 'Are We Ready for Autonomous Driving? The KITTI Vision Benchmark Suite,' in Proc. IEEE CVPR, 2012, pp. 3354-3361.

[12] H. Caesar et al., 'nuScenes: A Multimodal Dataset for Autonomous Driving,' in Proc. IEEE/CVF CVPR, 2020, pp. 11621-11631.

[13] J. Geyer et al., 'A2D2: Audi Autonomous Driving Dataset,' arXiv:2004.06320, 2020.

[14] D. Feng et al., 'Deep Multi-Modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challenges,' IEEE Transactions on Intelligent Transportation Systems, vol. 22, no. 3, pp. 1341-1360, 2021.

[15] D. Teng, "PACO: Predictive Auto-Configuration for SLO-Constrained Large Language Model Inference Serving," Innovation and Technology Studies, 2025.

[16] Y. Zhou and O. Tuzel, 'VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection,' in Proc. IEEE/CVF CVPR, 2018, pp. 4490-4499.

[17] Y. Yan, Y. Mao, and B. Li, 'SECOND: Sparsely Embedded Convolutional Detection,' Sensors, vol. 18, no. 10, 3337, 2018.

[18] A. H. Lang, S. Vora, H. Caesar, L. Zhou, J. Yang, and O. Beijbom, 'PointPillars: Fast Encoders for Object Detection From Point Clouds,' in Proc. IEEE/CVF CVPR, 2019, pp. 12697-12705.

[19] S. Vora, A. H. Lang, B. Helou, and O. Beijbom, 'PointPainting: Sequential Fusion for 3D Object Detection,' in Proc. IEEE/CVF CVPR, 2020, pp. 4604-4612.

[20] M. Liang, B. Yang, Y. Chen, R. Hu, and R. Urtasun, 'Multi-Task Multi-Sensor Fusion for 3D Object Detection,' in Proc. IEEE/CVF CVPR, 2019, pp. 7345-7353.

[21] X. Bai, Z. Hu, X. Zhu, Q. Huang, Y. Chen, H. Fu, and C.-L. Tai, 'TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection With Transformers,' in Proc. IEEE/CVF CVPR, 2022, pp. 1090-1099.

[22] Z. Wang, J. S. Yang, W. Shang, and J. Ding, "FairPromote: Explainable and fairness-aware talent promotion prediction via adversarial debiasing and SHAP-based interpretation," IEEE Access, 2026.

[23] B. Zi, "Large language models for enterprise workflow automation in financial operations," Innovation and Technology Studies, vol. 1, no. 1, pp. 24-29, 2024.

[24] J. Ding, Z. Shen, and W. Liu, "Game-theoretic cost-sensitive adversarial training for robust cloud intrusion detection against GAN-based evasion attacks," Applied Sciences, vol. 16, no. 8, Art. no. 3944, 2026.

[25] D. Teng, M. Rhee, Y. Qin, B. Zi, and W. Liu, "SW-SpeedDLM: Sliding window speculative decoding for diffusion language models under long context constraints," Mathematics, vol. 14, no. 12, Art. no. 2137, 2026.

[26] B. Zi, "Cloud-native distributed systems for real-time payment intelligence," AI and Data Science Journal, vol. 1, no. 1, pp. 51-56, 2024.

[27] Z. Chen, M. Wang, Z. Zeng, and W. Ping, "Uncertainty-aware financial forecasting: Leveraging conformal prediction for risk-adjusted models," IEEE Access, 2026.

[28] B. Wang, Z. Wang, W. Zhao, F. Zhang, and W. Shang, "DRL-Adapt: Deep reinforcement learning for adaptive routing convergence optimization in large-scale networks," IEEE Open Journal of the Computer Society, 2026.

[29] Y. Jiao, H. Fan, X. Yue, W. Ping, T. Sun, and J. Wang, "Dynamic heterogeneous graph contrastive learning for uncovering collusive financial fraud," Scientific Reports, 2026.

Downloads

Published

2026-07-29