# End-to-end-Autonomous-Driving **Repository Path**: Handy_xing/End-to-end-Autonomous-Driving ## Basic Information - **Project Name**: End-to-end-Autonomous-Driving - **Description**: No description available - **Primary Language**: Unknown - **License**: MIT - **Default Branch**: main - **Homepage**: None - **GVP Project**: No ## Statistics - **Stars**: 0 - **Forks**: 0 - **Created**: 2025-01-03 - **Last Updated**: 2025-01-03 ## Categories & Tags **Categories**: Uncategorized **Tags**: None ## README
# End-to-end Autonomous Driving > **This repo is all you need for end-to-end autonomous driving research.** We present awesome talks, comprehensive paper collections, benchmarks, and challenges. ## Table of Contents - [At a Glance](#at-a-glance) - [Learning Materials for Beginners](#learning-materials-for-beginners) - [Workshops and Talks](#workshops-and-talks) - [Paper Collection](#paper-collection) - [Benchmarks and Datasets](#benchmarks-and-datasets) - [Competitions / Challenges](#competitions--challenges) - [Contributing](#contributing) - [License](#license) - [Citation](#citation) - [Contact](#contact) ## At a Glance The autonomous driving community has witnessed a rapid growth in approaches that embrace an end-to-end algorithm framework, utilizing raw sensor input to generate vehicle motion plans, instead of concentrating on individual tasks such as detection and motion prediction. In this survey, we provide a comprehensive analysis of more than 270 papers on the motivation, roadmap, methodology, challenges, and future trends in end-to-end autonomous driving. More details can be found in our survey paper. > [**End-to-end Autonomous Driving: Challenges and Frontiers**](https://arxiv.org/abs/2306.16927) > > [Li Chen](https://scholar.google.com/citations?user=ulZxvY0AAAAJ&hl=en&authuser=1)1,2, [Penghao Wu](https://penghao-wu.github.io)1, [Kashyap Chitta](https://kashyap7x.github.io/)3,4, [Bernhard Jaeger](https://kait0.github.io/)3,4, [Andreas Geiger](https://www.cvlibs.net/)3,4, and [Hongyang Li](https://lihongyang.info/)1,2 > > 1 OpenDriveLab, Shanghai AI Lab, 2 University of Hong Kong, 3 University of Tübingen, 4 Tübingen AI Center >
![](assets/overview.jpg)
`` If you find some useful related materials, shoot us an email or simply open a PR! ``

(back to top)

## Learning Materials for Beginners **Online Courses** - [Lecture: Self-Driving Cars](https://uni-tuebingen.de/en/fakultaeten/mathematisch-naturwissenschaftliche-fakultaet/fachbereiche/informatik/lehrstuehle/autonomous-vision/lectures/self-driving-cars/), Andreas Geiger, University of Tübingen, Germany - [Self-Driving Cars Specialization](https://www.coursera.org/specializations/self-driving-cars), University of Toronto, Coursera - [The Complete Self-Driving Car Course - Applied Deep Learning](https://www.udemy.com/course/applied-deep-learningtm-the-complete-self-driving-car-course/), Udemy - [Self-Driving Car Engineer Nanodegree Program](https://www.udacity.com/course/self-driving-car-engineer-nanodegree--nd0013), Udacity

(back to top)

## Workshops and Talks **Workshops (recent years)** - [CVPR 2024] [Foundation Models for Autonomous Systems](https://opendrivelab.com/cvpr2024/workshop/) - [CVPR 2024] [Tutorial: End-to-End Autonomy: A New Era of Self-Driving](https://wayve.ai/cvpr-e2ead-tutorial/) - [CVPR 2024] [Tutorial: Towards Building AGI in Autonomy and Robotics](https://opendrivelab.com/cvpr2024/tutorial/) - [CVPR 2023] [Workshop on End-to-end Autonomous Driving](https://opendrivelab.com/e2ead/cvpr23.html) - [CVPR 2023] [End-to-End Autonomous Driving: Perception, Prediction, Planning and Simulation](https://e2ead.github.io/2023.html) - [ICRA 2023] [Scalable Autonomous Driving](https://sites.google.com/view/icra2023av/home?authuser=0) **Workshops (previous years)**
- [NeurIPS 2022] [Machine Learning for Autonomous Driving](https://ml4ad.github.io/) - [IROS 2022] [Behavior-driven Autonomous Driving in Unstructured Environments](https://gamma.umd.edu/workshops/badue22/) - [ICRA 2022] [Fresh Perspectives on the Future of Autonomous Driving Workshop](https://www.self-driving-cars.org/) - [NeurIPS 2021] [Machine Learning for Autonomous Driving](https://ml4ad.github.io/2021/) - [NeurIPS 2020] [Machine Learning for Autonomous Driving](https://ml4ad.github.io/2020/) - [CVPR 2020] [Workshop on Scalability in Autonomous Driving](https://sites.google.com/view/cvpr20-scalability)

**Talks**
Relevant talks from other workshops - [Common Misconceptions in Autonomous Driving](https://www.youtube.com/watch?v=x_42Fji1Z2M) - Andreas Geiger, Workshop on Autonomous Driving, CVPR 2023 - [Learning Robust Policies for Self-Driving](https://www.youtube.com/watch?v=rm-1sPQV4zg) - Andreas Geiger, AVVision: Autonomous Vehicle Vision Workshop, ECCV 2022 - [Autonomous Driving: The Way Forward](https://www.youtube.com/watch?v=XmtTjqimW3g) - Vladlen Koltun, Workshop on AI for Autonomous Driving, ICML 2020 - [Feedback in Imitation Learning: Confusion on Causality and Covariate Shift](https://www.youtube.com/watch?v=4VAwdCIBTG8) - Sanjiban Choudhury and Arun Venkatraman, Workshop on AI for Autonomous Driving, ICML 2020

(back to top)

## Paper Collection We list key challenges from a wide span of candidate concerns, as well as trending methodologies. Please refer to [this page](./papers.md) for the full list, and the [survey paper](https://arxiv.org/abs/2306.16927) for detailed discussions. - [Survey](./papers.md#survey) - [Language / VLM for Driving](./papers.md#language--vlm-for-driving) - [Review for VLM in Driving](./papers.md#review-for-vlm-in-driving) - [Papers for VLM in Driving](./papers.md#papers-for-vlm-in-driving) - [World Model & Model-based RL](./papers.md#world-model--model-based-rl) - [Multi-sensor Fusion](./papers.md#multi-sensor-fusion) - [Multi-task Learning](./papers.md#multi-task-learning) - [Interpretability](./papers.md#interpretability) - [Review for Interpretability](./papers.md#review-for-interpretability) - [Attention Visualization](./papers.md#attention-visualization) - [Interpretable Tasks](./papers.md#interpretable-tasks) - [Cost Learning](./papers.md#cost-learning) - [Linguistic Explainability](./papers.md#linguistic-explainability) - [Uncertainty Modeling](./papers.md#uncertainty-modeling) - [Counterfactual Explanations and Causal Inference](./papers.md#counterfactual-explanations-and-causal-inference) - [Visual Abstraction / Representation Learning](./papers.md#visual-abstraction--representation-learning) - [Policy Distillation](./papers.md#policy-distillation) - [Causal Confusion](./papers.md#causal-confusion) - [Robustness](./papers.md#robustness) - [Long-tailed Distribution](./papers.md#long-tailed-distribution) - [Covariate Shift](./papers.md#covariate-shift) - [Domain Adaptation](./papers.md#domain-adaptation) - [Affordance Learning](./papers.md#affordance-learning) - [BEV](./papers.md#bev) - [Transformer](./papers.md#transformer) - [V2V Cooperative](./papers.md#v2v-cooperative) - [Distributed RL](./papers.md#distributed-rl) - [Data-driven Simulation](./papers.md#data-driven-simulation) - [Parameter Initialization](./papers.md#parameter-initialization) - [Traffic Simulation](./papers.md#traffic-simulation) - [Sensor Simulation](./papers.md#sensor-simulation)

(back to top)

## Benchmarks and Datasets > Real-world deployment is the final benchmark for autonomous driving. > However, testing in the real world is expensive. For academic benchmarking, we recommend you read this write-up from Jaeger et al. 2024: [Common mistakes in benchmarking](https://github.com/autonomousvision/carla_garage/blob/leaderboard_2/docs/common_mistakes_in_benchmarking_ad.md). **Closed-loop** - [CARLA](https://leaderboard.carla.org/leaderboard/) - [Leaderboard 1.0](https://leaderboard.carla.org/get_started_v1/) - [Leaderboard 2.0](https://leaderboard.carla.org/get_started/) - [nuPlan](https://www.nuscenes.org/nuplan) - [Leaderboard](https://eval.ai/web/challenges/challenge-page/1856/overview) (inactive after the CVPR 2023 challege) - [NAVSIM](https://github.com/autonomousvision/navsim)
Open-loop - [nuScenes](https://www.nuscenes.org/nuscenes) - [nuPlan](https://www.nuscenes.org/nuplan) - [Argoverse](https://www.argoverse.org/av2.html) - [Waymo Open Dataset](https://waymo.com/open/)

(back to top)

## Competitions / Challenges - [End-to-End Driving at Scale](https://opendrivelab.com/challenge2024/#end_to_end_driving_at_scale), Foundation Models for Autonomous Systems, CVPR 2024 - [CARLA Autonomous Driving Challenge](https://opendrivelab.com/challenge2024/#carla), Foundation Models for Autonomous Systems, CVPR 2024 - [nuPlan planning](https://opendrivelab.com/AD23Challenge.html#nuplan_planning), Workshop on End-to-end Autonomous Driving, CVPR 2023 - [CARLA Autonomous Driving Challenge 2022](https://ml4ad.github.io/#challenge), Machine Learning for Autonomous Driving, NeurIPS 2022 - [CARLA Autonomous Driving Challenge 2021](https://ml4ad.github.io/2021/#challenge), Machine Learning for Autonomous Driving, NeurIPS 2021 - [CARLA Autonomous Driving Challenge 2020](https://ml4ad.github.io/2020/#challenge), Machine Learning for Autonomous Driving, NeurIPS 2020 - [Learn-to-Race Autonomous Racing Virtual Challenge](https://www.aicrowd.com/challenges/learn-to-race-autonomous-racing-virtual-challenge), 2022 - [INDY Autonomous Challenge](https://www.indyautonomouschallenge.com/)

(back to top)

## Contributing Thank you for all your contributions. Please make sure to read the [contributing guide](./CONTRIBUTING.md) before you make a pull request.

(back to top)

## License End-to-end Autonomous Driving is released under the [MIT license](./LICENSE).

(back to top)

## Citation If you find this project useful in your research, please consider citing: ```BibTeX @article{chen2023e2esurvey, title={End-to-end Autonomous Driving: Challenges and Frontiers}, author={Chen, Li and Wu, Penghao and Chitta, Kashyap and Jaeger, Bernhard and Geiger, Andreas and Li, Hongyang}, journal={IEEE Transactions on Pattern Analysis and Machine Intelligence}, year={2024} } ```

(back to top)

## Contact Primary contact: `hy@opendrivelab.com`. You can also contact: `lichen@opendrivelab.com`. Join [OpenDriveLab Slack](https://opendrivelab.slack.com/join/shared_invite/zt-2ft3dfjoz-6XErfBts4s_8Fen88wO4Jg#/shared-invite/email) to chat with the commuty! Slack channel: `#e2ead`.

(back to top)