Awesome self-driving

A list of awesome stuff for awesome self-driving stuff.

Frameworks & libraries

Computer vision

• OpenCV
• Visionworks

Machine learning

• PyTorch
• Torchvision
• PyTorch Lightning
• Detectron2
• CNTK
• ONNX

Inference

• Torch2TRT

3D data processing

• Open3D

Simulators

• Carla
• Carla map editor
• LGSVL
• AirSim

Topics

OS

UNIX stuff

• Python UNIX service implementation

OS ENviroment

• Pylot
• ROS2
• ROS
• Apollo
• Autoware

Comminications

• ZCM

Sensors / Hardware

• List of GStreamer vision plugins

• Pylon GStreamer plugin

• NVIDIA Jetson IMX477 RPIv3 driver

• ZCM GStreamer plugin

• Intel RealSense library

• Charuco camera calibration

• Lidar to camera calibration

Perception

Lidar

Object detection

• Super Fast and Accurate 3D Object Detection based on 3D LiDAR Point Clouds

Camera

Object detection

• MMDetection toolbox
• MMDetection 3D toolbox
• Deep learning object detection SOTA
• PyTorch tutorial for object detection

Human pose estimation

• MMPose toolbox

Action recognition

• MMAction toolbox

Segmentation

• MMSegmentation toolbox

Depth estimation

• Simple depth estimation using CNN
• Monodepth2
• MiDaS
• Facebook research consistent depth

Stereo Vision

• Dense depth
• PSMNet
• Semi-global blockmatching CUDA implementation
• Yet another deep stereovision

Depth obstacles segmentation

• V-Disp

Structure from motion

• COLMAP

Visual tracking

• GPL TLD C++ implementation

NN Tuning and explanation

• GradCam

Control

...

Localization

• PythonRobotics
• Laika: python GNSS processing library

SLAM and odometry

• Awesome SLAM datasets
• OpenCV RGBD Odometry

Planning

RL

• Min Carla environment
• Highway env
• RL for Decision-Making for self-driving-cars
• Learning by cheating
• Learning by cheating
• Jetson reinforcement learning

Visualization

• Carla Viz plugin
• StreetScape.gl
• XVIZ

Datasets

Real datasets

• KITTI
• KITTI 360
• CityScapes
• A2D2
• German traffic signs
• Icevision traffic lights
• Awesome public datasets

Synthetics datasets

• vkitti v2
• Carla dataset runner

Tools

• Awesome list of data labeling tools
• CVAT
• Semi-auto image annotataion
• Open images downloader
• Cityscapes scripts
• 3D labelling tools
• Label IMG

GANs, augmentation, etc.

• Image2Image papers
• Vid2Vid
• Summer2Winter stylee transfering
• Fast photo style

Challenges

• Carla AD Challenge
• Udacity CarND Advanced Lane-Lines Challenge

Awesome information

Papers research

• Papers With Code (always SOTA)
• Awesome bibliography research in autonomous driving
• SOTA in self-driving cars from CVLIBS

Blogs, Youtube, magazines

• List of data science blogs
• PyImageSearch
• Two Minute Papers
• Computer Vision Foundation
• JetsonHacks
• Lex Fridman
• GreenTheOnly
• Self-driving woman
• Sid1057
• DeepScale AI
• Comma AI
• Learn OpenCV

Courses

• Self-driving cars specialization by University of Toronto
• List of awesome courses

Pretrained models

• Pretrained models from OpenVINO

Basic

• Awesome Computer Vision
• Awesome Deep Vision
• DeepLearning papers roadmap

Other

• Awesome list of 3D reconstruction methods
• Awesome CARLA list

TO SORT

• vision-for-action
• Converter PyTorch networks to TensorRT
• Jetson inference

TODO

• Order
• README STructuire
• Programming Languages
• Control section
• Card design
• Web Version
• Awesome contribution
• More Courses
• More Books