In this project, we will attempt to recreate a GitHub Copilot. Since properly recreating the service requires an immense amount of compute for model training, we will seek to build a Mini Copilot. The purpose of this undertaking, and the materials in this repo, is purely educational.
Weekly slides can be found here (requires UMich login).
| Week | Date | Topic |
|---|---|---|
| 1 | 9/22 | Project Overview + Causal Language Modeling (CLM) w/ n-grams |
| 2 | 9/29 | CLM + High Performance Computing (HPC) |
| 3 | 10/6 | CLM Continued + Model Evaluation |
| 4 | 10/20 | Masked Language Modeling (MLM) |
| 5 | 10/27 | Model Deployment |
| 6 | 11/3 | Creating a VSCode Extension |
| 7 | 11/10 | Buffer Week / Going deeper |
| 8 | 11/17 | Final Expo Prep |