Skip to content

Commit a62a9c0

Browse files
committed
update TETA metric
1 parent 139c5ac commit a62a9c0

File tree

2 files changed

+9
-2
lines changed

2 files changed

+9
-2
lines changed

README.md

+9-1
Original file line numberDiff line numberDiff line change
@@ -13,13 +13,21 @@ However, this is far from the case in recent large-scale MOT datasets, which con
1313
We address these issues by disentangling classification from tracking.
1414
We introduce a new metric, Track Every Thing Accuracy (TETA), breaking tracking measurement into three sub-factors: localization, association, and classification, allowing comprehensive benchmarking of tracking performance even under inaccurate classification. TETA also deals with the challenging incomplete annotation problem in large-scale tracking datasets. We further introduce a Track Every Thing tracker (TETer), that performs association using Class Exemplar Matching (CEM). Our experiments show that TETA evaluates trackers more comprehensively, and TETer achieves significant improvements on the challenging large-scale datasets BDD100K and TAO compared to the state-of-the-art.
1515

16+
## Update TETA metric
17+
18+
*New Repo*: we update the TETA metric to a new repo: [TETA](https://github.com/siyuanliii/TETA). It is more user-friendly and has more features.
19+
20+
The new repo directly supports evaluation for `TAO TETA benchmark`, `Open-vocabulary MOT benchmark`, `BDD100K MOT benchmark`, and `BDD100K MOTS benchmark`.
21+
Please refer to the new repo for the latest updates.
22+
1623
## TETA
17-
[TETA](teta/README.md) builds upon the HOTA metric, while extending it to better deal with
24+
[TETA](https://github.com/siyuanliii/TETA) builds upon the HOTA metric, while extending it to better deal with
1825
multiple categories and incomplete annotations. TETA evaluate trackers based on a novel local cluster design. TETA consists of three parts: a
1926
localization score, an association score, and a classification score, which enable
2027
us to evaluate the different aspects of each tracker properly.
2128

2229

30+
2331
Install TETA metric:
2432
```angular2html
2533
python -m pip install git+https://github.com/SysCV/tet.git/#subdirectory=teta

docs/GET_STARTED.md

-1
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,6 @@ After downloaded the annotations, please transform the offical annotation files
2222

2323
First, uncompress the downloaded annotation file and you will obtain a folder named `bdd100k`.
2424

25-
2625
To convert the detection set, you can do as
2726
```bash
2827
mkdir data/bdd/annotations/det_20

0 commit comments

Comments
 (0)