Skip to content

Commit

Permalink
Update Pendubot Real Leaderboard
Browse files Browse the repository at this point in the history
  • Loading branch information
fwiebe committed Sep 4, 2024
1 parent 6d12d48 commit 96bc11b
Show file tree
Hide file tree
Showing 31 changed files with 64 additions and 0 deletions.
2 changes: 2 additions & 0 deletions data/pendubot/real_system/MC-PILCO/experiment01/scores_v2.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
1.0,1.3721065521240234,11.691982558060378,9.247057619780913,0.536432089618087,84.22068426778098,0.5964209018036564
2 changes: 2 additions & 0 deletions data/pendubot/real_system/MC-PILCO/experiment02/scores_v2.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
1.0,1.3721449375152588,11.656568827258399,8.934273187378643,0.5398028662100958,84.60940728507781,0.5976436797868687
2 changes: 2 additions & 0 deletions data/pendubot/real_system/MC-PILCO/experiment03/scores_v2.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
1.0,1.3992974758148191,11.84262978836031,10.336574342325124,0.5302110745745225,83.93313890430656,0.5893910977031668
2 changes: 2 additions & 0 deletions data/pendubot/real_system/MC-PILCO/experiment04/scores_v2.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
1.0,1.403743267059326,11.813429077399809,9.310972378019702,0.5334033982993993,84.32980455659778,0.5945004072747676
2 changes: 2 additions & 0 deletions data/pendubot/real_system/MC-PILCO/experiment05/scores_v2.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
1.0,1.398350715637207,12.057463101633976,10.635689048250246,0.543627709706396,84.33121642564925,0.5839847900779653
2 changes: 2 additions & 0 deletions data/pendubot/real_system/MC-PILCO/experiment06/scores_v2.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
1.0,1.398958683013916,11.87534865970869,10.244573530957947,0.5336816544153807,83.9017415369565,0.5892573306059011
2 changes: 2 additions & 0 deletions data/pendubot/real_system/MC-PILCO/experiment07/scores_v2.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
1.0,1.3736138343811035,11.777496293871941,9.718503137252087,0.5324923602329773,84.13633755787693,0.5936438088129359
2 changes: 2 additions & 0 deletions data/pendubot/real_system/MC-PILCO/experiment08/scores_v2.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
1.0,1.3980398178100584,11.838905882821498,9.199835888754047,0.5418800211302855,84.61425140294169,0.5937118279776432
2 changes: 2 additions & 0 deletions data/pendubot/real_system/MC-PILCO/experiment09/scores_v2.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
1.0,1.3994460105895996,11.85149280516689,10.127253152422849,0.5356657692709692,84.44546876863926,0.5892527393778391
2 changes: 2 additions & 0 deletions data/pendubot/real_system/MC-PILCO/experiment10/scores_v2.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
1.0,1.3980329036712646,12.031196196179696,11.89737465785724,0.5333047743634042,84.56633883763493,0.578290513327909
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
0.0,7.592276096343993,30.041898786911702,20.0628070099998,0.4111619453188515,313.9426705667083,0.0
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
1.0,4.412771463394165,39.09381451115345,53.420739649731345,0.6423514810036381,255.42234722975468,0.21401097079397924
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
1.0,4.400810956954956,38.97279095048071,51.705537042611354,0.6107483295551839,256.6270444129157,0.2196113238267845
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
0.0,9.999107122421265,33.77630234365946,20.776046322257585,0.41823808252273426,439.3238833363313,0.0
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
1.0,4.367953062057495,35.2716471081072,53.44573279244919,0.649067751139582,243.74702378537282,0.21862242044343916
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
1.0,4.413331985473633,38.242784004642566,55.86327988624351,0.667334897338159,255.55546064458457,0.20967923567887747
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
1.0,4.106338739395142,37.37093111798331,53.142155164719036,0.6212363429247721,249.176227118287,0.22518782172088492
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
1.0,4.410606384277344,39.01471796762816,52.12486780365781,0.6191416959139163,255.0620800576345,0.21812843115392377
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
1.0,4.363100528717041,40.688444838076364,53.130380237862475,0.6137743444357987,260.3890328881922,0.2172863332101579
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
1.0,4.1176440715789795,34.019617045928584,51.87708939254911,0.6426701772856825,242.34284169908852,0.22745206986755007
2 changes: 2 additions & 0 deletions data/pendubot/real_system/sac_lqr/experiment01/scores_v2.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
0.0,1.256127119064331,19.743063343286533,15.111872951091453,2.130652067361425,117.17110140648666,0.0
2 changes: 2 additions & 0 deletions data/pendubot/real_system/sac_lqr/experiment02/scores_v2.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
0.0,1.2039551734924316,24.58628725299553,16.452743987997,1.3512377510483462,111.26678830522062,0.0
2 changes: 2 additions & 0 deletions data/pendubot/real_system/sac_lqr/experiment03/scores_v2.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
1.0,0.6918332576751709,41.73368793171898,86.23864545352124,0.9414122500436884,124.74094488873791,0.308768955027495
2 changes: 2 additions & 0 deletions data/pendubot/real_system/sac_lqr/experiment04/scores_v2.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
0.0,1.2150514125823975,24.741091348540753,16.643726761466514,1.1968822085033928,109.67734489621098,0.0
2 changes: 2 additions & 0 deletions data/pendubot/real_system/sac_lqr/experiment05/scores_v2.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
1.0,2.4588129520416255,52.89037240610973,87.65005807796823,0.6925666787573005,168.66306698425487,0.25678046344663374
2 changes: 2 additions & 0 deletions data/pendubot/real_system/sac_lqr/experiment06/scores_v2.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
0.0,1.229020118713379,19.943725481861584,14.442991933583002,2.0241613271638466,118.1860229867219,0.0
2 changes: 2 additions & 0 deletions data/pendubot/real_system/sac_lqr/experiment07/scores_v2.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
1.0,0.6746368408203125,37.1183195101425,78.69829478215063,0.7742182969147683,114.04452213581521,0.3383572126386012
2 changes: 2 additions & 0 deletions data/pendubot/real_system/sac_lqr/experiment08/scores_v2.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
0.0,1.2363758087158203,23.810686328416587,15.899131538795174,1.1164675340303907,105.70910956123048,0.0
2 changes: 2 additions & 0 deletions data/pendubot/real_system/sac_lqr/experiment09/scores_v2.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
0.0,1.7710816860198975,34.65765615991183,26.18356437271505,0.9852614465466879,164.72209344009428,0.0
2 changes: 2 additions & 0 deletions data/pendubot/real_system/sac_lqr/experiment10/scores_v2.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],RealAI Score
1.0,0.6964025497436523,37.333394489882764,78.93441110973423,0.8032135302913469,117.02605391842712,0.3320350789211952
4 changes: 4 additions & 0 deletions leaderboards/pendubot_real_system_leaderboard_v2.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
Controller,Short Controller Description,Swingup Success,Swingup Time [s],Energy [J],Torque Cost[N²m²],Torque Smoothness [Nm],Velocity Cost [m²/s²],Best RealAI Score,Average RealAI Score,Username,Data
[MC-PILCO](https://github.com/dfki-ric-underactuated-lab/real_ai_gym_leaderboard/tree/main/data/pendubot/real_system/MC-PILCO/README.md),MC-PILCO for swingup and stabilization,10/10,1.37,11.66,8.93,0.54,84.61,0.598,0.591,turcato-niccolo,[data](https://github.com/dfki-ric-underactuated-lab/real_ai_gym_leaderboard/tree/main/data/pendubot/real_system/MC-PILCO/experiment02/trajectory.csv) [plot](https://github.com/dfki-ric-underactuated-lab/real_ai_gym_leaderboard/tree/main/data/pendubot/real_system/MC-PILCO/experiment02/timeseries.png) [video](https://github.com/dfki-ric-underactuated-lab/real_ai_gym_leaderboard/tree/main/data/pendubot/real_system/MC-PILCO/experiment02/video.gif)
[ilqr_tvlqr_lqr](https://github.com/dfki-ric-underactuated-lab/real_ai_gym_leaderboard/tree/main/data/pendubot/real_system/ilqr_tvlqr_lqr/README.md),Stabilization of iLQR trajectory with time-varying LQR.,8/10,4.12,34.02,51.88,0.643,242.34,0.227,0.175,fwiebe,[data](https://github.com/dfki-ric-underactuated-lab/real_ai_gym_leaderboard/tree/main/data/pendubot/real_system/ilqr_tvlqr_lqr/experiment10/trajectory.csv) [plot](https://github.com/dfki-ric-underactuated-lab/real_ai_gym_leaderboard/tree/main/data/pendubot/real_system/ilqr_tvlqr_lqr/experiment10/timeseries.png) [video](https://github.com/dfki-ric-underactuated-lab/real_ai_gym_leaderboard/tree/main/data/pendubot/real_system/ilqr_tvlqr_lqr/experiment10/video.gif)
[sac_lqr](https://github.com/dfki-ric-underactuated-lab/real_ai_gym_leaderboard/tree/main/data/pendubot/real_system/sac_lqr/README.md),Swing-up with an RL Policy learned with SAC. Stabilization with LQR.,4/10,0.67,37.12,78.7,0.774,114.04,0.338,0.124,chiniklas,[data](https://github.com/dfki-ric-underactuated-lab/real_ai_gym_leaderboard/tree/main/data/pendubot/real_system/sac_lqr/experiment07/trajectory.csv) [plot](https://github.com/dfki-ric-underactuated-lab/real_ai_gym_leaderboard/tree/main/data/pendubot/real_system/sac_lqr/experiment07/timeseries.png) [video](https://github.com/dfki-ric-underactuated-lab/real_ai_gym_leaderboard/tree/main/data/pendubot/real_system/sac_lqr/experiment07/video.gif)

0 comments on commit 96bc11b

Please sign in to comment.