add support for existing tests after hf1270 #1493

oxarbitrage · 2018-12-24T14:01:28Z

By comments in #1324 (comment) the flag for existing tests was added to database fixture.

This pull is not to merge(at least not as it is) but it is for discussion of some issues found in the existing tests after the hardfork.

Trying to give support for the following existing test cases:

hardfork_core_338_test
hardfork_core_453_test
hardfork_core_625_big_limit_order_test
target_cr_test_limit_call
target_cr_test_call_limit

The first 3 tests pass after hardfork, only mod needed is on hardfork_core_338_test that use call price to do some checks. This is not allowed after HF1270, order matching is as expected.

In the last 2 there are some different at matching orders, specifically i modified a bit target_cr_test_limit_call to show this differences:

This is how before HF match the orders before and after the big sell order:

NAME               FOR SALE         FOR WHAT PRICE (S/W) 1/PRICE (W/S)
======================================================================
seller              7 USDBIT         78 BTS      0.08974   11.14286 
buyer3            111 BTS           10 USDBIT   11.10000    0.09009 
buyer2          33000 BTS         3000 USDBIT   11.00000    0.09091 
buyer              80 BTS           10 USDBIT    8.00000    0.12500 
NAME               FOR SALE         FOR WHAT PRICE (S/W) 1/PRICE (W/S)
======================================================================
seller              7 USDBIT         78 BTS      0.08974   11.14286 
buyer2          12056 BTS         1096 USDBIT   11.00000    0.09091 
buyer              80 BTS           10 USDBIT    8.00000    0.12500

And this is what after HF will do:

NAME               FOR SALE         FOR WHAT PRICE (S/W) 1/PRICE (W/S)
======================================================================
seller              7 USDBIT         78 BTS      0.08974   11.14286 
buyer3            111 BTS           10 USDBIT   11.10000    0.09009 
buyer2          33000 BTS         3000 USDBIT   11.00000    0.09091 
buyer              80 BTS           10 USDBIT    8.00000    0.12500 
NAME               FOR SALE         FOR WHAT PRICE (S/W) 1/PRICE (W/S)
======================================================================
seller              7 USDBIT         78 BTS      0.08974   11.14286 
buyer2          24310 BTS         2210 USDBIT   11.00000    0.09091 
buyer              80 BTS           10 USDBIT    8.00000    0.12500

@abitmore i will like to have your word about this when you can.

abitmore · 2018-12-24T15:37:12Z

@oxarbitrage could you print data of the call orders? There should be a difference.

oxarbitrage · 2018-12-24T15:47:04Z

before HF call orders:

NAME             TYPE             DEBT           COLLAT  CALL PRICE(D/C) ~CALL PRICE(C/D)        SWAN(D/C)        SWAN(C/D)
======================================================================
borrower        1000 USDBIT        15000 BTS          8.57143          0.11667          0.06667         15.00000 
borrower2       1000 USDBIT        15500 BTS          8.85714          0.11290          0.06452         15.50000 
borrower3       1000 USDBIT        25000 BTS         14.28571          0.07000          0.04000         25.00000 
NAME             TYPE             DEBT           COLLAT  CALL PRICE(D/C) ~CALL PRICE(C/D)        SWAN(D/C)        SWAN(C/D)
======================================================================
borrower         615 USDBIT        10765 BTS         10.00232          0.09998          0.05713         17.50407 
borrower2        499 USDBIT         9989 BTS         11.43888          0.08742          0.04995         20.01804 
borrower3       1000 USDBIT        25000 BTS         14.28571          0.07000          0.04000         25.00000

After:

NAME             TYPE             DEBT           COLLAT  CALL PRICE(D/C) ~CALL PRICE(C/D)        SWAN(D/C)        SWAN(C/D)
======================================================================
borrower        1000 USDBIT        15000 BTS          1.00000          1.00000          0.06667         15.00000 
borrower2       1000 USDBIT        15500 BTS          1.00000          1.00000          0.06452         15.50000 
borrower3       1000 USDBIT        25000 BTS          1.00000          1.00000          0.04000         25.00000 
NAME             TYPE             DEBT           COLLAT  CALL PRICE(D/C) ~CALL PRICE(C/D)        SWAN(D/C)        SWAN(C/D)
======================================================================
borrower3       1000 USDBIT        25000 BTS          1.00000          1.00000          0.04000         25.00000

abitmore · 2018-12-25T19:19:11Z

The issue is fixed in 1270-fix-call-price-cache branch. Thanks.

…res/bitshares-core into 1270_existing_testcases

oxarbitrage · 2018-12-26T00:00:19Z

thank you @abitmore . Everything passing now, i removed the prints at 3aec53d . Can be merged as it is.

Do you think we should do more HF1270 checks inside rounding_tests, bitassets_tests, swan tests?

abitmore · 2018-12-26T20:55:28Z

Yes, we need swan_tests (including revivals). I guess we need bitasset_tests as well, but perhaps don't need to update rounding tests. Thanks.

oxarbitrage · 2018-12-27T16:23:59Z

I added after hf1270 tests to swan_tests.

There is an issue with order matching in 1 of them, at black_swan_issue_346

Before HF:

./tests/chain_test -t swan_tests/black_swan_issue_346
...
1291336ms th_a       db_update.cpp:249             check_for_blackswan  ] *call_ptr: {"id":"1.8.0","borrower":"1.2.18","collateral":1000,"debt":100,"call_price":{"base":{"amount":40,"asset_id":"1.3.0"},"quote":{"amount":7,"asset_id":"1.3.2"}}} 
1291336ms th_a       db_update.cpp:259             check_for_blackswan  ] Black Swan detected on asset USDBIT0X (1.3.2) at block 1: 
   Least collateralized call: 10.00000000000000000  0.10000000000000001
   Settle Price:              50.00000000000000000  0.02000000000000000
   Max:                       50.00000000000000000  0.02000000000000000

1291336ms th_a       db_update.cpp:260             check_for_blackswan  ] enable_black_swan: true 
1291337ms th_a       swan_tests.cpp:230            operator()           ] feed.max_short_squeeze_price(): {"base":{"amount":2,"asset_id":"1.3.3"},"quote":{"amount":75,"asset_id":"1.3.0"}} 
1291338ms th_a       swan_tests.cpp:230            operator()           ] feed.max_short_squeeze_price(): {"base":{"amount":7,"asset_id":"1.3.3"},"quote":{"amount":500,"asset_id":"1.3.0"}} 
1291338ms th_a       db_market.cpp:1069            check_call_orders    ] black swan detected on asset USDBIT1X (1.3.3) at block 1
1291338ms th_a       db_market.cpp:1070            check_call_orders    ] enable_black_swan: true 
NAME               FOR SALE         FOR WHAT PRICE (S/W) 1/PRICE (W/S)
======================================================================
seller             39 USDBIT1X       2000 BTS      0.01950   51.28205

After HF:

./tests/chain_test -t swan_tests/black_swan_issue_346_hf1270
...
1339306ms th_a       swan_tests.cpp:230            operator()           ] feed.max_short_squeeze_price(): {"base":{"amount":2,"asset_id":"1.3.2"},"quote":{"amount":15,"asset_id":"1.3.0"}} 
1339306ms th_a       swan_tests.cpp:230            operator()           ] feed.max_short_squeeze_price(): {"base":{"amount":1,"asset_id":"1.3.2"},"quote":{"amount":75,"asset_id":"1.3.0"}} 
1339306ms th_a       db_update.cpp:249             check_for_blackswan  ] *call_ptr: {"id":"1.8.0","borrower":"1.2.18","collateral":1000,"debt":100,"call_price":{"base":{"amount":1,"asset_id":"1.3.0"},"quote":{"amount":1,"asset_id":"1.3.2"}}} 
1339307ms th_a       db_update.cpp:259             check_for_blackswan  ] Black Swan detected on asset USDBIT0X (1.3.2) at block 4: 
   Least collateralized call: 10.00000000000000000  0.10000000000000001
   Settle Price:              50.00000000000000000  0.02000000000000000
   Max:                       75.00000000000000000  0.01333333333333333

1339307ms th_a       db_update.cpp:260             check_for_blackswan  ] enable_black_swan: true 
1339307ms th_a       swan_tests.cpp:230            operator()           ] feed.max_short_squeeze_price(): {"base":{"amount":2,"asset_id":"1.3.3"},"quote":{"amount":75,"asset_id":"1.3.0"}} 
1339308ms th_a       swan_tests.cpp:230            operator()           ] feed.max_short_squeeze_price(): {"base":{"amount":7,"asset_id":"1.3.3"},"quote":{"amount":500,"asset_id":"1.3.0"}} 
1339308ms th_a       db_update.cpp:249             check_for_blackswan  ] *call_ptr: {"id":"1.8.1","borrower":"1.2.18","collateral":5000,"debt":100,"call_price":{"base":{"amount":1,"asset_id":"1.3.0"},"quote":{"amount":1,"asset_id":"1.3.3"}}} 
1339308ms th_a       db_update.cpp:259             check_for_blackswan  ] Black Swan detected on asset USDBIT1X (1.3.3) at block 4: 
   Least collateralized call: 50.00000000000000000  0.02000000000000000
   Settle Price:              47.61904761904762040  0.02100000000000000
   Max:                       50.00000000000000000  0.02000000000000000

1339308ms th_a       db_update.cpp:260             check_for_blackswan  ] enable_black_swan: true 
NAME               FOR SALE         FOR WHAT PRICE (S/W) 1/PRICE (W/S)
======================================================================
seller             40 USDBIT1X       2000 BTS      0.02000   50.00000 
seller             39 USDBIT1X       2000 BTS      0.01950   51.28205 
/home/alfredo/CLionProjects/1270_existing_testcases/tests/tests/swan_tests.cpp(284): error: in "swan_tests/black_swan_issue_346_hf1270": check db.find_object( oid_020 ) == nullptr has failed

The rest of them seems to be ok. @abitmore let me know what do you think about this one when you can.

Thanks.

abitmore · 2019-01-01T13:35:02Z

@oxarbitrage that's an old test case which tests behaviors before any recent hard fork. I guess the behavior has changed since 2.0.180612, perhaps change the test case to that date and see what will happen? If it doesn't pass as well, I think we can skip it.

tests/tests/bitasset_tests.cpp

abitmore · 2019-01-24T09:31:39Z

tests/tests/bitasset_tests.cpp

+            BOOST_CHECK(!db.find<limit_order_object>(sell_id));
+         }
+         // go beyond hard fork 1270
+         blocks += generate_blocks(HARDFORK_CORE_1270_TIME, true, skip);


To be more accurate, here should be

blocks += generate_blocks(HARDFORK_CORE_1270_TIME - mi, true, skip); blocks += generate_blocks(db.get_dynamic_global_properties().next_maintenance_time, true, skip);

thank you for the suggestion, i actually tried to make it like that everywhere but there are some problems not sure why.

in the case of this particular test(hf_935_test) when i make the generate block chains i get error:

83898ms th_a bitasset_tests.cpp:1150 test_method ] 10 assert_exception: Assert Exception prev: popping block would leave head block null {} th_a fork_database.cpp:41 pop_block {} th_a db_block.cpp:477 pop_block

Make sure you increased blocks here, aka blocks += generate_blocks(...).

tests/tests/market_tests.cpp

tests/tests/swan_tests.cpp

abitmore · 2019-01-24T10:23:45Z

By the way, similar code added in previous PR need to be updated as well, E.G.

BOOST_AUTO_TEST_CASE(mcr_bug_increase_before1270)
{ try {

   generate_blocks(HARDFORK_CORE_453_TIME);

   generate_block();

and also mcr_bug_increase_after1270, mcr_bug_decrease_before1270 and mcr_bug_decrease_after1270.

To be more accurate, should generate blocks until the maintenance time but not the hf time.

Actually, theoretically some test cases will fail if hf453 and hf1270 happen in the same maintenance interval (in reality we know they aren't, so it's fine).

oxarbitrage · 2019-01-24T18:25:03Z

Block generation for market and swan tests changed for accuracy at a2d5fac

The only one with issues when doing this change is bitasset_tests/hf_935_test. Ill try to see what is the problem there and send a fix.

oxarbitrage · 2019-01-25T20:10:17Z

The bitasset_tests/hf_935_test is a bit weird to me, maybe i am not understanding it correctly but HARDFORK_CORE_868_890_TIME, HARDFORK_CORE_935_TIME, HARDFORK_CORE_343_TIME are all the same date.
Independently from changes of this pull request, with all those hardforks at the same time the block that tests beyond hard fork 890 and before hard fork 935 was never happening.

In this commit: 8466e19 i removed that test and use the spot to test hardfork 1270. I am unsure if it is the right thing to do, can revert back.

tests/tests/bitasset_tests.cpp

abitmore · 2019-01-25T21:54:09Z

The logic around i is as follows (code executes in order):

the 1st pass, no block generation at the beginning, do something related to MCR, go beyond hf343, do something, go beyond hf 935, do something, go beyond hf1270, pop all blocks (roll back all changes)
the 2nd pass, mostly same as 1st, the only difference is to test MSSR but not MCR, after this all changes are rolled back
the 3rd pass, generate blocks to the time right after hf343, do something related to MCR, then go beyond hf935 and hf1270, pop blocks until the time right after hf343, so at this stage the chain is after hf343
the 4th pass, we're now after hf343, do tests related to MSSR, go beyond hf935 and hf1270, roll back to hf343
the 5th pass, generate blocks to hf935, test MCR, roll back to the time right after hf 935
the 6th pass, test MSSR, roll back to hf935
the 7th pass, generate blocks to hf1270, test MCR, roll back to the time right after hf1270
the 8th pass, test MSSR, roll back to hf1270

tests/tests/bitasset_tests.cpp

oxarbitrage · 2019-01-25T22:56:06Z

thank you, with the logic described i should be able to make it better.

tests/tests/bitasset_tests.cpp

tests/tests/market_tests.cpp

add support for existing tests after hf1270

bf9537f

print call orders instead of market in target_cr_test_limit_call

9f06364

oxarbitrage added 2 commits December 25, 2018 20:30

Merge branch '1270-fix-call-price-cache' of https://github.com/bitsha…

613f414

…res/bitshares-core into 1270_existing_testcases

remove prints after fix

3aec53d

add hf1270 swan tests

46e2943

abitmore added this to the 201905 - Consensus-Upgrade Release milestone Jan 16, 2019

oxarbitrage added 2 commits January 16, 2019 17:31

skip black_swan_issue_346 test after hf1270

4e2514c

update bitasset tests for hf1270

7abf7c5

abitmore requested changes Jan 24, 2019

View reviewed changes

accurate block generation for hf1270 in market and swan tests

a2d5fac

changes in bitasset_tests/hf_935_test

8466e19

abitmore requested changes Jan 25, 2019

View reviewed changes

tests/tests/bitasset_tests.cpp Outdated Show resolved Hide resolved

tests/tests/bitasset_tests.cpp Outdated Show resolved Hide resolved

tests/tests/bitasset_tests.cpp Outdated Show resolved Hide resolved

abitmore reviewed Jan 25, 2019

View reviewed changes

tests/tests/bitasset_tests.cpp Outdated Show resolved Hide resolved

oxarbitrage mentioned this pull request Jan 29, 2019

Test Cases for PR 1270 (MCR Bugfix) #1423

Closed

10 tasks

workaround hf_935_test

ece99b6

abitmore requested changes Jan 30, 2019

View reviewed changes

tests/tests/bitasset_tests.cpp Outdated Show resolved Hide resolved

tests/tests/bitasset_tests.cpp Outdated Show resolved Hide resolved

use affected_by_hf_343 flag

1aad691

abitmore reviewed Jan 30, 2019

View reviewed changes

tests/tests/market_tests.cpp Outdated Show resolved Hide resolved

remove trailing white spaces

ca1e045

abitmore approved these changes Jan 30, 2019

View reviewed changes

abitmore merged commit 6b22b91 into bitshares:1270-fix-call-price-cache Jan 30, 2019

MichelSantos mentioned this pull request Feb 8, 2019

Release Notes: BitShares Core version 3.0.0 #1569

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

add support for existing tests after hf1270 #1493

add support for existing tests after hf1270 #1493

oxarbitrage commented Dec 24, 2018

abitmore commented Dec 24, 2018

oxarbitrage commented Dec 24, 2018

abitmore commented Dec 25, 2018

oxarbitrage commented Dec 26, 2018

abitmore commented Dec 26, 2018

oxarbitrage commented Dec 27, 2018

abitmore commented Jan 1, 2019 •

edited

Loading

abitmore Jan 24, 2019

oxarbitrage Jan 24, 2019

abitmore Jan 24, 2019

abitmore commented Jan 24, 2019 •

edited

Loading

oxarbitrage commented Jan 24, 2019

oxarbitrage commented Jan 25, 2019 •

edited

Loading

abitmore commented Jan 25, 2019

oxarbitrage commented Jan 25, 2019

add support for existing tests after hf1270 #1493

add support for existing tests after hf1270 #1493

Conversation

oxarbitrage commented Dec 24, 2018

abitmore commented Dec 24, 2018

oxarbitrage commented Dec 24, 2018

abitmore commented Dec 25, 2018

oxarbitrage commented Dec 26, 2018

abitmore commented Dec 26, 2018

oxarbitrage commented Dec 27, 2018

abitmore commented Jan 1, 2019 • edited Loading

abitmore Jan 24, 2019

Choose a reason for hiding this comment

oxarbitrage Jan 24, 2019

Choose a reason for hiding this comment

abitmore Jan 24, 2019

Choose a reason for hiding this comment

abitmore commented Jan 24, 2019 • edited Loading

oxarbitrage commented Jan 24, 2019

oxarbitrage commented Jan 25, 2019 • edited Loading

abitmore commented Jan 25, 2019

oxarbitrage commented Jan 25, 2019

abitmore commented Jan 1, 2019 •

edited

Loading

abitmore commented Jan 24, 2019 •

edited

Loading

oxarbitrage commented Jan 25, 2019 •

edited

Loading