Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Size error in fsx test. #4889

Closed
zhoucheng361 opened this issue May 23, 2024 · 2 comments · Fixed by #4901
Closed

Size error in fsx test. #4889

zhoucheng361 opened this issue May 23, 2024 · 2 comments · Fixed by #4901
Labels
needs-review Issues with PR ready for review

Comments

@zhoucheng361
Copy link
Contributor

zhoucheng361 commented May 23, 2024

What happened:

https://github.com/juicedata/juicefs/actions/runs/9180031853/job/25243543237

13646: TRUNCATE UP     from 0x2c88c4 (2918596) to 0x83d590 (8639888)
13647: TRUNCATE UP     from 0x83d590 (8639888) to 0x8c6080 (9199744)
13648: MAPWRITE        0x655898 (6641816) thru 0x65d333 (6673203)	(0x7a9c (31388) bytes)
13649: TRUNCATE DOWN   from 0x8c6080 (9199744) to 0x358550 (3507536)
13650: TRUNCATE UP     from 0x358550 (3507536) to 0x640a78 (6556280)
13651: WRITE           0x848cfc (8686844) thru 0x84d1f3 (8704499)	(0x44f8 (17656) bytes) HOLE
13652: TRUNCATE UP     from 0x84d1f4 (8704500) to 0x8cee10 (9235984)
13653: MAPWRITE        0x8c6de4 (9203172) thru 0x8cee0f (9235983)	(0x802c (32812) bytes)
13654: MAPREAD         0x4272b0 (4354736) thru 0x432c73 (4402291)	(0xb9c4 (47556) bytes)
13655: READ            0x241a30 (2366000) thru 0x24b44f (2405455)	(0x9a20 (39456) bytes)
13656: TRUNCATE DOWN   from 0x8cee10 (9235984) to 0x6a783c (6977596)
13657: WRITE           0x618fc0 (6393792) thru 0x624937 (6441271)	(0xb978 (47480) bytes)
13658: TRUNCATE DOWN   from 0x6a783c (6977596) to 0x553dec (5586412)
13659: TRUNCATE UP     from 0x553dec (5586412) to 0x62be88 (6471304)
13660: TRUNCATE DOWN   from 0x62be88 (6471304) to 0x53a36c (5481324)
13661: MAPREAD         0xcd5c8 (841160) thru 0xced53 (847187)	(0x178c (6028) bytes)
13662: TRUNCATE DOWN   from 0x53a36c (5481324) to 0x2b4524 (2835748)
13663: TRUNCATE DOWN   from 0x2b4524 (2835748) to 0x23aecc (2338508)
13664: TRUNCATE UP     from 0x23aecc (2338508) to 0x4a6200 (4874752)
13665: TRUNCATE UP     from 0x4a6200 (4874752) to 0x7fe47c (8381564)
13666: MAPWRITE        0x7fd9f4 (8378868) thru 0x7fe47b (8381563)	(0xa88 (2696) bytes)
13667: MAPWRITE        0x613f98 (6373272) thru 0x62329f (6435487)	(0xf308 (62216) bytes)
13668: READ            0x22018 (139288) thru 0x23b3f (146239)	(0x1b28 (6952) bytes)
13669: TRUNCATE UP     from 0x7fe47c (8381564) to 0x984c5c (9981020)
13670: MAPWRITE        0x97baa0 (9943712) thru 0x984c5b (998[1019](https://github.com/juicedata/juicefs/actions/runs/9180031853/job/25243543237#step:11:1020))	(0x91bc (37308) bytes)
13671: READ            0x155a4 (87460) thru 0x22dc7 (142791)	(0xd824 (55332) bytes)
13672: MAPREAD         0x83d6dc (8640220) thru 0x849107 (8687879)	(0xba2c (47660) bytes)
13673: READ            0x620188 (6422920) thru 0x62bf33 (6471475)	(0xbdac (48556) bytes)
13674: MAPREAD         0x38ddd4 (3726804) thru 0x39a0d7 (3776727)	(0xc304 (49924) bytes)
13675: TRUNCATE DOWN   from 0x984c5c (998[1020](https://github.com/juicedata/juicefs/actions/runs/9180031853/job/25243543237#step:11:1021)) to 0x971f74 (9903988)
13676: READ            0x4e2e40 (5123648) thru 0x4ee357 (5170007)	(0xb518 (46360) bytes)
13677: TRUNCATE DOWN   from 0x971f74 (9903988) to 0x7c31a8 (8139176)
13678: WRITE           0x7b75bc (8091068) thru 0x7be403 (8119299)	(0x6e48 (28232) bytes)
13679: READ            0x163be0 (1457120) thru 0x167197 (1470871)	(0x35b8 (13752) bytes)
13680: WRITE           0x86b0a8 (8827048) thru 0x86b87f (8829055)	(0x7d8 (2008) bytes) HOLE
13681: WRITE           0x631478 (6493304) thru 0x6342eb (6505195)	(0x2e74 (11892) bytes)
13682: WRITE           0x728cf8 (7507192) thru 0x73240f (7545871)	(0x9718 (38680) bytes)
13683: TRUNCATE DOWN   from 0x86b880 (8829056) to 0x346554 (3433812)
13684: READ            0x23e528 (2352424) thru 0x2493bf (2397119)	(0xae98 (44696) bytes)
13685: WRITE           0x74eff8 (7663608) thru 0x75002b (7667755)	(0x1034 (4148) bytes) HOLE
13686: TRUNCATE DOWN   from 0x75002c (7667756) to 0x44e600 (4515328)
13687: TRUNCATE UP     from 0x44e600 (4515328) to 0x6cb06c (7123052)
13688: MAPWRITE        0x6c53e0 (7099360) thru 0x6cb06b (7123051)	(0x5c8c (23692) bytes)
Size error: expected 0x6cb06c stat 0xffffffffffffffff seek 0x6cb06c
Correct content saved for comparison
(maybe hexdump "/tmp/fsx.out" vs "/tmp/fsx.out.fsxgood")
Seed was set to 1716326563

What you expected to happen:

How to reproduce it (as minimally and precisely as possible):

Anything else we need to know?

Environment:

  • JuiceFS version (use juicefs --version) or Hadoop Java SDK version:
  • Cloud provider or hardware configuration running JuiceFS:
  • OS (e.g cat /etc/os-release):
  • Kernel (e.g. uname -a):
  • Object storage (cloud provider and region, or self maintained):
  • Metadata engine info (version, cloud provider managed or self maintained):
  • Network connectivity (JuiceFS to metadata engine, JuiceFS to object storage):
  • Others:
@zhoucheng361 zhoucheng361 added kind/bug Something isn't working and removed kind/bug Something isn't working labels May 23, 2024
@SandyXSD
Copy link
Contributor

The real error: check_size: fstat: Interrupted system call

@SandyXSD
Copy link
Contributor

Weird access log:

2024.05.24 17:19:59.179251 [uid:0,gid:0,pid:0] write (18437,61440,5386240,94) - OK <0.000136>
2024.05.24 17:19:59.179355 [uid:0,gid:0,pid:1681334] getattr (18437): (18437,[-rw-r--r--:0100644,1,0,0,1716542088,1716542399,1716542399,8423716
2024.05.24 17:19:59.209987 [uid:0,gid:0,pid:1681334] setattr (18437[94],0x248,[size=4744348]): (18437,[-rw-r--r--:0100644,1,0,0,1716542088,1716
2024.05.24 17:19:59.210461 [uid:0,gid:0,pid:1681334] write (18439,9,662,98): (signal 2
) - OK <0.000027>
2024.05.24 17:19:59.211623 [uid:0,gid:0,pid:1681334] write (18439,18,671,98) - OK <0.000008>
2024.05.24 17:19:59.213241 [uid:0,gid:0,pid:1681334] flush (18437,94,3644B96B778CA4FE) - OK <0.000043>
2024.05.24 17:19:59.213319 [uid:0,gid:0,pid:1681334] flush (18438,96,3644B96B778CA4FE) - OK <0.000005>

@SandyXSD SandyXSD added the needs-review Issues with PR ready for review label May 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
needs-review Issues with PR ready for review
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants