【PerfXLab】Optimize Randn and randn_like

[bin913]

PR Category
[ Operator]

Type of Change
[Performance Optimization]

Description
optimize randn and randn_like

Issue

Progress

• Change is properly reviewed (1 reviewer required, 2 recommended).
• Change is responded to an issue.
• Change is fully covered by a UT.

Performance
t_tensor_constructor_perf.py::test_tensor_constructor_benchmark[randn-randn-generic_constructor_input_fn]
Operator: randn Performance Test (dtype=torch.float16, mode=kernel,level=core)
Status Torch Latency (ms) Gems Latency (ms) Gems Speedup Size Detail

SUCCESS 2.290912 1.666816 1.374 {'size': [1073741824], 'dtype': torch.float16, 'device': 'cuda'}
SUCCESS 0.043616 0.032896 1.326 {'size': [4096, 4096], 'dtype': torch.float16, 'device': 'cuda'}
SUCCESS 0.043712 0.033920 1.289 {'size': [64, 512, 512], 'dtype': torch.float16, 'device': 'cuda'}
SUCCESS 2.274112 1.653408 1.375 {'size': [1024, 1024, 1024], 'dtype': torch.float16, 'device': 'cuda'}
SUCCESS 0.005664 0.005632 1.006 {'size': [64, 64], 'dtype': torch.float16, 'device': 'cuda'}

Operator: randn Performance Test (dtype=torch.float32, mode=kernel,level=core)
Status Torch Latency (ms) Gems Latency (ms) Gems Speedup Size Detail

SUCCESS 2.276512 1.713344 1.329 {'size': [1073741824], 'dtype': torch.float32, 'device': 'cuda'}
SUCCESS 0.043392 0.032320 1.343 {'size': [4096, 4096], 'dtype': torch.float32, 'device': 'cuda'}
SUCCESS 0.043136 0.032384 1.332 {'size': [64, 512, 512], 'dtype': torch.float32, 'device': 'cuda'}
SUCCESS 2.259264 1.687392 1.339 {'size': [1024, 1024, 1024], 'dtype': torch.float32, 'device': 'cuda'}
SUCCESS 0.005856 0.005408 1.083 {'size': [64, 64], 'dtype': torch.float32, 'device': 'cuda'}

Operator: randn Performance Test (dtype=torch.bfloat16, mode=kernel,level=core)
Status Torch Latency (ms) Gems Latency (ms) Gems Speedup Size Detail

SUCCESS 2.273152 1.642272 1.384 {'size': [1073741824], 'dtype': torch.bfloat16, 'device': 'cuda'}
SUCCESS 0.043584 0.032256 1.351 {'size': [4096, 4096], 'dtype': torch.bfloat16, 'device': 'cuda'}
SUCCESS 0.043712 0.032128 1.361 {'size': [64, 512, 512], 'dtype': torch.bfloat16, 'device': 'cuda'}
SUCCESS 2.274240 1.641728 1.385 {'size': [1024, 1024, 1024], 'dtype': torch.bfloat16, 'device': 'cuda'}
SUCCESS 0.005856 0.005408 1.083 {'size': [64, 64], 'dtype': torch.bfloat16, 'device': 'cuda'}

test_tensor_constructor_perf.py::test_tensor_constructor_benchmark[randn_like-randn_like-unary_input_fn]
Operator: randn_like Performance Test (dtype=torch.float16, mode=kernel,level=core)
Status Torch Latency (ms) Gems Latency (ms) Gems Speedup Size Detail

SUCCESS 2.291104 1.667392 1.374 [torch.Size([1073741824])]
SUCCESS 0.044384 0.033152 1.339 [torch.Size([4096, 4096])]
SUCCESS 0.044160 0.032896 1.342 [torch.Size([64, 512, 512])]
SUCCESS 2.273856 1.654624 1.374 [torch.Size([1024, 1024, 1024])]
SUCCESS 0.005536 0.005344 1.036 [torch.Size([64, 64])]

Operator: randn_like Performance Test (dtype=torch.float32, mode=kernel,level=core)
Status Torch Latency (ms) Gems Latency (ms) Gems Speedup Size Detail

SUCCESS 2.260832 1.700096 1.330 [torch.Size([1073741824])]
SUCCESS 0.043168 0.032480 1.329 [torch.Size([4096, 4096])]
SUCCESS 0.043360 0.032480 1.335 [torch.Size([64, 512, 512])]
SUCCESS 2.260352 1.700224 1.329 [torch.Size([1024, 1024, 1024])]
SUCCESS 0.005696 0.005344 1.066 [torch.Size([64, 64])]

Operator: randn_like Performance Test (dtype=torch.bfloat16, mode=kernel,level=core)
Status Torch Latency (ms) Gems Latency (ms) Gems Speedup Size Detail

SUCCESS 2.275488 1.642208 1.386 [torch.Size([1073741824])]
SUCCESS 0.043552 0.032192 1.353 [torch.Size([4096, 4096])]
SUCCESS 0.043360 0.032160 1.348 [torch.Size([64, 512, 512])]
SUCCESS 2.275040 1.642432 1.385 [torch.Size([1024, 1024, 1024])]
SUCCESS 0.005536 0.005344 1.036 [torch.Size([64, 64])]

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
15 out of 16 committers have signed the CLA.

✅ bin913
✅ xuexingtu
✅ fantasy666
✅ AdvancedCompiler
✅ factnn
✅ Kylin1207
✅ botbigeyes
✅ kiddyjinjin
✅ 0x45f
✅ Ason93
✅ dongjibin1996
✅ ylyzty
✅ purerli98
✅ Galaxy1458
✅ zhoubo567
❌ mikiya1991
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

[tengqm]

Why this change?

[bin913]

This is introduced by a code conflict, I have removed it in latest commit

[tengqm]

@bin913 Please sign the CLA in order for your PR to be considered as a merge candidate.

[huangyiqun]

Please run pre-commit run to check and format the code.

[bin913]

@bin913 Please sign the CLA in order for your PR to be considered as a merge candidate.

Thanks for the reminder, I have signed the CLA.

[kiddyjinjin]

lgtm