Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Azure + DPDK 20.02 corrupted packets with mlx5 (DPDK issue) #486

Open
hhaim opened this issue Jun 3, 2020 · 0 comments
Open

Azure + DPDK 20.02 corrupted packets with mlx5 (DPDK issue) #486

hhaim opened this issue Jun 3, 2020 · 0 comments

Comments

@hhaim
Copy link
Contributor

hhaim commented Jun 3, 2020

This does not work

Stateless mode

 sudo ./t-rex-64 -i --no-ofed

sending 512 flows with cached mbuf fails

tui>start -f stl/bench.py -m 1mpps -t size=512,vm=cached --port 1 --force

connection   : localhost, Port 4501                  total_tx_L2  : 20.33 Mb/sec â¼â¼â¼               
version      : STL @ v2.81                           total_tx_L1  : 26.69 Mb/sec â¼â¼â¼               
cpu_util.    : 1.0% @ 1 cores (1 per dual port)      total_rx     : 0 b/sec                           
rx_cpu_util. : 0.0% / 0 pkt/sec                      total_pps    : 39.71 Kpkt/sec â¼â¼â¼             
async_util.  : 0.03% / 1.43 KB/sec                   drop_rate    : 20.33 Mb/sec                   
total_cps.   : 0 cps/sec                             queue_full   : 0 pkts                         

Port Statistics

   port    |         0         |         1         |       total       
-----------+-------------------+-------------------+------------------
owner      |         azureuser |         azureuser |                   
link       |                UP |                UP |                   
state      |              IDLE |              IDLE |                   
speed      |           10 Gb/s |           10 Gb/s |                   
CPU util.  |              0.0% |              0.0% |                   
--         |                   |                   |                   
Tx bps L2  |             0 bps |    â¼â¼â¼ 20.33 Mbps |    â¼â¼â¼ 20.33 Mbps 
Tx bps L1  |             0 bps |    â¼â¼â¼ 26.69 Mbps |    â¼â¼â¼ 26.69 Mbps 
Tx pps     |             0 pps |    â¼â¼â¼ 39.71 Kpps |    â¼â¼â¼ 39.71 Kpps 
Line Util. |               0 % |            0.27 % |                      
---        |                   |                   |                   
Rx bps     |             0 bps |             0 bps |             0 bps 9 bps ps 
Rx pps     |             0 pps |             0 pps |             0 pps 4 pps 
----       |                   |                   |                   
opackets   |                 0 |          64164003 |          64164003 
ipackets   |           4853777 |                 4 |           4853781 
obytes     |                 0 |        5048640384 |        5048640384 
ibytes     |        1242565992 |               296 |        1242566288 
tx-pkts    |            0 pkts |       64.16 Mpkts |       64.16 Mpkts 
rx-pkts    |        4.85 Mpkts |            4 pkts |        4.85 Mpkts 
tx-bytes   |               0 B |           5.05 GB |           5.05 GB 
rx-bytes   |           1.24 GB |             296 B |           1.24 GB 
-----      |                   |                   |                   
oerrors    |                 0 |                 0 |                 0 
ierrors    |                 0 |                 0 |                 0 

status:  -

Press 'ESC' for navigation panel...
status: [OK]

While this works. In DPDK 19.05 this senario works fine
The packets are corrupted

tui>start -f stl/bench.py -m 1mpps -t size=512 --port 1 --force

connection   : localhost, Port 4501                  total_tx_L2  : 20.33 Mb/sec â¼â¼â¼               
version      : STL @ v2.81                           total_tx_L1  : 26.69 Mb/sec â¼â¼â¼               
cpu_util.    : 1.0% @ 1 cores (1 per dual port)      total_rx     : 0 b/sec                           
rx_cpu_util. : 0.0% / 0 pkt/sec                      total_pps    : 39.71 Kpkt/sec â¼â¼â¼             
async_util.  : 0.03% / 1.43 KB/sec                   drop_rate    : 20.33 Mb/sec                   
total_cps.   : 0 cps/sec                             queue_full   : 0 pkts                         

Port Statistics

   port    |         0         |         1         |       total       
-----------+-------------------+-------------------+------------------
owner      |         azureuser |         azureuser |                   
link       |                UP |                UP |                   
state      |              IDLE |              IDLE |                   
speed      |           10 Gb/s |           10 Gb/s |                   
CPU util.  |              0.0% |              0.0% |                   
--         |                   |                   |                   
Tx bps L2  |             0 bps |    â¼â¼â¼ 20.33 Mbps |    â¼â¼â¼ 20.33 Mbps 
Tx bps L1  |             0 bps |    â¼â¼â¼ 26.69 Mbps |    â¼â¼â¼ 26.69 Mbps 
Tx pps     |             0 pps |    â¼â¼â¼ 39.71 Kpps |    â¼â¼â¼ 39.71 Kpps 
Line Util. |               0 % |            0.27 % |                      
---        |                   |                   |                   
Rx bps     |             0 bps |             0 bps |             0 bps 9 bps ps 
Rx pps     |             0 pps |             0 pps |             0 pps 4 pps 
----       |                   |                   |                   
opackets   |                 0 |          64164003 |          64164003 
ipackets   |           4853777 |                 4 |           4853781 
obytes     |                 0 |        5048640384 |        5048640384 
ibytes     |        1242565992 |               296 |        1242566288 
tx-pkts    |            0 pkts |       64.16 Mpkts |       64.16 Mpkts 
rx-pkts    |        4.85 Mpkts |            4 pkts |        4.85 Mpkts 
tx-bytes   |               0 B |           5.05 GB |           5.05 GB 
rx-bytes   |           1.24 GB |             296 B |           1.24 GB 
-----      |                   |                   |                   
oerrors    |                 0 |                 0 |                 0 
ierrors    |                 0 |                 0 |                 0 

status:  -

Press 'ESC' for navigation panel...
status: [OK]

The code was compiled from source with original mlx5 driver (without TREX_PATCH)
https://github.com/cisco-system-traffic-generator/trex-core/wiki/Build-For-Azure-Ubuntu-(mlx5)

So it means Azure + mlx5 does not work for some reason. mlx5 on PF works well in our lab.

DPDK 190.05 works good on Azure and PF.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant