Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Z9100]: syncd crash is seen during fast-reboot #3075

Closed
chitra-raghavan opened this issue Jun 24, 2019 · 1 comment
Closed

[Z9100]: syncd crash is seen during fast-reboot #3075

chitra-raghavan opened this issue Jun 24, 2019 · 1 comment
Assignees
@lguohan

Comments

@chitra-raghavan
Copy link
Contributor

Description

While running fast-reboot tests , synd crash is seen in Z9100 /Z9264f platforms.
script : advanced_reboot.py
Topology : T0

Steps to reproduce the issue:

  1. Run the script advanced_reboot.py from sonic-mgmt repo
  2. Check for syncd crash

Describe the results you received:
The device hangs after executing the fast-reboot command.

root@sonic-z9100-02:~# show arp  | wc
    510    2041   28511
root@sonic-z9100-02:~# [  525.222067] kexec_core: Starting new kernel 

syslog:
Jun 24 10:04:52.504158 sonic-z9100-02 NOTICE root: Rebooting with /sbin/kexec -e to SONiC-OS-HEAD.15-622c426a ...


 << Device hangs after this

Describe the results you expected:

Additional information you deem important (e.g. issue happens only occasionally):

Output of show version:


  root@sonic-z9100-02:~# show ver

SONiC Software Version: SONiC.HEAD.15-622c426a
Distribution: Debian 9.9
Kernel: 4.9.0-9-2-amd64
Build commit: 622c426a
Build date: Sun Jun 23 06:23:55 UTC 2019
Built by: johnar@jenkins-worker-3

Platform: x86_64-dell_z9100_c2538-r0
HwSKU: Force10-Z9100-C8D48
ASIC: broadcom
Serial Number: CN0GTX3X7793151D0003
Uptime: 10:18:41 up 11 min,  2 users,  load average: 0.66, 0.93, 0.82

Docker images:
REPOSITORY                 TAG                 IMAGE ID            SIZE
docker-syncd-brcm          HEAD.15-622c426a    7503f1450bf4        392MB
docker-syncd-brcm          latest              7503f1450bf4        392MB
docker-fpm-frr             HEAD.15-622c426a    381072f66e64        319MB
docker-fpm-frr             latest              381072f66e64        319MB
docker-lldp-sv2            HEAD.15-622c426a    b26e12331f44        299MB
docker-lldp-sv2            latest              b26e12331f44        299MB
docker-router-advertiser   HEAD.15-622c426a    c7138dc69688        280MB
docker-router-advertiser   latest              c7138dc69688        280MB
docker-dhcp-relay          HEAD.15-622c426a    586335930bed        288MB
docker-dhcp-relay          latest              586335930bed        288MB
docker-database            HEAD.15-622c426a    27f41ec7a059        280MB
docker-database            latest              27f41ec7a059        280MB
docker-teamd               HEAD.15-622c426a    ec3f1fda1b86        301MB
docker-teamd               latest              ec3f1fda1b86        301MB
docker-snmp-sv2            HEAD.15-622c426a    4233cbd40ad6        313MB
docker-snmp-sv2            latest              4233cbd40ad6        313MB
docker-orchagent           HEAD.15-622c426a    07471ddac6f2        319MB
docker-orchagent           latest              07471ddac6f2        319MB
docker-sonic-telemetry     HEAD.15-622c426a    a1f7cee4cb3d        302MB
docker-sonic-telemetry     latest              a1f7cee4cb3d        302MB
docker-platform-monitor    HEAD.15-622c426a    33fcdd9bfc0e        326MB
docker-platform-monitor    latest              33fcdd9bfc0e        326MB

Files Attached:
syslog-z9100-fast-reboot_master_15.log
fpmsyncd.1561370689.48.core.gz
syncd.1561370681.28.core.gz
@chitra-raghavan
Copy link
Contributor Author

This is fixed in recent images

yxieca added a commit to yxieca/sonic-buildimage that referenced this issue Jan 13, 2024
@yxieca
[YANG][utilities] update sonic DB version string format
7f4c429 
Old format: version_a_b_c
New format: version_<branch>_<nn>

sonic-utilities:
* 371d62a2 2024-01-13 | Revert "Enhanced route_check.py for multi_asic platforms (sonic-net#3077)" (HEAD -> master, github/ying-test-submodule-advance) [Ying Xie]
* 7ddc709a 2024-01-13 | Revert "route_check: Skip route checks if bgp feature is not enabled (sonic-net#3075)" [Ying Xie]
* 1489c727 2024-01-12 | [Techsupport]Adding more FRR and BGP dumps (sonic-net#3118) (github/master) [Sudharsan Dhamal Gopalarathnam]
* 359e6925 2024-01-11 | Disable Key Validation feature during sonic-installation for Cisco Platforms (sonic-net#3115) [selvipal]
* 9515c642 2024-01-04 | [chassis]: Support show ip bgp summary to display without error when no external neighbors are configured on chassis LC (sonic-net#3099) [Arvindsrinivasan Lakshmi Narasimhan]
* 9400691c 2023-12-25 | Fix database initialization for db_migrator (sonic-net#3100) [ganglv]
* 56dafb07 2023-12-25 | Support disable/enable syslog rate limit feature (sonic-net#3072) [Junchao-Mellanox]
* 529bb96b 2023-12-23 | route_check: Skip route checks if bgp feature is not enabled (sonic-net#3075) [anamehra]
* bcb10f18 2023-12-23 | Support golden config in db migrator (sonic-net#3076) [ganglv]
* 20d1495b 2023-12-21 | [db_migrator] add db migrator version space for 202305/202311 branch (sonic-net#3081) [Ying Xie]
* a68d3d3a 2023-12-20 | Collect module EEPROM data in dump (sonic-net#3009) [Junchao-Mellanox]
* e7a8def6 2023-12-19 | Enhanced route_check.py for multi_asic platforms (sonic-net#3077) [Deepak Singhal]

Signed-off-by: Ying Xie <[email protected]>
@yxieca yxieca mentioned this issue Jan 13, 2024
Closed
11 tasks
mssonicbld added a commit that referenced this issue Jan 15, 2024
@mssonicbld
[submodule] Update submodule sonic-utilities to the latest HEAD autom…
6107b51 
…atically (#17573)

#### Why I did it
src/sonic-utilities
```
* 942a7c9e - (HEAD -> master, origin/master, origin/HEAD) Revert "Enhanced route_check.py for multi_asic platforms" (#3122) (2 minutes ago) [Ying Xie]
* 01ee98ec - Revert "route_check: Skip route checks if bgp feature is not enabled" (#3121) (3 minutes ago) [Ying Xie]
* 1489c727 - [Techsupport]Adding more FRR and BGP dumps (#3118) (2 days ago) [Sudharsan Dhamal Gopalarathnam]
* 359e6925 - Disable Key Validation feature during sonic-installation for Cisco Platforms (#3115) (4 days ago) [selvipal]
* 9515c642 - [chassis]: Support show ip bgp summary to display without error when no external neighbors are configured on chassis LC (#3099) (10 days ago) [Arvindsrinivasan Lakshmi Narasimhan]
* 9400691c - Fix database initialization for db_migrator (#3100) (3 weeks ago) [ganglv]
* 56dafb07 - Support disable/enable syslog rate limit feature (#3072) (3 weeks ago) [Junchao-Mellanox]
* 529bb96b - route_check: Skip route checks if bgp feature is not enabled (#3075) (3 weeks ago) [anamehra]
* bcb10f18 - Support golden config in db migrator (#3076) (3 weeks ago) [ganglv]
* 20d1495b - [db_migrator] add db migrator version space for 202305/202311 branch (#3081) (4 weeks ago) [Ying Xie]
* a68d3d3a - Collect module EEPROM data in dump (#3009) (4 weeks ago) [Junchao-Mellanox]
* e7a8def6 - Enhanced route_check.py for multi_asic platforms (#3077) (4 weeks ago) [Deepak Singhal]
```
#### How I did it
#### How to verify it
#### Description for the changelog
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@lguohan lguohan

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@lguohan @chitra-raghavan