EVE-NG community version - IOL L3 switch crashed randomly

Before posting something, READ the changelog, WATCH the videos, howto and provide following:
Your install is: Bare metal, ESXi, what CPU model, RAM, HD, what EVE version you have, output of the uname -a and any other info that might help us faster.

Moderator: mike

certkilo
Posts: 7
Joined: Wed Dec 11, 2019 9:33 am

EVE-NG community version - IOL L3 switch crashed randomly

Post by certkilo » Fri Feb 14, 2020 3:15 am

Hi,

Testing some IOL L3 switches but randomly few crashed with below errors. It crashed only after it has been powered on for 2-3 days. Not sure if it's the IOS image issue. Do share your thoughts. Thanks.

IOL image: i86bi-linux-l2-adventerprisek9-15.2c.bin
EVE-NG version: 2.0.3-102
ESXi version: 6.7.0 Update 3
ESXi hw:
abab.jpg
dd.jpg

Code: Select all

000139: *Feb 14 00:32:11.603 SGT: %UTIL-3-RADIXTREE: Data structure error--Deleting a null node
-Traceback= A1EDCB5z C5F1FACz 98B481Bz 980329Dz 980313Ez 9803040z 986E6F4z 986E3E5z 8CFF5C0z 8D01675z 8D0B1F6z 8D0AAD3z 8D3C708z 8CE59DFz 8CE5CC3z 8E480D4z
000146: *Feb 14 00:32:18.324 SGT: %MDT-4-INCOMPATIBLE_TUNNEL_TYPE: Incompatible tunnel type in BGP update router_id:10.128.255.2 RD:10.128.250.1:2000 type:1 tunnel_type:4; local tunnel_type:0
000163: *Feb 14 00:32:23.303 SGT: %SYS-2-MALLOCFAIL: Memory allocation of 65692 bytes failed from 0x896581A, alignment 8
Pool: Processor  Free: 1052376  Cause: Memory fragmentation
Alternate Pool: None  Free: 0  Cause: No Alternate pool
 -Process= "Pool Manager", ipl= 6, pid= 5
-Traceback= A1EDCB5z BB05043z BAFE05Ez 896581Az BB1E460z BB1DE90z
000167: *Feb 14 00:32:53.336 SGT: %SYS-2-MALLOCFAIL: Memory allocation of 65692 bytes failed from 0x896581A, alignment 8
Pool: Processor  Free: 925640  Cause: Memory fragmentation
Alternate Pool: None  Free: 0  Cause: No Alternate pool
 -Process= "Pool Manager", ipl= 6, pid= 5
-Traceback= A1EDCB5z BB05043z BAFE05Ez 896581Az BB1E460z BB1DE90z
000168: *Feb 14 00:33:23.357 SGT: %SYS-2-MALLOCFAIL: Memory allocation of 65692 bytes failed from 0x896581A, alignment 8
Pool: Processor  Free: 840000  Cause: Memory fragmentation
Alternate Pool: None  Free: 0  Cause: No Alternate pool
 -Process= "Pool Manager", ipl= 6, pid= 5
-Traceback= A1EDCB5z BB05043z BAFE05Ez 896581Az BB1E460z BB1DE90z
000750: *Feb 14 00:39:41.604 SGT: %UTIL-3-RADIXTREE: Data structure error--Deleting a null node
You do not have the required permissions to view the files attached to this post.

Uldis (UD)
Posts: 5067
Joined: Wed Mar 15, 2017 4:44 pm
Location: London
Contact:

Re: EVE-NG community version - IOL L3 switch crashed randomly

Post by Uldis (UD) » Fri Feb 14, 2020 10:35 pm

dont use 15.5.2T it is rare bad image
best are 15.4.2T or 15.7 T

certkilo
Posts: 7
Joined: Wed Dec 11, 2019 9:33 am

Re: EVE-NG community version - IOL L3 switch crashed randomly

Post by certkilo » Mon Mar 02, 2020 3:15 am

Uldis (UD) wrote:
Fri Feb 14, 2020 10:35 pm
dont use 15.5.2T it is rare bad image
best are 15.4.2T or 15.7 T
Thanks for your reply. I will give it a try.

certkilo
Posts: 7
Joined: Wed Dec 11, 2019 9:33 am

Re: EVE-NG community version - IOL L3 switch crashed randomly

Post by certkilo » Mon Mar 02, 2020 3:28 am

Uldis (UD) wrote:
Fri Feb 14, 2020 10:35 pm
dont use 15.5.2T it is rare bad image
best are 15.4.2T or 15.7 T
By the way, what version do you recommend for L2 IOL? Thanks.

Uldis (UD)
Posts: 5067
Joined: Wed Mar 15, 2017 4:44 pm
Location: London
Contact:

Re: EVE-NG community version - IOL L3 switch crashed randomly

Post by Uldis (UD) » Mon Mar 02, 2020 9:25 am

In my EVE I left just 2 images:
No need more, these 2 are best.

i86bi_LinuxL2-AdvEnterpriseK9-M_152_May_2018.bin
i86bi_LinuxL3-AdvEnterpriseK9-M2_157_3_May_2018.bin

No crash nothing, works like charm.

UD

certkilo
Posts: 7
Joined: Wed Dec 11, 2019 9:33 am

Re: EVE-NG community version - IOL L3 switch crashed randomly

Post by certkilo » Mon Mar 02, 2020 1:50 pm

Thanks. I tried "i86bi_LinuxL2-AdvEnterpriseK9-M_152_May_2018.bin" in my env but encountered below error. I did a search and only can found some workaround on GNS3 not EVE-NG. Did a search of the forum but no luck either. Kindly advise.

Code: Select all

000006: *Mar  2 21:46:41.070 SGT: %LINK-3-UPDOWN: Interface Ethernet0/3, changed state to up
000010: *Mar  2 21:46:41.133 SGT: %LINK-3-UPDOWN: Interface Ethernet1/3, changed state to up
000011: *Mar  2 21:46:41.149 SGT: %LINK-3-UPDOWN: Interface Ethernet2/1, changed state to up
000012: *Mar  2 21:46:41.154 SGT: %LINK-3-UPDOWN: Interface Ethernet2/2, changed state to up
000013: *Mar  2 21:46:41.160 SGT: %PLATFORM-2-SIGNATURE_FAILED: Image '/i86bi_LinuxL2-AdvEnterpriseK9-M_152_May_2018.bin' failed code signing checks, error 'Failure in opening the file'. Ethernet switching has been disabled to protect against attack.
000014: *Mar  2 21:46:41.174 SGT: %LINK-3-UPDOWN: Interface Ethernet2/3, changed state to up
000015: *Mar  2 21:46:41.179 SGT: %LINK-3-UPDOWN: Interface Ethernet3/0, changed state to up
000016: *Mar  2 21:46:41.195 SGT: %LINK-3-UPDOWN: Interface Ethernet3/1, changed state to up
000017: *Mar  2 21:46:41.210 SGT: %LINK-3-UPDOWN: Interface Ethernet3/2, changed state to up
000018: *Mar  2 21:46:41.224 SGT: %LINK-3-UPDOWN: Interface Ethernet3/3, changed state to up
000043: *Mar  2 21:46:42.958 SGT: %LINK-3-UPDOWN: Interface Ethernet0/0, changed state to up
000044: *Mar  2 21:46:42.972 SGT: %LINK-3-UPDOWN: Interface Ethernet0/1, changed state to up
000045: *Mar  2 21:46:42.972 SGT: %LINK-3-UPDOWN: Interface Ethernet0/2, changed state to up
000046: *Mar  2 21:46:42.982 SGT: %LINK-3-UPDOWN: Interface Ethernet1/0, changed state to up
000047: *Mar  2 21:46:42.987 SGT: %LINK-3-UPDOWN: Interface Ethernet1/1, changed state to up
000048: *Mar  2 21:46:43.000 SGT: %LINK-3-UPDOWN: Interface Ethernet1/2, changed state to up
000049: *Mar  2 21:46:43.001 SGT: %LINK-3-UPDOWN: Interface Ethernet2/0, changed state to up
000050: *Mar  2 21:46:43.019 SGT: %LINK-3-UPDOWN: Interface Ethernet4/0, changed state to up

Uldis (UD)
Posts: 5067
Joined: Wed Mar 15, 2017 4:44 pm
Location: London
Contact:

Re: EVE-NG community version - IOL L3 switch crashed randomly

Post by Uldis (UD) » Mon Mar 02, 2020 4:05 pm

You are using very OLD EVE..
in the new versions this problem is solved..
%PLATFORM-2-SIGNATURE_FAILED: Image '/i86bi_LinuxL2-AdvEnterpriseK9-M_152_May_2018.bin

With new EVE you will see VERIFIED :

Code: Select all

*Mar  2 16:10:46.874: %LINEPROTO-5-UPDOWN: Line protocol on Interface Ethernet0/0, changed state to up
*Mar  2 16:10:46.874: %LINEPROTO-5-UPDOWN: Line protocol on Interface Ethernet0/1, changed state to up
*Mar  2 16:10:46.874: %LINEPROTO-5-UPDOWN: Line protocol on Interface Ethernet0/2, changed state to up
*Mar  2 16:10:46.874: %LINEPROTO-5-UPDOWN: Line protocol on Interface Ethernet0/3, changed state to up
*Mar  2 16:10:47.717: %PLATFORM-5-SIGNATURE_VERIFIED: Image '/i86bi_LinuxL2-AdvEnterpriseK9-M_152_May_2018.bin' passed code signing verification
Update your eve, last for EVE community is version 2.0.3-105.
but about GNS3 dont ask me, I dont know...

certkilo
Posts: 7
Joined: Wed Dec 11, 2019 9:33 am

Re: EVE-NG community version - IOL L3 switch crashed randomly

Post by certkilo » Tue Mar 03, 2020 2:03 am

Thanks for the quick reply. I am using 2.0.3-102 at the moment. Will upgrade and verify again. Much appreciated.

certkilo
Posts: 7
Joined: Wed Dec 11, 2019 9:33 am

Re: EVE-NG community version - IOL L3 switch crashed randomly

Post by certkilo » Tue Mar 03, 2020 3:23 am

certkilo wrote:
Tue Mar 03, 2020 2:03 am
Thanks for the quick reply. I am using 2.0.3-102 at the moment. Will upgrade and verify again. Much appreciated.
I upgraded EVE-NG to 2.0.3-105 according to below procedure. No error encountered.
https://www.eve-ng.net/index.php/how-to ... t-version/

However, when i start the switch, i am still seeing below error.

Code: Select all

Press RETURN to get started!


000006: *Mar  3 10:38:46.856 SGT: %LINK-3-UPDOWN: Interface Ethernet0/3, changed state to up
000010: *Mar  3 10:38:46.942 SGT: %LINK-3-UPDOWN: Interface Ethernet1/3, changed state to up
000011: *Mar  3 10:38:46.942 SGT: %LINK-3-UPDOWN: Interface Ethernet2/1, changed state to up
000012: *Mar  3 10:38:46.942 SGT: %LINK-3-UPDOWN: Interface Ethernet2/2, changed state to up
000013: *Mar  3 10:38:46.961 SGT: %LINK-3-UPDOWN: Interface Ethernet2/3, changed state to up
000014: *Mar  3 10:38:46.967 SGT: %LINK-3-UPDOWN: Interface Ethernet3/0, changed state to up
000015: *Mar  3 10:38:46.973 SGT: %PLATFORM-2-SIGNATURE_FAILED: Image '/i86bi_LinuxL2-AdvEnterpriseK9-M_152_May_2018.bin' failed code signing checks, error 'Failure in opening the file'. Ethernet switching has been disabled to protect against attack.
000016: *Mar  3 10:38:46.978 SGT: %LINK-3-UPDOWN: Interface Ethernet3/1, changed state to up
eve-ng version.jpg
You do not have the required permissions to view the files attached to this post.

Uldis (UD)
Posts: 5067
Joined: Wed Mar 15, 2017 4:44 pm
Location: London
Contact:

Re: EVE-NG community version - IOL L3 switch crashed randomly

Post by Uldis (UD) » Wed Mar 04, 2020 11:59 am

add new fresh node on topo and test
old node in lab needs to be wiped to force run this IOL properly

Post Reply