Jump to content

Падает JunoOS on EX3200 - usb0: unrecoverable error, controller halted


Recommended Posts

Всем привет!

 

Начал на ровном месте падать в полный коматоз Juniper EX3200. Четвертый раз за трое суток. Сам возобновляет работу через 55-60 мин. Выловил ошибку на консольном порте. Система никак не отзывается. Имеем:

 

 

usb0: unrecoverable error, controller halted
usb0: blocking intrs 0x10
umass0: BBB reset failed, TIMEOUT
umass0: BBB bulk-in clear stall failed, TIMEOUT
umass0: BBB bulk-out clear stall failed, TIMEOUT
umass0: BBB reset failed, TIMEOUT
umass0: BBB bulk-in clear stall failed, TIMEOUT
umass0: BBB bulk-out clear stall failed, TIMEOUT
umass0: BBB reset failed, TIMEOUT
umass0: BBB bulk-in clear stall failed, TIMEOUT
umass0: BBB bulk-out clear stall failed, TIMEOUT
umass0: BBB reset failed, TIMEOUT
umass0: BBB bulk-in clear stall failed, TIMEOUT
umass0: BBB bulk-out clear stall failed, TIMEOUT
umass0: BBB reset failed, TIMEOUT
umass0: BBB bulk-in clear stall failed, TIMEOUT
umass0: BBB bulk-out clear stall failed, TIMEOUT
g_vfs_done():da0s1f[WRITE(offset=8192, length=2048)]error = 5
g_vfs_done():da0s1f[WRITE(offset=573440, length=2048)]error = 5
g_vfs_done():da0s1f[WRITE(offset=65470464, length=4096)]error = 5
g_vfs_done():da0s1f[WRITE(offset=65486848, length=16384)]error = 5
g_vfs_done():da0s1f[WRITE(offset=66013184, length=2048)]error = 5
g_vfs_done():da0s1f[WRITE(offset=66082816, length=2048)]error = 5
g_vfs_done():da0s1f[WRITE(offset=98205696, length=16384)]error = 5
g_vfs_done():da0s1f[WRITE(offset=99794944, length=12288)]error = 5
panic: initiate_write_inodeblock_ufs1: already started
Uptime: 2d19h17m57s

 

Куда копать?

 

Спасибо!

Link to post
Share on other sites

Судя по всему, сыпеться флешка.

 

То есть флешь системы присоединен через usb на матплате?

 

Спустя некоторое время происходит такое:

 

 

(da0:umass-sim0:0:0:0): Synchronize cache failed, status == 0x34, scsi status == 0x0
Dumping 48 MB (250 chunks)
Aborting dump due to I/O error.
status == 0x34, scsi status == 0xad

** DUMP FAILED (ERROR 5) **
Automatic reboot in 15 seconds - press a key on the console to abort
Rebooting...
Link to post
Share on other sites

Процесс загрузки:

 

U-Boot 1.1.6 (Feb  6 2008 - 11:27:42)

Board: EX3200-24T 2.22
EPLD:  Version 6.0 (0x85)
DRAM:  Initializing (512 MB)
FLASH: 8 MB
USB:   scanning bus for devices... 2 USB Device(s) found
       scanning bus for storage devices... 1 Storage Device(s) found

Consoles: U-Boot console
Found compatible API, ver. 7

FreeBSD/PowerPC U-Boot bootstrap loader, Revision 2.1
(marcelm@apg-bbuild01.juniper.net, Wed Feb  6 11:23:55 PST 2008)
Memory: 512MB
Loading /boot/defaults/loader.conf
/kernel data=0x81f408+0x880f8 syms=[0x4+0x70290+0x4+0x9d96a]


Hit [Enter] to boot immediately, or space bar for command prompt.
Booting [/kernel]...
Kernel entry at 0xa00000e0 ...
GDB: no debug ports present
KDB: debugger backends: ddb
KDB: current backend: ddb
Copyright (c) 1996-2010, Juniper Networks, Inc.
All rights reserved.
Copyright (c) 1992-2006 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
JUNOS 10.1R1.8 #0: 2010-02-12 17:24:20 UTC
    builder@queth.juniper.net:/volume/build/junos/10.1/release/10.1R1.8/obj-powerpc/bsd/sys/compile/JUNIPER-EX
Timecounter "decrementer" frequency 37500000 Hz quality 0
cpu0: Freescale e500v2 core revision 2.2
cpu0: HID0 80004080<EMCP,TBEN,EN_MAS7_UPDATE>
real memory  = 513802240 (490 MB)
avail memory = 502714368 (479 MB)
ETHERNET SOCKET BRIDGE initialising
Initializing EXSERIES platform properties ...
nexus0: <PPC e500 Nexus device>
ocpbus0: <on-chip peripheral bus> on nexus0
openpic0: <OpenPIC in on-chip peripheral bus> iomem 0xfef40000-0xfef600b3 on ocpbus0
i2c0: <MPC85XX OnChip i2c Controller> iomem 0xfef03000-0xfef03014 irq 59 on ocpbus0
i2c1: <MPC85XX OnChip i2c Controller> iomem 0xfef03100-0xfef03114 irq 59 on ocpbus0
uart0: <16550 or compatible> iomem 0xfef04500-0xfef0450f irq 58 on ocpbus0
uart0: console (9600,n,8,1)
uart1: <16550 or compatible> iomem 0xfef04600-0xfef0460f irq 58 on ocpbus0
lbc0: <Freescale 8533 Local Bus Controller> iomem 0xfef05000-0xfef05fff,0xff000000-0xffffffff irq 22 on ocpbus0
cfi0: <AMD/Fujitsu - 8MB> iomem 0xff800000-0xffffffff on lbc0
syspld0 iomem 0xff000000-0xff00ffff on lbc0
tsec0: <eTSEC ethernet controller> iomem 0xfef24000-0xfef24fff irq 45,46,50 on ocpbus0
tsec0: hardware MAC address 2c:6b:f5:80:35:bf
miibus0: <MII bus> on tsec0
e1000phy0: <Marvell 88E1112 Gigabit PHY> on miibus0
e1000phy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX-FDX, auto
pcib0: <Freescale MPC8544 PCI host controller> iomem 0xfef08000-0xfef08fff,0xf0000000-0xf3ffffff on ocpbus0
pci0: <PCI bus> on pcib0
pci0: <serial bus, USB> at device 18.0 (no driver attached)
ehci0: <Philips ISP156x USB 2.0 controller> mem 0xf0001000-0xf00010ff irq 22 at device 18.2 on pci0
usb0: EHCI version 1.0
usb0: <Philips ISP156x USB 2.0 controller> on ehci0
usb0: USB revision 2.0
uhub0: Philips EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
umass0: STMicroelectronics ST72682  High Speed Mode, rev 2.00/2.10, addr 2
pcib1: <Freescale MPC8544 PCI Express host controller> iomem 0xfef0a000-0xfef0afff,0xe0000000-0xe3ffffff,0xec000000-0xec0fffff irq 42 on ocpbus0
pci1: <PCI bus> on pcib1
pcib2: <PCI-PCI bridge> at device 0.0 on pci1
pci2: <PCI bus> on pcib2
mpfe0: <Juniper EX-series Packet Forwarding Engine> mem 0xa4000000-0xa40fffff,0xa0000000-0xa3ffffff irq 18 at device 0.0 on pci2
idma0: <mp85xxx DMA Controller> iomem 0xfef21000-0xfef21300 irq 36 on ocpbus0
Initializing product: 36 ..
bme0:Virtual BME driver initializing
Timecounters tick every 1.000 msec
Loading the NETPFE picpeer module
IPsec: Initialized Security Association Processing.
da0 at umass-sim0 bus 0 target 0 lun 0
da0: <ST ST72682 2.10> Removable Direct Access SCSI-2 device
da0: 40.000MB/s transfers
da0: 1000MB (2048000 512 byte sectors: 64H 32S/T 1000C)
if_pfe_open: listener socket opened, listening on ...
Trying to mount root from ufs:/dev/da0s1a
WARNING: / was not properly dismounted
Attaching /packages/jbase via /dev/mdctl...
Mounted jbase package on /dev/md0...
Mounted jcrypto-ex package on /dev/md1...
Mounted jdocs-ex package on /dev/md2...
Mounted jkernel-ex package on /dev/md3...
Mounted jpfe-ex42x package on /dev/md4...
Mounted jroute-ex package on /dev/md5...
Mounted jswitch-ex package on /dev/md6...
Mounted jweb-ex package on /dev/md7...
Executing /packages/mnt/jweb-ex-10.1R1.8/mount.post..
Automatic reboot in progress...
** Last Mounted on /
** Root file system
** Phase 1 - Check Blocks and Sizes
** Phase 2 - Check Pathnames
** Phase 3 - Check Connectivity
** Phase 4 - Check Reference Counts
** Phase 5 - Check Cyl groups
1326 files, 56348 used, 37913 free (49 frags, 4733 blocks, 0.1% fragmentation)

***** FILE SYSTEM MARKED CLEAN *****
** Last Mounted on /config
** Phase 1 - Check Blocks and Sizes
** Phase 2 - Check Pathnames
** Phase 3 - Check Connectivity
** Phase 4 - Check Reference Counts
** Phase 5 - Check Cyl groups
78 files, 180 used, 28147 free (227 frags, 3490 blocks, 0.8% fragmentation)

***** FILE SYSTEM MARKED CLEAN *****
** Last Mounted on /var
** Phase 1 - Check Blocks and Sizes
** Phase 2 - Check Pathnames
** Phase 3 - Check Connectivity
** Phase 4 - Check Reference Counts
UNREF FILE I=4273  OWNER=root MODE=140755
SIZE=0 MTIME=Mar  1 13:56 2017
CLEAR? yes

** Phase 5 - Check Cyl groups
FREE BLK COUNT(S) WRONG IN SUPERBLK
SALVAGE? yes

SUMMARY INFORMATION BAD
SALVAGE? yes

BLK(S) MISSING IN BIT MAPS
SALVAGE? yes

537 files, 1579 used, 61220 free (204 frags, 7627 blocks, 0.3% fragmentation)

***** FILE SYSTEM MARKED CLEAN *****

***** FILE SYSTEM WAS MODIFIED *****
RE-CHECKING FILE SYSTEM
** Last Mounted on /var
** Phase 1 - Check Blocks and Sizes
** Phase 2 - Check Pathnames
** Phase 3 - Check Connectivity
** Phase 4 - Check Reference Counts
** Phase 5 - Check Cyl groups
537 files, 1579 used, 61220 free (204 frags, 7627 blocks, 0.3% fragmentation)
** Last Mounted on /var/tmp
** Phase 1 - Check Blocks and Sizes
** Phase 2 - Check Pathnames
** Phase 3 - Check Connectivity
** Phase 4 - Check Reference Counts
** Phase 5 - Check Cyl groups
10 files, 10507 used, 150491 free (19 frags, 18809 blocks, 0.0% fragmentation)

***** FILE SYSTEM MARKED CLEAN *****
FILE SYSTEM CLEAN; SKIPPING CHECKS
clean, 150491 free (19 frags, 18809 blocks, 0.0% fragmentation)
Creating initial configuration...mgd: commit complete
Setting initial options:  debugger_on_panic=NO debugger_on_break=NO.
Starting optional daemons: .
Doing initial network setup:.
Initial interface configuration:
additional daemons:.
Additional routing options:kern.module_path: /boot//kernel;/boot/modules -> /boot//kernel;/boot/modules;/modules
 grat_arp_on_ifup=YES: net.link.ether.inet.grat_arp_on_ifup: 1 -> 1
kld netpfe drv: ifpfed_ethLoading the NETPFE ethernet module
 ifpfed_ml_cmnLoading common multilink module.
kld platform: ex_ifpfeLoading the EX-series platform NETPFE module
 if_vcpkern.module_path: /boot//kernel;/boot/modules;/modules -> /boot//kernel;/boot/modules;/modules;/modules/peertype
kld peertype: peertype_hcm peertype_pfem peertype_sfi peertype_slavere ipsec kld.
Doing additional network setup:.
Starting final network daemons:.
setting ldconfig path: /usr/lib /opt/lib
starting standard daemons: cron.
Local package initialization:.
starting local daemons:.

Как я понял, на плате живет контроллер:

 

umass0: STMicroelectronics ST72682 High Speed Mode, rev 2.00/2.10, addr 2

 

 

К нему присоединен NAND flash в количестве до 8 штук (судя по даташиту). Кто видел внутренности этого коммутатора, флешь припаян или в каретке?

 

 

da0 at umass-sim0 bus 0 target 0 lun 0

da0: <ST ST72682 2.10> Removable Direct Access SCSI-2 device

da0: 40.000MB/s transfers

da0: 1000MB (2048000 512 byte sectors: 64H 32S/T 1000C)

if_pfe_open: listener socket opened, listening on ...

Trying to mount root from ufs:/dev/da0s1a

Edited by masterzep
Link to post
Share on other sites

Там есть резервная флешка или область куда заливается копия.

С нее можно загрузиться тоже, если при апдейте туда слили копию.

Судя по версии прошивки, она там заводская.

Ребутните и попробуйте словить момент загрузки с альтернативной области.

Потом апдейт и копия на основную, если основная жива - все заработает.

Link to post
Share on other sites

Там есть резервная флешка или область куда заливается копия.

С нее можно загрузиться тоже, если при апдейте туда слили копию.

Судя по версии прошивки, она там заводская.

Ребутните и попробуйте словить момент загрузки с альтернативной области.

Потом апдейт и копия на основную, если основная жива - все заработает.

 

на 10.1R1.8 еще нет Dual-boot

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
  • Recently Browsing   0 members

    No registered users viewing this page.

×
×
  • Create New...