Several weeks ago it affected ADCs 25,24 then ADCs 23,22,21; now the are TDC14,15,16. After removing FP Fast Clear everything returned to normal.
This is how printout looked like:
interrupt: (C000)>mEMSD_interrupt b180 CIO=005e DP=0000 Tok=7b34 Done=982c interrupt: (8000)Give semaphore interrupt: (C000)<mEMSD_interrupt b180 CIO=005e DP=0000 Tok=7b34 Done=982c [0]roc_isr: [4000]>readAll() [0]process_event: (8) DP=005e Eventbuf 0x12fc0f8, nwords 0x1f400 [0]read_crate: (8)Entering read_crate(0x12fc110,0x1f400,0x12fc110) [0]: (4000)Block Read data stored at address 0x12fc13c ,dmaptr = 0x92fc13c [0]read_crate: (8)Sparse Data Scan 0x0, cycle 0x0, scan 0x3fc00c0, effective 0x3fdfff0 [0]read_crate: (8)eventnum = 606, DP=0x005e eff.scan=03fdfff0 Before LNE Slot=6 r/w=27,29 Slot=7 r/w=27,29 Slot=18 r/w=27,29 Slot=19 r/w=27,29 Slot=20 r/w=27,29 Slot=21 r/w=27,29 Slot=22 r/w=27,29 Slot=23 r/w=27,29 Slot=24 r/w=27,29 Slot=25 r/w=27,29 After LNE Slot=6 r/w=28,29 Slot=7 r/w=28,29 Slot=18 r/w=28,29 Slot=19 r/w=28,29 Slot=20 r/w=28,29 Slot=21 r/w=28,29 Slot=22 r/w=28,29 Slot=23 r/w=28,29 Slot=24 r/w=28,29 Slot=25 r/w=28,29 [0]read_crate: (8)slot=6 fprd_dma: 0, wc=2000041, bus=92fc13c, next=92fc240 [0]read_crate: (8)slot=7 fprd_dma: 0, wc=2000041, bus=92fc240, next=92fc344 [0]read_crate: (8)slot=18 fprd_dma: 0, wc=2000041, bus=92fc344, next=92fc448 [0]read_crate: (8)slot=19 fprd_dma: 0, wc=2000041, bus=92fc448, next=92fc54c [0]read_crate: (8)slot=20 fprd_dma: 0, wc=2000041, bus=92fc54c, next=92fc650 [0]read_crate: (8)slot=21 fprd_dma: 0, wc=2000041, bus=92fc650, next=92fc754 [0]read_crate: (8)slot=22 fprd_dma: 0, wc=2000041, bus=92fc754, next=92fc858 [0]read_crate: (8)slot=23 fprd_dma: 0, wc=2000041, bus=92fc858, next=92fc95c [0]read_crate: (8)slot=24 fprd_dma: 0, wc=2000041, bus=92fc95c, next=92fca60 [0]read_crate: (8)slot=25 fprd_dma: 0, wc=2000041, bus=92fca60, next=92fcb64 [0]read_crate: (8)slot=4 fprd_dma: 1c040, wc=40, bus=92fcb64, next=92fcb64 [0]read_crate: (100)Error in TDC slot 4, code 0x1c040 0x13b9ec0 (fbroc_isr): SFI_DAT_ERR: Fastbus Data error paddr=0, status=0x2a0 [0]read_crate: (8)slot=5 fprd_dma: 0, wc=2000040, bus=92fcb64, next=92fcc64 [0]read_crate: (8)slot=8 fprd_dma: 0, wc=2000040, bus=92fcb64, next=92fcc64 [0]read_crate: (8)slot=9 fprd_dma: 0, wc=2000040, bus=92fcb84, next=92fcc84 [0]read_crate: (8)slot=10 fprd_dma: 0, wc=2000040, bus=92fcb84, next=92fcc84 [0]read_crate: (8)slot=11 fprd_dma: 1c040, wc=40, bus=92fcb84, next=92fcc84 [0]read_crate: (100)Error in TDC slot 11, code 0x1c040 0x13b9ec0 (fbroc_isr): SFI_DAT_ERR: Fastbus Data error paddr=0, status=0x2a0 [0]read_crate: (8)slot=12 fprd_dma: 0, wc=2000040, bus=92fcb84, next=92fcc84 [0]read_crate: (8)slot=13 fprd_dma: 0, wc=2000040, bus=92fcb84, next=92fcc84 [0]read_crate: (8)slot=14 fprd_dma: 1c040, wc=40, bus=92fcb84, next=92fcc84 [0]read_crate: (100)Error in TDC slot 14, code 0x1c040 0x13b9ec0 (fbroc_isr): SFI_DAT_ERR: Fastbus Data error paddr=0, status=0x2a0 [0]read_crate: (8)slot=15 fprd_dma: 1c040, wc=40, bus=92fcb84, next=92fcc84 [0]read_crate: (100)Error in TDC slot 15, code 0x1c040 0x13b9ec0 (fbroc_isr): SFI_DAT_ERR: Fastbus Data error paddr=0, status=0xa0 [0]read_crate: (8)slot=16 fprd_dma: 1c040, wc=40, bus=92fcb84, next=92fcc84 [0]read_crate: (100)Error in TDC slot 16, code 0x1c040 [0]read_event info: 25e @0x12fcb88->@0x12fcba8 0000:ef000020 00000000 b1808b0e 005e0000 7b343400 ffff982c 982c982c 982c982c [0]read_crate: (8)Return from read_crate(0x12fc110,0x1f400,0x12fcba8) [0]process_event: (8)Sending event (0x12fc0f8 005e 0x12fc0f8 0xab0) Occupy link for 550 wordsEMSD CSR=9780.8b0e.005e.c1d0:7b34.3400.054f.9800 Written: 0380.0001.0000.0000 (10)Sending data:EMSD CSR=9780.8b0e.005e.c1d0:7b34.3400.054f.9800 Written: 0380.0001.0000.0000 0000:b1000a98 185e0000 b0fa5ba5 cc43e497 0000025e 00000000 00000000 00000000 0020:00000000 da0000aa 03fc00c0 30008e41 34000e9a 30020e69 34040d76 34060e8b 0040:34080d7a 340a0e8b 340c0e3c 340e0eba 34100e86 30120e3d 30140c48 34160e7f 0060:34180dc9 341a0ea4 341c0dfe 341e0e35 34201008 30220f8d 30240eec 34260f2d 0080:34280fc1 342a0fb1 342c1046 342e0fd5 34300f19 34320f22 34340ed9 34360f67 00a0:30380fa1 303a1019 303c0ef2 343e0ec1 304001b8 34420196 34440193 304601af 00c0:344801e8 344a01f2 304c0296 344e0218 345001b1 305201af 34540194 34560190 00e0:345801e0 345a01c5 345c01d7 345e0213 30600201 34620167 3464015e 30660132 0100:34680201 306a0237 306c01f8 306e020f 34700183 34720214 3474016f 307601cc 0120:3078022a 347a023b 307c0205 347e0241 38000e41 3800072d 3c020b12 38040b5e 0140:3806071d 38080c1b 3c0a0b57 380c0bf9 3c0e076f 381001a1 3c1201fb 3c14016b 0160:38160194 3c1801f8 381a01e3 381c01b5 3c1e01df 3c20021b 3c2201a8 38240199 0180:3c260182 3c2801ec 3c2a0241 3c2c0241 382e0218 3c3001a7 3832017a 3c340178 01a0:3c36012f 3c380228 3c3a0220 3c3c0225 383e0219 3c40018e 3842018b 3c4401b0 01c0:3c46019c 38480205 384a01df 384c01ef 3c4e01f2 3c5001e0 3c52019a 3c5401dd 01e0:38560178 3c580214 3c5a01f2 385c01be 3c5e01e2 386001cc 38620157 3c640165 0200:3c660167 3c6801bb 3c6a0229 386c0212 3c6e020a 387001a7 3872017d 3c74016e 0220:3876021f 3878020c 3c7a0222 387c0226 3c7e0208 90008e41 900001b5 900200c1 0240:900400x13b9ec0 (fbroc_isr): 0f4 9406013c 94080158 940a0166 900c01a8 940e017c 90100148 9012010e 0260:94140117 94160180 9018012c 901a0127 901c014e 941e0159 94200108 94220171 0280:902400d2 9026009d 90280143 942a014c 902c0150 902e0140 943000d0 9432012f 02a0:94340115 903600c0 94380146 903a0149 943c014e 943e0137 904000f7 904200aa 02c0:944400c8 904600c4 94480121 944a013e 944c013d 904e0129 9450009d 905200d6 02e0:945400ff 945600b9 9458012a 945a0121 905c00d8 945e013e 946001bd 94620161 0300:94640140 9066013d 90680181 906a01a2 946c019f 906e018d 9070016f 907201bc 0320:90740129 94760107 907801d9 947a01ba 907c01bd 907e01fd 98000e41 9c00017f 0340:9802017a 980401c2 980601c5 9c0801f5 980a01d2 980c022e 9c0e0222 9c100163 0360:981201dd 98140142 98160134 981801a5 9c1a01a9 9c1c01ca 9c1e0168 9820013e 0380:982201a6 98240199 9c260155 982801e7 9c2a01f0 9c2c0235 9c2e01f4 9c3000f3 03a0:9c3201d8 983400d2 9836012b 983801fb 9c3a01a2 983c0156 983e014a 9c400121 03c0:9c420164 9844017b 9c460172 9c4801d3 9c4a0181 9c4c01de 9c4e01c4 9c500131 03e0:985201a8 9c540188 98560118 985801cd 985a0174 9c5c0131 985e0258 9c600161 0400:986200e7 986400d2 986601c3 9c680155 9c6a01bf 9c6c0183 9c6e01e7 9c7001c3 0420:98720155 98740118 987600f9 987801c0 987a01e5 9c7c01b2 9c7e01a4 a0008e41 0440:a000014a a0020148 a404012a a00600e4 a008016a a40a0169 a40c018d a40e01ce 0460:a410013e a0120145 a414014d a0160103 a41801a0 a41a0191 a01cSFI_DAT_ERR: Fastbus Data error paddr=0, status=0xa0 00f2 a41e0228 0480:a4200140 a422015a a4240114 a026010f a0280179 a42a01a4 a02c0156 a02e017f 04a0:a43000f1 a43200cf a43400d4 a43600d0 a4380185 a03a018c a03c016d a03e0135 04c0:a4400152 a0420138 a0440101 a446012c a4480172 a04a0141 a04c01d8 a04e0179 04e0:a4500144 a052019f a45400ff a45600fd a4580231 a05a0191 a05c0164 a05e0193 0500:a0600110 a062010a a0640111 a4660199 a4680170 a06a0176 a46c017e a06e0174 0520:a470017c a472010f a07400e8 a4760123 a47801f9 a07a025c a47c0207 a07e0179 0540:a8000e41 ac000152 ac020128 a80400e7 a806015a ac080190 a80a0159 ac0c019d 0560:a80e01cd ac100163 a8120144 a8140139 ac160159 a818019a ac1a01af a81c01b5 0580:a81e01b4 ac20012d ac22015b ac240131 a826016b ac28018a a82a01b5 a82c01c1 05a0:a82e01d2 a8300169 a832017f ac340121 a836012e a8380213 ac3a0210 ac3c01ad 05c0:ac3e01c9 ac400178 a8420199 ac440176 a846017a a84801c6 ac4a01dd ac4c01e2 05e0:a84e01cf a850018e ac5201e8 a854015e a856014b ac5801db a85a01c0 ac5c019b 0600:a85e01e9 a860019f a8620176 ac640150 a8660169 ac68019c ac6a01bf ac6c01e0 0620:a86e01e3 a8700162 a872014d a874011e a876015e a87801e2 ac7a01a9 ac7c01d7 0640:a87e01af b0000e41 b40001da b40201b1 b40401a9 b4060198 b4080209 b40a01ef 0660:b40c0229 b40e0227 b01001c8 b0120195 b01401b8 b416018e b0180233 b01a01e9 0680:b01c01cd b41e020e b02001b3 b42201b0 b4240191 b026018f b4280229 b42a0218 06a0:b02c0232 b02e0242 b430017c b03201a4 b434014d b436017a b0380201 b43a01fd 06c0:b43c021a b03e01f2 b440018b b0420187 b0440199 b04601b0 b44801f7 b04a01f1 06e0:b44c01fa b04e0205 b0500124 b4520150 b4540141 b056014b b058023d b45a01ec 0700:b45c01f7 b45e01db b06001a0 b4620178 b4640178 b0660177 b46801e7 b46a0219 0720:b06c022e b46e0203 b070019e b4720186 b4740189 b47601aa b0780250 b47a01b7 0740:b47c0269 b07e021e b8008e41 b80001bf bc020185 b8040187 bc06012e b808020a 0760:b80a01e9 b80c01f8 b80e0206 bc1001b6 b81201ce b81401b6 b81601ac bc180222 0780:b81a0200 b81c021b b81e020b bc2001da b82201ab b8240170 b826018b bc2801fa 07a0:bc2a023e bc2c022c b82e0251 b83001b0 bc3201b5 b8340166 bc360188 b838025c 07c0:bc3a0242 b83c021a b83e01ee b84001a9 bc4201c0 bc4401af bc460183 bc480165 07e0:bc4a01a4 bc4c01e5 bc4e01f3 b85001e5 bc5201c8 b85401b1 b8560189 bc580226 0800:b85a01e6 bc5c01ca b85e0212 b86001a2 b862018e bc64017c b86601ae bc6801fe 0820:b86a0223 b86c01fe b86e023c bc7001c2 b8720192 bc74016f b876015f bc780200 0840:bc7a0215 bc7c023e bc7e01db c0008e41 c40001d2 c40201b3 c00401a9 c406019c 0860:c40801df c00a01f4 c40c024b c00e01fc c41001ad c41201cc c41401cc c41601a4 0880:c4180217 c01a020a c01c01e4 c01e020e c42001f4 c42201cc c0240197 c02601aa 08a0:c028022f c02a0284 c02c025f c02e0258 c43001c5 c43201c7 c4340175 c036019d 08c0:c4380220 c43a023f c43c022b c43e0238 c04001fc c04201c8 c44401a3 c44601a8 08e0:c44801f9 c44a0213 c44c024c c04e0219 c05001c8 c45201bc c05401a0 c45601b2 0900:c058020f c45a0205 c45c01dd c45e0232 c46001cf c0620199 c4640180 c466019f 0920:c068022d c46a020f c46c0230 c06e01fa c070018b c07201ae c074016e c476019d 0940:c478020a c47a0243 c47c023e c47e020f c8000e41 c80001b7 c80201a2 cc04019f 0960:cc060194 cc0801d7 c80a01d2 cc0c0213 cc0e0214 cc1001d7 c81201d8 cc1401dc 0980:c81601a8 cc18022f cc1a021e cc1c01e7 cc1e021f c82001df c82201b8 c824018d 09a0:cc2601be c8280236 cc2a0265 c82c0268 c82e0278 cc3001ab c8320197 cc340188 09c0:cc3601b6 cc38026f cc3a0170 cc3c0232 c83e020b c840019b c84201cc cc4401ae 09e0:c84601d6 c84801fc cc4a0212 cc4c0200 c84e022e c8500205 cc52019c cc5401f0 0a00:cc5601b3 cc580244 cc5a020e cc5c01f7 cc5e021b cc6001fb cc6201c9 cc6401d2 0a20:cc6601ab c8680202 cc6a0234 c86c020a cc6e01ed c87001a8 cc7201b9 cc7401ab 0a40:c876019e cc780276 c87a022c c87c0237 c87e01f0 4080080a 4081080a 4083046a 0a60:408e04fa 40a6041b 40a70d80 40ac0888 40af0773 da0000bb ef000020 00000000 0a80:b1808b0e 005e0000 7b343400 ffff982c 982c982c 982c982c 00000000 00000000 (10)Data sentEMSD CSR=b180.8b0e.005e.0000:7c34.3400.ffff.9850 Written: 0380.0001.0000.0000 [0]process_event: (8)Sent 0xaa0 [0]process_event: (8)<Process_event 606, ev->bytes 2736 0x13b9ec0 (fbroc_isr): [0]roc_isr: [4000]<vmeroc_isr (8000)>mEMSD_int_unblock() b180 CIO=005e DP=0000 Tok=7c34 Done=9850 0x13b9ec0 (fbroc_isr): (8000)<mEMSD_int_enable(1) 0x13b9ec0 (fbroc_isr): (8000)<mEMSD_int_unblock() 3980 interrupt: (8000)<mEMSD_int_enable(0) interrupt: (C000)>mEMSD_interrupt b180 CIO=005f DP=0000 Tok=7c35 Done=9950 interrupt: (8000)Give semaphore interrupt: (C000)<mEMSD_interrupt b180 CIO=005f DP=0000 Tok=7c35 Done=9950 [0]roc_isr: [4000]>readAll() [0]process_event: (8) DP=005f Eventbuf 0x12fc0f8, nwords 0x1f400 [0]read_crate: (8)Entering read_crate(0x12fc110,0x1f400,0x12fc110) [0]: (4000)Block Read data stored at address 0x12fc13c ,dmaptr = 0x92fc13c [0]read_crate: (8)Sparse Data Scan 0x0, cycle 0x0, scan 0x3fc00c0, effective 0x3fdfff0 [0]read_crate: (8)eventnum = 607, DP=0x005f eff.scan=03fdfff0 Before LNE Slot=6 r/w=28,30 Slot=7 r/w=28,30 Slot=18 r/w=28,30 Slot=19 r/w=28,30 Slot=20 r/w=28,30 Slot=21 r/w=28,30 Slot=22 r/w=28,30 Slot=23 r/w=28,30 Slot=24 r/w=28,30 Slot=25 r/w=28,30 After LNE Slot=6 r/w=29,30 Slot=7 r/w=29,30 Slot=18 r/w=29,30 Slot=19 r/w=29,30 Slot=20 r/w=29,30 Slot=21 r/w=29,30 Slot=22 r/w=29,30 Slot=23 r/w=29,30 Slot=24 r/w=29,30 Slot=25 r/w=29,30