========================================== 96Jun16 00:01 Operator On Duty: Alan Kerr 96Jun16 00:06 Comment: attempted to load VSN000911-915 into DAT2. none of them would load and archtape says that it has not seen these tapes. 96Jun16 00:14 Job End #3132 ------------------------------------------------------------ 96Jun16 00:14 Job Start #3133 96Jun16 00:27 Job End #3133 ------------------------------------------------------------ 96Jun16 00:27 Job Start #3134 96Jun16 00:42 Job End #3134 96Jun16 00:42 Comment: the problem with the DATs continues. Disk 1 is full enough that I don't believe that the next job will definately fit. I am rebooting to see if I can clear this problem. 96Jun16 00:54 Correlator rebooted. Area:code Reason: trying to clear DAT tape problem. *96Jun16 Down-time category:SFT 01:01-01:27 boot does nothing. HOWEVER, a distribution on gardenia is mis-identifying the output tape. The non-loadable tapes were initialized on gardenia. I have now initialized some tapes on magnolia. These DATs WILL LOAD! *96Jun16 Down-time category:ARC 01:27-01:44 now that I have loadable DATs, I must wait for some file to get off of disk. ------------------------------------------------------------ 96Jun16 01:45 Job Start #3135 96Jun16 01:49 Comment: FD track 33 dead (MF16536) JT 19:53 96Jun16 02:06 Job End #3135 ------------------------------------------------------------ 96Jun16 02:07 Job Start #3136 96Jun16 02:24 Job End #3136 ------------------------------------------------------------ 96Jun16 02:24 Job Start #3137 96Jun16 02:39 Job End #3137 ------------------------------------------------------------ 96Jun16 02:40 Job Start #3138 96Jun16 02:45 Comment: Y poor playback tracks 2,4. JT 20:39 96Jun16 02:46 Comment: HN poor playback tracks 14,16. JT 20:40 96Jun16 02:58 Job End #3138 ------------------------------------------------------------ 96Jun16 02:58 Job Start #3139 96Jun16 03:01 Comment: Y poor playback track 2,4. JT 20:54 96Jun16 03:11 Job End #3139 ------------------------------------------------------------ 96Jun16 03:11 Job Start #3140 96Jun16 03:26 Job End #3140 ------------------------------------------------------------ 96Jun16 03:26 Job Start #3141 96Jun16 03:42 Job End #3141 ------------------------------------------------------------ 96Jun16 03:42 Job Start #3142 96Jun16 03:51 Comment: HM poor playback most tracks. JT 21:45 96Jun16 03:52 Comment: Y poor playback most tracks. JT 21:45 96Jun16 03:58 Job End #3142 ------------------------------------------------------------ 96Jun16 03:58 Job Start #3143 96Jun16 04:09 Comment: zia is really, really, REALLY hung. It won't reboot and almost every window on gardenia is hung waiting on zia. (I can't even get out of "dist") So far nothing on azalea or the correlator is misbehaving. 96Jun16 04:13 Job End #3143 ------------------------------------------------------------ 96Jun16 04:14 Job Start #3144 96Jun16 04:19 Job # Killed by operator ------------------------------------------------------------ 96Jun16 04:20 Job Start #3144 (restart) 96Jun16 04:41 Job End #3144 ------------------------------------------------------------ 96Jun16 04:42 Job Start #3145 96Jun16 05:01 Job End #3145 ------------------------------------------------------------ 96Jun16 05:01 Job Start #3146 96Jun16 05:21 Job End #3146 ------------------------------------------------------------ 96Jun16 05:22 Job Start #3147 96Jun16 05:43 Job End #3147 ------------------------------------------------------------ 96Jun16 05:44 Job Start #3148 96Jun16 05:49 Comment: FD track33 dead. JT 23:25 96Jun16 05:56 Job End #3148 ------------------------------------------------------------ 96Jun16 05:56 Job Start #3149 96Jun16 06:06 Comment: FD track 33 dead, Y poor playback most tracks. JT 23:40 96Jun16 06:07 Job End #3149 ------------------------------------------------------------ 96Jun16 06:07 Job Start #3150 96Jun16 06:25 Comment: PT track 14,16 poor playback. JT 23:56 96Jun16 06:29 Job End #3150 ------------------------------------------------------------ 96Jun16 06:29 Job Start #3151 96Jun16 06:49 Job End #3151 ------------------------------------------------------------ 96Jun16 06:50 Job Start #3152 ========================================== 96Jun16 06:52 Operator On Duty: Betty Ragan 96Jun16 06:53 Comment: PT slow to sync. 96Jun16 06:59 Job End #3152 ------------------------------------------------------------ 96Jun16 06:59 Job Start #3153 96Jun16 07:16 Job End #3153 ------------------------------------------------------------ 96Jun16 07:16 Job Start #3154 96Jun16 07:33 Job End #3154 96Jun16 07:33 Comment: running systest 96Jun16 07:47 Correlator rebooted. Area: test Reason: post-systest ------------------------------------------------------------ 96Jun16 07:49 Job Start #3155 96Jun16 07:55 Comment: FD still has dead track 33. 96Jun16 08:00 Job End #3155 ------------------------------------------------------------ 96Jun16 08:00 Job Start #3156 96Jun16 08:18 Job End #3156 ------------------------------------------------------------ 96Jun16 08:18 Job Start #3157 96Jun16 08:35 Job End #3157 ------------------------------------------------------------ 96Jun16 08:36 Job Start #3158 96Jun16 08:45 Job End #3158 ------------------------------------------------------------ 96Jun16 08:46 Job Start #3159 96Jun16 09:02 Job End #3159 ------------------------------------------------------------ 96Jun16 09:03 Job Start #3160 96Jun16 09:20 Job End #3160 ------------------------------------------------------------ 96Jun16 09:20 Job Start #3161 96Jun16 09:32 Job End #3161 *96Jun16 Down-time category:OHD 09:32-10:04 ------------------------------------------------------------ 96Jun16 10:04 Job Start #5120 96Jun16 10:53 Comment: MK has bad track 2. (This is the second project I've seen that on -- I'd write it up if I had access to MAINT.) 96Jun16 10:53 Comment: PT having frequent trouble staying in sync, often has low weights. This clears up about halfway thru the job. 96Jun16 12:01 Job End #5120 ------------------------------------------------------------ 96Jun16 12:01 Job Start #5121 96Jun16 14:04 Job End #5121 ------------------------------------------------------------ 96Jun16 14:05 Job Start #5122 96Jun16 14:38 Comment: FD in SEARCH, jt 16:36 96Jun16 14:39 Comment: BR, HN in SEARCH, jt 16:39 96Jun16 14:47 Comment: BR syncs at 16:57. 96Jun16 15:00 Comment: FD STALLed, jt 17:21, syncs again about 17:30. 96Jun16 15:32 Comment: HN syncs, jt 18:25. 96Jun16 15:36 Comment: MK in SEARCH, jt 18:33-18:53. 96Jun16 15:48 Comment: OV SEARCHing jt 18:58-19:12. 96Jun16 16:08 Job End #5122 ------------------------------------------------------------ 96Jun16 16:09 Job Start #5123 96Jun16 16:40 Comment: jt 20:33, FD not syncing, popping in and out of SEARCH. Syncs at 20:36, but has problems again on the next pass. 96Jun16 16:51 Job End #5123 *96Jun16 Down-time category:OHD 16:52-16:59 96Jun16 16:55 Comment: Just realized that jobs 5130-5144 use this same set of tapes, so I'm skipping down to those. ------------------------------------------------------------ 96Jun16 16:59 Job Start #5130 96Jun16 16:59 Job #5130 Killed by system: "2048 FFT with 16-track toll NOT allowed" ------------------------------------------------------------ 96Jun16 17:00 Job Start #5131 96Jun16 17:01 Job #5131 Killed by system. Same message. All the BH019 jobs from 5130 on have 2048 FFT size, and I'd assume they all have the 16-track roll... so I assume they're not going to run. Going back to jobs 5124-5127 *96Jun16 Down-time category:OHD 17:04-17:23 ------------------------------------------------------------ 96Jun16 17:23 Job Start #5124 96Jun16 17:28 Comment: FD has dead track 33. Known problem. ========================================== 96Jun16 18:56 Operator On Duty: Alan Kerr 96Jun16 19:00 Job End #5124 ------------------------------------------------------------ 96Jun16 19:01 Job Start #5125 96Jun16 21:02 Job End #5125 96Jun16 21:02 Comment: running systest 96Jun16 21:17 Correlator rebooted. Area:code Reason: post systest ------------------------------------------------------------ 96Jun16 21:20 Job Start #5126 96Jun16 21:26 Comment: FD track 33 dead (continues). 96Jun16 23:16 Job End #5126 ------------------------------------------------------------ 96Jun16 23:16 Job Start #5127 96Jun16 23:31 Job End #5127 *96Jun16 Down-time category:OHD 23:32-23:42 ------------------------------------------------------------ 96Jun16 23:42 Job Start #5220 96Jun16 23:46 Job # Killed by operator. "/deliver: write failed, file system is full" message.