2005/07/15 9:00 9:00;;2005/07/15 9:00;;+25;;LCChain
2005-7-18 10:30;;mtk ;;  Mark reran with the full chain - not split across DOMHubs 2005-7-18 11:00;;  All passed - 143 links.;;  2005/07/15 9:30 9:30;;2005/07/15 9:30;;+25;;STF A/B
2005-07-16 15:30;;  kdh;;  strange event - ran manually and got many fails. then ran using mark's stfA/stfB scripts and things look OK 2005-07-16 18:30;;4 FAILs
1. UP5P0652 - atwd_pulser_spe
2. UP5P0920 - flasher brightness - this is "Daikaku_Inumura", one of the Golden PMT Doms
3. TP4P0093 - ADC
4. AP5P0439 - fadc_fe_pulser;;DO NOT USE STF results from 12:00 to 15:30 on this date - they are BAD! 2005/06/15 11:30 11:30;;2005/06/15 11:30;;+25;;DOMCal
2005-7-15 10:19;;  Mark;;  2005-7-15 11:19;;  88776d7e42bf "Technology" is a high gain DOM which failed to calibrate. I set the nominal opertaing voltage to 1172 volts in the database.

see the domcal plots at


inital domcal plots
;;  2005/06/15 12:30 12:30;;2005/06/15 12:30;;+25;;Lux
2005-7-17 13:00;;kdh;;Runs are in 2005/07/17.lux.
The sync board shows 345 kHz - not 500 kHz but this is same as FAT7 2005-7-17 18:00;;;;  2005/07/15 14:30 14:30;;2005/06/15 14:30;;+25;;TestDAQ
2005-7-19 2:11;;  kael and mark;;  runs 7385 thru 7411 looked succesful, then ran out of disk space

i (mark) stopped TestDAQ, deleted all of the hit files for the recent runs, and started up TestDAQ again with run 7430
2005-7-19 2:11;;  Genealogy fathub2.52B went dead during run 7446;;  2005/06/15 20:30 20:30;;2005/06/15 20:30;;+25;;Soaking / stability
2005-7-17 17:00;;kdh;;75000 sec run 2005-7-18 10:30;; ;;  2005/06/18 08:30 08:30;;2005/06/18 08:30;;+25;;Cooldown
2005-07-19 08:34;;kdh;;Did a manual defrost at 10:05 am - 2 liters H2O expelled from DFL. Defrost time of about 30 min should be sufficient 2005-07-19 16:40;; ;;  2005/06/18 16:00 16:00;;2005/06/18 16:00;;-20;;Defrost
2005-7-20 11:30;;kael;;did short defrost - no water expelled from DFL 2005-7-20 12:30;; ;;  9; 2005/06/18; 17:00 ; -20; cooldown 2005/06/19 08:00 08:00;;2005/06/19 08:00;;-45;;STF
2005-7-20 12:30;;kdh;;  several fails 2005-7-20 14:00;; ;;  2005/06/19 10:00 10:00;;2005/06/19 10:00;;-45;;DOMCal
2005-7-20 14:40;;kael;; 2005-7-20 15:30;;  all doms finished;;  2005/06/19 11:00 11:00;;2005/06/19 11:00;;-45;;TestDAQ
2005-7-20 16:54;;kael;;  No dead DOMs. 2005-7-21 00:50;;  RUNS 7465 - 7511 are GOOD.;;  2005/06/19 18:00 18:00;;2005/06/19 18:00;;-45;;LUX
2005-7-21 6:30;;  kael;;  2005-7-21 8:45;;  OK;;  2005/06/19 20:00 20:00;;2005/06/19 20:00;;-45;;Soaking / stability
2005-7-21 8:50;;  kael;;  2005-7-22 12:30;; ;;  Note that Demonology has bad HV setting so the rate is bad. Musicology has slow monitor readout. 2005/06/19 20:00 20:00;;2005/06/19 20:00;;-45;;Cooldown
2005-7-22 12:35;;kael;;simple turn down of switch to -53 C. Did short (30 min) defrost prior to turn-down. 2005-7-22 12:54;; ;;  2005/06/20 08:00 08:00;;2005/06/20 08:00;;-55;;STF
2005-7-26 11:30;;kael;;  2005-7-26 14:30;;Barat serious HV failure;;  2005/06/20 10:00 10:00;;2005/06/20 10:00;;-55;;DOMCal
2005-07-23 03:30;;kael;;150 DOMs in run 2005-7-23 4:45;;2 very high gain DOMs (TP5P0733 - Vexillilogy and TP5P0753 - Technology) failed to calibrate. SPE fits OK but rejected by DOMCal fitter.;;  2005/07/21 11:00 11:00;;2005/06/20 11:00;;-55;;TestDAQ
2005-7-25 9:21;;  kael;;Dead DOM
- runs 7521-7534 and 7543 - 7575 OK.

MK: "Barat", a FAT05 Wind DOM, appeared to lose its HV/PMT during run 7538.
STF will likely disagnose this problem further. 2005-7-25 23:45;; ;;  Seismology and
Cryptology went DEAD during run 7517 to 7520 fathub2.03 A and B 2005/06/20 18:00 18:00;;2005/06/20 18:00;;-55;;LUX
2005-07-26 9:45;;  kael;;  2005-7-26 11:00;; ;;  2005/06/20 20:00 20:00;;2005/06/20 20:00;;-55;;Soaking / stability
2005-07-23 5:10;;kael;;Remembered to insert new voltages into DB. 2005-7-25 9:10;;  May need more soaking - fathub1 crashed on Sunday. Data files are in 2005/07/23 directory. Additional soak started on Monday 25 July at 11:47 PM. Data into 2005/07/25;;  2005/06/21 20:00 20:00;;2005/06/21 20:00;;-55;;Warmup
2005-7-26 15:00;;kael;;  started multimon - going into 2005/07/26 2005-7-26 22:00;; ;;  2005/07/25 08:00 08:00;;2005/07/25 08:00;;-20;;STF
2005-7-27 12:30;;kael;;T DOMs run on 7/27.
U DOMs run on 7/28 between 21:00 and 23:00 2005-7-28 23:00;; ;;  2005/07/25 10:00 10:00;;2005/07/25 10:00;;-20;;DOMCal
2005-7-26 22:00;;kael;;  2005-7-27 7:23;;UP5P0502 "Barat" failed to produce an XML. All others OK;;  2005/07/25 11:00 11:00;;2005/07/25 11:00;;-20;;TestDAQ
2005-7-27 21:21;;kael and mark and hagar;;run 7596 "Apple" goes dead

Hagar zips up successful steering files. Runs restarted 7600 by david - no fpgall -

runs restarted again by mark starting with 7603. we got a run which did not terminate in run 7606

mark restarted runs again with 7607
2005-7-27 21:21;;kael Note that GPS was bad for this period - all runs which rely on RAP sync of DOMs are BAD.
For LC/Timeres runs with good GPS look to 7638 - 7660.;;  2005/07/25 18:00 18:00;;2005/07/25 18:00;;-20;;LUX
2005-07-27 07:20;;  kael;;  2005-7-27 7:24;; ;;  2005/07/25 20:00 20:00;;2005/07/25 20:00;;-20;;Soaking / stability
2005-7-28 04:16;;kael;;Paused at 10:30 to reboot hubs because of GPS problem 2005-7-28 11:16;; ;;  27; 2005/06/25; 08:00; -20; Defrost 28; 2005/06/25; ; -14; Warmup1 2005/07/26;;2005/07/26;;+15;;Warmup2
2005-7-29 22:0;;kael / hagar;;stopped warm-up at +25 C (DOM MB temp) 2005-7-29 22:0;; ;;  30; 2005/06/26; 08:00; +25; LCChain 31; 2005/06/26; 08:30; +25; STF 32; 2005/06/26; 10:30; +25; domcal 33; 2005/06/26; 11:30; +25; TestDAQ 34; 2005/06/26; 18:30; +25; Lux 35; 2005/06/26; 20:30; +25; Soaking / stability 36; 2005/06/28; 08:30; +25; Cooldown 37; 2005/06/28; ; -20; Defrost 38; 2005/06/28; ; -20; Cooldown 39; 2005/06/29; 08:00; -45; STF 40; 2005/06/29; 10:00; -45; DOMCal 41; 2005/06/29; 11:00; -45; TestDAQ 42; 2005/06/29; 18:00; -45; LUX 43; 2005/06/29; 20:00; -45; Soaking / stability 43; 2005/07/01; 08:00; -45; Soaking / stability at 2000 kV 43; 2005/06/02; 08:00; -45; Soaking / stability 44; 2005/07/08; 08:30; -45; Warmup 45; 2005/07/09; 08:30; -45; UnLoad