2005/06/10  16:30    16:30;;2005/06/10;;+25;;LCChain
2005-6-10  18:00;;Hagar;;
2005-6-10 18:30;;Success. <br>Connection between hub was not tested.<br>hub2-hub1-hub5 <br>The hubs connection was tested succesfuly <br><br>setup here:<br><a href=http://icecube.wisc.edu/~hagar/fat/fat7/monitor.hub1.start.FAT7.dat> fathub1 </a><a href=http://icecube.wisc.edu/~hagar/fat/fat7/monitor.fathub2.start.fat7.dat> fathub2 </a><br><a href=http://icecube.wisc.edu/~hagar/fat/fat7/monitor.fathub5.start.fat7.dat> fathub5 </a><br>;;one doms (700) was not communicating. It was replaced by fat 6 dom Leprechaun (620)
2005/06/10  16:50    16:50;;2005/06/10;;+25;;STF
2005-6-11 18:49;;hagar;;- fathub2 : ok<br>- 3 doms failed flasher clock. after fb update passed.  fathub1, fathub5: stoppetd before flasher-width. many flasher clock failures.all passed after fb update.<br>---------<br>run u and t speratly for flasher width.<br>all doms passed.
2005-6-15 11:00;;problem running flasher-width on hub1 and hub2 <br><br>2 failures: flasher bright on 13215a559856 Hadephobia, 666<br> <br><br>flasher width on Ecclesiophobia 664;;
2005/06/10  18:20    18:20;;2005/06/10;;+25;;DOMCal
2005-6-10 22:40;;hagar;;Updated domcal on all doms. <br> 7b0de8658562 LeukoPhobia Failed to calibrate. It is on fathub1 111U. updated domcal (again) but still no HV info while updating HV2DB
2005-6-10 23:40;;~/domcal/domcal+25/ <br>1 dom failed <br><a href=http://icecube.wisc.edu/~hagar/fat/fat7/histo25/hv.html> histos here.</a><br>;;
2005/06/10  19:20    19:20;;2005/06/10;;+25;;Lux
2005-6-11 10:40;;hagar/kael;;error: connection refused from lightsource.py.<br>Rates very high 20k-30k<br>one dom readouts=0, the same one who did not calibrate <br>Chris killed a python light control script, and now ok.
2005-6-11 18:47;;11.lux<br>;;
2005/06/11  08:00    08:00;;2005/06/11;;+25;;TestDAQ
2005-6-14 21:16;;hagar and later mark;;Beginning of run was very bumpy. <br><a href=http://www.icecube.wisc.edu/~hagar/fat/fat7/fat7crisis.txt><br>more details here </a> testdaq is now mworking after a domhubaoo update using Kael's fix. for more details contact Mark.<br> <br>more gps problems on hub5, card2, although hub was rebooted earlier.<br>Another problem is that the output fiels are not written to the same directory.<br>rebooting hub.... <br>....now run 6874 - fathub2 card3 gps is gone, did fpga 3 f 3 and restrted the run.<br> <br>again for gps hub5,2 fpga 2 f 3....boring <br><br>unbeleivablem after disk space problem, for runs 6884, 6885 messages: "requested dom not present in hit stream" for all hubs and "<br>icecube.daq.domhub.common.DHDriverException: Reply does not match a known DOM App message format<br>        at sun.rmi.transport.StreamRemoteCall.exceptionReceivedFromServer(StreamRemoteCall.java:247)<br>4635 [Thread-11] ERROR TestDAQ Control  - DOM Hodophobia 52cae978ebb0 fathub2.32B failed configuration change<br>icecube.daq.domhub.common.DHDriverException: Reply does not match a known DOM App message format<br>        at sun.rmi.transport.StreamRemoteCall.exceptionReceivedFromServer(StreamRemoteCall.java:247)<br>"<br><br>rebooted all three hubs, started testdaq.<br> <br>Runs (which Hagar started at run number 6887) were successful during the night until the DOM Ephebiphobia went dead during the first time resolution run (#6930)<br><br>consequently, i am repeating the previous run (the last of the ped pattern runs) and also the timeres runs.<br><br>these runs start with run number 6943<br><br>I deleted runs 6930 to 6942 from the data warehouse staging area.<br><br>
2005-6-15 9:00;;runs:<br>6887-6928, 6944-6947;;
2005/06/11  16:30   16:30;;2005/06/11;;+25;;Soaking / stability
2005-6-12 18:52;;kael;;see lux run above
2005-6-12 18:52;;;;
2005/06/11  17:30   17:30;;2005/06/11;;+25;;Cooldown
2005-6-15 13:11;;Claire / Hagar;;cold_rebbot started
2005-6-17 9:35;;failures:<br>fathub2:<br>630 - 17 failures  - Obesophobia, 3270c...<br>530 - Murophobia, 39f663d...1 failure-<br>610 - Radiophobia, ea6f08e...3 failures<br>730 - Mythophobia, 12d916...- 1 failure<br><br>fathub2:<br>730 - fe4fff5cfe19 -Photophobia- two failures<br><br>;;
8; 2005/06/12 08:30 ;  -20; Defrost


9; 2005/06/12 09:15 ;  -20; Cooldown


2005/06/12  22:00  22:00;;2005/06/12;;-45;;STF
2005-6-17 9:45;;hagar;;
2005-6-17 11:49;;fails:<br>725, novercaphobia - flasher bright <br>4e41e17f6b7e atwd pulser, chipB 1<br>e4194d677ad0 - disc scan<br>6458149340b pmt hv ramp<br>0912cde99f01 pmt hv ramp<br>01c99<br>01c997d687a6 atwd pulser 40pe, chip A1<br>69a843a5e181 pmt hv ramp<br>34bb7d414187 pmt hv ramp<br>721, textophobia - flasher bright<br>597, xyrophobia, flasher width<br>679, symmetrophobia flasher bright<br>669, sciaphobia, flasher bright<br>peccatophobia, 689 flasher bright<br>nomatophobia 647 - flasher bright<br>scoleciphobia 693 - flasher bright, flasher width<br> <br>limnophobia, 676 flasher bright<br>666, hadephobia flasher bright<br>648, hobophobia flasher bright<br>702, globophobia, fash bright<br>lavophobia flasher bright<br>618, ephebiphobia flasher width<br>ideophobia 708 - flasher bright<br>714, graphobia flasher width<br>638, cancerphobia - flasher width;;
2005/06/13  09:00  09:00;;2005/06/12;;-45;;DOMCal
2005-6-17 11:51;;hagar;;upgrdae to domcal 5.8
2005-6-17 13:5;;all doms calibrated but<br>7b0de8658562 <br>Leukophobia;;
2005/06/13  10:00  10:00;;2005/06/13;;-45;;TestDAQ
2005-6-17 13:6;;hagar;;run 6950- error in card 2 fathub5<br>and card 3 and 1 on fathub2<br>Reloaded pages 3 and 1. without rebooting,<br>----<br>run 6951<br>I forgot to "ready" on hub2. restart.<br>-----<br>run 6952-6954 - gps on hub5<br>rebooted hubs<br> <br>----<br>run 6955-6958 ok<br>-----<br>run 6959 hung <br><br><br>run 6960 encountered GPS errors, fathubs 2 and 5 were rebooted<br><br>started sequence of testdaq runs where we left off with run 6961<br> <br><br>assorted GPS problems occured until we rebooted the fathub5 again and started up run 6967 <br><br>debugged problems with new script until data taking for real began with run 6970<br>---<br><br>run 6970 -gps. <br>reloaded page 3,1 on fathub5<br>------<br> run 6975 seems ok <br>-------<br>run 6979 : gainvsHv 1300 - Leukophobia does not respond to slow control <br>----<br>fine til 6995 where Sitiophobia 3a5... is lost(first linearty rn )...restarting tetsdaq and reloading all cards on hub2 and hub5<br>---<br>6997.-7010ok<br> <br>run 7012 - Papaphobia dropped out from slow control. <br>restarted testdaq and fpga hub2 and hub5<br>------<br>run 7013 did not start well<br>-----<br>run 7014, 7015 ok<br>---<br>run 7016 Trichopathophobia failed comm...<br>----- <br>run 7018... 7027
2005-6-18 2:06;;good runs:<br>6955-6958,<br>6975-6993 (Leukophobia not responding, but this guy is dead already) <br>6997.-7010 <br>7014 , 7018-7027;;
2005/06/13  17:00  17:00;;2005/06/17 21:00;;-45;;LUX
2005-6-19 18:40;;hagar;;
2005-6-19 21:38;;06/19.lux<br>;;
2005/06/13  19:00  19:00;;2005/06/17 23:00;;-45;;Soaking / stability
2005-6-18 2:7;;hagar;;
2005-6-20 9:56;;06/18 = 40.2 hours<br>06/19 = 12 hours <br>;;
2005/06/14  19:00  19:00;;2005/06/19  21:00;;-45;;Cooldown
2005-6-20 9:57;;Claire;;started cold reboot at 10:00
2005-6-20 20:26;;;;
2005/06/15  08:30  08:30;;2005/06/20  8:00;;-55;;STF
2005-6-20 21:15;;hagar;;using new version of stf, with the new commands called "stfA" and "stfB"<br> <br>running on all tests but flasher using old stf
2005-6-20 23:39;;<a href=http://icecube.wisc.edu/~hagar/fat/fat7/stf_fail.txt><br>here </a>;;
2005/06/15  10:00  10:00;;2005/06/20  10:00;;-55;;DOMCal
2005-6-20 19:59;;mark;;upload domcal v5.9 and started domcal
2005-6-20 21:00;;all doms calibrated by 7b0de8658...;;
2005/06/15  11:00  11:00;;2005/06/20  12:00;;-55;;Lux
2005-6-20 23:41;;hagar;;3592798f3eb0-TP5P0597-Xyrophobia is not communicating restarting. <br>The light source were left on, so I stopped it again when the light source are off.<br>restarted. now there are 146 doms with good starting rate.<br>happy I am !
2005-6-21 10:59;;first in 20.lux, but only the nohup file is in.<br>then in 21.lux<br> <br>9 hours of monitoring;;
2005/06/15  13:00  13:00;;2005/06/20  14:00;;-55;;TestDAQ
2005-6-21 10:59;;hagar;;start at 0007028 - card 2 hub 5 gps.<br>I put a script called fpgall in bin to reload pages 1,3 on all cards. <br>---<br>run 7029-7036 used the wrong steering files. I had a typo in automate<br>---<br>7037...
later;;;;
20; 2005/06/15 21:00;   -55; Soaking / stability


21; 2005/06/17 08:00;   -55; Warmup


22; 2005/06/17 11:30;   -20; STF


23; 2005/06/17 13:00;   -20; DOMCal


24; 2005/06/17 14:00;   -20; Lux


25; 2005/06/17 16:00;   -20; TestDAQ


26; 2005/06/18 08:30;   -20; Soaking / stability


27; 2005/06/19 08:30;   -20; Defrost


28; 2005/06/19 09:15;   -14; Warmup1


29; 2005/06/19 14:15;   +15; Warmup2


30; 2005/06/20 09:15;   +25; LCChain


31; 2005/06/20 10:00;   +25; STF


32; 2005/06/20 11:05;   +25; DOMCal


33; 2005/06/20 12:05;   +25; TestDAQ 


34; 2005/06/20 19:05;   +25; Lux


35; 2005/06/20 21:05;   +25; Soaking / stability


36; 2005/06/21 16:30;   +25; Cooldown


37; 2005/06/22 08:30;   -20; Defrost


38; 2005/06/22 09:15;   -20; Cooldown


39; 2005/06/22 19:15;   -45; STF


40; 2005/06/23 08:00;   -45; DOMCal


41; 2005/06/23 09:00;   -45; Lux


42; 2005/06/23 11:00;   -45; TestDAQ


43; 2005/06/23 19:30;   -45; Soaking / stability