2005/11/8 17:00   17:00;;2005/11/8 17:00;;+25;;Initialization
2005-11-10 16:51;;Mark;;<br>total  number of       unknown (monitor)     doms =  50<br>total  number of         known (monitor)     doms =  63<br>total  number of found unknown (newdoms.txt) doms =  50<br>total  number of found unknown             T doms =  29<br>total  number of found unknown             U doms =  17<br>total  number of found unknown             A doms =   4<br>ISH DOMs                                          =   4<br>IERISH DOMs                                       =   7<br>IER DOMs                                          =   4<br> <br> <br><br>plus 5 european DOMs which had to be added specially
2005-11-10 16:51;;Flasher download:<br>hub1: failed the following doms, and then tried manually:<br>hub2:<br>5000 - version1, execution failed error code 1<br>5003,5005 - version 6, loaded version 12<br>5031,5033 - version 12 already there. reloaded<br><br>hub1:<br>5019 already v12<br><br> 5021, 5027, 5027,5033,5053. already v12. reloaded<br>5054 already v12, reload failed on  error code 2;;
2005/11/9  9:00    9:00;;2005/11/9  9:00;;+25;;LCChain
2005-11-10 14:50;;hagar;;Single failure between: 222A "Papagayoish" and 223B "Shigellosis". (7056626 and 94464c22). On one side only. <br><br>also, a failure between 231B "Tularemia" and 231A<br>"Thalassophilia". I think "Thalassophilia" had an LC problem in the philia fat as i remember<br>.
2005-11-10 16:52;;Thalassophilia removed from FAT.<br><br>"Papagayoish" removed from FAT <br><br>No other LC failures;;
2005/11/9  9:30    9:30;;2005/11/9  9:30;;+25;;STF A/B
2005-11-11 0:14;;;;Updated domid for DESY DOM Tp5Y0129 <br><br>Ran before final reload
2005-11-11 15:49;;- One T/A DOM failed comm<br>- one u dom failed comm<br><br>- Troll 617 - all flasher<br>- trenton935 - two FB<br>- Zucchinier 975- one FB <br>- many failures on pulser_1pe_A...<br>- a single  pulser_1pe_bx failure on  Measles 0937 <br><br>Limonophilia,986 - failed adc<br><br>iconophilia - many failures <br><br><A HREF=http://icecube.wisc.edu/~hagar/fat/fat11/STF+25A.fat11.TA.jpg><br>Here </a><br><a HREF=http://icecube.wisc.edu/~hagar/fat/fat11/stf.25A.fat11.u.jpg>><br>and here </a>;;need to run seperate test
2005/11/9  10:30    10:30;;2005/11/9  10:30;;+25;;DOMCal
2005-11-10 20:56;;Mark+ hagar;;UP5P1064 Candidiasis at fathub2.12B failed HV calibration<br><br>Demonology had a 10^7 gain value of 3,500 volts! <br><br>Domcal ran again. all doms calibrated but apple.<br>91c420c11953
2005-11-10 20:56;;domcal values inserted into the database... <br><br><a href=http://www.icecube.wisc.edu/~hagar/fat/fat11/domcal-histos+25A/hvsummary.html><br>histos here<br></a>;;
2005/11/9  11:30    11:30;;2005/11/9  11:30;;+25;;TestDAQ
2005-11-11 11:58;;hagar;;start: 8723 <br><br>Ran smoothly - no dead doms, no crasahes :)
2005-11-12 03:26;;;;
2005/11/9  18:30    18:30;;2005/11/9  18:30;;+25;;Lux
2005-11-12 08:30;;hagar;;
2005-11-12 10:27;;~/monitoring/2005/11/12.lux<br>followed by mutimon;;
2005/11/9  20:30   20:30;;2005/11/9  20:30;;+25;;Soaking / stability
2005-11-12 10:28;;hagar;;
2005-11-13 16:28;;~/monitoring/2005/11/12.lux<br><br>Some funny looking doms. pics will follow shortly;;
2005/11/10  08:30   08:30;;2005/11/10  08:30;;+25;;Cooldown
2005-11-13 17:29;;hagar;;<br>coold down started
2005-11-14 9:30;;results:<br>/mnt/data/testdaq/cold_boot_test/2005/11/13<br>;;
2005/11/10  16:00   16:00;;2005/11/10  16:00;;-20;;Defrost
2005-11-14 9:58;;hagar;;
2005-11-14 9:58;;;;
2005/11/14  11:00   11:00;;2005/11/10  17:00;;-20;;cooldown
2005-11-14 10:22;;;;
2005-11-15 9:23;;;;
2005/11/15  9:00  9:00;;2005/11/15  9:00;;-45;;STF
2005-11-15 18:00;;Kotoyo;;First T-DOM run is wrong configuration(forgot to remove WisDOM)<br><br>U-DOM run start from<br>11/15/05 6:59:21 PM CST  a861a18355e1   ADC.xml<br><br>2nd T-DOM run start from<br>11/15/05 7:49:53 PM CST  f301c4df9d40   ADC.xml  <br> <br>All results are merged into <br>stf_results.FAT11.-45A.txt<br>and <br> stf_fail.FAT11.-45A.txt<br>
2005-11-15 20:56;;<a href=http://www.icecube.wisc.edu/~hoshina/FAT/fat11-45A/STF-fat11-M45A-T-DOMs.jpg>T-DOMs</a><br><br><a href=http://www.icecube.wisc.edu/~hoshina/FAT/fat11-45A/STF-fat11-M45A-U-DOMs.jpg>U-DOMs</a><br><br>;;  Arkansus didn't communicate
2005/11/15  10:00  10:00;;2005/11/15  10:00;;-45;;DOMCal
2005-11-15 0:20;;Kotoyo;;Arkansas didn't communicate with string processer. only 111 .out files are created,
2005-11-15 1:17;;  See<a href = http://www.icecube.wisc.edu/~hoshina/FAT/fat11-45A/hv.html> here </a> <br><br>  Leukophobia (7b0de8658562) failed<br><br>Candidiasis(0c5f80348cdb) only two measurement points are succeeded to fit;;
2005/11/15  11:00  11:00;;2005/11/15  11:00;;-45;;TestDAQ
2005-11-15 11:50;;Kotoyo;;added an experimental "LC3" run - using triple local coincidence.<br><br>started from run 8748<br>restarted from run 8757 and  "Hoplophilia" dropped out of data-taking.<br>there was no error message in testdaq control, but the data quality log<br>complained the DOM was missing.<br><br>message:<br>6: Hoplophilia ba165cd85421 fathub1.03B -- Requested DOM not present in hit stream<br><br>
2005-11-15 17:50;;  run 8760 - 8788;;   Arkansus didn't communicate with DomHub
2005/11/15  15:00  15:00;;2005/11/15  15:00;;-45;;LUX
2005-11-15 2:15;;  Kotoyo;; 
2005-11-15 4:19;;<br>Small data size:<br>UP5P0672 Leukophobia<br>UP5P0620 Leprechaun<br><br>;;Special DOMs for optical fiber test :<br>Oenophilia<br>Trenton<br>Hemophilia<br>Potophobia<br>Sosuke_Inukawa<br>Leprechaun<br>
2005/11/15  17:00  17:00;;2005/11/15  17:00;;-45;;Soaking / stability
2005-11-15 4:19;; ;;suspended at 2005/11/15 11:30 to run TestDAQ <br><br>Restarted at 2005/11/16 00:29
2005-11-16 0:38;; ;;      4 3 B (Arkansus) NOT communicating
2005/11/16  19:00  19:00;;2005/11/16  19:00;;-45;;Cooldown
2005-11-18 10:21;;Dan W;;
2005-11-18 21:13;;;;
2005/11/17  9:00  9:00;;2005/11/17  9:00;;-55;;STF
2005-11-19 0:14;;Kotoyo;;
2005-11-19 1:27;;<a href=http://www.icecube.wisc.edu/~hoshina/FAT/fat11-55A/STF-fat11-M55A-T-DOMs.jpg>T-DOMs</a><br><br><a href=http://www.icecube.wisc.edu/~hoshina/FAT/fat11-55A/STF-fat11-M55A-U-DOMs.jpg>U-DOMs</a><br><br><br>;;
2005/11/17  10:00  10:00;;2005/11/17  10:00;;-55;;DOMCal
2005-11-18 21:12;;hagar;;
2005-11-18 22:1;;<a href=http://icecube.wisc.edu/~hagar/fat/fat11/55/hvsummary.html><br>Here </a><br>;;
2005/11/17  11:00  11:00;;2005/11/17  11:00;;-55;;TestDAQ
2005-11-19 14:50;;  mark and others;;   mark restarted TestDAQ from beginning after a strage error on hub2:<br>2155065 [RMI TCP Connection(21)-172.16.34.160] ERROR (DOM.java:1183) - Problem creating wf data server for dom: ba8ae8198d4f<br>2155070 [RMI TCP Connection(21)-172.16.34.160] ERROR (DOM.java:1268) - Problem creating monitor server for dom: ba8ae8198d4f<br><br>new runs start with run 8882<br>
2005-11-19 18:52;; ;; 
2005/11/17  15:00  15:00;;2005/11/17  15:00;;-55;;LUX
2005-11-18 22:02;;hagar,Kotoyo;;
2005-11-19 0:10;;Looks OK<br><br>Following special doms has low sensitivity<br><br>Oenophilia<br>Trenton<br>Hemophilia(with big error bar)<br>Potophobia<br>Sosuke_Inukawa<br>Leprechaun;;
2005/11/17  17:00  17:00;;2005/11/17  17:00;;-55;;Soaking / stability
2005-11-19 1:32;;Kotoyo;;suspended at 11/19 14:40 to run TestDAQ <br><br>11/19 20:22 restart again
2005-11-21 10:31;;;;
2005/11/18  19:00  19:00;;2005/11/18  19:00;;-55;;Warmup
2005-11-21 10:30;;hagar;;multimon at 21
2005-11-21 14:51;;152U hub1-ff245ac8fbac-UP5P0948-Tennessee<br>and<br>203U hub2 ad084d9664ba-UP5P0584-Baba_Yagaish<br>dropped from multimon<br><br>;;<br>
2005/11/19  11:00  11:00;;2005/11/19  11:00;;-20;;STF
2005-11-22 0:10;;Erik;;
2005-11-22 1:59;;no pictures due to slooow connection.  See .txt files;;
2005/11/19  12:00  12:00;;2005/11/19  12:00;;-20;;DOMCal
2005-11-21 18:45;;Erik;;
2005-11-21 20:45;;<a href="http://icecube.wisc.edu/~estrahler/fat/UW-FAT-11/histos/hvsummary.html">See Here</a>;;
2005/11/19  13:00  13:00;;2005/11/19  13:00;;-20;;TestDAQ
2005-11-22 12:17;;Erik;;
2005-11-22 17:15;;good runs: 8911; 8915- 8942<br><br>8944 maybe?  (special run with one missing dom)<br><br>good files on the move.  someone should delete .hit files after xfer is complete;;
2005/11/19  17:00  17:00;;2005/11/19  17:00;;-20;;LUX
2005-11-21 20:45;;Erik;;
2005-11-21 23:47;;smooth;;
2005/11/19  19:00  19:00;;2005/11/19  19:00;;-20;;Soaking / stability<br>
2005-11-22 2:2;;Erik;;paused for testDAQ 11/22 12:17<br><br>started again 11/22 17:19
2005-11-23 9:39;; ;;   this is a comment from Mark - at some point during the FAT "Oenophilia" stopped communicating for large periods of time when multimon was running - I am making a note here because I don't see one above.
2005/11/20  19:00  19:00;;2005/11/20  19:00;;-20;;Defrost
2005-11-23 9:44;;hagar;;
2005-11-23 10:22;;;;
2005/11/21  10:00   10:00;;2005/11/21  10:00;;-14;;Warmup1<br>
2005-11-23 10:23;;hagar;; 
2005-11-23 16:00;; ;; 
2005/11/21;;2005/11/21;;+15;;Warmup2<br>
2005-11-23 16:00;; ;; 
2005-11-23 21:00;; ;; 
2005/11/22  09:00  09:00;;2005/11/22  09:00;;+25;;LCChain<br>
2005-11-27 21:29;;  hagar;;success all the way up to fathub2 50B.<br>
2005-11-27 21:29;; ;; 
2005/11/22  09:30  09:30;;2005/11/22  09:30;;+25;;STF
2005-11-24 14:00;;Sean;;
2005-11-24 16:22;;<a href=http://icecube.wisc.edu/~grullon/FAT11/STF+25B_fat11_T.jpg > T-DOMs </a> <br><br><a href=http://icecube.wisc.edu/~grullon/FAT11/STF+25B_fat11_U.jpg > U-DOMs </a>;;
2005/11/22  10:30  10:30;;2005/11/22  10:30;;+25;;domcal
2005-11-24 14:39;;Sean;;
2005-11-24 14:39;;plots can be found <a href=http://icecube.wisc.edu/~grullon/FAT11/25Bhistos/hvsummary.html > here. </a>;;
2005/11/22  11:30  11:30;;2005/11/22  11:30;;+25;;TestDAQ
2005-11-25 18:20;;hagar;;Pausing multimon <br>Rebooted hub2 after several error mesasges:<br>..Exception occurred during daa stream close for... varios doms, all on hub2<br> <br><br>run 8957, 8959 <br>Similr error, each time on the same wire pair, on different doms.<br>ERROR: exception caught in RapCalImplBS constructor (id=Influenza 3d7d89305e2a fathub1.30B) (tcalfit 1): java.lang.ArrayIndexOutOfBoundsException: -1<br> <br><br>and in 8959:<br>ERROR: exception caught in RapCalImplBS constructor (id=Rabies 4e6a97fcef81 fathub1.30A) (tcalfit 1): java.lang.ArrayIndexOutOfBoundsException: -1<br>
2005-11-26 1:36;;from 8952<br> <br>to 8987<br>Some failing runs were ran again;;
2005/11/22  15:30  15:30;;2005/11/22  15:30;;+25;;Lux
2005-11-26 7:00;;Sean;;
2005-11-26 9:00;;everything seemed to go smoothly with LUX.;;
2005/11/22  19:30  19:30;;2005/11/22  19:30;;+25;;Soaking / stability
2005-11-24 0:50;;;;started soaking at 12:50am at 11/24, had problems with domcal, will try again in the morning
2005-11-24 12:50;;;;
2005/11/23  19:30  19:30;;2005/11/23  19:30;;+25;;Cooldown
2005-11-28 10:20;;hagar;;
;;;;
38; 2005/11/19; 23:30;   +25; Soaking / stability


39; 2005/11/21; 08:30;   +25; Cooldown


2005/11/25  10:00  10:00;;2005/11/25  10:00;;-45;;DOMCal
2005-11-29 10:33;;jbraun;;
2005-11-29 1:00;;histos <a href=http://www.amanda.wisc.edu/jbraun/domcal-fat11-45b/hv.html>here</a><br><br>Leukophobia & Candidiasis failed,<br><br>Demonology noisy.  All others OK;;Switched to release 403 at MK request
2005/11/25  11:00  11:00;;2005/11/25  11:00;;-45;;Soaking / stability
2005-11-29 15:20;;Erik;;soaking....
2005-11-29 15:20;;;;
42; 2005/11/22; 08:00;   -45; STF


43; 2005/11/22; 10:00;   -45; DOMCal


44; 2005/11/22; 11:00;   -45; TestDAQ


45; 2005/11/22; 18:00;   -45; LUX


46; 2005/11/22; 20:00;   -45; Soaking / stability 


47; 2005/11/28; 10:30;   -45; Warmup