Recovery of front end DAQ bad status following 3am crash of h1lsc0
FRS11528
Dave:
Full details are in the separate alog. It took 90 minutes away from the CDS upgrade time to resolve this. However it was important to have a functioning FEC-DAQ system before continuing with the upgrade
CDS Upgrade Part-II
WP7815
Richard, Fil, Dave:
The remaining task for the CDS upgrade were completed today. The following front ends were upgraded to 8-core V4 computers:
h1lsc0, h1susb123, h1sush2a, h1sush2b, h1sush34, h1sush56
The procedure for each was:
power down computer and remove from rack
remove IRIG-B and IX-Dolphin cards, replace full-height plate with half-height (all except h1lsc0)
install cards into V4 replacement machine
put new computer into rack, connect original network, timing, IX-Dolphin.
Connect new v12 One Stop (OSS) fiber
Replace PS2 KVM cable with USB cable
In CER (Fil) pull OSS to IO Chassis, replace old OSS fiber with new.
Change DHCP to serve new computer's MAC address
Power up IO Chassis and computer, verify cards are seen and models start correctly.
Also h1oaf1 was connected to the Dolphin fabric. A new h1iopoaf1 model was started, but some Dolphin issues were encountered which will be addressed later.
The completes the CDS upgrade, many thanks to Rolf, Keith, Jamie, Richard, Jonathan, Fil, Ed for all the hard work to make it happen.
h1guardian1 reboot
T.J, Jamie and Dave:
We rebooted h1guardian1 after all the frontends had been recovered. Details in T.J.'s alog (summary: all nodes except two started)
BSC2 (Beam Splitter) digital camera
FRS-11520/FRS-11519 (duplicates)
Richard, Fil, Gerardo, Dave:
We replaced the h1cam29 digital camera (BSC2-Beam Splitter) with a new camera. Following a restart of the video server we are now getting an image from BSC2.
h1asc
Jenne, Dave:
A new h1asc model was installed.
h1sqz
WP-7835
Nutsinee, Dave:
A new h1sqz model was installed.
Beckhoff
Daniel, Dave:
Daniel has new code for C1-PLC1 (poll-corr) and C1-PLC4 (sqz). New DAQ INI files were generated.
New GDS channels
WP-7832
Thomas M, Dave:
The requested channels were added to H1BROADCAST.ini, obsolete channels were removed.
DAQ restart
Dave:
DAQ was restarted for all the the changed above which needed it.
Stopped auto DIAG_RESET
Dave:
Now that we do not expect any further front end glitching, I completed disabled the automatic reset of these (which was running as a cronjob on h1fescript0).