Overnight fw0 became unstable again. We have two things to try: [1] offloading NDS QFS-NFS data using the new h1ldasgw2 machine, and [2] upgrading a frame writer's NFS network from 1GE to 10GE.
We just did the item [1]. We restarted the h1ldasgw2 solaris machine and hooked it back up to both QLogic switches. This solaris server sees both file systems (h1-ldas-frames and cds-h1-frames), and exports them as read-only NFS mounts. We reconfigured both h1nds0 and h1nds1 to only NFS mount h1ldasgw2, and set up their /frames symbolic links to both see /cds-h1-frames (i.e. the frames written by h1fw1).
So now on the h1fw0 system, h1ldasgw0 is only serving h1fw0 and not h1nds0, and no one is reading its frames except for LDAS disk-to-disk which is archiving the science frames (remember commissioning frames are archived from h1fw1).