cdsfs1 went into read-only mode Friday evening between 18:20 and 19:20. At 17:45 this afternoon I rebooted the machine using the standard recovery procedure. Backups are proceding.

While looking at the system overviews I noticed that h1fw0 is not running. It has been unstable from about 16:45 this afternoon. Unfortunately fw1 is not perfectly stable, it had failed around 3pm and 5pm with short restarts. fw0 cannot run for more than a few minutes without crashing.

The console message on h1ldasgw0 shows many errors of type:

samfs: WARNING: SAM-QFS: ldas-h1-frames: cannot flush pages err=43 ....

I called Greg, he and Dan will investigate further. Sometimes fw0 gets to run for 10 minutes before crashing, so I'll keep both frame writers going to minimize the possibility of complete data loss. Greg will switch LDAS to using h1fw1 as the primary frame source.