Weekly

SiteReadiness: 100.0% SAM tests: 99.3% No significant problems over last week. For various reasons we are missing ~3K cores, some are down because of power outage last week, some are in the process of Alma9 installation, and some have problematic Alma9 setup. Additionally, we observe periods with lower than usual CMS jobs pressure.

SiteReadiness: 85.7% SAM tests: 95.7% We had one red day in Site Readiness. I tried to fix problems in CephFS and provoked XRootD outage that lasted several hours. We also had two power outages. The first one was partial on May 31st, as a result we lost ~5K cores for ~18 hours. On June 2nd … Read more

SiteReadiness: 100.0% SAM tests: 100.0% Smooth running over the last week. Nothing outstanding to report.

SiteReadiness: 100.0% SAM tests: 97.6% Normal operations during the last week. On Friday our XRootD was overloaded with requests, not clear what specific CMS activity was causing it. We continue using host certificate with a wildcard.

SiteReadiness: 100.0% SAM tests: 99.3% Normal operations during the last week. Started to use a host certificate with a wildcard; this means that cmssw version 9 and lower will not work when exchanging data with our site.

SiteReadiness: 100.0% SAM tests: 96.2% Normal operations during the last week.

SiteReadiness: 100.0% SAM tests: 99.0% Normal operations during the last week. Planning to test host certificate with a wildcard.

SiteReadiness: 100.0% SAM tests: 98.5% Normal operations during the last week. We were asked to reduce frequency of squid restarts and upgrade them to a newer version.

SiteReadiness: 100.0% SAM tests: 98.5% Significant portion of cores were taken for Tier0 activities. It looks like reading data remotely from CERN like it is done now under-utilizes CPUs and puts pressure on XrooTD to the point that the servers start struggling.

SiteReadiness: 100.0% SAM tests: 97.6% Significant portion of cores were taken for Tier0 production activities. The test is run for now just on our site.