{"id":398,"date":"2025-07-09T14:35:14","date_gmt":"2025-07-09T14:35:14","guid":{"rendered":"https:\/\/ppc.mit.edu\/t2\/?p=398"},"modified":"2025-11-03T20:18:41","modified_gmt":"2025-11-03T20:18:41","slug":"mit-tier2-report-july-9-2025","status":"publish","type":"post","link":"https:\/\/ppc.mit.edu\/t2\/?p=398","title":{"rendered":"MIT Tier-2 Report – July 9 2025"},"content":{"rendered":"\n

SiteReadiness: 85.7%<\/p>\n\n\n\n

SAM tests: 91.9%<\/p>\n\n\n\n

Over the last week we started to have problems with the worker nodes (WNs). Some WNs loose reliable connectivity to the outside world (ping starts showing packet loss), some go offline, and some need to be rebooted. I am not sure what is exactly the reason behind it – CMS jobs; or us offloading data from a lot of HDFS nodes preparing for servers retirement, the activity that saturates networking capability and loads a lot of WNs.<\/p>\n\n\n\n

\n
\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n<\/figure>\n\n\n\n
\n
\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n<\/figure>\n","protected":false},"excerpt":{"rendered":"

SiteReadiness: 85.7% SAM tests: 91.9% Over the last week we started to have problems with the worker nodes (WNs). Some WNs loose reliable connectivity to the outside world (ping starts showing packet loss), some go offline, and some need to be rebooted. I am not sure what is exactly the reason behind it – CMS … Read more<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[12],"class_list":["post-398","post","type-post","status-publish","format-standard","hentry","category-report","tag-weekly"],"_links":{"self":[{"href":"https:\/\/ppc.mit.edu\/t2\/index.php?rest_route=\/wp\/v2\/posts\/398","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ppc.mit.edu\/t2\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ppc.mit.edu\/t2\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ppc.mit.edu\/t2\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/ppc.mit.edu\/t2\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=398"}],"version-history":[{"count":2,"href":"https:\/\/ppc.mit.edu\/t2\/index.php?rest_route=\/wp\/v2\/posts\/398\/revisions"}],"predecessor-version":[{"id":635,"href":"https:\/\/ppc.mit.edu\/t2\/index.php?rest_route=\/wp\/v2\/posts\/398\/revisions\/635"}],"wp:attachment":[{"href":"https:\/\/ppc.mit.edu\/t2\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=398"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ppc.mit.edu\/t2\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=398"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ppc.mit.edu\/t2\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=398"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}