{"id":285,"date":"2025-05-14T13:00:30","date_gmt":"2025-05-14T13:00:30","guid":{"rendered":"https:\/\/ppc.mit.edu\/t2\/?p=285"},"modified":"2025-11-03T20:19:57","modified_gmt":"2025-11-03T20:19:57","slug":"mit-tier2-report-may-14-2025","status":"publish","type":"post","link":"https:\/\/ppc.mit.edu\/t2\/?p=285","title":{"rendered":"MIT Tier-2 Report &#8211; May 14 2025"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">SiteReadiness: 100%<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">SAM tests: 95.4%<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We had smooth operations over the last week. We wiped out previous CephFS deployment and bootstrapped a new cluster last Tuesday. While doing it, SAM tests turned red for several hours while new file system was unavailable; as a result SiteRediness for that day was in red, and our site was briefly put into the waiting room.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Once CephFS was redeployed we started to push data into it. At the moment we have transferred \/store\/himc, \/store\/hidata, and ~70% of \/store\/mc. Also started copying of \/store\/data. At the peak we can push ~400 TB into CephFS. We expect this activity will be completed this weekend. At that moment we will switch our site configuration to mostly use CephFS. However, we plan to rely on old HDFS for \/store\/user,   \/store\/temp, and \/store\/unmerged.<\/p>\n\n\n\n<figure class=\"wp-block-gallery has-nested-images columns-default is-cropped wp-block-gallery-1 is-layout-flex wp-block-gallery-is-layout-flex\">\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"408\" data-id=\"275\" src=\"https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.19.27-AM-1024x408.png\" alt=\"\" class=\"wp-image-275\" srcset=\"https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.19.27-AM-1024x408.png 1024w, https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.19.27-AM-300x120.png 300w, https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.19.27-AM-768x306.png 768w, https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.19.27-AM-1536x612.png 1536w, https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.19.27-AM-2048x817.png 2048w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"420\" data-id=\"277\" src=\"https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.20.36-AM-1024x420.png\" alt=\"\" class=\"wp-image-277\" srcset=\"https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.20.36-AM-1024x420.png 1024w, https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.20.36-AM-300x123.png 300w, https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.20.36-AM-768x315.png 768w, https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.20.36-AM-1536x630.png 1536w, https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.20.36-AM-2048x839.png 2048w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/figure>\n\n\n\n<figure class=\"wp-block-gallery has-nested-images columns-default is-cropped wp-block-gallery-2 is-layout-flex wp-block-gallery-is-layout-flex\">\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"419\" data-id=\"278\" src=\"https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.21.37-AM-1024x419.png\" alt=\"\" class=\"wp-image-278\" srcset=\"https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.21.37-AM-1024x419.png 1024w, https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.21.37-AM-300x123.png 300w, https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.21.37-AM-768x314.png 768w, https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.21.37-AM-1536x629.png 1536w, https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.21.37-AM.png 2001w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"411\" data-id=\"279\" src=\"https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.22.09-AM-1024x411.png\" alt=\"\" class=\"wp-image-279\" srcset=\"https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.22.09-AM-1024x411.png 1024w, https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.22.09-AM-300x120.png 300w, https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.22.09-AM-768x308.png 768w, https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.22.09-AM-1536x617.png 1536w, https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.22.09-AM.png 2018w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/figure>\n\n\n\n<figure class=\"wp-block-gallery has-nested-images columns-default is-cropped wp-block-gallery-3 is-layout-flex wp-block-gallery-is-layout-flex\">\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"341\" data-id=\"282\" src=\"https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.29.43-AM-1024x341.png\" alt=\"\" class=\"wp-image-282\" srcset=\"https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.29.43-AM-1024x341.png 1024w, https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.29.43-AM-300x100.png 300w, https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.29.43-AM-768x256.png 768w, https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.29.43-AM-1536x511.png 1536w, https:\/\/ppc.mit.edu\/t2\/wp-content\/uploads\/2025\/05\/Screen-Shot-2025-05-14-at-8.29.43-AM-2048x681.png 2048w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/figure>\n","protected":false},"excerpt":{"rendered":"<p>SiteReadiness: 100% SAM tests: 95.4% We had smooth operations over the last week. We wiped out previous CephFS deployment and bootstrapped a new cluster last Tuesday. While doing it, SAM tests turned red for several hours while new file system was unavailable; as a result SiteRediness for that day was in red, and our site &#8230; <a title=\"MIT Tier-2 Report &#8211; May 14 2025\" class=\"read-more\" href=\"https:\/\/ppc.mit.edu\/t2\/?p=285\" aria-label=\"Read more about MIT Tier-2 Report &#8211; May 14 2025\">Read more<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[12],"class_list":["post-285","post","type-post","status-publish","format-standard","hentry","category-report","tag-weekly"],"_links":{"self":[{"href":"https:\/\/ppc.mit.edu\/t2\/index.php?rest_route=\/wp\/v2\/posts\/285","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ppc.mit.edu\/t2\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ppc.mit.edu\/t2\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ppc.mit.edu\/t2\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/ppc.mit.edu\/t2\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=285"}],"version-history":[{"count":3,"href":"https:\/\/ppc.mit.edu\/t2\/index.php?rest_route=\/wp\/v2\/posts\/285\/revisions"}],"predecessor-version":[{"id":645,"href":"https:\/\/ppc.mit.edu\/t2\/index.php?rest_route=\/wp\/v2\/posts\/285\/revisions\/645"}],"wp:attachment":[{"href":"https:\/\/ppc.mit.edu\/t2\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=285"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ppc.mit.edu\/t2\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=285"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ppc.mit.edu\/t2\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=285"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}