The iostat looks fine with utilization of 4.3%.
Linux 4.18.0-553.36.1.el8_10.x86_64 (phost) 02/24/2025 _x86_64_ (8 CPU)
r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util Device
0.60 1.81 30.2k 79.5k 0.00 0.11 0.1% 5.8% 1.52 1.32 0.00 50.0k 43.8k 0.30 0.1% nvme0n1
29.55 1.87 5.5M 152.5k 0.00 0.29 0.0% 13.5% 59.60 10.08 1.78 190.1k 81.4k 1.36 4.3% nvme1n1
the logs have the following - please notice the time stamp jumps (***) –
*** 2025-02-24T19:05:57.808706Z D i.q.c.s.a.PageFrameReduceJob reducing [shard=3, id=549197, taskType=0, frameIndex=55, frameCount=131, active=true, cursor=2438011]
*** 2025-02-24T19:05:58.575118Z D i.q.g.e.t.AsyncFilteredRecordCursor collected [shard=3, frameIndex=49, frameCount=131, frameId=549197, active=true, cursor=2438005]
2025-02-24T19:05:58.575159Z D i.q.g.e.t.AsyncFilteredRecordCursor collected [shard=3, frameIndex=50, frameCount=131, frameId=549197, active=true, cursor=2438006]
2025-02-24T19:05:58.575186Z D i.q.c.s.a.PageFrameSequence dispatched [shard=3, id=549197, frameIndex=65, frameCount=131, cursor=2438021]
2025-02-24T19:05:58.575188Z D i.q.c.s.a.PageFrameSequence dispatched [shard=3, id=549197, frameIndex=66, frameCount=131, cursor=2438022]
*** 2025-02-24T19:05:58.575188Z D i.q.c.s.a.PageFrameReduceJob reducing [shard=3, id=549197, taskType=0, frameIndex=56, frameCount=131, active=true, cursor=2438012]
*** 2025-02-24T19:05:59.652755Z D i.q.g.e.t.AsyncFilteredRecordCursor collected [shard=1, frameIndex=83, frameCount=127, frameId=549204, active=true, cursor=9223372036854775807]
2025-02-24T19:05:59.652795Z D i.q.c.s.a.PageFrameSequence reducing locally [shard=1, id=549204, taskType=0, frameIndex=84, frameCount=127, active=true]
2025-02-24T19:05:59.736381Z D i.q.c.s.a.PageFrameReduceJob reducing [shard=3, id=549197, taskType=0, frameIndex=57, frameCount=131, active=true, cursor=2438013]
2025-02-24T19:05:59.948926Z D i.q.c.s.a.PageFrameReduceJob reducing [shard=3, id=549197, taskType=0, frameIndex=58, frameCount=131, active=true, cursor=2438014]
*** 2025-02-24T19:05:59.948941Z D i.q.c.s.a.PageFrameReduceJob reducing [shard=3, id=549197, taskType=0, frameIndex=59, frameCount=131, active=true, cursor=2438015]
*** 2025-02-24T19:06:00.571364Z D i.q.c.s.a.PageFrameReduceJob reducing [shard=3, id=549197, taskType=0, frameIndex=60, frameCount=131, active=true, cursor=2438016]
*** 2025-02-24T19:06:01.770218Z D i.q.g.e.t.AsyncFilteredRecordCursor collected [shard=3, frameIndex=51, frameCount=131, frameId=549197, active=true, cursor=2438007]
2025-02-24T19:06:01.770255Z D i.q.g.e.t.AsyncFilteredRecordCursor collected [shard=3, frameIndex=52, frameCount=131, frameId=549197, active=true, cursor=2438008]
2025-02-24T19:06:01.770256Z D i.q.g.e.t.AsyncFilteredRecordCursor collected [shard=3, frameIndex=53, frameCount=131, frameId=549197, active=true, cursor=2438009]
2025-02-24T19:06:01.770281Z D i.q.g.e.t.AsyncFilteredRecordCursor collected [shard=3, frameIndex=54, frameCount=131, frameId=549197, active=true, cursor=2438010]
2025-02-24T19:06:01.770306Z D i.q.g.e.t.AsyncFilteredRecordCursor collected [shard=3, frameIndex=55, frameCount=131, frameId=549197, active=true, cursor=2438011]
2025-02-24T19:06:01.770341Z D i.q.g.e.t.AsyncFilteredRecordCursor collected [shard=3, frameIndex=56, frameCount=131, frameId=549197, active=true, cursor=2438012]
2025-02-24T19:06:01.770361Z D i.q.c.s.a.PageFrameSequence dispatched [shard=3, id=549197, frameIndex=67, frameCount=131, cursor=2438023]
2025-02-24T19:06:01.770363Z D i.q.c.s.a.PageFrameSequence dispatched [shard=3, id=549197, frameIndex=68, frameCount=131, cursor=2438024]
2025-02-24T19:06:01.770364Z D i.q.c.s.a.PageFrameSequence dispatched [shard=3, id=549197, frameIndex=69, frameCount=131, cursor=2438025]
2025-02-24T19:06:01.770365Z D i.q.c.s.a.PageFrameSequence dispatched [shard=3, id=549197, frameIndex=70, frameCount=131, cursor=2438026]
2025-02-24T19:06:01.770366Z D i.q.c.s.a.PageFrameSequence dispatched [shard=3, id=549197, frameIndex=71, frameCount=131, cursor=2438027]
2025-02-24T19:06:01.770367Z D i.q.c.s.a.PageFrameSequence dispatched [shard=3, id=549197, frameIndex=72, frameCount=131, cursor=2438028]
2025-02-24T19:06:01.770368Z D i.q.c.s.a.PageFrameReduceJob reducing [shard=3, id=549197, taskType=0, frameIndex=61, frameCount=131, active=true, cursor=2438017]
2025-02-24T19:06:02.189180Z D i.q.c.s.a.PageFrameReduceJob reducing [shard=3, id=549197, taskType=0, frameIndex=62, frameCount=131, active=true, cursor=2438018]
**** 2025-02-24T19:06:02.189198Z D i.q.s.DirectLongList resized [old=2048, new=7350552]
**** 2025-02-24T19:06:04.060287Z D i.q.c.s.a.PageFrameReduceJob reducing [shard=3, id=549197, taskType=0, frameIndex=63, frameCount=131, active=true, cursor=2438019]
2025-02-24T19:06:04.060307Z D i.q.s.DirectLongList resized [old=7337216, new=7350552]
2025-02-24T19:06:04.148093Z D i.q.g.e.t.AsyncFilteredRecordCursor collected [shard=1, frameIndex=84, frameCount=127, frameId=549204, active=true, cursor=9223372036854775807]
2025-02-24T19:06:04.148137Z D i.q.c.s.a.PageFrameSequence reducing locally [shard=1, id=549204, taskType=0, frameIndex=85, frameCount=127, active=true]
2025-02-24T19:06:04.148148Z D i.q.g.e.t.AsyncFilteredRecordCursor collected [shard=1, frameIndex=85, frameCount=127, frameId=549204, active=true, cursor=9223372036854775807]
2025-02-24T19:06:04.148150Z D i.q.c.s.a.PageFrameSequence reducing locally [shard=1, id=549204, taskType=0, frameIndex=86, frameCount=127, active=true]
2025-02-24T19:06:04.148155Z D i.q.s.DirectLongList resized [old=7290416, new=7298224]
2025-02-24T19:06:04.503145Z D i.q.c.s.a.PageFrameReduceJob reducing [shard=3, id=549197, taskType=0, frameIndex=64, frameCount=131, active=true, cursor=2438020]
2025-02-24T19:06:04.503163Z D i.q.c.s.a.PageFrameReduceJob reducing [shard=3, id=549197, taskType=0, frameIndex=65, frameCount=131, active=true, cursor=2438021]
2025-02-24T19:06:05.646815Z D i.q.g.e.t.AsyncFilteredRecordCursor collected [shard=3, frameIndex=57, frameCount=131, frameId=549197, active=true, cursor=2438013]
2025-02-24T19:06:05.646856Z D i.q.g.e.t.AsyncFilteredRecordCursor collected [shard=3, frameIndex=58, frameCount=131, frameId=549197, active=true, cursor=2438014]
2025-02-24T19:06:05.646857Z D i.q.g.e.t.AsyncFilteredRecordCursor collected [shard=3, frameIndex=59, frameCount=131, frameId=549197, active=true, cursor=2438015]
2025-02-24T19:06:05.646894Z D i.q.g.e.t.AsyncFilteredRecordCursor collected [shard=3, frameIndex=60, frameCount=131, frameId=549197, active=true, cursor=2438016]
2025-02-24T19:06:05.646923Z D i.q.g.e.t.AsyncFilteredRecordCursor collected [shard=3, frameIndex=61, frameCount=131, frameId=549197, active=true, cursor=2438017]
2025-02-24T19:06:05.646945Z D i.q.c.s.a.PageFrameSequence dispatched [shard=3, id=549197, frameIndex=73, frameCount=131, cursor=2438029]
2025-02-24T19:06:05.646947Z D i.q.c.s.a.PageFrameSequence dispatched [shard=3, id=549197, frameIndex=74, frameCount=131, cursor=2438030]
2025-02-24T19:06:05.646948Z D i.q.c.s.a.PageFrameSequence dispatched [shard=3, id=549197, frameIndex=75, frameCount=131, cursor=2438031]
2025-02-24T19:06:05.646949Z D i.q.c.s.a.PageFrameSequence dispatched [shard=3, id=549197, frameIndex=76, frameCount=131, cursor=2438032]
2025-02-24T19:06:05.646950Z D i.q.c.s.a.PageFrameSequence dispatched [shard=3, id=549197, frameIndex=77, frameCount=131, cursor=2438033]
2025-02-24T19:06:05.646951Z D i.q.c.s.a.PageFrameReduceJob reducing [shard=3, id=549197, taskType=0, frameIndex=66, frameCount=131, active=true, cursor=2438022]
2025-02-24T19:06:06.844159Z D i.q.c.s.a.PageFrameReduceJob reducing [shard=3, id=549197, taskType=0, frameIndex=67, frameCount=131, active=true, cursor=2438023]
2025-02-24T19:06:06.883914Z D i.q.c.s.a.PageFrameReduceJob reducing [shard=3, id=549197, taskType=0, frameIndex=68, frameCount=131, active=true, cursor=2438024]
2025-02-24T19:06:08.018270Z D i.q.g.e.t.AsyncFilteredRecordCursor collected [shard=1, frameIndex=86, frameCount=127, frameId=549204, active=true, cursor=9223372036854775807]
2025-02-24T19:06:08.018312Z D i.q.c.s.a.PageFrameSequence reducing locally [shard=1, id=549204, taskType=0, frameIndex=87, frameCount=127, active=true]
2025-02-24T19:06:08.820241Z D i.q.g.e.t.AsyncFilteredRecordCursor collected [shard=3, frameIndex=62, frameCount=131, frameId=549197, active=true, cursor=2438018]
2025-02-24T19:06:08.820281Z D i.q.c.s.a.PageFrameSequence dispatched [shard=3, id=549197, frameIndex=78, frameCount=131, cursor=2438034]
2025-02-24T19:06:08.820283Z D i.q.c.s.a.PageFrameReduceJob reducing [shard=3, id=549197, taskType=0, frameIndex=69, frameCount=131, active=true, cursor=2438025]
2025-02-24T19:06:09.175791Z D i.q.c.s.a.PageFrameReduceJob reducing [shard=3, id=549197, taskType=0, frameIndex=70, frameCount=131, active=true, cursor=2438026]
2025-02-24T19:06:09.175807Z D i.q.c.s.a.PageFrameReduceJob reducing [shard=3, id=549197, taskType=0, frameIndex=71, frameCount=131, active=true, cursor=2438027]
2025-02-24T19:06:09.175813Z D i.q.s.DirectLongList resized [old=7360112, new=7365304]
2025-02-24T19:06:09.600070Z D i.q.c.s.a.PageFrameReduceJob reducing [shard=3, id=549197, taskType=0, frameIndex=72, frameCount=131, active=true, cursor=2438028]
2025-02-24T19:06:10.514732Z D i.q.c.s.a.PageFrameReduceJob reducing [shard=3, id=549197, taskType=0, frameIndex=73, frameCount=131, active=true, cursor=2438029]
2025-02-24T19:06:11.295444Z D i.q.c.s.a.PageFrameReduceJob reducing [shard=3, id=549197, taskType=0, frameIndex=74, frameCount=131, active=true, cursor=2438030]