Response status code does not indicate success: NotFound (404); Substatus: 0; ActivityId: 15b68c14-b503-4f15-a5a4-12d04ec2fcfb; Reason: (Message: {"Errors":["Resource Not Found. Learn more: https://aka.ms/cosmosdb-tsg-not-found"]}
ActivityId: 15b68c14-b503-4f15-a5a4-12d04ec2fcfb, Request URI: /apps/e60b5e22-1fb5-448f-84c8-62e3df8115fc/services/a2b11ff3-71b1-4800-b1d2-fdf1f60e72ba/partitions/8e9a2605-6a6a-43a6-933b-df8468bbe2dc/replicas/133888516527073309s, RequestStats:
RequestStartTime: 2025-05-14T05:20:25.4398841Z, RequestEndTime: 2025-05-14T05:20:25.4413936Z, Number of regions attempted:1
{"systemHistory":[{"dateUtc":"2025-05-14T05:19:34.4823188Z","cpu":0.269,"memory":436387028.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.071,"availableThreads":32765,"minThreads":40,"maxThreads":32767},"numberOfOpenTcpConnection":127},{"dateUtc":"2025-05-14T05:19:44.4923494Z","cpu":0.336,"memory":436389176.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.0536,"availableThreads":32765,"minThreads":40,"maxThreads":32767},"numberOfOpenTcpConnection":127},{"dateUtc":"2025-05-14T05:19:54.5023879Z","cpu":0.312,"memory":436376428.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.0386,"availableThreads":32764,"minThreads":40,"maxThreads":32767},"numberOfOpenTcpConnection":130},{"dateUtc":"2025-05-14T05:20:04.5123049Z","cpu":0.332,"memory":436391684.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.0773,"availableThreads":32765,"minThreads":40,"maxThreads":32767},"numberOfOpenTcpConnection":130},{"dateUtc":"2025-05-14T05:20:14.5223211Z","cpu":0.527,"memory":436375968.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.1455,"availableThreads":32765,"minThreads":40,"maxThreads":32767},"numberOfOpenTcpConnection":131},{"dateUtc":"2025-05-14T05:20:24.5323625Z","cpu":0.347,"memory":436376400.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.0877,"availableThreads":32765,"minThreads":40,"maxThreads":32767},"numberOfOpenTcpConnection":130}]}
RequestStart: 2025-05-14T05:20:25.4400121Z; ResponseTime: 2025-05-14T05:20:25.4413859Z; StoreResult: StorePhysicalAddress: rntbd://10.0.1.6:11300/apps/e60b5e22-1fb5-448f-84c8-62e3df8115fc/services/a2b11ff3-71b1-4800-b1d2-fdf1f60e72ba/partitions/8e9a2605-6a6a-43a6-933b-df8468bbe2dc/replicas/133888516527073309s, LSN: 91, GlobalCommittedLsn: 91, PartitionKeyRangeId: , IsValid: True, StatusCode: 404, SubStatusCode: 0, RequestCharge: 1, ItemLSN: -1, SessionToken: -1#91, UsingLocalLSN: False, TransportException: null, BELatencyMs: 0.338, ActivityId: 15b68c14-b503-4f15-a5a4-12d04ec2fcfb, RetryAfterInMs: , ReplicaHealthStatuses: [(port: 11000 | status: Unknown | lkt: 5/12/2025 8:54:10 PM),(port: 11300 | status: Unknown | lkt: 5/12/2025 8:54:10 PM),(port: 11300 | status: Unknown | lkt: 5/12/2025 8:54:10 PM),(port: 11300 | status: Unknown | lkt: 5/12/2025 8:54:10 PM)], TransportRequestTimeline: {"requestTimeline":[{"event": "Created", "startTimeUtc": "2025-05-14T05:20:25.4399250Z", "durationInMs": 0.0213},{"event": "ChannelAcquisitionStarted", "startTimeUtc": "2025-05-14T05:20:25.4399463Z", "durationInMs": 0.0019},{"event": "Pipelined", "startTimeUtc": "2025-05-14T05:20:25.4399482Z", "durationInMs": 0.0541},{"event": "Transit Time", "startTimeUtc": "2025-05-14T05:20:25.4400023Z", "durationInMs": 0.8393},{"event": "Received", "startTimeUtc": "2025-05-14T05:20:25.4408416Z", "durationInMs": 0.1415},{"event": "Completed", "startTimeUtc": "2025-05-14T05:20:25.4409831Z", "durationInMs": 0}],"serviceEndpointStats":{"inflightRequests":1,"openConnections":1},"connectionStats":{"waitforConnectionInit":"False","callsPendingReceive":0,"lastSendAttempt":"2025-05-14T05:20:25.4325487Z","lastSend":"2025-05-14T05:20:25.4325762Z","lastReceive":"2025-05-14T05:20:25.4339338Z"},"requestSizeInBytes":560,"responseMetadataSizeInBytes":135,"responseBodySizeInBytes":84};
ResourceType: Collection, OperationType: Read
RequestStart: 2025-05-14T05:20:25.4400932Z; ResponseTime: 2025-05-14T05:20:25.4413936Z; StoreResult: StorePhysicalAddress: rntbd://10.0.1.9:11300/apps/e60b5e22-1fb5-448f-84c8-62e3df8115fc/services/a2b11ff3-71b1-4800-b1d2-fdf1f60e72ba/partitions/8e9a2605-6a6a-43a6-933b-df8468bbe2dc/replicas/133827142573201340s, LSN: 91, GlobalCommittedLsn: 91, PartitionKeyRangeId: , IsValid: True, StatusCode: 404, SubStatusCode: 0, RequestCharge: 1, ItemLSN: -1, SessionToken: -1#91, UsingLocalLSN: False, TransportException: null, BELatencyMs: 0.266, ActivityId: 15b68c14-b503-4f15-a5a4-12d04ec2fcfb, RetryAfterInMs: , ReplicaHealthStatuses: [(port: 11000 | status: Unknown | lkt: 5/12/2025 8:54:10 PM),(port: 11300 | status: Unknown | lkt: 5/12/2025 8:54:10 PM),(port: 11300 | status: Unknown | lkt: 5/12/2025 8:54:10 PM),(port: 11300 | status: Unknown | lkt: 5/12/2025 8:54:10 PM)], TransportRequestTimeline: {"requestTimeline":[{"event": "Created", "startTimeUtc": "2025-05-14T05:20:25.4400167Z", "durationInMs": 0.0124},{"event": "ChannelAcquisitionStarted", "startTimeUtc": "2025-05-14T05:20:25.4400291Z", "durationInMs": 0.0009},{"event": "Pipelined", "startTimeUtc": "2025-05-14T05:20:25.4400300Z", "durationInMs": 0.0402},{"event": "Transit Time", "startTimeUtc": "2025-05-14T05:20:25.4400702Z", "durationInMs": 0.8612},{"event": "Received", "startTimeUtc": "2025-05-14T05:20:25.4409314Z", "durationInMs": 0.1542},{"event": "Completed", "startTimeUtc": "2025-05-14T05:20:25.4410856Z", "durationInMs": 0}],"serviceEndpointStats":{"inflightRequests":1,"openConnections":1},"connectionStats":{"waitforConnectionInit":"False","callsPendingReceive":0,"lastSendAttempt":"2025-05-14T05:20:25.4294440Z","lastSend":"2025-05-14T05:20:25.4294713Z","lastReceive":"2025-05-14T05:20:25.4307439Z"},"requestSizeInBytes":560,"responseMetadataSizeInBytes":135,"responseBodySizeInBytes":84};
ResourceType: Collection, OperationType: Read
, SDK: Microsoft.Azure.Documents.Common/2.14.0, Microsoft.Azure.Cosmos.Tracing.TraceData.ClientSideRequestStatisticsTraceDatum, Linux/12 cosmos-netstandard-sdk/3.38.0);