Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
4.563726667s
FAIL (2025-07-29 12:59:50 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.563832182s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
120.671486ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 12:59:48 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 120.706049ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [.......................................................X.XX.] duration:
43.594601732s
FAIL (2025-07-29 12:59:45 UTC)
======ERROR======
uplink: context deadline exceeded
======LOGS======
]: Got next segment. Inline: false
Jul 29 12:58:01.067631265 (20h12m47.888582309s) [upload=19438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 12:58:01.067638616 (20h12m47.888589678s) [upload=19438]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 12:58:01.108360560 (20h12m47.929311626s) [seg_pos={0 0}, upload=19438]: Begin upload segment...
Jul 29 12:58:01.108434877 (20h12m47.929385942s) [seg_pos={0 0}, upload=19438]: Done begin upload segment.
Jul 29 12:58:01.108485985 (20h12m47.929437164s) [noise=true , address=104.36.82.13:4218 , piece_id=6IEJUUFTV4VLL5Y524APFK6IEXVBUYXGOMT76X4YH65WK6RAQWOA, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.109180766 (20h12m47.93013183s) [noise=true , address=104.36.82.12:4158 , piece_id=DHPGGM44LHOSCI2SYNE5VFWFVAZDGOMD6FSHOUDGKJB32X6TR4IA, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.109593695 (20h12m47.930544789s) [noise=true , address=104.36.82.14:4245 , piece_id=644PPPCL437WEHXHYCXECCRR4FETOY5ZLFIK5YURKZBZIJ65KUTA, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.109991546 (20h12m47.930942613s) [noise=true , address=104.36.82.21:4504 , piece_id=FVW7GW4BDDJKXGP722XE2Z4QEGNAJUVSC4RYWZUPHQLXAWECUOZA, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.110477127 (20h12m47.931428197s) [noise=true , address=104.36.82.55:4223 , piece_id=TXNFLXUKYIQVOPBUVCCQPGCMDG526DTPLMWIH7D42MUL6E4AFNUQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.110878656 (20h12m47.931829726s) [noise=true , address=104.36.82.11:4140 , piece_id=TM4AGHUWT6BUJK2WNKIL3VVDBKIPIQVCJXNGM64PC7RQGMOHEJ5A, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.111297836 (20h12m47.932248898s) [noise=true , address=104.36.82.5:4855 , piece_id=ZGVSGGO5COBXYE344VOMLX3LPARY2JACW4PM2WKKO7C53QIEL6ZQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.111640483 (20h12m47.932591549s) [noise=true , address=104.36.82.10:4090 , piece_id=UTZZUICUGGY4UJDPKMCECJAEUZPEMIY7TZMOLJQUJV3NKXOIO3OA, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.112060105 (20h12m47.933011171s) [noise=true , address=104.36.82.51:4061 , piece_id=OGZEFHUSKEVGZKH7S67UXSCWF6VGF7WIZI33P6DZC6ZW3TPPKO7Q, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.112413667 (20h12m47.933364735s) [noise=true , address=104.36.82.15:4292 , piece_id=NWYV5IFHAS2BNNXQZLIXIML6UVF7KD6WU3VTJ24HYC6GIXWQY4MA, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.112763523 (20h12m47.933714589s) [noise=true , address=104.36.82.52:4098 , piece_id=VLOKEQC7RQ6VYIT4TSES3F4GQJKCEZIJTTSSM3URPANWMY66R3ZQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.113103407 (20h12m47.934054473s) [noise=true , address=104.36.82.42:4797 , piece_id=BT4ULXH44YJKTV7PPT43OGNPH36DEVUHDBXBTSIS7VGSGTRJKKYQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.113472834 (20h12m47.934423894s) [noise=true , address=104.36.82.47:4531 , piece_id=PM4KZEASQP2PHGMLB7RDEJ6W53EFCBHJ5EBJTMVTZAI2KEMR5XXQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.113833742 (20h12m47.934784804s) [noise=true , address=104.36.82.54:4178 , piece_id=LNRSUVHXT2OZWG2SG65AOE34LKRBEFVSQP576NYV4G7OTI2FBE3Q, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.114185899 (20h12m47.935136964s) [noise=true , address=104.36.82.43:4844 , piece_id=6EVSLFKGL7K3QV6VZ52KIFXFSZA7PFQL2C2GQYL5YV2TQI45IAMQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.114563217 (20h12m47.935514281s) [noise=true , address=104.36.82.4:4831 , piece_id=UQNKKSPZ24AIATEQWNMSDO6Q5JVM734FLO3MDTG3GCB5XB5FSYPQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.114924389 (20h12m47.935875455s) [noise=true , address=104.36.82.46:4495 , piece_id=RZQECGTO6ITXL65JRUMFD2FC262ICQGHFREK2CMNZ3GBIZI3N2CQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.115342212 (20h12m47.936293277s) [noise=true , address=104.36.82.56:4242 , piece_id=DHO2PL36INEQOYSYKGYHGCTGYJR7V7TBO5TRK5D6W5OE7FIBJ7KQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.220083974 (20h12m48.041035034s) [upload=19438]: Next returned nil segment
Jul 29 12:58:01.220114559 (20h12m48.041065865s) [upload=19438]: Waiting for error group managing segments...
Jul 29 12:58:01.227401017 (20h12m48.048352076s) [noise=true , address=104.36.82.54:4178 , piece_id=LNRSUVHXT2OZWG2SG65AOE34LKRBEFVSQP576NYV4G7OTI2FBE3Q, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:01.228063673 (20h12m48.049014733s) [noise=true , address=104.36.82.56:4242 , piece_id=DHO2PL36INEQOYSYKGYHGCTGYJR7V7TBO5TRK5D6W5OE7FIBJ7KQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:01.230715332 (20h12m48.051666391s) [noise=true , address=104.36.82.4:4831 , piece_id=UQNKKSPZ24AIATEQWNMSDO6Q5JVM734FLO3MDTG3GCB5XB5FSYPQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:01.231360975 (20h12m48.052312039s) [noise=true , address=104.36.82.14:4245 , piece_id=644PPPCL437WEHXHYCXECCRR4FETOY5ZLFIK5YURKZBZIJ65KUTA, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:01.233993105 (20h12m48.054944164s) [noise=true , address=104.36.82.12:4158 , piece_id=DHPGGM44LHOSCI2SYNE5VFWFVAZDGOMD6FSHOUDGKJB32X6TR4IA, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:01.241297750 (20h12m48.0622488s) [noise=true , address=104.36.82.52:4098 , piece_id=VLOKEQC7RQ6VYIT4TSES3F4GQJKCEZIJTTSSM3URPANWMY66R3ZQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:01.376716761 (20h12m48.197667813s) [noise=true , address=104.36.82.43:4844 , piece_id=6EVSLFKGL7K3QV6VZ52KIFXFSZA7PFQL2C2GQYL5YV2TQI45IAMQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:02.335253199 (20h12m49.156204243s) [noise=true , address=104.36.82.55:4223 , piece_id=TXNFLXUKYIQVOPBUVCCQPGCMDG526DTPLMWIH7D42MUL6E4AFNUQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:03.043981725 (20h12m49.864932787s) [noise=true , address=104.36.82.47:4531 , piece_id=PM4KZEASQP2PHGMLB7RDEJ6W53EFCBHJ5EBJTMVTZAI2KEMR5XXQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:16.529700154 (20h13m3.350651197s) [noise=true , address=104.36.82.5:4855 , piece_id=ZGVSGGO5COBXYE344VOMLX3LPARY2JACW4PM2WKKO7C53QIEL6ZQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:24.897864107 (20h13m11.718815157s) [noise=true , address=104.36.82.51:4061 , piece_id=OGZEFHUSKEVGZKH7S67UXSCWF6VGF7WIZI33P6DZC6ZW3TPPKO7Q, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:28.624160601 (20h13m15.445111653s) [noise=true , address=104.36.82.21:4504 , piece_id=FVW7GW4BDDJKXGP722XE2Z4QEGNAJUVSC4RYWZUPHQLXAWECUOZA, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:30.701079139 (20h13m17.522030188s) [noise=true , address=104.36.82.42:4797 , piece_id=BT4ULXH44YJKTV7PPT43OGNPH36DEVUHDBXBTSIS7VGSGTRJKKYQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:37.335400027 (20h13m24.156351085s) [noise=true , address=104.36.82.11:4140 , piece_id=TM4AGHUWT6BUJK2WNKIL3VVDBKIPIQVCJXNGM64PC7RQGMOHEJ5A, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:37.335427046 (20h13m24.156378105s) [seg_pos={0 0}, upload=19438]: Segment reached optimal threshold of 14 pieces.
Jul 29 12:58:37.336491848 (20h13m24.157442906s) [noise=true , address=104.36.82.15:4292 , piece_id=NWYV5IFHAS2BNNXQZLIXIML6UVF7KD6WU3VTJ24HYC6GIXWQY4MA, seg_pos={0 0}, upload=19438]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UpWmMhEmk5veKZvzsQ3MCxCMnfEKtFgCugBTsYfy9Ejm7G4xD): protocol: rpc: dial tcp 104.36.82.15:4292: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 12:58:37.336583451 (20h13m24.157534508s) [noise=true , address=104.36.82.13:4218 , piece_id=6IEJUUFTV4VLL5Y524APFK6IEXVBUYXGOMT76X4YH65WK6RAQWOA, seg_pos={0 0}, upload=19438]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mbzxg1BjmbXeHxGgheZmQoN91k8NgaAUUASPkJe3fEmS4eEkc): protocol: rpc: dial tcp 104.36.82.13:4218: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 12:58:37.336636556 (20h13m24.157587613s) [noise=true , address=104.36.82.10:4090 , piece_id=UTZZUICUGGY4UJDPKMCECJAEUZPEMIY7TZMOLJQUJV3NKXOIO3OA, seg_pos={0 0}, upload=19438]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qSkJk9HUyQon3UP1AA8mRcqJbNdkKJh6cEUZoHLGNniqDvNqB): protocol: rpc: dial tcp 104.36.82.10:4090: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 12:58:37.336688139 (20h13m24.157639196s) [noise=true , address=104.36.82.46:4495 , piece_id=RZQECGTO6ITXL65JRUMFD2FC262ICQGHFREK2CMNZ3GBIZI3N2CQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YpHarCJ3ouMGTs59udhU7az9h68ELEHTa2aTAax2chR2Gux1x): protocol: write tcp 159.223.143.39:58718->104.36.82.46:4495: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 12:58:37.336699045 (20h13m24.157650088s) [seg_pos={0 0}, upload=19438]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 12:58:37.336775276 (20h13m24.157726332s) [upload=19438]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 12:58:37.336779211 (20h13m24.157730254s) [upload=19438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 12:58:37.397080471 (20h13m24.218031536s) [upload=19438]: Done uploading segments...
Jul 29 12:58:37.397103349 (20h13m24.218054409s) [upload=19438]: Upload finished. err: <nil>
Duration: 43.594642862s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
9 out of 60 is failed (threshold=3) [.............................................XXXX......XXXXX] duration:
30.037997956s
FAIL (2025-07-29 12:59:37 UTC)
orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 30.038022603s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
235.016304ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 12:59:25 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 235.04799ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
4.526636349s
FAIL (2025-07-29 12:59:22 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.526678494s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
102.417927ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 12:59:06 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 102.448997ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [........................................................X.XX] duration:
1m0.002110959s
FAIL (2025-07-29 12:59:01 UTC)
======ERROR======
uplink: context deadline exceeded
======LOGS======
]: Got next segment. Inline: false
Jul 29 12:58:01.067631265 (20h12m47.888582309s) [upload=19438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 12:58:01.067638616 (20h12m47.888589678s) [upload=19438]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 12:58:01.108360560 (20h12m47.929311626s) [seg_pos={0 0}, upload=19438]: Begin upload segment...
Jul 29 12:58:01.108434877 (20h12m47.929385942s) [seg_pos={0 0}, upload=19438]: Done begin upload segment.
Jul 29 12:58:01.108485985 (20h12m47.929437164s) [noise=true , address=104.36.82.13:4218 , piece_id=6IEJUUFTV4VLL5Y524APFK6IEXVBUYXGOMT76X4YH65WK6RAQWOA, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.109180766 (20h12m47.93013183s) [noise=true , address=104.36.82.12:4158 , piece_id=DHPGGM44LHOSCI2SYNE5VFWFVAZDGOMD6FSHOUDGKJB32X6TR4IA, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.109593695 (20h12m47.930544789s) [noise=true , address=104.36.82.14:4245 , piece_id=644PPPCL437WEHXHYCXECCRR4FETOY5ZLFIK5YURKZBZIJ65KUTA, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.109991546 (20h12m47.930942613s) [noise=true , address=104.36.82.21:4504 , piece_id=FVW7GW4BDDJKXGP722XE2Z4QEGNAJUVSC4RYWZUPHQLXAWECUOZA, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.110477127 (20h12m47.931428197s) [noise=true , address=104.36.82.55:4223 , piece_id=TXNFLXUKYIQVOPBUVCCQPGCMDG526DTPLMWIH7D42MUL6E4AFNUQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.110878656 (20h12m47.931829726s) [noise=true , address=104.36.82.11:4140 , piece_id=TM4AGHUWT6BUJK2WNKIL3VVDBKIPIQVCJXNGM64PC7RQGMOHEJ5A, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.111297836 (20h12m47.932248898s) [noise=true , address=104.36.82.5:4855 , piece_id=ZGVSGGO5COBXYE344VOMLX3LPARY2JACW4PM2WKKO7C53QIEL6ZQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.111640483 (20h12m47.932591549s) [noise=true , address=104.36.82.10:4090 , piece_id=UTZZUICUGGY4UJDPKMCECJAEUZPEMIY7TZMOLJQUJV3NKXOIO3OA, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.112060105 (20h12m47.933011171s) [noise=true , address=104.36.82.51:4061 , piece_id=OGZEFHUSKEVGZKH7S67UXSCWF6VGF7WIZI33P6DZC6ZW3TPPKO7Q, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.112413667 (20h12m47.933364735s) [noise=true , address=104.36.82.15:4292 , piece_id=NWYV5IFHAS2BNNXQZLIXIML6UVF7KD6WU3VTJ24HYC6GIXWQY4MA, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.112763523 (20h12m47.933714589s) [noise=true , address=104.36.82.52:4098 , piece_id=VLOKEQC7RQ6VYIT4TSES3F4GQJKCEZIJTTSSM3URPANWMY66R3ZQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.113103407 (20h12m47.934054473s) [noise=true , address=104.36.82.42:4797 , piece_id=BT4ULXH44YJKTV7PPT43OGNPH36DEVUHDBXBTSIS7VGSGTRJKKYQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.113472834 (20h12m47.934423894s) [noise=true , address=104.36.82.47:4531 , piece_id=PM4KZEASQP2PHGMLB7RDEJ6W53EFCBHJ5EBJTMVTZAI2KEMR5XXQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.113833742 (20h12m47.934784804s) [noise=true , address=104.36.82.54:4178 , piece_id=LNRSUVHXT2OZWG2SG65AOE34LKRBEFVSQP576NYV4G7OTI2FBE3Q, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.114185899 (20h12m47.935136964s) [noise=true , address=104.36.82.43:4844 , piece_id=6EVSLFKGL7K3QV6VZ52KIFXFSZA7PFQL2C2GQYL5YV2TQI45IAMQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.114563217 (20h12m47.935514281s) [noise=true , address=104.36.82.4:4831 , piece_id=UQNKKSPZ24AIATEQWNMSDO6Q5JVM734FLO3MDTG3GCB5XB5FSYPQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.114924389 (20h12m47.935875455s) [noise=true , address=104.36.82.46:4495 , piece_id=RZQECGTO6ITXL65JRUMFD2FC262ICQGHFREK2CMNZ3GBIZI3N2CQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.115342212 (20h12m47.936293277s) [noise=true , address=104.36.82.56:4242 , piece_id=DHO2PL36INEQOYSYKGYHGCTGYJR7V7TBO5TRK5D6W5OE7FIBJ7KQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.220083974 (20h12m48.041035034s) [upload=19438]: Next returned nil segment
Jul 29 12:58:01.220114559 (20h12m48.041065865s) [upload=19438]: Waiting for error group managing segments...
Jul 29 12:58:01.227401017 (20h12m48.048352076s) [noise=true , address=104.36.82.54:4178 , piece_id=LNRSUVHXT2OZWG2SG65AOE34LKRBEFVSQP576NYV4G7OTI2FBE3Q, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:01.228063673 (20h12m48.049014733s) [noise=true , address=104.36.82.56:4242 , piece_id=DHO2PL36INEQOYSYKGYHGCTGYJR7V7TBO5TRK5D6W5OE7FIBJ7KQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:01.230715332 (20h12m48.051666391s) [noise=true , address=104.36.82.4:4831 , piece_id=UQNKKSPZ24AIATEQWNMSDO6Q5JVM734FLO3MDTG3GCB5XB5FSYPQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:01.231360975 (20h12m48.052312039s) [noise=true , address=104.36.82.14:4245 , piece_id=644PPPCL437WEHXHYCXECCRR4FETOY5ZLFIK5YURKZBZIJ65KUTA, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:01.233993105 (20h12m48.054944164s) [noise=true , address=104.36.82.12:4158 , piece_id=DHPGGM44LHOSCI2SYNE5VFWFVAZDGOMD6FSHOUDGKJB32X6TR4IA, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:01.241297750 (20h12m48.0622488s) [noise=true , address=104.36.82.52:4098 , piece_id=VLOKEQC7RQ6VYIT4TSES3F4GQJKCEZIJTTSSM3URPANWMY66R3ZQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:01.376716761 (20h12m48.197667813s) [noise=true , address=104.36.82.43:4844 , piece_id=6EVSLFKGL7K3QV6VZ52KIFXFSZA7PFQL2C2GQYL5YV2TQI45IAMQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:02.335253199 (20h12m49.156204243s) [noise=true , address=104.36.82.55:4223 , piece_id=TXNFLXUKYIQVOPBUVCCQPGCMDG526DTPLMWIH7D42MUL6E4AFNUQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:03.043981725 (20h12m49.864932787s) [noise=true , address=104.36.82.47:4531 , piece_id=PM4KZEASQP2PHGMLB7RDEJ6W53EFCBHJ5EBJTMVTZAI2KEMR5XXQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:16.529700154 (20h13m3.350651197s) [noise=true , address=104.36.82.5:4855 , piece_id=ZGVSGGO5COBXYE344VOMLX3LPARY2JACW4PM2WKKO7C53QIEL6ZQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:24.897864107 (20h13m11.718815157s) [noise=true , address=104.36.82.51:4061 , piece_id=OGZEFHUSKEVGZKH7S67UXSCWF6VGF7WIZI33P6DZC6ZW3TPPKO7Q, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:28.624160601 (20h13m15.445111653s) [noise=true , address=104.36.82.21:4504 , piece_id=FVW7GW4BDDJKXGP722XE2Z4QEGNAJUVSC4RYWZUPHQLXAWECUOZA, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:30.701079139 (20h13m17.522030188s) [noise=true , address=104.36.82.42:4797 , piece_id=BT4ULXH44YJKTV7PPT43OGNPH36DEVUHDBXBTSIS7VGSGTRJKKYQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:37.335400027 (20h13m24.156351085s) [noise=true , address=104.36.82.11:4140 , piece_id=TM4AGHUWT6BUJK2WNKIL3VVDBKIPIQVCJXNGM64PC7RQGMOHEJ5A, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:37.335427046 (20h13m24.156378105s) [seg_pos={0 0}, upload=19438]: Segment reached optimal threshold of 14 pieces.
Jul 29 12:58:37.336491848 (20h13m24.157442906s) [noise=true , address=104.36.82.15:4292 , piece_id=NWYV5IFHAS2BNNXQZLIXIML6UVF7KD6WU3VTJ24HYC6GIXWQY4MA, seg_pos={0 0}, upload=19438]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UpWmMhEmk5veKZvzsQ3MCxCMnfEKtFgCugBTsYfy9Ejm7G4xD): protocol: rpc: dial tcp 104.36.82.15:4292: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 12:58:37.336583451 (20h13m24.157534508s) [noise=true , address=104.36.82.13:4218 , piece_id=6IEJUUFTV4VLL5Y524APFK6IEXVBUYXGOMT76X4YH65WK6RAQWOA, seg_pos={0 0}, upload=19438]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mbzxg1BjmbXeHxGgheZmQoN91k8NgaAUUASPkJe3fEmS4eEkc): protocol: rpc: dial tcp 104.36.82.13:4218: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 12:58:37.336636556 (20h13m24.157587613s) [noise=true , address=104.36.82.10:4090 , piece_id=UTZZUICUGGY4UJDPKMCECJAEUZPEMIY7TZMOLJQUJV3NKXOIO3OA, seg_pos={0 0}, upload=19438]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qSkJk9HUyQon3UP1AA8mRcqJbNdkKJh6cEUZoHLGNniqDvNqB): protocol: rpc: dial tcp 104.36.82.10:4090: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 12:58:37.336688139 (20h13m24.157639196s) [noise=true , address=104.36.82.46:4495 , piece_id=RZQECGTO6ITXL65JRUMFD2FC262ICQGHFREK2CMNZ3GBIZI3N2CQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YpHarCJ3ouMGTs59udhU7az9h68ELEHTa2aTAax2chR2Gux1x): protocol: write tcp 159.223.143.39:58718->104.36.82.46:4495: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 12:58:37.336699045 (20h13m24.157650088s) [seg_pos={0 0}, upload=19438]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 12:58:37.336775276 (20h13m24.157726332s) [upload=19438]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 12:58:37.336779211 (20h13m24.157730254s) [upload=19438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 12:58:37.397080471 (20h13m24.218031536s) [upload=19438]: Done uploading segments...
Jul 29 12:58:37.397103349 (20h13m24.218054409s) [upload=19438]: Upload finished. err: <nil>
Duration: 1m0.002130603s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
4.499427378s
FAIL (2025-07-29 12:58:54 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.499454166s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
241.348626ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 12:58:52 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 241.381218ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [..............................................XXXX......XXXX] duration:
30.043835942s
FAIL (2025-07-29 12:58:51 UTC)
orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 30.043866752s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
4.663535076s
FAIL (2025-07-29 12:58:38 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.663564383s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
100.160098ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 12:58:14 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 100.191837ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
670.185895ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 12:58:12 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 670.220187ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.........................................................X.X] duration:
1m0.004198766s
FAIL (2025-07-29 12:58:00 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
=19421]: Uploading segments...
Jul 29 12:57:01.018774744 (20h11m47.83972582s) [upload=19421]: Got next segment. Inline: false
Jul 29 12:57:01.018915250 (20h11m47.839866308s) [upload=19421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 12:57:01.018924311 (20h11m47.839875372s) [upload=19421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 12:57:01.132108324 (20h11m47.953059389s) [seg_pos={0 0}, upload=19421]: Begin upload segment...
Jul 29 12:57:01.132176672 (20h11m47.953127747s) [seg_pos={0 0}, upload=19421]: Done begin upload segment.
Jul 29 12:57:01.132208388 (20h11m47.953159452s) [noise=true , address=104.36.82.10:4097 , piece_id=NJTPMEPKEB4FS6WFSZ7B7DEWJREFU6Z4X4BOV5V54NB7GO57JLXQ, seg_pos={0 0}, upload=19421]: Uploading piece...
Jul 29 12:57:01.132243259 (20h11m47.953194331s) [noise=true , address=104.36.82.54:4182 , piece_id=7TOWS5ZKDATGQVQZURRKEMG5GUWYC2BJEFTOZG5EJOOF3J5QEB2Q, seg_pos={0 0}, upload=19421]: Uploading piece...
Jul 29 12:57:01.132699173 (20h11m47.953650291s) [noise=true , address=104.36.82.61:4407 , piece_id=G62IZ7MAJ4P6J4XTUL6WA23R6PGZYEEAJ6KFHPQHAMMKBXEKKQMA, seg_pos={0 0}, upload=19421]: Uploading piece...
Jul 29 12:57:01.133136751 (20h11m47.954087817s) [noise=true , address=104.36.82.44:4878 , piece_id=FMJJVQP573KNICNQXVJZY2TE5QKEETOY3EOGDTQRT3RHWTKCEOQQ, seg_pos={0 0}, upload=19421]: Uploading piece...
Jul 29 12:57:01.133235346 (20h11m47.954186409s) [noise=true , address=104.36.82.5:4868 , piece_id=DVMQE6KOXXKXMDD6X73O23HG3IS3D7PB7MOQJZHXITLAWLH6QKDA, seg_pos={0 0}, upload=19421]: Uploading piece...
Jul 29 12:57:01.133695629 (20h11m47.95464669s) [noise=true , address=104.36.82.7:4939 , piece_id=D2CY2W6IUBD5IY7RIXQFG3U6SISEIM4ZJA3OF4TBKO6RMODLUL3Q, seg_pos={0 0}, upload=19421]: Uploading piece...
Jul 29 12:57:01.134147849 (20h11m47.955098915s) [noise=true , address=104.36.82.11:4148 , piece_id=PMFFULLW6OON7WHW3II7VWK7HQTTEPGCZ6X3RLR3FEO4WFNQHFIA, seg_pos={0 0}, upload=19421]: Uploading piece...
Jul 29 12:57:01.135482430 (20h11m47.956433494s) [noise=true , address=104.36.82.15:4260 , piece_id=24V4E6HRA76QCGUUM4GLWBANWQN5TVZRZ4X7ALBDAQJV2O7RUW2Q, seg_pos={0 0}, upload=19421]: Uploading piece...
Jul 29 12:57:01.135914430 (20h11m47.956865491s) [noise=true , address=104.36.82.54:4162 , piece_id=5CR256YPGUFP7Z7ULJCN2KJ5PU7RUZLMD6WHTUEUDPUJFHRMQYWA, seg_pos={0 0}, upload=19421]: Uploading piece...
Jul 29 12:57:01.136346307 (20h11m47.957297372s) [noise=true , address=104.36.82.50:4023 , piece_id=Y2I3KZHZWQ37Y6PUFXSUCRZBRHWI4TXKCBQDJQNQ4S6YNCSUJCLQ, seg_pos={0 0}, upload=19421]: Uploading piece...
Jul 29 12:57:01.136814176 (20h11m47.957765238s) [noise=true , address=104.36.82.13:4209 , piece_id=IWXWZFISEI6Z4GMYRTMEPNBFMIJCIYYJD7CCN2WYLEOEGD6USJBA, seg_pos={0 0}, upload=19421]: Uploading piece...
Jul 29 12:57:01.137322966 (20h11m47.958274035s) [noise=true , address=104.36.82.47:4550 , piece_id=T6JJPRNVLQKL4J4MEXV2J4ABBZVCVQ4ZSBDSQNIBSTQB2Q4VJTNA, seg_pos={0 0}, upload=19421]: Uploading piece...
Jul 29 12:57:01.137828155 (20h11m47.958779227s) [noise=true , address=104.36.82.52:4085 , piece_id=TPV4QDX3KW65WBELDSQT76XEBO3YMQTEPCBSO54GHHOXZCVXJM7A, seg_pos={0 0}, upload=19421]: Uploading piece...
Jul 29 12:57:01.138256491 (20h11m47.959207559s) [noise=true , address=104.36.82.55:4221 , piece_id=HADZT4YHBDLAMK265ALVXEXFYYB5CQNWX7WUPKWJGNGHQJWLX3RQ, seg_pos={0 0}, upload=19421]: Uploading piece...
Jul 29 12:57:01.139815363 (20h11m47.960766434s) [noise=true , address=104.36.82.46:4500 , piece_id=GM235JXFDEJH26SWEL6X7HXNEAVRAJIAVRNZOTL657TYZMFDFVUQ, seg_pos={0 0}, upload=19421]: Uploading piece...
Jul 29 12:57:01.140730087 (20h11m47.961681155s) [noise=true , address=104.36.82.42:4813 , piece_id=WGWLKEDLOX6FGM33WUVYU7N5TB4FLICU77YS2PZFHSHUXUNLZKVQ, seg_pos={0 0}, upload=19421]: Uploading piece...
Jul 29 12:57:01.141937272 (20h11m47.962888344s) [noise=true , address=104.36.82.56:4239 , piece_id=G5CETKNYOQNPTXHT4EQIDERVWUH7PGXTKQAOQJHCYPJ2YFH52DTA, seg_pos={0 0}, upload=19421]: Uploading piece...
Jul 29 12:57:01.143216452 (20h11m47.964167524s) [noise=true , address=104.36.82.14:4230 , piece_id=KUA2QMJVVRTFDWOA2NAPLGDC2BWF2ERUGKSJY7HOVVT3MLNHKUXQ, seg_pos={0 0}, upload=19421]: Uploading piece...
Jul 29 12:57:01.250945253 (20h11m48.071896317s) [upload=19421]: Next returned nil segment
Jul 29 12:57:01.250968904 (20h11m48.071919973s) [upload=19421]: Waiting for error group managing segments...
Jul 29 12:57:01.269334453 (20h11m48.090285499s) [noise=true , address=104.36.82.7:4939 , piece_id=D2CY2W6IUBD5IY7RIXQFG3U6SISEIM4ZJA3OF4TBKO6RMODLUL3Q, seg_pos={0 0}, upload=19421]: Done uploading piece. err: <nil>
Jul 29 12:57:02.255299435 (20h11m49.076250499s) [noise=true , address=104.36.82.50:4023 , piece_id=Y2I3KZHZWQ37Y6PUFXSUCRZBRHWI4TXKCBQDJQNQ4S6YNCSUJCLQ, seg_pos={0 0}, upload=19421]: Done uploading piece. err: <nil>
Jul 29 12:57:04.283298429 (20h11m51.104249489s) [noise=true , address=104.36.82.56:4239 , piece_id=G5CETKNYOQNPTXHT4EQIDERVWUH7PGXTKQAOQJHCYPJ2YFH52DTA, seg_pos={0 0}, upload=19421]: Done uploading piece. err: <nil>
Jul 29 12:57:05.748160739 (20h11m52.569111801s) [noise=true , address=104.36.82.54:4162 , piece_id=5CR256YPGUFP7Z7ULJCN2KJ5PU7RUZLMD6WHTUEUDPUJFHRMQYWA, seg_pos={0 0}, upload=19421]: Done uploading piece. err: <nil>
Jul 29 12:57:08.394949803 (20h11m55.215900874s) [noise=true , address=104.36.82.52:4085 , piece_id=TPV4QDX3KW65WBELDSQT76XEBO3YMQTEPCBSO54GHHOXZCVXJM7A, seg_pos={0 0}, upload=19421]: Done uploading piece. err: <nil>
Jul 29 12:57:09.428147303 (20h11m56.249098359s) [noise=true , address=104.36.82.61:4407 , piece_id=G62IZ7MAJ4P6J4XTUL6WA23R6PGZYEEAJ6KFHPQHAMMKBXEKKQMA, seg_pos={0 0}, upload=19421]: Done uploading piece. err: <nil>
Jul 29 12:57:10.311385308 (20h11m57.132336366s) [noise=true , address=104.36.82.42:4813 , piece_id=WGWLKEDLOX6FGM33WUVYU7N5TB4FLICU77YS2PZFHSHUXUNLZKVQ, seg_pos={0 0}, upload=19421]: Done uploading piece. err: <nil>
Jul 29 12:57:11.025298164 (20h11m57.846249227s) [noise=true , address=104.36.82.47:4550 , piece_id=T6JJPRNVLQKL4J4MEXV2J4ABBZVCVQ4ZSBDSQNIBSTQB2Q4VJTNA, seg_pos={0 0}, upload=19421]: Done uploading piece. err: <nil>
Jul 29 12:57:11.343105545 (20h11m58.164056588s) [noise=true , address=104.36.82.11:4148 , piece_id=PMFFULLW6OON7WHW3II7VWK7HQTTEPGCZ6X3RLR3FEO4WFNQHFIA, seg_pos={0 0}, upload=19421]: Done uploading piece. err: <nil>
Jul 29 12:57:11.932107962 (20h11m58.753059023s) [noise=true , address=104.36.82.14:4230 , piece_id=KUA2QMJVVRTFDWOA2NAPLGDC2BWF2ERUGKSJY7HOVVT3MLNHKUXQ, seg_pos={0 0}, upload=19421]: Done uploading piece. err: <nil>
Jul 29 12:57:13.756420548 (20h12m0.577371605s) [noise=true , address=104.36.82.5:4868 , piece_id=DVMQE6KOXXKXMDD6X73O23HG3IS3D7PB7MOQJZHXITLAWLH6QKDA, seg_pos={0 0}, upload=19421]: Done uploading piece. err: <nil>
Jul 29 12:57:14.448596115 (20h12m1.269547175s) [noise=true , address=104.36.82.10:4097 , piece_id=NJTPMEPKEB4FS6WFSZ7B7DEWJREFU6Z4X4BOV5V54NB7GO57JLXQ, seg_pos={0 0}, upload=19421]: Done uploading piece. err: <nil>
Jul 29 12:57:16.561028666 (20h12m3.381979719s) [noise=true , address=104.36.82.13:4209 , piece_id=IWXWZFISEI6Z4GMYRTMEPNBFMIJCIYYJD7CCN2WYLEOEGD6USJBA, seg_pos={0 0}, upload=19421]: Done uploading piece. err: <nil>
Jul 29 12:57:19.540608733 (20h12m6.361559794s) [noise=true , address=104.36.82.54:4182 , piece_id=7TOWS5ZKDATGQVQZURRKEMG5GUWYC2BJEFTOZG5EJOOF3J5QEB2Q, seg_pos={0 0}, upload=19421]: Done uploading piece. err: <nil>
Jul 29 12:57:19.540651028 (20h12m6.361602085s) [seg_pos={0 0}, upload=19421]: Segment reached optimal threshold of 14 pieces.
Jul 29 12:57:19.540841496 (20h12m6.361792568s) [noise=true , address=104.36.82.44:4878 , piece_id=FMJJVQP573KNICNQXVJZY2TE5QKEETOY3EOGDTQRT3RHWTKCEOQQ, seg_pos={0 0}, upload=19421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF
Jul 29 12:57:19.541177419 (20h12m6.362128488s) [noise=true , address=104.36.82.55:4221 , piece_id=HADZT4YHBDLAMK265ALVXEXFYYB5CQNWX7WUPKWJGNGHQJWLX3RQ, seg_pos={0 0}, upload=19421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ssFiXk5oKTgnVMJ5TBJuSXuD1D2C46gT2hcY6yaDxf8fL1cjm): protocol: rpc: dial tcp 104.36.82.55:4221: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 12:57:19.541202989 (20h12m6.362154142s) [noise=true , address=104.36.82.15:4260 , piece_id=24V4E6HRA76QCGUUM4GLWBANWQN5TVZRZ4X7ALBDAQJV2O7RUW2Q, seg_pos={0 0}, upload=19421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aLsgrV3k6vUSavgPkPGA2FF9HR3ryN9bnHutruFJHW1GYixeL): protocol: rpc: dial tcp 104.36.82.15:4260: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 12:57:19.541274663 (20h12m6.36222572s) [noise=true , address=104.36.82.46:4500 , piece_id=GM235JXFDEJH26SWEL6X7HXNEAVRAJIAVRNZOTL657TYZMFDFVUQ, seg_pos={0 0}, upload=19421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B7ox4ehqxJ2mwqeXj8C9N9GuSU5etNC23iT1pJnTgMLGBAGQK): protocol: write tcp 159.223.143.39:45148->104.36.82.46:4500: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 12:57:19.541307643 (20h12m6.362258703s) [seg_pos={0 0}, upload=19421]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 12:57:19.541405224 (20h12m6.362356289s) [upload=19421]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 12:57:19.541410999 (20h12m6.362362062s) [upload=19421]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 12:57:19.605360738 (20h12m6.426311786s) [upload=19421]: Done uploading segments...
Jul 29 12:57:19.605379364 (20h12m6.426330412s) [upload=19421]: Upload finished. err: <nil>
Duration: 1m0.004226354s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [...............................................XXXX......XXX] duration:
30.033883749s
FAIL (2025-07-29 12:57:47 UTC)
orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 30.033910708s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
288.045482ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 12:57:38 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 288.069279ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
4.598488747s
FAIL (2025-07-29 12:57:25 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.598527023s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
100.720461ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 12:57:24 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 100.746113ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
4.584565443s
FAIL (2025-07-29 12:57:03 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.584597838s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
102.439698ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 12:56:47 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 102.557859ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
27.572927781s
FAIL (2025-07-29 12:56:44 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
d finished. err: <nil>
Jul 29 12:55:16.700504598 (20h10m3.521455665s) [upload=19394]: Starting upload
Jul 29 12:55:16.700583543 (20h10m3.521534603s) [upload=19394]: Done starting upload
Jul 29 12:55:16.700918248 (20h10m3.521869308s) [upload=19394]: Uploading segments...
Jul 29 12:55:16.700973839 (20h10m3.521924908s) [upload=19394]: Got next segment. Inline: false
Jul 29 12:55:16.701023687 (20h10m3.521974746s) [upload=19394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 12:55:16.701029925 (20h10m3.521980984s) [upload=19394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 12:55:16.749816286 (20h10m3.570767352s) [seg_pos={0 0}, upload=19394]: Begin upload segment...
Jul 29 12:55:16.749891291 (20h10m3.570842358s) [seg_pos={0 0}, upload=19394]: Done begin upload segment.
Jul 29 12:55:16.749909979 (20h10m3.570861045s) [noise=true , address=104.36.82.46:4507 , piece_id=TBO3Q4AXDWAUZELLXQY4HM6QB5IKP7EVN24JYSFMFIL4LBFA2MSQ, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.749952102 (20h10m3.570903169s) [noise=true , address=104.36.82.2:4750 , piece_id=RLW2PISUL3SIPVSKAK2M77ZQQLIBPEUAUVEDHAXE4ZZ2ZQ7OA2BA, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.750420510 (20h10m3.571371577s) [noise=true , address=104.36.82.53:4148 , piece_id=VA67JKDKUCGKYF4VDHLJ6D7NVDC636HSQ3DEYAQJBH2TKUSJHBZA, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.750918077 (20h10m3.571869144s) [noise=true , address=104.36.82.46:4488 , piece_id=5HWGSCOYLGQXFTJI7HKN73ROXWHA4WL2UB42R5OJY3AGOFAHN2DA, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.751515867 (20h10m3.57246695s) [noise=true , address=104.36.82.44:4902 , piece_id=SJP7OAUSAXJOD3DZFQ7O42YCGUHX3QNDPJ2G4GUGBQMC5CBS6CZQ, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.751933006 (20h10m3.572884073s) [noise=true , address=104.36.82.56:4239 , piece_id=Q3OYIRU6J6WCBAULX2LCWYMS3IQYWUGDMAKXTU4NCYUEN63AZHBA, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.752320690 (20h10m3.573271757s) [noise=true , address=104.36.82.5:4854 , piece_id=QDCCDIDSQSKNQUYAGA35DREZAHNWKNGI3ULJVBWE5YPXMS74CVIA, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.752901472 (20h10m3.573852552s) [noise=true , address=104.36.82.12:4167 , piece_id=OU57V3KUYWG32VZ4JF2UBVDTSWAFITZSYFRPCSKVNPITRWKNY7BA, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.753263631 (20h10m3.574214699s) [noise=true , address=104.36.82.53:4146 , piece_id=AIJAQWUXDJOL3VFZ3GQDW5AK5YEAZLOYUCSAZWVKK4GFAKYMEJTQ, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.753658123 (20h10m3.574609193s) [noise=true , address=104.36.82.36:4650 , piece_id=VU2S2FC43EJ23WXWKUN3MFQT4ZI3DYVVTJZLGUBMMZL4PKVCVPLA, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.754194660 (20h10m3.575145719s) [noise=true , address=104.36.82.22:4523 , piece_id=JQPXWVJM7BHGOMHI6UFSKWDMNRNVJTMMR4SH2FL4ERF364O6EIQQ, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.754628620 (20h10m3.575579688s) [noise=true , address=104.36.82.15:4264 , piece_id=PTRI2722KUD7JYRBYDZ2M4CW7CRC5VQRP2OE33673LDPTBHIUE3A, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.755179032 (20h10m3.576130104s) [noise=true , address=104.36.82.55:4215 , piece_id=MHHS5KTBRGVQXUOZRO2L2MDOU74Q7KC7XZ7N3KSIHTTUEFYMXAHA, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.755606478 (20h10m3.576557545s) [noise=true , address=104.36.82.11:4136 , piece_id=JR4MVMD2RZNGXREIMEEH7DFW2UKTKHB4DB7HH5PLQE4KLH75I43A, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.756045101 (20h10m3.576996169s) [noise=true , address=104.36.82.42:4811 , piece_id=FSBZV4FMLOZQPG3GBRAAEX2GD4EJZASSJNN6SIS4VBQ3EMFNWUZQ, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.756389044 (20h10m3.577340111s) [noise=true , address=104.36.82.13:4206 , piece_id=RSLFA3RR4QIILNEXL4XZZSQPPN7WYWRZLKBDXQXOD3OSRCNMFH5A, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.756934105 (20h10m3.577885172s) [noise=true , address=104.36.82.42:4812 , piece_id=YHJEL7TRJ7ORMGLU3BGRWHX7HVB4WC6VYHU3UBFTUUVPQNHPQXAA, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.757250451 (20h10m3.578201511s) [noise=true , address=104.36.82.52:4088 , piece_id=OZTILGM3XYPJ74I5OVV4PAX6X5XMUCQR22BDQ3UEMCTBDN2MCJIQ, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.861760644 (20h10m3.682711708s) [upload=19394]: Next returned nil segment
Jul 29 12:55:16.861781124 (20h10m3.682732185s) [upload=19394]: Waiting for error group managing segments...
Jul 29 12:55:16.874940717 (20h10m3.695891779s) [noise=true , address=104.36.82.42:4811 , piece_id=FSBZV4FMLOZQPG3GBRAAEX2GD4EJZASSJNN6SIS4VBQ3EMFNWUZQ, seg_pos={0 0}, upload=19394]: Done uploading piece. err: <nil>
Jul 29 12:55:16.883984420 (20h10m3.70493547s) [noise=true , address=104.36.82.36:4650 , piece_id=VU2S2FC43EJ23WXWKUN3MFQT4ZI3DYVVTJZLGUBMMZL4PKVCVPLA, seg_pos={0 0}, upload=19394]: Done uploading piece. err: <nil>
Jul 29 12:55:16.884338136 (20h10m3.705289188s) [noise=true , address=104.36.82.55:4215 , piece_id=MHHS5KTBRGVQXUOZRO2L2MDOU74Q7KC7XZ7N3KSIHTTUEFYMXAHA, seg_pos={0 0}, upload=19394]: Done uploading piece. err: <nil>
Jul 29 12:55:16.888708941 (20h10m3.709659991s) [noise=true , address=104.36.82.12:4167 , piece_id=OU57V3KUYWG32VZ4JF2UBVDTSWAFITZSYFRPCSKVNPITRWKNY7BA, seg_pos={0 0}, upload=19394]: Done uploading piece. err: <nil>
Jul 29 12:55:16.894636988 (20h10m3.715588051s) [noise=true , address=104.36.82.42:4812 , piece_id=YHJEL7TRJ7ORMGLU3BGRWHX7HVB4WC6VYHU3UBFTUUVPQNHPQXAA, seg_pos={0 0}, upload=19394]: Done uploading piece. err: <nil>
Jul 29 12:55:16.896369641 (20h10m3.7173207s) [noise=true , address=104.36.82.11:4136 , piece_id=JR4MVMD2RZNGXREIMEEH7DFW2UKTKHB4DB7HH5PLQE4KLH75I43A, seg_pos={0 0}, upload=19394]: Done uploading piece. err: <nil>
Jul 29 12:55:17.154512755 (20h10m3.975463819s) [noise=true , address=104.36.82.22:4523 , piece_id=JQPXWVJM7BHGOMHI6UFSKWDMNRNVJTMMR4SH2FL4ERF364O6EIQQ, seg_pos={0 0}, upload=19394]: Done uploading piece. err: <nil>
Jul 29 12:55:23.845001407 (20h10m10.665952458s) [noise=true , address=104.36.82.2:4750 , piece_id=RLW2PISUL3SIPVSKAK2M77ZQQLIBPEUAUVEDHAXE4ZZ2ZQ7OA2BA, seg_pos={0 0}, upload=19394]: Done uploading piece. err: <nil>
Jul 29 12:55:23.951274755 (20h10m10.772225811s) [noise=true , address=104.36.82.44:4902 , piece_id=SJP7OAUSAXJOD3DZFQ7O42YCGUHX3QNDPJ2G4GUGBQMC5CBS6CZQ, seg_pos={0 0}, upload=19394]: Done uploading piece. err: <nil>
Jul 29 12:55:26.121545307 (20h10m12.942496374s) [noise=true , address=104.36.82.13:4206 , piece_id=RSLFA3RR4QIILNEXL4XZZSQPPN7WYWRZLKBDXQXOD3OSRCNMFH5A, seg_pos={0 0}, upload=19394]: Done uploading piece. err: <nil>
Jul 29 12:55:27.278742979 (20h10m14.099694044s) [noise=true , address=104.36.82.15:4264 , piece_id=PTRI2722KUD7JYRBYDZ2M4CW7CRC5VQRP2OE33673LDPTBHIUE3A, seg_pos={0 0}, upload=19394]: Done uploading piece. err: <nil>
Jul 29 12:55:28.923472238 (20h10m15.744423297s) [noise=true , address=104.36.82.52:4088 , piece_id=OZTILGM3XYPJ74I5OVV4PAX6X5XMUCQR22BDQ3UEMCTBDN2MCJIQ, seg_pos={0 0}, upload=19394]: Done uploading piece. err: <nil>
Jul 29 12:55:39.367154682 (20h10m26.188105744s) [noise=true , address=104.36.82.5:4854 , piece_id=QDCCDIDSQSKNQUYAGA35DREZAHNWKNGI3ULJVBWE5YPXMS74CVIA, seg_pos={0 0}, upload=19394]: Done uploading piece. err: <nil>
Jul 29 12:56:16.551865049 (20h11m3.372816117s) [noise=true , address=104.36.82.56:4239 , piece_id=Q3OYIRU6J6WCBAULX2LCWYMS3IQYWUGDMAKXTU4NCYUEN63AZHBA, seg_pos={0 0}, upload=19394]: Done uploading piece. err: ecclient: upload failed (node:126Feu3gWgog12YavTHZkkUKK8wq6RynV8zsWd3WUAUYjvQwBnc, address:104.36.82.56:4239): protocol: expected piece hash; context deadline exceeded; EOF
Jul 29 12:56:16.551957990 (20h11m3.372909049s) [noise=true , address=104.36.82.53:4148 , piece_id=VA67JKDKUCGKYF4VDHLJ6D7NVDC636HSQ3DEYAQJBH2TKUSJHBZA, seg_pos={0 0}, upload=19394]: Done uploading piece. err: ecclient: upload failed (node:12GGwKp8TvH5JJ8mcR4sqKcGMCc56hMEgWpAR3zqTWerqTLQ9Rv, address:104.36.82.53:4148): protocol: expected piece hash; context deadline exceeded; EOF
Jul 29 12:56:16.552035957 (20h11m3.372987015s) [noise=true , address=104.36.82.53:4146 , piece_id=AIJAQWUXDJOL3VFZ3GQDW5AK5YEAZLOYUCSAZWVKK4GFAKYMEJTQ, seg_pos={0 0}, upload=19394]: Done uploading piece. err: ecclient: upload failed (node:1ecwZFchyb5HmyKwRFfLDaVGck3xDWmgrVNYadHoTLWY5Z2Qs1, address:104.36.82.53:4146): protocol: expected piece hash; context deadline exceeded; EOF
Jul 29 12:56:16.552421390 (20h11m3.373372448s) [noise=true , address=104.36.82.46:4488 , piece_id=5HWGSCOYLGQXFTJI7HKN73ROXWHA4WL2UB42R5OJY3AGOFAHN2DA, seg_pos={0 0}, upload=19394]: Done uploading piece. err: ecclient: upload failed (node:1MU3fdv9cTkq4pUZ3h989STAG1wxrbhFgzmr6tcrfumZKHP9BZ, address:104.36.82.46:4488): protocol: read tcp 159.223.143.39:40572->104.36.82.46:4488: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 12:56:16.552495373 (20h11m3.373446429s) [noise=true , address=104.36.82.46:4507 , piece_id=TBO3Q4AXDWAUZELLXQY4HM6QB5IKP7EVN24JYSFMFIL4LBFA2MSQ, seg_pos={0 0}, upload=19394]: Done uploading piece. err: ecclient: upload failed (node:14jurWWPpmxwiBS3XmZysEUwugsceYJqVXFj7BbYpx8UFcTR8R, address:104.36.82.46:4507): protocol: read tcp 159.223.143.39:43458->104.36.82.46:4507: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 12:56:16.552513971 (20h11m3.373465029s) [seg_pos={0 0}, upload=19394]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 29 12:56:16.584813987 (20h11m3.405765058s) [upload=19394]: Done uploading segments...
Jul 29 12:56:16.584869790 (20h11m3.405820861s) [upload=19394]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 27.57295567s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [................................................XXXX......XX] duration:
30.00327901s
FAIL (2025-07-29 12:56:32 UTC)
orbiter warning: uplink: context deadline exceeded
Duration: 30.003327224s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
247.679002ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 12:56:28 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 247.722121ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.037778795s
FAIL (2025-07-29 12:56:16 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
d finished. err: <nil>
Jul 29 12:55:16.700504598 (20h10m3.521455665s) [upload=19394]: Starting upload
Jul 29 12:55:16.700583543 (20h10m3.521534603s) [upload=19394]: Done starting upload
Jul 29 12:55:16.700918248 (20h10m3.521869308s) [upload=19394]: Uploading segments...
Jul 29 12:55:16.700973839 (20h10m3.521924908s) [upload=19394]: Got next segment. Inline: false
Jul 29 12:55:16.701023687 (20h10m3.521974746s) [upload=19394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 12:55:16.701029925 (20h10m3.521980984s) [upload=19394]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 12:55:16.749816286 (20h10m3.570767352s) [seg_pos={0 0}, upload=19394]: Begin upload segment...
Jul 29 12:55:16.749891291 (20h10m3.570842358s) [seg_pos={0 0}, upload=19394]: Done begin upload segment.
Jul 29 12:55:16.749909979 (20h10m3.570861045s) [noise=true , address=104.36.82.46:4507 , piece_id=TBO3Q4AXDWAUZELLXQY4HM6QB5IKP7EVN24JYSFMFIL4LBFA2MSQ, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.749952102 (20h10m3.570903169s) [noise=true , address=104.36.82.2:4750 , piece_id=RLW2PISUL3SIPVSKAK2M77ZQQLIBPEUAUVEDHAXE4ZZ2ZQ7OA2BA, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.750420510 (20h10m3.571371577s) [noise=true , address=104.36.82.53:4148 , piece_id=VA67JKDKUCGKYF4VDHLJ6D7NVDC636HSQ3DEYAQJBH2TKUSJHBZA, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.750918077 (20h10m3.571869144s) [noise=true , address=104.36.82.46:4488 , piece_id=5HWGSCOYLGQXFTJI7HKN73ROXWHA4WL2UB42R5OJY3AGOFAHN2DA, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.751515867 (20h10m3.57246695s) [noise=true , address=104.36.82.44:4902 , piece_id=SJP7OAUSAXJOD3DZFQ7O42YCGUHX3QNDPJ2G4GUGBQMC5CBS6CZQ, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.751933006 (20h10m3.572884073s) [noise=true , address=104.36.82.56:4239 , piece_id=Q3OYIRU6J6WCBAULX2LCWYMS3IQYWUGDMAKXTU4NCYUEN63AZHBA, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.752320690 (20h10m3.573271757s) [noise=true , address=104.36.82.5:4854 , piece_id=QDCCDIDSQSKNQUYAGA35DREZAHNWKNGI3ULJVBWE5YPXMS74CVIA, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.752901472 (20h10m3.573852552s) [noise=true , address=104.36.82.12:4167 , piece_id=OU57V3KUYWG32VZ4JF2UBVDTSWAFITZSYFRPCSKVNPITRWKNY7BA, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.753263631 (20h10m3.574214699s) [noise=true , address=104.36.82.53:4146 , piece_id=AIJAQWUXDJOL3VFZ3GQDW5AK5YEAZLOYUCSAZWVKK4GFAKYMEJTQ, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.753658123 (20h10m3.574609193s) [noise=true , address=104.36.82.36:4650 , piece_id=VU2S2FC43EJ23WXWKUN3MFQT4ZI3DYVVTJZLGUBMMZL4PKVCVPLA, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.754194660 (20h10m3.575145719s) [noise=true , address=104.36.82.22:4523 , piece_id=JQPXWVJM7BHGOMHI6UFSKWDMNRNVJTMMR4SH2FL4ERF364O6EIQQ, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.754628620 (20h10m3.575579688s) [noise=true , address=104.36.82.15:4264 , piece_id=PTRI2722KUD7JYRBYDZ2M4CW7CRC5VQRP2OE33673LDPTBHIUE3A, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.755179032 (20h10m3.576130104s) [noise=true , address=104.36.82.55:4215 , piece_id=MHHS5KTBRGVQXUOZRO2L2MDOU74Q7KC7XZ7N3KSIHTTUEFYMXAHA, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.755606478 (20h10m3.576557545s) [noise=true , address=104.36.82.11:4136 , piece_id=JR4MVMD2RZNGXREIMEEH7DFW2UKTKHB4DB7HH5PLQE4KLH75I43A, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.756045101 (20h10m3.576996169s) [noise=true , address=104.36.82.42:4811 , piece_id=FSBZV4FMLOZQPG3GBRAAEX2GD4EJZASSJNN6SIS4VBQ3EMFNWUZQ, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.756389044 (20h10m3.577340111s) [noise=true , address=104.36.82.13:4206 , piece_id=RSLFA3RR4QIILNEXL4XZZSQPPN7WYWRZLKBDXQXOD3OSRCNMFH5A, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.756934105 (20h10m3.577885172s) [noise=true , address=104.36.82.42:4812 , piece_id=YHJEL7TRJ7ORMGLU3BGRWHX7HVB4WC6VYHU3UBFTUUVPQNHPQXAA, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.757250451 (20h10m3.578201511s) [noise=true , address=104.36.82.52:4088 , piece_id=OZTILGM3XYPJ74I5OVV4PAX6X5XMUCQR22BDQ3UEMCTBDN2MCJIQ, seg_pos={0 0}, upload=19394]: Uploading piece...
Jul 29 12:55:16.861760644 (20h10m3.682711708s) [upload=19394]: Next returned nil segment
Jul 29 12:55:16.861781124 (20h10m3.682732185s) [upload=19394]: Waiting for error group managing segments...
Jul 29 12:55:16.874940717 (20h10m3.695891779s) [noise=true , address=104.36.82.42:4811 , piece_id=FSBZV4FMLOZQPG3GBRAAEX2GD4EJZASSJNN6SIS4VBQ3EMFNWUZQ, seg_pos={0 0}, upload=19394]: Done uploading piece. err: <nil>
Jul 29 12:55:16.883984420 (20h10m3.70493547s) [noise=true , address=104.36.82.36:4650 , piece_id=VU2S2FC43EJ23WXWKUN3MFQT4ZI3DYVVTJZLGUBMMZL4PKVCVPLA, seg_pos={0 0}, upload=19394]: Done uploading piece. err: <nil>
Jul 29 12:55:16.884338136 (20h10m3.705289188s) [noise=true , address=104.36.82.55:4215 , piece_id=MHHS5KTBRGVQXUOZRO2L2MDOU74Q7KC7XZ7N3KSIHTTUEFYMXAHA, seg_pos={0 0}, upload=19394]: Done uploading piece. err: <nil>
Jul 29 12:55:16.888708941 (20h10m3.709659991s) [noise=true , address=104.36.82.12:4167 , piece_id=OU57V3KUYWG32VZ4JF2UBVDTSWAFITZSYFRPCSKVNPITRWKNY7BA, seg_pos={0 0}, upload=19394]: Done uploading piece. err: <nil>
Jul 29 12:55:16.894636988 (20h10m3.715588051s) [noise=true , address=104.36.82.42:4812 , piece_id=YHJEL7TRJ7ORMGLU3BGRWHX7HVB4WC6VYHU3UBFTUUVPQNHPQXAA, seg_pos={0 0}, upload=19394]: Done uploading piece. err: <nil>
Jul 29 12:55:16.896369641 (20h10m3.7173207s) [noise=true , address=104.36.82.11:4136 , piece_id=JR4MVMD2RZNGXREIMEEH7DFW2UKTKHB4DB7HH5PLQE4KLH75I43A, seg_pos={0 0}, upload=19394]: Done uploading piece. err: <nil>
Jul 29 12:55:17.154512755 (20h10m3.975463819s) [noise=true , address=104.36.82.22:4523 , piece_id=JQPXWVJM7BHGOMHI6UFSKWDMNRNVJTMMR4SH2FL4ERF364O6EIQQ, seg_pos={0 0}, upload=19394]: Done uploading piece. err: <nil>
Jul 29 12:55:23.845001407 (20h10m10.665952458s) [noise=true , address=104.36.82.2:4750 , piece_id=RLW2PISUL3SIPVSKAK2M77ZQQLIBPEUAUVEDHAXE4ZZ2ZQ7OA2BA, seg_pos={0 0}, upload=19394]: Done uploading piece. err: <nil>
Jul 29 12:55:23.951274755 (20h10m10.772225811s) [noise=true , address=104.36.82.44:4902 , piece_id=SJP7OAUSAXJOD3DZFQ7O42YCGUHX3QNDPJ2G4GUGBQMC5CBS6CZQ, seg_pos={0 0}, upload=19394]: Done uploading piece. err: <nil>
Jul 29 12:55:26.121545307 (20h10m12.942496374s) [noise=true , address=104.36.82.13:4206 , piece_id=RSLFA3RR4QIILNEXL4XZZSQPPN7WYWRZLKBDXQXOD3OSRCNMFH5A, seg_pos={0 0}, upload=19394]: Done uploading piece. err: <nil>
Jul 29 12:55:27.278742979 (20h10m14.099694044s) [noise=true , address=104.36.82.15:4264 , piece_id=PTRI2722KUD7JYRBYDZ2M4CW7CRC5VQRP2OE33673LDPTBHIUE3A, seg_pos={0 0}, upload=19394]: Done uploading piece. err: <nil>
Jul 29 12:55:28.923472238 (20h10m15.744423297s) [noise=true , address=104.36.82.52:4088 , piece_id=OZTILGM3XYPJ74I5OVV4PAX6X5XMUCQR22BDQ3UEMCTBDN2MCJIQ, seg_pos={0 0}, upload=19394]: Done uploading piece. err: <nil>
Jul 29 12:55:39.367154682 (20h10m26.188105744s) [noise=true , address=104.36.82.5:4854 , piece_id=QDCCDIDSQSKNQUYAGA35DREZAHNWKNGI3ULJVBWE5YPXMS74CVIA, seg_pos={0 0}, upload=19394]: Done uploading piece. err: <nil>
Jul 29 12:56:16.551865049 (20h11m3.372816117s) [noise=true , address=104.36.82.56:4239 , piece_id=Q3OYIRU6J6WCBAULX2LCWYMS3IQYWUGDMAKXTU4NCYUEN63AZHBA, seg_pos={0 0}, upload=19394]: Done uploading piece. err: ecclient: upload failed (node:126Feu3gWgog12YavTHZkkUKK8wq6RynV8zsWd3WUAUYjvQwBnc, address:104.36.82.56:4239): protocol: expected piece hash; context deadline exceeded; EOF
Jul 29 12:56:16.551957990 (20h11m3.372909049s) [noise=true , address=104.36.82.53:4148 , piece_id=VA67JKDKUCGKYF4VDHLJ6D7NVDC636HSQ3DEYAQJBH2TKUSJHBZA, seg_pos={0 0}, upload=19394]: Done uploading piece. err: ecclient: upload failed (node:12GGwKp8TvH5JJ8mcR4sqKcGMCc56hMEgWpAR3zqTWerqTLQ9Rv, address:104.36.82.53:4148): protocol: expected piece hash; context deadline exceeded; EOF
Jul 29 12:56:16.552035957 (20h11m3.372987015s) [noise=true , address=104.36.82.53:4146 , piece_id=AIJAQWUXDJOL3VFZ3GQDW5AK5YEAZLOYUCSAZWVKK4GFAKYMEJTQ, seg_pos={0 0}, upload=19394]: Done uploading piece. err: ecclient: upload failed (node:1ecwZFchyb5HmyKwRFfLDaVGck3xDWmgrVNYadHoTLWY5Z2Qs1, address:104.36.82.53:4146): protocol: expected piece hash; context deadline exceeded; EOF
Jul 29 12:56:16.552421390 (20h11m3.373372448s) [noise=true , address=104.36.82.46:4488 , piece_id=5HWGSCOYLGQXFTJI7HKN73ROXWHA4WL2UB42R5OJY3AGOFAHN2DA, seg_pos={0 0}, upload=19394]: Done uploading piece. err: ecclient: upload failed (node:1MU3fdv9cTkq4pUZ3h989STAG1wxrbhFgzmr6tcrfumZKHP9BZ, address:104.36.82.46:4488): protocol: read tcp 159.223.143.39:40572->104.36.82.46:4488: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 12:56:16.552495373 (20h11m3.373446429s) [noise=true , address=104.36.82.46:4507 , piece_id=TBO3Q4AXDWAUZELLXQY4HM6QB5IKP7EVN24JYSFMFIL4LBFA2MSQ, seg_pos={0 0}, upload=19394]: Done uploading piece. err: ecclient: upload failed (node:14jurWWPpmxwiBS3XmZysEUwugsceYJqVXFj7BbYpx8UFcTR8R, address:104.36.82.46:4507): protocol: read tcp 159.223.143.39:43458->104.36.82.46:4507: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 12:56:16.552513971 (20h11m3.373465029s) [seg_pos={0 0}, upload=19394]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 29 12:56:16.584813987 (20h11m3.405765058s) [upload=19394]: Done uploading segments...
Jul 29 12:56:16.584869790 (20h11m3.405820861s) [upload=19394]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1m0.037821612s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
4.797667113s
FAIL (2025-07-29 12:56:10 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.797716339s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
242.699157ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 12:56:10 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 242.73066ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
117.917892ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 12:56:04 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 117.9383ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.................................................XXXX......X] duration:
30.030842421s
FAIL (2025-07-29 12:55:54 UTC)
orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 30.030870964s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
666.590844ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 12:55:49 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 666.61915ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
4.509702825s
FAIL (2025-07-29 12:55:40 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.509997513s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
176.802444ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 12:55:20 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 176.840029ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
475.775767ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 12:55:20 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 475.803011ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
4.58963589s
FAIL (2025-07-29 12:55:19 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.589664036s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..................................................XXXX......] duration:
23.898308296s
FAIL (2025-07-29 12:55:01 UTC)
orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 23.898338376s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...................................................XXXX.....] duration:
18.411008591s
FAIL (2025-07-29 12:54:30 UTC)
orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 18.41104278s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
102.165296ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 12:54:26 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 102.192486ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
4.700275777s
FAIL (2025-07-29 12:54:21 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.700342527s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
241.918047ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 12:54:07 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 241.945537ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
110.182466ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 12:53:52 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 110.207754ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
4.611296101s
FAIL (2025-07-29 12:53:32 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.611325297s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....................................................XXXX....] duration:
16.158736633s
FAIL (2025-07-29 12:53:19 UTC)
orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 16.158771127s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
4.606059164s
FAIL (2025-07-29 12:53:08 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.60609974s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
238.802086ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 12:53:04 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 238.826817ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
103.831478ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 12:52:51 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 103.893329ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
145.756364ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 12:52:23 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 145.784361ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....................................................XXXX...] duration:
29.799617067s
FAIL (2025-07-29 12:52:22 UTC)
orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 29.799669242s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
4.57958552s
FAIL (2025-07-29 12:52:20 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.579626702s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
251.165731ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 12:52:09 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 251.192306ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
104.453154ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 12:51:31 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 104.481191ms
edge
gateway
vhost
bgp
eu1
|