Created
November 14, 2024 11:51
-
-
Save snowch/e2fc06bd420d92f060ee6e985ea3ed73 to your computer and use it in GitHub Desktop.
mount-t3 log output
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2024-11-14T11:37:16.555306Z DEBUG mountpoint_s3::cli: waiting up to 30 seconds for child process to be ready | |
| 2024-11-14T11:37:16.555705Z INFO mountpoint_s3::cli: mount-s3 1.10.0 | |
| 2024-11-14T11:37:16.555724Z DEBUG mountpoint_s3::cli: CliArgs { bucket_name: "csnow-bucket", mount_point: "/home/jovyan/s3", prefix: None, region: Some("VAST"), endpoint_url: Some("http://172.200.201.1:80"), force_path_style: false, transfer_acceleration: false, dual_stack: false, requester_pays: false, bucket_type: None, no_sign_request: false, profile: None, read_only: false, storage_class: None, allow_delete: true, allow_overwrite: false, auto_unmount: false, allow_root: false, allow_other: false, maximum_throughput_gbps: None, max_threads: 16, part_size: 8388608, read_part_size: None, write_part_size: None, uid: Some(1000), gid: Some(100), dir_mode: Some(509), file_mode: Some(436), foreground: false, expected_bucket_owner: None, log_directory: Some("/home/jovyan/s3.log"), log_metrics: false, debug: true, debug_crt: true, no_log: false, cache: None, metadata_ttl: None, max_cache_size: None, user_agent_prefix: None, sse: None, sse_kms_key_id: None, upload_checksums: None, bind: None } | |
| 2024-11-14T11:37:16.555902Z DEBUG awscrt::libcrypto_resolve: searching process and loaded modules | |
| 2024-11-14T11:37:16.555908Z DEBUG awscrt::libcrypto_resolve: found static aws-lc HMAC symbols | |
| 2024-11-14T11:37:16.555911Z DEBUG awscrt::libcrypto_resolve: found static aws-lc libcrypto 1.1.1 EVP_MD symbols | |
| 2024-11-14T11:37:16.555930Z DEBUG awscrt::libcrypto_resolve: Compiled with libcrypto AWS-LC 1.36.1, linked to libcrypto AWS-LC 1.36.1 | |
| 2024-11-14T11:37:16.555938Z INFO awscrt::tls-handler: static: Initializing TLS using s2n. | |
| 2024-11-14T11:37:16.572201Z DEBUG awscrt::tls-handler: ctx: Based on OS, we detected the default PKI path as /etc/ssl/certs, and ca file as /etc/ssl/certs/ca-certificates.crt | |
| 2024-11-14T11:37:16.572261Z INFO awscrt::event-loop: id=0x564afdff8d10: Initializing edge-triggered epoll | |
| 2024-11-14T11:37:16.572269Z INFO awscrt::event-loop: id=0x564afdff8d10: Using eventfd for cross-thread notifications. | |
| 2024-11-14T11:37:16.572276Z INFO awscrt::event-loop: id=0x564afdff8d10: Starting event-loop thread. | |
| 2024-11-14T11:37:16.572337Z INFO awscrt::event-loop: id=0x564afdff8d60: Initializing edge-triggered epoll | |
| 2024-11-14T11:37:16.572346Z INFO awscrt::event-loop: id=0x564afdff8d60: Using eventfd for cross-thread notifications. | |
| 2024-11-14T11:37:16.572351Z INFO awscrt::event-loop: id=0x564afdff8d60: Starting event-loop thread. | |
| 2024-11-14T11:37:16.572390Z INFO awscrt::event-loop: id=0x564afdfd66e0: Initializing edge-triggered epoll | |
| 2024-11-14T11:37:16.572395Z INFO awscrt::event-loop: id=0x564afdfd66e0: Using eventfd for cross-thread notifications. | |
| 2024-11-14T11:37:16.572399Z INFO awscrt::event-loop: id=0x564afdfd66e0: Starting event-loop thread. | |
| 2024-11-14T11:37:16.572422Z INFO awscrt::event-loop: id=0x564afdff8d10: main loop started | |
| 2024-11-14T11:37:16.572441Z INFO awscrt::event-loop: id=0x564afdfe6b30: Initializing edge-triggered epoll | |
| 2024-11-14T11:37:16.572448Z INFO awscrt::event-loop: id=0x564afdfe6b30: Using eventfd for cross-thread notifications. | |
| 2024-11-14T11:37:16.572450Z INFO awscrt::event-loop: id=0x564afdff8d10: default timeout 100000, and max events to process per tick 100 | |
| 2024-11-14T11:37:16.572452Z INFO awscrt::event-loop: id=0x564afdfe6b30: Starting event-loop thread. | |
| 2024-11-14T11:37:16.572447Z INFO awscrt::event-loop: id=0x564afdff8d60: main loop started | |
| 2024-11-14T11:37:16.572470Z INFO awscrt::event-loop: id=0x564afdff8d60: default timeout 100000, and max events to process per tick 100 | |
| 2024-11-14T11:37:16.572484Z INFO awscrt::dns: id=0x564afdff3ee0: Initializing default host resolver with 8 max host entries. | |
| 2024-11-14T11:37:16.572489Z INFO awscrt::channel-bootstrap: id=0x564afdff2cb0: Initializing client bootstrap with event-loop group 0x564afdfed890 | |
| 2024-11-14T11:37:16.572506Z INFO awscrt::event-loop: id=0x564afdfd66e0: main loop started | |
| 2024-11-14T11:37:16.572521Z INFO awscrt::event-loop: id=0x564afdfe6b30: main loop started | |
| 2024-11-14T11:37:16.572537Z INFO awscrt::event-loop: id=0x564afdfd66e0: default timeout 100000, and max events to process per tick 100 | |
| 2024-11-14T11:37:16.572541Z INFO awscrt::event-loop: id=0x564afdfe6b30: default timeout 100000, and max events to process per tick 100 | |
| 2024-11-14T11:37:16.572556Z DEBUG awscrt::channel-bootstrap: id=0x564afdff2cb0: acquiring bootstrap reference | |
| 2024-11-14T11:37:16.572560Z INFO awscrt::connection-manager: id=0x564afdff71c0: Successfully created | |
| 2024-11-14T11:37:16.572564Z INFO awscrt::exp-backoff-strategy: id=0x564afdfecf10: Initializing exponential backoff retry strategy with scale factor: 0 jitter mode: 0 and max retries 1 | |
| 2024-11-14T11:37:16.572567Z DEBUG awscrt::channel-bootstrap: id=0x564afdff2cb0: releasing bootstrap reference | |
| 2024-11-14T11:37:16.572629Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdfecf10: Initializing retry token 0x564afdfe78d0 | |
| 2024-11-14T11:37:16.572654Z DEBUG awscrt::Unknown: (id=0x564afe004810) IMDS client's token is invalid and is now updating. | |
| 2024-11-14T11:37:16.572667Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdfecf10: Vending retry_token 0x564afdfe78d0 | |
| 2024-11-14T11:37:16.572672Z DEBUG awscrt::Unknown: id=0x564afe004810: IMDS Client successfully acquired retry token. | |
| 2024-11-14T11:37:16.572678Z DEBUG awscrt::connection-manager: id=0x564afdff71c0: Acquire connection | |
| 2024-11-14T11:37:16.572683Z DEBUG awscrt::connection-manager: id=0x564afdff71c0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=1, pending_settings_count=0, pending_connect_count=1, vended_connection_count=0, open_connection_count=0, ref_count=1 | |
| 2024-11-14T11:37:16.572688Z INFO awscrt::connection-manager: id=0x564afdff71c0: Requesting 1 new connections from http | |
| 2024-11-14T11:37:16.572692Z DEBUG awscrt::channel-bootstrap: id=0x564afdff2cb0: acquiring bootstrap reference | |
| 2024-11-14T11:37:16.572696Z DEBUG awscrt::dns: id=0x564afdff3ee0: Host resolution requested for 169.254.169.254 | |
| 2024-11-14T11:37:16.572699Z DEBUG awscrt::dns: id=0x564afdff3ee0: No cached entries found for 169.254.169.254 starting new resolver thread. | |
| 2024-11-14T11:37:16.572780Z DEBUG awscrt::dns: static: resolving host 169.254.169.254 | |
| 2024-11-14T11:37:16.572816Z DEBUG awscrt::dns: static: resolved record: 169.254.169.254 | |
| 2024-11-14T11:37:16.572821Z DEBUG awscrt::dns: static, resolving host 169.254.169.254 successful, returned 1 addresses | |
| 2024-11-14T11:37:16.572826Z DEBUG awscrt::dns: static: new address resolved 169.254.169.254 for host 169.254.169.254 caching | |
| 2024-11-14T11:37:16.572830Z DEBUG awscrt::dns: static, invoking resolution callback for host 169.254.169.254 with 1 addresses | |
| 2024-11-14T11:37:16.572867Z DEBUG awscrt::socket: id=0x7fa810000f20 fd=16: initializing with domain 0 and type 0 | |
| 2024-11-14T11:37:16.572874Z DEBUG awscrt::socket: id=0x7fa810000f20 fd=16: setting socket options to: keep-alive 0, keep idle 0, keep-alive interval 0, keep-alive probe count 0. | |
| 2024-11-14T11:37:16.572879Z DEBUG awscrt::socket: id=0x7fa810000f20 fd=16: beginning connect. | |
| 2024-11-14T11:37:16.572883Z DEBUG awscrt::socket: id=0x7fa810000f20 fd=16: connecting to endpoint 169.254.169.254:80. | |
| 2024-11-14T11:37:16.579750Z DEBUG awscrt::socket: id=0x7fa810000f20 fd=16: connection failure | |
| 2024-11-14T11:37:16.579764Z DEBUG awscrt::channel-bootstrap: id=0x564afdff2cb0: client connection on socket 0x7fa810000f20 completed with error 1049. | |
| 2024-11-14T11:37:16.579768Z DEBUG awscrt::channel-bootstrap: id=0x564afdff2cb0: recording bad address 169.254.169.254. | |
| 2024-11-14T11:37:16.579771Z INFO awscrt::dns: id=0x564afdff3ee0: recording failure for record 169.254.169.254 for 169.254.169.254, moving to bad list | |
| 2024-11-14T11:37:16.579777Z DEBUG awscrt::dns: static: purging address 169.254.169.254 for host 169.254.169.254 from the cache due to cache eviction or shutdown | |
| 2024-11-14T11:37:16.579780Z DEBUG awscrt::socket: id=0x7fa810000f20 fd=16: closing | |
| 2024-11-14T11:37:16.579807Z ERROR awscrt::channel-bootstrap: id=0x564afdff2cb0: Connection failed with error_code 1049. | |
| 2024-11-14T11:37:16.579812Z ERROR awscrt::http-connection: static: Client connection failed with error 1049 (AWS_IO_SOCKET_NO_ROUTE_TO_HOST). | |
| 2024-11-14T11:37:16.579815Z WARN awscrt::connection-manager: id=0x564afdff71c0: Failed to obtain new connection from http layer, error 1049(socket connect failure, no route to host.) | |
| 2024-11-14T11:37:16.579818Z DEBUG awscrt::connection-manager: id=0x564afdff71c0: Failing excess connection acquisition with error code 1049 | |
| 2024-11-14T11:37:16.579822Z DEBUG awscrt::connection-manager: id=0x564afdff71c0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=0, ref_count=1 | |
| 2024-11-14T11:37:16.579829Z WARN awscrt::connection-manager: id=0x564afdff71c0: Failed to complete connection acquisition with error_code 1049(socket connect failure, no route to host.) | |
| 2024-11-14T11:37:16.579833Z WARN awscrt::Unknown: id=0x564afe004810: IMDS Client failed to acquire a connection, error code 1049(socket connect failure, no route to host.) | |
| 2024-11-14T11:37:16.579836Z DEBUG awscrt::Unknown: (id=0x564afe004810) IMDS client failed to fetch token for requester 0x564afdfebf30, fall back to v1 for the same requester. Received response status code: 0 | |
| 2024-11-14T11:37:16.579839Z DEBUG awscrt::Unknown: (id=0x564afe004810) IMDS client failed to fetch token, fallback to v1. requester 0x564afdff6a70. | |
| 2024-11-14T11:37:16.579844Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdfecf10: Initializing retry token 0x7fa810001f10 | |
| 2024-11-14T11:37:16.579858Z ERROR awscrt::Unknown: (id=0x564afe004810) IMDS client failed to update the token from IMDS. | |
| 2024-11-14T11:37:16.579863Z DEBUG awscrt::channel-bootstrap: id=0x564afdff2cb0: releasing bootstrap reference | |
| 2024-11-14T11:37:16.579887Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdfecf10: Vending retry_token 0x7fa810001f10 | |
| 2024-11-14T11:37:16.579902Z DEBUG awscrt::Unknown: id=0x564afe004810: IMDS Client successfully acquired retry token. | |
| 2024-11-14T11:37:16.579912Z DEBUG awscrt::connection-manager: id=0x564afdff71c0: Acquire connection | |
| 2024-11-14T11:37:16.579917Z DEBUG awscrt::connection-manager: id=0x564afdff71c0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=1, pending_settings_count=0, pending_connect_count=1, vended_connection_count=0, open_connection_count=0, ref_count=1 | |
| 2024-11-14T11:37:16.579923Z INFO awscrt::connection-manager: id=0x564afdff71c0: Requesting 1 new connections from http | |
| 2024-11-14T11:37:16.579927Z DEBUG awscrt::channel-bootstrap: id=0x564afdff2cb0: acquiring bootstrap reference | |
| 2024-11-14T11:37:16.579931Z DEBUG awscrt::dns: id=0x564afdff3ee0: Host resolution requested for 169.254.169.254 | |
| 2024-11-14T11:37:16.680074Z DEBUG awscrt::dns: static: resolving host 169.254.169.254 | |
| 2024-11-14T11:37:16.680118Z DEBUG awscrt::dns: static: resolved record: 169.254.169.254 | |
| 2024-11-14T11:37:16.680124Z DEBUG awscrt::dns: static, resolving host 169.254.169.254 successful, returned 1 addresses | |
| 2024-11-14T11:37:16.680131Z INFO awscrt::dns: static: promoting spotty record 169.254.169.254 for 169.254.169.254 back to good list | |
| 2024-11-14T11:37:16.680135Z DEBUG awscrt::dns: static: purging address 169.254.169.254 for host 169.254.169.254 from the cache due to cache eviction or shutdown | |
| 2024-11-14T11:37:16.680139Z DEBUG awscrt::dns: static, invoking resolution callback for host 169.254.169.254 with 1 addresses | |
| 2024-11-14T11:37:16.680229Z DEBUG awscrt::socket: id=0x7fa80c000f20 fd=16: initializing with domain 0 and type 0 | |
| 2024-11-14T11:37:16.680257Z DEBUG awscrt::socket: id=0x7fa80c000f20 fd=16: setting socket options to: keep-alive 0, keep idle 0, keep-alive interval 0, keep-alive probe count 0. | |
| 2024-11-14T11:37:16.680264Z DEBUG awscrt::socket: id=0x7fa80c000f20 fd=16: beginning connect. | |
| 2024-11-14T11:37:16.680278Z DEBUG awscrt::socket: id=0x7fa80c000f20 fd=16: connecting to endpoint 169.254.169.254:80. | |
| 2024-11-14T11:37:16.690583Z DEBUG awscrt::socket: id=0x7fa80c000f20 fd=16: connection failure | |
| 2024-11-14T11:37:16.690606Z DEBUG awscrt::channel-bootstrap: id=0x564afdff2cb0: client connection on socket 0x7fa80c000f20 completed with error 1049. | |
| 2024-11-14T11:37:16.690610Z DEBUG awscrt::channel-bootstrap: id=0x564afdff2cb0: recording bad address 169.254.169.254. | |
| 2024-11-14T11:37:16.690614Z INFO awscrt::dns: id=0x564afdff3ee0: recording failure for record 169.254.169.254 for 169.254.169.254, moving to bad list | |
| 2024-11-14T11:37:16.690621Z DEBUG awscrt::dns: static: purging address 169.254.169.254 for host 169.254.169.254 from the cache due to cache eviction or shutdown | |
| 2024-11-14T11:37:16.690625Z DEBUG awscrt::socket: id=0x7fa80c000f20 fd=16: closing | |
| 2024-11-14T11:37:16.690647Z ERROR awscrt::channel-bootstrap: id=0x564afdff2cb0: Connection failed with error_code 1049. | |
| 2024-11-14T11:37:16.690652Z ERROR awscrt::http-connection: static: Client connection failed with error 1049 (AWS_IO_SOCKET_NO_ROUTE_TO_HOST). | |
| 2024-11-14T11:37:16.690655Z WARN awscrt::connection-manager: id=0x564afdff71c0: Failed to obtain new connection from http layer, error 1049(socket connect failure, no route to host.) | |
| 2024-11-14T11:37:16.690659Z DEBUG awscrt::connection-manager: id=0x564afdff71c0: Failing excess connection acquisition with error code 1049 | |
| 2024-11-14T11:37:16.690664Z DEBUG awscrt::connection-manager: id=0x564afdff71c0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=0, ref_count=1 | |
| 2024-11-14T11:37:16.690677Z WARN awscrt::connection-manager: id=0x564afdff71c0: Failed to complete connection acquisition with error_code 1049(socket connect failure, no route to host.) | |
| 2024-11-14T11:37:16.690681Z WARN awscrt::Unknown: id=0x564afe004810: IMDS Client failed to acquire a connection, error code 1049(socket connect failure, no route to host.) | |
| 2024-11-14T11:37:16.690707Z DEBUG awscrt::channel-bootstrap: id=0x564afdff2cb0: releasing bootstrap reference | |
| 2024-11-14T11:37:16.690734Z INFO awscrt::connection-manager: id=0x564afdff71c0: release | |
| 2024-11-14T11:37:16.690757Z INFO awscrt::connection-manager: id=0x564afdff71c0: ref count now zero, starting shut down process | |
| 2024-11-14T11:37:16.690761Z INFO awscrt::connection-manager: id=0x564afdff71c0: manager release, failing 0 pending acquisitions | |
| 2024-11-14T11:37:16.690766Z DEBUG awscrt::connection-manager: id=0x564afdff71c0: snapshot - state=2, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=0, ref_count=0 | |
| 2024-11-14T11:37:16.690770Z INFO awscrt::connection-manager: id=0x564afdff71c0: Destroying self | |
| 2024-11-14T11:37:16.690773Z DEBUG awscrt::channel-bootstrap: id=0x564afdff2cb0: releasing bootstrap reference | |
| 2024-11-14T11:37:16.690777Z DEBUG awscrt::channel-bootstrap: id=0x564afdff2cb0: bootstrap destroying | |
| 2024-11-14T11:37:16.690792Z DEBUG mountpoint_s3_client::instance_info: EC2 instance info not retrieved: ImdsQueryFailed(CrtError(Error(1049, "aws-c-io: AWS_IO_SOCKET_NO_ROUTE_TO_HOST, socket connect failure, no route to host."))) | |
| 2024-11-14T11:37:16.690811Z DEBUG awscrt::dns: static: Either no requests have been made for an address for 169.254.169.254 for the duration of the ttl, or this thread is being forcibly shutdown. Killing thread. | |
| 2024-11-14T11:37:16.690815Z WARN mountpoint_s3::cli: failed to detect network throughput. Using 10 gbps as throughput. Use --maximum-throughput-gbps CLI flag to configure a target throughput appropriate for the instance. Detection failed due to: failed to get instance type: IMDS query failed: Unknown CRT error | |
| 2024-11-14T11:37:16.690827Z INFO mountpoint_s3::cli: target network throughput 10 Gbps | |
| 2024-11-14T11:37:16.690828Z DEBUG awscrt::dns: static: purging address 169.254.169.254 for host 169.254.169.254 from the cache due to cache eviction or shutdown | |
| 2024-11-14T11:37:16.690878Z INFO awscrt::event-loop: id=0x564afdff9690: Initializing edge-triggered epoll | |
| 2024-11-14T11:37:16.690887Z INFO awscrt::event-loop: id=0x564afdff9690: Using eventfd for cross-thread notifications. | |
| 2024-11-14T11:37:16.690893Z INFO awscrt::event-loop: id=0x564afdff9690: Starting event-loop thread. | |
| 2024-11-14T11:37:16.690938Z INFO awscrt::event-loop: id=0x564afdfe6b30: Destroying event_loop | |
| 2024-11-14T11:37:16.690958Z INFO awscrt::event-loop: id=0x564afdfdd150: Initializing edge-triggered epoll | |
| 2024-11-14T11:37:16.690958Z INFO awscrt::event-loop: id=0x564afdfe6b30: Stopping event-loop thread. | |
| 2024-11-14T11:37:16.690964Z INFO awscrt::event-loop: id=0x564afdfdd150: Using eventfd for cross-thread notifications. | |
| 2024-11-14T11:37:16.690968Z INFO awscrt::event-loop: id=0x564afdfdd150: Starting event-loop thread. | |
| 2024-11-14T11:37:16.690985Z DEBUG awscrt::event-loop: id=0x564afdfe6b30: exiting main loop | |
| 2024-11-14T11:37:16.690999Z INFO awscrt::event-loop: id=0x564afdfe8210: Initializing edge-triggered epoll | |
| 2024-11-14T11:37:16.690998Z INFO awscrt::event-loop: id=0x564afdff9690: main loop started | |
| 2024-11-14T11:37:16.691004Z INFO awscrt::event-loop: id=0x564afdfe8210: Using eventfd for cross-thread notifications. | |
| 2024-11-14T11:37:16.691010Z INFO awscrt::event-loop: id=0x564afdfe8210: Starting event-loop thread. | |
| 2024-11-14T11:37:16.691012Z INFO awscrt::event-loop: id=0x564afdff9690: default timeout 100000, and max events to process per tick 100 | |
| 2024-11-14T11:37:16.691036Z INFO awscrt::event-loop: id=0x564afe03a830: Initializing edge-triggered epoll | |
| 2024-11-14T11:37:16.691037Z INFO awscrt::event-loop: id=0x564afdfd66e0: Destroying event_loop | |
| 2024-11-14T11:37:16.691041Z INFO awscrt::event-loop: id=0x564afe03a830: Using eventfd for cross-thread notifications. | |
| 2024-11-14T11:37:16.691042Z INFO awscrt::event-loop: id=0x564afdfd66e0: Stopping event-loop thread. | |
| 2024-11-14T11:37:16.691045Z INFO awscrt::event-loop: id=0x564afe03a830: Starting event-loop thread. | |
| 2024-11-14T11:37:16.691054Z INFO awscrt::event-loop: id=0x564afdfdd150: main loop started | |
| 2024-11-14T11:37:16.691068Z INFO awscrt::dns: id=0x564afdfe5f50: Initializing default host resolver with 8 max host entries. | |
| 2024-11-14T11:37:16.691068Z DEBUG awscrt::event-loop: id=0x564afdfd66e0: exiting main loop | |
| 2024-11-14T11:37:16.691078Z INFO awscrt::channel-bootstrap: id=0x564afe03b630: Initializing client bootstrap with event-loop group 0x564afdffac50 | |
| 2024-11-14T11:37:16.691080Z INFO awscrt::event-loop: id=0x564afdfdd150: default timeout 100000, and max events to process per tick 100 | |
| 2024-11-14T11:37:16.691083Z INFO awscrt::standard-retry-strategy: static: creating new standard retry strategy | |
| 2024-11-14T11:37:16.691086Z INFO awscrt::standard-retry-strategy: id=0x564afdff7e30: creating backing exponential backoff strategy with max_retries of 9 | |
| 2024-11-14T11:37:16.691090Z INFO awscrt::exp-backoff-strategy: id=0x564afdffabd0: Initializing exponential backoff retry strategy with scale factor: 500 jitter mode: 2 and max retries 9 | |
| 2024-11-14T11:37:16.691093Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: maximum bucket capacity set to 500 | |
| 2024-11-14T11:37:16.691098Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100): TLS context not provided, initializing a new one for credentials provider. | |
| 2024-11-14T11:37:16.691101Z INFO awscrt::event-loop: id=0x564afe03a830: main loop started | |
| 2024-11-14T11:37:16.691111Z INFO awscrt::event-loop: id=0x564afdff8d60: Destroying event_loop | |
| 2024-11-14T11:37:16.691123Z INFO awscrt::event-loop: id=0x564afdff8d60: Stopping event-loop thread. | |
| 2024-11-14T11:37:16.691125Z INFO awscrt::event-loop: id=0x564afe03a830: default timeout 100000, and max events to process per tick 100 | |
| 2024-11-14T11:37:16.691142Z DEBUG awscrt::event-loop: id=0x564afdff8d60: exiting main loop | |
| 2024-11-14T11:37:16.691189Z INFO awscrt::event-loop: id=0x564afdff8d10: Destroying event_loop | |
| 2024-11-14T11:37:16.691193Z INFO awscrt::event-loop: id=0x564afdff8d10: Stopping event-loop thread. | |
| 2024-11-14T11:37:16.691127Z INFO awscrt::event-loop: id=0x564afdfe8210: main loop started | |
| 2024-11-14T11:37:16.691205Z INFO awscrt::event-loop: id=0x564afdfe8210: default timeout 100000, and max events to process per tick 100 | |
| 2024-11-14T11:37:16.691219Z DEBUG awscrt::event-loop: id=0x564afdff8d10: exiting main loop | |
| 2024-11-14T11:37:16.706376Z DEBUG awscrt::AWSProfile: Creating profile collection from file at "/home/jovyan/.aws/config" | |
| 2024-11-14T11:37:16.706452Z ERROR awscrt::common-io: static: Failed to open file. path:'/home/jovyan/.aws/config' mode:'rb' errno:2 aws-error:44(AWS_ERROR_FILE_INVALID_PATH) | |
| 2024-11-14T11:37:16.706456Z DEBUG awscrt::AWSProfile: Failed to read file at "/home/jovyan/.aws/config" | |
| 2024-11-14T11:37:16.706459Z DEBUG awscrt::AWSProfile: Creating profile collection from file at "/home/jovyan/.aws/credentials" | |
| 2024-11-14T11:37:16.706464Z ERROR awscrt::common-io: static: Failed to open file. path:'/home/jovyan/.aws/credentials' mode:'rb' errno:2 aws-error:44(AWS_ERROR_FILE_INVALID_PATH) | |
| 2024-11-14T11:37:16.706466Z DEBUG awscrt::AWSProfile: Failed to read file at "/home/jovyan/.aws/credentials" | |
| 2024-11-14T11:37:16.706470Z ERROR awscrt::AuthCredentialsProvider: static: Profile credentials parser could not load or parse a credentials or config file. | |
| 2024-11-14T11:37:16.706482Z DEBUG awscrt::AWSProfile: Creating profile collection from file at "/home/jovyan/.aws/config" | |
| 2024-11-14T11:37:16.706487Z ERROR awscrt::common-io: static: Failed to open file. path:'/home/jovyan/.aws/config' mode:'rb' errno:2 aws-error:44(AWS_ERROR_FILE_INVALID_PATH) | |
| 2024-11-14T11:37:16.706490Z DEBUG awscrt::AWSProfile: Failed to read file at "/home/jovyan/.aws/config" | |
| 2024-11-14T11:37:16.706493Z ERROR awscrt::AuthCredentialsProvider: Failed to build config profile collection from file at (/home/jovyan/.aws/config) : Invalid file path. | |
| 2024-11-14T11:37:16.706497Z INFO awscrt::AuthCredentialsProvider: ECS provider: Unable to initialize from environment because AWS_CONTAINER_CREDENTIALS_FULL_URI and AWS_CONTAINER_CREDENTIALS_RELATIVE_URI are not set. | |
| 2024-11-14T11:37:16.706501Z INFO awscrt::AuthCredentialsProvider: default chain: IMDS credentials provider will be used to retrieve credentials | |
| 2024-11-14T11:37:16.706507Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: acquiring bootstrap reference | |
| 2024-11-14T11:37:16.706510Z INFO awscrt::connection-manager: id=0x564afe157240: Successfully created | |
| 2024-11-14T11:37:16.706514Z INFO awscrt::exp-backoff-strategy: id=0x564afe1574a0: Initializing exponential backoff retry strategy with scale factor: 0 jitter mode: 0 and max retries 1 | |
| 2024-11-14T11:37:16.707388Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: acquiring bootstrap reference | |
| 2024-11-14T11:37:16.712472Z INFO awscrt::event-loop: id=0x564afe120fa0: Initializing edge-triggered epoll | |
| 2024-11-14T11:37:16.712487Z INFO awscrt::event-loop: id=0x564afe120fa0: Using eventfd for cross-thread notifications. | |
| 2024-11-14T11:37:16.712494Z INFO awscrt::event-loop: id=0x564afe120fa0: Starting event-loop thread. | |
| 2024-11-14T11:37:16.712547Z INFO awscrt::event-loop: id=0x564afe11e200: Initializing edge-triggered epoll | |
| 2024-11-14T11:37:16.712552Z INFO awscrt::event-loop: id=0x564afe11e200: Using eventfd for cross-thread notifications. | |
| 2024-11-14T11:37:16.712556Z INFO awscrt::event-loop: id=0x564afe11e200: Starting event-loop thread. | |
| 2024-11-14T11:37:16.712592Z INFO awscrt::event-loop: id=0x564afe11d800: Initializing edge-triggered epoll | |
| 2024-11-14T11:37:16.712589Z INFO awscrt::event-loop: id=0x564afe120fa0: main loop started | |
| 2024-11-14T11:37:16.712598Z INFO awscrt::event-loop: id=0x564afe11d800: Using eventfd for cross-thread notifications. | |
| 2024-11-14T11:37:16.712609Z INFO awscrt::event-loop: id=0x564afe11d800: Starting event-loop thread. | |
| 2024-11-14T11:37:16.712613Z INFO awscrt::event-loop: id=0x564afe120fa0: default timeout 100000, and max events to process per tick 100 | |
| 2024-11-14T11:37:16.712614Z INFO awscrt::event-loop: id=0x564afe11e200: main loop started | |
| 2024-11-14T11:37:16.712635Z INFO awscrt::event-loop: id=0x564afe11e200: default timeout 100000, and max events to process per tick 100 | |
| 2024-11-14T11:37:16.712652Z INFO awscrt::event-loop: id=0x564afe11ca00: Initializing edge-triggered epoll | |
| 2024-11-14T11:37:16.712659Z INFO awscrt::event-loop: id=0x564afe11ca00: Using eventfd for cross-thread notifications. | |
| 2024-11-14T11:37:16.712663Z INFO awscrt::event-loop: id=0x564afe11ca00: Starting event-loop thread. | |
| 2024-11-14T11:37:16.712674Z INFO awscrt::event-loop: id=0x564afe11d800: main loop started | |
| 2024-11-14T11:37:16.712696Z INFO awscrt::event-loop: id=0x564afe11d800: default timeout 100000, and max events to process per tick 100 | |
| 2024-11-14T11:37:16.712748Z INFO awscrt::event-loop: id=0x564afe11ca00: main loop started | |
| 2024-11-14T11:37:16.712766Z INFO awscrt::event-loop: id=0x564afe11ca00: default timeout 100000, and max events to process per tick 100 | |
| 2024-11-14T11:37:16.717159Z DEBUG list_objects{id=0 bucket="csnow-bucket" continued=false delimiter="" max_keys="0" prefix=""}: mountpoint_s3_client::s3_crt_client::list_objects: new request | |
| 2024-11-14T11:37:16.717181Z INFO awscrt::S3Client: id=0x564afe0dbeb0 Initiating making of meta request | |
| 2024-11-14T11:37:16.717191Z DEBUG awscrt::S3MetaRequest: id=0x564afe23b120 Created new Default Meta Request. operation=ListObjectsV2 | |
| 2024-11-14T11:37:16.717195Z DEBUG awscrt::dns: id=0x564afdfe5f50: Host resolution requested for 172.200.201.1 | |
| 2024-11-14T11:37:16.717199Z DEBUG awscrt::dns: id=0x564afdfe5f50: No cached entries found for 172.200.201.1 starting new resolver thread. | |
| 2024-11-14T11:37:16.717275Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: acquiring bootstrap reference | |
| 2024-11-14T11:37:16.717280Z INFO awscrt::connection-manager: id=0x564afe247d70: Successfully created | |
| 2024-11-14T11:37:16.717283Z DEBUG awscrt::S3Endpoint: id=0x564afe159a30: Created connection manager 0x564afe247d70 for endpoint | |
| 2024-11-14T11:37:16.717294Z INFO awscrt::S3Client: id=0x564afe0dbeb0: Created meta request 0x564afe23b120 | |
| 2024-11-14T11:37:16.717323Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:16.717324Z DEBUG awscrt::dns: static: resolving host 172.200.201.1 | |
| 2024-11-14T11:37:16.717345Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:16.717349Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:16.717350Z DEBUG awscrt::dns: static: resolved record: 172.200.201.1 | |
| 2024-11-14T11:37:16.717355Z DEBUG awscrt::dns: static, resolving host 172.200.201.1 successful, returned 1 addresses | |
| 2024-11-14T11:37:16.717356Z DEBUG awscrt::S3MetaRequest: id=0x564afe23b120: Meta Request Default created request 0x7fa7f40010c0 | |
| 2024-11-14T11:37:16.717360Z DEBUG awscrt::dns: static: new address resolved 172.200.201.1 for host 172.200.201.1 caching | |
| 2024-11-14T11:37:16.717365Z DEBUG awscrt::dns: static, invoking resolution callback for host 172.200.201.1 with 1 addresses | |
| 2024-11-14T11:37:16.717368Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:16.717374Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:16.717400Z DEBUG awscrt::S3MetaRequest: id=0x564afe23b120: Meta Request prepared request 0x7fa7f40010c0 | |
| 2024-11-14T11:37:16.717455Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:16.717467Z INFO awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider has expired credentials. Requerying. | |
| 2024-11-14T11:37:16.717471Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe157440) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:16.717477Z INFO awscrt::AuthCredentialsProvider: id=0x564afe03ba10: Loaded credentials from environment variables | |
| 2024-11-14T11:37:16.717481Z INFO awscrt::AuthCredentialsProvider: (id=0x564afe157440) Credentials provider chain callback terminating on index 1, with valid credentials and error code 0 | |
| 2024-11-14T11:37:16.717484Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider next refresh time set to 149835377121568 | |
| 2024-11-14T11:37:16.717487Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider succesfully sourced credentials on refresh | |
| 2024-11-14T11:37:16.717489Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider notifying pending queries of new credentials | |
| 2024-11-14T11:37:16.717492Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:16.717523Z INFO awscrt::AuthSigning: (id=0x7fa7f8000b70) Signing successfully built canonical request for algorithm SigV4, with contents | |
| GET | |
| /csnow-bucket/ | |
| delimiter=&list-type=2&max-keys=0&prefix= | |
| accept:application/xml | |
| content-length:0 | |
| host:172.200.201.1:80 | |
| x-amz-content-sha256:UNSIGNED-PAYLOAD | |
| x-amz-date:20241114T113716Z | |
| x-amz-optional-object-attributes:RestoreStatus | |
| accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes | |
| UNSIGNED-PAYLOAD | |
| 2024-11-14T11:37:16.717529Z INFO awscrt::AuthSigning: (id=0x7fa7f8000b70) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 | |
| 20241114T113716Z | |
| 20241114/VAST/s3/aws4_request | |
| a836781f7edc7b9848b1ebbf5bba4cc59da7bf9c3ec6d057ac518ca7ba67f0c2 | |
| 2024-11-14T11:37:16.717545Z INFO awscrt::AuthSigning: (id=0x7fa7f8000b70) Http request successfully built final authorization value via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241114/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes, Signature=ba76e99aa93b1ab94148b812481db17b5b10bb0051e5b7d70f1c080f201a6232 | |
| 2024-11-14T11:37:16.717565Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:16.717570Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:16.717572Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:16.717575Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:16.717580Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: attempting to acquire retry token for partition_id 172.200.201.1:80 | |
| 2024-11-14T11:37:16.717583Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket for partition_id 172.200.201.1:80 does not exist, attempting to create one | |
| 2024-11-14T11:37:16.717587Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket 0x7fa7f40019f0 for partition_id 172.200.201.1:80 created | |
| 2024-11-14T11:37:16.717590Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Initializing retry token 0x7fa7f4001ae0 | |
| 2024-11-14T11:37:16.717605Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:16.717636Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Vending retry_token 0x7fa7f4001ae0 | |
| 2024-11-14T11:37:16.717653Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: token acquired callback invoked with error Success. with token 0x7fa7f4001900 and nested token 0x7fa7f4001ae0 | |
| 2024-11-14T11:37:16.717657Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Acquire connection | |
| 2024-11-14T11:37:16.717663Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=1, pending_settings_count=0, pending_connect_count=1, vended_connection_count=0, open_connection_count=0, ref_count=1 | |
| 2024-11-14T11:37:16.717670Z INFO awscrt::connection-manager: id=0x564afe247d70: Requesting 1 new connections from http | |
| 2024-11-14T11:37:16.717676Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: acquiring bootstrap reference | |
| 2024-11-14T11:37:16.717680Z DEBUG awscrt::dns: id=0x564afdfe5f50: Host resolution requested for 172.200.201.1 | |
| 2024-11-14T11:37:16.717683Z DEBUG awscrt::dns: id=0x564afdfe5f50: cached entries found for 172.200.201.1 returning to caller. | |
| 2024-11-14T11:37:16.717707Z DEBUG awscrt::socket: id=0x7fa80c002060 fd=24: initializing with domain 0 and type 0 | |
| 2024-11-14T11:37:16.717711Z DEBUG awscrt::socket: id=0x7fa80c002060 fd=24: setting socket options to: keep-alive 0, keep idle 0, keep-alive interval 0, keep-alive probe count 0. | |
| 2024-11-14T11:37:16.717716Z DEBUG awscrt::socket: id=0x7fa80c002060 fd=24: beginning connect. | |
| 2024-11-14T11:37:16.717720Z DEBUG awscrt::socket: id=0x7fa80c002060 fd=24: connecting to endpoint 172.200.201.1:80. | |
| 2024-11-14T11:37:16.718049Z INFO awscrt::socket: id=0x7fa80c002060 fd=24: connection success | |
| 2024-11-14T11:37:16.718056Z DEBUG awscrt::socket: id=0x7fa80c002060 fd=24: assigning to event loop 0x564afdfdd150 | |
| 2024-11-14T11:37:16.718061Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: client connection on socket 0x7fa80c002060 completed with error 0. | |
| 2024-11-14T11:37:16.718064Z DEBUG awscrt::channel: id=0x7fa80c002560: Beginning creation and setup of new channel. | |
| 2024-11-14T11:37:16.718067Z DEBUG awscrt::channel: id=0x7fa80c002560: setup complete, notifying caller. | |
| 2024-11-14T11:37:16.718071Z DEBUG awscrt::channel: id=0x7fa80c002560: no message pool is currently stored in the event-loop local storage, adding 0x7fa80c002290 with max message size 16384, message count 4, with 4 small blocks of 128 bytes. | |
| 2024-11-14T11:37:16.718083Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: channel 0x7fa80c002560 setup succeeded: bootstrapping. | |
| 2024-11-14T11:37:16.718087Z DEBUG awscrt::socket-handler: id=0x7fa80c001f30: Socket handler created with max_read_size of 16384 | |
| 2024-11-14T11:37:16.718095Z INFO awscrt::http-connection: id=0x7fa80c013190: HTTP/1.1 client connection established. | |
| 2024-11-14T11:37:16.718098Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Received new connection (id=0x7fa80c013190) from http layer | |
| 2024-11-14T11:37:16.718101Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Grabbing pooled connection (0x7fa80c013190) | |
| 2024-11-14T11:37:16.718105Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:16.718108Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Successfully completed connection acquisition with connection id=0x7fa80c013190 | |
| 2024-11-14T11:37:16.718118Z DEBUG awscrt::http-stream: id=0x7fa80c0136c0: Created client request on connection=0x7fa80c013190: GET /csnow-bucket/?list-type=2&delimiter=&max-keys=0&prefix= HTTP/1.1 | |
| 2024-11-14T11:37:16.720257Z DEBUG awscrt::http-stream: id=0x7fa80c0136c0: Client request complete, response status: 200 (OK). | |
| 2024-11-14T11:37:16.720273Z DEBUG awscrt::S3MetaRequest: id=0x564afe23b120: Request 0x7fa7f40010c0 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
| 2024-11-14T11:37:16.720283Z DEBUG awscrt::standard-retry-strategy: token_id=0x7fa7f4001900: partition=172.200.201.1:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
| 2024-11-14T11:37:16.720310Z DEBUG awscrt::connection-manager: id=0x564afe247d70: User releasing connection (id=0x7fa80c013190) | |
| 2024-11-14T11:37:16.720315Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:16.720320Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:16.720334Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:16.720338Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:16.720342Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:16.720352Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:1 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:16.720366Z DEBUG list_objects{id=0 bucket="csnow-bucket" continued=false delimiter="" max_keys="0" prefix=""}: mountpoint_s3_client::s3_crt_client: S3 request finished request_type=Default crt_error=None http_status=200 range=None duration=2.961246ms ttfb=Some(2.072889ms) request_id=1360310035f278 | |
| 2024-11-14T11:37:16.720421Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:16.720425Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:16.720427Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:16.720432Z DEBUG awscrt::S3MetaRequest: id=0x564afe23b120 Meta request finished with error code 0 (Success.) | |
| 2024-11-14T11:37:16.720454Z DEBUG list_objects{id=0 bucket="csnow-bucket" continued=false delimiter="" max_keys="0" prefix=""}: mountpoint_s3_client::s3_crt_client: meta request finished duration=3.260746ms | |
| 2024-11-14T11:37:16.720472Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:16.720476Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:16.720501Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:16.720500Z DEBUG awscrt::S3MetaRequest: id=0x564afe23b120 Cleaning up meta request | |
| 2024-11-14T11:37:16.720504Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:16.720514Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:16.720516Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:16.720520Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:16.720665Z DEBUG mountpoint_s3::cli: using S3 personality Standard for bucket csnow-bucket | |
| 2024-11-14T11:37:16.786153Z DEBUG mountpoint_s3::mem_limiter: target memory usage is 22.28 GiB with 2.78 GiB reserved memory | |
| 2024-11-14T11:37:16.786193Z DEBUG mountpoint_s3::cli: creating fuse session fuse_session_config=FuseSessionConfig { mount_point: "/home/jovyan/s3", options: [DefaultPermissions, FSName("mountpoint-s3"), NoAtime], max_threads: 16 } | |
| 2024-11-14T11:37:16.786204Z INFO fuser::session: Mounting /home/jovyan/s3 | |
| 2024-11-14T11:37:16.790172Z INFO mountpoint_s3::cli: successfully mounted bucket csnow-bucket at /home/jovyan/s3 | |
| 2024-11-14T11:37:16.790214Z DEBUG mountpoint_s3::fuse::session: starting fuse worker 0 (thread id 132987) | |
| 2024-11-14T11:37:16.790286Z DEBUG fuser::request: FUSE( 2) ino 0x0000000000000000 INIT kernel ABI 7.34, capabilities 0x33fffffb, max readahead 131072 | |
| 2024-11-14T11:37:16.790354Z DEBUG mountpoint_s3::fuse::session: starting fuse worker 1 (thread id 132988) | |
| 2024-11-14T11:37:16.791992Z DEBUG fuser::request: INIT response: ABI 7.28, flags 0x402021, max readahead 131072, max write 16777216 | |
| 2024-11-14T11:37:16.792068Z DEBUG mountpoint_s3::cli: success status flag received from child process | |
| 2024-11-14T11:37:17.717572Z DEBUG awscrt::dns: static: resolving host 172.200.201.1 | |
| 2024-11-14T11:37:17.717617Z DEBUG awscrt::dns: static: resolved record: 172.200.201.1 | |
| 2024-11-14T11:37:17.717621Z DEBUG awscrt::dns: static, resolving host 172.200.201.1 successful, returned 1 addresses | |
| 2024-11-14T11:37:17.718401Z DEBUG awscrt::channel: id=0x7fa80c002560: channel throughput - 291000 bytes per second | |
| 2024-11-14T11:37:18.717818Z DEBUG awscrt::dns: static: resolving host 172.200.201.1 | |
| 2024-11-14T11:37:18.717858Z DEBUG awscrt::dns: static: resolved record: 172.200.201.1 | |
| 2024-11-14T11:37:18.717863Z DEBUG awscrt::dns: static, resolving host 172.200.201.1 successful, returned 1 addresses | |
| 2024-11-14T11:37:18.718474Z DEBUG awscrt::channel: id=0x7fa80c002560: channel throughput - 0 bytes per second | |
| 2024-11-14T11:37:19.048697Z DEBUG fuser::request: FUSE( 4) ino 0x0000000000000001 GETATTR | |
| 2024-11-14T11:37:19.049535Z DEBUG fuser::request: FUSE( 6) ino 0x0000000000000001 OPENDIR flags 0x18800 | |
| 2024-11-14T11:37:19.049723Z DEBUG fuser::request: FUSE( 8) ino 0x0000000000000001 READDIRPLUS fh FileHandle(1), offset 0, size 4096 | |
| 2024-11-14T11:37:19.049906Z DEBUG readdirplus{req=8 ino=1 fh=1 offset=0}:list_objects{id=1 bucket="csnow-bucket" continued=false delimiter="/" max_keys="1000" prefix=""}: mountpoint_s3_client::s3_crt_client::list_objects: new request | |
| 2024-11-14T11:37:19.049923Z INFO readdirplus{req=8 ino=1 fh=1 offset=0}: awscrt::S3Client: id=0x564afe0dbeb0 Initiating making of meta request | |
| 2024-11-14T11:37:19.049940Z DEBUG readdirplus{req=8 ino=1 fh=1 offset=0}: awscrt::S3MetaRequest: id=0x7fa7bc005b50 Created new Default Meta Request. operation=ListObjectsV2 | |
| 2024-11-14T11:37:19.049959Z INFO readdirplus{req=8 ino=1 fh=1 offset=0}: awscrt::S3Client: id=0x564afe0dbeb0: Created meta request 0x7fa7bc005b50 | |
| 2024-11-14T11:37:19.050013Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:19.050033Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:19.050037Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:19.050045Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc005b50: Meta Request Default created request 0x7fa7f4002820 | |
| 2024-11-14T11:37:19.050060Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:19.050066Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:19.050106Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc005b50: Meta Request prepared request 0x7fa7f4002820 | |
| 2024-11-14T11:37:19.050137Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:19.050155Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider successfully sourced from cache | |
| 2024-11-14T11:37:19.050158Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:19.050185Z INFO awscrt::AuthSigning: (id=0x7fa810000bf0) Signing successfully built canonical request for algorithm SigV4, with contents | |
| GET | |
| /csnow-bucket/ | |
| delimiter=%2F&list-type=2&max-keys=1000&prefix= | |
| accept:application/xml | |
| content-length:0 | |
| host:172.200.201.1:80 | |
| x-amz-content-sha256:UNSIGNED-PAYLOAD | |
| x-amz-date:20241114T113719Z | |
| x-amz-optional-object-attributes:RestoreStatus | |
| accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes | |
| UNSIGNED-PAYLOAD | |
| 2024-11-14T11:37:19.050192Z INFO awscrt::AuthSigning: (id=0x7fa810000bf0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 | |
| 20241114T113719Z | |
| 20241114/VAST/s3/aws4_request | |
| 827025cd1868c6a0119d1aab2598d97933ecc5ac80da196675c1d94ce43eb21a | |
| 2024-11-14T11:37:19.050204Z INFO awscrt::AuthSigning: (id=0x7fa810000bf0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241114/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes, Signature=1f1c4f8e581b7be5f1db65621a4f7cb0213ed9408227ef72863833732ae7b54a | |
| 2024-11-14T11:37:19.050224Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:19.050229Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:19.050231Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:19.050234Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:19.050239Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: attempting to acquire retry token for partition_id 172.200.201.1:80 | |
| 2024-11-14T11:37:19.050244Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket 0x7fa7f40019f0 for partition_id 172.200.201.1:80 found | |
| 2024-11-14T11:37:19.050249Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Initializing retry token 0x7fa7f40046f0 | |
| 2024-11-14T11:37:19.050264Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:19.050292Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Vending retry_token 0x7fa7f40046f0 | |
| 2024-11-14T11:37:19.050301Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: token acquired callback invoked with error Success. with token 0x7fa7f4002ac0 and nested token 0x7fa7f40046f0 | |
| 2024-11-14T11:37:19.050305Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Acquire connection | |
| 2024-11-14T11:37:19.050309Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Grabbing pooled connection (0x7fa80c013190) | |
| 2024-11-14T11:37:19.050315Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:19.050355Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Successfully completed connection acquisition with connection id=0x7fa80c013190 | |
| 2024-11-14T11:37:19.050391Z DEBUG awscrt::http-stream: id=0x7fa80c014cb0: Created client request on connection=0x7fa80c013190: GET /csnow-bucket/?list-type=2&delimiter=%2F&max-keys=1000&prefix= HTTP/1.1 | |
| 2024-11-14T11:37:19.052699Z DEBUG awscrt::http-stream: id=0x7fa80c014cb0: Client request complete, response status: 200 (OK). | |
| 2024-11-14T11:37:19.052725Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc005b50: Request 0x7fa7f4002820 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
| 2024-11-14T11:37:19.052732Z DEBUG awscrt::standard-retry-strategy: token_id=0x7fa7f4002ac0: partition=172.200.201.1:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
| 2024-11-14T11:37:19.052754Z DEBUG awscrt::connection-manager: id=0x564afe247d70: User releasing connection (id=0x7fa80c013190) | |
| 2024-11-14T11:37:19.052759Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:19.052765Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:19.052778Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:19.052780Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:19.052785Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:19.052778Z DEBUG readdirplus{req=8 ino=1 fh=1 offset=0}:list_objects{id=1 bucket="csnow-bucket" continued=false delimiter="/" max_keys="1000" prefix=""}: mountpoint_s3_client::s3_crt_client: S3 request finished request_type=Default crt_error=None http_status=200 range=None duration=2.671654ms ttfb=Some(2.204733ms) request_id=1360310035f279 | |
| 2024-11-14T11:37:19.052789Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:19.052816Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:19.052820Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:19.052822Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:19.052827Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc005b50 Meta request finished with error code 0 (Success.) | |
| 2024-11-14T11:37:19.052840Z DEBUG readdirplus{req=8 ino=1 fh=1 offset=0}:list_objects{id=1 bucket="csnow-bucket" continued=false delimiter="/" max_keys="1000" prefix=""}: mountpoint_s3_client::s3_crt_client: meta request finished duration=2.914928ms | |
| 2024-11-14T11:37:19.052857Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:19.052861Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:19.052918Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:19.052917Z DEBUG readdirplus{req=8 ino=1 fh=1 offset=0}: awscrt::S3MetaRequest: id=0x7fa7bc005b50 Cleaning up meta request | |
| 2024-11-14T11:37:19.052922Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:19.052930Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:19.052933Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:19.052936Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:19.053195Z DEBUG fuser::request: FUSE( 10) ino 0x0000000000000001 READDIRPLUS fh FileHandle(1), offset 7, size 4096 | |
| 2024-11-14T11:37:19.053259Z DEBUG fuser::request: FUSE( 12) ino 0x0000000000000001 RELEASEDIR fh FileHandle(1), flags 0x18800, flush false, lock owner None | |
| 2024-11-14T11:37:19.053803Z DEBUG fuser::request: FUSE( 14) ino 0x0000000000000001 GETATTR | |
| 2024-11-14T11:37:19.718050Z DEBUG awscrt::dns: static: resolving host 172.200.201.1 | |
| 2024-11-14T11:37:19.718093Z DEBUG awscrt::dns: static: resolved record: 172.200.201.1 | |
| 2024-11-14T11:37:19.718098Z DEBUG awscrt::dns: static, resolving host 172.200.201.1 successful, returned 1 addresses | |
| 2024-11-14T11:37:19.718480Z DEBUG awscrt::channel: id=0x7fa80c002560: channel throughput - 457500 bytes per second | |
| 2024-11-14T11:37:20.718299Z DEBUG awscrt::dns: static: resolving host 172.200.201.1 | |
| 2024-11-14T11:37:20.718354Z DEBUG awscrt::dns: static: resolved record: 172.200.201.1 | |
| 2024-11-14T11:37:20.718359Z DEBUG awscrt::dns: static, resolving host 172.200.201.1 successful, returned 1 addresses | |
| 2024-11-14T11:37:20.718548Z DEBUG awscrt::channel: id=0x7fa80c002560: channel throughput - 0 bytes per second | |
| 2024-11-14T11:37:21.556108Z INFO mountpoint_s3::metrics: fs.inode_kinds[kind=directory]: 6 | |
| 2024-11-14T11:37:21.556133Z INFO mountpoint_s3::metrics: fs.inodes: 6 | |
| 2024-11-14T11:37:21.556135Z INFO mountpoint_s3::metrics: fuse.op_latency_us[op=getattr]: n=2: min=15 p10=15 p50=15 avg=31.50 p90=48 p99=48 p99.9=48 max=48 | |
| 2024-11-14T11:37:21.556137Z INFO mountpoint_s3::metrics: fuse.op_latency_us[op=init]: n=1: min=28 p10=28 p50=28 avg=28.00 p90=28 p99=28 p99.9=28 max=28 | |
| 2024-11-14T11:37:21.556139Z INFO mountpoint_s3::metrics: fuse.op_latency_us[op=opendir]: n=1: min=116 p10=116 p50=116 avg=116.00 p90=116 p99=116 p99.9=116 max=116 | |
| 2024-11-14T11:37:21.556141Z INFO mountpoint_s3::metrics: fuse.op_latency_us[op=readdirplus]: n=2: min=18 p10=18 p50=18 avg=1701.00 p90=3391 p99=3391 p99.9=3391 max=3391 | |
| 2024-11-14T11:37:21.556143Z INFO mountpoint_s3::metrics: fuse.op_latency_us[op=releasedir]: n=1: min=11 p10=11 p50=11 avg=11.00 p90=11 p99=11 p99.9=11 max=11 | |
| 2024-11-14T11:37:21.556145Z INFO mountpoint_s3::metrics: fuse.readdirplus.entries: 7 (n=2) | |
| 2024-11-14T11:37:21.556146Z INFO mountpoint_s3::metrics: process.memory_usage: 15122432 | |
| 2024-11-14T11:37:21.556148Z INFO mountpoint_s3::metrics: s3.client.buffer_pool.forced_used: 0 | |
| 2024-11-14T11:37:21.556150Z INFO mountpoint_s3::metrics: s3.client.buffer_pool.get_usage_latency_us: n=2: min=0 p10=0 p50=0 avg=0.50 p90=1 p99=1 p99.9=1 max=1 | |
| 2024-11-14T11:37:21.556152Z INFO mountpoint_s3::metrics: s3.client.buffer_pool.mem_limit: 2013265920 | |
| 2024-11-14T11:37:21.556154Z INFO mountpoint_s3::metrics: s3.client.buffer_pool.primary_allocated: 0 | |
| 2024-11-14T11:37:21.556155Z INFO mountpoint_s3::metrics: s3.client.buffer_pool.primary_cutoff: 33554432 | |
| 2024-11-14T11:37:21.556157Z INFO mountpoint_s3::metrics: s3.client.buffer_pool.primary_num_blocks: 0 | |
| 2024-11-14T11:37:21.556159Z INFO mountpoint_s3::metrics: s3.client.buffer_pool.primary_reserved: 0 | |
| 2024-11-14T11:37:21.556160Z INFO mountpoint_s3::metrics: s3.client.buffer_pool.primary_used: 0 | |
| 2024-11-14T11:37:21.556162Z INFO mountpoint_s3::metrics: s3.client.buffer_pool.secondary_reserved: 0 | |
| 2024-11-14T11:37:21.556164Z INFO mountpoint_s3::metrics: s3.client.buffer_pool.secondary_used: 0 | |
| 2024-11-14T11:37:21.556166Z INFO mountpoint_s3::metrics: s3.client.host_count[host=172.200.201.1]: 1 | |
| 2024-11-14T11:37:21.556167Z INFO mountpoint_s3::metrics: s3.client.num_auto_default_network_io: 0 | |
| 2024-11-14T11:37:21.556169Z INFO mountpoint_s3::metrics: s3.client.num_auto_ranged_copy_network_io: 0 | |
| 2024-11-14T11:37:21.556171Z INFO mountpoint_s3::metrics: s3.client.num_auto_ranged_get_network_io: 0 | |
| 2024-11-14T11:37:21.556173Z INFO mountpoint_s3::metrics: s3.client.num_auto_ranged_put_network_io: 0 | |
| 2024-11-14T11:37:21.556183Z INFO mountpoint_s3::metrics: s3.client.num_requests_being_prepared: 0 | |
| 2024-11-14T11:37:21.556185Z INFO mountpoint_s3::metrics: s3.client.num_requests_being_processed: 0 | |
| 2024-11-14T11:37:21.556187Z INFO mountpoint_s3::metrics: s3.client.num_requests_stream_queued_waiting: 0 | |
| 2024-11-14T11:37:21.556189Z INFO mountpoint_s3::metrics: s3.client.num_requests_streaming_response: 0 | |
| 2024-11-14T11:37:21.556190Z INFO mountpoint_s3::metrics: s3.client.num_total_network_io: 0 | |
| 2024-11-14T11:37:21.556192Z INFO mountpoint_s3::metrics: s3.client.request_queue_size: 0 | |
| 2024-11-14T11:37:21.556194Z INFO mountpoint_s3::metrics: s3.meta_requests.first_byte_latency_us[op=list_objects]: n=2: min=2832 p10=2847 p50=2847 avg=3000.00 p90=3167 p99=3167 p99.9=3167 max=3167 | |
| 2024-11-14T11:37:21.556196Z INFO mountpoint_s3::metrics: s3.meta_requests.total_latency_us[op=list_objects]: n=2: min=2912 p10=2927 p50=2927 avg=3088.00 p90=3263 p99=3263 p99.9=3263 max=3263 | |
| 2024-11-14T11:37:21.556197Z INFO mountpoint_s3::metrics: s3.meta_requests[op=list_objects]: 2 (n=2) | |
| 2024-11-14T11:37:21.556199Z INFO mountpoint_s3::metrics: s3.requests.first_byte_latency_us[op=list_objects,type=Default]: n=2: min=2064 p10=2079 p50=2079 avg=2136.00 p90=2207 p99=2207 p99.9=2207 max=2207 | |
| 2024-11-14T11:37:21.556201Z INFO mountpoint_s3::metrics: s3.requests.total_latency_us[op=list_objects,type=Default]: n=2: min=2656 p10=2671 p50=2671 avg=2816.00 p90=2975 p99=2975 p99.9=2975 max=2975 | |
| 2024-11-14T11:37:21.556203Z INFO mountpoint_s3::metrics: s3.requests[op=list_objects,type=Default]: 2 (n=2) | |
| 2024-11-14T11:37:21.556205Z INFO mountpoint_s3::metrics: system.available_memory: 16441352192 | |
| 2024-11-14T11:37:21.709021Z DEBUG fuser::request: FUSE( 16) ino 0x0000000000000001 LOOKUP name "nyc-data" | |
| 2024-11-14T11:37:21.709205Z DEBUG lookup{req=16 ino=1 name="nyc-data"}:head_object{id=2 bucket="csnow-bucket" key="nyc-data"}: mountpoint_s3_client::s3_crt_client::head_object: new request | |
| 2024-11-14T11:37:21.709222Z INFO lookup{req=16 ino=1 name="nyc-data"}: awscrt::S3Client: id=0x564afe0dbeb0 Initiating making of meta request | |
| 2024-11-14T11:37:21.709236Z DEBUG lookup{req=16 ino=1 name="nyc-data"}: awscrt::S3MetaRequest: id=0x7fa7bc00c0c0 Created new Default Meta Request. operation=HeadObject | |
| 2024-11-14T11:37:21.709251Z INFO lookup{req=16 ino=1 name="nyc-data"}: awscrt::S3Client: id=0x564afe0dbeb0: Created meta request 0x7fa7bc00c0c0 | |
| 2024-11-14T11:37:21.709308Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.709333Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.709337Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.709337Z DEBUG lookup{req=16 ino=1 name="nyc-data"}:list_objects{id=3 bucket="csnow-bucket" continued=false delimiter="/" max_keys="1" prefix="nyc-data/"}: mountpoint_s3_client::s3_crt_client::list_objects: new request | |
| 2024-11-14T11:37:21.709344Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc00c0c0: Meta Request Default created request 0x7fa7f40049b0 | |
| 2024-11-14T11:37:21.709345Z INFO lookup{req=16 ino=1 name="nyc-data"}: awscrt::S3Client: id=0x564afe0dbeb0 Initiating making of meta request | |
| 2024-11-14T11:37:21.709352Z DEBUG lookup{req=16 ino=1 name="nyc-data"}: awscrt::S3MetaRequest: id=0x7fa7bc007a80 Created new Default Meta Request. operation=ListObjectsV2 | |
| 2024-11-14T11:37:21.709357Z INFO lookup{req=16 ino=1 name="nyc-data"}: awscrt::S3Client: id=0x564afe0dbeb0: Created meta request 0x7fa7bc007a80 | |
| 2024-11-14T11:37:21.709361Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.709367Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.709385Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.709388Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.709391Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.709394Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc007a80: Meta Request Default created request 0x7fa7f4004af0 | |
| 2024-11-14T11:37:21.709398Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.709402Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):2/2 Requests-preparing:2 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.709414Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc00c0c0: Meta Request prepared request 0x7fa7f40049b0 | |
| 2024-11-14T11:37:21.709446Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:21.709451Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider successfully sourced from cache | |
| 2024-11-14T11:37:21.709456Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:21.709477Z INFO awscrt::AuthSigning: (id=0x7fa814000bf0) Signing successfully built canonical request for algorithm SigV4, with contents | |
| HEAD | |
| /csnow-bucket/nyc-data | |
| accept:application/xml | |
| content-length:0 | |
| host:172.200.201.1:80 | |
| x-amz-content-sha256:UNSIGNED-PAYLOAD | |
| x-amz-date:20241114T113721Z | |
| accept;content-length;host;x-amz-content-sha256;x-amz-date | |
| UNSIGNED-PAYLOAD | |
| 2024-11-14T11:37:21.709483Z INFO awscrt::AuthSigning: (id=0x7fa814000bf0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 | |
| 20241114T113721Z | |
| 20241114/VAST/s3/aws4_request | |
| bc8e55861864339f3dacf241b49417b3faf83932611f7a0bc2c76a94cd500ae1 | |
| 2024-11-14T11:37:21.709495Z INFO awscrt::AuthSigning: (id=0x7fa814000bf0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241114/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date, Signature=083d2fa8b970437b99b6541c1d3e0db5529fd81f28ac22fb15aab908fac64374 | |
| 2024-11-14T11:37:21.709517Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.709517Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc007a80: Meta Request prepared request 0x7fa7f4004af0 | |
| 2024-11-14T11:37:21.709521Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.709524Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.709525Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:21.709527Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.709528Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider successfully sourced from cache | |
| 2024-11-14T11:37:21.709531Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:21.709533Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: attempting to acquire retry token for partition_id 172.200.201.1:80 | |
| 2024-11-14T11:37:21.709537Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket 0x7fa7f40019f0 for partition_id 172.200.201.1:80 found | |
| 2024-11-14T11:37:21.709544Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Initializing retry token 0x7fa7f4004da0 | |
| 2024-11-14T11:37:21.709547Z INFO awscrt::AuthSigning: (id=0x7fa814000ff0) Signing successfully built canonical request for algorithm SigV4, with contents | |
| GET | |
| /csnow-bucket/ | |
| delimiter=%2F&list-type=2&max-keys=1&prefix=nyc-data%2F | |
| accept:application/xml | |
| content-length:0 | |
| host:172.200.201.1:80 | |
| x-amz-content-sha256:UNSIGNED-PAYLOAD | |
| x-amz-date:20241114T113721Z | |
| x-amz-optional-object-attributes:RestoreStatus | |
| accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes | |
| UNSIGNED-PAYLOAD | |
| 2024-11-14T11:37:21.709551Z INFO awscrt::AuthSigning: (id=0x7fa814000ff0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 | |
| 20241114T113721Z | |
| 20241114/VAST/s3/aws4_request | |
| 83b994bbe59b39c83e96358bbd59be65192b4a5464697fcf772581e8951d2202 | |
| 2024-11-14T11:37:21.709560Z INFO awscrt::AuthSigning: (id=0x7fa814000ff0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241114/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes, Signature=ae10fed83ff084b2b1061124b645cc19348d50d98a727e1172a6c9bff988f608 | |
| 2024-11-14T11:37:21.709564Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):2/2 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.709569Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.709572Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.709575Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.709578Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.709581Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: attempting to acquire retry token for partition_id 172.200.201.1:80 | |
| 2024-11-14T11:37:21.709583Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket 0x7fa7f40019f0 for partition_id 172.200.201.1:80 found | |
| 2024-11-14T11:37:21.709586Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Initializing retry token 0x7fa7f4004f90 | |
| 2024-11-14T11:37:21.709590Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):2/2 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/2/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.709594Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Vending retry_token 0x7fa7f4004f90 | |
| 2024-11-14T11:37:21.709598Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: token acquired callback invoked with error Success. with token 0x7fa7f4004f30 and nested token 0x7fa7f4004f90 | |
| 2024-11-14T11:37:21.709601Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Acquire connection | |
| 2024-11-14T11:37:21.709605Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Grabbing pooled connection (0x7fa80c013190) | |
| 2024-11-14T11:37:21.709609Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:21.709618Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Vending retry_token 0x7fa7f4004da0 | |
| 2024-11-14T11:37:21.709648Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: token acquired callback invoked with error Success. with token 0x7fa7f4004d40 and nested token 0x7fa7f4004da0 | |
| 2024-11-14T11:37:21.709653Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Successfully completed connection acquisition with connection id=0x7fa80c013190 | |
| 2024-11-14T11:37:21.709661Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Acquire connection | |
| 2024-11-14T11:37:21.709674Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=1, pending_settings_count=0, pending_connect_count=1, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:21.709680Z INFO awscrt::connection-manager: id=0x564afe247d70: Requesting 1 new connections from http | |
| 2024-11-14T11:37:21.709688Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: acquiring bootstrap reference | |
| 2024-11-14T11:37:21.709688Z DEBUG awscrt::http-stream: id=0x7fa80c015fd0: Created client request on connection=0x7fa80c013190: GET /csnow-bucket/?list-type=2&delimiter=%2F&max-keys=1&prefix=nyc-data%2F HTTP/1.1 | |
| 2024-11-14T11:37:21.709691Z DEBUG awscrt::dns: id=0x564afdfe5f50: Host resolution requested for 172.200.201.1 | |
| 2024-11-14T11:37:21.709696Z DEBUG awscrt::dns: id=0x564afdfe5f50: cached entries found for 172.200.201.1 returning to caller. | |
| 2024-11-14T11:37:21.709720Z DEBUG awscrt::socket: id=0x7fa7fc0019e0 fd=1: initializing with domain 0 and type 0 | |
| 2024-11-14T11:37:21.709725Z DEBUG awscrt::socket: id=0x7fa7fc0019e0 fd=1: setting socket options to: keep-alive 0, keep idle 0, keep-alive interval 0, keep-alive probe count 0. | |
| 2024-11-14T11:37:21.709730Z DEBUG awscrt::socket: id=0x7fa7fc0019e0 fd=1: beginning connect. | |
| 2024-11-14T11:37:21.709734Z DEBUG awscrt::socket: id=0x7fa7fc0019e0 fd=1: connecting to endpoint 172.200.201.1:80. | |
| 2024-11-14T11:37:21.710003Z INFO awscrt::socket: id=0x7fa7fc0019e0 fd=1: connection success | |
| 2024-11-14T11:37:21.710010Z DEBUG awscrt::socket: id=0x7fa7fc0019e0 fd=1: assigning to event loop 0x564afdff9690 | |
| 2024-11-14T11:37:21.710017Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: client connection on socket 0x7fa7fc0019e0 completed with error 0. | |
| 2024-11-14T11:37:21.710020Z DEBUG awscrt::channel: id=0x7fa7fc002040: Beginning creation and setup of new channel. | |
| 2024-11-14T11:37:21.710023Z DEBUG awscrt::channel: id=0x7fa7fc002040: setup complete, notifying caller. | |
| 2024-11-14T11:37:21.710027Z DEBUG awscrt::channel: id=0x7fa7fc002040: no message pool is currently stored in the event-loop local storage, adding 0x7fa7fc001c70 with max message size 16384, message count 4, with 4 small blocks of 128 bytes. | |
| 2024-11-14T11:37:21.710037Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: channel 0x7fa7fc002040 setup succeeded: bootstrapping. | |
| 2024-11-14T11:37:21.710041Z DEBUG awscrt::socket-handler: id=0x7fa7fc001850: Socket handler created with max_read_size of 16384 | |
| 2024-11-14T11:37:21.710050Z INFO awscrt::http-connection: id=0x7fa7fc012e20: HTTP/1.1 client connection established. | |
| 2024-11-14T11:37:21.710053Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Received new connection (id=0x7fa7fc012e20) from http layer | |
| 2024-11-14T11:37:21.710056Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Grabbing pooled connection (0x7fa7fc012e20) | |
| 2024-11-14T11:37:21.710059Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=2, open_connection_count=2, ref_count=1 | |
| 2024-11-14T11:37:21.710062Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Successfully completed connection acquisition with connection id=0x7fa7fc012e20 | |
| 2024-11-14T11:37:21.710071Z DEBUG awscrt::http-stream: id=0x7fa7fc0133c0: Created client request on connection=0x7fa7fc012e20: HEAD /csnow-bucket/nyc-data HTTP/1.1 | |
| 2024-11-14T11:37:21.711854Z DEBUG awscrt::http-stream: id=0x7fa80c015fd0: Client request complete, response status: 200 (OK). | |
| 2024-11-14T11:37:21.711854Z DEBUG awscrt::http-stream: id=0x7fa7fc0133c0: Client request complete, response status: 404 (Not Found). | |
| 2024-11-14T11:37:21.711867Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc007a80: Request 0x7fa7f4004af0 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
| 2024-11-14T11:37:21.711874Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc00c0c0: Request 0x7fa7f40049b0 finished with error code 14343 (aws-c-s3: AWS_ERROR_S3_INVALID_RESPONSE_STATUS, Invalid response status from request) and response status 404 | |
| 2024-11-14T11:37:21.711876Z DEBUG awscrt::standard-retry-strategy: token_id=0x7fa7f4004f30: partition=172.200.201.1:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
| 2024-11-14T11:37:21.711879Z ERROR awscrt::S3MetaRequest: id=0x7fa7bc00c0c0 Meta request cannot recover from error 14343 (Invalid response status from request). (request=0x7fa7f40049b0, response status=404) | |
| 2024-11-14T11:37:21.711910Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.711914Z DEBUG awscrt::connection-manager: id=0x564afe247d70: User releasing connection (id=0x7fa80c013190) | |
| 2024-11-14T11:37:21.711918Z DEBUG awscrt::connection-manager: id=0x564afe247d70: User releasing connection (id=0x7fa7fc012e20) | |
| 2024-11-14T11:37:21.711919Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.711921Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=2, ref_count=1 | |
| 2024-11-14T11:37:21.711923Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=2, ref_count=1 | |
| 2024-11-14T11:37:21.711924Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.711927Z INFO awscrt::connection-manager: id=0x564afe247d70: Releasing connection (id=0x7fa7fc012e20) | |
| 2024-11-14T11:37:21.711930Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.711935Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:1 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.711935Z INFO awscrt::http-connection: id=0x7fa7fc012e20: Shutting down connection with error code 0 (AWS_ERROR_SUCCESS). | |
| 2024-11-14T11:37:21.711940Z DEBUG awscrt::channel: id=0x7fa7fc002040: Channel shutdown is already pending, not scheduling another. | |
| 2024-11-14T11:37:21.711940Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.711943Z DEBUG awscrt::channel: id=0x7fa7fc002040: beginning shutdown process | |
| 2024-11-14T11:37:21.711944Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.711946Z DEBUG awscrt::channel: id=0x7fa7fc002040: handler 0x7fa7fc001850 shutdown in read dir completed. | |
| 2024-11-14T11:37:21.711947Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.711950Z DEBUG awscrt::channel: id=0x7fa7fc002040: handler 0x7fa7fc012e28 shutdown in read dir completed. | |
| 2024-11-14T11:37:21.711951Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.711954Z DEBUG awscrt::channel: id=0x7fa7fc002040: handler 0x7fa7fc012e28 shutdown in write dir completed. | |
| 2024-11-14T11:37:21.711955Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.711957Z DEBUG awscrt::socket: id=0x7fa7fc0019e0 fd=1: closing | |
| 2024-11-14T11:37:21.711950Z DEBUG lookup{req=16 ino=1 name="nyc-data"}:list_objects{id=3 bucket="csnow-bucket" continued=false delimiter="/" max_keys="1" prefix="nyc-data/"}: mountpoint_s3_client::s3_crt_client: S3 request finished request_type=Default crt_error=None http_status=200 range=None duration=2.42759ms ttfb=Some(2.003095ms) request_id=1360310035f27c | |
| 2024-11-14T11:37:21.711991Z DEBUG lookup{req=16 ino=1 name="nyc-data"}:head_object{id=2 bucket="csnow-bucket" key="nyc-data"}: mountpoint_s3_client::s3_crt_client: S3 request failed request_type=HeadObject crt_error=Some(Error(14343, "aws-c-s3: AWS_ERROR_S3_INVALID_RESPONSE_STATUS, Invalid response status from request")) http_status=404 range=None duration=2.491137ms ttfb=Some(1.732436ms) request_id=1360a1000d09db | |
| 2024-11-14T11:37:21.711996Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.712000Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.712002Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.712003Z DEBUG awscrt::channel: id=0x7fa7fc002040: handler 0x7fa7fc001850 shutdown in write dir completed. | |
| 2024-11-14T11:37:21.712007Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc007a80 Meta request finished with error code 0 (Success.) | |
| 2024-11-14T11:37:21.712008Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: channel 0x7fa7fc002040 shutdown with error 0. | |
| 2024-11-14T11:37:21.712012Z INFO awscrt::http-connection: 0x7fa7fc012e20: Client shutdown completed with error 0 (AWS_ERROR_SUCCESS). | |
| 2024-11-14T11:37:21.712015Z DEBUG awscrt::connection-manager: id=0x564afe247d70: shutdown received for connection (id=0x7fa7fc012e20) | |
| 2024-11-14T11:37:21.712018Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:21.712021Z DEBUG awscrt::channel: id=0x7fa7fc002040: destroying channel. | |
| 2024-11-14T11:37:21.712020Z DEBUG lookup{req=16 ino=1 name="nyc-data"}:list_objects{id=3 bucket="csnow-bucket" continued=false delimiter="/" max_keys="1" prefix="nyc-data/"}: mountpoint_s3_client::s3_crt_client: meta request finished duration=2.668691ms | |
| 2024-11-14T11:37:21.712026Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: releasing bootstrap reference | |
| 2024-11-14T11:37:21.712041Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc00c0c0 Meta request finished with error code 14343 (Invalid response status from request) | |
| 2024-11-14T11:37:21.712067Z DEBUG lookup{req=16 ino=1 name="nyc-data"}:head_object{id=2 bucket="csnow-bucket" key="nyc-data"}: mountpoint_s3_client::s3_crt_client: duration=2.828245ms request_id=1360a1000d09db error=ServiceError(NotFound) meta request failed | |
| 2024-11-14T11:37:21.712072Z DEBUG lookup{req=16 ino=1 name="nyc-data"}:head_object{id=2 bucket="csnow-bucket" key="nyc-data"}: mountpoint_s3_client::s3_crt_client: meta request result: MetaRequestResult { response_status: 404, crt_error: Error(14343, "aws-c-s3: AWS_ERROR_S3_INVALID_RESPONSE_STATUS, Invalid response status from request"), error_response_headers: Some(Headers { inner: 0x7fa7fc013c70 }), error_response_body: None } | |
| 2024-11-14T11:37:21.712078Z DEBUG lookup{req=16 ino=1 name="nyc-data"}: awscrt::S3MetaRequest: id=0x7fa7bc007a80 Cleaning up meta request | |
| 2024-11-14T11:37:21.712084Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.712090Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.712098Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.712100Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.712103Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.712106Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.712109Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.712184Z DEBUG lookup{req=16 ino=1 name="nyc-data"}: awscrt::S3MetaRequest: id=0x7fa7bc00c0c0 Cleaning up meta request | |
| 2024-11-14T11:37:21.712189Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.712193Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.712195Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.712198Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.712201Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.712242Z DEBUG fuser::request: FUSE( 18) ino 0x0000000000000005 LOOKUP name "yellow_tripdata_2024-01.parquet" | |
| 2024-11-14T11:37:21.712347Z DEBUG lookup{req=18 ino=5 name="yellow_tripdata_2024-01.parquet"}:head_object{id=4 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client::head_object: new request | |
| 2024-11-14T11:37:21.712357Z INFO lookup{req=18 ino=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0 Initiating making of meta request | |
| 2024-11-14T11:37:21.712365Z DEBUG lookup{req=18 ino=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7c8006360 Created new Default Meta Request. operation=HeadObject | |
| 2024-11-14T11:37:21.712377Z INFO lookup{req=18 ino=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0: Created meta request 0x7fa7c8006360 | |
| 2024-11-14T11:37:21.712381Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.712385Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.712388Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.712391Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c8006360: Meta Request Default created request 0x7fa7f4008760 | |
| 2024-11-14T11:37:21.712402Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.712406Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.712439Z DEBUG lookup{req=18 ino=5 name="yellow_tripdata_2024-01.parquet"}:list_objects{id=5 bucket="csnow-bucket" continued=false delimiter="/" max_keys="1" prefix="nyc-data/yellow_tripdata_2024-01.parquet/"}: mountpoint_s3_client::s3_crt_client::list_objects: new request | |
| 2024-11-14T11:37:21.712454Z INFO lookup{req=18 ino=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0 Initiating making of meta request | |
| 2024-11-14T11:37:21.712456Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c8006360: Meta Request prepared request 0x7fa7f4008760 | |
| 2024-11-14T11:37:21.712459Z DEBUG lookup{req=18 ino=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7c80081a0 Created new Default Meta Request. operation=ListObjectsV2 | |
| 2024-11-14T11:37:21.712480Z INFO lookup{req=18 ino=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0: Created meta request 0x7fa7c80081a0 | |
| 2024-11-14T11:37:21.712480Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:21.712484Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.712487Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider successfully sourced from cache | |
| 2024-11-14T11:37:21.712488Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.712491Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:21.712492Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.712497Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c80081a0: Meta Request Default created request 0x7fa7f4008910 | |
| 2024-11-14T11:37:21.712503Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.712507Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):2/2 Requests-preparing:2 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.712508Z INFO awscrt::AuthSigning: (id=0x7fa800000f20) Signing successfully built canonical request for algorithm SigV4, with contents | |
| HEAD | |
| /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet | |
| accept:application/xml | |
| content-length:0 | |
| host:172.200.201.1:80 | |
| x-amz-content-sha256:UNSIGNED-PAYLOAD | |
| x-amz-date:20241114T113721Z | |
| accept;content-length;host;x-amz-content-sha256;x-amz-date | |
| UNSIGNED-PAYLOAD | |
| 2024-11-14T11:37:21.712515Z INFO awscrt::AuthSigning: (id=0x7fa800000f20) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 | |
| 20241114T113721Z | |
| 20241114/VAST/s3/aws4_request | |
| f48a3a712bbe677b6bce63fabb8870440381a3f39d9a5e6a3555d06a3d58f0fd | |
| 2024-11-14T11:37:21.712517Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c80081a0: Meta Request prepared request 0x7fa7f4008910 | |
| 2024-11-14T11:37:21.712528Z INFO awscrt::AuthSigning: (id=0x7fa800000f20) Http request successfully built final authorization value via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241114/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date, Signature=b57c05ca9ccbf90510e84e12e7bbdfec916ae79c56012e756492bd94c161e31b | |
| 2024-11-14T11:37:21.712532Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:21.712536Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider successfully sourced from cache | |
| 2024-11-14T11:37:21.712539Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:21.712545Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.712548Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.712556Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.712558Z INFO awscrt::AuthSigning: (id=0x7fa814000ff0) Signing successfully built canonical request for algorithm SigV4, with contents | |
| GET | |
| /csnow-bucket/ | |
| delimiter=%2F&list-type=2&max-keys=1&prefix=nyc-data%2Fyellow_tripdata_2024-01.parquet%2F | |
| accept:application/xml | |
| content-length:0 | |
| host:172.200.201.1:80 | |
| x-amz-content-sha256:UNSIGNED-PAYLOAD | |
| x-amz-date:20241114T113721Z | |
| x-amz-optional-object-attributes:RestoreStatus | |
| accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes | |
| UNSIGNED-PAYLOAD | |
| 2024-11-14T11:37:21.712559Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.712562Z INFO awscrt::AuthSigning: (id=0x7fa814000ff0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 | |
| 20241114T113721Z | |
| 20241114/VAST/s3/aws4_request | |
| 79c3430359f525169037998d2521afe8b43ea4886ddb1db6df5b64e49382786c | |
| 2024-11-14T11:37:21.712564Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: attempting to acquire retry token for partition_id 172.200.201.1:80 | |
| 2024-11-14T11:37:21.712568Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket 0x7fa7f40019f0 for partition_id 172.200.201.1:80 found | |
| 2024-11-14T11:37:21.712571Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Initializing retry token 0x7fa7f4008bc0 | |
| 2024-11-14T11:37:21.712586Z INFO awscrt::AuthSigning: (id=0x7fa814000ff0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241114/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes, Signature=76d6f43cfba57dcabb59ef5d047185a6d4966a30a315bd92b5791d1ed5cb0a66 | |
| 2024-11-14T11:37:21.712591Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):2/2 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.712597Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.712599Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.712602Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.712604Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Vending retry_token 0x7fa7f4008bc0 | |
| 2024-11-14T11:37:21.712605Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.712610Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: token acquired callback invoked with error Success. with token 0x7fa7f4008b60 and nested token 0x7fa7f4008bc0 | |
| 2024-11-14T11:37:21.712610Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: attempting to acquire retry token for partition_id 172.200.201.1:80 | |
| 2024-11-14T11:37:21.712613Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Acquire connection | |
| 2024-11-14T11:37:21.712614Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket 0x7fa7f40019f0 for partition_id 172.200.201.1:80 found | |
| 2024-11-14T11:37:21.712617Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Grabbing pooled connection (0x7fa80c013190) | |
| 2024-11-14T11:37:21.712618Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Initializing retry token 0x7fa7f4008db0 | |
| 2024-11-14T11:37:21.712625Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):2/2 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/2/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.712625Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:21.712629Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Vending retry_token 0x7fa7f4008db0 | |
| 2024-11-14T11:37:21.712636Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Successfully completed connection acquisition with connection id=0x7fa80c013190 | |
| 2024-11-14T11:37:21.712638Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: token acquired callback invoked with error Success. with token 0x7fa7f4008d50 and nested token 0x7fa7f4008db0 | |
| 2024-11-14T11:37:21.712641Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Acquire connection | |
| 2024-11-14T11:37:21.712644Z DEBUG awscrt::http-stream: id=0x7fa80c017100: Created client request on connection=0x7fa80c013190: HEAD /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet HTTP/1.1 | |
| 2024-11-14T11:37:21.712645Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=1, pending_settings_count=0, pending_connect_count=1, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:21.712649Z INFO awscrt::connection-manager: id=0x564afe247d70: Requesting 1 new connections from http | |
| 2024-11-14T11:37:21.712655Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: acquiring bootstrap reference | |
| 2024-11-14T11:37:21.712659Z DEBUG awscrt::dns: id=0x564afdfe5f50: Host resolution requested for 172.200.201.1 | |
| 2024-11-14T11:37:21.712663Z DEBUG awscrt::dns: id=0x564afdfe5f50: cached entries found for 172.200.201.1 returning to caller. | |
| 2024-11-14T11:37:21.712679Z DEBUG awscrt::socket: id=0x7fa7f4009470 fd=1: initializing with domain 0 and type 0 | |
| 2024-11-14T11:37:21.712684Z DEBUG awscrt::socket: id=0x7fa7f4009470 fd=1: setting socket options to: keep-alive 0, keep idle 0, keep-alive interval 0, keep-alive probe count 0. | |
| 2024-11-14T11:37:21.712688Z DEBUG awscrt::socket: id=0x7fa7f4009470 fd=1: beginning connect. | |
| 2024-11-14T11:37:21.712691Z DEBUG awscrt::socket: id=0x7fa7f4009470 fd=1: connecting to endpoint 172.200.201.1:80. | |
| 2024-11-14T11:37:21.712871Z INFO awscrt::socket: id=0x7fa7f4009470 fd=1: connection success | |
| 2024-11-14T11:37:21.712878Z DEBUG awscrt::socket: id=0x7fa7f4009470 fd=1: assigning to event loop 0x564afdfe8210 | |
| 2024-11-14T11:37:21.712882Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: client connection on socket 0x7fa7f4009470 completed with error 0. | |
| 2024-11-14T11:37:21.712885Z DEBUG awscrt::channel: id=0x7fa7f4009890: Beginning creation and setup of new channel. | |
| 2024-11-14T11:37:21.712888Z DEBUG awscrt::channel: id=0x7fa7f4009890: setup complete, notifying caller. | |
| 2024-11-14T11:37:21.712892Z DEBUG awscrt::channel: id=0x7fa7f4009890: no message pool is currently stored in the event-loop local storage, adding 0x7fa7f40096a0 with max message size 16384, message count 4, with 4 small blocks of 128 bytes. | |
| 2024-11-14T11:37:21.712903Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: channel 0x7fa7f4009890 setup succeeded: bootstrapping. | |
| 2024-11-14T11:37:21.712907Z DEBUG awscrt::socket-handler: id=0x7fa7f4009340: Socket handler created with max_read_size of 16384 | |
| 2024-11-14T11:37:21.712914Z INFO awscrt::http-connection: id=0x7fa7f4019f90: HTTP/1.1 client connection established. | |
| 2024-11-14T11:37:21.712917Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Received new connection (id=0x7fa7f4019f90) from http layer | |
| 2024-11-14T11:37:21.712920Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Grabbing pooled connection (0x7fa7f4019f90) | |
| 2024-11-14T11:37:21.712924Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=2, open_connection_count=2, ref_count=1 | |
| 2024-11-14T11:37:21.712926Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Successfully completed connection acquisition with connection id=0x7fa7f4019f90 | |
| 2024-11-14T11:37:21.712938Z DEBUG awscrt::http-stream: id=0x7fa7f401a400: Created client request on connection=0x7fa7f4019f90: GET /csnow-bucket/?list-type=2&delimiter=%2F&max-keys=1&prefix=nyc-data%2Fyellow_tripdata_2024-01.parquet%2F HTTP/1.1 | |
| 2024-11-14T11:37:21.714194Z DEBUG awscrt::http-stream: id=0x7fa80c017100: Client request complete, response status: 200 (OK). | |
| 2024-11-14T11:37:21.714201Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c8006360: Request 0x7fa7f4008760 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
| 2024-11-14T11:37:21.714205Z DEBUG awscrt::standard-retry-strategy: token_id=0x7fa7f4008b60: partition=172.200.201.1:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
| 2024-11-14T11:37:21.714228Z DEBUG awscrt::connection-manager: id=0x564afe247d70: User releasing connection (id=0x7fa80c013190) | |
| 2024-11-14T11:37:21.714232Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=2, ref_count=1 | |
| 2024-11-14T11:37:21.714244Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.714243Z DEBUG lookup{req=18 ino=5 name="yellow_tripdata_2024-01.parquet"}:head_object{id=4 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: S3 request finished request_type=HeadObject crt_error=None http_status=200 range=None duration=1.78727ms ttfb=Some(1.50343ms) request_id=1360310035f27d | |
| 2024-11-14T11:37:21.714249Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.714255Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.714259Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.714263Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.714267Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.714270Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.714272Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.714275Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c8006360 Meta request finished with error code 0 (Success.) | |
| 2024-11-14T11:37:21.714284Z DEBUG lookup{req=18 ino=5 name="yellow_tripdata_2024-01.parquet"}:head_object{id=4 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: meta request finished duration=1.925334ms | |
| 2024-11-14T11:37:21.714299Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.714303Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.714331Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.714329Z DEBUG lookup{req=18 ino=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7c8006360 Cleaning up meta request | |
| 2024-11-14T11:37:21.714335Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.714345Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.714348Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.714351Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.716113Z DEBUG awscrt::http-stream: id=0x7fa7f401a400: Client request complete, response status: 200 (OK). | |
| 2024-11-14T11:37:21.716127Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c80081a0: Request 0x7fa7f4008910 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
| 2024-11-14T11:37:21.716131Z DEBUG awscrt::standard-retry-strategy: token_id=0x7fa7f4008d50: partition=172.200.201.1:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
| 2024-11-14T11:37:21.716144Z DEBUG awscrt::connection-manager: id=0x564afe247d70: User releasing connection (id=0x7fa7f4019f90) | |
| 2024-11-14T11:37:21.716148Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=2, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=2, ref_count=1 | |
| 2024-11-14T11:37:21.716154Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.716157Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.716160Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.716163Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.716167Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:1 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.716183Z DEBUG lookup{req=18 ino=5 name="yellow_tripdata_2024-01.parquet"}:list_objects{id=5 bucket="csnow-bucket" continued=false delimiter="/" max_keys="1" prefix="nyc-data/yellow_tripdata_2024-01.parquet/"}: mountpoint_s3_client::s3_crt_client: S3 request finished request_type=Default crt_error=None http_status=200 range=None duration=3.662583ms ttfb=Some(3.048668ms) request_id=1360a1000d09dc | |
| 2024-11-14T11:37:21.716279Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.716283Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.716285Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.716289Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c80081a0 Meta request finished with error code 0 (Success.) | |
| 2024-11-14T11:37:21.716297Z DEBUG lookup{req=18 ino=5 name="yellow_tripdata_2024-01.parquet"}:list_objects{id=5 bucket="csnow-bucket" continued=false delimiter="/" max_keys="1" prefix="nyc-data/yellow_tripdata_2024-01.parquet/"}: mountpoint_s3_client::s3_crt_client: meta request finished duration=3.839975ms | |
| 2024-11-14T11:37:21.716310Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.716313Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.716322Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.716324Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.716323Z DEBUG lookup{req=18 ino=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7c80081a0 Cleaning up meta request | |
| 2024-11-14T11:37:21.716327Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.716332Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.716335Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.716477Z DEBUG fuser::request: FUSE( 20) ino 0x0000000000000005 UNLINK name "yellow_tripdata_2024-01.parquet" | |
| 2024-11-14T11:37:21.716568Z DEBUG unlink{req=20 parent=5 name="yellow_tripdata_2024-01.parquet"}:head_object{id=6 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client::head_object: new request | |
| 2024-11-14T11:37:21.716592Z INFO unlink{req=20 parent=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0 Initiating making of meta request | |
| 2024-11-14T11:37:21.716601Z DEBUG unlink{req=20 parent=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7bc0063a0 Created new Default Meta Request. operation=HeadObject | |
| 2024-11-14T11:37:21.716613Z INFO unlink{req=20 parent=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0: Created meta request 0x7fa7bc0063a0 | |
| 2024-11-14T11:37:21.716619Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.716623Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.716626Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.716629Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc0063a0: Meta Request Default created request 0x7fa7f401ba90 | |
| 2024-11-14T11:37:21.716640Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.716643Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.716668Z DEBUG unlink{req=20 parent=5 name="yellow_tripdata_2024-01.parquet"}:list_objects{id=7 bucket="csnow-bucket" continued=false delimiter="/" max_keys="1" prefix="nyc-data/yellow_tripdata_2024-01.parquet/"}: mountpoint_s3_client::s3_crt_client::list_objects: new request | |
| 2024-11-14T11:37:21.716674Z INFO unlink{req=20 parent=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0 Initiating making of meta request | |
| 2024-11-14T11:37:21.716674Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc0063a0: Meta Request prepared request 0x7fa7f401ba90 | |
| 2024-11-14T11:37:21.716680Z DEBUG unlink{req=20 parent=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7bc00a170 Created new Default Meta Request. operation=ListObjectsV2 | |
| 2024-11-14T11:37:21.716693Z INFO unlink{req=20 parent=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0: Created meta request 0x7fa7bc00a170 | |
| 2024-11-14T11:37:21.716694Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.716697Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.716705Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.716705Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:21.716708Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc00a170: Meta Request Default created request 0x7fa7f401bc40 | |
| 2024-11-14T11:37:21.716711Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider successfully sourced from cache | |
| 2024-11-14T11:37:21.716715Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:21.716718Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.716721Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):2/2 Requests-preparing:2 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.716730Z INFO awscrt::AuthSigning: (id=0x7fa8100015c0) Signing successfully built canonical request for algorithm SigV4, with contents | |
| HEAD | |
| /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet | |
| accept:application/xml | |
| content-length:0 | |
| host:172.200.201.1:80 | |
| x-amz-content-sha256:UNSIGNED-PAYLOAD | |
| x-amz-date:20241114T113721Z | |
| accept;content-length;host;x-amz-content-sha256;x-amz-date | |
| UNSIGNED-PAYLOAD | |
| 2024-11-14T11:37:21.716730Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc00a170: Meta Request prepared request 0x7fa7f401bc40 | |
| 2024-11-14T11:37:21.716734Z INFO awscrt::AuthSigning: (id=0x7fa8100015c0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 | |
| 20241114T113721Z | |
| 20241114/VAST/s3/aws4_request | |
| f48a3a712bbe677b6bce63fabb8870440381a3f39d9a5e6a3555d06a3d58f0fd | |
| 2024-11-14T11:37:21.716739Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:21.716743Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider successfully sourced from cache | |
| 2024-11-14T11:37:21.716746Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:21.716746Z INFO awscrt::AuthSigning: (id=0x7fa8100015c0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241114/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date, Signature=b57c05ca9ccbf90510e84e12e7bbdfec916ae79c56012e756492bd94c161e31b | |
| 2024-11-14T11:37:21.716754Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.716757Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.716759Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.716762Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.716764Z INFO awscrt::AuthSigning: (id=0x7fa800001060) Signing successfully built canonical request for algorithm SigV4, with contents | |
| GET | |
| /csnow-bucket/ | |
| delimiter=%2F&list-type=2&max-keys=1&prefix=nyc-data%2Fyellow_tripdata_2024-01.parquet%2F | |
| accept:application/xml | |
| content-length:0 | |
| host:172.200.201.1:80 | |
| x-amz-content-sha256:UNSIGNED-PAYLOAD | |
| x-amz-date:20241114T113721Z | |
| x-amz-optional-object-attributes:RestoreStatus | |
| accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes | |
| UNSIGNED-PAYLOAD | |
| 2024-11-14T11:37:21.716766Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: attempting to acquire retry token for partition_id 172.200.201.1:80 | |
| 2024-11-14T11:37:21.716768Z INFO awscrt::AuthSigning: (id=0x7fa800001060) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 | |
| 20241114T113721Z | |
| 20241114/VAST/s3/aws4_request | |
| 79c3430359f525169037998d2521afe8b43ea4886ddb1db6df5b64e49382786c | |
| 2024-11-14T11:37:21.716773Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket 0x7fa7f40019f0 for partition_id 172.200.201.1:80 found | |
| 2024-11-14T11:37:21.716776Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Initializing retry token 0x7fa7f401bdf0 | |
| 2024-11-14T11:37:21.716781Z INFO awscrt::AuthSigning: (id=0x7fa800001060) Http request successfully built final authorization value via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241114/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes, Signature=76d6f43cfba57dcabb59ef5d047185a6d4966a30a315bd92b5791d1ed5cb0a66 | |
| 2024-11-14T11:37:21.716791Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):2/2 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.716795Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.716798Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.716800Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.716803Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.716806Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: attempting to acquire retry token for partition_id 172.200.201.1:80 | |
| 2024-11-14T11:37:21.716809Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket 0x7fa7f40019f0 for partition_id 172.200.201.1:80 found | |
| 2024-11-14T11:37:21.716812Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Initializing retry token 0x7fa7f401bef0 | |
| 2024-11-14T11:37:21.716816Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):2/2 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/2/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.716830Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Vending retry_token 0x7fa7f401bdf0 | |
| 2024-11-14T11:37:21.716839Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: token acquired callback invoked with error Success. with token 0x7fa7f401a2b0 and nested token 0x7fa7f401bdf0 | |
| 2024-11-14T11:37:21.716842Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Acquire connection | |
| 2024-11-14T11:37:21.716846Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Grabbing pooled connection (0x7fa7f4019f90) | |
| 2024-11-14T11:37:21.716850Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=2, ref_count=1 | |
| 2024-11-14T11:37:21.716855Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Vending retry_token 0x7fa7f401bef0 | |
| 2024-11-14T11:37:21.716856Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Successfully completed connection acquisition with connection id=0x7fa7f4019f90 | |
| 2024-11-14T11:37:21.716858Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: token acquired callback invoked with error Success. with token 0x7fa7f4008d50 and nested token 0x7fa7f401bef0 | |
| 2024-11-14T11:37:21.716861Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Acquire connection | |
| 2024-11-14T11:37:21.716864Z DEBUG awscrt::http-stream: id=0x7fa7f401c050: Created client request on connection=0x7fa7f4019f90: HEAD /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet HTTP/1.1 | |
| 2024-11-14T11:37:21.716864Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Grabbing pooled connection (0x7fa80c013190) | |
| 2024-11-14T11:37:21.716872Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=2, open_connection_count=2, ref_count=1 | |
| 2024-11-14T11:37:21.716896Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Successfully completed connection acquisition with connection id=0x7fa80c013190 | |
| 2024-11-14T11:37:21.716913Z DEBUG awscrt::http-stream: id=0x7fa80c017e30: Created client request on connection=0x7fa80c013190: GET /csnow-bucket/?list-type=2&delimiter=%2F&max-keys=1&prefix=nyc-data%2Fyellow_tripdata_2024-01.parquet%2F HTTP/1.1 | |
| 2024-11-14T11:37:21.717357Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.717361Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.717363Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.717367Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.717370Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):2/2 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/2/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.718328Z DEBUG awscrt::http-stream: id=0x7fa80c017e30: Client request complete, response status: 200 (OK). | |
| 2024-11-14T11:37:21.718336Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc00a170: Request 0x7fa7f401bc40 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
| 2024-11-14T11:37:21.718340Z DEBUG awscrt::standard-retry-strategy: token_id=0x7fa7f4008d50: partition=172.200.201.1:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
| 2024-11-14T11:37:21.718355Z DEBUG awscrt::connection-manager: id=0x564afe247d70: User releasing connection (id=0x7fa80c013190) | |
| 2024-11-14T11:37:21.718356Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.718359Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=2, ref_count=1 | |
| 2024-11-14T11:37:21.718359Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.718363Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.718367Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.718370Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.718368Z DEBUG unlink{req=20 parent=5 name="yellow_tripdata_2024-01.parquet"}:list_objects{id=7 bucket="csnow-bucket" continued=false delimiter="/" max_keys="1" prefix="nyc-data/yellow_tripdata_2024-01.parquet/"}: mountpoint_s3_client::s3_crt_client: S3 request finished request_type=Default crt_error=None http_status=200 range=None duration=1.637191ms ttfb=Some(1.363336ms) request_id=1360310035f27e | |
| 2024-11-14T11:37:21.718374Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.718380Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.718383Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.718386Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc00a170 Meta request finished with error code 0 (Success.) | |
| 2024-11-14T11:37:21.718392Z DEBUG unlink{req=20 parent=5 name="yellow_tripdata_2024-01.parquet"}:list_objects{id=7 bucket="csnow-bucket" continued=false delimiter="/" max_keys="1" prefix="nyc-data/yellow_tripdata_2024-01.parquet/"}: mountpoint_s3_client::s3_crt_client: meta request finished duration=1.716042ms | |
| 2024-11-14T11:37:21.718404Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.718408Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.718412Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.718414Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.718417Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.718420Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.718423Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.718427Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.718429Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.718427Z DEBUG unlink{req=20 parent=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7bc00a170 Cleaning up meta request | |
| 2024-11-14T11:37:21.718432Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.718441Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.718444Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.718519Z DEBUG awscrt::dns: static: resolving host 172.200.201.1 | |
| 2024-11-14T11:37:21.718535Z DEBUG awscrt::dns: static: resolved record: 172.200.201.1 | |
| 2024-11-14T11:37:21.718538Z DEBUG awscrt::dns: static, resolving host 172.200.201.1 successful, returned 1 addresses | |
| 2024-11-14T11:37:21.718539Z DEBUG awscrt::channel: id=0x7fa80c002560: channel throughput - 474000 bytes per second | |
| 2024-11-14T11:37:21.719534Z DEBUG awscrt::http-stream: id=0x7fa7f401c050: Client request complete, response status: 200 (OK). | |
| 2024-11-14T11:37:21.719552Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc0063a0: Request 0x7fa7f401ba90 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
| 2024-11-14T11:37:21.719556Z DEBUG awscrt::standard-retry-strategy: token_id=0x7fa7f401a2b0: partition=172.200.201.1:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
| 2024-11-14T11:37:21.719576Z DEBUG awscrt::connection-manager: id=0x564afe247d70: User releasing connection (id=0x7fa7f4019f90) | |
| 2024-11-14T11:37:21.719581Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=2, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=2, ref_count=1 | |
| 2024-11-14T11:37:21.719595Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.719599Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.719602Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.719606Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.719608Z DEBUG unlink{req=20 parent=5 name="yellow_tripdata_2024-01.parquet"}:head_object{id=6 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: S3 request finished request_type=HeadObject crt_error=None http_status=200 range=None duration=2.933168ms ttfb=Some(2.611386ms) request_id=1360a1000d09dd | |
| 2024-11-14T11:37:21.719614Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.719656Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.719659Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.719662Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.719665Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc0063a0 Meta request finished with error code 0 (Success.) | |
| 2024-11-14T11:37:21.719676Z DEBUG unlink{req=20 parent=5 name="yellow_tripdata_2024-01.parquet"}:head_object{id=6 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: meta request finished duration=3.080384ms | |
| 2024-11-14T11:37:21.719691Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.719694Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.719708Z DEBUG unlink{req=20 parent=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7bc0063a0 Cleaning up meta request | |
| 2024-11-14T11:37:21.719711Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.719717Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.719720Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.719722Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.719725Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.719725Z DEBUG unlink{req=20 parent=5 name="yellow_tripdata_2024-01.parquet"}: mountpoint_s3::superblock: unlink on remote file will delete key nyc-data/yellow_tripdata_2024-01.parquet parent=5 name="yellow_tripdata_2024-01.parquet" | |
| 2024-11-14T11:37:21.719734Z DEBUG unlink{req=20 parent=5 name="yellow_tripdata_2024-01.parquet"}:delete_object{id=8 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client::delete_object: new request | |
| 2024-11-14T11:37:21.719807Z INFO unlink{req=20 parent=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0 Initiating making of meta request | |
| 2024-11-14T11:37:21.719816Z DEBUG unlink{req=20 parent=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7bc008fe0 Created new Default Meta Request. operation=DeleteObject | |
| 2024-11-14T11:37:21.719826Z INFO unlink{req=20 parent=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0: Created meta request 0x7fa7bc008fe0 | |
| 2024-11-14T11:37:21.719830Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.719834Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.719836Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.719840Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc008fe0: Meta Request Default created request 0x7fa7f401cf50 | |
| 2024-11-14T11:37:21.719849Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.719852Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.719866Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc008fe0: Meta Request prepared request 0x7fa7f401cf50 | |
| 2024-11-14T11:37:21.719879Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:21.719882Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider successfully sourced from cache | |
| 2024-11-14T11:37:21.719885Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:21.719894Z INFO awscrt::AuthSigning: (id=0x7fa800000bf0) Signing successfully built canonical request for algorithm SigV4, with contents | |
| DELETE | |
| /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet | |
| accept:application/xml | |
| content-length:0 | |
| host:172.200.201.1:80 | |
| x-amz-content-sha256:UNSIGNED-PAYLOAD | |
| x-amz-date:20241114T113721Z | |
| accept;content-length;host;x-amz-content-sha256;x-amz-date | |
| UNSIGNED-PAYLOAD | |
| 2024-11-14T11:37:21.719898Z INFO awscrt::AuthSigning: (id=0x7fa800000bf0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 | |
| 20241114T113721Z | |
| 20241114/VAST/s3/aws4_request | |
| c5ba28b402c31e2f4b66a3d1d18eea1e219047b35330846e2b07524f8f01f172 | |
| 2024-11-14T11:37:21.719907Z INFO awscrt::AuthSigning: (id=0x7fa800000bf0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241114/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date, Signature=97b37b5bcadcc96a68d2b7fce2aad8a674d2ce60dfd708f537760c62afd28842 | |
| 2024-11-14T11:37:21.719922Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.719925Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.719928Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.719931Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.719934Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: attempting to acquire retry token for partition_id 172.200.201.1:80 | |
| 2024-11-14T11:37:21.719937Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket 0x7fa7f40019f0 for partition_id 172.200.201.1:80 found | |
| 2024-11-14T11:37:21.719944Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Initializing retry token 0x7fa7f401d090 | |
| 2024-11-14T11:37:21.719949Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.719953Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Vending retry_token 0x7fa7f401d090 | |
| 2024-11-14T11:37:21.719956Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: token acquired callback invoked with error Success. with token 0x7fa7f401a2b0 and nested token 0x7fa7f401d090 | |
| 2024-11-14T11:37:21.719959Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Acquire connection | |
| 2024-11-14T11:37:21.719962Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Grabbing pooled connection (0x7fa7f4019f90) | |
| 2024-11-14T11:37:21.719965Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=2, ref_count=1 | |
| 2024-11-14T11:37:21.719968Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Successfully completed connection acquisition with connection id=0x7fa7f4019f90 | |
| 2024-11-14T11:37:21.719975Z DEBUG awscrt::http-stream: id=0x7fa7f401d3f0: Created client request on connection=0x7fa7f4019f90: DELETE /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet HTTP/1.1 | |
| 2024-11-14T11:37:21.727257Z DEBUG awscrt::http-stream: id=0x7fa7f401d3f0: Client request complete, response status: 204 (No Content). | |
| 2024-11-14T11:37:21.727270Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc008fe0: Request 0x7fa7f401cf50 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 204 | |
| 2024-11-14T11:37:21.727274Z DEBUG awscrt::standard-retry-strategy: token_id=0x7fa7f401a2b0: partition=172.200.201.1:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
| 2024-11-14T11:37:21.727286Z DEBUG awscrt::connection-manager: id=0x564afe247d70: User releasing connection (id=0x7fa7f4019f90) | |
| 2024-11-14T11:37:21.727290Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=2, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=2, ref_count=1 | |
| 2024-11-14T11:37:21.727296Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.727299Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.727302Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.727306Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.727309Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.727310Z DEBUG unlink{req=20 parent=5 name="yellow_tripdata_2024-01.parquet"}:delete_object{id=8 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: S3 request finished request_type=Default crt_error=None http_status=204 range=None duration=7.440495ms ttfb=Some(7.225667ms) request_id=1360a1000d09de | |
| 2024-11-14T11:37:21.727357Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.727361Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.727363Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.727373Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc008fe0 Meta request finished with error code 0 (Success.) | |
| 2024-11-14T11:37:21.727402Z DEBUG unlink{req=20 parent=5 name="yellow_tripdata_2024-01.parquet"}:delete_object{id=8 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: meta request finished duration=7.572059ms | |
| 2024-11-14T11:37:21.727418Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.727421Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.727438Z DEBUG unlink{req=20 parent=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7bc008fe0 Cleaning up meta request | |
| 2024-11-14T11:37:21.727442Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.727448Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.727450Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.727453Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.727456Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.727480Z DEBUG fuser::request: FUSE( 22) ino 0x0000000000000007 FORGET nlookup 1 | |
| 2024-11-14T11:37:21.978527Z DEBUG fuser::request: FUSE( 24) ino 0x0000000000000005 GETATTR | |
| 2024-11-14T11:37:21.978673Z DEBUG fuser::request: FUSE( 26) ino 0x0000000000000005 LOOKUP name "yellow_tripdata_2024-01.parquet" | |
| 2024-11-14T11:37:21.978836Z DEBUG lookup{req=26 ino=5 name="yellow_tripdata_2024-01.parquet"}:head_object{id=9 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client::head_object: new request | |
| 2024-11-14T11:37:21.978853Z INFO lookup{req=26 ino=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0 Initiating making of meta request | |
| 2024-11-14T11:37:21.978868Z DEBUG lookup{req=26 ino=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7bc0167f0 Created new Default Meta Request. operation=HeadObject | |
| 2024-11-14T11:37:21.978886Z INFO lookup{req=26 ino=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0: Created meta request 0x7fa7bc0167f0 | |
| 2024-11-14T11:37:21.978925Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.978942Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.978946Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.978954Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc0167f0: Meta Request Default created request 0x7fa7f4021550 | |
| 2024-11-14T11:37:21.978954Z DEBUG lookup{req=26 ino=5 name="yellow_tripdata_2024-01.parquet"}:list_objects{id=10 bucket="csnow-bucket" continued=false delimiter="/" max_keys="1" prefix="nyc-data/yellow_tripdata_2024-01.parquet/"}: mountpoint_s3_client::s3_crt_client::list_objects: new request | |
| 2024-11-14T11:37:21.978961Z INFO lookup{req=26 ino=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0 Initiating making of meta request | |
| 2024-11-14T11:37:21.978968Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.978978Z DEBUG lookup{req=26 ino=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7bc016d20 Created new Default Meta Request. operation=ListObjectsV2 | |
| 2024-11-14T11:37:21.978983Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.978984Z INFO lookup{req=26 ino=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0: Created meta request 0x7fa7bc016d20 | |
| 2024-11-14T11:37:21.978990Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.978994Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.978996Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.979000Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc016d20: Meta Request Default created request 0x7fa7f4021690 | |
| 2024-11-14T11:37:21.979003Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.979007Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):2/2 Requests-preparing:2 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.979004Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc0167f0: Meta Request prepared request 0x7fa7f4021550 | |
| 2024-11-14T11:37:21.979036Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:21.979041Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider successfully sourced from cache | |
| 2024-11-14T11:37:21.979045Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:21.979066Z INFO awscrt::AuthSigning: (id=0x7fa810001020) Signing successfully built canonical request for algorithm SigV4, with contents | |
| HEAD | |
| /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet | |
| accept:application/xml | |
| content-length:0 | |
| host:172.200.201.1:80 | |
| x-amz-content-sha256:UNSIGNED-PAYLOAD | |
| x-amz-date:20241114T113721Z | |
| accept;content-length;host;x-amz-content-sha256;x-amz-date | |
| UNSIGNED-PAYLOAD | |
| 2024-11-14T11:37:21.979070Z INFO awscrt::AuthSigning: (id=0x7fa810001020) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 | |
| 20241114T113721Z | |
| 20241114/VAST/s3/aws4_request | |
| f48a3a712bbe677b6bce63fabb8870440381a3f39d9a5e6a3555d06a3d58f0fd | |
| 2024-11-14T11:37:21.979081Z INFO awscrt::AuthSigning: (id=0x7fa810001020) Http request successfully built final authorization value via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241114/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date, Signature=b57c05ca9ccbf90510e84e12e7bbdfec916ae79c56012e756492bd94c161e31b | |
| 2024-11-14T11:37:21.979099Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.979101Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc016d20: Meta Request prepared request 0x7fa7f4021690 | |
| 2024-11-14T11:37:21.979103Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.979106Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.979109Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.979109Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:21.979115Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: attempting to acquire retry token for partition_id 172.200.201.1:80 | |
| 2024-11-14T11:37:21.979121Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider successfully sourced from cache | |
| 2024-11-14T11:37:21.979124Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:21.979124Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket 0x7fa7f40019f0 for partition_id 172.200.201.1:80 found | |
| 2024-11-14T11:37:21.979130Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Initializing retry token 0x7fa7f40217d0 | |
| 2024-11-14T11:37:21.979139Z INFO awscrt::AuthSigning: (id=0x7fa810001530) Signing successfully built canonical request for algorithm SigV4, with contents | |
| GET | |
| /csnow-bucket/ | |
| delimiter=%2F&list-type=2&max-keys=1&prefix=nyc-data%2Fyellow_tripdata_2024-01.parquet%2F | |
| accept:application/xml | |
| content-length:0 | |
| host:172.200.201.1:80 | |
| x-amz-content-sha256:UNSIGNED-PAYLOAD | |
| x-amz-date:20241114T113721Z | |
| x-amz-optional-object-attributes:RestoreStatus | |
| accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes | |
| UNSIGNED-PAYLOAD | |
| 2024-11-14T11:37:21.979142Z INFO awscrt::AuthSigning: (id=0x7fa810001530) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 | |
| 20241114T113721Z | |
| 20241114/VAST/s3/aws4_request | |
| 79c3430359f525169037998d2521afe8b43ea4886ddb1db6df5b64e49382786c | |
| 2024-11-14T11:37:21.979143Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):2/2 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.979151Z INFO awscrt::AuthSigning: (id=0x7fa810001530) Http request successfully built final authorization value via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241114/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes, Signature=76d6f43cfba57dcabb59ef5d047185a6d4966a30a315bd92b5791d1ed5cb0a66 | |
| 2024-11-14T11:37:21.979166Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.979169Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.979172Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.979175Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.979172Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Vending retry_token 0x7fa7f40217d0 | |
| 2024-11-14T11:37:21.979178Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: attempting to acquire retry token for partition_id 172.200.201.1:80 | |
| 2024-11-14T11:37:21.979189Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket 0x7fa7f40019f0 for partition_id 172.200.201.1:80 found | |
| 2024-11-14T11:37:21.979190Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: token acquired callback invoked with error Success. with token 0x7fa7f401ce00 and nested token 0x7fa7f40217d0 | |
| 2024-11-14T11:37:21.979192Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Initializing retry token 0x7fa7f40218d0 | |
| 2024-11-14T11:37:21.979196Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Acquire connection | |
| 2024-11-14T11:37:21.979200Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Grabbing pooled connection (0x7fa7f4019f90) | |
| 2024-11-14T11:37:21.979205Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=2, ref_count=1 | |
| 2024-11-14T11:37:21.979205Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):2/2 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/2/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.979217Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Vending retry_token 0x7fa7f40218d0 | |
| 2024-11-14T11:37:21.979224Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Successfully completed connection acquisition with connection id=0x7fa7f4019f90 | |
| 2024-11-14T11:37:21.979225Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: token acquired callback invoked with error Success. with token 0x7fa7f401a2b0 and nested token 0x7fa7f40218d0 | |
| 2024-11-14T11:37:21.979230Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Acquire connection | |
| 2024-11-14T11:37:21.979234Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Grabbing pooled connection (0x7fa80c013190) | |
| 2024-11-14T11:37:21.979238Z DEBUG awscrt::http-stream: id=0x7fa7f40219d0: Created client request on connection=0x7fa7f4019f90: HEAD /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet HTTP/1.1 | |
| 2024-11-14T11:37:21.979239Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=2, open_connection_count=2, ref_count=1 | |
| 2024-11-14T11:37:21.979315Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Successfully completed connection acquisition with connection id=0x7fa80c013190 | |
| 2024-11-14T11:37:21.979345Z DEBUG awscrt::http-stream: id=0x7fa80c018ef0: Created client request on connection=0x7fa80c013190: GET /csnow-bucket/?list-type=2&delimiter=%2F&max-keys=1&prefix=nyc-data%2Fyellow_tripdata_2024-01.parquet%2F HTTP/1.1 | |
| 2024-11-14T11:37:21.981512Z DEBUG awscrt::http-stream: id=0x7fa80c018ef0: Client request complete, response status: 200 (OK). | |
| 2024-11-14T11:37:21.981525Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc016d20: Request 0x7fa7f4021690 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
| 2024-11-14T11:37:21.981530Z DEBUG awscrt::standard-retry-strategy: token_id=0x7fa7f401a2b0: partition=172.200.201.1:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
| 2024-11-14T11:37:21.981531Z DEBUG awscrt::http-stream: id=0x7fa7f40219d0: Client request complete, response status: 404 (Not Found). | |
| 2024-11-14T11:37:21.981545Z DEBUG awscrt::connection-manager: id=0x564afe247d70: User releasing connection (id=0x7fa80c013190) | |
| 2024-11-14T11:37:21.981546Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc0167f0: Request 0x7fa7f4021550 finished with error code 14343 (aws-c-s3: AWS_ERROR_S3_INVALID_RESPONSE_STATUS, Invalid response status from request) and response status 404 | |
| 2024-11-14T11:37:21.981550Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=2, ref_count=1 | |
| 2024-11-14T11:37:21.981551Z ERROR awscrt::S3MetaRequest: id=0x7fa7bc0167f0 Meta request cannot recover from error 14343 (Invalid response status from request). (request=0x7fa7f4021550, response status=404) | |
| 2024-11-14T11:37:21.981560Z DEBUG awscrt::connection-manager: id=0x564afe247d70: User releasing connection (id=0x7fa7f4019f90) | |
| 2024-11-14T11:37:21.981564Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=2, ref_count=1 | |
| 2024-11-14T11:37:21.981568Z INFO awscrt::connection-manager: id=0x564afe247d70: Releasing connection (id=0x7fa7f4019f90) | |
| 2024-11-14T11:37:21.981578Z INFO awscrt::http-connection: id=0x7fa7f4019f90: Shutting down connection with error code 0 (AWS_ERROR_SUCCESS). | |
| 2024-11-14T11:37:21.981572Z DEBUG lookup{req=26 ino=5 name="yellow_tripdata_2024-01.parquet"}:list_objects{id=10 bucket="csnow-bucket" continued=false delimiter="/" max_keys="1" prefix="nyc-data/yellow_tripdata_2024-01.parquet/"}: mountpoint_s3_client::s3_crt_client: S3 request finished request_type=Default crt_error=None http_status=200 range=None duration=2.466632ms ttfb=Some(2.078194ms) request_id=1360310035f27f | |
| 2024-11-14T11:37:21.981587Z DEBUG awscrt::channel: id=0x7fa7f4009890: Channel shutdown is already pending, not scheduling another. | |
| 2024-11-14T11:37:21.981592Z DEBUG awscrt::channel: id=0x7fa7f4009890: beginning shutdown process | |
| 2024-11-14T11:37:21.981596Z DEBUG awscrt::channel: id=0x7fa7f4009890: handler 0x7fa7f4009340 shutdown in read dir completed. | |
| 2024-11-14T11:37:21.981598Z DEBUG awscrt::channel: id=0x7fa7f4009890: handler 0x7fa7f4019f98 shutdown in read dir completed. | |
| 2024-11-14T11:37:21.981603Z DEBUG awscrt::channel: id=0x7fa7f4009890: handler 0x7fa7f4019f98 shutdown in write dir completed. | |
| 2024-11-14T11:37:21.981602Z DEBUG lookup{req=26 ino=5 name="yellow_tripdata_2024-01.parquet"}:head_object{id=9 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: S3 request failed request_type=HeadObject crt_error=Some(Error(14343, "aws-c-s3: AWS_ERROR_S3_INVALID_RESPONSE_STATUS, Invalid response status from request")) http_status=404 range=None duration=2.55768ms ttfb=Some(2.140251ms) request_id=1360a1000d09df | |
| 2024-11-14T11:37:21.981607Z DEBUG awscrt::socket: id=0x7fa7f4009470 fd=1: closing | |
| 2024-11-14T11:37:21.981663Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.981667Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.981670Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.981677Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc0167f0 Meta request finished with error code 14343 (Invalid response status from request) | |
| 2024-11-14T11:37:21.981691Z DEBUG lookup{req=26 ino=5 name="yellow_tripdata_2024-01.parquet"}:head_object{id=9 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: duration=2.834726ms request_id=1360a1000d09df error=ServiceError(NotFound) meta request failed | |
| 2024-11-14T11:37:21.981699Z DEBUG lookup{req=26 ino=5 name="yellow_tripdata_2024-01.parquet"}:head_object{id=9 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: meta request result: MetaRequestResult { response_status: 404, crt_error: Error(14343, "aws-c-s3: AWS_ERROR_S3_INVALID_RESPONSE_STATUS, Invalid response status from request"), error_response_headers: Some(Headers { inner: 0x7fa7f4008d60 }), error_response_body: None } | |
| 2024-11-14T11:37:21.981718Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc016d20 Meta request finished with error code 0 (Success.) | |
| 2024-11-14T11:37:21.981724Z DEBUG lookup{req=26 ino=5 name="yellow_tripdata_2024-01.parquet"}:list_objects{id=10 bucket="csnow-bucket" continued=false delimiter="/" max_keys="1" prefix="nyc-data/yellow_tripdata_2024-01.parquet/"}: mountpoint_s3_client::s3_crt_client: meta request finished duration=2.761623ms | |
| 2024-11-14T11:37:21.981731Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.981735Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.981734Z DEBUG lookup{req=26 ino=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7bc0167f0 Cleaning up meta request | |
| 2024-11-14T11:37:21.981740Z DEBUG awscrt::channel: id=0x7fa7f4009890: handler 0x7fa7f4009340 shutdown in write dir completed. | |
| 2024-11-14T11:37:21.981751Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.981754Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.981756Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.981758Z DEBUG lookup{req=26 ino=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7bc016d20 Cleaning up meta request | |
| 2024-11-14T11:37:21.981759Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.981764Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.981768Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: channel 0x7fa7f4009890 shutdown with error 0. | |
| 2024-11-14T11:37:21.981771Z INFO awscrt::http-connection: 0x7fa7f4019f90: Client shutdown completed with error 0 (AWS_ERROR_SUCCESS). | |
| 2024-11-14T11:37:21.981774Z DEBUG awscrt::connection-manager: id=0x564afe247d70: shutdown received for connection (id=0x7fa7f4019f90) | |
| 2024-11-14T11:37:21.981778Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:21.981781Z DEBUG awscrt::channel: id=0x7fa7f4009890: destroying channel. | |
| 2024-11-14T11:37:21.981787Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: releasing bootstrap reference | |
| 2024-11-14T11:37:21.981789Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.981792Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.981794Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.981797Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.981800Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.981820Z DEBUG lookup{req=26 ino=5 name="yellow_tripdata_2024-01.parquet"}: mountpoint_s3::fuse: lookup failed: file does not exist: file "yellow_tripdata_2024-01.parquet" does not exist in parent inode 5 (full key "nyc-data/") | |
| 2024-11-14T11:37:21.981894Z DEBUG fuser::request: FUSE( 28) ino 0x0000000000000005 LOOKUP name "yellow_tripdata_2024-01.parquet" | |
| 2024-11-14T11:37:21.982027Z DEBUG lookup{req=28 ino=5 name="yellow_tripdata_2024-01.parquet"}:head_object{id=11 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client::head_object: new request | |
| 2024-11-14T11:37:21.982042Z INFO lookup{req=28 ino=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0 Initiating making of meta request | |
| 2024-11-14T11:37:21.982052Z DEBUG lookup{req=28 ino=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7c800b2e0 Created new Default Meta Request. operation=HeadObject | |
| 2024-11-14T11:37:21.982067Z INFO lookup{req=28 ino=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0: Created meta request 0x7fa7c800b2e0 | |
| 2024-11-14T11:37:21.982085Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.982100Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.982103Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.982107Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800b2e0: Meta Request Default created request 0x7fa7f4022340 | |
| 2024-11-14T11:37:21.982117Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.982121Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.982136Z DEBUG lookup{req=28 ino=5 name="yellow_tripdata_2024-01.parquet"}:list_objects{id=12 bucket="csnow-bucket" continued=false delimiter="/" max_keys="1" prefix="nyc-data/yellow_tripdata_2024-01.parquet/"}: mountpoint_s3_client::s3_crt_client::list_objects: new request | |
| 2024-11-14T11:37:21.982143Z INFO lookup{req=28 ino=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0 Initiating making of meta request | |
| 2024-11-14T11:37:21.982149Z DEBUG lookup{req=28 ino=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7c800c080 Created new Default Meta Request. operation=ListObjectsV2 | |
| 2024-11-14T11:37:21.982152Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800b2e0: Meta Request prepared request 0x7fa7f4022340 | |
| 2024-11-14T11:37:21.982159Z INFO lookup{req=28 ino=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0: Created meta request 0x7fa7c800c080 | |
| 2024-11-14T11:37:21.982164Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.982170Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.982173Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.982174Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:21.982176Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800c080: Meta Request Default created request 0x7fa7f4022480 | |
| 2024-11-14T11:37:21.982179Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider successfully sourced from cache | |
| 2024-11-14T11:37:21.982180Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.982182Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:21.982184Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):2/2 Requests-preparing:2 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.982199Z INFO awscrt::AuthSigning: (id=0x7fa8000015e0) Signing successfully built canonical request for algorithm SigV4, with contents | |
| HEAD | |
| /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet | |
| accept:application/xml | |
| content-length:0 | |
| host:172.200.201.1:80 | |
| x-amz-content-sha256:UNSIGNED-PAYLOAD | |
| x-amz-date:20241114T113721Z | |
| accept;content-length;host;x-amz-content-sha256;x-amz-date | |
| UNSIGNED-PAYLOAD | |
| 2024-11-14T11:37:21.982203Z INFO awscrt::AuthSigning: (id=0x7fa8000015e0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 | |
| 20241114T113721Z | |
| 20241114/VAST/s3/aws4_request | |
| f48a3a712bbe677b6bce63fabb8870440381a3f39d9a5e6a3555d06a3d58f0fd | |
| 2024-11-14T11:37:21.982218Z INFO awscrt::AuthSigning: (id=0x7fa8000015e0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241114/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date, Signature=b57c05ca9ccbf90510e84e12e7bbdfec916ae79c56012e756492bd94c161e31b | |
| 2024-11-14T11:37:21.982243Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.982245Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800c080: Meta Request prepared request 0x7fa7f4022480 | |
| 2024-11-14T11:37:21.982247Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.982250Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.982251Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:21.982253Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.982254Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider successfully sourced from cache | |
| 2024-11-14T11:37:21.982258Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:21.982258Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: attempting to acquire retry token for partition_id 172.200.201.1:80 | |
| 2024-11-14T11:37:21.982263Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket 0x7fa7f40019f0 for partition_id 172.200.201.1:80 found | |
| 2024-11-14T11:37:21.982266Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Initializing retry token 0x7fa7f40225c0 | |
| 2024-11-14T11:37:21.982272Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):2/2 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.982272Z INFO awscrt::AuthSigning: (id=0x7fa800001120) Signing successfully built canonical request for algorithm SigV4, with contents | |
| GET | |
| /csnow-bucket/ | |
| delimiter=%2F&list-type=2&max-keys=1&prefix=nyc-data%2Fyellow_tripdata_2024-01.parquet%2F | |
| accept:application/xml | |
| content-length:0 | |
| host:172.200.201.1:80 | |
| x-amz-content-sha256:UNSIGNED-PAYLOAD | |
| x-amz-date:20241114T113721Z | |
| x-amz-optional-object-attributes:RestoreStatus | |
| accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes | |
| UNSIGNED-PAYLOAD | |
| 2024-11-14T11:37:21.982276Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Vending retry_token 0x7fa7f40225c0 | |
| 2024-11-14T11:37:21.982277Z INFO awscrt::AuthSigning: (id=0x7fa800001120) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 | |
| 20241114T113721Z | |
| 20241114/VAST/s3/aws4_request | |
| 79c3430359f525169037998d2521afe8b43ea4886ddb1db6df5b64e49382786c | |
| 2024-11-14T11:37:21.982279Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: token acquired callback invoked with error Success. with token 0x7fa7f4008eb0 and nested token 0x7fa7f40225c0 | |
| 2024-11-14T11:37:21.982283Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Acquire connection | |
| 2024-11-14T11:37:21.982286Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Grabbing pooled connection (0x7fa80c013190) | |
| 2024-11-14T11:37:21.982289Z INFO awscrt::AuthSigning: (id=0x7fa800001120) Http request successfully built final authorization value via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241114/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes, Signature=76d6f43cfba57dcabb59ef5d047185a6d4966a30a315bd92b5791d1ed5cb0a66 | |
| 2024-11-14T11:37:21.982289Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:21.982306Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.982309Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.982312Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.982315Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.982315Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Successfully completed connection acquisition with connection id=0x7fa80c013190 | |
| 2024-11-14T11:37:21.982318Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: attempting to acquire retry token for partition_id 172.200.201.1:80 | |
| 2024-11-14T11:37:21.982322Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket 0x7fa7f40019f0 for partition_id 172.200.201.1:80 found | |
| 2024-11-14T11:37:21.982325Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Initializing retry token 0x7fa7f4022780 | |
| 2024-11-14T11:37:21.982329Z DEBUG awscrt::http-stream: id=0x7fa80c019cd0: Created client request on connection=0x7fa80c013190: HEAD /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet HTTP/1.1 | |
| 2024-11-14T11:37:21.982334Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):2/2 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/2/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.982343Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Vending retry_token 0x7fa7f4022780 | |
| 2024-11-14T11:37:21.982349Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: token acquired callback invoked with error Success. with token 0x7fa7f4009740 and nested token 0x7fa7f4022780 | |
| 2024-11-14T11:37:21.982352Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Acquire connection | |
| 2024-11-14T11:37:21.982356Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=1, pending_settings_count=0, pending_connect_count=1, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:21.982359Z INFO awscrt::connection-manager: id=0x564afe247d70: Requesting 1 new connections from http | |
| 2024-11-14T11:37:21.982366Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: acquiring bootstrap reference | |
| 2024-11-14T11:37:21.982370Z DEBUG awscrt::dns: id=0x564afdfe5f50: Host resolution requested for 172.200.201.1 | |
| 2024-11-14T11:37:21.982374Z DEBUG awscrt::dns: id=0x564afdfe5f50: cached entries found for 172.200.201.1 returning to caller. | |
| 2024-11-14T11:37:21.982406Z DEBUG awscrt::socket: id=0x7fa80c019f80 fd=1: initializing with domain 0 and type 0 | |
| 2024-11-14T11:37:21.982412Z DEBUG awscrt::socket: id=0x7fa80c019f80 fd=1: setting socket options to: keep-alive 0, keep idle 0, keep-alive interval 0, keep-alive probe count 0. | |
| 2024-11-14T11:37:21.982417Z DEBUG awscrt::socket: id=0x7fa80c019f80 fd=1: beginning connect. | |
| 2024-11-14T11:37:21.982421Z DEBUG awscrt::socket: id=0x7fa80c019f80 fd=1: connecting to endpoint 172.200.201.1:80. | |
| 2024-11-14T11:37:21.982599Z INFO awscrt::socket: id=0x7fa80c019f80 fd=1: connection success | |
| 2024-11-14T11:37:21.982606Z DEBUG awscrt::socket: id=0x7fa80c019f80 fd=1: assigning to event loop 0x564afdfdd150 | |
| 2024-11-14T11:37:21.982611Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: client connection on socket 0x7fa80c019f80 completed with error 0. | |
| 2024-11-14T11:37:21.982614Z DEBUG awscrt::channel: id=0x7fa80c01a3f0: Beginning creation and setup of new channel. | |
| 2024-11-14T11:37:21.982617Z DEBUG awscrt::channel: id=0x7fa80c01a3f0: setup complete, notifying caller. | |
| 2024-11-14T11:37:21.982620Z DEBUG awscrt::channel: id=0x7fa80c01a3f0: message pool 0x7fa80c002290 found in event-loop local storage: using it. | |
| 2024-11-14T11:37:21.982630Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: channel 0x7fa80c01a3f0 setup succeeded: bootstrapping. | |
| 2024-11-14T11:37:21.982633Z DEBUG awscrt::socket-handler: id=0x7fa808001df0: Socket handler created with max_read_size of 16384 | |
| 2024-11-14T11:37:21.982639Z INFO awscrt::http-connection: id=0x7fa80c01a830: HTTP/1.1 client connection established. | |
| 2024-11-14T11:37:21.982642Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Received new connection (id=0x7fa80c01a830) from http layer | |
| 2024-11-14T11:37:21.982645Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Grabbing pooled connection (0x7fa80c01a830) | |
| 2024-11-14T11:37:21.982648Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=2, open_connection_count=2, ref_count=1 | |
| 2024-11-14T11:37:21.982651Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Successfully completed connection acquisition with connection id=0x7fa80c01a830 | |
| 2024-11-14T11:37:21.982658Z DEBUG awscrt::http-stream: id=0x7fa80c01ac60: Created client request on connection=0x7fa80c01a830: GET /csnow-bucket/?list-type=2&delimiter=%2F&max-keys=1&prefix=nyc-data%2Fyellow_tripdata_2024-01.parquet%2F HTTP/1.1 | |
| 2024-11-14T11:37:21.983718Z DEBUG awscrt::http-stream: id=0x7fa80c01ac60: Client request complete, response status: 200 (OK). | |
| 2024-11-14T11:37:21.983726Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800c080: Request 0x7fa7f4022480 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
| 2024-11-14T11:37:21.983729Z DEBUG awscrt::standard-retry-strategy: token_id=0x7fa7f4009740: partition=172.200.201.1:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
| 2024-11-14T11:37:21.983746Z DEBUG awscrt::connection-manager: id=0x564afe247d70: User releasing connection (id=0x7fa80c01a830) | |
| 2024-11-14T11:37:21.983749Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=2, ref_count=1 | |
| 2024-11-14T11:37:21.983757Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.983765Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.983768Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.983763Z DEBUG lookup{req=28 ino=5 name="yellow_tripdata_2024-01.parquet"}:list_objects{id=12 bucket="csnow-bucket" continued=false delimiter="/" max_keys="1" prefix="nyc-data/yellow_tripdata_2024-01.parquet/"}: mountpoint_s3_client::s3_crt_client: S3 request finished request_type=Default crt_error=None http_status=200 range=None duration=1.515158ms ttfb=Some(980.202µs) request_id=1360a1000d09e0 | |
| 2024-11-14T11:37:21.983772Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.983776Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.983784Z DEBUG awscrt::http-stream: id=0x7fa80c019cd0: Client request complete, response status: 404 (Not Found). | |
| 2024-11-14T11:37:21.983790Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800b2e0: Request 0x7fa7f4022340 finished with error code 14343 (aws-c-s3: AWS_ERROR_S3_INVALID_RESPONSE_STATUS, Invalid response status from request) and response status 404 | |
| 2024-11-14T11:37:21.983793Z ERROR awscrt::S3MetaRequest: id=0x7fa7c800b2e0 Meta request cannot recover from error 14343 (Invalid response status from request). (request=0x7fa7f4022340, response status=404) | |
| 2024-11-14T11:37:21.983793Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.983802Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.983806Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.983807Z DEBUG awscrt::connection-manager: id=0x564afe247d70: User releasing connection (id=0x7fa80c013190) | |
| 2024-11-14T11:37:21.983812Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=2, ref_count=1 | |
| 2024-11-14T11:37:21.983812Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800c080 Meta request finished with error code 0 (Success.) | |
| 2024-11-14T11:37:21.983816Z INFO awscrt::connection-manager: id=0x564afe247d70: Releasing connection (id=0x7fa80c013190) | |
| 2024-11-14T11:37:21.983813Z DEBUG lookup{req=28 ino=5 name="yellow_tripdata_2024-01.parquet"}:head_object{id=11 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: S3 request failed request_type=HeadObject crt_error=Some(Error(14343, "aws-c-s3: AWS_ERROR_S3_INVALID_RESPONSE_STATUS, Invalid response status from request")) http_status=404 range=None duration=1.65456ms ttfb=Some(1.42287ms) request_id=1360310035f280 | |
| 2024-11-14T11:37:21.983824Z INFO awscrt::http-connection: id=0x7fa80c013190: Shutting down connection with error code 0 (AWS_ERROR_SUCCESS). | |
| 2024-11-14T11:37:21.983828Z DEBUG awscrt::channel: id=0x7fa80c002560: Channel shutdown is already pending, not scheduling another. | |
| 2024-11-14T11:37:21.983826Z DEBUG lookup{req=28 ino=5 name="yellow_tripdata_2024-01.parquet"}:list_objects{id=12 bucket="csnow-bucket" continued=false delimiter="/" max_keys="1" prefix="nyc-data/yellow_tripdata_2024-01.parquet/"}: mountpoint_s3_client::s3_crt_client: meta request finished duration=1.677923ms | |
| 2024-11-14T11:37:21.983831Z DEBUG awscrt::channel: id=0x7fa80c002560: beginning shutdown process | |
| 2024-11-14T11:37:21.983836Z DEBUG awscrt::channel: id=0x7fa80c002560: handler 0x7fa80c001f30 shutdown in read dir completed. | |
| 2024-11-14T11:37:21.983838Z DEBUG awscrt::channel: id=0x7fa80c002560: handler 0x7fa80c013198 shutdown in read dir completed. | |
| 2024-11-14T11:37:21.983842Z DEBUG awscrt::channel: id=0x7fa80c002560: handler 0x7fa80c013198 shutdown in write dir completed. | |
| 2024-11-14T11:37:21.983845Z DEBUG awscrt::socket: id=0x7fa80c002060 fd=24: closing | |
| 2024-11-14T11:37:21.983847Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800b2e0 Meta request finished with error code 14343 (Invalid response status from request) | |
| 2024-11-14T11:37:21.983855Z DEBUG lookup{req=28 ino=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7c800c080 Cleaning up meta request | |
| 2024-11-14T11:37:21.983854Z DEBUG lookup{req=28 ino=5 name="yellow_tripdata_2024-01.parquet"}:head_object{id=11 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: duration=1.811415ms request_id=1360310035f280 error=ServiceError(NotFound) meta request failed | |
| 2024-11-14T11:37:21.983861Z DEBUG lookup{req=28 ino=5 name="yellow_tripdata_2024-01.parquet"}:head_object{id=11 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: meta request result: MetaRequestResult { response_status: 404, crt_error: Error(14343, "aws-c-s3: AWS_ERROR_S3_INVALID_RESPONSE_STATUS, Invalid response status from request"), error_response_headers: Some(Headers { inner: 0x7fa80c01aff0 }), error_response_body: None } | |
| 2024-11-14T11:37:21.983870Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.983873Z DEBUG awscrt::channel: id=0x7fa80c002560: handler 0x7fa80c001f30 shutdown in write dir completed. | |
| 2024-11-14T11:37:21.983874Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.983881Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: channel 0x7fa80c002560 shutdown with error 0. | |
| 2024-11-14T11:37:21.983884Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.983885Z INFO awscrt::http-connection: 0x7fa80c013190: Client shutdown completed with error 0 (AWS_ERROR_SUCCESS). | |
| 2024-11-14T11:37:21.983888Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.983889Z DEBUG awscrt::connection-manager: id=0x564afe247d70: shutdown received for connection (id=0x7fa80c013190) | |
| 2024-11-14T11:37:21.983890Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.983893Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:21.983893Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.983897Z DEBUG awscrt::channel: id=0x7fa80c002560: destroying channel. | |
| 2024-11-14T11:37:21.983898Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.983902Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: releasing bootstrap reference | |
| 2024-11-14T11:37:21.983913Z DEBUG lookup{req=28 ino=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7c800b2e0 Cleaning up meta request | |
| 2024-11-14T11:37:21.983918Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.983922Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.983924Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.983923Z DEBUG lookup{req=28 ino=5 name="yellow_tripdata_2024-01.parquet"}: mountpoint_s3::fuse: lookup failed: file does not exist: file "yellow_tripdata_2024-01.parquet" does not exist in parent inode 5 (full key "nyc-data/") | |
| 2024-11-14T11:37:21.983927Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.983931Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.983960Z DEBUG fuser::request: FUSE( 30) ino 0x0000000000000005 CREATE name "yellow_tripdata_2024-01.parquet", mode 0o100644, flags 0x80c1 | |
| 2024-11-14T11:37:21.983977Z DEBUG create{req=30 parent=5 name="yellow_tripdata_2024-01.parquet"}: mountpoint_s3::fuse: create failed: operation not supported by Mountpoint | |
| 2024-11-14T11:37:21.983997Z DEBUG fuser::request: FUSE( 32) ino 0x0000000000000005 MKNOD name "yellow_tripdata_2024-01.parquet", mode 0o100644, rdev 0 | |
| 2024-11-14T11:37:21.984067Z DEBUG mknod{req=32 parent=5 name="yellow_tripdata_2024-01.parquet"}:head_object{id=13 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client::head_object: new request | |
| 2024-11-14T11:37:21.984079Z INFO mknod{req=32 parent=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0 Initiating making of meta request | |
| 2024-11-14T11:37:21.984086Z DEBUG mknod{req=32 parent=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7bc0177d0 Created new Default Meta Request. operation=HeadObject | |
| 2024-11-14T11:37:21.984096Z INFO mknod{req=32 parent=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0: Created meta request 0x7fa7bc0177d0 | |
| 2024-11-14T11:37:21.984101Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.984105Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.984107Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.984111Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc0177d0: Meta Request Default created request 0x7fa7f40225c0 | |
| 2024-11-14T11:37:21.984121Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.984124Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.984136Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc0177d0: Meta Request prepared request 0x7fa7f40225c0 | |
| 2024-11-14T11:37:21.984147Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:21.984149Z DEBUG mknod{req=32 parent=5 name="yellow_tripdata_2024-01.parquet"}:list_objects{id=14 bucket="csnow-bucket" continued=false delimiter="/" max_keys="1" prefix="nyc-data/yellow_tripdata_2024-01.parquet/"}: mountpoint_s3_client::s3_crt_client::list_objects: new request | |
| 2024-11-14T11:37:21.984151Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider successfully sourced from cache | |
| 2024-11-14T11:37:21.984155Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:21.984155Z INFO mknod{req=32 parent=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0 Initiating making of meta request | |
| 2024-11-14T11:37:21.984165Z DEBUG mknod{req=32 parent=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7bc017d70 Created new Default Meta Request. operation=ListObjectsV2 | |
| 2024-11-14T11:37:21.984169Z INFO awscrt::AuthSigning: (id=0x7fa814000c70) Signing successfully built canonical request for algorithm SigV4, with contents | |
| HEAD | |
| /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet | |
| accept:application/xml | |
| content-length:0 | |
| host:172.200.201.1:80 | |
| x-amz-content-sha256:UNSIGNED-PAYLOAD | |
| x-amz-date:20241114T113721Z | |
| accept;content-length;host;x-amz-content-sha256;x-amz-date | |
| UNSIGNED-PAYLOAD | |
| 2024-11-14T11:37:21.984173Z INFO awscrt::AuthSigning: (id=0x7fa814000c70) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 | |
| 20241114T113721Z | |
| 20241114/VAST/s3/aws4_request | |
| f48a3a712bbe677b6bce63fabb8870440381a3f39d9a5e6a3555d06a3d58f0fd | |
| 2024-11-14T11:37:21.984174Z INFO mknod{req=32 parent=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0: Created meta request 0x7fa7bc017d70 | |
| 2024-11-14T11:37:21.984178Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.984182Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.984184Z INFO awscrt::AuthSigning: (id=0x7fa814000c70) Http request successfully built final authorization value via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241114/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date, Signature=b57c05ca9ccbf90510e84e12e7bbdfec916ae79c56012e756492bd94c161e31b | |
| 2024-11-14T11:37:21.984184Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.984197Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc017d70: Meta Request Default created request 0x7fa7f4022880 | |
| 2024-11-14T11:37:21.984206Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.984212Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):2/2 Requests-preparing:2 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.984215Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc017d70: Meta Request prepared request 0x7fa7f4022880 | |
| 2024-11-14T11:37:21.984218Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.984222Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.984222Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:21.984225Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.984227Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider successfully sourced from cache | |
| 2024-11-14T11:37:21.984228Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.984230Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:21.984233Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: attempting to acquire retry token for partition_id 172.200.201.1:80 | |
| 2024-11-14T11:37:21.984236Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket 0x7fa7f40019f0 for partition_id 172.200.201.1:80 found | |
| 2024-11-14T11:37:21.984239Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Initializing retry token 0x7fa7f40229c0 | |
| 2024-11-14T11:37:21.984243Z INFO awscrt::AuthSigning: (id=0x7fa800001120) Signing successfully built canonical request for algorithm SigV4, with contents | |
| GET | |
| /csnow-bucket/ | |
| delimiter=%2F&list-type=2&max-keys=1&prefix=nyc-data%2Fyellow_tripdata_2024-01.parquet%2F | |
| accept:application/xml | |
| content-length:0 | |
| host:172.200.201.1:80 | |
| x-amz-content-sha256:UNSIGNED-PAYLOAD | |
| x-amz-date:20241114T113721Z | |
| x-amz-optional-object-attributes:RestoreStatus | |
| accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes | |
| UNSIGNED-PAYLOAD | |
| 2024-11-14T11:37:21.984247Z INFO awscrt::AuthSigning: (id=0x7fa800001120) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 | |
| 20241114T113721Z | |
| 20241114/VAST/s3/aws4_request | |
| 79c3430359f525169037998d2521afe8b43ea4886ddb1db6df5b64e49382786c | |
| 2024-11-14T11:37:21.984249Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):2/2 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.984256Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Vending retry_token 0x7fa7f40229c0 | |
| 2024-11-14T11:37:21.984257Z INFO awscrt::AuthSigning: (id=0x7fa800001120) Http request successfully built final authorization value via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241114/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes, Signature=76d6f43cfba57dcabb59ef5d047185a6d4966a30a315bd92b5791d1ed5cb0a66 | |
| 2024-11-14T11:37:21.984260Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: token acquired callback invoked with error Success. with token 0x7fa7f4008eb0 and nested token 0x7fa7f40229c0 | |
| 2024-11-14T11:37:21.984267Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Acquire connection | |
| 2024-11-14T11:37:21.984270Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Grabbing pooled connection (0x7fa80c01a830) | |
| 2024-11-14T11:37:21.984273Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:21.984276Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Successfully completed connection acquisition with connection id=0x7fa80c01a830 | |
| 2024-11-14T11:37:21.984277Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.984281Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.984283Z DEBUG awscrt::http-stream: id=0x7fa80c019cd0: Created client request on connection=0x7fa80c01a830: HEAD /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet HTTP/1.1 | |
| 2024-11-14T11:37:21.984283Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.984288Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.984290Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: attempting to acquire retry token for partition_id 172.200.201.1:80 | |
| 2024-11-14T11:37:21.984293Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket 0x7fa7f40019f0 for partition_id 172.200.201.1:80 found | |
| 2024-11-14T11:37:21.984296Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Initializing retry token 0x7fa7f4022ac0 | |
| 2024-11-14T11:37:21.984306Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):2/2 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/2/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.984325Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Vending retry_token 0x7fa7f4022ac0 | |
| 2024-11-14T11:37:21.984334Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: token acquired callback invoked with error Success. with token 0x7fa7f4009740 and nested token 0x7fa7f4022ac0 | |
| 2024-11-14T11:37:21.984338Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Acquire connection | |
| 2024-11-14T11:37:21.984342Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=1, pending_settings_count=0, pending_connect_count=1, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:21.984345Z INFO awscrt::connection-manager: id=0x564afe247d70: Requesting 1 new connections from http | |
| 2024-11-14T11:37:21.984351Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: acquiring bootstrap reference | |
| 2024-11-14T11:37:21.984354Z DEBUG awscrt::dns: id=0x564afdfe5f50: Host resolution requested for 172.200.201.1 | |
| 2024-11-14T11:37:21.984358Z DEBUG awscrt::dns: id=0x564afdfe5f50: cached entries found for 172.200.201.1 returning to caller. | |
| 2024-11-14T11:37:21.984391Z DEBUG awscrt::socket: id=0x7fa808002b30 fd=2: initializing with domain 0 and type 0 | |
| 2024-11-14T11:37:21.984397Z DEBUG awscrt::socket: id=0x7fa808002b30 fd=2: setting socket options to: keep-alive 0, keep idle 0, keep-alive interval 0, keep-alive probe count 0. | |
| 2024-11-14T11:37:21.984401Z DEBUG awscrt::socket: id=0x7fa808002b30 fd=2: beginning connect. | |
| 2024-11-14T11:37:21.984405Z DEBUG awscrt::socket: id=0x7fa808002b30 fd=2: connecting to endpoint 172.200.201.1:80. | |
| 2024-11-14T11:37:21.984589Z INFO awscrt::socket: id=0x7fa808002b30 fd=2: connection success | |
| 2024-11-14T11:37:21.984599Z DEBUG awscrt::socket: id=0x7fa808002b30 fd=2: assigning to event loop 0x564afe03a830 | |
| 2024-11-14T11:37:21.984604Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: client connection on socket 0x7fa808002b30 completed with error 0. | |
| 2024-11-14T11:37:21.984611Z DEBUG awscrt::channel: id=0x7fa808002e60: Beginning creation and setup of new channel. | |
| 2024-11-14T11:37:21.984615Z DEBUG awscrt::channel: id=0x7fa808002e60: setup complete, notifying caller. | |
| 2024-11-14T11:37:21.984619Z DEBUG awscrt::channel: id=0x7fa808002e60: no message pool is currently stored in the event-loop local storage, adding 0x7fa808001f20 with max message size 16384, message count 4, with 4 small blocks of 128 bytes. | |
| 2024-11-14T11:37:21.984629Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: channel 0x7fa808002e60 setup succeeded: bootstrapping. | |
| 2024-11-14T11:37:21.984633Z DEBUG awscrt::socket-handler: id=0x7fa7fc014c30: Socket handler created with max_read_size of 16384 | |
| 2024-11-14T11:37:21.984639Z INFO awscrt::http-connection: id=0x7fa808013a90: HTTP/1.1 client connection established. | |
| 2024-11-14T11:37:21.984642Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Received new connection (id=0x7fa808013a90) from http layer | |
| 2024-11-14T11:37:21.984645Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Grabbing pooled connection (0x7fa808013a90) | |
| 2024-11-14T11:37:21.984649Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=2, open_connection_count=2, ref_count=1 | |
| 2024-11-14T11:37:21.984653Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Successfully completed connection acquisition with connection id=0x7fa808013a90 | |
| 2024-11-14T11:37:21.984662Z DEBUG awscrt::http-stream: id=0x7fa808014030: Created client request on connection=0x7fa808013a90: GET /csnow-bucket/?list-type=2&delimiter=%2F&max-keys=1&prefix=nyc-data%2Fyellow_tripdata_2024-01.parquet%2F HTTP/1.1 | |
| 2024-11-14T11:37:21.985984Z DEBUG awscrt::http-stream: id=0x7fa808014030: Client request complete, response status: 200 (OK). | |
| 2024-11-14T11:37:21.985992Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc017d70: Request 0x7fa7f4022880 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
| 2024-11-14T11:37:21.985996Z DEBUG awscrt::standard-retry-strategy: token_id=0x7fa7f4009740: partition=172.200.201.1:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
| 2024-11-14T11:37:21.986014Z DEBUG awscrt::connection-manager: id=0x564afe247d70: User releasing connection (id=0x7fa808013a90) | |
| 2024-11-14T11:37:21.986018Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=2, ref_count=1 | |
| 2024-11-14T11:37:21.986026Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.986026Z DEBUG mknod{req=32 parent=5 name="yellow_tripdata_2024-01.parquet"}:list_objects{id=14 bucket="csnow-bucket" continued=false delimiter="/" max_keys="1" prefix="nyc-data/yellow_tripdata_2024-01.parquet/"}: mountpoint_s3_client::s3_crt_client: S3 request finished request_type=Default crt_error=None http_status=200 range=None duration=1.810653ms ttfb=Some(1.248066ms) request_id=1360310035f281 | |
| 2024-11-14T11:37:21.986036Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.986040Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.986045Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc017d70 Meta request finished with error code 0 (Success.) | |
| 2024-11-14T11:37:21.986053Z DEBUG awscrt::http-stream: id=0x7fa80c019cd0: Client request complete, response status: 404 (Not Found). | |
| 2024-11-14T11:37:21.986052Z DEBUG mknod{req=32 parent=5 name="yellow_tripdata_2024-01.parquet"}:list_objects{id=14 bucket="csnow-bucket" continued=false delimiter="/" max_keys="1" prefix="nyc-data/yellow_tripdata_2024-01.parquet/"}: mountpoint_s3_client::s3_crt_client: meta request finished duration=1.894339ms | |
| 2024-11-14T11:37:21.986063Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc0177d0: Request 0x7fa7f40225c0 finished with error code 14343 (aws-c-s3: AWS_ERROR_S3_INVALID_RESPONSE_STATUS, Invalid response status from request) and response status 404 | |
| 2024-11-14T11:37:21.986067Z ERROR awscrt::S3MetaRequest: id=0x7fa7bc0177d0 Meta request cannot recover from error 14343 (Invalid response status from request). (request=0x7fa7f40225c0, response status=404) | |
| 2024-11-14T11:37:21.986081Z DEBUG awscrt::connection-manager: id=0x564afe247d70: User releasing connection (id=0x7fa80c01a830) | |
| 2024-11-14T11:37:21.986080Z DEBUG mknod{req=32 parent=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7bc017d70 Cleaning up meta request | |
| 2024-11-14T11:37:21.986087Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.986089Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=2, ref_count=1 | |
| 2024-11-14T11:37:21.986092Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.986092Z INFO awscrt::connection-manager: id=0x564afe247d70: Releasing connection (id=0x7fa80c01a830) | |
| 2024-11-14T11:37:21.986089Z DEBUG mknod{req=32 parent=5 name="yellow_tripdata_2024-01.parquet"}:head_object{id=13 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: S3 request failed request_type=HeadObject crt_error=Some(Error(14343, "aws-c-s3: AWS_ERROR_S3_INVALID_RESPONSE_STATUS, Invalid response status from request")) http_status=404 range=None duration=1.935087ms ttfb=Some(1.743404ms) request_id=1360a1000d09e1 | |
| 2024-11-14T11:37:21.986097Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.986100Z INFO awscrt::http-connection: id=0x7fa80c01a830: Shutting down connection with error code 0 (AWS_ERROR_SUCCESS). | |
| 2024-11-14T11:37:21.986102Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.986104Z DEBUG awscrt::channel: id=0x7fa80c01a3f0: Channel shutdown is already pending, not scheduling another. | |
| 2024-11-14T11:37:21.986105Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.986107Z DEBUG awscrt::channel: id=0x7fa80c01a3f0: beginning shutdown process | |
| 2024-11-14T11:37:21.986108Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.986110Z DEBUG awscrt::channel: id=0x7fa80c01a3f0: handler 0x7fa808001df0 shutdown in read dir completed. | |
| 2024-11-14T11:37:21.986112Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.986113Z DEBUG awscrt::channel: id=0x7fa80c01a3f0: handler 0x7fa80c01a838 shutdown in read dir completed. | |
| 2024-11-14T11:37:21.986116Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.986117Z DEBUG awscrt::channel: id=0x7fa80c01a3f0: handler 0x7fa80c01a838 shutdown in write dir completed. | |
| 2024-11-14T11:37:21.986126Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.986128Z DEBUG awscrt::socket: id=0x7fa80c019f80 fd=1: closing | |
| 2024-11-14T11:37:21.986129Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.986134Z DEBUG awscrt::S3MetaRequest: id=0x7fa7bc0177d0 Meta request finished with error code 14343 (Invalid response status from request) | |
| 2024-11-14T11:37:21.986140Z DEBUG mknod{req=32 parent=5 name="yellow_tripdata_2024-01.parquet"}:head_object{id=13 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: duration=2.059643ms request_id=1360a1000d09e1 error=ServiceError(NotFound) meta request failed | |
| 2024-11-14T11:37:21.986145Z DEBUG mknod{req=32 parent=5 name="yellow_tripdata_2024-01.parquet"}:head_object{id=13 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: meta request result: MetaRequestResult { response_status: 404, crt_error: Error(14343, "aws-c-s3: AWS_ERROR_S3_INVALID_RESPONSE_STATUS, Invalid response status from request"), error_response_headers: Some(Headers { inner: 0x7fa80c000f20 }), error_response_body: None } | |
| 2024-11-14T11:37:21.986152Z DEBUG awscrt::channel: id=0x7fa80c01a3f0: handler 0x7fa808001df0 shutdown in write dir completed. | |
| 2024-11-14T11:37:21.986157Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: channel 0x7fa80c01a3f0 shutdown with error 0. | |
| 2024-11-14T11:37:21.986157Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.986160Z INFO awscrt::http-connection: 0x7fa80c01a830: Client shutdown completed with error 0 (AWS_ERROR_SUCCESS). | |
| 2024-11-14T11:37:21.986161Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.986163Z DEBUG awscrt::connection-manager: id=0x564afe247d70: shutdown received for connection (id=0x7fa80c01a830) | |
| 2024-11-14T11:37:21.986162Z DEBUG mknod{req=32 parent=5 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7bc0177d0 Cleaning up meta request | |
| 2024-11-14T11:37:21.986166Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.986166Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:21.986169Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.986171Z DEBUG awscrt::channel: id=0x7fa80c01a3f0: destroying channel. | |
| 2024-11-14T11:37:21.986172Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.986175Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: releasing bootstrap reference | |
| 2024-11-14T11:37:21.986175Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.986180Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.986219Z DEBUG fuser::request: FUSE( 34) ino 0x0000000000000008 OPEN flags 0x8001 | |
| 2024-11-14T11:37:21.986295Z DEBUG open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}:head_object{id=15 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client::head_object: new request | |
| 2024-11-14T11:37:21.986308Z INFO open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0 Initiating making of meta request | |
| 2024-11-14T11:37:21.986315Z DEBUG open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7c800c810 Created new Default Meta Request. operation=HeadObject | |
| 2024-11-14T11:37:21.986327Z INFO open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0: Created meta request 0x7fa7c800c810 | |
| 2024-11-14T11:37:21.986351Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.986358Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.986360Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.986364Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800c810: Meta Request Default created request 0x7fa7f4022bc0 | |
| 2024-11-14T11:37:21.986373Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.986377Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.986384Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800c810: Meta Request prepared request 0x7fa7f4022bc0 | |
| 2024-11-14T11:37:21.986384Z DEBUG open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}:list_objects{id=16 bucket="csnow-bucket" continued=false delimiter="/" max_keys="1" prefix="nyc-data/yellow_tripdata_2024-01.parquet/"}: mountpoint_s3_client::s3_crt_client::list_objects: new request | |
| 2024-11-14T11:37:21.986392Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:21.986392Z INFO open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0 Initiating making of meta request | |
| 2024-11-14T11:37:21.986396Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider successfully sourced from cache | |
| 2024-11-14T11:37:21.986398Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:21.986399Z DEBUG open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7c800d0a0 Created new Default Meta Request. operation=ListObjectsV2 | |
| 2024-11-14T11:37:21.986408Z INFO awscrt::AuthSigning: (id=0x7fa800000ea0) Signing successfully built canonical request for algorithm SigV4, with contents | |
| HEAD | |
| /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet | |
| accept:application/xml | |
| content-length:0 | |
| host:172.200.201.1:80 | |
| x-amz-content-sha256:UNSIGNED-PAYLOAD | |
| x-amz-date:20241114T113721Z | |
| accept;content-length;host;x-amz-content-sha256;x-amz-date | |
| UNSIGNED-PAYLOAD | |
| 2024-11-14T11:37:21.986408Z INFO open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0: Created meta request 0x7fa7c800d0a0 | |
| 2024-11-14T11:37:21.986413Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.986415Z INFO awscrt::AuthSigning: (id=0x7fa800000ea0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 | |
| 20241114T113721Z | |
| 20241114/VAST/s3/aws4_request | |
| f48a3a712bbe677b6bce63fabb8870440381a3f39d9a5e6a3555d06a3d58f0fd | |
| 2024-11-14T11:37:21.986417Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.986425Z INFO awscrt::AuthSigning: (id=0x7fa800000ea0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241114/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date, Signature=b57c05ca9ccbf90510e84e12e7bbdfec916ae79c56012e756492bd94c161e31b | |
| 2024-11-14T11:37:21.986426Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.986431Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d0a0: Meta Request Default created request 0x7fa7f4022d00 | |
| 2024-11-14T11:37:21.986440Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.986443Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):2/2 Requests-preparing:2 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.986447Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.986450Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.986451Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d0a0: Meta Request prepared request 0x7fa7f4022d00 | |
| 2024-11-14T11:37:21.986452Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.986456Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.986459Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:21.986460Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: attempting to acquire retry token for partition_id 172.200.201.1:80 | |
| 2024-11-14T11:37:21.986463Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider successfully sourced from cache | |
| 2024-11-14T11:37:21.986464Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket 0x7fa7f40019f0 for partition_id 172.200.201.1:80 found | |
| 2024-11-14T11:37:21.986466Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:21.986468Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Initializing retry token 0x7fa7f40229c0 | |
| 2024-11-14T11:37:21.986478Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):2/2 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.986483Z INFO awscrt::AuthSigning: (id=0x7fa814000ff0) Signing successfully built canonical request for algorithm SigV4, with contents | |
| GET | |
| /csnow-bucket/ | |
| delimiter=%2F&list-type=2&max-keys=1&prefix=nyc-data%2Fyellow_tripdata_2024-01.parquet%2F | |
| accept:application/xml | |
| content-length:0 | |
| host:172.200.201.1:80 | |
| x-amz-content-sha256:UNSIGNED-PAYLOAD | |
| x-amz-date:20241114T113721Z | |
| x-amz-optional-object-attributes:RestoreStatus | |
| accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes | |
| UNSIGNED-PAYLOAD | |
| 2024-11-14T11:37:21.986487Z INFO awscrt::AuthSigning: (id=0x7fa814000ff0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 | |
| 20241114T113721Z | |
| 20241114/VAST/s3/aws4_request | |
| 79c3430359f525169037998d2521afe8b43ea4886ddb1db6df5b64e49382786c | |
| 2024-11-14T11:37:21.986488Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Vending retry_token 0x7fa7f40229c0 | |
| 2024-11-14T11:37:21.986496Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: token acquired callback invoked with error Success. with token 0x7fa7f4008eb0 and nested token 0x7fa7f40229c0 | |
| 2024-11-14T11:37:21.986497Z INFO awscrt::AuthSigning: (id=0x7fa814000ff0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241114/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes, Signature=76d6f43cfba57dcabb59ef5d047185a6d4966a30a315bd92b5791d1ed5cb0a66 | |
| 2024-11-14T11:37:21.986507Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Acquire connection | |
| 2024-11-14T11:37:21.986511Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Grabbing pooled connection (0x7fa808013a90) | |
| 2024-11-14T11:37:21.986515Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:21.986533Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Successfully completed connection acquisition with connection id=0x7fa808013a90 | |
| 2024-11-14T11:37:21.986542Z DEBUG awscrt::http-stream: id=0x7fa808015500: Created client request on connection=0x7fa808013a90: HEAD /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet HTTP/1.1 | |
| 2024-11-14T11:37:21.986556Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.986560Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.986562Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.986565Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.986568Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: attempting to acquire retry token for partition_id 172.200.201.1:80 | |
| 2024-11-14T11:37:21.986571Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket 0x7fa7f40019f0 for partition_id 172.200.201.1:80 found | |
| 2024-11-14T11:37:21.986573Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Initializing retry token 0x7fa7f4022e40 | |
| 2024-11-14T11:37:21.986588Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Vending retry_token 0x7fa7f4022e40 | |
| 2024-11-14T11:37:21.986592Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):2/2 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/2/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.986593Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: token acquired callback invoked with error Success. with token 0x7fa7f4009740 and nested token 0x7fa7f4022e40 | |
| 2024-11-14T11:37:21.986597Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Acquire connection | |
| 2024-11-14T11:37:21.986601Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=1, pending_settings_count=0, pending_connect_count=1, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:21.986604Z INFO awscrt::connection-manager: id=0x564afe247d70: Requesting 1 new connections from http | |
| 2024-11-14T11:37:21.986609Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: acquiring bootstrap reference | |
| 2024-11-14T11:37:21.986612Z DEBUG awscrt::dns: id=0x564afdfe5f50: Host resolution requested for 172.200.201.1 | |
| 2024-11-14T11:37:21.986616Z DEBUG awscrt::dns: id=0x564afdfe5f50: cached entries found for 172.200.201.1 returning to caller. | |
| 2024-11-14T11:37:21.986629Z DEBUG awscrt::socket: id=0x7fa808015c10 fd=1: initializing with domain 0 and type 0 | |
| 2024-11-14T11:37:21.986633Z DEBUG awscrt::socket: id=0x7fa808015c10 fd=1: setting socket options to: keep-alive 0, keep idle 0, keep-alive interval 0, keep-alive probe count 0. | |
| 2024-11-14T11:37:21.986637Z DEBUG awscrt::socket: id=0x7fa808015c10 fd=1: beginning connect. | |
| 2024-11-14T11:37:21.986644Z DEBUG awscrt::socket: id=0x7fa808015c10 fd=1: connecting to endpoint 172.200.201.1:80. | |
| 2024-11-14T11:37:21.986775Z INFO awscrt::socket: id=0x7fa808015c10 fd=1: connection success | |
| 2024-11-14T11:37:21.986781Z DEBUG awscrt::socket: id=0x7fa808015c10 fd=1: assigning to event loop 0x564afe03a830 | |
| 2024-11-14T11:37:21.986791Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: client connection on socket 0x7fa808015c10 completed with error 0. | |
| 2024-11-14T11:37:21.986794Z DEBUG awscrt::channel: id=0x7fa808016030: Beginning creation and setup of new channel. | |
| 2024-11-14T11:37:21.986797Z DEBUG awscrt::channel: id=0x7fa808016030: setup complete, notifying caller. | |
| 2024-11-14T11:37:21.986800Z DEBUG awscrt::channel: id=0x7fa808016030: message pool 0x7fa808001f20 found in event-loop local storage: using it. | |
| 2024-11-14T11:37:21.986803Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: channel 0x7fa808016030 setup succeeded: bootstrapping. | |
| 2024-11-14T11:37:21.986806Z DEBUG awscrt::socket-handler: id=0x7fa808015ae0: Socket handler created with max_read_size of 16384 | |
| 2024-11-14T11:37:21.986811Z INFO awscrt::http-connection: id=0x7fa808016470: HTTP/1.1 client connection established. | |
| 2024-11-14T11:37:21.986814Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Received new connection (id=0x7fa808016470) from http layer | |
| 2024-11-14T11:37:21.986817Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Grabbing pooled connection (0x7fa808016470) | |
| 2024-11-14T11:37:21.986820Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=2, open_connection_count=2, ref_count=1 | |
| 2024-11-14T11:37:21.986823Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Successfully completed connection acquisition with connection id=0x7fa808016470 | |
| 2024-11-14T11:37:21.986830Z DEBUG awscrt::http-stream: id=0x7fa808016930: Created client request on connection=0x7fa808016470: GET /csnow-bucket/?list-type=2&delimiter=%2F&max-keys=1&prefix=nyc-data%2Fyellow_tripdata_2024-01.parquet%2F HTTP/1.1 | |
| 2024-11-14T11:37:21.988571Z DEBUG awscrt::http-stream: id=0x7fa808016930: Client request complete, response status: 200 (OK). | |
| 2024-11-14T11:37:21.988670Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d0a0: Request 0x7fa7f4022d00 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
| 2024-11-14T11:37:21.988674Z DEBUG awscrt::standard-retry-strategy: token_id=0x7fa7f4009740: partition=172.200.201.1:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
| 2024-11-14T11:37:21.988692Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.988695Z DEBUG awscrt::connection-manager: id=0x564afe247d70: User releasing connection (id=0x7fa808016470) | |
| 2024-11-14T11:37:21.988697Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.988700Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=2, ref_count=1 | |
| 2024-11-14T11:37:21.988700Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.988705Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.988708Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):2/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:1 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.988713Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.988714Z DEBUG awscrt::http-stream: id=0x7fa808015500: Client request complete, response status: 404 (Not Found). | |
| 2024-11-14T11:37:21.988720Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.988723Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800c810: Request 0x7fa7f4022bc0 finished with error code 14343 (aws-c-s3: AWS_ERROR_S3_INVALID_RESPONSE_STATUS, Invalid response status from request) and response status 404 | |
| 2024-11-14T11:37:21.988723Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.988728Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.988730Z ERROR awscrt::S3MetaRequest: id=0x7fa7c800c810 Meta request cannot recover from error 14343 (Invalid response status from request). (request=0x7fa7f4022bc0, response status=404) | |
| 2024-11-14T11:37:21.988731Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):2/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:1 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.988736Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.988739Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.988740Z DEBUG awscrt::connection-manager: id=0x564afe247d70: User releasing connection (id=0x7fa808013a90) | |
| 2024-11-14T11:37:21.988741Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.988744Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=2, ref_count=1 | |
| 2024-11-14T11:37:21.988745Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.988747Z INFO awscrt::connection-manager: id=0x564afe247d70: Releasing connection (id=0x7fa808013a90) | |
| 2024-11-14T11:37:21.988749Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:1 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.988754Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.988755Z INFO awscrt::http-connection: id=0x7fa808013a90: Shutting down connection with error code 0 (AWS_ERROR_SUCCESS). | |
| 2024-11-14T11:37:21.988750Z DEBUG open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}:head_object{id=15 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: S3 request failed request_type=HeadObject crt_error=Some(Error(14343, "aws-c-s3: AWS_ERROR_S3_INVALID_RESPONSE_STATUS, Invalid response status from request")) http_status=404 range=None duration=2.351294ms ttfb=Some(2.13742ms) request_id=1360310035f282 | |
| 2024-11-14T11:37:21.988757Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.988758Z DEBUG awscrt::channel: id=0x7fa808002e60: Channel shutdown is already pending, not scheduling another. | |
| 2024-11-14T11:37:21.988754Z DEBUG open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}:list_objects{id=16 bucket="csnow-bucket" continued=false delimiter="/" max_keys="1" prefix="nyc-data/yellow_tripdata_2024-01.parquet/"}: mountpoint_s3_client::s3_crt_client: S3 request finished request_type=Default crt_error=None http_status=200 range=None duration=2.300171ms ttfb=Some(1.706908ms) request_id=13613100138282 | |
| 2024-11-14T11:37:21.988763Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.988765Z DEBUG awscrt::channel: id=0x7fa808002e60: beginning shutdown process | |
| 2024-11-14T11:37:21.988780Z DEBUG awscrt::channel: id=0x7fa808002e60: handler 0x7fa7fc014c30 shutdown in read dir completed. | |
| 2024-11-14T11:37:21.988780Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800c810 Meta request finished with error code 14343 (Invalid response status from request) | |
| 2024-11-14T11:37:21.988783Z DEBUG awscrt::channel: id=0x7fa808002e60: handler 0x7fa808013a98 shutdown in read dir completed. | |
| 2024-11-14T11:37:21.988787Z DEBUG awscrt::channel: id=0x7fa808002e60: handler 0x7fa808013a98 shutdown in write dir completed. | |
| 2024-11-14T11:37:21.988790Z DEBUG awscrt::socket: id=0x7fa808002b30 fd=2: closing | |
| 2024-11-14T11:37:21.988791Z DEBUG open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}:head_object{id=15 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: duration=2.479185ms request_id=1360310035f282 error=ServiceError(NotFound) meta request failed | |
| 2024-11-14T11:37:21.988796Z DEBUG open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}:head_object{id=15 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: meta request result: MetaRequestResult { response_status: 404, crt_error: Error(14343, "aws-c-s3: AWS_ERROR_S3_INVALID_RESPONSE_STATUS, Invalid response status from request"), error_response_headers: Some(Headers { inner: 0x7fa8080179d0 }), error_response_body: None } | |
| 2024-11-14T11:37:21.988811Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d0a0 Meta request finished with error code 0 (Success.) | |
| 2024-11-14T11:37:21.988815Z DEBUG open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}:list_objects{id=16 bucket="csnow-bucket" continued=false delimiter="/" max_keys="1" prefix="nyc-data/yellow_tripdata_2024-01.parquet/"}: mountpoint_s3_client::s3_crt_client: meta request finished duration=2.422298ms | |
| 2024-11-14T11:37:21.988818Z DEBUG open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7c800c810 Cleaning up meta request | |
| 2024-11-14T11:37:21.988820Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.988821Z DEBUG awscrt::channel: id=0x7fa808002e60: handler 0x7fa7fc014c30 shutdown in write dir completed. | |
| 2024-11-14T11:37:21.988826Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.988828Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: channel 0x7fa808002e60 shutdown with error 0. | |
| 2024-11-14T11:37:21.988830Z DEBUG open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7c800d0a0 Cleaning up meta request | |
| 2024-11-14T11:37:21.988831Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.988832Z INFO awscrt::http-connection: 0x7fa808013a90: Client shutdown completed with error 0 (AWS_ERROR_SUCCESS). | |
| 2024-11-14T11:37:21.988836Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.988837Z DEBUG awscrt::connection-manager: id=0x564afe247d70: shutdown received for connection (id=0x7fa808013a90) | |
| 2024-11-14T11:37:21.988838Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.988841Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:21.988841Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.988849Z DEBUG awscrt::channel: id=0x7fa808002e60: destroying channel. | |
| 2024-11-14T11:37:21.988850Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.988854Z DEBUG awscrt::channel-bootstrap: id=0x564afe03b630: releasing bootstrap reference | |
| 2024-11-14T11:37:21.988882Z DEBUG open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}:put_object{id=17 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client::put_object: new request | |
| 2024-11-14T11:37:21.988952Z INFO open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0 Initiating making of meta request | |
| 2024-11-14T11:37:21.988961Z DEBUG open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7c800d6f0 Created new Auto-Ranged Put Meta Request. | |
| 2024-11-14T11:37:21.988973Z INFO open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x564afe0dbeb0: Created meta request 0x7fa7c800d6f0 | |
| 2024-11-14T11:37:21.988979Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.988984Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.988986Z DEBUG open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}: mountpoint_s3::fs: new file handle created fh=2 ino=8 | |
| 2024-11-14T11:37:21.988988Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.989002Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.989007Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.989014Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: Prepared request 0x7fa7f4022f40 for part 0 | |
| 2024-11-14T11:37:21.989022Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:21.989026Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider successfully sourced from cache | |
| 2024-11-14T11:37:21.989028Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:21.989040Z INFO awscrt::AuthSigning: (id=0x7fa800000f20) Signing successfully built canonical request for algorithm SigV4, with contents | |
| POST | |
| /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet | |
| uploads= | |
| accept:application/xml | |
| content-length:0 | |
| host:172.200.201.1:80 | |
| x-amz-checksum-algorithm:CRC32C | |
| x-amz-content-sha256:UNSIGNED-PAYLOAD | |
| x-amz-date:20241114T113721Z | |
| accept;content-length;host;x-amz-checksum-algorithm;x-amz-content-sha256;x-amz-date | |
| UNSIGNED-PAYLOAD | |
| 2024-11-14T11:37:21.989044Z INFO awscrt::AuthSigning: (id=0x7fa800000f20) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 | |
| 20241114T113721Z | |
| 20241114/VAST/s3/aws4_request | |
| 3224f46e2f71e35185faedb7b9f0a181ec33da6e869ccafce0e3252a5505650c | |
| 2024-11-14T11:37:21.989054Z INFO awscrt::AuthSigning: (id=0x7fa800000f20) Http request successfully built final authorization value via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241114/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-checksum-algorithm;x-amz-content-sha256;x-amz-date, Signature=4e21709eb7e39524765f643878f544cc206aab72811050336780b969497cfdd6 | |
| 2024-11-14T11:37:21.989076Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.989081Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.989083Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.989087Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.989090Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: attempting to acquire retry token for partition_id 172.200.201.1:80 | |
| 2024-11-14T11:37:21.989094Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket 0x7fa7f40019f0 for partition_id 172.200.201.1:80 found | |
| 2024-11-14T11:37:21.989097Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Initializing retry token 0x7fa7f4023080 | |
| 2024-11-14T11:37:21.989108Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/1/0/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.989117Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Vending retry_token 0x7fa7f4023080 | |
| 2024-11-14T11:37:21.989123Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: token acquired callback invoked with error Success. with token 0x7fa7f4008eb0 and nested token 0x7fa7f4023080 | |
| 2024-11-14T11:37:21.989127Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Acquire connection | |
| 2024-11-14T11:37:21.989131Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Grabbing pooled connection (0x7fa808016470) | |
| 2024-11-14T11:37:21.989134Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:21.989137Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Successfully completed connection acquisition with connection id=0x7fa808016470 | |
| 2024-11-14T11:37:21.989144Z DEBUG awscrt::http-stream: id=0x7fa8080181d0: Created client request on connection=0x7fa808016470: POST /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet?uploads HTTP/1.1 | |
| 2024-11-14T11:37:21.992540Z DEBUG fuser::request: FUSE( 36) ino 0x0000000000000008 GETXATTR name "security.capability", size GetSize(GetXAttrSize) | |
| 2024-11-14T11:37:21.992570Z WARN getxattr{req=36 ino=8 name="security.capability"}: mountpoint_s3::fuse: getxattr failed: operation not supported by Mountpoint | |
| 2024-11-14T11:37:21.992713Z DEBUG fuser::request: FUSE( 38) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 0, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:21.995607Z DEBUG awscrt::http-stream: id=0x7fa8080181d0: Client request complete, response status: 200 (OK). | |
| 2024-11-14T11:37:21.995615Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: Request 0x7fa7f4022f40 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
| 2024-11-14T11:37:21.995619Z DEBUG awscrt::standard-retry-strategy: token_id=0x7fa7f4008eb0: partition=172.200.201.1:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
| 2024-11-14T11:37:21.995639Z DEBUG awscrt::connection-manager: id=0x564afe247d70: User releasing connection (id=0x7fa808016470) | |
| 2024-11-14T11:37:21.995644Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:21.995649Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.995656Z DEBUG open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}:put_object{id=17 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: S3 request finished request_type=CreateMultipartUpload crt_error=None http_status=200 range=None duration=6.620153ms ttfb=Some(6.422082ms) request_id=13613100138283 | |
| 2024-11-14T11:37:21.995662Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.995666Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.995751Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.995756Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.995761Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:21.995764Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:21.995766Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:21.995769Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:21.995773Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:21.995993Z DEBUG fuser::request: FUSE( 40) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 131072, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:21.997929Z DEBUG fuser::request: FUSE( 42) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 262144, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:21.998122Z DEBUG fuser::request: FUSE( 44) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 393216, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:21.998505Z DEBUG fuser::request: FUSE( 46) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 524288, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:21.998690Z DEBUG fuser::request: FUSE( 48) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 655360, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.000967Z DEBUG fuser::request: FUSE( 50) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 786432, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.001174Z DEBUG fuser::request: FUSE( 52) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 917504, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.001431Z DEBUG fuser::request: FUSE( 54) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 1048576, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.001616Z DEBUG fuser::request: FUSE( 56) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 1179648, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.003647Z DEBUG fuser::request: FUSE( 58) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 1310720, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.003850Z DEBUG fuser::request: FUSE( 60) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 1441792, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.004097Z DEBUG fuser::request: FUSE( 62) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 1572864, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.004281Z DEBUG fuser::request: FUSE( 64) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 1703936, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.006145Z DEBUG fuser::request: FUSE( 66) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 1835008, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.006333Z DEBUG fuser::request: FUSE( 68) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 1966080, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.006562Z DEBUG fuser::request: FUSE( 70) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 2097152, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.006735Z DEBUG fuser::request: FUSE( 72) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 2228224, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.008583Z DEBUG fuser::request: FUSE( 74) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 2359296, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.008778Z DEBUG fuser::request: FUSE( 76) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 2490368, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.009013Z DEBUG fuser::request: FUSE( 78) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 2621440, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.009180Z DEBUG fuser::request: FUSE( 80) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 2752512, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.010768Z DEBUG fuser::request: FUSE( 82) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 2883584, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.010970Z DEBUG fuser::request: FUSE( 84) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 3014656, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.011207Z DEBUG fuser::request: FUSE( 86) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 3145728, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.011377Z DEBUG fuser::request: FUSE( 88) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 3276800, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.013020Z DEBUG fuser::request: FUSE( 90) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 3407872, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.013222Z DEBUG fuser::request: FUSE( 92) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 3538944, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.013772Z DEBUG fuser::request: FUSE( 94) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 3670016, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.014003Z DEBUG fuser::request: FUSE( 96) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 3801088, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.015402Z DEBUG fuser::request: FUSE( 98) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 3932160, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.015588Z DEBUG fuser::request: FUSE(100) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 4063232, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.015824Z DEBUG fuser::request: FUSE(102) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 4194304, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.015998Z DEBUG fuser::request: FUSE(104) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 4325376, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.016454Z DEBUG fuser::request: FUSE(106) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 4456448, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.016655Z DEBUG fuser::request: FUSE(108) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 4587520, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.016908Z DEBUG fuser::request: FUSE(110) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 4718592, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.017090Z DEBUG fuser::request: FUSE(112) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 4849664, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.017595Z DEBUG fuser::request: FUSE(114) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 4980736, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.017781Z DEBUG fuser::request: FUSE(116) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 5111808, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.018074Z DEBUG fuser::request: FUSE(118) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 5242880, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.018307Z DEBUG fuser::request: FUSE(120) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 5373952, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.018715Z DEBUG fuser::request: FUSE(122) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 5505024, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.018911Z DEBUG fuser::request: FUSE(124) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 5636096, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.019207Z DEBUG fuser::request: FUSE(126) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 5767168, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.019424Z DEBUG fuser::request: FUSE(128) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 5898240, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.019802Z DEBUG fuser::request: FUSE(130) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 6029312, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.019990Z DEBUG fuser::request: FUSE(132) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 6160384, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.020286Z DEBUG fuser::request: FUSE(134) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 6291456, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.020485Z DEBUG fuser::request: FUSE(136) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 6422528, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.020772Z DEBUG fuser::request: FUSE(138) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 6553600, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.021261Z DEBUG fuser::request: FUSE(140) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 6684672, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.021552Z DEBUG fuser::request: FUSE(142) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 6815744, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.021733Z DEBUG fuser::request: FUSE(144) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 6946816, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.022159Z DEBUG fuser::request: FUSE(146) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 7077888, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.022332Z DEBUG fuser::request: FUSE(148) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 7208960, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.022779Z DEBUG fuser::request: FUSE(150) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 7340032, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.022951Z DEBUG fuser::request: FUSE(152) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 7471104, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.023271Z DEBUG fuser::request: FUSE(154) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 7602176, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.023448Z DEBUG fuser::request: FUSE(156) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 7733248, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.023794Z DEBUG fuser::request: FUSE(158) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 7864320, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.023964Z DEBUG fuser::request: FUSE(160) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 7995392, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.024383Z DEBUG fuser::request: FUSE(162) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 8126464, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.024566Z DEBUG fuser::request: FUSE(164) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 8257536, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.024697Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.024712Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.024715Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.024731Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: Returning request 0x7fa7f4023180 for part 1 | |
| 2024-11-14T11:37:22.024742Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.024746Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.024778Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.024775Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0 UploadPart for Multi-part Upload, with ID:14045258306563313237 | |
| 2024-11-14T11:37:22.024781Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.024790Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.024793Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.024796Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.024802Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: Prepared request 0x7fa7f4023180 for part 1 | |
| 2024-11-14T11:37:22.024816Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:22.024820Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider successfully sourced from cache | |
| 2024-11-14T11:37:22.024823Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:22.024848Z INFO awscrt::AuthSigning: (id=0x7fa800000e50) Signing successfully built canonical request for algorithm SigV4, with contents | |
| PUT | |
| /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet | |
| partNumber=1&uploadId=14045258306563313237 | |
| accept:application/xml | |
| content-encoding:aws-chunked | |
| content-length:8388655 | |
| host:172.200.201.1:80 | |
| x-amz-content-sha256:STREAMING-UNSIGNED-PAYLOAD-TRAILER | |
| x-amz-date:20241114T113722Z | |
| x-amz-decoded-content-length:8388608 | |
| x-amz-trailer:x-amz-checksum-crc32c | |
| accept;content-encoding;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-decoded-content-length;x-amz-trailer | |
| STREAMING-UNSIGNED-PAYLOAD-TRAILER | |
| 2024-11-14T11:37:22.024852Z INFO awscrt::AuthSigning: (id=0x7fa800000e50) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 | |
| 20241114T113722Z | |
| 20241114/VAST/s3/aws4_request | |
| 93667e076633c51b6627b60d13c21bc6e7f089cbe5fc16e6cc04eaef1b113e80 | |
| 2024-11-14T11:37:22.024864Z INFO awscrt::AuthSigning: (id=0x7fa800000e50) Http request successfully built final authorization value via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241114/VAST/s3/aws4_request, SignedHeaders=accept;content-encoding;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-decoded-content-length;x-amz-trailer, Signature=c93088a67ed3f367a82ac8badb8487f7ef57da04859906ec04122baa390e5c2e | |
| 2024-11-14T11:37:22.024878Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.024882Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.024884Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.024887Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.024893Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: attempting to acquire retry token for partition_id 172.200.201.1:80 | |
| 2024-11-14T11:37:22.024902Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket 0x7fa7f40019f0 for partition_id 172.200.201.1:80 found | |
| 2024-11-14T11:37:22.024906Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Initializing retry token 0x7fa7f40232c0 | |
| 2024-11-14T11:37:22.024919Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/1/0/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.024954Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Vending retry_token 0x7fa7f40232c0 | |
| 2024-11-14T11:37:22.024977Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: token acquired callback invoked with error Success. with token 0x7fa7f4008eb0 and nested token 0x7fa7f40232c0 | |
| 2024-11-14T11:37:22.024982Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Acquire connection | |
| 2024-11-14T11:37:22.024986Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Grabbing pooled connection (0x7fa808016470) | |
| 2024-11-14T11:37:22.024991Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:22.025026Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Successfully completed connection acquisition with connection id=0x7fa808016470 | |
| 2024-11-14T11:37:22.025053Z DEBUG awscrt::http-stream: id=0x7fa808018db0: Created client request on connection=0x7fa808016470: PUT /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet?partNumber=1&uploadId=14045258306563313237 HTTP/1.1 | |
| 2024-11-14T11:37:22.025767Z DEBUG fuser::request: FUSE(166) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 8388608, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.025954Z DEBUG fuser::request: FUSE(168) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 8519680, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.026566Z DEBUG fuser::request: FUSE(170) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 8650752, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.026739Z DEBUG fuser::request: FUSE(172) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 8781824, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.027719Z DEBUG fuser::request: FUSE(174) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 8912896, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.027907Z DEBUG fuser::request: FUSE(176) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 9043968, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.028675Z DEBUG fuser::request: FUSE(178) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 9175040, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.028864Z DEBUG fuser::request: FUSE(180) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 9306112, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.030985Z DEBUG fuser::request: FUSE(182) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 9437184, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.031209Z DEBUG fuser::request: FUSE(184) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 9568256, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.031508Z DEBUG fuser::request: FUSE(186) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 9699328, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.031704Z DEBUG fuser::request: FUSE(188) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 9830400, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.033152Z DEBUG fuser::request: FUSE(190) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 9961472, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.033331Z DEBUG fuser::request: FUSE(192) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 10092544, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.033753Z DEBUG fuser::request: FUSE(194) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 10223616, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.033979Z DEBUG fuser::request: FUSE(196) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 10354688, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.035286Z DEBUG fuser::request: FUSE(198) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 10485760, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.035520Z DEBUG fuser::request: FUSE(200) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 10616832, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.035771Z DEBUG fuser::request: FUSE(202) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 10747904, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.035975Z DEBUG fuser::request: FUSE(204) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 10878976, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.037775Z DEBUG fuser::request: FUSE(206) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 11010048, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.037990Z DEBUG fuser::request: FUSE(208) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 11141120, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.038242Z DEBUG fuser::request: FUSE(210) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 11272192, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.038437Z DEBUG fuser::request: FUSE(212) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 11403264, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.039809Z DEBUG fuser::request: FUSE(214) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 11534336, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.040019Z DEBUG fuser::request: FUSE(216) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 11665408, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.040275Z DEBUG fuser::request: FUSE(218) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 11796480, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.040480Z DEBUG fuser::request: FUSE(220) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 11927552, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.041758Z DEBUG fuser::request: FUSE(222) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 12058624, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.041950Z DEBUG fuser::request: FUSE(224) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 12189696, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.042592Z DEBUG fuser::request: FUSE(226) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 12320768, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.042781Z DEBUG fuser::request: FUSE(228) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 12451840, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.043922Z DEBUG fuser::request: FUSE(230) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 12582912, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.044121Z DEBUG fuser::request: FUSE(232) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 12713984, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.044635Z DEBUG fuser::request: FUSE(234) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 12845056, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.044821Z DEBUG fuser::request: FUSE(236) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 12976128, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.047246Z DEBUG fuser::request: FUSE(238) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 13107200, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.047432Z DEBUG fuser::request: FUSE(240) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 13238272, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.047674Z DEBUG fuser::request: FUSE(242) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 13369344, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.047863Z DEBUG fuser::request: FUSE(244) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 13500416, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.049484Z DEBUG fuser::request: FUSE(246) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 13631488, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.049690Z DEBUG fuser::request: FUSE(248) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 13762560, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.049954Z DEBUG fuser::request: FUSE(250) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 13893632, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.050138Z DEBUG fuser::request: FUSE(252) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 14024704, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.051598Z DEBUG fuser::request: FUSE(254) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 14155776, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.051780Z DEBUG fuser::request: FUSE(256) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 14286848, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.052038Z DEBUG fuser::request: FUSE(258) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 14417920, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.052226Z DEBUG fuser::request: FUSE(260) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 14548992, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.053969Z DEBUG fuser::request: FUSE(262) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 14680064, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.054166Z DEBUG fuser::request: FUSE(264) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 14811136, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.054439Z DEBUG fuser::request: FUSE(266) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 14942208, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.054620Z DEBUG fuser::request: FUSE(268) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 15073280, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.055929Z DEBUG fuser::request: FUSE(270) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 15204352, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.056098Z DEBUG fuser::request: FUSE(272) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 15335424, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.056687Z DEBUG fuser::request: FUSE(274) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 15466496, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.056865Z DEBUG fuser::request: FUSE(276) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 15597568, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.057853Z DEBUG awscrt::http-stream: id=0x7fa808018db0: Client request complete, response status: 200 (OK). | |
| 2024-11-14T11:37:22.057872Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: Request 0x7fa7f4023180 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
| 2024-11-14T11:37:22.057880Z DEBUG awscrt::standard-retry-strategy: token_id=0x7fa7f4008eb0: partition=172.200.201.1:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
| 2024-11-14T11:37:22.057895Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: 1 parts have completed. | |
| 2024-11-14T11:37:22.057909Z DEBUG awscrt::connection-manager: id=0x564afe247d70: User releasing connection (id=0x7fa808016470) | |
| 2024-11-14T11:37:22.057914Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:22.057930Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.057948Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.057951Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.057943Z DEBUG open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}:put_object{id=17 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: S3 request finished request_type=UploadPart crt_error=None http_status=200 range=None duration=33.097447ms ttfb=Some(9.8668ms) request_id=13613100138284 | |
| 2024-11-14T11:37:22.057959Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.057972Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.058006Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.058010Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.058012Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.058015Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.058018Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.058054Z DEBUG fuser::request: FUSE(278) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 15728640, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.058229Z DEBUG fuser::request: FUSE(280) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 15859712, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.058486Z DEBUG fuser::request: FUSE(282) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 15990784, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.058669Z DEBUG fuser::request: FUSE(284) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 16121856, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.060323Z DEBUG fuser::request: FUSE(286) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 16252928, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.060530Z DEBUG fuser::request: FUSE(288) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 16384000, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.060788Z DEBUG fuser::request: FUSE(290) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 16515072, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.060978Z DEBUG fuser::request: FUSE(292) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 16646144, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.061067Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.061074Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.061076Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.061080Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: Returning request 0x7fa7f40233c0 for part 2 | |
| 2024-11-14T11:37:22.061091Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.061095Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.061111Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0 UploadPart for Multi-part Upload, with ID:14045258306563313237 | |
| 2024-11-14T11:37:22.061112Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.061119Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.061127Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: Prepared request 0x7fa7f40233c0 for part 2 | |
| 2024-11-14T11:37:22.061130Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.061134Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.061138Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.061143Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:22.061147Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider successfully sourced from cache | |
| 2024-11-14T11:37:22.061150Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:22.061175Z INFO awscrt::AuthSigning: (id=0x7fa800001060) Signing successfully built canonical request for algorithm SigV4, with contents | |
| PUT | |
| /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet | |
| partNumber=2&uploadId=14045258306563313237 | |
| accept:application/xml | |
| content-encoding:aws-chunked | |
| content-length:8388655 | |
| host:172.200.201.1:80 | |
| x-amz-content-sha256:STREAMING-UNSIGNED-PAYLOAD-TRAILER | |
| x-amz-date:20241114T113722Z | |
| x-amz-decoded-content-length:8388608 | |
| x-amz-trailer:x-amz-checksum-crc32c | |
| accept;content-encoding;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-decoded-content-length;x-amz-trailer | |
| STREAMING-UNSIGNED-PAYLOAD-TRAILER | |
| 2024-11-14T11:37:22.061179Z INFO awscrt::AuthSigning: (id=0x7fa800001060) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 | |
| 20241114T113722Z | |
| 20241114/VAST/s3/aws4_request | |
| 02afb5651c0f33d1f75fc48eeed5c99ba0f7577c04c7b59b23933ae6bf349fc2 | |
| 2024-11-14T11:37:22.061190Z INFO awscrt::AuthSigning: (id=0x7fa800001060) Http request successfully built final authorization value via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241114/VAST/s3/aws4_request, SignedHeaders=accept;content-encoding;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-decoded-content-length;x-amz-trailer, Signature=3d4327ac79f3e13b4b856db13aa90baa50f394ec07aed75b3edac91c708dacad | |
| 2024-11-14T11:37:22.061207Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.061210Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.061213Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.061216Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.061221Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: attempting to acquire retry token for partition_id 172.200.201.1:80 | |
| 2024-11-14T11:37:22.061224Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket 0x7fa7f40019f0 for partition_id 172.200.201.1:80 found | |
| 2024-11-14T11:37:22.061228Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Initializing retry token 0x7fa7f4023500 | |
| 2024-11-14T11:37:22.061243Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/1/0/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.061283Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Vending retry_token 0x7fa7f4023500 | |
| 2024-11-14T11:37:22.061301Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: token acquired callback invoked with error Success. with token 0x7fa7f4008eb0 and nested token 0x7fa7f4023500 | |
| 2024-11-14T11:37:22.061314Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Acquire connection | |
| 2024-11-14T11:37:22.061318Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Grabbing pooled connection (0x7fa808016470) | |
| 2024-11-14T11:37:22.061322Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:22.061359Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Successfully completed connection acquisition with connection id=0x7fa808016470 | |
| 2024-11-14T11:37:22.061381Z DEBUG awscrt::http-stream: id=0x7fa8080193c0: Created client request on connection=0x7fa808016470: PUT /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet?partNumber=2&uploadId=14045258306563313237 HTTP/1.1 | |
| 2024-11-14T11:37:22.062614Z DEBUG fuser::request: FUSE(294) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 16777216, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.062750Z DEBUG fuser::request: FUSE(296) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 16908288, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.062942Z DEBUG fuser::request: FUSE(298) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 17039360, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.063070Z DEBUG fuser::request: FUSE(300) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 17170432, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.064638Z DEBUG fuser::request: FUSE(302) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 17301504, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.064781Z DEBUG fuser::request: FUSE(304) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 17432576, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.065001Z DEBUG fuser::request: FUSE(306) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 17563648, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.065185Z DEBUG fuser::request: FUSE(308) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 17694720, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.067167Z DEBUG fuser::request: FUSE(310) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 17825792, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.067366Z DEBUG fuser::request: FUSE(312) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 17956864, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.067560Z DEBUG fuser::request: FUSE(314) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 18087936, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.067697Z DEBUG fuser::request: FUSE(316) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 18219008, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.069474Z DEBUG fuser::request: FUSE(318) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 18350080, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.069640Z DEBUG fuser::request: FUSE(320) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 18481152, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.069845Z DEBUG fuser::request: FUSE(322) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 18612224, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.069964Z DEBUG fuser::request: FUSE(324) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 18743296, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.072127Z DEBUG fuser::request: FUSE(326) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 18874368, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.072272Z DEBUG fuser::request: FUSE(328) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 19005440, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.072508Z DEBUG fuser::request: FUSE(330) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 19136512, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.072772Z DEBUG fuser::request: FUSE(332) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 19267584, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.074290Z DEBUG fuser::request: FUSE(334) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 19398656, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.074440Z DEBUG fuser::request: FUSE(336) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 19529728, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.074917Z DEBUG fuser::request: FUSE(338) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 19660800, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.075044Z DEBUG fuser::request: FUSE(340) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 19791872, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.076359Z DEBUG fuser::request: FUSE(342) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 19922944, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.076490Z DEBUG fuser::request: FUSE(344) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 20054016, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.076792Z DEBUG fuser::request: FUSE(346) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 20185088, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.076921Z DEBUG fuser::request: FUSE(348) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 20316160, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.078328Z DEBUG fuser::request: FUSE(350) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 20447232, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.078461Z DEBUG fuser::request: FUSE(352) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 20578304, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.078947Z DEBUG fuser::request: FUSE(354) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 20709376, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.079074Z DEBUG fuser::request: FUSE(356) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 20840448, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.079892Z DEBUG awscrt::http-stream: id=0x7fa8080193c0: Client request complete, response status: 200 (OK). | |
| 2024-11-14T11:37:22.079912Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: Request 0x7fa7f40233c0 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
| 2024-11-14T11:37:22.079919Z DEBUG awscrt::standard-retry-strategy: token_id=0x7fa7f4008eb0: partition=172.200.201.1:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
| 2024-11-14T11:37:22.079933Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: 2 parts have completed. | |
| 2024-11-14T11:37:22.079944Z DEBUG awscrt::connection-manager: id=0x564afe247d70: User releasing connection (id=0x7fa808016470) | |
| 2024-11-14T11:37:22.079949Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:22.079966Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.079980Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.079971Z DEBUG open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}:put_object{id=17 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: S3 request finished request_type=UploadPart crt_error=None http_status=200 range=None duration=18.809677ms ttfb=Some(11.400259ms) request_id=1361310013828e | |
| 2024-11-14T11:37:22.079984Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.079996Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.080001Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.080014Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.080017Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.080019Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.080022Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.080025Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.080082Z DEBUG fuser::request: FUSE(358) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 20971520, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.080240Z DEBUG fuser::request: FUSE(360) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 21102592, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.080821Z DEBUG fuser::request: FUSE(362) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 21233664, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.080951Z DEBUG fuser::request: FUSE(364) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 21364736, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.082067Z DEBUG fuser::request: FUSE(366) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 21495808, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.082207Z DEBUG fuser::request: FUSE(368) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 21626880, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.082912Z DEBUG fuser::request: FUSE(370) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 21757952, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.083048Z DEBUG fuser::request: FUSE(372) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 21889024, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.083986Z DEBUG fuser::request: FUSE(374) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 22020096, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.084120Z DEBUG fuser::request: FUSE(376) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 22151168, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.084808Z DEBUG fuser::request: FUSE(378) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 22282240, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.084944Z DEBUG fuser::request: FUSE(380) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 22413312, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.085904Z DEBUG fuser::request: FUSE(382) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 22544384, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.086044Z DEBUG fuser::request: FUSE(384) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 22675456, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.086923Z DEBUG fuser::request: FUSE(386) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 22806528, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.087059Z DEBUG fuser::request: FUSE(388) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 22937600, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.087976Z DEBUG fuser::request: FUSE(390) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 23068672, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.088141Z DEBUG fuser::request: FUSE(392) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 23199744, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.088570Z DEBUG fuser::request: FUSE(394) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 23330816, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.088710Z DEBUG fuser::request: FUSE(396) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 23461888, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.089716Z DEBUG fuser::request: FUSE(398) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 23592960, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.089866Z DEBUG fuser::request: FUSE(400) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 23724032, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.090196Z DEBUG fuser::request: FUSE(402) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 23855104, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.090335Z DEBUG fuser::request: FUSE(404) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 23986176, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.091978Z DEBUG fuser::request: FUSE(406) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 24117248, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.092125Z DEBUG fuser::request: FUSE(408) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 24248320, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.092322Z DEBUG fuser::request: FUSE(410) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 24379392, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.092454Z DEBUG fuser::request: FUSE(412) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 24510464, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.094350Z DEBUG fuser::request: FUSE(414) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 24641536, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.094487Z DEBUG fuser::request: FUSE(416) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 24772608, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.094684Z DEBUG fuser::request: FUSE(418) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 24903680, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.094815Z DEBUG fuser::request: FUSE(420) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 25034752, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.094872Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.094885Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.094888Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.094896Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: Returning request 0x7fa7f4023500 for part 3 | |
| 2024-11-14T11:37:22.094907Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.094912Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.094943Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.094946Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.094944Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0 UploadPart for Multi-part Upload, with ID:14045258306563313237 | |
| 2024-11-14T11:37:22.094949Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.094958Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.094961Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.094968Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: Prepared request 0x7fa7f4023500 for part 3 | |
| 2024-11-14T11:37:22.094980Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:22.094984Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider successfully sourced from cache | |
| 2024-11-14T11:37:22.094994Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:22.095019Z INFO awscrt::AuthSigning: (id=0x7fa800005090) Signing successfully built canonical request for algorithm SigV4, with contents | |
| PUT | |
| /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet | |
| partNumber=3&uploadId=14045258306563313237 | |
| accept:application/xml | |
| content-encoding:aws-chunked | |
| content-length:8388655 | |
| host:172.200.201.1:80 | |
| x-amz-content-sha256:STREAMING-UNSIGNED-PAYLOAD-TRAILER | |
| x-amz-date:20241114T113722Z | |
| x-amz-decoded-content-length:8388608 | |
| x-amz-trailer:x-amz-checksum-crc32c | |
| accept;content-encoding;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-decoded-content-length;x-amz-trailer | |
| STREAMING-UNSIGNED-PAYLOAD-TRAILER | |
| 2024-11-14T11:37:22.095023Z INFO awscrt::AuthSigning: (id=0x7fa800005090) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 | |
| 20241114T113722Z | |
| 20241114/VAST/s3/aws4_request | |
| 6cf0c3b314a5fbd502b5e196ab18140ee21bb1e572b849e05b16d2a7bc745d6d | |
| 2024-11-14T11:37:22.095034Z INFO awscrt::AuthSigning: (id=0x7fa800005090) Http request successfully built final authorization value via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241114/VAST/s3/aws4_request, SignedHeaders=accept;content-encoding;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-decoded-content-length;x-amz-trailer, Signature=a1f78657eb73beca16c3694994d720eb40f6582f3e6bde27cc99dd523da26c02 | |
| 2024-11-14T11:37:22.095048Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.095052Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.095055Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.095057Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.095063Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: attempting to acquire retry token for partition_id 172.200.201.1:80 | |
| 2024-11-14T11:37:22.095066Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket 0x7fa7f40019f0 for partition_id 172.200.201.1:80 found | |
| 2024-11-14T11:37:22.095070Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Initializing retry token 0x7fa7f4023640 | |
| 2024-11-14T11:37:22.095086Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/1/0/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.095129Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Vending retry_token 0x7fa7f4023640 | |
| 2024-11-14T11:37:22.095143Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: token acquired callback invoked with error Success. with token 0x7fa7f4008eb0 and nested token 0x7fa7f4023640 | |
| 2024-11-14T11:37:22.095148Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Acquire connection | |
| 2024-11-14T11:37:22.095152Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Grabbing pooled connection (0x7fa808016470) | |
| 2024-11-14T11:37:22.095156Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:22.095160Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Successfully completed connection acquisition with connection id=0x7fa808016470 | |
| 2024-11-14T11:37:22.095172Z DEBUG awscrt::http-stream: id=0x7fa808019670: Created client request on connection=0x7fa808016470: PUT /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet?partNumber=3&uploadId=14045258306563313237 HTTP/1.1 | |
| 2024-11-14T11:37:22.096045Z DEBUG fuser::request: FUSE(422) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 25165824, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.096188Z DEBUG fuser::request: FUSE(424) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 25296896, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.096467Z DEBUG fuser::request: FUSE(426) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 25427968, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.096643Z DEBUG fuser::request: FUSE(428) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 25559040, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.097906Z DEBUG fuser::request: FUSE(430) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 25690112, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.098041Z DEBUG fuser::request: FUSE(432) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 25821184, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.098357Z DEBUG fuser::request: FUSE(434) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 25952256, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.098491Z DEBUG fuser::request: FUSE(436) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 26083328, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.099858Z DEBUG fuser::request: FUSE(438) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 26214400, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.100010Z DEBUG fuser::request: FUSE(440) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 26345472, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.100252Z DEBUG fuser::request: FUSE(442) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 26476544, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.100375Z DEBUG fuser::request: FUSE(444) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 26607616, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.101514Z DEBUG fuser::request: FUSE(446) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 26738688, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.101670Z DEBUG fuser::request: FUSE(448) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 26869760, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.102009Z DEBUG fuser::request: FUSE(450) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 27000832, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.102135Z DEBUG fuser::request: FUSE(452) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 27131904, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.103288Z DEBUG fuser::request: FUSE(454) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 27262976, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.103423Z DEBUG fuser::request: FUSE(456) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 27394048, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.104236Z DEBUG fuser::request: FUSE(458) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 27525120, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.104357Z DEBUG fuser::request: FUSE(460) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 27656192, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.105976Z DEBUG fuser::request: FUSE(462) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 27787264, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.106120Z DEBUG fuser::request: FUSE(464) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 27918336, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.106524Z DEBUG fuser::request: FUSE(466) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 28049408, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.106657Z DEBUG fuser::request: FUSE(468) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 28180480, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.108045Z DEBUG fuser::request: FUSE(470) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 28311552, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.108189Z DEBUG fuser::request: FUSE(472) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 28442624, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.108432Z DEBUG fuser::request: FUSE(474) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 28573696, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.108569Z DEBUG fuser::request: FUSE(476) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 28704768, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.109781Z DEBUG fuser::request: FUSE(478) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 28835840, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.109925Z DEBUG fuser::request: FUSE(480) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 28966912, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.110776Z DEBUG fuser::request: FUSE(482) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 29097984, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.110914Z DEBUG fuser::request: FUSE(484) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 29229056, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.111751Z DEBUG fuser::request: FUSE(486) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 29360128, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.111926Z DEBUG fuser::request: FUSE(488) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 29491200, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.112712Z DEBUG fuser::request: FUSE(490) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 29622272, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.112857Z DEBUG fuser::request: FUSE(492) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 29753344, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.113104Z DEBUG awscrt::http-stream: id=0x7fa808019670: Client request complete, response status: 200 (OK). | |
| 2024-11-14T11:37:22.113121Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: Request 0x7fa7f4023500 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
| 2024-11-14T11:37:22.113127Z DEBUG awscrt::standard-retry-strategy: token_id=0x7fa7f4008eb0: partition=172.200.201.1:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
| 2024-11-14T11:37:22.113140Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: 3 parts have completed. | |
| 2024-11-14T11:37:22.113152Z DEBUG awscrt::connection-manager: id=0x564afe247d70: User releasing connection (id=0x7fa808016470) | |
| 2024-11-14T11:37:22.113157Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:22.113162Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.113177Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.113180Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.113186Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.113190Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.113181Z DEBUG open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}:put_object{id=17 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: S3 request finished request_type=UploadPart crt_error=None http_status=200 range=None duration=18.176272ms ttfb=Some(11.516764ms) request_id=13613100138298 | |
| 2024-11-14T11:37:22.113225Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.113228Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.113239Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.113242Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.113245Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.113496Z DEBUG fuser::request: FUSE(494) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 29884416, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.113634Z DEBUG fuser::request: FUSE(496) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 30015488, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.114642Z DEBUG fuser::request: FUSE(498) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 30146560, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.114783Z DEBUG fuser::request: FUSE(500) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 30277632, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.115469Z DEBUG fuser::request: FUSE(502) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 30408704, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.115602Z DEBUG fuser::request: FUSE(504) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 30539776, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.116425Z DEBUG fuser::request: FUSE(506) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 30670848, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.116559Z DEBUG fuser::request: FUSE(508) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 30801920, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.117071Z DEBUG fuser::request: FUSE(510) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 30932992, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.117208Z DEBUG fuser::request: FUSE(512) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 31064064, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.118034Z DEBUG fuser::request: FUSE(514) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 31195136, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.118159Z DEBUG fuser::request: FUSE(516) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 31326208, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.118828Z DEBUG fuser::request: FUSE(518) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 31457280, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.118954Z DEBUG fuser::request: FUSE(520) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 31588352, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.120034Z DEBUG fuser::request: FUSE(522) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 31719424, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.120177Z DEBUG fuser::request: FUSE(524) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 31850496, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.120934Z DEBUG fuser::request: FUSE(526) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 31981568, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.121061Z DEBUG fuser::request: FUSE(528) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 32112640, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.121872Z DEBUG fuser::request: FUSE(530) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 32243712, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.122012Z DEBUG fuser::request: FUSE(532) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 32374784, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.122978Z DEBUG fuser::request: FUSE(534) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 32505856, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.123116Z DEBUG fuser::request: FUSE(536) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 32636928, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.123938Z DEBUG fuser::request: FUSE(538) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 32768000, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.124072Z DEBUG fuser::request: FUSE(540) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 32899072, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.124657Z DEBUG fuser::request: FUSE(542) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 33030144, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.124782Z DEBUG fuser::request: FUSE(544) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 33161216, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.125645Z DEBUG fuser::request: FUSE(546) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 33292288, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.125770Z DEBUG fuser::request: FUSE(548) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 33423360, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.125839Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.125860Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.125866Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.125877Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: Returning request 0x7fa7f4023500 for part 4 | |
| 2024-11-14T11:37:22.125894Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.125901Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.125929Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.125928Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0 UploadPart for Multi-part Upload, with ID:14045258306563313237 | |
| 2024-11-14T11:37:22.125933Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.125942Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.125945Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.125948Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.125951Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: Prepared request 0x7fa7f4023500 for part 4 | |
| 2024-11-14T11:37:22.125964Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:22.125968Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider successfully sourced from cache | |
| 2024-11-14T11:37:22.125971Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:22.125995Z INFO awscrt::AuthSigning: (id=0x7fa800001060) Signing successfully built canonical request for algorithm SigV4, with contents | |
| PUT | |
| /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet | |
| partNumber=4&uploadId=14045258306563313237 | |
| accept:application/xml | |
| content-encoding:aws-chunked | |
| content-length:8388655 | |
| host:172.200.201.1:80 | |
| x-amz-content-sha256:STREAMING-UNSIGNED-PAYLOAD-TRAILER | |
| x-amz-date:20241114T113722Z | |
| x-amz-decoded-content-length:8388608 | |
| x-amz-trailer:x-amz-checksum-crc32c | |
| accept;content-encoding;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-decoded-content-length;x-amz-trailer | |
| STREAMING-UNSIGNED-PAYLOAD-TRAILER | |
| 2024-11-14T11:37:22.126006Z INFO awscrt::AuthSigning: (id=0x7fa800001060) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 | |
| 20241114T113722Z | |
| 20241114/VAST/s3/aws4_request | |
| c667f61a2f57f22d92e744b4817443fb0d9d00531d77669fb5b194e6574d967e | |
| 2024-11-14T11:37:22.126017Z INFO awscrt::AuthSigning: (id=0x7fa800001060) Http request successfully built final authorization value via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241114/VAST/s3/aws4_request, SignedHeaders=accept;content-encoding;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-decoded-content-length;x-amz-trailer, Signature=328d0d02f36e34348358ff8813ba63fac8b48d85853e766dd5c1efeb47cebc16 | |
| 2024-11-14T11:37:22.126036Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.126040Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.126042Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.126045Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.126051Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: attempting to acquire retry token for partition_id 172.200.201.1:80 | |
| 2024-11-14T11:37:22.126054Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket 0x7fa7f40019f0 for partition_id 172.200.201.1:80 found | |
| 2024-11-14T11:37:22.126058Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Initializing retry token 0x7fa7f4023640 | |
| 2024-11-14T11:37:22.126071Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/1/0/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.126094Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Vending retry_token 0x7fa7f4023640 | |
| 2024-11-14T11:37:22.126107Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: token acquired callback invoked with error Success. with token 0x7fa7f4008eb0 and nested token 0x7fa7f4023640 | |
| 2024-11-14T11:37:22.126112Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Acquire connection | |
| 2024-11-14T11:37:22.126115Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Grabbing pooled connection (0x7fa808016470) | |
| 2024-11-14T11:37:22.126120Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:22.126124Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Successfully completed connection acquisition with connection id=0x7fa808016470 | |
| 2024-11-14T11:37:22.126134Z DEBUG awscrt::http-stream: id=0x7fa808019920: Created client request on connection=0x7fa808016470: PUT /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet?partNumber=4&uploadId=14045258306563313237 HTTP/1.1 | |
| 2024-11-14T11:37:22.126431Z DEBUG fuser::request: FUSE(550) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 33554432, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.126592Z DEBUG fuser::request: FUSE(552) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 33685504, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.127365Z DEBUG fuser::request: FUSE(554) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 33816576, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.127535Z DEBUG fuser::request: FUSE(556) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 33947648, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.128192Z DEBUG fuser::request: FUSE(558) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 34078720, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.128355Z DEBUG fuser::request: FUSE(560) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 34209792, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.129846Z DEBUG fuser::request: FUSE(562) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 34340864, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.130034Z DEBUG fuser::request: FUSE(564) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 34471936, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.130294Z DEBUG fuser::request: FUSE(566) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 34603008, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.130562Z DEBUG fuser::request: FUSE(568) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 34734080, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.131509Z DEBUG fuser::request: FUSE(570) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 34865152, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.131670Z DEBUG fuser::request: FUSE(572) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 34996224, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.132281Z DEBUG fuser::request: FUSE(574) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 35127296, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.132430Z DEBUG fuser::request: FUSE(576) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 35258368, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.134341Z DEBUG fuser::request: FUSE(578) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 35389440, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.134487Z DEBUG fuser::request: FUSE(580) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 35520512, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.134680Z DEBUG fuser::request: FUSE(582) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 35651584, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.134809Z DEBUG fuser::request: FUSE(584) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 35782656, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.136246Z DEBUG fuser::request: FUSE(586) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 35913728, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.136400Z DEBUG fuser::request: FUSE(588) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 36044800, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.136649Z DEBUG fuser::request: FUSE(590) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 36175872, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.136795Z DEBUG fuser::request: FUSE(592) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 36306944, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.138174Z DEBUG fuser::request: FUSE(594) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 36438016, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.138342Z DEBUG fuser::request: FUSE(596) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 36569088, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.138886Z DEBUG fuser::request: FUSE(598) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 36700160, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.139030Z DEBUG fuser::request: FUSE(600) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 36831232, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.139816Z DEBUG fuser::request: FUSE(602) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 36962304, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.139968Z DEBUG fuser::request: FUSE(604) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 37093376, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.140667Z DEBUG fuser::request: FUSE(606) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 37224448, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.140813Z DEBUG fuser::request: FUSE(608) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 37355520, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.143625Z DEBUG fuser::request: FUSE(610) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 37486592, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.143776Z DEBUG fuser::request: FUSE(612) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 37617664, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.143991Z DEBUG fuser::request: FUSE(614) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 37748736, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.144117Z DEBUG fuser::request: FUSE(616) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 37879808, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.144624Z DEBUG awscrt::http-stream: id=0x7fa808019920: Client request complete, response status: 200 (OK). | |
| 2024-11-14T11:37:22.144643Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: Request 0x7fa7f4023500 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
| 2024-11-14T11:37:22.144648Z DEBUG awscrt::standard-retry-strategy: token_id=0x7fa7f4008eb0: partition=172.200.201.1:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
| 2024-11-14T11:37:22.144661Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: 4 parts have completed. | |
| 2024-11-14T11:37:22.144673Z DEBUG awscrt::connection-manager: id=0x564afe247d70: User releasing connection (id=0x7fa808016470) | |
| 2024-11-14T11:37:22.144677Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:22.144690Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.144704Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.144708Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.144698Z DEBUG open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}:put_object{id=17 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: S3 request finished request_type=UploadPart crt_error=None http_status=200 range=None duration=18.714173ms ttfb=Some(11.837564ms) request_id=136131001382a2 | |
| 2024-11-14T11:37:22.144713Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.144721Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.144739Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.144742Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.144744Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.144747Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.144750Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.145725Z DEBUG fuser::request: FUSE(618) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 38010880, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.145865Z DEBUG fuser::request: FUSE(620) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 38141952, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.146086Z DEBUG fuser::request: FUSE(622) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 38273024, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.146214Z DEBUG fuser::request: FUSE(624) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 38404096, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.147573Z DEBUG fuser::request: FUSE(626) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 38535168, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.147705Z DEBUG fuser::request: FUSE(628) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 38666240, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.147908Z DEBUG fuser::request: FUSE(630) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 38797312, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.148038Z DEBUG fuser::request: FUSE(632) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 38928384, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.149707Z DEBUG fuser::request: FUSE(634) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 39059456, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.149850Z DEBUG fuser::request: FUSE(636) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 39190528, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.150070Z DEBUG fuser::request: FUSE(638) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 39321600, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.150203Z DEBUG fuser::request: FUSE(640) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 39452672, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.151831Z DEBUG fuser::request: FUSE(642) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 39583744, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.151977Z DEBUG fuser::request: FUSE(644) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 39714816, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.152490Z DEBUG fuser::request: FUSE(646) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 39845888, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.152649Z DEBUG fuser::request: FUSE(648) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 39976960, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.154378Z DEBUG fuser::request: FUSE(650) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 40108032, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.154547Z DEBUG fuser::request: FUSE(652) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 40239104, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.154917Z DEBUG fuser::request: FUSE(654) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 40370176, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.155058Z DEBUG fuser::request: FUSE(656) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 40501248, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.156443Z DEBUG fuser::request: FUSE(658) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 40632320, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.156580Z DEBUG fuser::request: FUSE(660) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 40763392, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.157062Z DEBUG fuser::request: FUSE(662) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 40894464, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.157221Z DEBUG fuser::request: FUSE(664) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 41025536, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.158705Z DEBUG fuser::request: FUSE(666) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 41156608, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.158867Z DEBUG fuser::request: FUSE(668) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 41287680, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.159133Z DEBUG fuser::request: FUSE(670) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 41418752, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.159274Z DEBUG fuser::request: FUSE(672) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 41549824, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.160953Z DEBUG fuser::request: FUSE(674) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 41680896, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.161097Z DEBUG fuser::request: FUSE(676) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 41811968, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.161168Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.161195Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.161200Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.161208Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: Returning request 0x7fa7f4023500 for part 5 | |
| 2024-11-14T11:37:22.161224Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.161231Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.161263Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0 UploadPart for Multi-part Upload, with ID:14045258306563313237 | |
| 2024-11-14T11:37:22.161267Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.161279Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.161284Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.161285Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: Prepared request 0x7fa7f4023500 for part 5 | |
| 2024-11-14T11:37:22.161289Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.161296Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.161299Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:22.161303Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider successfully sourced from cache | |
| 2024-11-14T11:37:22.161306Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:22.161329Z INFO awscrt::AuthSigning: (id=0x7fa800005090) Signing successfully built canonical request for algorithm SigV4, with contents | |
| PUT | |
| /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet | |
| partNumber=5&uploadId=14045258306563313237 | |
| accept:application/xml | |
| content-encoding:aws-chunked | |
| content-length:8388655 | |
| host:172.200.201.1:80 | |
| x-amz-content-sha256:STREAMING-UNSIGNED-PAYLOAD-TRAILER | |
| x-amz-date:20241114T113722Z | |
| x-amz-decoded-content-length:8388608 | |
| x-amz-trailer:x-amz-checksum-crc32c | |
| accept;content-encoding;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-decoded-content-length;x-amz-trailer | |
| STREAMING-UNSIGNED-PAYLOAD-TRAILER | |
| 2024-11-14T11:37:22.161333Z INFO awscrt::AuthSigning: (id=0x7fa800005090) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 | |
| 20241114T113722Z | |
| 20241114/VAST/s3/aws4_request | |
| 27c132623bedb5856d440e4f0ddcd384a8db8ee4fa6fe31dd8443d0e949fe5bf | |
| 2024-11-14T11:37:22.161338Z DEBUG fuser::request: FUSE(678) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 41943040, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.161344Z INFO awscrt::AuthSigning: (id=0x7fa800005090) Http request successfully built final authorization value via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241114/VAST/s3/aws4_request, SignedHeaders=accept;content-encoding;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-decoded-content-length;x-amz-trailer, Signature=1395e202ac95445ea1fa80407f065e9a16fc068c9996583afa397fa9c655edf8 | |
| 2024-11-14T11:37:22.161360Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.161368Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.161372Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.161376Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.161383Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: attempting to acquire retry token for partition_id 172.200.201.1:80 | |
| 2024-11-14T11:37:22.161388Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket 0x7fa7f40019f0 for partition_id 172.200.201.1:80 found | |
| 2024-11-14T11:37:22.161394Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Initializing retry token 0x7fa7f4023640 | |
| 2024-11-14T11:37:22.161403Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/1/0/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.161408Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Vending retry_token 0x7fa7f4023640 | |
| 2024-11-14T11:37:22.161413Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: token acquired callback invoked with error Success. with token 0x7fa7f4008eb0 and nested token 0x7fa7f4023640 | |
| 2024-11-14T11:37:22.161419Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Acquire connection | |
| 2024-11-14T11:37:22.161425Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Grabbing pooled connection (0x7fa808016470) | |
| 2024-11-14T11:37:22.161431Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:22.161471Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Successfully completed connection acquisition with connection id=0x7fa808016470 | |
| 2024-11-14T11:37:22.161494Z DEBUG fuser::request: FUSE(680) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 42074112, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.161495Z DEBUG awscrt::http-stream: id=0x7fa808019920: Created client request on connection=0x7fa808016470: PUT /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet?partNumber=5&uploadId=14045258306563313237 HTTP/1.1 | |
| 2024-11-14T11:37:22.162813Z DEBUG fuser::request: FUSE(682) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 42205184, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.162959Z DEBUG fuser::request: FUSE(684) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 42336256, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.163315Z DEBUG fuser::request: FUSE(686) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 42467328, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.163454Z DEBUG fuser::request: FUSE(688) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 42598400, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.164897Z DEBUG fuser::request: FUSE(690) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 42729472, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.165068Z DEBUG fuser::request: FUSE(692) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 42860544, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.165365Z DEBUG fuser::request: FUSE(694) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 42991616, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.165509Z DEBUG fuser::request: FUSE(696) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 43122688, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.166639Z DEBUG fuser::request: FUSE(698) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 43253760, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.166821Z DEBUG fuser::request: FUSE(700) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 43384832, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.167138Z DEBUG fuser::request: FUSE(702) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 43515904, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.167259Z DEBUG fuser::request: FUSE(704) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 43646976, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.168561Z DEBUG fuser::request: FUSE(706) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 43778048, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.168724Z DEBUG fuser::request: FUSE(708) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 43909120, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.168982Z DEBUG fuser::request: FUSE(710) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 44040192, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.169115Z DEBUG fuser::request: FUSE(712) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 44171264, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.170282Z DEBUG fuser::request: FUSE(714) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 44302336, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.170437Z DEBUG fuser::request: FUSE(716) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 44433408, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.171075Z DEBUG fuser::request: FUSE(718) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 44564480, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.171219Z DEBUG fuser::request: FUSE(720) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 44695552, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.171885Z DEBUG fuser::request: FUSE(722) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 44826624, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.172032Z DEBUG fuser::request: FUSE(724) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 44957696, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.172704Z DEBUG fuser::request: FUSE(726) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 45088768, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.172842Z DEBUG fuser::request: FUSE(728) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 45219840, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.173438Z DEBUG fuser::request: FUSE(730) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 45350912, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.173582Z DEBUG fuser::request: FUSE(732) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 45481984, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.174674Z DEBUG fuser::request: FUSE(734) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 45613056, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.174816Z DEBUG fuser::request: FUSE(736) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 45744128, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.175611Z DEBUG fuser::request: FUSE(738) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 45875200, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.175745Z DEBUG fuser::request: FUSE(740) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 46006272, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.176735Z DEBUG fuser::request: FUSE(742) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 46137344, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.176866Z DEBUG fuser::request: FUSE(744) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 46268416, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.177304Z DEBUG fuser::request: FUSE(746) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 46399488, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.177424Z DEBUG fuser::request: FUSE(748) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 46530560, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.178668Z DEBUG fuser::request: FUSE(750) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 46661632, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.178815Z DEBUG fuser::request: FUSE(752) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 46792704, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.179037Z DEBUG fuser::request: FUSE(754) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 46923776, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.179158Z DEBUG fuser::request: FUSE(756) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 47054848, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.180940Z DEBUG awscrt::http-stream: id=0x7fa808019920: Client request complete, response status: 200 (OK). | |
| 2024-11-14T11:37:22.180959Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: Request 0x7fa7f4023500 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
| 2024-11-14T11:37:22.180965Z DEBUG awscrt::standard-retry-strategy: token_id=0x7fa7f4008eb0: partition=172.200.201.1:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
| 2024-11-14T11:37:22.180968Z DEBUG fuser::request: FUSE(758) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 47185920, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.180980Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: 5 parts have completed. | |
| 2024-11-14T11:37:22.180996Z DEBUG awscrt::connection-manager: id=0x564afe247d70: User releasing connection (id=0x7fa808016470) | |
| 2024-11-14T11:37:22.181002Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:22.181007Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.181020Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.181022Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.181030Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.181036Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.181031Z DEBUG open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}:put_object{id=17 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: S3 request finished request_type=UploadPart crt_error=None http_status=200 range=None duration=19.699576ms ttfb=Some(12.684654ms) request_id=136131001382ac | |
| 2024-11-14T11:37:22.181074Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.181080Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.181085Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.181090Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.181096Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.181142Z DEBUG fuser::request: FUSE(760) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 47316992, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.181357Z DEBUG fuser::request: FUSE(762) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 47448064, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.181480Z DEBUG fuser::request: FUSE(764) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 47579136, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.183002Z DEBUG fuser::request: FUSE(766) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 47710208, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.183143Z DEBUG fuser::request: FUSE(768) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 47841280, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.183352Z DEBUG fuser::request: FUSE(770) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 47972352, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.183476Z DEBUG fuser::request: FUSE(772) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 48103424, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.185023Z DEBUG fuser::request: FUSE(774) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 48234496, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.185151Z DEBUG fuser::request: FUSE(776) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 48365568, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.185360Z DEBUG fuser::request: FUSE(778) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 48496640, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.185482Z DEBUG fuser::request: FUSE(780) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 48627712, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.186775Z DEBUG fuser::request: FUSE(782) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 48758784, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.186906Z DEBUG fuser::request: FUSE(784) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 48889856, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.187112Z DEBUG fuser::request: FUSE(786) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 49020928, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.187237Z DEBUG fuser::request: FUSE(788) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 49152000, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.188604Z DEBUG fuser::request: FUSE(790) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 49283072, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.188733Z DEBUG fuser::request: FUSE(792) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 49414144, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.188944Z DEBUG fuser::request: FUSE(794) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 49545216, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.189112Z DEBUG fuser::request: FUSE(796) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 49676288, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.190435Z DEBUG fuser::request: FUSE(798) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 49807360, size 131072, write flags 0x0 | |
| 2024-11-14T11:37:22.190518Z DEBUG fuser::request: FUSE(800) ino 0x0000000000000008 WRITE fh FileHandle(2), offset 49938432, size 23209, write flags 0x0 | |
| 2024-11-14T11:37:22.190555Z DEBUG fuser::request: FUSE(802) ino 0x0000000000000008 FLUSH fh FileHandle(2), lock owner LockOwner(9853402045375017833) | |
| 2024-11-14T11:37:22.190615Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.190627Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.190630Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.190636Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: Returning request 0x7fa7f4023500 for part 6 | |
| 2024-11-14T11:37:22.190648Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.190652Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.190684Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.190684Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0 UploadPart for Multi-part Upload, with ID:14045258306563313237 | |
| 2024-11-14T11:37:22.190759Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.190768Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.190771Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.190774Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.190778Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: Prepared request 0x7fa7f4023500 for part 6 | |
| 2024-11-14T11:37:22.190790Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:22.190794Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider successfully sourced from cache | |
| 2024-11-14T11:37:22.190796Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:22.190819Z INFO awscrt::AuthSigning: (id=0x7fa800001060) Signing successfully built canonical request for algorithm SigV4, with contents | |
| PUT | |
| /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet | |
| partNumber=6&uploadId=14045258306563313237 | |
| accept:application/xml | |
| content-encoding:aws-chunked | |
| content-length:8018648 | |
| host:172.200.201.1:80 | |
| x-amz-content-sha256:STREAMING-UNSIGNED-PAYLOAD-TRAILER | |
| x-amz-date:20241114T113722Z | |
| x-amz-decoded-content-length:8018601 | |
| x-amz-trailer:x-amz-checksum-crc32c | |
| accept;content-encoding;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-decoded-content-length;x-amz-trailer | |
| STREAMING-UNSIGNED-PAYLOAD-TRAILER | |
| 2024-11-14T11:37:22.190823Z INFO awscrt::AuthSigning: (id=0x7fa800001060) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 | |
| 20241114T113722Z | |
| 20241114/VAST/s3/aws4_request | |
| 9670d73bae4c7736087735e5ea9d3268e366e0e14261d800365fc78564574e0a | |
| 2024-11-14T11:37:22.190834Z INFO awscrt::AuthSigning: (id=0x7fa800001060) Http request successfully built final authorization value via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241114/VAST/s3/aws4_request, SignedHeaders=accept;content-encoding;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-decoded-content-length;x-amz-trailer, Signature=ba307cad673a10d0ca6d81e013ebe0754dfdf7447c02b9b1cf0c68e3b6667601 | |
| 2024-11-14T11:37:22.190849Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.190852Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.190855Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.190858Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.190863Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: attempting to acquire retry token for partition_id 172.200.201.1:80 | |
| 2024-11-14T11:37:22.190866Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket 0x7fa7f40019f0 for partition_id 172.200.201.1:80 found | |
| 2024-11-14T11:37:22.190870Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Initializing retry token 0x7fa7f4023640 | |
| 2024-11-14T11:37:22.190877Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/1/0/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.190884Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Vending retry_token 0x7fa7f4023640 | |
| 2024-11-14T11:37:22.190887Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: token acquired callback invoked with error Success. with token 0x7fa7f4008eb0 and nested token 0x7fa7f4023640 | |
| 2024-11-14T11:37:22.190890Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Acquire connection | |
| 2024-11-14T11:37:22.190894Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Grabbing pooled connection (0x7fa808016470) | |
| 2024-11-14T11:37:22.190898Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:22.190968Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Successfully completed connection acquisition with connection id=0x7fa808016470 | |
| 2024-11-14T11:37:22.191021Z DEBUG awscrt::http-stream: id=0x7fa808019920: Created client request on connection=0x7fa808016470: PUT /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet?partNumber=6&uploadId=14045258306563313237 HTTP/1.1 | |
| 2024-11-14T11:37:22.209658Z DEBUG awscrt::http-stream: id=0x7fa808019920: Client request complete, response status: 200 (OK). | |
| 2024-11-14T11:37:22.209684Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: Request 0x7fa7f4023500 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
| 2024-11-14T11:37:22.209689Z DEBUG awscrt::standard-retry-strategy: token_id=0x7fa7f4008eb0: partition=172.200.201.1:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
| 2024-11-14T11:37:22.209703Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: 6 parts have completed. | |
| 2024-11-14T11:37:22.209716Z DEBUG awscrt::connection-manager: id=0x564afe247d70: User releasing connection (id=0x7fa808016470) | |
| 2024-11-14T11:37:22.209720Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:22.209723Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.209740Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.209743Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.209751Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.209755Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.209754Z DEBUG open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}:put_object{id=17 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: S3 request finished request_type=UploadPart crt_error=None http_status=200 range=None duration=18.929185ms ttfb=Some(11.248344ms) request_id=136131001382b6 | |
| 2024-11-14T11:37:22.209798Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.209801Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.209804Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.209807Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.209810Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.210248Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: Prepared request 0x7fa7f4023500 for part 0 | |
| 2024-11-14T11:37:22.210261Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:22.210265Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider successfully sourced from cache | |
| 2024-11-14T11:37:22.210268Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:22.210288Z INFO awscrt::AuthSigning: (id=0x7fa800005090) Signing successfully built canonical request for algorithm SigV4, with contents | |
| POST | |
| /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet | |
| uploadId=14045258306563313237 | |
| accept:application/xml | |
| content-length:1123 | |
| host:172.200.201.1:80 | |
| x-amz-content-sha256:UNSIGNED-PAYLOAD | |
| x-amz-date:20241114T113722Z | |
| accept;content-length;host;x-amz-content-sha256;x-amz-date | |
| UNSIGNED-PAYLOAD | |
| 2024-11-14T11:37:22.210292Z INFO awscrt::AuthSigning: (id=0x7fa800005090) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 | |
| 20241114T113722Z | |
| 20241114/VAST/s3/aws4_request | |
| 4898a316631357b2f6af65868bc7e16d7426a4ee450a5346b8f9408d04ee7f16 | |
| 2024-11-14T11:37:22.210303Z INFO awscrt::AuthSigning: (id=0x7fa800005090) Http request successfully built final authorization value via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241114/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date, Signature=d8196657cd5c84449a96895a9d9cba4bf6cef5bc7a92788bce99a56424ed06ca | |
| 2024-11-14T11:37:22.210317Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.210321Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.210324Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.210327Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.210332Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: attempting to acquire retry token for partition_id 172.200.201.1:80 | |
| 2024-11-14T11:37:22.210336Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket 0x7fa7f40019f0 for partition_id 172.200.201.1:80 found | |
| 2024-11-14T11:37:22.210339Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Initializing retry token 0x7fa7f4023640 | |
| 2024-11-14T11:37:22.210353Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/1/0/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.210379Z DEBUG awscrt::exp-backoff-strategy: id=0x564afdffabd0: Vending retry_token 0x7fa7f4023640 | |
| 2024-11-14T11:37:22.210396Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: token acquired callback invoked with error Success. with token 0x7fa7f4008eb0 and nested token 0x7fa7f4023640 | |
| 2024-11-14T11:37:22.210401Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Acquire connection | |
| 2024-11-14T11:37:22.210405Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Grabbing pooled connection (0x7fa808016470) | |
| 2024-11-14T11:37:22.210409Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:22.210430Z DEBUG awscrt::connection-manager: id=0x564afe247d70: Successfully completed connection acquisition with connection id=0x7fa808016470 | |
| 2024-11-14T11:37:22.210447Z DEBUG awscrt::http-stream: id=0x7fa808019920: Created client request on connection=0x7fa808016470: POST /csnow-bucket/nyc-data/yellow_tripdata_2024-01.parquet?uploadId=14045258306563313237 HTTP/1.1 | |
| 2024-11-14T11:37:22.228901Z DEBUG awscrt::http-stream: id=0x7fa808019920: Client request complete, response status: 200 (OK). | |
| 2024-11-14T11:37:22.228939Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0: Request 0x7fa7f4023500 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
| 2024-11-14T11:37:22.229008Z DEBUG awscrt::standard-retry-strategy: token_id=0x7fa7f4008eb0: partition=172.200.201.1:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
| 2024-11-14T11:37:22.229065Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.229073Z DEBUG awscrt::connection-manager: id=0x564afe247d70: User releasing connection (id=0x7fa808016470) | |
| 2024-11-14T11:37:22.229085Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.229089Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.229089Z DEBUG awscrt::connection-manager: id=0x564afe247d70: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=1, ref_count=1 | |
| 2024-11-14T11:37:22.229096Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.229101Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.229106Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.229109Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.229111Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.229114Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.229104Z DEBUG open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}:put_object{id=17 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: S3 request finished request_type=CompleteMultipartUpload crt_error=None http_status=200 range=None duration=18.813755ms ttfb=Some(18.35588ms) request_id=136131001382bf | |
| 2024-11-14T11:37:22.229117Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.229183Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.229186Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.229188Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.229192Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800d6f0 Meta request finished with error code 0 (Success.) | |
| 2024-11-14T11:37:22.229247Z DEBUG open{req=34 ino=8 pid=133008 name="yellow_tripdata_2024-01.parquet"}:put_object{id=17 bucket="csnow-bucket" key="nyc-data/yellow_tripdata_2024-01.parquet"}: mountpoint_s3_client::s3_crt_client: meta request finished duration=240.248521ms | |
| 2024-11-14T11:37:22.229287Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.229293Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.229345Z DEBUG flush{req=802 ino=8 fh=2 pid=133008 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fa7c800d6f0 Cleaning up meta request | |
| 2024-11-14T11:37:22.229354Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.229367Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.229371Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.229374Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.229378Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.229405Z DEBUG flush{req=802 ino=8 fh=2 pid=133008 name="yellow_tripdata_2024-01.parquet"}: mountpoint_s3::fs::handles: put succeeded key="nyc-data/yellow_tripdata_2024-01.parquet" size=49961641 | |
| 2024-11-14T11:37:22.229480Z DEBUG fuser::request: FUSE(804) ino 0x0000000000000008 RELEASE fh FileHandle(2), flags 0x8001, flush false, lock owner None | |
| 2024-11-14T11:37:22.718713Z DEBUG awscrt::dns: static: resolving host 172.200.201.1 | |
| 2024-11-14T11:37:22.718751Z DEBUG awscrt::dns: static: resolved record: 172.200.201.1 | |
| 2024-11-14T11:37:22.718755Z DEBUG awscrt::dns: static, resolving host 172.200.201.1 successful, returned 1 addresses | |
| 2024-11-14T11:37:22.958721Z DEBUG fuser::request: FUSE(806) ino 0x0000000000000001 LOOKUP name "nyc-data" | |
| 2024-11-14T11:37:22.958899Z DEBUG lookup{req=806 ino=1 name="nyc-data"}:head_object{id=18 bucket="csnow-bucket" key="nyc-data"}: mountpoint_s3_client::s3_crt_client::head_object: new request | |
| 2024-11-14T11:37:22.958916Z INFO lookup{req=806 ino=1 name="nyc-data"}: awscrt::S3Client: id=0x564afe0dbeb0 Initiating making of meta request | |
| 2024-11-14T11:37:22.958930Z DEBUG lookup{req=806 ino=1 name="nyc-data"}: awscrt::S3MetaRequest: id=0x7fa7c800dde0 Created new Default Meta Request. operation=HeadObject | |
| 2024-11-14T11:37:22.958947Z INFO lookup{req=806 ino=1 name="nyc-data"}: awscrt::S3Client: id=0x564afe0dbeb0: Created meta request 0x7fa7c800dde0 | |
| 2024-11-14T11:37:22.958981Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.959005Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.959009Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.959016Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800dde0: Meta Request Default created request 0x7fa7f4009740 | |
| 2024-11-14T11:37:22.959024Z DEBUG lookup{req=806 ino=1 name="nyc-data"}:list_objects{id=19 bucket="csnow-bucket" continued=false delimiter="/" max_keys="1" prefix="nyc-data/"}: mountpoint_s3_client::s3_crt_client::list_objects: new request | |
| 2024-11-14T11:37:22.959030Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.959033Z INFO lookup{req=806 ino=1 name="nyc-data"}: awscrt::S3Client: id=0x564afe0dbeb0 Initiating making of meta request | |
| 2024-11-14T11:37:22.959036Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.959039Z DEBUG lookup{req=806 ino=1 name="nyc-data"}: awscrt::S3MetaRequest: id=0x7fa7c80193c0 Created new Default Meta Request. operation=ListObjectsV2 | |
| 2024-11-14T11:37:22.959055Z INFO lookup{req=806 ino=1 name="nyc-data"}: awscrt::S3Client: id=0x564afe0dbeb0: Created meta request 0x7fa7c80193c0 | |
| 2024-11-14T11:37:22.959061Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.959065Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.959068Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.959071Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c80193c0: Meta Request Default created request 0x7fa7f40267b0 | |
| 2024-11-14T11:37:22.959075Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.959079Z INFO awscrt::S3ClientStats: id=0x564afe0dbeb0 Requests-in-flight(approx/exact):2/2 Requests-preparing:2 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
| 2024-11-14T11:37:22.959083Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c800dde0: Meta Request prepared request 0x7fa7f4009740 | |
| 2024-11-14T11:37:22.959110Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:22.959115Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider successfully sourced from cache | |
| 2024-11-14T11:37:22.959119Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:22.959140Z INFO awscrt::AuthSigning: (id=0x7fa80000bb00) Signing successfully built canonical request for algorithm SigV4, with contents | |
| HEAD | |
| /csnow-bucket/nyc-data | |
| accept:application/xml | |
| content-length:0 | |
| host:172.200.201.1:80 | |
| x-amz-content-sha256:UNSIGNED-PAYLOAD | |
| x-amz-date:20241114T113722Z | |
| accept;content-length;host;x-amz-content-sha256;x-amz-date | |
| UNSIGNED-PAYLOAD | |
| 2024-11-14T11:37:22.959144Z INFO awscrt::AuthSigning: (id=0x7fa80000bb00) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 | |
| 20241114T113722Z | |
| 20241114/VAST/s3/aws4_request | |
| 9a428a6ca5f0b9946a93b030c16ecc6803700a7faacf4ebd5001ed7940648bac | |
| 2024-11-14T11:37:22.959156Z INFO awscrt::AuthSigning: (id=0x7fa80000bb00) Http request successfully built final authorization value via algorithm SigV4, with contents | |
| AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241114/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date, Signature=e6c419b290e933c2f94332c3c0ad07749385c8ba831b3d4fedd268040f92b418 | |
| 2024-11-14T11:37:22.959178Z DEBUG awscrt::S3MetaRequest: id=0x7fa7c80193c0: Meta Request prepared request 0x7fa7f40267b0 | |
| 2024-11-14T11:37:22.959180Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
| 2024-11-14T11:37:22.959184Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Credentials provider chain get credentials dispatch | |
| 2024-11-14T11:37:22.959186Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 s_s3_client_process_work_default - Processing any new meta requests. | |
| 2024-11-14T11:37:22.959187Z DEBUG awscrt::AuthCredentialsProvider: (id=0x564afe137f30) Cached credentials provider successfully sourced from cache | |
| 2024-11-14T11:37:22.959190Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating meta requests. | |
| 2024-11-14T11:37:22.959191Z INFO awscrt::AuthCredentialsProvider: (id=0x564afdfdd100) Default chain credentials provider successfully sourced credentials | |
| 2024-11-14T11:37:22.959195Z DEBUG awscrt::S3Client: id=0x564afe0dbeb0 Updating connections, assigning requests where possible. | |
| 2024-11-14T11:37:22.959210Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: attempting to acquire retry token for partition_id 172.200.201.1:80 | |
| 2024-11-14T11:37:22.959214Z DEBUG awscrt::standard-retry-strategy: id=0x564afdff7e30: bucket 0x7fa7f40019f0 for partition_id 172.200.201.1:80 found | |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment