Last active
June 24, 2025 04:14
-
-
Save nerdalert/e2aa24102ab1bec4446556fbb194ad96 to your computer and use it in GitHub Desktop.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2025-06-24T04:04:35.7285268Z Current runner version: '2.325.0' | |
| 2025-06-24T04:04:35.7315212Z ##[group]Operating System | |
| 2025-06-24T04:04:35.7316005Z Ubuntu | |
| 2025-06-24T04:04:35.7316512Z 24.04.2 | |
| 2025-06-24T04:04:35.7316951Z LTS | |
| 2025-06-24T04:04:35.7317533Z ##[endgroup] | |
| 2025-06-24T04:04:35.7318061Z ##[group]Runner Image | |
| 2025-06-24T04:04:35.7318693Z Image: ubuntu-24.04 | |
| 2025-06-24T04:04:35.7319275Z Version: 20250615.1.0 | |
| 2025-06-24T04:04:35.7320471Z Included Software: https://github.com/actions/runner-images/blob/ubuntu24/20250615.1/images/ubuntu/Ubuntu2404-Readme.md | |
| 2025-06-24T04:04:35.7321903Z Image Release: https://github.com/actions/runner-images/releases/tag/ubuntu24%2F20250615.1 | |
| 2025-06-24T04:04:35.7322791Z ##[endgroup] | |
| 2025-06-24T04:04:35.7323377Z ##[group]Runner Image Provisioner | |
| 2025-06-24T04:04:35.7323987Z 2.0.437.1 | |
| 2025-06-24T04:04:35.7324629Z ##[endgroup] | |
| 2025-06-24T04:04:35.7325725Z ##[group]GITHUB_TOKEN Permissions | |
| 2025-06-24T04:04:35.7327918Z Contents: read | |
| 2025-06-24T04:04:35.7328444Z Metadata: read | |
| 2025-06-24T04:04:35.7329189Z PullRequests: read | |
| 2025-06-24T04:04:35.7329754Z ##[endgroup] | |
| 2025-06-24T04:04:35.7332210Z Secret source: None | |
| 2025-06-24T04:04:35.7333077Z Prepare workflow directory | |
| 2025-06-24T04:04:35.7664773Z Prepare all required actions | |
| 2025-06-24T04:04:35.7702781Z Getting action download info | |
| 2025-06-24T04:04:36.1623930Z Download action repository 'actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683' (SHA:11bd71901bbe5b1630ceea73d27597364c9af683) | |
| 2025-06-24T04:04:36.2641669Z Download action repository 'azure/setup-helm@5119fcb9089d432beecbf79bb2c7915207344b78' (SHA:5119fcb9089d432beecbf79bb2c7915207344b78) | |
| 2025-06-24T04:04:36.5531177Z Download action repository 'actions/setup-python@8d9ed9ac5c53483de85588cdf95a591a75ab9f55' (SHA:8d9ed9ac5c53483de85588cdf95a591a75ab9f55) | |
| 2025-06-24T04:04:36.7935295Z Download action repository 'helm/chart-testing-action@0d28d3144d3a25ea2cc349d6e59901c4ff469b3b' (SHA:0d28d3144d3a25ea2cc349d6e59901c4ff469b3b) | |
| 2025-06-24T04:04:36.9860543Z Download action repository 'helm/kind-action@a1b0e391336a6ee6713a0583f8c6240d70863de3' (SHA:a1b0e391336a6ee6713a0583f8c6240d70863de3) | |
| 2025-06-24T04:04:37.3240101Z Getting action download info | |
| 2025-06-24T04:04:37.4346296Z Download action repository 'sigstore/cosign-installer@dc72c7d5c4d10cd6bcb8cf6e3fd625a9e5e537da' (SHA:dc72c7d5c4d10cd6bcb8cf6e3fd625a9e5e537da) | |
| 2025-06-24T04:04:37.7319653Z Complete job name: Test Latest Release | |
| 2025-06-24T04:04:37.8152981Z ##[group]Run actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 | |
| 2025-06-24T04:04:37.8154664Z with: | |
| 2025-06-24T04:04:37.8155374Z fetch-depth: 0 | |
| 2025-06-24T04:04:37.8156148Z persist-credentials: true | |
| 2025-06-24T04:04:37.8157050Z repository: llm-d/llm-d-deployer | |
| 2025-06-24T04:04:37.8158194Z token: *** | |
| 2025-06-24T04:04:37.8158921Z ssh-strict: true | |
| 2025-06-24T04:04:37.8159670Z ssh-user: git | |
| 2025-06-24T04:04:37.8160660Z clean: true | |
| 2025-06-24T04:04:37.8161433Z sparse-checkout-cone-mode: true | |
| 2025-06-24T04:04:37.8162346Z fetch-tags: false | |
| 2025-06-24T04:04:37.8163099Z show-progress: true | |
| 2025-06-24T04:04:37.8163882Z lfs: false | |
| 2025-06-24T04:04:37.8164575Z submodules: false | |
| 2025-06-24T04:04:37.8165334Z set-safe-directory: true | |
| 2025-06-24T04:04:37.8166455Z ##[endgroup] | |
| 2025-06-24T04:04:38.0890591Z Syncing repository: llm-d/llm-d-deployer | |
| 2025-06-24T04:04:38.0893585Z ##[group]Getting Git version info | |
| 2025-06-24T04:04:38.0895474Z Working directory is '/home/runner/work/llm-d-deployer/llm-d-deployer' | |
| 2025-06-24T04:04:38.0898517Z [command]/usr/bin/git version | |
| 2025-06-24T04:04:38.0968895Z git version 2.49.0 | |
| 2025-06-24T04:04:38.0999988Z ##[endgroup] | |
| 2025-06-24T04:04:38.1013885Z Temporarily overriding HOME='/home/runner/work/_temp/ec0b553c-a429-436e-abd8-3ff6adbd163a' before making global git config changes | |
| 2025-06-24T04:04:38.1016432Z Adding repository directory to the temporary git global config as a safe directory | |
| 2025-06-24T04:04:38.1019610Z [command]/usr/bin/git config --global --add safe.directory /home/runner/work/llm-d-deployer/llm-d-deployer | |
| 2025-06-24T04:04:38.1057880Z Deleting the contents of '/home/runner/work/llm-d-deployer/llm-d-deployer' | |
| 2025-06-24T04:04:38.1061839Z ##[group]Initializing the repository | |
| 2025-06-24T04:04:38.1066838Z [command]/usr/bin/git init /home/runner/work/llm-d-deployer/llm-d-deployer | |
| 2025-06-24T04:04:38.1165442Z hint: Using 'master' as the name for the initial branch. This default branch name | |
| 2025-06-24T04:04:38.1167438Z hint: is subject to change. To configure the initial branch name to use in all | |
| 2025-06-24T04:04:38.1169068Z hint: of your new repositories, which will suppress this warning, call: | |
| 2025-06-24T04:04:38.1170544Z hint: | |
| 2025-06-24T04:04:38.1171500Z hint: git config --global init.defaultBranch <name> | |
| 2025-06-24T04:04:38.1172552Z hint: | |
| 2025-06-24T04:04:38.1174020Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and | |
| 2025-06-24T04:04:38.1176415Z hint: 'development'. The just-created branch can be renamed via this command: | |
| 2025-06-24T04:04:38.1178739Z hint: | |
| 2025-06-24T04:04:38.1180150Z hint: git branch -m <name> | |
| 2025-06-24T04:04:38.1182716Z Initialized empty Git repository in /home/runner/work/llm-d-deployer/llm-d-deployer/.git/ | |
| 2025-06-24T04:04:38.1188241Z [command]/usr/bin/git remote add origin https://github.com/llm-d/llm-d-deployer | |
| 2025-06-24T04:04:38.1223372Z ##[endgroup] | |
| 2025-06-24T04:04:38.1225622Z ##[group]Disabling automatic garbage collection | |
| 2025-06-24T04:04:38.1227715Z [command]/usr/bin/git config --local gc.auto 0 | |
| 2025-06-24T04:04:38.1256521Z ##[endgroup] | |
| 2025-06-24T04:04:38.1257691Z ##[group]Setting up auth | |
| 2025-06-24T04:04:38.1262634Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand | |
| 2025-06-24T04:04:38.1293679Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" | |
| 2025-06-24T04:04:38.1714351Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader | |
| 2025-06-24T04:04:38.1724400Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" | |
| 2025-06-24T04:04:38.1905564Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** | |
| 2025-06-24T04:04:38.1938713Z ##[endgroup] | |
| 2025-06-24T04:04:38.1940543Z ##[group]Fetching the repository | |
| 2025-06-24T04:04:38.1949499Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --no-recurse-submodules origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* +ec8fe5f4716f05a2a78c793d79483703b5833542:refs/remotes/pull/335/merge | |
| 2025-06-24T04:04:38.6842310Z From https://github.com/llm-d/llm-d-deployer | |
| 2025-06-24T04:04:38.6843400Z * [new branch] gh-pages -> origin/gh-pages | |
| 2025-06-24T04:04:38.6844562Z * [new branch] heterogeneous-p-and-d -> origin/heterogeneous-p-and-d | |
| 2025-06-24T04:04:38.6846963Z * [new branch] main -> origin/main | |
| 2025-06-24T04:04:38.6848009Z * [new branch] mkdn-link-checker1 -> origin/mkdn-link-checker1 | |
| 2025-06-24T04:04:38.6851118Z * [new branch] onboarding-flows -> origin/onboarding-flows | |
| 2025-06-24T04:04:38.6852036Z * [new tag] llm-d-1.0.0 -> llm-d-1.0.0 | |
| 2025-06-24T04:04:38.6853933Z * [new tag] llm-d-1.0.1 -> llm-d-1.0.1 | |
| 2025-06-24T04:04:38.6855030Z * [new tag] llm-d-1.0.10 -> llm-d-1.0.10 | |
| 2025-06-24T04:04:38.6856569Z * [new tag] llm-d-1.0.11 -> llm-d-1.0.11 | |
| 2025-06-24T04:04:38.6858350Z * [new tag] llm-d-1.0.12 -> llm-d-1.0.12 | |
| 2025-06-24T04:04:38.6859754Z * [new tag] llm-d-1.0.13 -> llm-d-1.0.13 | |
| 2025-06-24T04:04:38.6861881Z * [new tag] llm-d-1.0.14 -> llm-d-1.0.14 | |
| 2025-06-24T04:04:38.6863668Z * [new tag] llm-d-1.0.15 -> llm-d-1.0.15 | |
| 2025-06-24T04:04:38.6865628Z * [new tag] llm-d-1.0.16 -> llm-d-1.0.16 | |
| 2025-06-24T04:04:38.6866991Z * [new tag] llm-d-1.0.17 -> llm-d-1.0.17 | |
| 2025-06-24T04:04:38.6868212Z * [new tag] llm-d-1.0.18 -> llm-d-1.0.18 | |
| 2025-06-24T04:04:38.6869353Z * [new tag] llm-d-1.0.19 -> llm-d-1.0.19 | |
| 2025-06-24T04:04:38.6871499Z * [new tag] llm-d-1.0.2 -> llm-d-1.0.2 | |
| 2025-06-24T04:04:38.6872823Z * [new tag] llm-d-1.0.20 -> llm-d-1.0.20 | |
| 2025-06-24T04:04:38.6874282Z * [new tag] llm-d-1.0.3 -> llm-d-1.0.3 | |
| 2025-06-24T04:04:38.6875656Z * [new tag] llm-d-1.0.4 -> llm-d-1.0.4 | |
| 2025-06-24T04:04:38.6877329Z * [new tag] llm-d-1.0.5 -> llm-d-1.0.5 | |
| 2025-06-24T04:04:38.6879167Z * [new tag] llm-d-1.0.6 -> llm-d-1.0.6 | |
| 2025-06-24T04:04:38.6880971Z * [new tag] llm-d-1.0.7 -> llm-d-1.0.7 | |
| 2025-06-24T04:04:38.6882290Z * [new tag] llm-d-1.0.8 -> llm-d-1.0.8 | |
| 2025-06-24T04:04:38.6885935Z * [new tag] llm-d-1.0.9 -> llm-d-1.0.9 | |
| 2025-06-24T04:04:38.6889757Z * [new ref] ec8fe5f4716f05a2a78c793d79483703b5833542 -> pull/335/merge | |
| 2025-06-24T04:04:38.6927091Z ##[endgroup] | |
| 2025-06-24T04:04:38.6927800Z ##[group]Determining the checkout info | |
| 2025-06-24T04:04:38.6928686Z ##[endgroup] | |
| 2025-06-24T04:04:38.6935608Z [command]/usr/bin/git sparse-checkout disable | |
| 2025-06-24T04:04:38.6981273Z [command]/usr/bin/git config --local --unset-all extensions.worktreeConfig | |
| 2025-06-24T04:04:38.7011833Z ##[group]Checking out the ref | |
| 2025-06-24T04:04:38.7016948Z [command]/usr/bin/git checkout --progress --force refs/remotes/pull/335/merge | |
| 2025-06-24T04:04:38.7191685Z Note: switching to 'refs/remotes/pull/335/merge'. | |
| 2025-06-24T04:04:38.7192207Z | |
| 2025-06-24T04:04:38.7192646Z You are in 'detached HEAD' state. You can look around, make experimental | |
| 2025-06-24T04:04:38.7193357Z changes and commit them, and you can discard any commits you make in this | |
| 2025-06-24T04:04:38.7194214Z state without impacting any branches by switching back to a branch. | |
| 2025-06-24T04:04:38.7194581Z | |
| 2025-06-24T04:04:38.7194833Z If you want to create a new branch to retain commits you create, you may | |
| 2025-06-24T04:04:38.7195386Z do so (now or later) by using -c with the switch command. Example: | |
| 2025-06-24T04:04:38.7195705Z | |
| 2025-06-24T04:04:38.7195855Z git switch -c <new-branch-name> | |
| 2025-06-24T04:04:38.7196076Z | |
| 2025-06-24T04:04:38.7196220Z Or undo this operation with: | |
| 2025-06-24T04:04:38.7196425Z | |
| 2025-06-24T04:04:38.7196542Z git switch - | |
| 2025-06-24T04:04:38.7196710Z | |
| 2025-06-24T04:04:38.7196983Z Turn off this advice by setting config variable advice.detachedHead to false | |
| 2025-06-24T04:04:38.7197352Z | |
| 2025-06-24T04:04:38.7197776Z HEAD is now at ec8fe5f Merge 379afa09693f1513b62ea7a29029a47e5dd07c6c into 4ef77d318945c21b40f75c3c1cd9453934981cc3 | |
| 2025-06-24T04:04:38.7201235Z ##[endgroup] | |
| 2025-06-24T04:04:38.7235049Z [command]/usr/bin/git log -1 --format=%H | |
| 2025-06-24T04:04:38.7256466Z ec8fe5f4716f05a2a78c793d79483703b5833542 | |
| 2025-06-24T04:04:38.7461402Z ##[group]Run azure/setup-helm@5119fcb9089d432beecbf79bb2c7915207344b78 | |
| 2025-06-24T04:04:38.7461823Z with: | |
| 2025-06-24T04:04:38.7462042Z version: v3.10.0 | |
| 2025-06-24T04:04:38.7462301Z ##[endgroup] | |
| 2025-06-24T04:04:38.8016434Z ##[group]Downloading v3.10.0 | |
| 2025-06-24T04:04:39.0068042Z [command]/usr/bin/unzip -o -q /home/runner/work/_temp/2c449a28-49c3-495e-a4aa-0b82f8e19d55 | |
| 2025-06-24T04:04:39.3684590Z ##[endgroup] | |
| 2025-06-24T04:04:39.3688373Z Helm tool version 'v3.10.0' has been cached at /opt/hostedtoolcache/helm/3.10.0/x64/linux-amd64/helm | |
| 2025-06-24T04:04:39.3914627Z ##[group]Run actions/setup-python@8d9ed9ac5c53483de85588cdf95a591a75ab9f55 | |
| 2025-06-24T04:04:39.3915016Z with: | |
| 2025-06-24T04:04:39.3915200Z python-version: 3.13 | |
| 2025-06-24T04:04:39.3915419Z check-latest: false | |
| 2025-06-24T04:04:39.3915752Z token: *** | |
| 2025-06-24T04:04:39.3915956Z update-environment: true | |
| 2025-06-24T04:04:39.3916197Z allow-prereleases: false | |
| 2025-06-24T04:04:39.3916409Z freethreaded: false | |
| 2025-06-24T04:04:39.3916607Z ##[endgroup] | |
| 2025-06-24T04:04:39.5540999Z ##[group]Installed versions | |
| 2025-06-24T04:04:39.5595985Z Successfully set up CPython (3.13.5) | |
| 2025-06-24T04:04:39.5596685Z ##[endgroup] | |
| 2025-06-24T04:04:39.5724667Z ##[group]Run helm/chart-testing-action@0d28d3144d3a25ea2cc349d6e59901c4ff469b3b | |
| 2025-06-24T04:04:39.5725091Z with: | |
| 2025-06-24T04:04:39.5725282Z version: 3.12.0 | |
| 2025-06-24T04:04:39.5725473Z yamllint_version: 1.33.0 | |
| 2025-06-24T04:04:39.5725687Z yamale_version: 4.0.4 | |
| 2025-06-24T04:04:39.5725868Z env: | |
| 2025-06-24T04:04:39.5726109Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:39.5726551Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T04:04:39.5726941Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:39.5727284Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:39.5727630Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:39.5727979Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T04:04:39.5728265Z ##[endgroup] | |
| 2025-06-24T04:04:39.5963066Z ##[group]Run sigstore/cosign-installer@dc72c7d5c4d10cd6bcb8cf6e3fd625a9e5e537da | |
| 2025-06-24T04:04:39.5963447Z with: | |
| 2025-06-24T04:04:39.5963634Z cosign-release: v2.4.1 | |
| 2025-06-24T04:04:39.5963845Z install-dir: $HOME/.cosign | |
| 2025-06-24T04:04:39.5964062Z use-sudo: false | |
| 2025-06-24T04:04:39.5964230Z env: | |
| 2025-06-24T04:04:39.5964467Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:39.5964868Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T04:04:39.5965263Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:39.5965611Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:39.5965945Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:39.5966289Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T04:04:39.5966572Z ##[endgroup] | |
| 2025-06-24T04:04:39.6024985Z ##[group]Run #!/bin/bash | |
| 2025-06-24T04:04:39.6025660Z [36;1m#!/bin/bash[0m | |
| 2025-06-24T04:04:39.6025875Z [36;1m# cosign install script[0m | |
| 2025-06-24T04:04:39.6026137Z [36;1mshopt -s expand_aliases[0m | |
| 2025-06-24T04:04:39.6026379Z [36;1mif [ -z "$NO_COLOR" ]; then[0m | |
| 2025-06-24T04:04:39.6026669Z [36;1m alias log_info="echo -e \"\033[1;32mINFO\033[0m:\""[0m | |
| 2025-06-24T04:04:39.6027019Z [36;1m alias log_error="echo -e \"\033[1;31mERROR\033[0m:\""[0m | |
| 2025-06-24T04:04:39.6027290Z [36;1melse[0m | |
| 2025-06-24T04:04:39.6027492Z [36;1m alias log_info="echo \"INFO:\""[0m | |
| 2025-06-24T04:04:39.6027773Z [36;1m alias log_error="echo \"ERROR:\""[0m | |
| 2025-06-24T04:04:39.6028021Z [36;1mfi[0m | |
| 2025-06-24T04:04:39.6028180Z [36;1mset -e[0m | |
| 2025-06-24T04:04:39.6028348Z [36;1m[0m | |
| 2025-06-24T04:04:39.6028525Z [36;1mmkdir -p $HOME/.cosign[0m | |
| 2025-06-24T04:04:39.6028738Z [36;1m[0m | |
| 2025-06-24T04:04:39.6028909Z [36;1mif [[ v2.4.1 == "main" ]]; then[0m | |
| 2025-06-24T04:04:39.6029254Z [36;1m log_info "installing cosign via 'go install' from its main version"[0m | |
| 2025-06-24T04:04:39.6029602Z [36;1m GOBIN=$(go env GOPATH)/bin[0m | |
| 2025-06-24T04:04:39.6030066Z [36;1m go install github.com/sigstore/cosign/cmd/cosign@main[0m | |
| 2025-06-24T04:04:39.6030401Z [36;1m ln -s $GOBIN/cosign $HOME/.cosign/cosign[0m | |
| 2025-06-24T04:04:39.6030650Z [36;1m exit 0[0m | |
| 2025-06-24T04:04:39.6030818Z [36;1mfi[0m | |
| 2025-06-24T04:04:39.6030975Z [36;1m[0m | |
| 2025-06-24T04:04:39.6031129Z [36;1mshaprog() {[0m | |
| 2025-06-24T04:04:39.6031321Z [36;1m case Linux in[0m | |
| 2025-06-24T04:04:39.6031514Z [36;1m Linux|linux)[0m | |
| 2025-06-24T04:04:39.6031920Z [36;1m sha256sum $1 | cut -d' ' -f1[0m | |
| 2025-06-24T04:04:39.6032145Z [36;1m ;;[0m | |
| 2025-06-24T04:04:39.6032317Z [36;1m macOS|macos)[0m | |
| 2025-06-24T04:04:39.6032525Z [36;1m shasum -a256 $1 | cut -d' ' -f1[0m | |
| 2025-06-24T04:04:39.6032759Z [36;1m ;;[0m | |
| 2025-06-24T04:04:39.6032934Z [36;1m Windows|windows)[0m | |
| 2025-06-24T04:04:39.6033374Z [36;1m powershell -command "(Get-FileHash $1 -Algorithm SHA256 | Select-Object -ExpandProperty Hash).ToLower()"[0m | |
| 2025-06-24T04:04:39.6033862Z [36;1m ;;[0m | |
| 2025-06-24T04:04:39.6034173Z [36;1m *)[0m | |
| 2025-06-24T04:04:39.6034376Z [36;1m log_error "unsupported OS Linux"[0m | |
| 2025-06-24T04:04:39.6034638Z [36;1m exit 1[0m | |
| 2025-06-24T04:04:39.6034809Z [36;1m ;;[0m | |
| 2025-06-24T04:04:39.6034972Z [36;1m esac[0m | |
| 2025-06-24T04:04:39.6035125Z [36;1m}[0m | |
| 2025-06-24T04:04:39.6035280Z [36;1m[0m | |
| 2025-06-24T04:04:39.6035447Z [36;1mbootstrap_version='v2.4.1'[0m | |
| 2025-06-24T04:04:39.6035894Z [36;1mbootstrap_linux_amd64_sha='8b24b946dd5809c6bd93de08033bcf6bc0ed7d336b7785787c080f574b89249b'[0m | |
| 2025-06-24T04:04:39.6036521Z [36;1mbootstrap_linux_arm_sha='541fd175fae792a154fa2fa025146e3d4691e2dd97717fa9ace35677a88489e7'[0m | |
| 2025-06-24T04:04:39.6037130Z [36;1mbootstrap_linux_arm64_sha='3b2e2e3854d0356c45fe6607047526ccd04742d20bd44afb5be91fa2a6e7cb4a'[0m | |
| 2025-06-24T04:04:39.6037751Z [36;1mbootstrap_darwin_amd64_sha='666032ca283da92b6f7953965688fd51200fdc891a86c19e05c98b898ea0af4e'[0m | |
| 2025-06-24T04:04:39.6038359Z [36;1mbootstrap_darwin_arm64_sha='13343856b69f70388c4fe0b986a31dde5958e444b41be22d785d3dc5e1a9cc62'[0m | |
| 2025-06-24T04:04:39.6038977Z [36;1mbootstrap_windows_amd64_sha='8d57f8a42a981d27290c4227271fa9f0f62ca6630eb4a21d316bd6b01405b87c'[0m | |
| 2025-06-24T04:04:39.6039420Z [36;1mcosign_executable_name=cosign[0m | |
| 2025-06-24T04:04:39.6039644Z [36;1m[0m | |
| 2025-06-24T04:04:39.6039928Z [36;1mtrap "popd >/dev/null" EXIT[0m | |
| 2025-06-24T04:04:39.6040150Z [36;1m[0m | |
| 2025-06-24T04:04:39.6040331Z [36;1mpushd $HOME/.cosign > /dev/null[0m | |
| 2025-06-24T04:04:39.6040556Z [36;1m[0m | |
| 2025-06-24T04:04:39.6040719Z [36;1mcase Linux in[0m | |
| 2025-06-24T04:04:39.6040911Z [36;1m Linux|linux)[0m | |
| 2025-06-24T04:04:39.6041109Z [36;1m case X64 in[0m | |
| 2025-06-24T04:04:39.6041302Z [36;1m X64|amd64)[0m | |
| 2025-06-24T04:04:39.6041538Z [36;1m bootstrap_filename='cosign-linux-amd64'[0m | |
| 2025-06-24T04:04:39.6041865Z [36;1m bootstrap_sha=${bootstrap_linux_amd64_sha}[0m | |
| 2025-06-24T04:04:39.6042193Z [36;1m desired_cosign_filename='cosign-linux-amd64'[0m | |
| 2025-06-24T04:04:39.6042576Z [36;1m # v0.6.0 had different filename structures from all other releases[0m | |
| 2025-06-24T04:04:39.6042914Z [36;1m if [[ v2.4.1 == 'v0.6.0' ]]; then[0m | |
| 2025-06-24T04:04:39.6043246Z [36;1m desired_cosign_filename='cosign_linux_amd64_0.6.0_linux_amd64'[0m | |
| 2025-06-24T04:04:39.6043687Z [36;1m desired_cosign_v060_signature='cosign_linux_amd64_0.6.0_linux_amd64.sig'[0m | |
| 2025-06-24T04:04:39.6044028Z [36;1m fi[0m | |
| 2025-06-24T04:04:39.6044202Z [36;1m ;;[0m | |
| 2025-06-24T04:04:39.6044363Z [36;1m[0m | |
| 2025-06-24T04:04:39.6044523Z [36;1m ARM|arm)[0m | |
| 2025-06-24T04:04:39.6044748Z [36;1m bootstrap_filename='cosign-linux-arm'[0m | |
| 2025-06-24T04:04:39.6045051Z [36;1m bootstrap_sha=${bootstrap_linux_arm_sha}[0m | |
| 2025-06-24T04:04:39.6045359Z [36;1m desired_cosign_filename='cosign-linux-arm'[0m | |
| 2025-06-24T04:04:39.6045642Z [36;1m if [[ v2.4.1 == 'v0.6.0' ]]; then[0m | |
| 2025-06-24T04:04:39.6045942Z [36;1m log_error "linux-arm build not available at v0.6.0"[0m | |
| 2025-06-24T04:04:39.6046222Z [36;1m exit 1[0m | |
| 2025-06-24T04:04:39.6046408Z [36;1m fi[0m | |
| 2025-06-24T04:04:39.6046570Z [36;1m ;;[0m | |
| 2025-06-24T04:04:39.6046734Z [36;1m[0m | |
| 2025-06-24T04:04:39.6046896Z [36;1m ARM64|arm64)[0m | |
| 2025-06-24T04:04:39.6047132Z [36;1m bootstrap_filename='cosign-linux-arm64'[0m | |
| 2025-06-24T04:04:39.6047559Z [36;1m bootstrap_sha=${bootstrap_linux_arm64_sha}[0m | |
| 2025-06-24T04:04:39.6047872Z [36;1m desired_cosign_filename='cosign-linux-arm64'[0m | |
| 2025-06-24T04:04:39.6048165Z [36;1m if [[ v2.4.1 == 'v0.6.0' ]]; then[0m | |
| 2025-06-24T04:04:39.6048465Z [36;1m log_error "linux-arm64 build not available at v0.6.0"[0m | |
| 2025-06-24T04:04:39.6048762Z [36;1m exit 1[0m | |
| 2025-06-24T04:04:39.6048948Z [36;1m fi[0m | |
| 2025-06-24T04:04:39.6049112Z [36;1m ;;[0m | |
| 2025-06-24T04:04:39.6049275Z [36;1m[0m | |
| 2025-06-24T04:04:39.6049420Z [36;1m *)[0m | |
| 2025-06-24T04:04:39.6049746Z [36;1m log_error "unsupported architecture X64"[0m | |
| 2025-06-24T04:04:39.6050335Z [36;1m exit 1[0m | |
| 2025-06-24T04:04:39.6050527Z [36;1m ;;[0m | |
| 2025-06-24T04:04:39.6050688Z [36;1m esac[0m | |
| 2025-06-24T04:04:39.6050853Z [36;1m ;;[0m | |
| 2025-06-24T04:04:39.6051010Z [36;1m[0m | |
| 2025-06-24T04:04:39.6051169Z [36;1m macOS|macos)[0m | |
| 2025-06-24T04:04:39.6051360Z [36;1m case X64 in[0m | |
| 2025-06-24T04:04:39.6051554Z [36;1m X64|amd64)[0m | |
| 2025-06-24T04:04:39.6051789Z [36;1m bootstrap_filename='cosign-darwin-amd64'[0m | |
| 2025-06-24T04:04:39.6052095Z [36;1m bootstrap_sha=${bootstrap_darwin_amd64_sha}[0m | |
| 2025-06-24T04:04:39.6052426Z [36;1m desired_cosign_filename='cosign-darwin-amd64'[0m | |
| 2025-06-24T04:04:39.6052787Z [36;1m # v0.6.0 had different filename structures from all other releases[0m | |
| 2025-06-24T04:04:39.6053129Z [36;1m if [[ v2.4.1 == 'v0.6.0' ]]; then[0m | |
| 2025-06-24T04:04:39.6053470Z [36;1m desired_cosign_filename='cosign_darwin_amd64_0.6.0_darwin_amd64'[0m | |
| 2025-06-24T04:04:39.6053922Z [36;1m desired_cosign_v060_signature='cosign_darwin_amd64_0.6.0_darwin_amd64.sig'[0m | |
| 2025-06-24T04:04:39.6054278Z [36;1m fi[0m | |
| 2025-06-24T04:04:39.6054447Z [36;1m ;;[0m | |
| 2025-06-24T04:04:39.6054617Z [36;1m[0m | |
| 2025-06-24T04:04:39.6054773Z [36;1m ARM64|arm64)[0m | |
| 2025-06-24T04:04:39.6055026Z [36;1m bootstrap_filename='cosign-darwin-arm64'[0m | |
| 2025-06-24T04:04:39.6055348Z [36;1m bootstrap_sha=${bootstrap_darwin_arm64_sha}[0m | |
| 2025-06-24T04:04:39.6055665Z [36;1m desired_cosign_filename='cosign-darwin-arm64'[0m | |
| 2025-06-24T04:04:39.6056036Z [36;1m # v0.6.0 had different filename structures from all other releases[0m | |
| 2025-06-24T04:04:39.6056366Z [36;1m if [[ v2.4.1 == 'v0.6.0' ]]; then[0m | |
| 2025-06-24T04:04:39.6056693Z [36;1m desired_cosign_filename='cosign_darwin_arm64_0.6.0_darwin_arm64'[0m | |
| 2025-06-24T04:04:39.6057134Z [36;1m desired_cosign_v060_signature='cosign_darwin_arm64_0.6.0_darwin_arm64.sig'[0m | |
| 2025-06-24T04:04:39.6057487Z [36;1m fi[0m | |
| 2025-06-24T04:04:39.6057656Z [36;1m ;;[0m | |
| 2025-06-24T04:04:39.6057817Z [36;1m[0m | |
| 2025-06-24T04:04:39.6057970Z [36;1m *)[0m | |
| 2025-06-24T04:04:39.6058176Z [36;1m log_error "unsupported architecture X64"[0m | |
| 2025-06-24T04:04:39.6058438Z [36;1m exit 1[0m | |
| 2025-06-24T04:04:39.6058620Z [36;1m ;;[0m | |
| 2025-06-24T04:04:39.6058786Z [36;1m esac[0m | |
| 2025-06-24T04:04:39.6058945Z [36;1m ;;[0m | |
| 2025-06-24T04:04:39.6059106Z [36;1m[0m | |
| 2025-06-24T04:04:39.6059269Z [36;1m Windows|windows)[0m | |
| 2025-06-24T04:04:39.6059468Z [36;1m case X64 in[0m | |
| 2025-06-24T04:04:39.6059660Z [36;1m X64|amd64)[0m | |
| 2025-06-24T04:04:39.6060009Z [36;1m bootstrap_filename='cosign-windows-amd64.exe'[0m | |
| 2025-06-24T04:04:39.6060337Z [36;1m bootstrap_sha=${bootstrap_windows_amd64_sha}[0m | |
| 2025-06-24T04:04:39.6060667Z [36;1m desired_cosign_filename='cosign-windows-amd64.exe'[0m | |
| 2025-06-24T04:04:39.6060992Z [36;1m cosign_executable_name=cosign.exe[0m | |
| 2025-06-24T04:04:39.6061325Z [36;1m # v0.6.0 had different filename structures from all other releases[0m | |
| 2025-06-24T04:04:39.6061649Z [36;1m if [[ v2.4.1 == 'v0.6.0' ]]; then[0m | |
| 2025-06-24T04:04:39.6061995Z [36;1m desired_cosign_filename='cosign_windows_amd64_0.6.0_windows_amd64.exe'[0m | |
| 2025-06-24T04:04:39.6062614Z [36;1m desired_cosign_v060_signature='cosign_windows_amd64_0.6.0_windows_amd64.exe.sig'[0m | |
| 2025-06-24T04:04:39.6062982Z [36;1m fi[0m | |
| 2025-06-24T04:04:39.6063147Z [36;1m ;;[0m | |
| 2025-06-24T04:04:39.6063315Z [36;1m *)[0m | |
| 2025-06-24T04:04:39.6063525Z [36;1m log_error "unsupported architecture X64"[0m | |
| 2025-06-24T04:04:39.6063780Z [36;1m exit 1[0m | |
| 2025-06-24T04:04:39.6063966Z [36;1m ;;[0m | |
| 2025-06-24T04:04:39.6064131Z [36;1m esac[0m | |
| 2025-06-24T04:04:39.6064293Z [36;1m ;;[0m | |
| 2025-06-24T04:04:39.6064448Z [36;1m *)[0m | |
| 2025-06-24T04:04:39.6064744Z [36;1m log_error "unsupported os Linux"[0m | |
| 2025-06-24T04:04:39.6064989Z [36;1m exit 1[0m | |
| 2025-06-24T04:04:39.6065159Z [36;1m ;;[0m | |
| 2025-06-24T04:04:39.6065318Z [36;1mesac[0m | |
| 2025-06-24T04:04:39.6065480Z [36;1m[0m | |
| 2025-06-24T04:04:39.6065640Z [36;1mSUDO=[0m | |
| 2025-06-24T04:04:39.6065878Z [36;1mif [[ "false" == "true" ]] && command -v sudo >/dev/null; then[0m | |
| 2025-06-24T04:04:39.6066177Z [36;1m SUDO=sudo[0m | |
| 2025-06-24T04:04:39.6066346Z [36;1mfi[0m | |
| 2025-06-24T04:04:39.6066502Z [36;1m[0m | |
| 2025-06-24T04:04:39.6066722Z [36;1mexpected_bootstrap_version_digest=${bootstrap_sha}[0m | |
| 2025-06-24T04:04:39.6067582Z [36;1mlog_info "Downloading bootstrap version '${bootstrap_version}' of cosign to verify version to be installed...\n https://github.com/sigstore/cosign/releases/download/${bootstrap_version}/${bootstrap_filename}"[0m | |
| 2025-06-24T04:04:39.6068728Z [36;1m$SUDO curl -fsL https://github.com/sigstore/cosign/releases/download/${bootstrap_version}/${bootstrap_filename} -o ${cosign_executable_name}[0m | |
| 2025-06-24T04:04:39.6069378Z [36;1mshaBootstrap=$(shaprog ${cosign_executable_name});[0m | |
| 2025-06-24T04:04:39.6069769Z [36;1mif [[ $shaBootstrap != ${expected_bootstrap_version_digest} ]]; then[0m | |
| 2025-06-24T04:04:39.6070277Z [36;1m log_error "Unable to validate cosign version: 'v2.4.1'"[0m | |
| 2025-06-24T04:04:39.6070562Z [36;1m exit 1[0m | |
| 2025-06-24T04:04:39.6070730Z [36;1mfi[0m | |
| 2025-06-24T04:04:39.6070929Z [36;1m$SUDO chmod +x ${cosign_executable_name}[0m | |
| 2025-06-24T04:04:39.6071176Z [36;1m[0m | |
| 2025-06-24T04:04:39.6071458Z [36;1m# If the bootstrap and specified `cosign` releases are the same, we're done.[0m | |
| 2025-06-24T04:04:39.6071842Z [36;1mif [[ v2.4.1 == ${bootstrap_version} ]]; then[0m | |
| 2025-06-24T04:04:39.6072312Z [36;1m log_info "bootstrap version successfully verified and matches requested version so nothing else to do"[0m | |
| 2025-06-24T04:04:39.6072748Z [36;1m exit 0[0m | |
| 2025-06-24T04:04:39.6072904Z [36;1mfi[0m | |
| 2025-06-24T04:04:39.6073059Z [36;1m[0m | |
| 2025-06-24T04:04:39.6073266Z [36;1msemver='^v([0-9]+\.){0,2}(\*|[0-9]+)(-?r?c?)(\.[0-9]+)$'[0m | |
| 2025-06-24T04:04:39.6073548Z [36;1mif [[ v2.4.1 =~ $semver ]]; then[0m | |
| 2025-06-24T04:04:39.6073829Z [36;1m log_info "Custom cosign version 'v2.4.1' requested"[0m | |
| 2025-06-24T04:04:39.6074102Z [36;1melse[0m | |
| 2025-06-24T04:04:39.6074362Z [36;1m log_error "Unable to validate requested cosign version: 'v2.4.1'"[0m | |
| 2025-06-24T04:04:39.6074682Z [36;1m exit 1[0m | |
| 2025-06-24T04:04:39.6074845Z [36;1mfi[0m | |
| 2025-06-24T04:04:39.6074992Z [36;1m[0m | |
| 2025-06-24T04:04:39.6075159Z [36;1m# Download custom cosign[0m | |
| 2025-06-24T04:04:39.6075777Z [36;1mlog_info "Downloading platform-specific version 'v2.4.1' of cosign...\n https://github.com/sigstore/cosign/releases/download/v2.4.1/${desired_cosign_filename}"[0m | |
| 2025-06-24T04:04:39.6076677Z [36;1m$SUDO curl -fsL https://github.com/sigstore/cosign/releases/download/v2.4.1/${desired_cosign_filename} -o cosign_v2.4.1[0m | |
| 2025-06-24T04:04:39.6077210Z [36;1mshaCustom=$(shaprog cosign_v2.4.1);[0m | |
| 2025-06-24T04:04:39.6077438Z [36;1m[0m | |
| 2025-06-24T04:04:39.6077624Z [36;1m# same hash means it is the same release[0m | |
| 2025-06-24T04:04:39.6077903Z [36;1mif [[ $shaCustom != $shaBootstrap ]]; then[0m | |
| 2025-06-24T04:04:39.6078200Z [36;1m if [[ v2.4.1 == 'v0.6.0' && Linux == 'Linux' ]]; then[0m | |
| 2025-06-24T04:04:39.6078534Z [36;1m # v0.6.0's linux release has a dependency on `libpcsclite1`[0m | |
| 2025-06-24T04:04:39.6079036Z [36;1m log_info "Installing libpcsclite1 package if necessary..."[0m | |
| 2025-06-24T04:04:39.6079343Z [36;1m set +e[0m | |
| 2025-06-24T04:04:39.6079534Z [36;1m sudo dpkg -s libpcsclite1[0m | |
| 2025-06-24T04:04:39.6079880Z [36;1m if [ $? -eq 0 ]; then[0m | |
| 2025-06-24T04:04:39.6080161Z [36;1m log_info "libpcsclite1 package is already installed"[0m | |
| 2025-06-24T04:04:39.6080445Z [36;1m else[0m | |
| 2025-06-24T04:04:39.6080723Z [36;1m log_info "libpcsclite1 package is not installed, installing it now."[0m | |
| 2025-06-24T04:04:39.6081205Z [36;1m sudo apt-get update -q -q[0m | |
| 2025-06-24T04:04:39.6081488Z [36;1m sudo apt-get install -yq libpcsclite1[0m | |
| 2025-06-24T04:04:39.6081734Z [36;1m fi[0m | |
| 2025-06-24T04:04:39.6082134Z [36;1m set -e[0m | |
| 2025-06-24T04:04:39.6105009Z [36;1m fi[0m | |
| 2025-06-24T04:04:39.6105260Z [36;1m[0m | |
| 2025-06-24T04:04:39.6105469Z [36;1m if [[ v2.4.1 == 'v0.6.0' ]]; then[0m | |
| 2025-06-24T04:04:39.6106265Z [36;1m log_info "Downloading detached signature for platform-specific 'v2.4.1' of cosign...\n https://github.com/sigstore/cosign/releases/download/v2.4.1/${desired_cosign_v060_signature}"[0m | |
| 2025-06-24T04:04:39.6107334Z [36;1m $SUDO curl -fsL https://github.com/sigstore/cosign/releases/download/v2.4.1/${desired_cosign_v060_signature} -o ${desired_cosign_filename}.sig[0m | |
| 2025-06-24T04:04:39.6107917Z [36;1m else[0m | |
| 2025-06-24T04:04:39.6108551Z [36;1m log_info "Downloading detached signature for platform-specific 'v2.4.1' of cosign...\n https://github.com/sigstore/cosign/releases/download/v2.4.1/${desired_cosign_filename}.sig"[0m | |
| 2025-06-24T04:04:39.6109480Z [36;1m $SUDO curl -fsLO https://github.com/sigstore/cosign/releases/download/v2.4.1/${desired_cosign_filename}.sig[0m | |
| 2025-06-24T04:04:39.6110183Z [36;1m fi[0m | |
| 2025-06-24T04:04:39.6110351Z [36;1m[0m | |
| 2025-06-24T04:04:39.6110528Z [36;1m if [[ v2.4.1 < 'v0.6.0' ]]; then[0m | |
| 2025-06-24T04:04:39.6111123Z [36;1m log_info "Downloading cosign public key 'v2.4.1' of cosign...\n https://raw.githubusercontent.com/sigstore/cosign/v2.4.1/.github/workflows/cosign.pub"[0m | |
| 2025-06-24T04:04:39.6111948Z [36;1m RELEASE_COSIGN_PUB_KEY=https://raw.githubusercontent.com/sigstore/cosign/v2.4.1/.github/workflows/cosign.pub[0m | |
| 2025-06-24T04:04:39.6112618Z [36;1m RELEASE_COSIGN_PUB_KEY_SHA='4aa4bd19530a4929d758a9896255aef2c82f1a3a9f4b000034c6df4307c14f9e'[0m | |
| 2025-06-24T04:04:39.6113030Z [36;1m else[0m | |
| 2025-06-24T04:04:39.6113551Z [36;1m log_info "Downloading cosign public key 'v2.4.1' of cosign...\n https://raw.githubusercontent.com/sigstore/cosign/v2.4.1/release/release-cosign.pub"[0m | |
| 2025-06-24T04:04:39.6114387Z [36;1m RELEASE_COSIGN_PUB_KEY=https://raw.githubusercontent.com/sigstore/cosign/v2.4.1/release/release-cosign.pub[0m | |
| 2025-06-24T04:04:39.6115065Z [36;1m RELEASE_COSIGN_PUB_KEY_SHA='f4cea466e5e887a45da5031757fa1d32655d83420639dc1758749b744179f126'[0m | |
| 2025-06-24T04:04:39.6115477Z [36;1m fi[0m | |
| 2025-06-24T04:04:39.6115632Z [36;1m[0m | |
| 2025-06-24T04:04:39.6115872Z [36;1m log_info "Verifying public key matches expected value"[0m | |
| 2025-06-24T04:04:39.6116242Z [36;1m $SUDO curl -fsL $RELEASE_COSIGN_PUB_KEY -o public.key[0m | |
| 2025-06-24T04:04:39.6116558Z [36;1m sha_fetched_key=$(shaprog public.key)[0m | |
| 2025-06-24T04:04:39.6116885Z [36;1m if [[ $sha_fetched_key != $RELEASE_COSIGN_PUB_KEY_SHA ]]; then[0m | |
| 2025-06-24T04:04:39.6117287Z [36;1m log_error "Fetched public key does not match expected digest, exiting"[0m | |
| 2025-06-24T04:04:39.6117631Z [36;1m exit 1[0m | |
| 2025-06-24T04:04:39.6117806Z [36;1m fi[0m | |
| 2025-06-24T04:04:39.6117963Z [36;1m[0m | |
| 2025-06-24T04:04:39.6118251Z [36;1m log_info "Using bootstrap cosign to verify signature of desired cosign version"[0m | |
| 2025-06-24T04:04:39.6118886Z [36;1m ./cosign verify-blob --insecure-ignore-tlog --key public.key --signature ${desired_cosign_filename}.sig cosign_v2.4.1[0m | |
| 2025-06-24T04:04:39.6119396Z [36;1m[0m | |
| 2025-06-24T04:04:39.6119772Z [36;1m $SUDO rm cosign[0m | |
| 2025-06-24T04:04:39.6120146Z [36;1m $SUDO mv cosign_v2.4.1 ${cosign_executable_name}[0m | |
| 2025-06-24T04:04:39.6120450Z [36;1m $SUDO chmod +x ${cosign_executable_name}[0m | |
| 2025-06-24T04:04:39.6120735Z [36;1m log_info "Installation complete!"[0m | |
| 2025-06-24T04:04:39.6120975Z [36;1mfi[0m | |
| 2025-06-24T04:04:39.6257586Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} | |
| 2025-06-24T04:04:39.6257919Z env: | |
| 2025-06-24T04:04:39.6258166Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:39.6258742Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T04:04:39.6259162Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:39.6259516Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:39.6260160Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:39.6260517Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T04:04:39.6260813Z ##[endgroup] | |
| 2025-06-24T04:04:39.6377855Z [1;32mINFO[0m: Downloading bootstrap version 'v2.4.1' of cosign to verify version to be installed... | |
| 2025-06-24T04:04:39.6378643Z https://github.com/sigstore/cosign/releases/download/v2.4.1/cosign-linux-amd64 | |
| 2025-06-24T04:04:40.2777526Z [1;32mINFO[0m: bootstrap version successfully verified and matches requested version so nothing else to do | |
| 2025-06-24T04:04:40.2813164Z ##[group]Run echo "$HOME/.cosign" >> $GITHUB_PATH | |
| 2025-06-24T04:04:40.2813485Z [36;1mecho "$HOME/.cosign" >> $GITHUB_PATH[0m | |
| 2025-06-24T04:04:40.2872216Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} | |
| 2025-06-24T04:04:40.2872537Z env: | |
| 2025-06-24T04:04:40.2872782Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:40.2873193Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T04:04:40.2873602Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:40.2873934Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:40.2874278Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:40.2874609Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T04:04:40.2874902Z ##[endgroup] | |
| 2025-06-24T04:04:40.2982838Z ##[group]Run cd $GITHUB_ACTION_PATH \ | |
| 2025-06-24T04:04:40.2983115Z [36;1mcd $GITHUB_ACTION_PATH \[0m | |
| 2025-06-24T04:04:40.2983338Z [36;1m&& ./ct.sh \[0m | |
| 2025-06-24T04:04:40.2983536Z [36;1m --version 3.12.0 \[0m | |
| 2025-06-24T04:04:40.2983770Z [36;1m --yamllint-version 1.33.0 \[0m | |
| 2025-06-24T04:04:40.2984031Z [36;1m --yamale-version 4.0.4[0m | |
| 2025-06-24T04:04:40.3035609Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} | |
| 2025-06-24T04:04:40.3035920Z env: | |
| 2025-06-24T04:04:40.3036153Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:40.3036545Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T04:04:40.3036921Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:40.3037266Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:40.3037604Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:40.3037943Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T04:04:40.3038231Z ##[endgroup] | |
| 2025-06-24T04:04:40.3161896Z Installing chart-testing v3.12.0... | |
| 2025-06-24T04:04:41.5841845Z Verified OK | |
| 2025-06-24T04:04:41.6788339Z Creating virtual Python environment... | |
| 2025-06-24T04:04:44.4634699Z Activating virtual environment... | |
| 2025-06-24T04:04:44.4652731Z Installing yamllint... | |
| 2025-06-24T04:04:44.8976819Z Collecting yamllint==1.33.0 | |
| 2025-06-24T04:04:44.9351539Z Downloading yamllint-1.33.0-py3-none-any.whl.metadata (4.2 kB) | |
| 2025-06-24T04:04:44.9514448Z Collecting pathspec>=0.5.3 (from yamllint==1.33.0) | |
| 2025-06-24T04:04:44.9552354Z Downloading pathspec-0.12.1-py3-none-any.whl.metadata (21 kB) | |
| 2025-06-24T04:04:44.9991132Z Collecting pyyaml (from yamllint==1.33.0) | |
| 2025-06-24T04:04:45.0032662Z Downloading PyYAML-6.0.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (2.1 kB) | |
| 2025-06-24T04:04:45.0110974Z Downloading yamllint-1.33.0-py3-none-any.whl (65 kB) | |
| 2025-06-24T04:04:45.0213418Z Downloading pathspec-0.12.1-py3-none-any.whl (31 kB) | |
| 2025-06-24T04:04:45.0276497Z Downloading PyYAML-6.0.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (759 kB) | |
| 2025-06-24T04:04:45.0496894Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 759.5/759.5 kB 39.0 MB/s eta 0:00:00 | |
| 2025-06-24T04:04:45.0626834Z Installing collected packages: pyyaml, pathspec, yamllint | |
| 2025-06-24T04:04:45.1696661Z | |
| 2025-06-24T04:04:45.1711772Z Successfully installed pathspec-0.12.1 pyyaml-6.0.2 yamllint-1.33.0 | |
| 2025-06-24T04:04:45.2860467Z Installing Yamale... | |
| 2025-06-24T04:04:45.6987655Z Collecting yamale==4.0.4 | |
| 2025-06-24T04:04:45.7337968Z Downloading yamale-4.0.4-py3-none-any.whl.metadata (20 kB) | |
| 2025-06-24T04:04:45.7426506Z Requirement already satisfied: pyyaml in /opt/hostedtoolcache/ct/3.12.0/amd64/venv/lib/python3.13/site-packages (from yamale==4.0.4) (6.0.2) | |
| 2025-06-24T04:04:45.7479575Z Downloading yamale-4.0.4-py3-none-any.whl (55 kB) | |
| 2025-06-24T04:04:45.7678965Z Installing collected packages: yamale | |
| 2025-06-24T04:04:45.8115417Z Successfully installed yamale-4.0.4 | |
| 2025-06-24T04:04:45.8547245Z Adding ct directory to PATH... | |
| 2025-06-24T04:04:45.8548064Z Setting CT_CONFIG_DIR... | |
| 2025-06-24T04:04:45.8548867Z Configuring environment variables for virtual environment for subsequent workflow steps... | |
| 2025-06-24T04:04:45.8572587Z Version: v3.12.0 | |
| 2025-06-24T04:04:45.8573069Z Git commit: d6991035017d7ac0e3dec3d1b5ad2e5f18674b32 | |
| 2025-06-24T04:04:45.8573545Z Date: 2025-01-13T12:22:07Z | |
| 2025-06-24T04:04:45.8573901Z License: Apache 2.0 | |
| 2025-06-24T04:04:45.8618482Z ##[group]Run changed=$(ct list-changed --target-branch "$TARGET_BRANCH") | |
| 2025-06-24T04:04:45.8618969Z [36;1mchanged=$(ct list-changed --target-branch "$TARGET_BRANCH")[0m | |
| 2025-06-24T04:04:45.8619297Z [36;1mif [[ -n "$changed" ]]; then[0m | |
| 2025-06-24T04:04:45.8619579Z [36;1m echo "changed=true" >> "$GITHUB_OUTPUT"[0m | |
| 2025-06-24T04:04:45.8620218Z [36;1mfi[0m | |
| 2025-06-24T04:04:45.8679758Z shell: /usr/bin/bash -e {0} | |
| 2025-06-24T04:04:45.8680230Z env: | |
| 2025-06-24T04:04:45.8680483Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:45.8680883Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T04:04:45.8681273Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:45.8681598Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:45.8681936Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:45.8682301Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T04:04:45.8682620Z CT_CONFIG_DIR: /opt/hostedtoolcache/ct/3.12.0/amd64/etc | |
| 2025-06-24T04:04:45.8682928Z VIRTUAL_ENV: /opt/hostedtoolcache/ct/3.12.0/amd64/venv | |
| 2025-06-24T04:04:45.8683188Z TARGET_BRANCH: main | |
| 2025-06-24T04:04:45.8683366Z ##[endgroup] | |
| 2025-06-24T04:04:45.9392330Z ##[group]Run helm repo add ingress-nginx "https://kubernetes.github.io/ingress-nginx" | |
| 2025-06-24T04:04:45.9392909Z [36;1mhelm repo add ingress-nginx "https://kubernetes.github.io/ingress-nginx"[0m | |
| 2025-06-24T04:04:45.9393373Z [36;1mhelm repo add bitnami "https://charts.bitnami.com/bitnami"[0m | |
| 2025-06-24T04:04:45.9393703Z [36;1mhelm repo update[0m | |
| 2025-06-24T04:04:45.9452119Z shell: /usr/bin/bash -e {0} | |
| 2025-06-24T04:04:45.9452339Z env: | |
| 2025-06-24T04:04:45.9452582Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:45.9452990Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T04:04:45.9453384Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:45.9453718Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:45.9454057Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:45.9454395Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T04:04:45.9454936Z CT_CONFIG_DIR: /opt/hostedtoolcache/ct/3.12.0/amd64/etc | |
| 2025-06-24T04:04:45.9455243Z VIRTUAL_ENV: /opt/hostedtoolcache/ct/3.12.0/amd64/venv | |
| 2025-06-24T04:04:45.9455508Z ##[endgroup] | |
| 2025-06-24T04:04:46.0435696Z "ingress-nginx" has been added to your repositories | |
| 2025-06-24T04:04:48.7729589Z "bitnami" has been added to your repositories | |
| 2025-06-24T04:04:48.8046463Z Hang tight while we grab the latest from your chart repositories... | |
| 2025-06-24T04:04:48.8533042Z ...Successfully got an update from the "ingress-nginx" chart repository | |
| 2025-06-24T04:04:51.3140978Z ...Successfully got an update from the "bitnami" chart repository | |
| 2025-06-24T04:04:51.3142439Z Update Complete. ⎈Happy Helming!⎈ | |
| 2025-06-24T04:04:51.3300850Z ##[group]Run helm/kind-action@a1b0e391336a6ee6713a0583f8c6240d70863de3 | |
| 2025-06-24T04:04:51.3301187Z with: | |
| 2025-06-24T04:04:51.3301394Z config: helpers/kind-testing/kind-config.yaml | |
| 2025-06-24T04:04:51.3301644Z version: v0.26.0 | |
| 2025-06-24T04:04:51.3301831Z cluster_name: chart-testing | |
| 2025-06-24T04:04:51.3302052Z wait: 60s | |
| 2025-06-24T04:04:51.3302205Z verbosity: 0 | |
| 2025-06-24T04:04:51.3302378Z kubectl_version: v1.31.4 | |
| 2025-06-24T04:04:51.3302565Z registry: false | |
| 2025-06-24T04:04:51.3302746Z registry_image: registry:2 | |
| 2025-06-24T04:04:51.3302952Z registry_name: kind-registry | |
| 2025-06-24T04:04:51.3303159Z registry_port: 5000 | |
| 2025-06-24T04:04:51.3303351Z registry_enable_delete: false | |
| 2025-06-24T04:04:51.3303565Z ignore_failed_clean: false | |
| 2025-06-24T04:04:51.3303751Z env: | |
| 2025-06-24T04:04:51.3303972Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:51.3304352Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T04:04:51.3304745Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:51.3305067Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:51.3305387Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:04:51.3305709Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T04:04:51.3306029Z CT_CONFIG_DIR: /opt/hostedtoolcache/ct/3.12.0/amd64/etc | |
| 2025-06-24T04:04:51.3306333Z VIRTUAL_ENV: /opt/hostedtoolcache/ct/3.12.0/amd64/venv | |
| 2025-06-24T04:04:51.3306586Z ##[endgroup] | |
| 2025-06-24T04:04:51.3638586Z Installing kind... | |
| 2025-06-24T04:04:51.3653460Z /opt/hostedtoolcache/kind/v0.26.0/amd64/kind/bin ~/work/llm-d-deployer/llm-d-deployer | |
| 2025-06-24T04:04:51.9232731Z kind-linux-amd64: OK | |
| 2025-06-24T04:04:51.9271993Z ~/work/llm-d-deployer/llm-d-deployer | |
| 2025-06-24T04:04:51.9272687Z Adding kind directory to PATH... | |
| 2025-06-24T04:04:51.9273068Z Installing kubectl... | |
| 2025-06-24T04:04:52.2390513Z Adding kubectl directory to PATH... | |
| 2025-06-24T04:04:52.2411231Z kind v0.26.0 go1.23.4 linux/amd64 | |
| 2025-06-24T04:04:52.2756905Z Client Version: v1.31.4 | |
| 2025-06-24T04:04:52.2757280Z Kustomize Version: v5.4.2 | |
| 2025-06-24T04:04:52.2774762Z Creating kind cluster... | |
| 2025-06-24T04:04:55.3737891Z Creating cluster "chart-testing" ... | |
| 2025-06-24T04:04:55.3738639Z • Ensuring node image (kindest/node:v1.30.0) 🖼 ... | |
| 2025-06-24T04:05:04.8638874Z ✓ Ensuring node image (kindest/node:v1.30.0) 🖼 | |
| 2025-06-24T04:05:04.8639337Z • Preparing nodes 📦 ... | |
| 2025-06-24T04:05:06.7964593Z ✓ Preparing nodes 📦 | |
| 2025-06-24T04:05:06.8231970Z • Writing configuration 📜 ... | |
| 2025-06-24T04:05:06.9909754Z ✓ Writing configuration 📜 | |
| 2025-06-24T04:05:06.9910777Z • Starting control-plane 🕹️ ... | |
| 2025-06-24T04:05:18.7782972Z ✓ Starting control-plane 🕹️ | |
| 2025-06-24T04:05:18.7783481Z • Installing CNI 🔌 ... | |
| 2025-06-24T04:05:19.0661660Z ✓ Installing CNI 🔌 | |
| 2025-06-24T04:05:19.0665826Z • Installing StorageClass 💾 ... | |
| 2025-06-24T04:05:19.3708897Z ✓ Installing StorageClass 💾 | |
| 2025-06-24T04:05:19.3953369Z • Waiting ≤ 1m0s for control-plane = Ready ⏳ ... | |
| 2025-06-24T04:05:35.6044944Z ✓ Waiting ≤ 1m0s for control-plane = Ready ⏳ | |
| 2025-06-24T04:05:35.6045356Z • Ready after 16s 💚 | |
| 2025-06-24T04:05:35.7233218Z Set kubectl context to "kind-chart-testing" | |
| 2025-06-24T04:05:35.7233752Z You can now use your cluster with: | |
| 2025-06-24T04:05:35.7234399Z | |
| 2025-06-24T04:05:35.7234631Z kubectl cluster-info --context kind-chart-testing | |
| 2025-06-24T04:05:35.7234978Z | |
| 2025-06-24T04:05:35.7235362Z Thanks for using kind! 😊 | |
| 2025-06-24T04:05:35.7323756Z ##[group]Run export defaultScProvisioner=$(kubectl get storageclass -o jsonpath='{.items[?(@.metadata.annotations.storageclass\.kubernetes\.io/is-default-class=="true")].provisioner}') | |
| 2025-06-24T04:05:35.7325007Z [36;1mexport defaultScProvisioner=$(kubectl get storageclass -o jsonpath='{.items[?(@.metadata.annotations.storageclass\.kubernetes\.io/is-default-class=="true")].provisioner}')[0m | |
| 2025-06-24T04:05:35.7325745Z [36;1mif [[ -z "$defaultScProvisioner" ]]; then[0m | |
| 2025-06-24T04:05:35.7326454Z [36;1m echo "No default storage class found or it has no provisioner. Exiting early because the test using the custom Storage Class will likely fail. Use a cluster that has a default storage class."[0m | |
| 2025-06-24T04:05:35.7327123Z [36;1m exit 1[0m | |
| 2025-06-24T04:05:35.7327315Z [36;1mfi[0m | |
| 2025-06-24T04:05:35.7327611Z [36;1mecho "[INFO] defaultScProvisioner=$defaultScProvisioner"[0m | |
| 2025-06-24T04:05:35.7327918Z [36;1m[0m | |
| 2025-06-24T04:05:35.7328129Z [36;1mcat <<EOF | kubectl apply -f -[0m | |
| 2025-06-24T04:05:35.7328381Z [36;1mapiVersion: storage.k8s.io/v1[0m | |
| 2025-06-24T04:05:35.7328625Z [36;1mkind: StorageClass[0m | |
| 2025-06-24T04:05:35.7328823Z [36;1mmetadata:[0m | |
| 2025-06-24T04:05:35.7329007Z [36;1m name: custom-sc[0m | |
| 2025-06-24T04:05:35.7329335Z [36;1m# same provisioner as the one used by the default storage class on the cluster[0m | |
| 2025-06-24T04:05:35.7329707Z [36;1mprovisioner: $defaultScProvisioner[0m | |
| 2025-06-24T04:05:35.7330286Z [36;1mreclaimPolicy: Delete[0m | |
| 2025-06-24T04:05:35.7330541Z [36;1mvolumeBindingMode: WaitForFirstConsumer[0m | |
| 2025-06-24T04:05:35.7330792Z [36;1mEOF[0m | |
| 2025-06-24T04:05:35.7330944Z [36;1m[0m | |
| 2025-06-24T04:05:35.7331150Z [36;1mkubectl get storageclass custom-sc -o yaml[0m | |
| 2025-06-24T04:05:35.7391190Z shell: /usr/bin/bash -e {0} | |
| 2025-06-24T04:05:35.7391419Z env: | |
| 2025-06-24T04:05:35.7391661Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:05:35.7392077Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T04:05:35.7392505Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:05:35.7392846Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:05:35.7393177Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:05:35.7393509Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T04:05:35.7393827Z CT_CONFIG_DIR: /opt/hostedtoolcache/ct/3.12.0/amd64/etc | |
| 2025-06-24T04:05:35.7394132Z VIRTUAL_ENV: /opt/hostedtoolcache/ct/3.12.0/amd64/venv | |
| 2025-06-24T04:05:35.7394385Z ##[endgroup] | |
| 2025-06-24T04:05:35.8019542Z [INFO] defaultScProvisioner=rancher.io/local-path | |
| 2025-06-24T04:05:35.8882142Z storageclass.storage.k8s.io/custom-sc created | |
| 2025-06-24T04:05:35.9728903Z apiVersion: storage.k8s.io/v1 | |
| 2025-06-24T04:05:35.9729459Z kind: StorageClass | |
| 2025-06-24T04:05:35.9736778Z metadata: | |
| 2025-06-24T04:05:35.9737519Z annotations: | |
| 2025-06-24T04:05:35.9738725Z kubectl.kubernetes.io/last-applied-configuration: | | |
| 2025-06-24T04:05:35.9749604Z {"apiVersion":"storage.k8s.io/v1","kind":"StorageClass","metadata":{"annotations":{},"name":"custom-sc"},"provisioner":"rancher.io/local-path","reclaimPolicy":"Delete","volumeBindingMode":"WaitForFirstConsumer"} | |
| 2025-06-24T04:05:35.9752101Z creationTimestamp: "2025-06-24T04:05:35Z" | |
| 2025-06-24T04:05:35.9752529Z name: custom-sc | |
| 2025-06-24T04:05:35.9752831Z resourceVersion: "413" | |
| 2025-06-24T04:05:35.9753214Z uid: 654cc4a3-808e-42df-8428-d88ca38fb9ad | |
| 2025-06-24T04:05:35.9753662Z provisioner: rancher.io/local-path | |
| 2025-06-24T04:05:35.9754086Z reclaimPolicy: Delete | |
| 2025-06-24T04:05:35.9754459Z volumeBindingMode: WaitForFirstConsumer | |
| 2025-06-24T04:05:35.9819001Z ##[group]Run helm install ingress-nginx/ingress-nginx --generate-name \ | |
| 2025-06-24T04:05:35.9820053Z [36;1mhelm install ingress-nginx/ingress-nginx --generate-name \[0m | |
| 2025-06-24T04:05:35.9821002Z [36;1m --set controller.service.type='NodePort' \[0m | |
| 2025-06-24T04:05:35.9821612Z [36;1m --set controller.admissionWebhooks.enabled=false[0m | |
| 2025-06-24T04:05:35.9914424Z shell: /usr/bin/bash -e {0} | |
| 2025-06-24T04:05:35.9914737Z env: | |
| 2025-06-24T04:05:35.9915059Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:05:35.9915620Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T04:05:35.9916157Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:05:35.9916654Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:05:35.9917145Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:05:35.9917633Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T04:05:35.9918156Z CT_CONFIG_DIR: /opt/hostedtoolcache/ct/3.12.0/amd64/etc | |
| 2025-06-24T04:05:35.9918614Z VIRTUAL_ENV: /opt/hostedtoolcache/ct/3.12.0/amd64/venv | |
| 2025-06-24T04:05:35.9919006Z ##[endgroup] | |
| 2025-06-24T04:05:37.1988264Z NAME: ingress-nginx-1750737936 | |
| 2025-06-24T04:05:37.1988987Z LAST DEPLOYED: Tue Jun 24 04:05:36 2025 | |
| 2025-06-24T04:05:37.1989968Z NAMESPACE: default | |
| 2025-06-24T04:05:37.1990691Z STATUS: deployed | |
| 2025-06-24T04:05:37.1991277Z REVISION: 1 | |
| 2025-06-24T04:05:37.1991856Z TEST SUITE: None | |
| 2025-06-24T04:05:37.1992350Z NOTES: | |
| 2025-06-24T04:05:37.1992950Z The ingress-nginx controller has been installed. | |
| 2025-06-24T04:05:37.1993896Z Get the application URL by running these commands: | |
| 2025-06-24T04:05:37.1995243Z export HTTP_NODE_PORT=$(kubectl get service --namespace default ingress-nginx-1750737936-controller --output jsonpath="{.spec.ports[0].nodePort}") | |
| 2025-06-24T04:05:37.1997234Z export HTTPS_NODE_PORT=$(kubectl get service --namespace default ingress-nginx-1750737936-controller --output jsonpath="{.spec.ports[1].nodePort}") | |
| 2025-06-24T04:05:37.2000803Z export NODE_IP="$(kubectl get nodes --output jsonpath="{.items[0].status.addresses[1].address}")" | |
| 2025-06-24T04:05:37.2001329Z | |
| 2025-06-24T04:05:37.2001587Z echo "Visit http://${NODE_IP}:${HTTP_NODE_PORT} to access your application via HTTP." | |
| 2025-06-24T04:05:37.2002418Z echo "Visit https://${NODE_IP}:${HTTPS_NODE_PORT} to access your application via HTTPS." | |
| 2025-06-24T04:05:37.2002943Z | |
| 2025-06-24T04:05:37.2003168Z An example Ingress that makes use of the controller: | |
| 2025-06-24T04:05:37.2003684Z apiVersion: networking.k8s.io/v1 | |
| 2025-06-24T04:05:37.2004101Z kind: Ingress | |
| 2025-06-24T04:05:37.2004376Z metadata: | |
| 2025-06-24T04:05:37.2004665Z name: example | |
| 2025-06-24T04:05:37.2004949Z namespace: foo | |
| 2025-06-24T04:05:37.2005234Z spec: | |
| 2025-06-24T04:05:37.2005508Z ingressClassName: nginx | |
| 2025-06-24T04:05:37.2005840Z rules: | |
| 2025-06-24T04:05:37.2006120Z - host: www.example.com | |
| 2025-06-24T04:05:37.2006485Z http: | |
| 2025-06-24T04:05:37.2006746Z paths: | |
| 2025-06-24T04:05:37.2007053Z - pathType: Prefix | |
| 2025-06-24T04:05:37.2007408Z backend: | |
| 2025-06-24T04:05:37.2007710Z service: | |
| 2025-06-24T04:05:37.2008046Z name: exampleService | |
| 2025-06-24T04:05:37.2008420Z port: | |
| 2025-06-24T04:05:37.2008731Z number: 80 | |
| 2025-06-24T04:05:37.2009058Z path: / | |
| 2025-06-24T04:05:37.2009540Z # This section is only required if TLS is to be enabled for the Ingress | |
| 2025-06-24T04:05:37.2028059Z tls: | |
| 2025-06-24T04:05:37.2028343Z - hosts: | |
| 2025-06-24T04:05:37.2028638Z - www.example.com | |
| 2025-06-24T04:05:37.2028994Z secretName: example-tls | |
| 2025-06-24T04:05:37.2029240Z | |
| 2025-06-24T04:05:37.2029679Z If TLS is enabled for the Ingress, a Secret containing the certificate and key must also be provided: | |
| 2025-06-24T04:05:37.2030413Z | |
| 2025-06-24T04:05:37.2030528Z apiVersion: v1 | |
| 2025-06-24T04:05:37.2031190Z kind: Secret | |
| 2025-06-24T04:05:37.2031523Z metadata: | |
| 2025-06-24T04:05:37.2031821Z name: example-tls | |
| 2025-06-24T04:05:37.2032133Z namespace: foo | |
| 2025-06-24T04:05:37.2032728Z data: | |
| 2025-06-24T04:05:37.2033035Z tls.crt: <base64 encoded cert> | |
| 2025-06-24T04:05:37.2033415Z tls.key: <base64 encoded key> | |
| 2025-06-24T04:05:37.2033787Z type: kubernetes.io/tls | |
| 2025-06-24T04:05:37.2115351Z ##[group]Run curl -L "https://github.com/operator-framework/operator-lifecycle-manager/releases/download/${OLM_VERSION}/install.sh" -o install-olm.sh | |
| 2025-06-24T04:05:37.2117160Z [36;1mcurl -L "https://github.com/operator-framework/operator-lifecycle-manager/releases/download/${OLM_VERSION}/install.sh" -o install-olm.sh[0m | |
| 2025-06-24T04:05:37.2118245Z [36;1mchmod +x install-olm.sh[0m | |
| 2025-06-24T04:05:37.2118670Z [36;1m./install-olm.sh "${OLM_VERSION}"[0m | |
| 2025-06-24T04:05:37.2265736Z shell: /usr/bin/bash -e {0} | |
| 2025-06-24T04:05:37.2266105Z env: | |
| 2025-06-24T04:05:37.2266499Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:05:37.2267181Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T04:05:37.2267841Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:05:37.2270046Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:05:37.2270742Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:05:37.2271387Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T04:05:37.2272004Z CT_CONFIG_DIR: /opt/hostedtoolcache/ct/3.12.0/amd64/etc | |
| 2025-06-24T04:05:37.2272568Z VIRTUAL_ENV: /opt/hostedtoolcache/ct/3.12.0/amd64/venv | |
| 2025-06-24T04:05:37.2273061Z OLM_VERSION: v0.31.0 | |
| 2025-06-24T04:05:37.2273383Z ##[endgroup] | |
| 2025-06-24T04:05:37.2534362Z % Total % Received % Xferd Average Speed Time Time Time Current | |
| 2025-06-24T04:05:37.2535295Z Dload Upload Total Spent Left Speed | |
| 2025-06-24T04:05:37.2535648Z | |
| 2025-06-24T04:05:37.4234745Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 | |
| 2025-06-24T04:05:37.4235436Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 | |
| 2025-06-24T04:05:37.5487542Z | |
| 2025-06-24T04:05:37.5488675Z 100 1886 100 1886 0 0 6352 0 --:--:-- --:--:-- --:--:-- 6352 | |
| 2025-06-24T04:05:37.5490488Z 100 1886 100 1886 0 0 6351 0 --:--:-- --:--:-- --:--:-- 0 | |
| 2025-06-24T04:05:38.0002793Z customresourcedefinition.apiextensions.k8s.io/catalogsources.operators.coreos.com created | |
| 2025-06-24T04:05:38.1539074Z customresourcedefinition.apiextensions.k8s.io/clusterserviceversions.operators.coreos.com created | |
| 2025-06-24T04:05:38.1663761Z customresourcedefinition.apiextensions.k8s.io/installplans.operators.coreos.com created | |
| 2025-06-24T04:05:38.1741897Z customresourcedefinition.apiextensions.k8s.io/olmconfigs.operators.coreos.com created | |
| 2025-06-24T04:05:38.1872196Z customresourcedefinition.apiextensions.k8s.io/operatorconditions.operators.coreos.com created | |
| 2025-06-24T04:05:38.2001356Z customresourcedefinition.apiextensions.k8s.io/operatorgroups.operators.coreos.com created | |
| 2025-06-24T04:05:38.2106189Z customresourcedefinition.apiextensions.k8s.io/operators.operators.coreos.com created | |
| 2025-06-24T04:05:38.3034025Z customresourcedefinition.apiextensions.k8s.io/subscriptions.operators.coreos.com created | |
| 2025-06-24T04:05:38.6730990Z customresourcedefinition.apiextensions.k8s.io/catalogsources.operators.coreos.com condition met | |
| 2025-06-24T04:05:38.8416684Z customresourcedefinition.apiextensions.k8s.io/clusterserviceversions.operators.coreos.com condition met | |
| 2025-06-24T04:05:38.9466406Z customresourcedefinition.apiextensions.k8s.io/installplans.operators.coreos.com condition met | |
| 2025-06-24T04:05:39.0514032Z customresourcedefinition.apiextensions.k8s.io/olmconfigs.operators.coreos.com condition met | |
| 2025-06-24T04:05:39.1577174Z customresourcedefinition.apiextensions.k8s.io/operatorconditions.operators.coreos.com condition met | |
| 2025-06-24T04:05:39.2643057Z customresourcedefinition.apiextensions.k8s.io/operatorgroups.operators.coreos.com condition met | |
| 2025-06-24T04:05:39.3721981Z customresourcedefinition.apiextensions.k8s.io/operators.operators.coreos.com condition met | |
| 2025-06-24T04:05:39.5076327Z customresourcedefinition.apiextensions.k8s.io/subscriptions.operators.coreos.com condition met | |
| 2025-06-24T04:05:39.9004798Z namespace/olm created | |
| 2025-06-24T04:05:39.9533380Z namespace/operators created | |
| 2025-06-24T04:05:40.0066582Z serviceaccount/olm-operator-serviceaccount created | |
| 2025-06-24T04:05:40.0230181Z clusterrole.rbac.authorization.k8s.io/system:controller:operator-lifecycle-manager created | |
| 2025-06-24T04:05:40.0342377Z clusterrolebinding.rbac.authorization.k8s.io/olm-operator-binding-olm created | |
| 2025-06-24T04:05:40.0667432Z olmconfig.operators.coreos.com/cluster created | |
| 2025-06-24T04:05:40.0948095Z deployment.apps/olm-operator created | |
| 2025-06-24T04:05:40.1337440Z deployment.apps/catalog-operator created | |
| 2025-06-24T04:05:40.1482629Z clusterrole.rbac.authorization.k8s.io/aggregate-olm-edit created | |
| 2025-06-24T04:05:40.1698715Z clusterrole.rbac.authorization.k8s.io/aggregate-olm-view created | |
| 2025-06-24T04:05:40.2519758Z operatorgroup.operators.coreos.com/global-operators created | |
| 2025-06-24T04:05:40.2620771Z operatorgroup.operators.coreos.com/olm-operators created | |
| 2025-06-24T04:05:40.3275901Z clusterserviceversion.operators.coreos.com/packageserver created | |
| 2025-06-24T04:05:40.3641380Z catalogsource.operators.coreos.com/operatorhubio-catalog created | |
| 2025-06-24T04:05:40.4358504Z Waiting for deployment "olm-operator" rollout to finish: 0 of 1 updated replicas are available... | |
| 2025-06-24T04:05:45.9423132Z deployment "olm-operator" successfully rolled out | |
| 2025-06-24T04:05:45.9973520Z deployment "catalog-operator" successfully rolled out | |
| 2025-06-24T04:05:46.0504088Z Package server phase: Installing | |
| 2025-06-24T04:05:56.1405056Z Package server phase: Succeeded | |
| 2025-06-24T04:05:56.2015603Z deployment "packageserver" successfully rolled out | |
| 2025-06-24T04:05:56.2084233Z ##[group]Run ./chart-dependencies/ci-deps.sh | |
| 2025-06-24T04:05:56.2084862Z [36;1m./chart-dependencies/ci-deps.sh[0m | |
| 2025-06-24T04:05:56.2163134Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} | |
| 2025-06-24T04:05:56.2163639Z env: | |
| 2025-06-24T04:05:56.2164002Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:05:56.2164640Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T04:05:56.2165265Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:05:56.2165833Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:05:56.2166399Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:05:56.2166991Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T04:05:56.2167546Z CT_CONFIG_DIR: /opt/hostedtoolcache/ct/3.12.0/amd64/etc | |
| 2025-06-24T04:05:56.2168068Z VIRTUAL_ENV: /opt/hostedtoolcache/ct/3.12.0/amd64/venv | |
| 2025-06-24T04:05:56.2168512Z ##[endgroup] | |
| 2025-06-24T04:05:56.2711584Z [32m✅ 📜 Base CRDs: Installing...[0m | |
| 2025-06-24T04:05:57.4555994Z customresourcedefinition.apiextensions.k8s.io/gatewayclasses.gateway.networking.k8s.io created | |
| 2025-06-24T04:05:57.5040731Z customresourcedefinition.apiextensions.k8s.io/gateways.gateway.networking.k8s.io created | |
| 2025-06-24T04:05:57.5928950Z customresourcedefinition.apiextensions.k8s.io/grpcroutes.gateway.networking.k8s.io created | |
| 2025-06-24T04:05:57.8111342Z customresourcedefinition.apiextensions.k8s.io/httproutes.gateway.networking.k8s.io created | |
| 2025-06-24T04:05:57.8206947Z customresourcedefinition.apiextensions.k8s.io/referencegrants.gateway.networking.k8s.io created | |
| 2025-06-24T04:05:57.8244822Z [32m✅ 🚪 GAIE CRDs: Installing...[0m | |
| 2025-06-24T04:05:58.9728371Z customresourcedefinition.apiextensions.k8s.io/inferencemodels.inference.networking.x-k8s.io created | |
| 2025-06-24T04:05:58.9871837Z customresourcedefinition.apiextensions.k8s.io/inferencepools.inference.networking.x-k8s.io created | |
| 2025-06-24T04:05:58.9915451Z [32m✅ 🎒 Gateway provider is -> 'istio[0m[32m': Installing...[0m[0m | |
| 2025-06-24T04:05:59.0764095Z Release "istio-base" does not exist. Installing it now. | |
| 2025-06-24T04:06:00.4849502Z Pulled: gcr.io/istio-testing/charts/base:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d | |
| 2025-06-24T04:06:00.4850816Z Digest: sha256:d022e2d190b4acdb5abbf160e34a63b5bbd94d4c76ef8ec46bcb48c1e6e6c9c5 | |
| 2025-06-24T04:06:02.1341772Z NAME: istio-base | |
| 2025-06-24T04:06:02.1343586Z LAST DEPLOYED: Tue Jun 24 04:06:00 2025 | |
| 2025-06-24T04:06:02.1345246Z NAMESPACE: istio-system | |
| 2025-06-24T04:06:02.1346786Z STATUS: deployed | |
| 2025-06-24T04:06:02.1348266Z REVISION: 1 | |
| 2025-06-24T04:06:02.1349743Z TEST SUITE: None | |
| 2025-06-24T04:06:02.1351385Z NOTES: | |
| 2025-06-24T04:06:02.1352305Z Istio base successfully installed! | |
| 2025-06-24T04:06:02.1352929Z | |
| 2025-06-24T04:06:02.1353249Z To learn more about the release, try: | |
| 2025-06-24T04:06:02.1354031Z $ helm status istio-base -n istio-system | |
| 2025-06-24T04:06:02.1354782Z $ helm get all istio-base -n istio-system | |
| 2025-06-24T04:06:02.1789171Z Release "istiod" does not exist. Installing it now. | |
| 2025-06-24T04:06:03.1327072Z Pulled: gcr.io/istio-testing/charts/istiod:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d | |
| 2025-06-24T04:06:03.1327850Z Digest: sha256:b6a16f2823041fe7410e0fc089283902dd4795e9e1eaac2406f985fba111993a | |
| 2025-06-24T04:06:12.6134935Z NAME: istiod | |
| 2025-06-24T04:06:12.6135307Z LAST DEPLOYED: Tue Jun 24 04:06:03 2025 | |
| 2025-06-24T04:06:12.6135580Z NAMESPACE: istio-system | |
| 2025-06-24T04:06:12.6135775Z STATUS: deployed | |
| 2025-06-24T04:06:12.6135952Z REVISION: 1 | |
| 2025-06-24T04:06:12.6136105Z TEST SUITE: None | |
| 2025-06-24T04:06:12.6136270Z NOTES: | |
| 2025-06-24T04:06:12.6136445Z "istiod" successfully installed! | |
| 2025-06-24T04:06:12.6136608Z | |
| 2025-06-24T04:06:12.6136699Z To learn more about the release, try: | |
| 2025-06-24T04:06:12.6136958Z $ helm status istiod -n istio-system | |
| 2025-06-24T04:06:12.6137221Z $ helm get all istiod -n istio-system | |
| 2025-06-24T04:06:12.6137382Z | |
| 2025-06-24T04:06:12.6137826Z Next steps: | |
| 2025-06-24T04:06:12.6138170Z * Deploy a Gateway: https://istio.io/latest/docs/setup/additional-setup/gateway/ | |
| 2025-06-24T04:06:12.6138888Z * Try out our tasks to get started on common configurations: | |
| 2025-06-24T04:06:12.6139255Z * https://istio.io/latest/docs/tasks/traffic-management | |
| 2025-06-24T04:06:12.6139580Z * https://istio.io/latest/docs/tasks/security/ | |
| 2025-06-24T04:06:12.6140155Z * https://istio.io/latest/docs/tasks/policy-enforcement/ | |
| 2025-06-24T04:06:12.6140605Z * Review the list of actively supported releases, CVE publications and our hardening guide: | |
| 2025-06-24T04:06:12.6141058Z * https://istio.io/latest/docs/releases/supported-releases/ | |
| 2025-06-24T04:06:12.6141369Z * https://istio.io/latest/news/security/ | |
| 2025-06-24T04:06:12.6141672Z * https://istio.io/latest/docs/ops/best-practices/security/ | |
| 2025-06-24T04:06:12.6141892Z | |
| 2025-06-24T04:06:12.6142029Z For further documentation see https://istio.io website | |
| 2025-06-24T04:06:12.6214364Z ##[group]Run ct install \ | |
| 2025-06-24T04:06:12.6214812Z [36;1mct install \[0m | |
| 2025-06-24T04:06:12.6215149Z [36;1m --debug \[0m | |
| 2025-06-24T04:06:12.6215499Z [36;1m --config ct-install.yaml \[0m | |
| 2025-06-24T04:06:12.6215945Z [36;1m --upgrade \[0m | |
| 2025-06-24T04:06:12.6216326Z [36;1m --target-branch "$TARGET_BRANCH"[0m | |
| 2025-06-24T04:06:12.6293752Z shell: /usr/bin/bash -e {0} | |
| 2025-06-24T04:06:12.6293987Z env: | |
| 2025-06-24T04:06:12.6294226Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:06:12.6294634Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T04:06:12.6295020Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:06:12.6295360Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:06:12.6295701Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T04:06:12.6296028Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T04:06:12.6296394Z CT_CONFIG_DIR: /opt/hostedtoolcache/ct/3.12.0/amd64/etc | |
| 2025-06-24T04:06:12.6296707Z VIRTUAL_ENV: /opt/hostedtoolcache/ct/3.12.0/amd64/venv | |
| 2025-06-24T04:06:12.6296975Z TARGET_BRANCH: main | |
| 2025-06-24T04:06:12.6297154Z ##[endgroup] | |
| 2025-06-24T04:06:12.6404542Z Installing charts... | |
| 2025-06-24T04:06:12.6407668Z >>> helm version --template {{ .Version }} | |
| 2025-06-24T04:06:12.6650614Z >>> git rev-parse --is-inside-work-tree | |
| 2025-06-24T04:06:12.6666691Z >>> git rev-parse --verify origin/main | |
| 2025-06-24T04:06:12.6682750Z >>> git merge-base origin/main HEAD | |
| 2025-06-24T04:06:12.6700494Z >>> git diff --find-renames --name-only 4ef77d318945c21b40f75c3c1cd9453934981cc3 -- charts | |
| 2025-06-24T04:06:12.6759192Z | |
| 2025-06-24T04:06:12.6759560Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:06:12.6760386Z Charts to be processed: | |
| 2025-06-24T04:06:12.6760893Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:06:12.6761327Z llm-d => (version: "1.0.21", path: "charts/llm-d") | |
| 2025-06-24T04:06:12.6761731Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:06:12.6762025Z | |
| 2025-06-24T04:06:12.6762138Z >>> git rev-parse --is-inside-work-tree | |
| 2025-06-24T04:06:12.6773441Z >>> git rev-parse --verify origin/main | |
| 2025-06-24T04:06:12.6786987Z >>> git merge-base origin/main HEAD | |
| 2025-06-24T04:06:12.6804636Z >>> git worktree add ./ct-previous-revision790133394 4ef77d318945c21b40f75c3c1cd9453934981cc3 | |
| 2025-06-24T04:06:12.6993064Z HEAD is now at 4ef77d3 Add the ability to define envs to the vLLM containers in sample app (#301) | |
| 2025-06-24T04:06:12.7000333Z Preparing worktree (detached HEAD 4ef77d3) | |
| 2025-06-24T04:06:12.7000977Z >>> helm dependency build ct-previous-revision790133394/charts/llm-d | |
| 2025-06-24T04:06:12.7280668Z Hang tight while we grab the latest from your chart repositories... | |
| 2025-06-24T04:06:12.7701165Z ...Successfully got an update from the "ingress-nginx" chart repository | |
| 2025-06-24T04:06:15.4030905Z ...Successfully got an update from the "bitnami" chart repository | |
| 2025-06-24T04:06:15.4031721Z Update Complete. ⎈Happy Helming!⎈ | |
| 2025-06-24T04:06:17.8229650Z Saving 2 charts | |
| 2025-06-24T04:06:17.8236317Z Downloading common from repo https://charts.bitnami.com/bitnami | |
| 2025-06-24T04:06:20.3526111Z Downloading redis from repo https://charts.bitnami.com/bitnami | |
| 2025-06-24T04:06:20.8066396Z Pulled: registry-1.docker.io/bitnamicharts/redis:20.13.4 | |
| 2025-06-24T04:06:20.8066973Z Digest: sha256:6a389e13237e8e639ec0d445e785aa246b57bfce711b087033a196a291d5c8d7 | |
| 2025-06-24T04:06:20.8131933Z Deleting outdated charts | |
| 2025-06-24T04:06:20.8327304Z >>> helm dependency build charts/llm-d | |
| 2025-06-24T04:06:20.8586978Z Hang tight while we grab the latest from your chart repositories... | |
| 2025-06-24T04:06:20.9044096Z ...Successfully got an update from the "ingress-nginx" chart repository | |
| 2025-06-24T04:06:23.4643381Z ...Successfully got an update from the "bitnami" chart repository | |
| 2025-06-24T04:06:23.4644309Z Update Complete. ⎈Happy Helming!⎈ | |
| 2025-06-24T04:06:25.9220030Z Saving 2 charts | |
| 2025-06-24T04:06:25.9220629Z Downloading common from repo https://charts.bitnami.com/bitnami | |
| 2025-06-24T04:06:28.4089261Z Downloading redis from repo https://charts.bitnami.com/bitnami | |
| 2025-06-24T04:06:28.7704850Z Pulled: registry-1.docker.io/bitnamicharts/redis:20.13.4 | |
| 2025-06-24T04:06:28.7705671Z Digest: sha256:6a389e13237e8e639ec0d445e785aa246b57bfce711b087033a196a291d5c8d7 | |
| 2025-06-24T04:06:28.7771418Z Deleting outdated charts | |
| 2025-06-24T04:06:28.7925892Z >>> git cat-file -e origin/main:charts/llm-d/Chart.yaml | |
| 2025-06-24T04:06:28.7945871Z >>> git show origin/main:charts/llm-d/Chart.yaml | |
| 2025-06-24T04:06:28.7972648Z Testing upgrades of chart "llm-d => (version: \"1.0.21\", path: \"charts/llm-d\")" relative to previous revision "llm-d => (version: \"1.0.20\", path: \"ct-previous-revision790133394/charts/llm-d\")"... | |
| 2025-06-24T04:06:28.7973807Z | |
| 2025-06-24T04:06:28.7974783Z Installing chart "llm-d => (version: \"1.0.20\", path: \"ct-previous-revision790133394/charts/llm-d\")" with values file "ct-previous-revision790133394/charts/llm-d/ci/default-values.yaml"... | |
| 2025-06-24T04:06:28.7976330Z | |
| 2025-06-24T04:06:28.7976549Z Creating namespace "llm-d-x3wixbo1ie"... | |
| 2025-06-24T04:06:28.7977327Z >>> kubectl --request-timeout=30s create namespace llm-d-x3wixbo1ie | |
| 2025-06-24T04:06:28.8452953Z namespace/llm-d-x3wixbo1ie created | |
| 2025-06-24T04:06:28.8486306Z >>> helm install llm-d-x3wixbo1ie ct-previous-revision790133394/charts/llm-d --namespace llm-d-x3wixbo1ie --wait --values ct-previous-revision790133394/charts/llm-d/ci/default-values.yaml --timeout 500s | |
| 2025-06-24T04:06:58.8847927Z NAME: llm-d-x3wixbo1ie | |
| 2025-06-24T04:06:58.8848338Z LAST DEPLOYED: Tue Jun 24 04:06:31 2025 | |
| 2025-06-24T04:06:58.8848610Z NAMESPACE: llm-d-x3wixbo1ie | |
| 2025-06-24T04:06:58.8848825Z STATUS: deployed | |
| 2025-06-24T04:06:58.8848997Z REVISION: 1 | |
| 2025-06-24T04:06:58.8849213Z NOTES: | |
| 2025-06-24T04:06:58.8849505Z Thank you for installing llm-d. | |
| 2025-06-24T04:06:58.8849767Z | |
| 2025-06-24T04:06:58.8850157Z Your release is named `llm-d-x3wixbo1ie`. | |
| 2025-06-24T04:06:58.8850457Z | |
| 2025-06-24T04:06:58.8850605Z To learn more about the release, try: | |
| 2025-06-24T04:06:58.8850899Z | |
| 2025-06-24T04:06:58.8851000Z ```bash | |
| 2025-06-24T04:06:58.8851280Z $ helm status llm-d-x3wixbo1ie | |
| 2025-06-24T04:06:58.8851553Z $ helm get all llm-d-x3wixbo1ie | |
| 2025-06-24T04:06:58.8851780Z ``` | |
| 2025-06-24T04:06:58.8851860Z | |
| 2025-06-24T04:06:58.8851864Z | |
| 2025-06-24T04:06:58.8851982Z Following presets are available to your users: | |
| 2025-06-24T04:06:58.8852170Z | |
| 2025-06-24T04:06:58.8852174Z | |
| 2025-06-24T04:06:58.8852178Z | |
| 2025-06-24T04:06:58.8852354Z | Name | Description | | |
| 2025-06-24T04:06:58.8852852Z | ----------------------------------------------------------------- | ----------------------------------------------------------------------------------------------- | | |
| 2025-06-24T04:06:58.8853389Z | basic-gpu-preset | Basic gpu inference | | |
| 2025-06-24T04:06:58.8854026Z | basic-gpu-with-nixl-preset | GPU inference with NIXL P/D KV transfer and cache offloading | | |
| 2025-06-24T04:06:58.8855088Z | basic-gpu-with-nixl-and-redis-lookup-preset | GPU inference with NIXL P/D KV transfer, cache offloading and Redis lookup server | | |
| 2025-06-24T04:06:58.8855781Z | basic-sim-preset | Basic simulation | | |
| 2025-06-24T04:06:58.8856075Z | |
| 2025-06-24T04:06:58.8856182Z To provision a `ModelService`, create a new CR: | |
| 2025-06-24T04:06:58.8856367Z | |
| 2025-06-24T04:06:58.8858289Z ```yaml | |
| 2025-06-24T04:06:58.8858811Z apiVersion: llm-d.ai/v1alpha1 | |
| 2025-06-24T04:06:58.8859457Z kind: ModelService | |
| 2025-06-24T04:06:58.8872000Z metadata: | |
| 2025-06-24T04:06:58.8872303Z name: <name> | |
| 2025-06-24T04:06:58.8872484Z spec: | |
| 2025-06-24T04:06:58.8872688Z decoupleScaling: false | |
| 2025-06-24T04:06:58.8872982Z baseConfigMapRef: | |
| 2025-06-24T04:06:58.8873344Z name: basic-gpu-with-nixl-and-redis-lookup-preset | |
| 2025-06-24T04:06:58.8873658Z routing: | |
| 2025-06-24T04:06:58.8873834Z modelName: <model_name> | |
| 2025-06-24T04:06:58.8874035Z modelArtifacts: | |
| 2025-06-24T04:06:58.8874243Z uri: pvc://<pvc_name>/<path_to_model> | |
| 2025-06-24T04:06:58.8874477Z decode: | |
| 2025-06-24T04:06:58.8874624Z replicas: 1 | |
| 2025-06-24T04:06:58.8874794Z containers: | |
| 2025-06-24T04:06:58.8874960Z - name: "vllm" | |
| 2025-06-24T04:06:58.8875123Z args: | |
| 2025-06-24T04:06:58.8875275Z - "--model" | |
| 2025-06-24T04:06:58.8875447Z - <model_name> | |
| 2025-06-24T04:06:58.8875618Z prefill: | |
| 2025-06-24T04:06:58.8875772Z replicas: 1 | |
| 2025-06-24T04:06:58.8875933Z containers: | |
| 2025-06-24T04:06:58.8876087Z - name: "vllm" | |
| 2025-06-24T04:06:58.8876246Z args: | |
| 2025-06-24T04:06:58.8876389Z - "--model" | |
| 2025-06-24T04:06:58.8876555Z - <model_name> | |
| 2025-06-24T04:06:58.8876968Z ``` | |
| 2025-06-24T04:06:58.8896470Z >>> kubectl --request-timeout=30s get deployments --namespace llm-d-x3wixbo1ie --selector --output jsonpath={.items[*].metadata.name} | |
| 2025-06-24T04:06:58.9450797Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-x3wixbo1ie-inference-gateway-istio --namespace llm-d-x3wixbo1ie | |
| 2025-06-24T04:06:59.0068865Z deployment "llm-d-x3wixbo1ie-inference-gateway-istio" successfully rolled out | |
| 2025-06-24T04:06:59.0094156Z >>> kubectl --request-timeout=30s get deployment llm-d-x3wixbo1ie-inference-gateway-istio --namespace llm-d-x3wixbo1ie --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T04:06:59.0597316Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-x3wixbo1ie-modelservice --namespace llm-d-x3wixbo1ie | |
| 2025-06-24T04:06:59.1160471Z deployment "llm-d-x3wixbo1ie-modelservice" successfully rolled out | |
| 2025-06-24T04:06:59.1183505Z >>> kubectl --request-timeout=30s get deployment llm-d-x3wixbo1ie-modelservice --namespace llm-d-x3wixbo1ie --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T04:06:59.1695535Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-x3wixbo1ie-redis-master --namespace llm-d-x3wixbo1ie | |
| 2025-06-24T04:06:59.2284575Z deployment "llm-d-x3wixbo1ie-redis-master" successfully rolled out | |
| 2025-06-24T04:06:59.2307114Z >>> kubectl --request-timeout=30s get deployment llm-d-x3wixbo1ie-redis-master --namespace llm-d-x3wixbo1ie --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T04:06:59.2807486Z >>> helm test llm-d-x3wixbo1ie --namespace llm-d-x3wixbo1ie --timeout 500s | |
| 2025-06-24T04:07:23.3450375Z NAME: llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:23.3450707Z LAST DEPLOYED: Tue Jun 24 04:06:31 2025 | |
| 2025-06-24T04:07:23.3451189Z NAMESPACE: llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:23.3451439Z STATUS: deployed | |
| 2025-06-24T04:07:23.3451631Z REVISION: 1 | |
| 2025-06-24T04:07:23.3451839Z TEST SUITE: llm-d-x3wixbo1ie-test-connection | |
| 2025-06-24T04:07:23.3452126Z Last Started: Tue Jun 24 04:06:59 2025 | |
| 2025-06-24T04:07:23.3452381Z Last Completed: Tue Jun 24 04:07:23 2025 | |
| 2025-06-24T04:07:23.3452616Z Phase: Succeeded | |
| 2025-06-24T04:07:23.3452837Z TEST SUITE: llm-d-x3wixbo1ie-vllm-sim | |
| 2025-06-24T04:07:23.3453084Z Last Started: Tue Jun 24 04:06:59 2025 | |
| 2025-06-24T04:07:23.3453311Z Last Completed: Tue Jun 24 04:06:59 2025 | |
| 2025-06-24T04:07:23.3453537Z Phase: Succeeded | |
| 2025-06-24T04:07:23.3453747Z TEST SUITE: llm-d-x3wixbo1ie-vllm-sim | |
| 2025-06-24T04:07:23.3453981Z Last Started: Tue Jun 24 04:06:59 2025 | |
| 2025-06-24T04:07:23.3454212Z Last Completed: Tue Jun 24 04:06:59 2025 | |
| 2025-06-24T04:07:23.3454428Z Phase: Succeeded | |
| 2025-06-24T04:07:23.3454604Z NOTES: | |
| 2025-06-24T04:07:23.3454775Z Thank you for installing llm-d. | |
| 2025-06-24T04:07:23.3454924Z | |
| 2025-06-24T04:07:23.3455279Z Your release is named `llm-d-x3wixbo1ie`. | |
| 2025-06-24T04:07:23.3455472Z | |
| 2025-06-24T04:07:23.3455566Z To learn more about the release, try: | |
| 2025-06-24T04:07:23.3455723Z | |
| 2025-06-24T04:07:23.3455786Z ```bash | |
| 2025-06-24T04:07:23.3455966Z $ helm status llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:23.3456183Z $ helm get all llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:23.3456380Z ``` | |
| 2025-06-24T04:07:23.3456459Z | |
| 2025-06-24T04:07:23.3456463Z | |
| 2025-06-24T04:07:23.3456571Z Following presets are available to your users: | |
| 2025-06-24T04:07:23.3456792Z | |
| 2025-06-24T04:07:23.3456796Z | |
| 2025-06-24T04:07:23.3456799Z | |
| 2025-06-24T04:07:23.3456972Z | Name | Description | | |
| 2025-06-24T04:07:23.3457462Z | ----------------------------------------------------------------- | ----------------------------------------------------------------------------------------------- | | |
| 2025-06-24T04:07:23.3458002Z | basic-gpu-preset | Basic gpu inference | | |
| 2025-06-24T04:07:23.3458630Z | basic-gpu-with-nixl-preset | GPU inference with NIXL P/D KV transfer and cache offloading | | |
| 2025-06-24T04:07:23.3459645Z | basic-gpu-with-nixl-and-redis-lookup-preset | GPU inference with NIXL P/D KV transfer, cache offloading and Redis lookup server | | |
| 2025-06-24T04:07:23.3460589Z | basic-sim-preset | Basic simulation | | |
| 2025-06-24T04:07:23.3460889Z | |
| 2025-06-24T04:07:23.3460996Z To provision a `ModelService`, create a new CR: | |
| 2025-06-24T04:07:23.3461179Z | |
| 2025-06-24T04:07:23.3461247Z ```yaml | |
| 2025-06-24T04:07:23.3461412Z apiVersion: llm-d.ai/v1alpha1 | |
| 2025-06-24T04:07:23.3461770Z kind: ModelService | |
| 2025-06-24T04:07:23.3461945Z metadata: | |
| 2025-06-24T04:07:23.3462104Z name: <name> | |
| 2025-06-24T04:07:23.3462256Z spec: | |
| 2025-06-24T04:07:23.3462419Z decoupleScaling: false | |
| 2025-06-24T04:07:23.3462622Z baseConfigMapRef: | |
| 2025-06-24T04:07:23.3462864Z name: basic-gpu-with-nixl-and-redis-lookup-preset | |
| 2025-06-24T04:07:23.3463137Z routing: | |
| 2025-06-24T04:07:23.3463298Z modelName: <model_name> | |
| 2025-06-24T04:07:23.3463495Z modelArtifacts: | |
| 2025-06-24T04:07:23.3463685Z uri: pvc://<pvc_name>/<path_to_model> | |
| 2025-06-24T04:07:23.3463915Z decode: | |
| 2025-06-24T04:07:23.3464069Z replicas: 1 | |
| 2025-06-24T04:07:23.3464235Z containers: | |
| 2025-06-24T04:07:23.3464397Z - name: "vllm" | |
| 2025-06-24T04:07:23.3464569Z args: | |
| 2025-06-24T04:07:23.3464723Z - "--model" | |
| 2025-06-24T04:07:23.3464906Z - <model_name> | |
| 2025-06-24T04:07:23.3465081Z prefill: | |
| 2025-06-24T04:07:23.3465236Z replicas: 1 | |
| 2025-06-24T04:07:23.3465406Z containers: | |
| 2025-06-24T04:07:23.3465574Z - name: "vllm" | |
| 2025-06-24T04:07:23.3465741Z args: | |
| 2025-06-24T04:07:23.3465888Z - "--model" | |
| 2025-06-24T04:07:23.3466054Z - <model_name> | |
| 2025-06-24T04:07:23.3466219Z ``` | |
| 2025-06-24T04:07:23.3476653Z >>> helm upgrade llm-d-x3wixbo1ie charts/llm-d --namespace llm-d-x3wixbo1ie --reuse-values --wait --timeout 500s | |
| 2025-06-24T04:07:36.8740865Z Release "llm-d-x3wixbo1ie" has been upgraded. Happy Helming! | |
| 2025-06-24T04:07:36.8741251Z NAME: llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:36.8741485Z LAST DEPLOYED: Tue Jun 24 04:07:23 2025 | |
| 2025-06-24T04:07:36.8741748Z NAMESPACE: llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:36.8741957Z STATUS: deployed | |
| 2025-06-24T04:07:36.8742131Z REVISION: 2 | |
| 2025-06-24T04:07:36.8742277Z NOTES: | |
| 2025-06-24T04:07:36.8742447Z Thank you for installing llm-d. | |
| 2025-06-24T04:07:36.8742591Z | |
| 2025-06-24T04:07:36.8742689Z Your release is named `llm-d-x3wixbo1ie`. | |
| 2025-06-24T04:07:36.8742869Z | |
| 2025-06-24T04:07:36.8742956Z To learn more about the release, try: | |
| 2025-06-24T04:07:36.8743118Z | |
| 2025-06-24T04:07:36.8743579Z ```bash | |
| 2025-06-24T04:07:36.8743753Z $ helm status llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:36.8744227Z $ helm get all llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:36.8744424Z ``` | |
| 2025-06-24T04:07:36.8744505Z | |
| 2025-06-24T04:07:36.8744511Z | |
| 2025-06-24T04:07:36.8744645Z Following presets are available to your users: | |
| 2025-06-24T04:07:36.8744939Z | |
| 2025-06-24T04:07:36.8744945Z | |
| 2025-06-24T04:07:36.8744952Z | |
| 2025-06-24T04:07:36.8745154Z | Name | Description | | |
| 2025-06-24T04:07:36.8745695Z | ----------------------------------------------------------------- | ----------------------------------------------------------------------------------------------- | | |
| 2025-06-24T04:07:36.8746336Z | basic-gpu-preset | Basic gpu inference | | |
| 2025-06-24T04:07:36.8747092Z | basic-gpu-with-nixl-preset | GPU inference with NIXL P/D KV transfer and cache offloading | | |
| 2025-06-24T04:07:36.8748018Z | basic-gpu-with-nixl-and-redis-lookup-preset | GPU inference with NIXL P/D KV transfer, cache offloading and Redis lookup server | | |
| 2025-06-24T04:07:36.8749197Z | basic-sim-preset | Basic simulation | | |
| 2025-06-24T04:07:36.8749501Z | |
| 2025-06-24T04:07:36.8749612Z To provision a `ModelService`, create a new CR: | |
| 2025-06-24T04:07:36.8749988Z | |
| 2025-06-24T04:07:36.8750100Z ```yaml | |
| 2025-06-24T04:07:36.8750325Z apiVersion: llm-d.ai/v1alpha1 | |
| 2025-06-24T04:07:36.8750535Z kind: ModelService | |
| 2025-06-24T04:07:36.8750706Z metadata: | |
| 2025-06-24T04:07:36.8750911Z name: <name> | |
| 2025-06-24T04:07:36.8751126Z spec: | |
| 2025-06-24T04:07:36.8751287Z decoupleScaling: false | |
| 2025-06-24T04:07:36.8751501Z baseConfigMapRef: | |
| 2025-06-24T04:07:36.8751742Z name: basic-gpu-with-nixl-and-redis-lookup-preset | |
| 2025-06-24T04:07:36.8752030Z routing: | |
| 2025-06-24T04:07:36.8752201Z modelName: <model_name> | |
| 2025-06-24T04:07:36.8752411Z modelArtifacts: | |
| 2025-06-24T04:07:36.8752841Z uri: pvc://<pvc_name>/<path_to_model> | |
| 2025-06-24T04:07:36.8753158Z decode: | |
| 2025-06-24T04:07:36.8753310Z replicas: 1 | |
| 2025-06-24T04:07:36.8753472Z containers: | |
| 2025-06-24T04:07:36.8753655Z - name: "vllm" | |
| 2025-06-24T04:07:36.8753917Z args: | |
| 2025-06-24T04:07:36.8754073Z - "--model" | |
| 2025-06-24T04:07:36.8754235Z - <model_name> | |
| 2025-06-24T04:07:36.8754409Z prefill: | |
| 2025-06-24T04:07:36.8754634Z replicas: 1 | |
| 2025-06-24T04:07:36.8754833Z containers: | |
| 2025-06-24T04:07:36.8754989Z - name: "vllm" | |
| 2025-06-24T04:07:36.8755154Z args: | |
| 2025-06-24T04:07:36.8755304Z - "--model" | |
| 2025-06-24T04:07:36.8755604Z - <model_name> | |
| 2025-06-24T04:07:36.8755899Z ``` | |
| 2025-06-24T04:07:36.8782892Z >>> kubectl --request-timeout=30s get deployments --namespace llm-d-x3wixbo1ie --selector --output jsonpath={.items[*].metadata.name} | |
| 2025-06-24T04:07:36.9453524Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-x3wixbo1ie-inference-gateway-istio --namespace llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:37.0097841Z deployment "llm-d-x3wixbo1ie-inference-gateway-istio" successfully rolled out | |
| 2025-06-24T04:07:37.0123962Z >>> kubectl --request-timeout=30s get deployment llm-d-x3wixbo1ie-inference-gateway-istio --namespace llm-d-x3wixbo1ie --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T04:07:37.0660314Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-x3wixbo1ie-modelservice --namespace llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:37.1270409Z deployment "llm-d-x3wixbo1ie-modelservice" successfully rolled out | |
| 2025-06-24T04:07:37.1302861Z >>> kubectl --request-timeout=30s get deployment llm-d-x3wixbo1ie-modelservice --namespace llm-d-x3wixbo1ie --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T04:07:37.1826838Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-x3wixbo1ie-redis-master --namespace llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:37.2484149Z deployment "llm-d-x3wixbo1ie-redis-master" successfully rolled out | |
| 2025-06-24T04:07:37.2511619Z >>> kubectl --request-timeout=30s get deployment llm-d-x3wixbo1ie-redis-master --namespace llm-d-x3wixbo1ie --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T04:07:37.3048276Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-x3wixbo1ie-vllm-sim-decode --namespace llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:37.3636705Z deployment "llm-d-x3wixbo1ie-vllm-sim-decode" successfully rolled out | |
| 2025-06-24T04:07:37.3665150Z >>> kubectl --request-timeout=30s get deployment llm-d-x3wixbo1ie-vllm-sim-decode --namespace llm-d-x3wixbo1ie --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T04:07:37.4209190Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-x3wixbo1ie-vllm-sim-epp --namespace llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:37.4796507Z deployment "llm-d-x3wixbo1ie-vllm-sim-epp" successfully rolled out | |
| 2025-06-24T04:07:37.4826592Z >>> kubectl --request-timeout=30s get deployment llm-d-x3wixbo1ie-vllm-sim-epp --namespace llm-d-x3wixbo1ie --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T04:07:37.5371726Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-x3wixbo1ie-vllm-sim-prefill --namespace llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:37.5966446Z deployment "llm-d-x3wixbo1ie-vllm-sim-prefill" successfully rolled out | |
| 2025-06-24T04:07:37.5992224Z >>> kubectl --request-timeout=30s get deployment llm-d-x3wixbo1ie-vllm-sim-prefill --namespace llm-d-x3wixbo1ie --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T04:07:37.6524158Z >>> helm test llm-d-x3wixbo1ie --namespace llm-d-x3wixbo1ie --timeout 500s | |
| 2025-06-24T04:07:52.4540972Z NAME: llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:52.4541420Z LAST DEPLOYED: Tue Jun 24 04:07:23 2025 | |
| 2025-06-24T04:07:52.4541848Z NAMESPACE: llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:52.4542225Z STATUS: deployed | |
| 2025-06-24T04:07:52.4542516Z REVISION: 2 | |
| 2025-06-24T04:07:52.4542851Z TEST SUITE: llm-d-x3wixbo1ie-test-connection | |
| 2025-06-24T04:07:52.4543322Z Last Started: Tue Jun 24 04:07:38 2025 | |
| 2025-06-24T04:07:52.4543731Z Last Completed: Tue Jun 24 04:07:52 2025 | |
| 2025-06-24T04:07:52.4544145Z Phase: Succeeded | |
| 2025-06-24T04:07:52.4544513Z TEST SUITE: llm-d-x3wixbo1ie-vllm-sim | |
| 2025-06-24T04:07:52.4544940Z Last Started: Tue Jun 24 04:07:37 2025 | |
| 2025-06-24T04:07:52.4545341Z Last Completed: Tue Jun 24 04:07:38 2025 | |
| 2025-06-24T04:07:52.4545725Z Phase: Succeeded | |
| 2025-06-24T04:07:52.4546083Z TEST SUITE: llm-d-x3wixbo1ie-vllm-sim | |
| 2025-06-24T04:07:52.4546496Z Last Started: Tue Jun 24 04:07:38 2025 | |
| 2025-06-24T04:07:52.4546897Z Last Completed: Tue Jun 24 04:07:38 2025 | |
| 2025-06-24T04:07:52.4547277Z Phase: Succeeded | |
| 2025-06-24T04:07:52.4547580Z NOTES: | |
| 2025-06-24T04:07:52.4547854Z Thank you for installing llm-d. | |
| 2025-06-24T04:07:52.4548103Z | |
| 2025-06-24T04:07:52.4548267Z Your release is named `llm-d-x3wixbo1ie`. | |
| 2025-06-24T04:07:52.4548558Z | |
| 2025-06-24T04:07:52.4548838Z To learn more about the release, try: | |
| 2025-06-24T04:07:52.4549110Z | |
| 2025-06-24T04:07:52.4549214Z ```bash | |
| 2025-06-24T04:07:52.4549589Z $ helm status llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:52.4550175Z $ helm get all llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:52.4550508Z ``` | |
| 2025-06-24T04:07:52.4550646Z | |
| 2025-06-24T04:07:52.4550652Z | |
| 2025-06-24T04:07:52.4550830Z Following presets are available to your users: | |
| 2025-06-24T04:07:52.4551157Z | |
| 2025-06-24T04:07:52.4551163Z | |
| 2025-06-24T04:07:52.4551169Z | |
| 2025-06-24T04:07:52.4551463Z | Name | Description | | |
| 2025-06-24T04:07:52.4552327Z | ----------------------------------------------------------------- | ----------------------------------------------------------------------------------------------- | | |
| 2025-06-24T04:07:52.4553488Z | basic-gpu-preset | Basic gpu inference | | |
| 2025-06-24T04:07:52.4554511Z | basic-gpu-with-nixl-preset | GPU inference with NIXL P/D KV transfer and cache offloading | | |
| 2025-06-24T04:07:52.4555846Z | basic-gpu-with-nixl-and-redis-lookup-preset | GPU inference with NIXL P/D KV transfer, cache offloading and Redis lookup server | | |
| 2025-06-24T04:07:52.4556974Z | basic-sim-preset | Basic simulation | | |
| 2025-06-24T04:07:52.4557496Z | |
| 2025-06-24T04:07:52.4557674Z To provision a `ModelService`, create a new CR: | |
| 2025-06-24T04:07:52.4557996Z | |
| 2025-06-24T04:07:52.4558138Z ```yaml | |
| 2025-06-24T04:07:52.4558407Z apiVersion: llm-d.ai/v1alpha1 | |
| 2025-06-24T04:07:52.4558756Z kind: ModelService | |
| 2025-06-24T04:07:52.4559036Z metadata: | |
| 2025-06-24T04:07:52.4559291Z name: <name> | |
| 2025-06-24T04:07:52.4559544Z spec: | |
| 2025-06-24T04:07:52.4559992Z decoupleScaling: false | |
| 2025-06-24T04:07:52.4560332Z baseConfigMapRef: | |
| 2025-06-24T04:07:52.4560962Z name: basic-gpu-with-nixl-and-redis-lookup-preset | |
| 2025-06-24T04:07:52.4561425Z routing: | |
| 2025-06-24T04:07:52.4561692Z modelName: <model_name> | |
| 2025-06-24T04:07:52.4562025Z modelArtifacts: | |
| 2025-06-24T04:07:52.4562341Z uri: pvc://<pvc_name>/<path_to_model> | |
| 2025-06-24T04:07:52.4562713Z decode: | |
| 2025-06-24T04:07:52.4562933Z replicas: 1 | |
| 2025-06-24T04:07:52.4563178Z containers: | |
| 2025-06-24T04:07:52.4563424Z - name: "vllm" | |
| 2025-06-24T04:07:52.4563674Z args: | |
| 2025-06-24T04:07:52.4563902Z - "--model" | |
| 2025-06-24T04:07:52.4564153Z - <model_name> | |
| 2025-06-24T04:07:52.4564413Z prefill: | |
| 2025-06-24T04:07:52.4564642Z replicas: 1 | |
| 2025-06-24T04:07:52.4564884Z containers: | |
| 2025-06-24T04:07:52.4565125Z - name: "vllm" | |
| 2025-06-24T04:07:52.4565380Z args: | |
| 2025-06-24T04:07:52.4565616Z - "--model" | |
| 2025-06-24T04:07:52.4565876Z - <model_name> | |
| 2025-06-24T04:07:52.4566121Z ``` | |
| 2025-06-24T04:07:52.4580369Z ======================================================================================================================== | |
| 2025-06-24T04:07:52.4581373Z ........................................................................................................................ | |
| 2025-06-24T04:07:52.4582266Z ==> Events of namespace llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:52.4582955Z ........................................................................................................................ | |
| 2025-06-24T04:07:52.4583895Z >>> kubectl --request-timeout=30s get events --output wide --namespace llm-d-x3wixbo1ie --sort-by lastTimestamp | |
| 2025-06-24T04:07:52.5225919Z LAST SEEN TYPE REASON OBJECT SUBOBJECT SOURCE MESSAGE FIRST SEEN COUNT NAME | |
| 2025-06-24T04:07:52.5231455Z 80s Normal SuccessfulCreate replicaset/llm-d-x3wixbo1ie-inference-gateway-istio-5fc548c86f replicaset-controller Created pod: llm-d-x3wixbo1ie-inference-gateway-istio-5fc548c86f-6wqj7 80s 1 llm-d-x3wixbo1ie-inference-gateway-istio-5fc548c86f.184bdeedbab220c9 | |
| 2025-06-24T04:07:52.5238062Z 80s Normal Scheduled pod/llm-d-x3wixbo1ie-redis-master-685645794-296zz default-scheduler Successfully assigned llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-redis-master-685645794-296zz to chart-testing-control-plane 80s 1 llm-d-x3wixbo1ie-redis-master-685645794-296zz.184bdeedb41b56f8 | |
| 2025-06-24T04:07:52.5242160Z 80s Normal Scheduled pod/llm-d-x3wixbo1ie-inference-gateway-istio-5fc548c86f-6wqj7 default-scheduler Successfully assigned llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-inference-gateway-istio-5fc548c86f-6wqj7 to chart-testing-control-plane 80s 1 llm-d-x3wixbo1ie-inference-gateway-istio-5fc548c86f-6wqj7.184bdeedbb6c9c66 | |
| 2025-06-24T04:07:52.5245654Z 80s Normal ScalingReplicaSet deployment/llm-d-x3wixbo1ie-redis-master deployment-controller Scaled up replica set llm-d-x3wixbo1ie-redis-master-685645794 to 1 80s 1 llm-d-x3wixbo1ie-redis-master.184bdeedb131d622 | |
| 2025-06-24T04:07:52.5248758Z 80s Normal SuccessfulCreate replicaset/llm-d-x3wixbo1ie-redis-master-685645794 replicaset-controller Created pod: llm-d-x3wixbo1ie-redis-master-685645794-296zz 80s 1 llm-d-x3wixbo1ie-redis-master-685645794.184bdeedb242c301 | |
| 2025-06-24T04:07:52.5252143Z 80s Normal ScalingReplicaSet deployment/llm-d-x3wixbo1ie-inference-gateway-istio deployment-controller Scaled up replica set llm-d-x3wixbo1ie-inference-gateway-istio-5fc548c86f to 1 80s 1 llm-d-x3wixbo1ie-inference-gateway-istio.184bdeedb9f61679 | |
| 2025-06-24T04:07:52.5255310Z 80s Normal SuccessfulCreate replicaset/llm-d-x3wixbo1ie-modelservice-787ffc44bf replicaset-controller Created pod: llm-d-x3wixbo1ie-modelservice-787ffc44bf-6bzcj 80s 1 llm-d-x3wixbo1ie-modelservice-787ffc44bf.184bdeedb23ca5ef | |
| 2025-06-24T04:07:52.5258263Z 80s Normal ScalingReplicaSet deployment/llm-d-x3wixbo1ie-modelservice deployment-controller Scaled up replica set llm-d-x3wixbo1ie-modelservice-787ffc44bf to 1 80s 1 llm-d-x3wixbo1ie-modelservice.184bdeedb13d302f | |
| 2025-06-24T04:07:52.5261630Z 80s Normal Scheduled pod/llm-d-x3wixbo1ie-modelservice-787ffc44bf-6bzcj default-scheduler Successfully assigned llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-modelservice-787ffc44bf-6bzcj to chart-testing-control-plane 80s 1 llm-d-x3wixbo1ie-modelservice-787ffc44bf-6bzcj.184bdeedb41e3ae9 | |
| 2025-06-24T04:07:52.5265281Z 79s Normal Pulling pod/llm-d-x3wixbo1ie-redis-master-685645794-296zz spec.containers{redis} kubelet, chart-testing-control-plane Pulling image "quay.io/sclorg/redis-7-c9s:c9s" 79s 1 llm-d-x3wixbo1ie-redis-master-685645794-296zz.184bdeedd382bcaf | |
| 2025-06-24T04:07:52.5268923Z 79s Normal Pulling pod/llm-d-x3wixbo1ie-inference-gateway-istio-5fc548c86f-6wqj7 spec.containers{istio-proxy} kubelet, chart-testing-control-plane Pulling image "gcr.io/istio-testing/proxyv2:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d" 79s 1 llm-d-x3wixbo1ie-inference-gateway-istio-5fc548c86f-6wqj7.184bdeedd92d3bec | |
| 2025-06-24T04:07:52.5272849Z 79s Normal Pulling pod/llm-d-x3wixbo1ie-modelservice-787ffc44bf-6bzcj spec.containers{manager} kubelet, chart-testing-control-plane Pulling image "ghcr.io/llm-d/llm-d-model-service:0.0.10" 79s 1 llm-d-x3wixbo1ie-modelservice-787ffc44bf-6bzcj.184bdeedd55fce48 | |
| 2025-06-24T04:07:52.5276064Z 76s Normal Created pod/llm-d-x3wixbo1ie-redis-master-685645794-296zz spec.containers{redis} kubelet, chart-testing-control-plane Created container redis 76s 1 llm-d-x3wixbo1ie-redis-master-685645794-296zz.184bdeeeb38e1b65 | |
| 2025-06-24T04:07:52.5278083Z 76s Normal Pulled pod/llm-d-x3wixbo1ie-redis-master-685645794-296zz spec.containers{redis} kubelet, chart-testing-control-plane Successfully pulled image "quay.io/sclorg/redis-7-c9s:c9s" in 3.738s (3.739s including waiting). Image size: 97229638 bytes. 76s 1 llm-d-x3wixbo1ie-redis-master-685645794-296zz.184bdeeeb2604524 | |
| 2025-06-24T04:07:52.5280188Z 75s Normal Started pod/llm-d-x3wixbo1ie-redis-master-685645794-296zz spec.containers{redis} kubelet, chart-testing-control-plane Started container redis 75s 1 llm-d-x3wixbo1ie-redis-master-685645794-296zz.184bdeeebf6548b5 | |
| 2025-06-24T04:07:52.5282116Z 72s Normal Pulled pod/llm-d-x3wixbo1ie-modelservice-787ffc44bf-6bzcj spec.containers{manager} kubelet, chart-testing-control-plane Successfully pulled image "ghcr.io/llm-d/llm-d-model-service:0.0.10" in 3.552s (7.259s including waiting). Image size: 115030935 bytes. 72s 1 llm-d-x3wixbo1ie-modelservice-787ffc44bf-6bzcj.184bdeef861a9c57 | |
| 2025-06-24T04:07:52.5284018Z 72s Normal Created pod/llm-d-x3wixbo1ie-modelservice-787ffc44bf-6bzcj spec.containers{manager} kubelet, chart-testing-control-plane Created container manager 72s 1 llm-d-x3wixbo1ie-modelservice-787ffc44bf-6bzcj.184bdeef86cecd02 | |
| 2025-06-24T04:07:52.5285826Z 72s Normal Started pod/llm-d-x3wixbo1ie-modelservice-787ffc44bf-6bzcj spec.containers{manager} kubelet, chart-testing-control-plane Started container manager 72s 1 llm-d-x3wixbo1ie-modelservice-787ffc44bf-6bzcj.184bdeef92c717d5 | |
| 2025-06-24T04:07:52.5288032Z 69s Normal Pulled pod/llm-d-x3wixbo1ie-inference-gateway-istio-5fc548c86f-6wqj7 spec.containers{istio-proxy} kubelet, chart-testing-control-plane Successfully pulled image "gcr.io/istio-testing/proxyv2:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d" in 2.755s (9.951s including waiting). Image size: 107788353 bytes. 69s 1 llm-d-x3wixbo1ie-inference-gateway-istio-5fc548c86f-6wqj7.184bdef02a5446c7 | |
| 2025-06-24T04:07:52.5290527Z 69s Normal Started pod/llm-d-x3wixbo1ie-inference-gateway-istio-5fc548c86f-6wqj7 spec.containers{istio-proxy} kubelet, chart-testing-control-plane Started container istio-proxy 69s 1 llm-d-x3wixbo1ie-inference-gateway-istio-5fc548c86f-6wqj7.184bdef0303229fe | |
| 2025-06-24T04:07:52.5292535Z 69s Normal Created pod/llm-d-x3wixbo1ie-inference-gateway-istio-5fc548c86f-6wqj7 spec.containers{istio-proxy} kubelet, chart-testing-control-plane Created container istio-proxy 69s 1 llm-d-x3wixbo1ie-inference-gateway-istio-5fc548c86f-6wqj7.184bdef02ad3c1af | |
| 2025-06-24T04:07:52.5294302Z 53s Normal ScalingReplicaSet deployment/llm-d-x3wixbo1ie-vllm-sim-epp deployment-controller Scaled up replica set llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc to 1 53s 1 llm-d-x3wixbo1ie-vllm-sim-epp.184bdef40983449c | |
| 2025-06-24T04:07:52.5295909Z 53s Normal ScalingReplicaSet deployment/llm-d-x3wixbo1ie-vllm-sim-prefill deployment-controller Scaled up replica set llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677 to 1 53s 1 llm-d-x3wixbo1ie-vllm-sim-prefill.184bdef4047d66d2 | |
| 2025-06-24T04:07:52.5298363Z 53s Normal ScalingReplicaSet deployment/llm-d-x3wixbo1ie-vllm-sim-decode deployment-controller Scaled up replica set llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c to 1 53s 1 llm-d-x3wixbo1ie-vllm-sim-decode.184bdef40505d5d1 | |
| 2025-06-24T04:07:52.5301481Z 53s Normal Scheduled pod/llm-d-x3wixbo1ie-test-connection default-scheduler Successfully assigned llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-test-connection to chart-testing-control-plane 53s 1 llm-d-x3wixbo1ie-test-connection.184bdef40d2828a8 | |
| 2025-06-24T04:07:52.5304652Z 53s Warning FailedCreate replicaset/llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc replicaset-controller Error creating: pods "llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-" is forbidden: error looking up service account llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-vllm-sim-epp-sa: serviceaccount "llm-d-x3wixbo1ie-vllm-sim-epp-sa" not found 53s 4 llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc.184bdef40a607521 | |
| 2025-06-24T04:07:52.5306878Z 52s Normal SuccessfulCreate replicaset/llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677 replicaset-controller Created pod: llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-nx9ff 52s 1 llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677.184bdef42ffd2abd | |
| 2025-06-24T04:07:52.5308638Z 52s Normal SuccessfulCreate replicaset/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c replicaset-controller Created pod: llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n 52s 1 llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c.184bdef43b5cc630 | |
| 2025-06-24T04:07:52.5311215Z 52s Warning FailedCreate replicaset/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c replicaset-controller Error creating: pods "llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-" is forbidden: error looking up service account llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-vllm-sim-sa: serviceaccount "llm-d-x3wixbo1ie-vllm-sim-sa" not found 53s 7 llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c.184bdef405cb408d | |
| 2025-06-24T04:07:52.5313556Z 52s Normal Scheduled pod/llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-nx9ff default-scheduler Successfully assigned llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-nx9ff to chart-testing-control-plane 52s 1 llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-nx9ff.184bdef430bcc98c | |
| 2025-06-24T04:07:52.5315623Z 52s Normal Scheduled pod/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n default-scheduler Successfully assigned llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n to chart-testing-control-plane 52s 1 llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n.184bdef43b928482 | |
| 2025-06-24T04:07:52.5317815Z 52s Normal Scheduled pod/llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-czz7w default-scheduler Successfully assigned llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-czz7w to chart-testing-control-plane 52s 1 llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-czz7w.184bdef415f77ae5 | |
| 2025-06-24T04:07:52.5320863Z 52s Warning FailedCreate replicaset/llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677 replicaset-controller Error creating: pods "llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-" is forbidden: error looking up service account llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-vllm-sim-sa: serviceaccount "llm-d-x3wixbo1ie-vllm-sim-sa" not found 53s 7 llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677.184bdef40500d864 | |
| 2025-06-24T04:07:52.5323526Z 52s Normal SuccessfulCreate replicaset/llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc replicaset-controller Created pod: llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-czz7w 52s 1 llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc.184bdef41332e045 | |
| 2025-06-24T04:07:52.5325557Z 51s Normal Pulling pod/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n spec.initContainers{routing-proxy} kubelet, chart-testing-control-plane Pulling image "ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6" 51s 1 llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n.184bdef46922e563 | |
| 2025-06-24T04:07:52.5327758Z 51s Normal Pulling pod/llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-nx9ff spec.containers{vllm} kubelet, chart-testing-control-plane Pulling image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" 51s 1 llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-nx9ff.184bdef46ce89a19 | |
| 2025-06-24T04:07:52.5331019Z 51s Normal Pulling pod/llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-czz7w spec.containers{epp} kubelet, chart-testing-control-plane Pulling image "ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4" 51s 1 llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-czz7w.184bdef465890d40 | |
| 2025-06-24T04:07:52.5333414Z 48s Normal Created pod/llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-czz7w spec.containers{epp} kubelet, chart-testing-control-plane Created container epp 48s 1 llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-czz7w.184bdef536d24654 | |
| 2025-06-24T04:07:52.5335289Z 48s Normal Pulling pod/llm-d-x3wixbo1ie-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Pulling image "quay.io/curl/curl:latest" 48s 1 llm-d-x3wixbo1ie-test-connection.184bdef5020fcc5b | |
| 2025-06-24T04:07:52.5338018Z 48s Normal Pulled pod/llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-czz7w spec.containers{epp} kubelet, chart-testing-control-plane Successfully pulled image "ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4" in 3.501s (3.501s including waiting). Image size: 119587259 bytes. 48s 1 llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-czz7w.184bdef53641b4de | |
| 2025-06-24T04:07:52.5340606Z 47s Normal Started pod/llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-czz7w spec.containers{epp} kubelet, chart-testing-control-plane Started container epp 47s 1 llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-czz7w.184bdef53bf8a4e6 | |
| 2025-06-24T04:07:52.5342969Z 44s Normal Pulled pod/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n spec.initContainers{routing-proxy} kubelet, chart-testing-control-plane Successfully pulled image "ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6" in 3.346s (6.788s including waiting). Image size: 85265962 bytes. 44s 1 llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n.184bdef5fdbf5f64 | |
| 2025-06-24T04:07:52.5345409Z 44s Normal Created pod/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n spec.initContainers{routing-proxy} kubelet, chart-testing-control-plane Created container routing-proxy 44s 1 llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n.184bdef5feb393cd | |
| 2025-06-24T04:07:52.5347444Z 44s Normal Started pod/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n spec.initContainers{routing-proxy} kubelet, chart-testing-control-plane Started container routing-proxy 44s 1 llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n.184bdef603b07f97 | |
| 2025-06-24T04:07:52.5350010Z 44s Normal Pulled pod/llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-nx9ff spec.containers{vllm} kubelet, chart-testing-control-plane Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" in 683ms (7.408s including waiting). Image size: 87011014 bytes. 44s 1 llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-nx9ff.184bdef6267c3ec2 | |
| 2025-06-24T04:07:52.5351979Z 44s Normal Created pod/llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-nx9ff spec.containers{vllm} kubelet, chart-testing-control-plane Created container vllm 44s 1 llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-nx9ff.184bdef6275e553f | |
| 2025-06-24T04:07:52.5353923Z 43s Normal Pulled pod/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n spec.containers{vllm} kubelet, chart-testing-control-plane Container image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" already present on machine 43s 1 llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n.184bdef63047b38c | |
| 2025-06-24T04:07:52.5355746Z 43s Normal Started pod/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n spec.containers{vllm} kubelet, chart-testing-control-plane Started container vllm 43s 1 llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n.184bdef63718bfbe | |
| 2025-06-24T04:07:52.5357415Z 43s Normal Created pod/llm-d-x3wixbo1ie-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Created container curl 43s 1 llm-d-x3wixbo1ie-test-connection.184bdef662796ef2 | |
| 2025-06-24T04:07:52.5358949Z 43s Normal Started pod/llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-nx9ff spec.containers{vllm} kubelet, chart-testing-control-plane Started container vllm 43s 1 llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-nx9ff.184bdef62d456cd7 | |
| 2025-06-24T04:07:52.5361078Z 43s Normal Pulled pod/llm-d-x3wixbo1ie-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Successfully pulled image "quay.io/curl/curl:latest" in 998ms (5.904s including waiting). Image size: 9956545 bytes. 43s 1 llm-d-x3wixbo1ie-test-connection.184bdef662005883 | |
| 2025-06-24T04:07:52.5362861Z 43s Normal Created pod/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n spec.containers{vllm} kubelet, chart-testing-control-plane Created container vllm 43s 1 llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n.184bdef630f90947 | |
| 2025-06-24T04:07:52.5364532Z 34s Normal Started pod/llm-d-x3wixbo1ie-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Started container curl 34s 1 llm-d-x3wixbo1ie-test-connection.184bdef84b17b180 | |
| 2025-06-24T04:07:52.5366508Z 31s Warning Unhealthy pod/llm-d-x3wixbo1ie-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Liveness probe errored: rpc error: code = NotFound desc = failed to exec in container: failed to load task: no running task found: task 9620d9def0223354aedd74a1a7a7b48befb66b981a0a0e9aa52460b3eda9c2eb not found: not found 31s 1 llm-d-x3wixbo1ie-test-connection.184bdef8fcacc4e0 | |
| 2025-06-24T04:07:52.5368797Z 28s Normal Scheduled pod/llm-d-x3wixbo1ie-modelservice-7d8df699d6-zq2fj default-scheduler Successfully assigned llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-modelservice-7d8df699d6-zq2fj to chart-testing-control-plane 28s 1 llm-d-x3wixbo1ie-modelservice-7d8df699d6-zq2fj.184bdef9c7689d6b | |
| 2025-06-24T04:07:52.5370961Z 28s Normal Pulling pod/llm-d-x3wixbo1ie-modelservice-7d8df699d6-zq2fj spec.containers{manager} kubelet, chart-testing-control-plane Pulling image "ghcr.io/llm-d/llm-d-model-service:0.0.10" 28s 1 llm-d-x3wixbo1ie-modelservice-7d8df699d6-zq2fj.184bdef9df606ac5 | |
| 2025-06-24T04:07:52.5373158Z 28s Normal SuccessfulCreate replicaset/llm-d-x3wixbo1ie-modelservice-7d8df699d6 replicaset-controller Created pod: llm-d-x3wixbo1ie-modelservice-7d8df699d6-zq2fj 28s 1 llm-d-x3wixbo1ie-modelservice-7d8df699d6.184bdef9c710a027 | |
| 2025-06-24T04:07:52.5375324Z 28s Normal Scheduled pod/llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx default-scheduler Successfully assigned llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx to chart-testing-control-plane 28s 1 llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx.184bdef9cd3e8c0f | |
| 2025-06-24T04:07:52.5377826Z 28s Normal SuccessfulCreate replicaset/llm-d-x3wixbo1ie-inference-gateway-istio-7576547688 replicaset-controller Created pod: llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx 28s 1 llm-d-x3wixbo1ie-inference-gateway-istio-7576547688.184bdef9cc8d2650 | |
| 2025-06-24T04:07:52.5382450Z 28s Normal ScalingReplicaSet deployment/llm-d-x3wixbo1ie-inference-gateway-istio deployment-controller Scaled up replica set llm-d-x3wixbo1ie-inference-gateway-istio-7576547688 to 1 28s 1 llm-d-x3wixbo1ie-inference-gateway-istio.184bdef9cbe530a7 | |
| 2025-06-24T04:07:52.5385507Z 28s Normal ScalingReplicaSet deployment/llm-d-x3wixbo1ie-modelservice deployment-controller Scaled up replica set llm-d-x3wixbo1ie-modelservice-7d8df699d6 to 1 28s 1 llm-d-x3wixbo1ie-modelservice.184bdef9c69fc967 | |
| 2025-06-24T04:07:52.5388590Z 27s Normal Created pod/llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx spec.containers{istio-proxy} kubelet, chart-testing-control-plane Created container istio-proxy 27s 1 llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx.184bdef9e5de3c2e | |
| 2025-06-24T04:07:52.5392224Z 27s Normal Created pod/llm-d-x3wixbo1ie-modelservice-7d8df699d6-zq2fj spec.containers{manager} kubelet, chart-testing-control-plane Created container manager 27s 1 llm-d-x3wixbo1ie-modelservice-7d8df699d6-zq2fj.184bdef9e8efbfba | |
| 2025-06-24T04:07:52.5395408Z 27s Normal Started pod/llm-d-x3wixbo1ie-modelservice-7d8df699d6-zq2fj spec.containers{manager} kubelet, chart-testing-control-plane Started container manager 27s 1 llm-d-x3wixbo1ie-modelservice-7d8df699d6-zq2fj.184bdef9f6ddd48a | |
| 2025-06-24T04:07:52.5399124Z 27s Normal Pulled pod/llm-d-x3wixbo1ie-modelservice-7d8df699d6-zq2fj spec.containers{manager} kubelet, chart-testing-control-plane Successfully pulled image "ghcr.io/llm-d/llm-d-model-service:0.0.10" in 150ms (150ms including waiting). Image size: 115030935 bytes. 27s 1 llm-d-x3wixbo1ie-modelservice-7d8df699d6-zq2fj.184bdef9e85fea77 | |
| 2025-06-24T04:07:52.5403674Z 27s Normal Pulled pod/llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx spec.containers{istio-proxy} kubelet, chart-testing-control-plane Container image "gcr.io/istio-testing/proxyv2:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d" already present on machine 27s 1 llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx.184bdef9e540b041 | |
| 2025-06-24T04:07:52.5406591Z 27s Normal Started pod/llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx spec.containers{istio-proxy} kubelet, chart-testing-control-plane Started container istio-proxy 27s 1 llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx.184bdef9ebea0a3d | |
| 2025-06-24T04:07:52.5409703Z 25s Normal SuccessfulDelete replicaset/llm-d-x3wixbo1ie-inference-gateway-istio-5fc548c86f replicaset-controller Deleted pod: llm-d-x3wixbo1ie-inference-gateway-istio-5fc548c86f-6wqj7 25s 1 llm-d-x3wixbo1ie-inference-gateway-istio-5fc548c86f.184bdefa66c30f51 | |
| 2025-06-24T04:07:52.5413293Z 25s Normal Killing pod/llm-d-x3wixbo1ie-inference-gateway-istio-5fc548c86f-6wqj7 spec.containers{istio-proxy} kubelet, chart-testing-control-plane Stopping container istio-proxy 25s 1 llm-d-x3wixbo1ie-inference-gateway-istio-5fc548c86f-6wqj7.184bdefa66e8f3a0 | |
| 2025-06-24T04:07:52.5416770Z 25s Normal ScalingReplicaSet deployment/llm-d-x3wixbo1ie-inference-gateway-istio deployment-controller Scaled down replica set llm-d-x3wixbo1ie-inference-gateway-istio-5fc548c86f to 0 from 1 25s 1 llm-d-x3wixbo1ie-inference-gateway-istio.184bdefa66850357 | |
| 2025-06-24T04:07:52.5420161Z 18s Normal ScalingReplicaSet deployment/llm-d-x3wixbo1ie-modelservice deployment-controller Scaled down replica set llm-d-x3wixbo1ie-modelservice-787ffc44bf to 0 from 1 18s 1 llm-d-x3wixbo1ie-modelservice.184bdefc2f904a7a | |
| 2025-06-24T04:07:52.5423136Z 18s Normal SuccessfulDelete replicaset/llm-d-x3wixbo1ie-modelservice-787ffc44bf replicaset-controller Deleted pod: llm-d-x3wixbo1ie-modelservice-787ffc44bf-6bzcj 18s 1 llm-d-x3wixbo1ie-modelservice-787ffc44bf.184bdefc2fccc508 | |
| 2025-06-24T04:07:52.5426777Z 18s Normal Killing pod/llm-d-x3wixbo1ie-modelservice-787ffc44bf-6bzcj spec.containers{manager} kubelet, chart-testing-control-plane Stopping container manager 18s 1 llm-d-x3wixbo1ie-modelservice-787ffc44bf-6bzcj.184bdefc2fe7f369 | |
| 2025-06-24T04:07:52.5430399Z 14s Normal Killing pod/llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-czz7w spec.containers{epp} kubelet, chart-testing-control-plane Stopping container epp 14s 1 llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-czz7w.184bdefd050306cc | |
| 2025-06-24T04:07:52.5433271Z 14s Normal ScalingReplicaSet deployment/llm-d-x3wixbo1ie-vllm-sim-decode deployment-controller Scaled up replica set llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c to 1 14s 1 llm-d-x3wixbo1ie-vllm-sim-decode.184bdefcf928e1fb | |
| 2025-06-24T04:07:52.5436462Z 14s Normal SuccessfulCreate replicaset/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c replicaset-controller Created pod: llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt 14s 1 llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c.184bdefd14570d9b | |
| 2025-06-24T04:07:52.5440494Z 14s Warning FailedCreate replicaset/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c replicaset-controller Error creating: pods "llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-" is forbidden: error looking up service account llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-vllm-sim-sa: serviceaccount "llm-d-x3wixbo1ie-vllm-sim-sa" not found 14s 6 llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c.184bdefcf9e0d6ba | |
| 2025-06-24T04:07:52.5444404Z 14s Normal Killing pod/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n spec.containers{vllm} kubelet, chart-testing-control-plane Stopping container vllm 14s 1 llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n.184bdefd0311b1d3 | |
| 2025-06-24T04:07:52.5447609Z 14s Normal Killing pod/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n spec.initContainers{routing-proxy} kubelet, chart-testing-control-plane Stopping container routing-proxy 14s 1 llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n.184bdefd0310c88a | |
| 2025-06-24T04:07:52.5450786Z 14s Normal Scheduled pod/llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-vdwtj default-scheduler Successfully assigned llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-vdwtj to chart-testing-control-plane 14s 1 llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-vdwtj.184bdefd00932ae9 | |
| 2025-06-24T04:07:52.5454280Z 14s Normal Pulling pod/llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-vdwtj spec.containers{epp} kubelet, chart-testing-control-plane Pulling image "ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4" 14s 1 llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-vdwtj.184bdefd1cb6c73f | |
| 2025-06-24T04:07:52.5457427Z 14s Normal ScalingReplicaSet deployment/llm-d-x3wixbo1ie-vllm-sim-prefill deployment-controller Scaled up replica set llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677 to 1 14s 1 llm-d-x3wixbo1ie-vllm-sim-prefill.184bdefcf8e90895 | |
| 2025-06-24T04:07:52.5460956Z 14s Normal Scheduled pod/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt default-scheduler Successfully assigned llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt to chart-testing-control-plane 14s 1 llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt.184bdefd14cf7e89 | |
| 2025-06-24T04:07:52.5464679Z 14s Normal Scheduled pod/llm-d-x3wixbo1ie-test-connection default-scheduler Successfully assigned llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-test-connection to chart-testing-control-plane 14s 1 llm-d-x3wixbo1ie-test-connection.184bdefd06c570c7 | |
| 2025-06-24T04:07:52.5467812Z 14s Normal SuccessfulCreate replicaset/llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677 replicaset-controller Created pod: llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs 14s 1 llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677.184bdefd11d3b4df | |
| 2025-06-24T04:07:52.5472437Z 14s Warning FailedCreate replicaset/llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677 replicaset-controller Error creating: pods "llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-" is forbidden: error looking up service account llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-vllm-sim-sa: serviceaccount "llm-d-x3wixbo1ie-vllm-sim-sa" not found 14s 6 llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677.184bdefcf94aa01e | |
| 2025-06-24T04:07:52.5478790Z 14s Warning FailedCreate replicaset/llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc replicaset-controller Error creating: pods "llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-" is forbidden: error looking up service account llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-vllm-sim-epp-sa: serviceaccount "llm-d-x3wixbo1ie-vllm-sim-epp-sa" not found 14s 2 llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc.184bdefcfce6407d | |
| 2025-06-24T04:07:52.5482580Z 14s Normal SuccessfulCreate replicaset/llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc replicaset-controller Created pod: llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-vdwtj 14s 1 llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc.184bdefcfffd72cc | |
| 2025-06-24T04:07:52.5485958Z 14s Normal Killing pod/llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-nx9ff spec.containers{vllm} kubelet, chart-testing-control-plane Stopping container vllm 14s 1 llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-nx9ff.184bdefd01c621e5 | |
| 2025-06-24T04:07:52.5488820Z 14s Normal ScalingReplicaSet deployment/llm-d-x3wixbo1ie-vllm-sim-epp deployment-controller Scaled up replica set llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc to 1 14s 1 llm-d-x3wixbo1ie-vllm-sim-epp.184bdefcfcabf221 | |
| 2025-06-24T04:07:52.5492337Z 14s Normal Scheduled pod/llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs default-scheduler Successfully assigned llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs to chart-testing-control-plane 14s 1 llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs.184bdefd1235f1ab | |
| 2025-06-24T04:07:52.5495829Z 13s Normal Created pod/llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-vdwtj spec.containers{epp} kubelet, chart-testing-control-plane Created container epp 13s 1 llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-vdwtj.184bdefd27453797 | |
| 2025-06-24T04:07:52.5498694Z 13s Normal Started pod/llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs spec.containers{vllm} kubelet, chart-testing-control-plane Started container vllm 13s 1 llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs.184bdefd38e515e2 | |
| 2025-06-24T04:07:52.5501939Z 13s Normal Started pod/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt spec.initContainers{routing-proxy} kubelet, chart-testing-control-plane Started container routing-proxy 13s 1 llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt.184bdefd39ec8df4 | |
| 2025-06-24T04:07:52.5505080Z 13s Normal Created pod/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt spec.initContainers{routing-proxy} kubelet, chart-testing-control-plane Created container routing-proxy 13s 1 llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt.184bdefd32bc1f87 | |
| 2025-06-24T04:07:52.5508655Z 13s Normal Pulled pod/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt spec.initContainers{routing-proxy} kubelet, chart-testing-control-plane Container image "ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6" already present on machine 13s 1 llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt.184bdefd316987fa | |
| 2025-06-24T04:07:52.5512324Z 13s Normal Pulled pod/llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs spec.containers{vllm} kubelet, chart-testing-control-plane Container image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" already present on machine 13s 1 llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs.184bdefd2ebd3fa3 | |
| 2025-06-24T04:07:52.5515988Z 13s Normal Pulled pod/llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-vdwtj spec.containers{epp} kubelet, chart-testing-control-plane Successfully pulled image "ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4" in 165ms (165ms including waiting). Image size: 119587259 bytes. 13s 1 llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-vdwtj.184bdefd2691096f | |
| 2025-06-24T04:07:52.5519317Z 13s Normal Started pod/llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-vdwtj spec.containers{epp} kubelet, chart-testing-control-plane Started container epp 13s 1 llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-vdwtj.184bdefd2fec81ab | |
| 2025-06-24T04:07:52.5522452Z 13s Normal Created pod/llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs spec.containers{vllm} kubelet, chart-testing-control-plane Created container vllm 13s 1 llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs.184bdefd2fbed598 | |
| 2025-06-24T04:07:52.5525365Z 12s Normal Started pod/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt spec.containers{vllm} kubelet, chart-testing-control-plane Started container vllm 12s 1 llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt.184bdefd7894b734 | |
| 2025-06-24T04:07:52.5528559Z 12s Normal Pulled pod/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt spec.containers{vllm} kubelet, chart-testing-control-plane Container image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" already present on machine 12s 1 llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt.184bdefd6e7032ca | |
| 2025-06-24T04:07:52.5531886Z 12s Normal Created pod/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt spec.containers{vllm} kubelet, chart-testing-control-plane Created container vllm 12s 1 llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt.184bdefd727e3cba | |
| 2025-06-24T04:07:52.5534964Z 11s Normal Pulled pod/llm-d-x3wixbo1ie-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Container image "quay.io/curl/curl:latest" already present on machine 11s 1 llm-d-x3wixbo1ie-test-connection.184bdefdd25aa3fa | |
| 2025-06-24T04:07:52.5537677Z 11s Normal Created pod/llm-d-x3wixbo1ie-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Created container curl 11s 1 llm-d-x3wixbo1ie-test-connection.184bdefdd32692fb | |
| 2025-06-24T04:07:52.5540284Z 3s Normal Started pod/llm-d-x3wixbo1ie-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Started container curl 3s 1 llm-d-x3wixbo1ie-test-connection.184bdeff9d3f2ed3 | |
| 2025-06-24T04:07:52.5541857Z ........................................................................................................................ | |
| 2025-06-24T04:07:52.5542574Z <== Events of namespace llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:52.5543100Z ........................................................................................................................ | |
| 2025-06-24T04:07:52.5544127Z >>> kubectl --request-timeout=30s get pods --no-headers --namespace llm-d-x3wixbo1ie --selector --output jsonpath={.items[*].metadata.name} | |
| 2025-06-24T04:07:52.6009664Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:52.6010789Z ==> Description of pod llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx | |
| 2025-06-24T04:07:52.6011593Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:52.6012639Z >>> kubectl --request-timeout=30s describe pod llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx --namespace llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:52.6612768Z Name: llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx | |
| 2025-06-24T04:07:52.6617704Z Namespace: llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:52.6618084Z Priority: 0 | |
| 2025-06-24T04:07:52.6618505Z Service Account: llm-d-x3wixbo1ie-inference-gateway-istio | |
| 2025-06-24T04:07:52.6619046Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T04:07:52.6619505Z Start Time: Tue, 24 Jun 2025 04:07:24 +0000 | |
| 2025-06-24T04:07:52.6620269Z Labels: app.kubernetes.io/component=inference-gateway | |
| 2025-06-24T04:07:52.6620863Z app.kubernetes.io/gateway=llm-d-x3wixbo1ie-inference-gateway | |
| 2025-06-24T04:07:52.6621433Z app.kubernetes.io/instance=llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:52.6622218Z app.kubernetes.io/managed-by=Helm | |
| 2025-06-24T04:07:52.6622658Z app.kubernetes.io/name=llm-d | |
| 2025-06-24T04:07:52.6623229Z app.kubernetes.io/version=0.1 | |
| 2025-06-24T04:07:52.6623924Z gateway.istio.io/managed=istio.io-gateway-controller | |
| 2025-06-24T04:07:52.6624670Z gateway.networking.k8s.io/gateway-name=llm-d-x3wixbo1ie-inference-gateway | |
| 2025-06-24T04:07:52.6625283Z helm.sh/chart=llm-d-1.0.21 | |
| 2025-06-24T04:07:52.6625709Z istio.io/enable-inference-extproc=true | |
| 2025-06-24T04:07:52.6626150Z pod-template-hash=7576547688 | |
| 2025-06-24T04:07:52.6626739Z service.istio.io/canonical-name=llm-d-x3wixbo1ie-inference-gateway-istio | |
| 2025-06-24T04:07:52.6627377Z service.istio.io/canonical-revision=latest | |
| 2025-06-24T04:07:52.6627815Z sidecar.istio.io/inject=false | |
| 2025-06-24T04:07:52.6628221Z Annotations: istio.io/rev: default | |
| 2025-06-24T04:07:52.6629139Z meta.helm.sh/release-name: llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:52.6629649Z meta.helm.sh/release-namespace: llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:52.6630316Z networking.istio.io/service-type: ClusterIP | |
| 2025-06-24T04:07:52.6630794Z prometheus.io/path: /stats/prometheus | |
| 2025-06-24T04:07:52.6631228Z prometheus.io/port: 15020 | |
| 2025-06-24T04:07:52.6631618Z prometheus.io/scrape: true | |
| 2025-06-24T04:07:52.6631984Z Status: Running | |
| 2025-06-24T04:07:52.6632281Z IP: 10.244.0.21 | |
| 2025-06-24T04:07:52.6632658Z IPs: | |
| 2025-06-24T04:07:52.6632886Z IP: 10.244.0.21 | |
| 2025-06-24T04:07:52.6633404Z Controlled By: ReplicaSet/llm-d-x3wixbo1ie-inference-gateway-istio-7576547688 | |
| 2025-06-24T04:07:52.6634009Z Containers: | |
| 2025-06-24T04:07:52.6634271Z istio-proxy: | |
| 2025-06-24T04:07:52.6634925Z Container ID: containerd://9359e2f69832d481a5f2421dd456e5e9c15e301edd6e3a933095adfc74aafaec | |
| 2025-06-24T04:07:52.6636005Z Image: gcr.io/istio-testing/proxyv2:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d | |
| 2025-06-24T04:07:52.6636988Z Image ID: gcr.io/istio-testing/proxyv2@sha256:f8b9447198a9e52e5c928cc735536a41ad416afa2a7a674056b1e24c5789607c | |
| 2025-06-24T04:07:52.6638016Z Ports: 15020/TCP, 15021/TCP, 15090/TCP | |
| 2025-06-24T04:07:52.6638451Z Host Ports: 0/TCP, 0/TCP, 0/TCP | |
| 2025-06-24T04:07:52.6638821Z Args: | |
| 2025-06-24T04:07:52.6639067Z proxy | |
| 2025-06-24T04:07:52.6639304Z router | |
| 2025-06-24T04:07:52.6639539Z --domain | |
| 2025-06-24T04:07:52.6639991Z $(POD_NAMESPACE).svc.cluster.local | |
| 2025-06-24T04:07:52.6640903Z --proxyLogLevel | |
| 2025-06-24T04:07:52.6641332Z warning | |
| 2025-06-24T04:07:52.6641643Z --proxyComponentLogLevel | |
| 2025-06-24T04:07:52.6641992Z misc:error | |
| 2025-06-24T04:07:52.6642293Z --log_output_level | |
| 2025-06-24T04:07:52.6642597Z default:info | |
| 2025-06-24T04:07:52.6642902Z State: Running | |
| 2025-06-24T04:07:52.6643292Z Started: Tue, 24 Jun 2025 04:07:25 +0000 | |
| 2025-06-24T04:07:52.6643720Z Ready: True | |
| 2025-06-24T04:07:52.6644038Z Restart Count: 0 | |
| 2025-06-24T04:07:52.6644302Z Limits: | |
| 2025-06-24T04:07:52.6644513Z cpu: 2 | |
| 2025-06-24T04:07:52.6644757Z memory: 1Gi | |
| 2025-06-24T04:07:52.6645024Z Requests: | |
| 2025-06-24T04:07:52.6645314Z cpu: 100m | |
| 2025-06-24T04:07:52.6645609Z memory: 128Mi | |
| 2025-06-24T04:07:52.6646272Z Readiness: http-get http://:15021/healthz/ready delay=0s timeout=1s period=15s #success=1 #failure=4 | |
| 2025-06-24T04:07:52.6647261Z Startup: http-get http://:15021/healthz/ready delay=1s timeout=1s period=1s #success=1 #failure=30 | |
| 2025-06-24T04:07:52.6647975Z Environment: | |
| 2025-06-24T04:07:52.6648320Z PILOT_CERT_PROVIDER: istiod | |
| 2025-06-24T04:07:52.6648802Z CA_ADDR: istiod.istio-system.svc:15012 | |
| 2025-06-24T04:07:52.6649635Z POD_NAME: llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx (v1:metadata.name) | |
| 2025-06-24T04:07:52.6651031Z POD_NAMESPACE: llm-d-x3wixbo1ie (v1:metadata.namespace) | |
| 2025-06-24T04:07:52.6651704Z INSTANCE_IP: (v1:status.podIP) | |
| 2025-06-24T04:07:52.6652416Z SERVICE_ACCOUNT: (v1:spec.serviceAccountName) | |
| 2025-06-24T04:07:52.6653250Z HOST_IP: (v1:status.hostIP) | |
| 2025-06-24T04:07:52.6653803Z ISTIO_CPU_LIMIT: 2 (limits.cpu) | |
| 2025-06-24T04:07:52.6654266Z PROXY_CONFIG: {} | |
| 2025-06-24T04:07:52.6654656Z | |
| 2025-06-24T04:07:52.6655045Z ISTIO_META_POD_PORTS: [] | |
| 2025-06-24T04:07:52.6655451Z ISTIO_META_APP_CONTAINERS: | |
| 2025-06-24T04:07:52.6655915Z GOMEMLIMIT: 1073741824 (limits.memory) | |
| 2025-06-24T04:07:52.6656579Z GOMAXPROCS: 2 (limits.cpu) | |
| 2025-06-24T04:07:52.6657062Z ISTIO_META_CLUSTER_ID: Kubernetes | |
| 2025-06-24T04:07:52.6657933Z ISTIO_META_NODE_NAME: (v1:spec.nodeName) | |
| 2025-06-24T04:07:52.6658455Z ISTIO_META_INTERCEPTION_MODE: REDIRECT | |
| 2025-06-24T04:07:52.6659048Z ISTIO_META_WORKLOAD_NAME: llm-d-x3wixbo1ie-inference-gateway-istio | |
| 2025-06-24T04:07:52.6660354Z ISTIO_META_OWNER: kubernetes://apis/apps/v1/namespaces/llm-d-x3wixbo1ie/deployments/llm-d-x3wixbo1ie-inference-gateway-istio | |
| 2025-06-24T04:07:52.6661354Z ISTIO_META_MESH_ID: cluster.local | |
| 2025-06-24T04:07:52.6661826Z TRUST_DOMAIN: cluster.local | |
| 2025-06-24T04:07:52.6662228Z Mounts: | |
| 2025-06-24T04:07:52.6662532Z /etc/istio/pod from istio-podinfo (rw) | |
| 2025-06-24T04:07:52.6663006Z /etc/istio/proxy from istio-envoy (rw) | |
| 2025-06-24T04:07:52.6663452Z /var/lib/istio/data from istio-data (rw) | |
| 2025-06-24T04:07:52.6664025Z /var/run/secrets/credential-uds from credential-socket (rw) | |
| 2025-06-24T04:07:52.6664625Z /var/run/secrets/istio from istiod-ca-cert (rw) | |
| 2025-06-24T04:07:52.6665297Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-bl564 (ro) | |
| 2025-06-24T04:07:52.6666123Z /var/run/secrets/tokens from istio-token (rw) | |
| 2025-06-24T04:07:52.6666738Z /var/run/secrets/workload-spiffe-credentials from workload-certs (rw) | |
| 2025-06-24T04:07:52.6667784Z /var/run/secrets/workload-spiffe-uds from workload-socket (rw) | |
| 2025-06-24T04:07:52.6668332Z Conditions: | |
| 2025-06-24T04:07:52.6668621Z Type Status | |
| 2025-06-24T04:07:52.6669013Z PodReadyToStartContainers True | |
| 2025-06-24T04:07:52.6669680Z Initialized True | |
| 2025-06-24T04:07:52.6670192Z Ready True | |
| 2025-06-24T04:07:52.6670551Z ContainersReady True | |
| 2025-06-24T04:07:52.6670935Z PodScheduled True | |
| 2025-06-24T04:07:52.6671284Z Volumes: | |
| 2025-06-24T04:07:52.6671550Z workload-socket: | |
| 2025-06-24T04:07:52.6672008Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T04:07:52.6672548Z Medium: | |
| 2025-06-24T04:07:52.6672842Z SizeLimit: <unset> | |
| 2025-06-24T04:07:52.6673164Z credential-socket: | |
| 2025-06-24T04:07:52.6673626Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T04:07:52.6674148Z Medium: | |
| 2025-06-24T04:07:52.6674439Z SizeLimit: <unset> | |
| 2025-06-24T04:07:52.6674756Z workload-certs: | |
| 2025-06-24T04:07:52.6675205Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T04:07:52.6675745Z Medium: | |
| 2025-06-24T04:07:52.6676050Z SizeLimit: <unset> | |
| 2025-06-24T04:07:52.6676375Z istio-envoy: | |
| 2025-06-24T04:07:52.6676799Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T04:07:52.6677324Z Medium: Memory | |
| 2025-06-24T04:07:52.6677634Z SizeLimit: <unset> | |
| 2025-06-24T04:07:52.6677943Z istio-data: | |
| 2025-06-24T04:07:52.6678384Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T04:07:52.6678921Z Medium: | |
| 2025-06-24T04:07:52.6679210Z SizeLimit: <unset> | |
| 2025-06-24T04:07:52.6679519Z istio-podinfo: | |
| 2025-06-24T04:07:52.6680120Z Type: DownwardAPI (a volume populated by information about the pod) | |
| 2025-06-24T04:07:52.6680667Z Items: | |
| 2025-06-24T04:07:52.6680944Z metadata.labels -> labels | |
| 2025-06-24T04:07:52.6681338Z metadata.annotations -> annotations | |
| 2025-06-24T04:07:52.6681735Z istio-token: | |
| 2025-06-24T04:07:52.6682250Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T04:07:52.6682897Z TokenExpirationSeconds: 43200 | |
| 2025-06-24T04:07:52.6683297Z istiod-ca-cert: | |
| 2025-06-24T04:07:52.6683754Z Type: ConfigMap (a volume populated by a ConfigMap) | |
| 2025-06-24T04:07:52.6684271Z Name: istio-ca-root-cert | |
| 2025-06-24T04:07:52.6684647Z Optional: false | |
| 2025-06-24T04:07:52.6684979Z kube-api-access-bl564: | |
| 2025-06-24T04:07:52.6685757Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T04:07:52.6686417Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T04:07:52.6686827Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T04:07:52.6687276Z ConfigMapOptional: <nil> | |
| 2025-06-24T04:07:52.6687664Z DownwardAPI: true | |
| 2025-06-24T04:07:52.6688032Z QoS Class: Burstable | |
| 2025-06-24T04:07:52.6688412Z Node-Selectors: <none> | |
| 2025-06-24T04:07:52.6688983Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T04:07:52.6689702Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T04:07:52.6690397Z Events: | |
| 2025-06-24T04:07:52.6690714Z Type Reason Age From Message | |
| 2025-06-24T04:07:52.6691184Z ---- ------ ---- ---- ------- | |
| 2025-06-24T04:07:52.6692477Z Normal Scheduled 28s default-scheduler Successfully assigned llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx to chart-testing-control-plane | |
| 2025-06-24T04:07:52.6694401Z Normal Pulled 27s kubelet Container image "gcr.io/istio-testing/proxyv2:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d" already present on machine | |
| 2025-06-24T04:07:52.6695879Z Normal Created 27s kubelet Created container istio-proxy | |
| 2025-06-24T04:07:52.6696608Z Normal Started 27s kubelet Started container istio-proxy | |
| 2025-06-24T04:07:52.6697353Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:52.6698163Z <== Description of pod llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx | |
| 2025-06-24T04:07:52.6698947Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:52.6700842Z >>> kubectl --request-timeout=30s get pods llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx --no-headers --namespace llm-d-x3wixbo1ie --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T04:07:52.7178385Z >>> kubectl --request-timeout=30s get pods llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx --no-headers --namespace llm-d-x3wixbo1ie --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T04:07:52.7697266Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:52.7698339Z ==> Logs of container llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx | |
| 2025-06-24T04:07:52.7699140Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:52.7700333Z >>> kubectl --request-timeout=30s logs llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx --namespace llm-d-x3wixbo1ie --container istio-proxy | |
| 2025-06-24T04:07:52.8293588Z 2025-06-24T04:07:25.157508Z info FLAG: --concurrency="0" | |
| 2025-06-24T04:07:52.8294443Z 2025-06-24T04:07:25.157560Z info FLAG: --domain="llm-d-x3wixbo1ie.svc.cluster.local" | |
| 2025-06-24T04:07:52.8294938Z 2025-06-24T04:07:25.157568Z info FLAG: --help="false" | |
| 2025-06-24T04:07:52.8295277Z 2025-06-24T04:07:25.157587Z info FLAG: --log_as_json="false" | |
| 2025-06-24T04:07:52.8295607Z 2025-06-24T04:07:25.157591Z info FLAG: --log_caller="" | |
| 2025-06-24T04:07:52.8295942Z 2025-06-24T04:07:25.157595Z info FLAG: --log_output_level="default:info" | |
| 2025-06-24T04:07:52.8296340Z 2025-06-24T04:07:25.157604Z info FLAG: --log_stacktrace_level="default:none" | |
| 2025-06-24T04:07:52.8296706Z 2025-06-24T04:07:25.157619Z info FLAG: --log_target="[stdout]" | |
| 2025-06-24T04:07:52.8297072Z 2025-06-24T04:07:25.157624Z info FLAG: --meshConfig="./etc/istio/config/mesh" | |
| 2025-06-24T04:07:52.8297429Z 2025-06-24T04:07:25.157628Z info FLAG: --outlierLogPath="" | |
| 2025-06-24T04:07:52.8297891Z 2025-06-24T04:07:25.157636Z info FLAG: --profiling="true" | |
| 2025-06-24T04:07:52.8298512Z 2025-06-24T04:07:25.157640Z info FLAG: --proxyComponentLogLevel="misc:error" | |
| 2025-06-24T04:07:52.8299474Z 2025-06-24T04:07:25.157644Z info FLAG: --proxyLogLevel="warning" | |
| 2025-06-24T04:07:52.8300236Z 2025-06-24T04:07:25.157648Z info FLAG: --serviceCluster="istio-proxy" | |
| 2025-06-24T04:07:52.8300769Z 2025-06-24T04:07:25.157652Z info FLAG: --stsPort="0" | |
| 2025-06-24T04:07:52.8301260Z 2025-06-24T04:07:25.157659Z info FLAG: --templateFile="" | |
| 2025-06-24T04:07:52.8301789Z 2025-06-24T04:07:25.157663Z info FLAG: --tokenManagerPlugin="" | |
| 2025-06-24T04:07:52.8302389Z 2025-06-24T04:07:25.157668Z info FLAG: --vklog="0" | |
| 2025-06-24T04:07:52.8303337Z 2025-06-24T04:07:25.157673Z info Version 1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d-9befed2f1439d883120f8de70fd70d84ca0ebc3d-Clean | |
| 2025-06-24T04:07:52.8304408Z 2025-06-24T04:07:25.157683Z info Set max file descriptors (ulimit -n) to: 1048576 | |
| 2025-06-24T04:07:52.8305742Z 2025-06-24T04:07:25.157944Z info Proxy role ips=[10.244.0.21] type=router id=llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx.llm-d-x3wixbo1ie domain=llm-d-x3wixbo1ie.svc.cluster.local | |
| 2025-06-24T04:07:52.8306986Z 2025-06-24T04:07:25.158033Z info Apply proxy config from env {} | |
| 2025-06-24T04:07:52.8307351Z | |
| 2025-06-24T04:07:52.8307621Z 2025-06-24T04:07:25.160464Z info cpu limit detected as 2, setting concurrency | |
| 2025-06-24T04:07:52.8308542Z 2025-06-24T04:07:25.160750Z info Effective config: binaryPath: /usr/local/bin/envoy | |
| 2025-06-24T04:07:52.8309100Z concurrency: 2 | |
| 2025-06-24T04:07:52.8309395Z configPath: ./etc/istio/proxy | |
| 2025-06-24T04:07:52.8309754Z controlPlaneAuthPolicy: MUTUAL_TLS | |
| 2025-06-24T04:07:52.8310338Z discoveryAddress: istiod.istio-system.svc:15012 | |
| 2025-06-24T04:07:52.8310764Z drainDuration: 45s | |
| 2025-06-24T04:07:52.8311060Z proxyAdminPort: 15000 | |
| 2025-06-24T04:07:52.8311382Z serviceCluster: istio-proxy | |
| 2025-06-24T04:07:52.8311706Z statNameLength: 189 | |
| 2025-06-24T04:07:52.8311984Z statusPort: 15020 | |
| 2025-06-24T04:07:52.8312287Z terminationDrainDuration: 5s | |
| 2025-06-24T04:07:52.8312519Z | |
| 2025-06-24T04:07:52.8312746Z 2025-06-24T04:07:25.160801Z info JWT policy is third-party-jwt | |
| 2025-06-24T04:07:52.8313489Z 2025-06-24T04:07:25.160827Z info using credential fetcher of JWT type in cluster.local trust domain | |
| 2025-06-24T04:07:52.8314219Z 2025-06-24T04:07:25.161267Z info platform detected is Azure | |
| 2025-06-24T04:07:52.8314781Z 2025-06-24T04:07:25.175326Z info Starting default Istio SDS Server | |
| 2025-06-24T04:07:52.8315511Z 2025-06-24T04:07:25.175417Z info CA Endpoint istiod.istio-system.svc:15012, provider Citadel | |
| 2025-06-24T04:07:52.8316541Z 2025-06-24T04:07:25.175468Z info Using CA istiod.istio-system.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem | |
| 2025-06-24T04:07:52.8317391Z 2025-06-24T04:07:25.175653Z info Opening status port 15020 | |
| 2025-06-24T04:07:52.8318273Z 2025-06-24T04:07:25.176724Z info xdsproxy Initializing with upstream address "istiod.istio-system.svc:15012" and cluster "Kubernetes" | |
| 2025-06-24T04:07:52.8319185Z 2025-06-24T04:07:25.178014Z info sds Starting SDS grpc server | |
| 2025-06-24T04:07:52.8320258Z 2025-06-24T04:07:25.178039Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" | |
| 2025-06-24T04:07:52.8321284Z 2025-06-24T04:07:25.182163Z info Pilot SAN: [istiod.istio-system.svc] | |
| 2025-06-24T04:07:52.8321871Z 2025-06-24T04:07:25.186898Z info Starting proxy agent | |
| 2025-06-24T04:07:52.8323796Z 2025-06-24T04:07:25.187053Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] | |
| 2025-06-24T04:07:52.8327211Z 2025-06-24T04:07:25.247687Z warning envoy main external/envoy/source/server/server.cc:874 Usage of the deprecated runtime key overload.global_downstream_max_connections, consider switching to `envoy.resource_monitors.global_downstream_max_connections` instead.This runtime key will be removed in future. thread=20 | |
| 2025-06-24T04:07:52.8330693Z 2025-06-24T04:07:25.248005Z warning envoy main external/envoy/source/server/server.cc:970 There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. thread=20 | |
| 2025-06-24T04:07:52.8332132Z 2025-06-24T04:07:25.252631Z info xdsproxy connected to delta upstream XDS server: istiod.istio-system.svc:15012 id=1 | |
| 2025-06-24T04:07:52.8332765Z 2025-06-24T04:07:25.274651Z info ads ADS: new connection for node:1 | |
| 2025-06-24T04:07:52.8333138Z 2025-06-24T04:07:25.275120Z info ads ADS: new connection for node:2 | |
| 2025-06-24T04:07:52.8333822Z 2025-06-24T04:07:25.287113Z info cache generated new workload certificate resourceName=default latency=108.981004ms ttl=23h59m59.712890772s | |
| 2025-06-24T04:07:52.8334559Z 2025-06-24T04:07:25.287548Z info cache Root cert has changed, start rotating root cert | |
| 2025-06-24T04:07:52.8335185Z 2025-06-24T04:07:25.287585Z info cache returned workload trust anchor from cache ttl=23h59m59.712415775s | |
| 2025-06-24T04:07:52.8335844Z 2025-06-24T04:07:25.287629Z info cache returned workload certificate from cache ttl=23h59m59.712372134s | |
| 2025-06-24T04:07:52.8336398Z 2025-06-24T04:07:25.287787Z info cache returned workload trust anchor from cache ttl=23h59m59.712215707s | |
| 2025-06-24T04:07:52.8337311Z 2025-06-24T04:07:25.288041Z info cache returned workload trust anchor from cache ttl=23h59m59.711960254s | |
| 2025-06-24T04:07:52.8338019Z 2025-06-24T04:07:26.946344Z info Readiness succeeded in 1.790879831s | |
| 2025-06-24T04:07:52.8338556Z 2025-06-24T04:07:26.946672Z info Envoy proxy is ready | |
| 2025-06-24T04:07:52.8338946Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:52.8339525Z <== Logs of container llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx | |
| 2025-06-24T04:07:52.8340187Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:52.8340597Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:52.8341124Z ==> Description of pod llm-d-x3wixbo1ie-modelservice-7d8df699d6-zq2fj | |
| 2025-06-24T04:07:52.8341568Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:52.8342185Z >>> kubectl --request-timeout=30s describe pod llm-d-x3wixbo1ie-modelservice-7d8df699d6-zq2fj --namespace llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:52.8945308Z Name: llm-d-x3wixbo1ie-modelservice-7d8df699d6-zq2fj | |
| 2025-06-24T04:07:52.8945903Z Namespace: llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:52.8946132Z Priority: 0 | |
| 2025-06-24T04:07:52.8946429Z Service Account: llm-d-x3wixbo1ie-llm-d-x3wixbo1ie-modelservice | |
| 2025-06-24T04:07:52.8946808Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T04:07:52.8947109Z Start Time: Tue, 24 Jun 2025 04:07:24 +0000 | |
| 2025-06-24T04:07:52.8947439Z Labels: app.kubernetes.io/component=modelservice | |
| 2025-06-24T04:07:52.8947902Z app.kubernetes.io/instance=llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:52.8948183Z app.kubernetes.io/managed-by=Helm | |
| 2025-06-24T04:07:52.8948438Z app.kubernetes.io/name=llm-d | |
| 2025-06-24T04:07:52.8948703Z app.kubernetes.io/version=0.1 | |
| 2025-06-24T04:07:52.8948962Z control-plane=controller-manager | |
| 2025-06-24T04:07:52.8949216Z helm.sh/chart=llm-d-1.0.21 | |
| 2025-06-24T04:07:52.8949462Z pod-template-hash=7d8df699d6 | |
| 2025-06-24T04:07:52.8949693Z Annotations: <none> | |
| 2025-06-24T04:07:52.8950201Z Status: Running | |
| 2025-06-24T04:07:52.8950411Z SeccompProfile: RuntimeDefault | |
| 2025-06-24T04:07:52.8950629Z IP: 10.244.0.20 | |
| 2025-06-24T04:07:52.8950808Z IPs: | |
| 2025-06-24T04:07:52.8950960Z IP: 10.244.0.20 | |
| 2025-06-24T04:07:52.8951248Z Controlled By: ReplicaSet/llm-d-x3wixbo1ie-modelservice-7d8df699d6 | |
| 2025-06-24T04:07:52.8951880Z Containers: | |
| 2025-06-24T04:07:52.8952046Z manager: | |
| 2025-06-24T04:07:52.8952405Z Container ID: containerd://cc9f58298a5c650dd3a72e8e735272e8930290d22651b265383226b91bffc6ed | |
| 2025-06-24T04:07:52.8952901Z Image: ghcr.io/llm-d/llm-d-model-service:0.0.10 | |
| 2025-06-24T04:07:52.8953417Z Image ID: ghcr.io/llm-d/llm-d-model-service@sha256:4d38789615184aa173eaf0c085ecd7f3dc0f3970af5e97ecb4b25fdfcf54b82e | |
| 2025-06-24T04:07:52.8953879Z Port: <none> | |
| 2025-06-24T04:07:52.8954070Z Host Port: <none> | |
| 2025-06-24T04:07:52.8954251Z Command: | |
| 2025-06-24T04:07:52.8954404Z /manager | |
| 2025-06-24T04:07:52.8954550Z Args: | |
| 2025-06-24T04:07:52.8954716Z --leader-elect=false | |
| 2025-06-24T04:07:52.8954934Z --health-probe-bind-address=:8081 | |
| 2025-06-24T04:07:52.8955183Z --epp-cluster-role | |
| 2025-06-24T04:07:52.8955426Z llm-d-x3wixbo1ie-modelservice-endpoint-picker | |
| 2025-06-24T04:07:52.8955699Z --epp-pull-secrets | |
| 2025-06-24T04:07:52.8955871Z | |
| 2025-06-24T04:07:52.8956041Z --pd-pull-secrets | |
| 2025-06-24T04:07:52.8956215Z | |
| 2025-06-24T04:07:52.8956367Z State: Running | |
| 2025-06-24T04:07:52.8956579Z Started: Tue, 24 Jun 2025 04:07:25 +0000 | |
| 2025-06-24T04:07:52.8956981Z Ready: True | |
| 2025-06-24T04:07:52.8957164Z Restart Count: 0 | |
| 2025-06-24T04:07:52.8957328Z Limits: | |
| 2025-06-24T04:07:52.8957480Z cpu: 250m | |
| 2025-06-24T04:07:52.8957641Z memory: 250Mi | |
| 2025-06-24T04:07:52.8957810Z Requests: | |
| 2025-06-24T04:07:52.8957967Z cpu: 100m | |
| 2025-06-24T04:07:52.8958140Z memory: 100Mi | |
| 2025-06-24T04:07:52.8958478Z Liveness: http-get http://:8081/healthz delay=15s timeout=1s period=20s #success=1 #failure=3 | |
| 2025-06-24T04:07:52.8959027Z Readiness: http-get http://:8081/readyz delay=5s timeout=1s period=10s #success=1 #failure=3 | |
| 2025-06-24T04:07:52.8959410Z Environment: <none> | |
| 2025-06-24T04:07:52.8959588Z Mounts: | |
| 2025-06-24T04:07:52.8960103Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-4snv7 (ro) | |
| 2025-06-24T04:07:52.8960465Z Conditions: | |
| 2025-06-24T04:07:52.8960632Z Type Status | |
| 2025-06-24T04:07:52.8960867Z PodReadyToStartContainers True | |
| 2025-06-24T04:07:52.8961102Z Initialized True | |
| 2025-06-24T04:07:52.8961306Z Ready True | |
| 2025-06-24T04:07:52.8961517Z ContainersReady True | |
| 2025-06-24T04:07:52.8961732Z PodScheduled True | |
| 2025-06-24T04:07:52.8961924Z Volumes: | |
| 2025-06-24T04:07:52.8962088Z kube-api-access-4snv7: | |
| 2025-06-24T04:07:52.8962413Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T04:07:52.8962776Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T04:07:52.8963021Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T04:07:52.8963277Z ConfigMapOptional: <nil> | |
| 2025-06-24T04:07:52.8963497Z DownwardAPI: true | |
| 2025-06-24T04:07:52.8963719Z QoS Class: Burstable | |
| 2025-06-24T04:07:52.8963948Z Node-Selectors: <none> | |
| 2025-06-24T04:07:52.8964270Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T04:07:52.8964689Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T04:07:52.8964984Z Events: | |
| 2025-06-24T04:07:52.8965280Z Type Reason Age From Message | |
| 2025-06-24T04:07:52.8965740Z ---- ------ ---- ---- ------- | |
| 2025-06-24T04:07:52.8966890Z Normal Scheduled 28s default-scheduler Successfully assigned llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-modelservice-7d8df699d6-zq2fj to chart-testing-control-plane | |
| 2025-06-24T04:07:52.8968254Z Normal Pulling 28s kubelet Pulling image "ghcr.io/llm-d/llm-d-model-service:0.0.10" | |
| 2025-06-24T04:07:52.8969972Z Normal Pulled 27s kubelet Successfully pulled image "ghcr.io/llm-d/llm-d-model-service:0.0.10" in 150ms (150ms including waiting). Image size: 115030935 bytes. | |
| 2025-06-24T04:07:52.8971476Z Normal Created 27s kubelet Created container manager | |
| 2025-06-24T04:07:52.8972167Z Normal Started 27s kubelet Started container manager | |
| 2025-06-24T04:07:52.8974016Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:52.8974768Z <== Description of pod llm-d-x3wixbo1ie-modelservice-7d8df699d6-zq2fj | |
| 2025-06-24T04:07:52.8975473Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:52.8976825Z >>> kubectl --request-timeout=30s get pods llm-d-x3wixbo1ie-modelservice-7d8df699d6-zq2fj --no-headers --namespace llm-d-x3wixbo1ie --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T04:07:52.9555000Z >>> kubectl --request-timeout=30s get pods llm-d-x3wixbo1ie-modelservice-7d8df699d6-zq2fj --no-headers --namespace llm-d-x3wixbo1ie --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T04:07:53.0143630Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:53.0144719Z ==> Logs of container llm-d-x3wixbo1ie-modelservice-7d8df699d6-zq2fj | |
| 2025-06-24T04:07:53.0145986Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:53.0146829Z >>> kubectl --request-timeout=30s logs llm-d-x3wixbo1ie-modelservice-7d8df699d6-zq2fj --namespace llm-d-x3wixbo1ie --container manager | |
| 2025-06-24T04:07:53.0732781Z {"level":"info","ts":"2025-06-24T04:07:25.490407727Z","logger":"setup","caller":"cmd/root.go:272","msg":"starting manager"} | |
| 2025-06-24T04:07:53.0734339Z {"level":"info","ts":"2025-06-24T04:07:25.490735079Z","caller":"manager/server.go:83","msg":"starting server","name":"health probe","addr":"[::]:8081"} | |
| 2025-06-24T04:07:53.0737117Z {"level":"info","ts":"2025-06-24T04:07:25.490947095Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1.Deployment"} | |
| 2025-06-24T04:07:53.0739430Z {"level":"info","ts":"2025-06-24T04:07:25.491166785Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1alpha1.ModelService"} | |
| 2025-06-24T04:07:53.0741893Z {"level":"info","ts":"2025-06-24T04:07:25.490946018Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1.ServiceAccount"} | |
| 2025-06-24T04:07:53.0744087Z {"level":"info","ts":"2025-06-24T04:07:25.491012719Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1.Service"} | |
| 2025-06-24T04:07:53.0746304Z {"level":"info","ts":"2025-06-24T04:07:25.491023402Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1alpha2.InferenceModel"} | |
| 2025-06-24T04:07:53.0748534Z {"level":"info","ts":"2025-06-24T04:07:25.490941727Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1.ConfigMap"} | |
| 2025-06-24T04:07:53.0750942Z {"level":"info","ts":"2025-06-24T04:07:25.491047978Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1alpha2.InferencePool"} | |
| 2025-06-24T04:07:53.0753579Z {"level":"info","ts":"2025-06-24T04:07:25.491101375Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1.RoleBinding"} | |
| 2025-06-24T04:07:53.0756067Z {"level":"info","ts":"2025-06-24T04:07:25.491105556Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1alpha1.ModelService"} | |
| 2025-06-24T04:07:53.0758474Z {"level":"info","ts":"2025-06-24T04:07:25.59939805Z","caller":"controller/controller.go:239","msg":"Starting Controller","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService"} | |
| 2025-06-24T04:07:53.0760667Z {"level":"info","ts":"2025-06-24T04:07:25.599432765Z","caller":"controller/controller.go:248","msg":"Starting workers","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","worker count":1} | |
| 2025-06-24T04:07:53.0765229Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:53.0767245Z <== Logs of container llm-d-x3wixbo1ie-modelservice-7d8df699d6-zq2fj | |
| 2025-06-24T04:07:53.0768868Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:53.0771889Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:53.0772619Z ==> Description of pod llm-d-x3wixbo1ie-redis-master-685645794-296zz | |
| 2025-06-24T04:07:53.0773322Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:53.0774331Z >>> kubectl --request-timeout=30s describe pod llm-d-x3wixbo1ie-redis-master-685645794-296zz --namespace llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:53.1363507Z Name: llm-d-x3wixbo1ie-redis-master-685645794-296zz | |
| 2025-06-24T04:07:53.1364051Z Namespace: llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:53.1364444Z Priority: 0 | |
| 2025-06-24T04:07:53.1364803Z Service Account: llm-d-x3wixbo1ie-redis-master | |
| 2025-06-24T04:07:53.1365334Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T04:07:53.1365792Z Start Time: Tue, 24 Jun 2025 04:06:32 +0000 | |
| 2025-06-24T04:07:53.1366261Z Labels: app.kubernetes.io/component=master | |
| 2025-06-24T04:07:53.1366730Z app.kubernetes.io/instance=llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:53.1367227Z app.kubernetes.io/managed-by=Helm | |
| 2025-06-24T04:07:53.1367635Z app.kubernetes.io/name=redis | |
| 2025-06-24T04:07:53.1368042Z app.kubernetes.io/version=7.4.3 | |
| 2025-06-24T04:07:53.1368440Z helm.sh/chart=redis-20.13.4 | |
| 2025-06-24T04:07:53.1368850Z pod-template-hash=685645794 | |
| 2025-06-24T04:07:53.1369660Z Annotations: checksum/configmap: 2a9ab4a5432825504d910f022638674ce88eaefe9f9f595ad8bc107377d104fb | |
| 2025-06-24T04:07:53.1370870Z checksum/health: aff24913d801436ea469d8d374b2ddb3ec4c43ee7ab24663d5f8ff1a1b6991a9 | |
| 2025-06-24T04:07:53.1371739Z checksum/scripts: bdec350b84a1ace7cc118db113a21c9f160bde3425b07714e1c0c1da722621cf | |
| 2025-06-24T04:07:53.1372603Z checksum/secret: 44136fa355b3678a1146ad16f7e8649e94fb4fc21fe77e8310c060f61caaff8a | |
| 2025-06-24T04:07:53.1373211Z Status: Running | |
| 2025-06-24T04:07:53.1373515Z IP: 10.244.0.14 | |
| 2025-06-24T04:07:53.1373820Z IPs: | |
| 2025-06-24T04:07:53.1374056Z IP: 10.244.0.14 | |
| 2025-06-24T04:07:53.1374536Z Controlled By: ReplicaSet/llm-d-x3wixbo1ie-redis-master-685645794 | |
| 2025-06-24T04:07:53.1375057Z Containers: | |
| 2025-06-24T04:07:53.1375307Z redis: | |
| 2025-06-24T04:07:53.1375904Z Container ID: containerd://041c6f2b1f7b69c50ba7a3cebe1473dc02beff728da696cbd51ff87827058aae | |
| 2025-06-24T04:07:53.1376657Z Image: quay.io/sclorg/redis-7-c9s:c9s | |
| 2025-06-24T04:07:53.1377869Z Image ID: quay.io/sclorg/redis-7-c9s@sha256:d772acab11507231a2b152850f47c8b9b859dedb6652ca624949e97cb28c5e6f | |
| 2025-06-24T04:07:53.1378615Z Port: 6379/TCP | |
| 2025-06-24T04:07:53.1378946Z Host Port: 0/TCP | |
| 2025-06-24T04:07:53.1379284Z SeccompProfile: RuntimeDefault | |
| 2025-06-24T04:07:53.1379639Z Command: | |
| 2025-06-24T04:07:53.1380027Z /bin/bash | |
| 2025-06-24T04:07:53.1380282Z Args: | |
| 2025-06-24T04:07:53.1380516Z -ec | |
| 2025-06-24T04:07:53.1380850Z /opt/bitnami/scripts/start-scripts/start-master.sh | |
| 2025-06-24T04:07:53.1396416Z State: Running | |
| 2025-06-24T04:07:53.1396861Z Started: Tue, 24 Jun 2025 04:06:37 +0000 | |
| 2025-06-24T04:07:53.1397284Z Ready: True | |
| 2025-06-24T04:07:53.1397591Z Restart Count: 0 | |
| 2025-06-24T04:07:53.1397921Z Limits: | |
| 2025-06-24T04:07:53.1398150Z cpu: 250m | |
| 2025-06-24T04:07:53.1398421Z memory: 256Mi | |
| 2025-06-24T04:07:53.1398687Z Requests: | |
| 2025-06-24T04:07:53.1398939Z cpu: 100m | |
| 2025-06-24T04:07:53.1399213Z memory: 128Mi | |
| 2025-06-24T04:07:53.1400120Z Liveness: exec [/bin/bash -ec /health/ping_liveness_local.sh 5] delay=20s timeout=6s period=5s #success=1 #failure=5 | |
| 2025-06-24T04:07:53.1401295Z Readiness: exec [/bin/bash -ec /health/ping_readiness_local.sh 1] delay=20s timeout=2s period=5s #success=1 #failure=5 | |
| 2025-06-24T04:07:53.1402435Z Environment: | |
| 2025-06-24T04:07:53.1402768Z BITNAMI_DEBUG: false | |
| 2025-06-24T04:07:53.1403167Z REDIS_REPLICATION_MODE: master | |
| 2025-06-24T04:07:53.1403565Z ALLOW_EMPTY_PASSWORD: yes | |
| 2025-06-24T04:07:53.1403955Z REDIS_TLS_ENABLED: no | |
| 2025-06-24T04:07:53.1404326Z REDIS_PORT: 6379 | |
| 2025-06-24T04:07:53.1404671Z Mounts: | |
| 2025-06-24T04:07:53.1404950Z /data from redis-data (rw) | |
| 2025-06-24T04:07:53.1405315Z /health from health (rw) | |
| 2025-06-24T04:07:53.1405851Z /opt/bitnami/redis/etc/ from empty-dir (rw,path="app-conf-dir") | |
| 2025-06-24T04:07:53.1406461Z /opt/bitnami/redis/mounted-etc from config (rw) | |
| 2025-06-24T04:07:53.1407053Z /opt/bitnami/scripts/start-scripts from start-scripts (rw) | |
| 2025-06-24T04:07:53.1407624Z /tmp from empty-dir (rw,path="tmp-dir") | |
| 2025-06-24T04:07:53.1408036Z Conditions: | |
| 2025-06-24T04:07:53.1408321Z Type Status | |
| 2025-06-24T04:07:53.1408737Z PodReadyToStartContainers True | |
| 2025-06-24T04:07:53.1409143Z Initialized True | |
| 2025-06-24T04:07:53.1409498Z Ready True | |
| 2025-06-24T04:07:53.1410070Z ContainersReady True | |
| 2025-06-24T04:07:53.1410466Z PodScheduled True | |
| 2025-06-24T04:07:53.1410818Z Volumes: | |
| 2025-06-24T04:07:53.1411089Z start-scripts: | |
| 2025-06-24T04:07:53.1411471Z Type: ConfigMap (a volume populated by a ConfigMap) | |
| 2025-06-24T04:07:53.1411878Z Name: llm-d-x3wixbo1ie-redis-scripts | |
| 2025-06-24T04:07:53.1412231Z Optional: false | |
| 2025-06-24T04:07:53.1412536Z health: | |
| 2025-06-24T04:07:53.1412872Z Type: ConfigMap (a volume populated by a ConfigMap) | |
| 2025-06-24T04:07:53.1413393Z Name: llm-d-x3wixbo1ie-redis-health | |
| 2025-06-24T04:07:53.1413807Z Optional: false | |
| 2025-06-24T04:07:53.1414091Z config: | |
| 2025-06-24T04:07:53.1414452Z Type: ConfigMap (a volume populated by a ConfigMap) | |
| 2025-06-24T04:07:53.1415011Z Name: llm-d-x3wixbo1ie-redis-configuration | |
| 2025-06-24T04:07:53.1415451Z Optional: false | |
| 2025-06-24T04:07:53.1415751Z empty-dir: | |
| 2025-06-24T04:07:53.1416189Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T04:07:53.1416738Z Medium: | |
| 2025-06-24T04:07:53.1417041Z SizeLimit: <unset> | |
| 2025-06-24T04:07:53.1417372Z redis-data: | |
| 2025-06-24T04:07:53.1417716Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T04:07:53.1418210Z Medium: | |
| 2025-06-24T04:07:53.1418440Z SizeLimit: <unset> | |
| 2025-06-24T04:07:53.1418650Z QoS Class: Burstable | |
| 2025-06-24T04:07:53.1418962Z Node-Selectors: <none> | |
| 2025-06-24T04:07:53.1420022Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T04:07:53.1421076Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T04:07:53.1421641Z Events: | |
| 2025-06-24T04:07:53.1421974Z Type Reason Age From Message | |
| 2025-06-24T04:07:53.1422410Z ---- ------ ---- ---- ------- | |
| 2025-06-24T04:07:53.1423253Z Normal Scheduled 81s default-scheduler Successfully assigned llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-redis-master-685645794-296zz to chart-testing-control-plane | |
| 2025-06-24T04:07:53.1424238Z Normal Pulling 80s kubelet Pulling image "quay.io/sclorg/redis-7-c9s:c9s" | |
| 2025-06-24T04:07:53.1425218Z Normal Pulled 77s kubelet Successfully pulled image "quay.io/sclorg/redis-7-c9s:c9s" in 3.738s (3.739s including waiting). Image size: 97229638 bytes. | |
| 2025-06-24T04:07:53.1426068Z Normal Created 77s kubelet Created container redis | |
| 2025-06-24T04:07:53.1426452Z Normal Started 76s kubelet Started container redis | |
| 2025-06-24T04:07:53.1426928Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:53.1427329Z <== Description of pod llm-d-x3wixbo1ie-redis-master-685645794-296zz | |
| 2025-06-24T04:07:53.1428033Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:53.1428890Z >>> kubectl --request-timeout=30s get pods llm-d-x3wixbo1ie-redis-master-685645794-296zz --no-headers --namespace llm-d-x3wixbo1ie --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T04:07:53.1959214Z >>> kubectl --request-timeout=30s get pods llm-d-x3wixbo1ie-redis-master-685645794-296zz --no-headers --namespace llm-d-x3wixbo1ie --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T04:07:53.2471624Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:53.2472551Z ==> Logs of container llm-d-x3wixbo1ie-redis-master-685645794-296zz | |
| 2025-06-24T04:07:53.2476600Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:53.2478202Z >>> kubectl --request-timeout=30s logs llm-d-x3wixbo1ie-redis-master-685645794-296zz --namespace llm-d-x3wixbo1ie --container redis | |
| 2025-06-24T04:07:53.3106764Z 1:C 24 Jun 2025 04:06:37.186 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo | |
| 2025-06-24T04:07:53.3111802Z 1:C 24 Jun 2025 04:06:37.186 # Redis version=7.0.12, bits=64, commit=00000000, modified=0, pid=1, just started | |
| 2025-06-24T04:07:53.3112499Z 1:C 24 Jun 2025 04:06:37.186 # Configuration loaded | |
| 2025-06-24T04:07:53.3112839Z 1:M 24 Jun 2025 04:06:37.187 * monotonic clock: POSIX clock_gettime | |
| 2025-06-24T04:07:53.3113198Z 1:M 24 Jun 2025 04:06:37.187 * Running mode=standalone, port=6379. | |
| 2025-06-24T04:07:53.3113495Z 1:M 24 Jun 2025 04:06:37.187 # Server initialized | |
| 2025-06-24T04:07:53.3114171Z 1:M 24 Jun 2025 04:06:37.244 * Creating AOF base file appendonly.aof.1.base.rdb on server start | |
| 2025-06-24T04:07:53.3114647Z 1:M 24 Jun 2025 04:06:37.246 * Creating AOF incr file appendonly.aof.1.incr.aof on server start | |
| 2025-06-24T04:07:53.3115023Z 1:M 24 Jun 2025 04:06:37.246 * Ready to accept connections | |
| 2025-06-24T04:07:53.3129579Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:53.3130548Z <== Logs of container llm-d-x3wixbo1ie-redis-master-685645794-296zz | |
| 2025-06-24T04:07:53.3131145Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:53.3131574Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:53.3131941Z ==> Description of pod llm-d-x3wixbo1ie-test-connection | |
| 2025-06-24T04:07:53.3132579Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:53.3133121Z >>> kubectl --request-timeout=30s describe pod llm-d-x3wixbo1ie-test-connection --namespace llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:53.3688574Z Name: llm-d-x3wixbo1ie-test-connection | |
| 2025-06-24T04:07:53.3689152Z Namespace: llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:53.3689497Z Priority: 0 | |
| 2025-06-24T04:07:53.3689703Z Service Account: default | |
| 2025-06-24T04:07:53.3690306Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T04:07:53.3690620Z Start Time: Tue, 24 Jun 2025 04:07:38 +0000 | |
| 2025-06-24T04:07:53.3690877Z Labels: <none> | |
| 2025-06-24T04:07:53.3691083Z Annotations: helm.sh/hook: test | |
| 2025-06-24T04:07:53.3691326Z helm.sh/hook-weight: 1 | |
| 2025-06-24T04:07:53.3691560Z Status: Succeeded | |
| 2025-06-24T04:07:53.3691779Z SeccompProfile: RuntimeDefault | |
| 2025-06-24T04:07:53.3691995Z IP: 10.244.0.23 | |
| 2025-06-24T04:07:53.3692206Z IPs: | |
| 2025-06-24T04:07:53.3692366Z IP: 10.244.0.23 | |
| 2025-06-24T04:07:53.3692548Z Containers: | |
| 2025-06-24T04:07:53.3692697Z curl: | |
| 2025-06-24T04:07:53.3693291Z Container ID: containerd://2dfb393f1e96f80caed6dfb9fcbe30b6e9367688c0b857f8a05831798a730e17 | |
| 2025-06-24T04:07:53.3694114Z Image: quay.io/curl/curl:latest | |
| 2025-06-24T04:07:53.3694544Z Image ID: quay.io/curl/curl@sha256:f95026f35f8e40ca1c11738a1c5710baadf4b8cafabab9738dadbf9fb99084a9 | |
| 2025-06-24T04:07:53.3694960Z Port: <none> | |
| 2025-06-24T04:07:53.3695155Z Host Port: <none> | |
| 2025-06-24T04:07:53.3695335Z Command: | |
| 2025-06-24T04:07:53.3695484Z /bin/sh | |
| 2025-06-24T04:07:53.3695643Z -c | |
| 2025-06-24T04:07:53.3695786Z Args: | |
| 2025-06-24T04:07:53.3696273Z echo -e "\e[32m🥷 Waiting for pods to come up\e[0m" | |
| 2025-06-24T04:07:53.3696533Z echo "" | |
| 2025-06-24T04:07:53.3697100Z curl --connect-timeout 5 --max-time 20 --retry 20 --retry-delay 10 --retry-max-time 60 --retry-all-errors http://llm-d-x3wixbo1ie-inference-gateway-istio/v1/models | |
| 2025-06-24T04:07:53.3697685Z | |
| 2025-06-24T04:07:53.3697827Z echo "" | |
| 2025-06-24T04:07:53.3697975Z echo "" | |
| 2025-06-24T04:07:53.3698221Z echo -e "\e[32m🥷 Basic chat validation\e[0m" | |
| 2025-06-24T04:07:53.3698478Z echo "" | |
| 2025-06-24T04:07:53.3699041Z curl --connect-timeout 5 --max-time 20 --retry 20 --retry-delay 10 --retry-max-time 60 --retry-all-errors http://llm-d-x3wixbo1ie-inference-gateway-istio/v1/chat/completions \ | |
| 2025-06-24T04:07:53.3699689Z -H 'accept: application/json' \ | |
| 2025-06-24T04:07:53.3700147Z -H 'Content-Type: application/json' \ | |
| 2025-06-24T04:07:53.3700515Z -d '{"model":"food-review","messages":[{"content":"Say hi","role":"user"}],"stream":false}' | |
| 2025-06-24T04:07:53.3700858Z | |
| 2025-06-24T04:07:53.3701012Z State: Terminated | |
| 2025-06-24T04:07:53.3701222Z Reason: Completed | |
| 2025-06-24T04:07:53.3701416Z Exit Code: 0 | |
| 2025-06-24T04:07:53.3701627Z Started: Tue, 24 Jun 2025 04:07:49 +0000 | |
| 2025-06-24T04:07:53.3701890Z Finished: Tue, 24 Jun 2025 04:07:51 +0000 | |
| 2025-06-24T04:07:53.3702122Z Ready: False | |
| 2025-06-24T04:07:53.3702316Z Restart Count: 0 | |
| 2025-06-24T04:07:53.3702483Z Limits: | |
| 2025-06-24T04:07:53.3702646Z cpu: 10m | |
| 2025-06-24T04:07:53.3702805Z memory: 20Mi | |
| 2025-06-24T04:07:53.3702999Z Requests: | |
| 2025-06-24T04:07:53.3703150Z cpu: 10m | |
| 2025-06-24T04:07:53.3703323Z memory: 20Mi | |
| 2025-06-24T04:07:53.3703745Z Liveness: exec [ls /usr/bin/curl] delay=0s timeout=1s period=10s #success=1 #failure=3 | |
| 2025-06-24T04:07:53.3704219Z Environment: <none> | |
| 2025-06-24T04:07:53.3704402Z Mounts: | |
| 2025-06-24T04:07:53.3704694Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-tl8lk (ro) | |
| 2025-06-24T04:07:53.3705055Z Conditions: | |
| 2025-06-24T04:07:53.3705213Z Type Status | |
| 2025-06-24T04:07:53.3705448Z PodReadyToStartContainers False | |
| 2025-06-24T04:07:53.3705881Z Initialized True | |
| 2025-06-24T04:07:53.3706116Z Ready False | |
| 2025-06-24T04:07:53.3706322Z ContainersReady False | |
| 2025-06-24T04:07:53.3706544Z PodScheduled True | |
| 2025-06-24T04:07:53.3706753Z Volumes: | |
| 2025-06-24T04:07:53.3707188Z kube-api-access-tl8lk: | |
| 2025-06-24T04:07:53.3707539Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T04:07:53.3707894Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T04:07:53.3708142Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T04:07:53.3708401Z ConfigMapOptional: <nil> | |
| 2025-06-24T04:07:53.3708741Z DownwardAPI: true | |
| 2025-06-24T04:07:53.3709049Z QoS Class: Guaranteed | |
| 2025-06-24T04:07:53.3709280Z Node-Selectors: <none> | |
| 2025-06-24T04:07:53.3709652Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T04:07:53.3710299Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T04:07:53.3710714Z Events: | |
| 2025-06-24T04:07:53.3710901Z Type Reason Age From Message | |
| 2025-06-24T04:07:53.3711174Z ---- ------ ---- ---- ------- | |
| 2025-06-24T04:07:53.3712399Z Normal Scheduled 15s default-scheduler Successfully assigned llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-test-connection to chart-testing-control-plane | |
| 2025-06-24T04:07:53.3713782Z Normal Pulled 12s kubelet Container image "quay.io/curl/curl:latest" already present on machine | |
| 2025-06-24T04:07:53.3714620Z Normal Created 12s kubelet Created container curl | |
| 2025-06-24T04:07:53.3715235Z Normal Started 4s kubelet Started container curl | |
| 2025-06-24T04:07:53.3715872Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:53.3716383Z <== Description of pod llm-d-x3wixbo1ie-test-connection | |
| 2025-06-24T04:07:53.3716894Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:53.3718346Z >>> kubectl --request-timeout=30s get pods llm-d-x3wixbo1ie-test-connection --no-headers --namespace llm-d-x3wixbo1ie --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T04:07:53.4242187Z >>> kubectl --request-timeout=30s get pods llm-d-x3wixbo1ie-test-connection --no-headers --namespace llm-d-x3wixbo1ie --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T04:07:53.4760258Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:53.4761254Z ==> Logs of container llm-d-x3wixbo1ie-test-connection | |
| 2025-06-24T04:07:53.4761981Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:53.4762810Z >>> kubectl --request-timeout=30s logs llm-d-x3wixbo1ie-test-connection --namespace llm-d-x3wixbo1ie --container curl | |
| 2025-06-24T04:07:53.5344880Z [32m🥷 Waiting for pods to come up[0m | |
| 2025-06-24T04:07:53.5345132Z | |
| 2025-06-24T04:07:53.5345326Z % Total % Received % Xferd Average Speed Time Time Time Current | |
| 2025-06-24T04:07:53.5345754Z Dload Upload Total Spent Left Speed | |
| 2025-06-24T04:07:53.5345959Z | |
| 2025-06-24T04:07:53.5346081Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 | |
| 2025-06-24T04:07:53.5346390Z 100 237 100 237 0 0 2071 0 --:--:-- --:--:-- --:--:-- 16928 | |
| 2025-06-24T04:07:53.5347144Z {"object":"list","data":[{"id":"food-review","object":"model","created":1750738070,"owned_by":"vllm","root":"food-review","parent":null},{"id":"","object":"model","created":1750738070,"owned_by":"vllm","root":"","parent":"food-review"}]} | |
| 2025-06-24T04:07:53.5347774Z | |
| 2025-06-24T04:07:53.5347909Z [32m🥷 Basic chat validation[0m | |
| 2025-06-24T04:07:53.5348063Z | |
| 2025-06-24T04:07:53.5348550Z % Total % Received % Xferd Average Speed Time Time Time Current | |
| 2025-06-24T04:07:53.5348932Z Dload Upload Total Spent Left Speed | |
| 2025-06-24T04:07:53.5349124Z | |
| 2025-06-24T04:07:53.5349228Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 | |
| 2025-06-24T04:07:53.5349542Z 100 329 100 243 100 86 1174 415 --:--:-- --:--:-- --:--:-- 3074 | |
| 2025-06-24T04:07:53.5369519Z {"id":"chatcmpl-c991cc04-55cd-4459-a469-7c7f80363be5","created":1750738071,"model":"food-review","choices":[{"index":0,"finish_reason":"stop","message":{"role":"assistant","content":"The temperature here is twenty-five degrees centigrade."}}]} | |
| 2025-06-24T04:07:53.5371588Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:53.5372270Z <== Logs of container llm-d-x3wixbo1ie-test-connection | |
| 2025-06-24T04:07:53.5372818Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:53.5373445Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:53.5374044Z ==> Description of pod llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt | |
| 2025-06-24T04:07:53.5375164Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:53.5376185Z >>> kubectl --request-timeout=30s describe pod llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt --namespace llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:53.5959689Z Name: llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt | |
| 2025-06-24T04:07:53.5960789Z Namespace: llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:53.5961276Z Priority: 0 | |
| 2025-06-24T04:07:53.5961649Z Service Account: llm-d-x3wixbo1ie-vllm-sim-sa | |
| 2025-06-24T04:07:53.5961986Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T04:07:53.5962319Z Start Time: Tue, 24 Jun 2025 04:07:38 +0000 | |
| 2025-06-24T04:07:53.5962638Z Labels: llm-d.ai/inferenceServing=true | |
| 2025-06-24T04:07:53.5962912Z llm-d.ai/model=food-review | |
| 2025-06-24T04:07:53.5963151Z llm-d.ai/role=decode | |
| 2025-06-24T04:07:53.5963408Z pod-template-hash=54dd48fd6c | |
| 2025-06-24T04:07:53.5963648Z Annotations: <none> | |
| 2025-06-24T04:07:53.5963850Z Status: Running | |
| 2025-06-24T04:07:53.5964042Z IP: 10.244.0.25 | |
| 2025-06-24T04:07:53.5964225Z IPs: | |
| 2025-06-24T04:07:53.5964376Z IP: 10.244.0.25 | |
| 2025-06-24T04:07:53.5964681Z Controlled By: ReplicaSet/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c | |
| 2025-06-24T04:07:53.5965018Z Init Containers: | |
| 2025-06-24T04:07:53.5965196Z routing-proxy: | |
| 2025-06-24T04:07:53.5965779Z Container ID: containerd://2f650d41d6ad97eaa7bf6fd60e2869bf75fc94c087080c22ce007964acd86151 | |
| 2025-06-24T04:07:53.5966281Z Image: ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6 | |
| 2025-06-24T04:07:53.5966826Z Image ID: ghcr.io/llm-d/llm-d-routing-sidecar@sha256:7f3db0d03f3b3b16ec2a0e8d0d855bb7db83ef8d670dd9027f194e772a87856b | |
| 2025-06-24T04:07:53.5967311Z Port: 8000/TCP | |
| 2025-06-24T04:07:53.5967512Z Host Port: 0/TCP | |
| 2025-06-24T04:07:53.5967706Z Args: | |
| 2025-06-24T04:07:53.5967860Z --port=8000 | |
| 2025-06-24T04:07:53.5968038Z --vllm-port=8001 | |
| 2025-06-24T04:07:53.5968334Z State: Running | |
| 2025-06-24T04:07:53.5968809Z Started: Tue, 24 Jun 2025 04:07:39 +0000 | |
| 2025-06-24T04:07:53.5969210Z Ready: True | |
| 2025-06-24T04:07:53.5969541Z Restart Count: 0 | |
| 2025-06-24T04:07:53.5970100Z Environment: <none> | |
| 2025-06-24T04:07:53.5970418Z Mounts: | |
| 2025-06-24T04:07:53.5970924Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-wdt9z (ro) | |
| 2025-06-24T04:07:53.5971541Z Containers: | |
| 2025-06-24T04:07:53.5971803Z vllm: | |
| 2025-06-24T04:07:53.5972815Z Container ID: containerd://0b44f9b09129ac9d054b52e0d4eff2011d8bcacce31f08b8a37f0eff36ce529c | |
| 2025-06-24T04:07:53.5973552Z Image: ghcr.io/llm-d/llm-d-inference-sim:0.0.4 | |
| 2025-06-24T04:07:53.5974213Z Image ID: ghcr.io/llm-d/llm-d-inference-sim@sha256:5995c4dde42888844812359c121899c1d12e647588ed58fef206c3c653315338 | |
| 2025-06-24T04:07:53.5974998Z Port: 5557/TCP | |
| 2025-06-24T04:07:53.5975304Z Host Port: 0/TCP | |
| 2025-06-24T04:07:53.5975486Z Args: | |
| 2025-06-24T04:07:53.5975640Z --model | |
| 2025-06-24T04:07:53.5975866Z food-review | |
| 2025-06-24T04:07:53.5976159Z --port | |
| 2025-06-24T04:07:53.5976420Z 8001 | |
| 2025-06-24T04:07:53.5976584Z State: Running | |
| 2025-06-24T04:07:53.5976897Z Started: Tue, 24 Jun 2025 04:07:40 +0000 | |
| 2025-06-24T04:07:53.5977221Z Ready: True | |
| 2025-06-24T04:07:53.5977404Z Restart Count: 0 | |
| 2025-06-24T04:07:53.5977603Z Environment: | |
| 2025-06-24T04:07:53.5977901Z HOME: /home | |
| 2025-06-24T04:07:53.5978083Z Mounts: | |
| 2025-06-24T04:07:53.5978257Z /home from home (rw) | |
| 2025-06-24T04:07:53.5978732Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-wdt9z (ro) | |
| 2025-06-24T04:07:53.5979115Z Conditions: | |
| 2025-06-24T04:07:53.5979281Z Type Status | |
| 2025-06-24T04:07:53.5979671Z PodReadyToStartContainers True | |
| 2025-06-24T04:07:53.5980470Z Initialized True | |
| 2025-06-24T04:07:53.5980709Z Ready True | |
| 2025-06-24T04:07:53.5981395Z ContainersReady True | |
| 2025-06-24T04:07:53.5981776Z PodScheduled True | |
| 2025-06-24T04:07:53.5982143Z Volumes: | |
| 2025-06-24T04:07:53.5982296Z home: | |
| 2025-06-24T04:07:53.5982548Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T04:07:53.5982992Z Medium: | |
| 2025-06-24T04:07:53.5983168Z SizeLimit: <unset> | |
| 2025-06-24T04:07:53.5983366Z kube-api-access-wdt9z: | |
| 2025-06-24T04:07:53.5983794Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T04:07:53.5984161Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T04:07:53.5984501Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T04:07:53.5984789Z ConfigMapOptional: <nil> | |
| 2025-06-24T04:07:53.5985014Z DownwardAPI: true | |
| 2025-06-24T04:07:53.5985300Z QoS Class: BestEffort | |
| 2025-06-24T04:07:53.5985563Z Node-Selectors: <none> | |
| 2025-06-24T04:07:53.5986079Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T04:07:53.5986822Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T04:07:53.5987351Z Events: | |
| 2025-06-24T04:07:53.5987693Z Type Reason Age From Message | |
| 2025-06-24T04:07:53.5988160Z ---- ------ ---- ---- ------- | |
| 2025-06-24T04:07:53.5989320Z Normal Scheduled 15s default-scheduler Successfully assigned llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt to chart-testing-control-plane | |
| 2025-06-24T04:07:53.5990749Z Normal Pulled 14s kubelet Container image "ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6" already present on machine | |
| 2025-06-24T04:07:53.5991642Z Normal Created 14s kubelet Created container routing-proxy | |
| 2025-06-24T04:07:53.5992362Z Normal Started 14s kubelet Started container routing-proxy | |
| 2025-06-24T04:07:53.5992977Z Normal Pulled 13s kubelet Container image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" already present on machine | |
| 2025-06-24T04:07:53.5993591Z Normal Created 13s kubelet Created container vllm | |
| 2025-06-24T04:07:53.5993986Z Normal Started 13s kubelet Started container vllm | |
| 2025-06-24T04:07:53.5994417Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:53.5994913Z <== Description of pod llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt | |
| 2025-06-24T04:07:53.5995514Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:53.5996452Z >>> kubectl --request-timeout=30s get pods llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt --no-headers --namespace llm-d-x3wixbo1ie --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T04:07:53.6532945Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:53.6534198Z ==> Logs of init container llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt | |
| 2025-06-24T04:07:53.6534974Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:53.6536110Z >>> kubectl --request-timeout=30s logs llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt --namespace llm-d-x3wixbo1ie --container routing-proxy | |
| 2025-06-24T04:07:53.7070508Z I0624 04:07:39.343924 1 cmd.go:51] "p/d connector validated" connector="nixl" | |
| 2025-06-24T04:07:53.7071136Z I0624 04:07:39.344357 1 proxy.go:115] "starting" logger="proxy server" addr="[::]:8000" | |
| 2025-06-24T04:07:53.7092663Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:53.7093951Z <== Logs of init container llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt | |
| 2025-06-24T04:07:53.7094759Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:53.7095782Z >>> kubectl --request-timeout=30s get pods llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt --no-headers --namespace llm-d-x3wixbo1ie --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T04:07:53.7628217Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:53.7629072Z ==> Logs of container llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt | |
| 2025-06-24T04:07:53.7629991Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:53.7630990Z >>> kubectl --request-timeout=30s logs llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt --namespace llm-d-x3wixbo1ie --container vllm | |
| 2025-06-24T04:07:53.8193020Z I0624 04:07:40.395648 1 cmd.go:36] "Start vllm simulator" | |
| 2025-06-24T04:07:53.8193602Z I0624 04:07:40.395869 1 simulator.go:135] "Server starting" port=8001 | |
| 2025-06-24T04:07:53.8194030Z I0624 04:07:51.090847 1 simulator.go:195] "chat completion request received" | |
| 2025-06-24T04:07:53.8218051Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:53.8218966Z <== Logs of container llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt | |
| 2025-06-24T04:07:53.8219728Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:53.8220582Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:53.8221069Z ==> Description of pod llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n | |
| 2025-06-24T04:07:53.8221509Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:53.8222189Z >>> kubectl --request-timeout=30s describe pod llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n --namespace llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:53.8810040Z Name: llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n | |
| 2025-06-24T04:07:53.8810699Z Namespace: llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:53.8811126Z Priority: 0 | |
| 2025-06-24T04:07:53.8811464Z Service Account: llm-d-x3wixbo1ie-vllm-sim-sa | |
| 2025-06-24T04:07:53.8811805Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T04:07:53.8812124Z Start Time: Tue, 24 Jun 2025 04:07:00 +0000 | |
| 2025-06-24T04:07:53.8812782Z Labels: llm-d.ai/inferenceServing=true | |
| 2025-06-24T04:07:53.8813075Z llm-d.ai/model=food-review | |
| 2025-06-24T04:07:53.8813341Z llm-d.ai/role=decode | |
| 2025-06-24T04:07:53.8813618Z pod-template-hash=54dd48fd6c | |
| 2025-06-24T04:07:53.8813865Z Annotations: <none> | |
| 2025-06-24T04:07:53.8814122Z Status: Terminating (lasts <invalid>) | |
| 2025-06-24T04:07:53.8814389Z Termination Grace Period: 30s | |
| 2025-06-24T04:07:53.8814607Z IP: 10.244.0.18 | |
| 2025-06-24T04:07:53.8814819Z IPs: | |
| 2025-06-24T04:07:53.8814974Z IP: 10.244.0.18 | |
| 2025-06-24T04:07:53.8815277Z Controlled By: ReplicaSet/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c | |
| 2025-06-24T04:07:53.8815612Z Init Containers: | |
| 2025-06-24T04:07:53.8815790Z routing-proxy: | |
| 2025-06-24T04:07:53.8816182Z Container ID: containerd://0a1a98e000d1f16e4fa22e7e3b8fcbace9955255fa639b22be85b7bbf2941654 | |
| 2025-06-24T04:07:53.8816671Z Image: ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6 | |
| 2025-06-24T04:07:53.8817209Z Image ID: ghcr.io/llm-d/llm-d-routing-sidecar@sha256:7f3db0d03f3b3b16ec2a0e8d0d855bb7db83ef8d670dd9027f194e772a87856b | |
| 2025-06-24T04:07:53.8817813Z Port: 8000/TCP | |
| 2025-06-24T04:07:53.8818419Z Host Port: 0/TCP | |
| 2025-06-24T04:07:53.8818686Z Args: | |
| 2025-06-24T04:07:53.8818847Z --port=8000 | |
| 2025-06-24T04:07:53.8819029Z --vllm-port=8001 | |
| 2025-06-24T04:07:53.8819219Z State: Running | |
| 2025-06-24T04:07:53.8819433Z Started: Tue, 24 Jun 2025 04:07:08 +0000 | |
| 2025-06-24T04:07:53.8819676Z Ready: True | |
| 2025-06-24T04:07:53.8820108Z Restart Count: 0 | |
| 2025-06-24T04:07:53.8820310Z Environment: <none> | |
| 2025-06-24T04:07:53.8820496Z Mounts: | |
| 2025-06-24T04:07:53.8820820Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-k47d6 (ro) | |
| 2025-06-24T04:07:53.8821179Z Containers: | |
| 2025-06-24T04:07:53.8821328Z vllm: | |
| 2025-06-24T04:07:53.8821693Z Container ID: containerd://937c9c8bbef5cf195558ecd16b8f1b8c6c0227004f3b019810cedb9deae6ca13 | |
| 2025-06-24T04:07:53.8822157Z Image: ghcr.io/llm-d/llm-d-inference-sim:0.0.4 | |
| 2025-06-24T04:07:53.8822659Z Image ID: ghcr.io/llm-d/llm-d-inference-sim@sha256:5995c4dde42888844812359c121899c1d12e647588ed58fef206c3c653315338 | |
| 2025-06-24T04:07:53.8823118Z Port: 5557/TCP | |
| 2025-06-24T04:07:53.8823311Z Host Port: 0/TCP | |
| 2025-06-24T04:07:53.8823496Z Args: | |
| 2025-06-24T04:07:53.8823642Z --model | |
| 2025-06-24T04:07:53.8823802Z food-review | |
| 2025-06-24T04:07:53.8823964Z --port | |
| 2025-06-24T04:07:53.8824116Z 8001 | |
| 2025-06-24T04:07:53.8824267Z State: Running | |
| 2025-06-24T04:07:53.8824483Z Started: Tue, 24 Jun 2025 04:07:09 +0000 | |
| 2025-06-24T04:07:53.8824722Z Ready: True | |
| 2025-06-24T04:07:53.8824902Z Restart Count: 0 | |
| 2025-06-24T04:07:53.8825077Z Environment: | |
| 2025-06-24T04:07:53.8825239Z HOME: /home | |
| 2025-06-24T04:07:53.8825406Z Mounts: | |
| 2025-06-24T04:07:53.8825563Z /home from home (rw) | |
| 2025-06-24T04:07:53.8825896Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-k47d6 (ro) | |
| 2025-06-24T04:07:53.8826245Z Conditions: | |
| 2025-06-24T04:07:53.8826419Z Type Status | |
| 2025-06-24T04:07:53.8826651Z PodReadyToStartContainers True | |
| 2025-06-24T04:07:53.8826884Z Initialized True | |
| 2025-06-24T04:07:53.8827099Z Ready True | |
| 2025-06-24T04:07:53.8827309Z ContainersReady True | |
| 2025-06-24T04:07:53.8827526Z PodScheduled True | |
| 2025-06-24T04:07:53.8827720Z Volumes: | |
| 2025-06-24T04:07:53.8827871Z home: | |
| 2025-06-24T04:07:53.8828117Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T04:07:53.8828426Z Medium: | |
| 2025-06-24T04:07:53.8828599Z SizeLimit: <unset> | |
| 2025-06-24T04:07:53.8828798Z kube-api-access-k47d6: | |
| 2025-06-24T04:07:53.8829266Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T04:07:53.8829639Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T04:07:53.8830077Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T04:07:53.8830331Z ConfigMapOptional: <nil> | |
| 2025-06-24T04:07:53.8830562Z DownwardAPI: true | |
| 2025-06-24T04:07:53.8830778Z QoS Class: BestEffort | |
| 2025-06-24T04:07:53.8831009Z Node-Selectors: <none> | |
| 2025-06-24T04:07:53.8831456Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T04:07:53.8832109Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T04:07:53.8832413Z Events: | |
| 2025-06-24T04:07:53.8832740Z Type Reason Age From Message | |
| 2025-06-24T04:07:53.8833212Z ---- ------ ---- ---- ------- | |
| 2025-06-24T04:07:53.8834394Z Normal Scheduled 53s default-scheduler Successfully assigned llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n to chart-testing-control-plane | |
| 2025-06-24T04:07:53.8835670Z Normal Pulling 52s kubelet Pulling image "ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6" | |
| 2025-06-24T04:07:53.8837108Z Normal Pulled 45s kubelet Successfully pulled image "ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6" in 3.346s (6.788s including waiting). Image size: 85265962 bytes. | |
| 2025-06-24T04:07:53.8838455Z Normal Created 45s kubelet Created container routing-proxy | |
| 2025-06-24T04:07:53.8839010Z Normal Started 45s kubelet Started container routing-proxy | |
| 2025-06-24T04:07:53.8839661Z Normal Pulled 44s kubelet Container image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" already present on machine | |
| 2025-06-24T04:07:53.8840477Z Normal Created 44s kubelet Created container vllm | |
| 2025-06-24T04:07:53.8841013Z Normal Started 44s kubelet Started container vllm | |
| 2025-06-24T04:07:53.8841452Z Normal Killing 15s kubelet Stopping container routing-proxy | |
| 2025-06-24T04:07:53.8841995Z Normal Killing 15s kubelet Stopping container vllm | |
| 2025-06-24T04:07:53.8842407Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:53.8842903Z <== Description of pod llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n | |
| 2025-06-24T04:07:53.8843414Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:53.8844771Z >>> kubectl --request-timeout=30s get pods llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n --no-headers --namespace llm-d-x3wixbo1ie --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T04:07:53.9362643Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:53.9363561Z ==> Logs of init container llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n | |
| 2025-06-24T04:07:53.9364066Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:53.9365108Z >>> kubectl --request-timeout=30s logs llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n --namespace llm-d-x3wixbo1ie --container routing-proxy | |
| 2025-06-24T04:07:53.9911793Z I0624 04:07:08.368411 1 cmd.go:51] "p/d connector validated" connector="nixl" | |
| 2025-06-24T04:07:53.9912485Z I0624 04:07:08.369051 1 proxy.go:115] "starting" logger="proxy server" addr="[::]:8000" | |
| 2025-06-24T04:07:53.9934627Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:53.9936105Z <== Logs of init container llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n | |
| 2025-06-24T04:07:53.9937062Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:53.9938523Z >>> kubectl --request-timeout=30s get pods llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n --no-headers --namespace llm-d-x3wixbo1ie --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T04:07:54.0473603Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:54.0475674Z ==> Logs of container llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n | |
| 2025-06-24T04:07:54.0476345Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:54.0477164Z >>> kubectl --request-timeout=30s logs llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n --namespace llm-d-x3wixbo1ie --container vllm | |
| 2025-06-24T04:07:54.1020912Z I0624 04:07:09.232645 1 cmd.go:36] "Start vllm simulator" | |
| 2025-06-24T04:07:54.1021543Z I0624 04:07:09.232800 1 simulator.go:135] "Server starting" port=8001 | |
| 2025-06-24T04:07:54.1022225Z I0624 04:07:19.657793 1 simulator.go:195] "chat completion request received" | |
| 2025-06-24T04:07:54.1022926Z I0624 04:07:38.435904 1 simulator.go:294] "reqProcessingWorker stopped:" worker id=1 | |
| 2025-06-24T04:07:54.1023657Z I0624 04:07:38.436185 1 simulator.go:294] "reqProcessingWorker stopped:" worker id=2 | |
| 2025-06-24T04:07:54.1024707Z I0624 04:07:38.436172 1 simulator.go:294] "reqProcessingWorker stopped:" worker id=5 | |
| 2025-06-24T04:07:54.1025410Z I0624 04:07:38.436203 1 simulator.go:294] "reqProcessingWorker stopped:" worker id=4 | |
| 2025-06-24T04:07:54.1026129Z I0624 04:07:38.436218 1 simulator.go:294] "reqProcessingWorker stopped:" worker id=3 | |
| 2025-06-24T04:07:54.1045919Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:54.1046740Z <== Logs of container llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-lb86n | |
| 2025-06-24T04:07:54.1047512Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:54.1048231Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:54.1048934Z ==> Description of pod llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-vdwtj | |
| 2025-06-24T04:07:54.1049476Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:54.1050357Z >>> kubectl --request-timeout=30s describe pod llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-vdwtj --namespace llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:54.1644671Z Name: llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-vdwtj | |
| 2025-06-24T04:07:54.1645673Z Namespace: llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:54.1646153Z Priority: 0 | |
| 2025-06-24T04:07:54.1646548Z Service Account: llm-d-x3wixbo1ie-vllm-sim-epp-sa | |
| 2025-06-24T04:07:54.1646999Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T04:07:54.1647375Z Start Time: Tue, 24 Jun 2025 04:07:38 +0000 | |
| 2025-06-24T04:07:54.1647793Z Labels: app.kubernetes.io/gateway=llm-d-x3wixbo1ie-inference-gateway | |
| 2025-06-24T04:07:54.1648277Z llm-d.ai/epp=llm-d-x3wixbo1ie-vllm-sim-epp | |
| 2025-06-24T04:07:54.1648606Z pod-template-hash=7bd6f8cffc | |
| 2025-06-24T04:07:54.1649072Z Annotations: <none> | |
| 2025-06-24T04:07:54.1649376Z Status: Running | |
| 2025-06-24T04:07:54.1649664Z IP: 10.244.0.22 | |
| 2025-06-24T04:07:54.1650154Z IPs: | |
| 2025-06-24T04:07:54.1650320Z IP: 10.244.0.22 | |
| 2025-06-24T04:07:54.1650633Z Controlled By: ReplicaSet/llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc | |
| 2025-06-24T04:07:54.1650965Z Containers: | |
| 2025-06-24T04:07:54.1651116Z epp: | |
| 2025-06-24T04:07:54.1651480Z Container ID: containerd://278c4c33c50413a8ffbe1949ae6676ba75b37526721b32fd96182b5d26e79c09 | |
| 2025-06-24T04:07:54.1651986Z Image: ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4 | |
| 2025-06-24T04:07:54.1653176Z Image ID: ghcr.io/llm-d/llm-d-inference-scheduler@sha256:d5d2492ee51c76bc78bb9dc1219dd7fba1fd70afe466c76860a6cd40ddf0c6f5 | |
| 2025-06-24T04:07:54.1653750Z Ports: 9002/TCP, 9003/TCP, 9090/TCP | |
| 2025-06-24T04:07:54.1654013Z Host Ports: 0/TCP, 0/TCP, 0/TCP | |
| 2025-06-24T04:07:54.1654232Z Args: | |
| 2025-06-24T04:07:54.1654387Z --poolName | |
| 2025-06-24T04:07:54.1654607Z llm-d-x3wixbo1ie-vllm-sim-inference-pool | |
| 2025-06-24T04:07:54.1654857Z --poolNamespace | |
| 2025-06-24T04:07:54.1655046Z llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:54.1655226Z -v | |
| 2025-06-24T04:07:54.1655378Z 4 | |
| 2025-06-24T04:07:54.1655526Z --zap-encoder | |
| 2025-06-24T04:07:54.1655694Z json | |
| 2025-06-24T04:07:54.1655839Z --grpcPort | |
| 2025-06-24T04:07:54.1656007Z 9002 | |
| 2025-06-24T04:07:54.1656164Z --grpcHealthPort | |
| 2025-06-24T04:07:54.1656331Z 9003 | |
| 2025-06-24T04:07:54.1656484Z State: Running | |
| 2025-06-24T04:07:54.1656697Z Started: Tue, 24 Jun 2025 04:07:39 +0000 | |
| 2025-06-24T04:07:54.1656940Z Ready: True | |
| 2025-06-24T04:07:54.1657121Z Restart Count: 0 | |
| 2025-06-24T04:07:54.1657307Z Requests: | |
| 2025-06-24T04:07:54.1657467Z cpu: 256m | |
| 2025-06-24T04:07:54.1657657Z memory: 128Mi | |
| 2025-06-24T04:07:54.1658117Z Liveness: grpc <pod>:9003 envoy.service.ext_proc.v3.ExternalProcessor delay=5s timeout=1s period=10s #success=1 #failure=3 | |
| 2025-06-24T04:07:54.1659018Z Readiness: grpc <pod>:9003 envoy.service.ext_proc.v3.ExternalProcessor delay=5s timeout=1s period=10s #success=1 #failure=3 | |
| 2025-06-24T04:07:54.1659506Z Environment: | |
| 2025-06-24T04:07:54.1659702Z ENABLE_KVCACHE_AWARE_SCORER: false | |
| 2025-06-24T04:07:54.1660176Z ENABLE_LOAD_AWARE_SCORER: true | |
| 2025-06-24T04:07:54.1660430Z ENABLE_PREFIX_AWARE_SCORER: true | |
| 2025-06-24T04:07:54.1660686Z ENABLE_SESSION_AWARE_SCORER: false | |
| 2025-06-24T04:07:54.1660965Z KVCACHE_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T04:07:54.1661437Z KVCACHE_INDEXER_REDIS_ADDR: llm-d-x3wixbo1ie-redis-master.llm-d-x3wixbo1ie.svc.cluster.local:8100 | |
| 2025-06-24T04:07:54.1661901Z LOAD_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T04:07:54.1662148Z PD_ENABLED: false | |
| 2025-06-24T04:07:54.1662406Z PD_PROMPT_LEN_THRESHOLD: 10 | |
| 2025-06-24T04:07:54.1662676Z PREFILL_ENABLE_KVCACHE_AWARE_SCORER: false | |
| 2025-06-24T04:07:54.1662943Z PREFILL_ENABLE_LOAD_AWARE_SCORER: false | |
| 2025-06-24T04:07:54.1663205Z PREFILL_ENABLE_PREFIX_AWARE_SCORER: false | |
| 2025-06-24T04:07:54.1663474Z PREFILL_ENABLE_SESSION_AWARE_SCORER: false | |
| 2025-06-24T04:07:54.1663737Z PREFILL_KVCACHE_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T04:07:54.1664211Z PREFILL_KVCACHE_INDEXER_REDIS_ADDR: llm-d-x3wixbo1ie-redis-master.llm-d-x3wixbo1ie.svc.cluster.local:8100 | |
| 2025-06-24T04:07:54.1664700Z PREFILL_LOAD_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T04:07:54.1664952Z PREFILL_PREFIX_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T04:07:54.1665207Z PREFILL_SESSION_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T04:07:54.1665457Z PREFIX_AWARE_SCORER_WEIGHT: 2 | |
| 2025-06-24T04:07:54.1665706Z SESSION_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T04:07:54.1665928Z Mounts: | |
| 2025-06-24T04:07:54.1666230Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-m9ttq (ro) | |
| 2025-06-24T04:07:54.1666601Z Conditions: | |
| 2025-06-24T04:07:54.1666767Z Type Status | |
| 2025-06-24T04:07:54.1667014Z PodReadyToStartContainers True | |
| 2025-06-24T04:07:54.1667251Z Initialized True | |
| 2025-06-24T04:07:54.1667461Z Ready True | |
| 2025-06-24T04:07:54.1667674Z ContainersReady True | |
| 2025-06-24T04:07:54.1667893Z PodScheduled True | |
| 2025-06-24T04:07:54.1668099Z Volumes: | |
| 2025-06-24T04:07:54.1668268Z kube-api-access-m9ttq: | |
| 2025-06-24T04:07:54.1668607Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T04:07:54.1668980Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T04:07:54.1669444Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T04:07:54.1669712Z ConfigMapOptional: <nil> | |
| 2025-06-24T04:07:54.1670189Z DownwardAPI: true | |
| 2025-06-24T04:07:54.1670563Z QoS Class: Burstable | |
| 2025-06-24T04:07:54.1670989Z Node-Selectors: <none> | |
| 2025-06-24T04:07:54.1671584Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T04:07:54.1672345Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T04:07:54.1672890Z Events: | |
| 2025-06-24T04:07:54.1673205Z Type Reason Age From Message | |
| 2025-06-24T04:07:54.1673689Z ---- ------ ---- ---- ------- | |
| 2025-06-24T04:07:54.1674638Z Normal Scheduled 16s default-scheduler Successfully assigned llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-vdwtj to chart-testing-control-plane | |
| 2025-06-24T04:07:54.1675803Z Normal Pulling 16s kubelet Pulling image "ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4" | |
| 2025-06-24T04:07:54.1677222Z Normal Pulled 15s kubelet Successfully pulled image "ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4" in 165ms (165ms including waiting). Image size: 119587259 bytes. | |
| 2025-06-24T04:07:54.1678300Z Normal Created 15s kubelet Created container epp | |
| 2025-06-24T04:07:54.1678712Z Normal Started 15s kubelet Started container epp | |
| 2025-06-24T04:07:54.1679147Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:54.1679647Z <== Description of pod llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-vdwtj | |
| 2025-06-24T04:07:54.1680379Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:54.1681251Z >>> kubectl --request-timeout=30s get pods llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-vdwtj --no-headers --namespace llm-d-x3wixbo1ie --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T04:07:54.2207030Z >>> kubectl --request-timeout=30s get pods llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-vdwtj --no-headers --namespace llm-d-x3wixbo1ie --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T04:07:54.2745436Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:54.2746219Z ==> Logs of container llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-vdwtj | |
| 2025-06-24T04:07:54.2746778Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:54.2747541Z >>> kubectl --request-timeout=30s logs llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-vdwtj --namespace llm-d-x3wixbo1ie --container epp | |
| 2025-06-24T04:07:54.3302988Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"epp/main.go:146","msg":"Flags processed","flags":{"DestinationEndpointHintMetadataNamespace":"envoy.lb","certPath":"","destinationEndpointHintKey":"x-gateway-destination-endpoint","grpcHealthPort":9003,"grpcPort":9002,"kubeconfig":"","kvCacheUsagePercentageMetric":"vllm:gpu_cache_usage_perc","loraInfoMetric":"vllm:lora_requests_info","metricsPort":9090,"poolName":"llm-d-x3wixbo1ie-vllm-sim-inference-pool","poolNamespace":"llm-d-x3wixbo1ie","refreshMetricsInterval":50000000,"refreshPrometheusMetricsInterval":5000000000,"secureServing":true,"totalQueuedRequestsMetric":"vllm:num_requests_waiting","v":4,"zap-devel":true,"zap-encoder":{},"zap-log-level":{},"zap-stacktrace-level":{},"zap-time-encoding":{}}} | |
| 2025-06-24T04:07:54.3308293Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"ENABLE_KVCACHE_AWARE_SCORER","value":"false"} | |
| 2025-06-24T04:07:54.3310170Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"KVCACHE_AWARE_SCORER"} | |
| 2025-06-24T04:07:54.3312260Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"ENABLE_LOAD_AWARE_SCORER","value":"true"} | |
| 2025-06-24T04:07:54.3313989Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"LOAD_AWARE_SCORER_WEIGHT","value":1} | |
| 2025-06-24T04:07:54.3315546Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"config/config.go:115","msg":"Initialized plugin","plugin":"LOAD_AWARE_SCORER","weight":1} | |
| 2025-06-24T04:07:54.3317187Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"ENABLE_PREFIX_AWARE_SCORER","value":"true"} | |
| 2025-06-24T04:07:54.3318922Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PREFIX_AWARE_SCORER_WEIGHT","value":2} | |
| 2025-06-24T04:07:54.3321037Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"config/config.go:115","msg":"Initialized plugin","plugin":"PREFIX_AWARE_SCORER","weight":2} | |
| 2025-06-24T04:07:54.3322468Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"ENABLE_SESSION_AWARE_SCORER","value":"false"} | |
| 2025-06-24T04:07:54.3324203Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"SESSION_AWARE_SCORER"} | |
| 2025-06-24T04:07:54.3325717Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_LEAST_KVCACHE_FILTER","defaultValue":"false"} | |
| 2025-06-24T04:07:54.3327226Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LEAST_KVCACHE_FILTER"} | |
| 2025-06-24T04:07:54.3328721Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_LEAST_QUEUE_FILTER","defaultValue":"false"} | |
| 2025-06-24T04:07:54.3330496Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LEAST_QUEUE_FILTER"} | |
| 2025-06-24T04:07:54.3332049Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_LORA_AFFINITY_FILTER","defaultValue":"false"} | |
| 2025-06-24T04:07:54.3333609Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LORA_AFFINITY_FILTER"} | |
| 2025-06-24T04:07:54.3335152Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_LOW_QUEUE_FILTER","defaultValue":"false"} | |
| 2025-06-24T04:07:54.3336666Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LOW_QUEUE_FILTER"} | |
| 2025-06-24T04:07:54.3338349Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_SHEDDABLE_CAPACITY_FILTER","defaultValue":"false"} | |
| 2025-06-24T04:07:54.3340138Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_SHEDDABLE_CAPACITY_FILTER"} | |
| 2025-06-24T04:07:54.3341885Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_KVCACHE_UTILIZATION_SCORER","defaultValue":"false"} | |
| 2025-06-24T04:07:54.3343466Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_KVCACHE_UTILIZATION_SCORER"} | |
| 2025-06-24T04:07:54.3344991Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_QUEUE_SCORER","defaultValue":"false"} | |
| 2025-06-24T04:07:54.3346597Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_QUEUE_SCORER"} | |
| 2025-06-24T04:07:54.3348142Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_PREFIX_SCORER","defaultValue":"false"} | |
| 2025-06-24T04:07:54.3350389Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_PREFIX_SCORER"} | |
| 2025-06-24T04:07:54.3352055Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PREFILL_ENABLE_KVCACHE_AWARE_SCORER","value":"false"} | |
| 2025-06-24T04:07:54.3353834Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"KVCACHE_AWARE_SCORER"} | |
| 2025-06-24T04:07:54.3355440Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PREFILL_ENABLE_LOAD_AWARE_SCORER","value":"false"} | |
| 2025-06-24T04:07:54.3357036Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"LOAD_AWARE_SCORER"} | |
| 2025-06-24T04:07:54.3358670Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PREFILL_ENABLE_PREFIX_AWARE_SCORER","value":"false"} | |
| 2025-06-24T04:07:54.3360498Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"PREFIX_AWARE_SCORER"} | |
| 2025-06-24T04:07:54.3362201Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PREFILL_ENABLE_SESSION_AWARE_SCORER","value":"false"} | |
| 2025-06-24T04:07:54.3363888Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"SESSION_AWARE_SCORER"} | |
| 2025-06-24T04:07:54.3365663Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_LEAST_KVCACHE_FILTER","defaultValue":"false"} | |
| 2025-06-24T04:07:54.3367576Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LEAST_KVCACHE_FILTER"} | |
| 2025-06-24T04:07:54.3369320Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_LEAST_QUEUE_FILTER","defaultValue":"false"} | |
| 2025-06-24T04:07:54.3371257Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LEAST_QUEUE_FILTER"} | |
| 2025-06-24T04:07:54.3373288Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_LORA_AFFINITY_FILTER","defaultValue":"false"} | |
| 2025-06-24T04:07:54.3375239Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LORA_AFFINITY_FILTER"} | |
| 2025-06-24T04:07:54.3376962Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_LOW_QUEUE_FILTER","defaultValue":"false"} | |
| 2025-06-24T04:07:54.3378660Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LOW_QUEUE_FILTER"} | |
| 2025-06-24T04:07:54.3380521Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_SHEDDABLE_CAPACITY_FILTER","defaultValue":"false"} | |
| 2025-06-24T04:07:54.3382269Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_SHEDDABLE_CAPACITY_FILTER"} | |
| 2025-06-24T04:07:54.3384028Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_KVCACHE_UTILIZATION_SCORER","defaultValue":"false"} | |
| 2025-06-24T04:07:54.3390051Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_KVCACHE_UTILIZATION_SCORER"} | |
| 2025-06-24T04:07:54.3392176Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_QUEUE_SCORER","defaultValue":"false"} | |
| 2025-06-24T04:07:54.3393953Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_QUEUE_SCORER"} | |
| 2025-06-24T04:07:54.3399447Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_PREFIX_SCORER","defaultValue":"false"} | |
| 2025-06-24T04:07:54.3404437Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_PREFIX_SCORER"} | |
| 2025-06-24T04:07:54.3407248Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PD_ENABLED","value":"false"} | |
| 2025-06-24T04:07:54.3408765Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PD_PROMPT_LEN_THRESHOLD","value":10} | |
| 2025-06-24T04:07:54.3410934Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFIX_SCORER_BLOCK_SIZE","defaultValue":256} | |
| 2025-06-24T04:07:54.3412680Z {"level":"info","ts":"2025-06-24T04:07:39Z","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"LOAD_AWARE_SCORER_QUEUE_THRESHOLD","defaultValue":128} | |
| 2025-06-24T04:07:54.3414055Z {"level":"info","ts":"2025-06-24T04:07:39Z","caller":"scorer/prefix_aware.go:154","msg":"Prefix aware scorer cleanup started"} | |
| 2025-06-24T04:07:54.3415141Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"setup","caller":"epp/main.go:224","msg":"Controller manager starting"} | |
| 2025-06-24T04:07:54.3416251Z {"level":"info","ts":"2025-06-24T04:07:39Z","caller":"manager/server.go:83","msg":"starting server","name":"metrics","addr":":9090"} | |
| 2025-06-24T04:07:54.3417519Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"controller-runtime.metrics","caller":"server/server.go:208","msg":"Starting metrics server"} | |
| 2025-06-24T04:07:54.3419094Z {"level":"info","ts":"2025-06-24T04:07:39Z","logger":"controller-runtime.metrics","caller":"server/server.go:247","msg":"Serving metrics server","bindAddress":":8080","secure":false} | |
| 2025-06-24T04:07:54.3420930Z {"level":"info","ts":"2025-06-24T04:07:39Z","caller":"runnable/grpc.go:26","msg":"gRPC server starting","name":"health"} | |
| 2025-06-24T04:07:54.3422078Z {"level":"info","ts":"2025-06-24T04:07:39Z","caller":"runnable/grpc.go:34","msg":"gRPC server listening","name":"health","port":9003} | |
| 2025-06-24T04:07:54.3424134Z {"level":"info","ts":"2025-06-24T04:07:39Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool","source":"kind source: *v1alpha2.InferencePool"} | |
| 2025-06-24T04:07:54.3426490Z {"level":"info","ts":"2025-06-24T04:07:39Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"pod","controllerGroup":"","controllerKind":"Pod","source":"kind source: *v1.Pod"} | |
| 2025-06-24T04:07:54.3428916Z {"level":"info","ts":"2025-06-24T04:07:39Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"inferencemodel","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferenceModel","source":"kind source: *v1alpha2.InferenceModel"} | |
| 2025-06-24T04:07:54.3431677Z {"level":"info","ts":"2025-06-24T04:07:39Z","caller":"controller/controller.go:239","msg":"Starting Controller","controller":"inferencemodel","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferenceModel"} | |
| 2025-06-24T04:07:54.3433984Z {"level":"info","ts":"2025-06-24T04:07:39Z","caller":"controller/controller.go:248","msg":"Starting workers","controller":"inferencemodel","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferenceModel","worker count":1} | |
| 2025-06-24T04:07:54.3435296Z {"level":"info","ts":"2025-06-24T04:07:39Z","caller":"controller/controller.go:239","msg":"Starting Controller","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool"} | |
| 2025-06-24T04:07:54.3436566Z {"level":"info","ts":"2025-06-24T04:07:39Z","caller":"controller/controller.go:248","msg":"Starting workers","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool","worker count":1} | |
| 2025-06-24T04:07:54.3437707Z {"level":"info","ts":"2025-06-24T04:07:39Z","caller":"controller/controller.go:239","msg":"Starting Controller","controller":"pod","controllerGroup":"","controllerKind":"Pod"} | |
| 2025-06-24T04:07:54.3438648Z {"level":"info","ts":"2025-06-24T04:07:39Z","caller":"controller/controller.go:248","msg":"Starting workers","controller":"pod","controllerGroup":"","controllerKind":"Pod","worker count":1} | |
| 2025-06-24T04:07:54.3441047Z {"level":"Level(-2)","ts":"2025-06-24T04:07:39Z","caller":"controller/inferencemodel_reconciler.go:47","msg":"Reconciling InferenceModel","controller":"inferencemodel","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferenceModel","InferenceModel":{"name":"llm-d-x3wixbo1ie-vllm-sim","namespace":"llm-d-x3wixbo1ie"},"namespace":"llm-d-x3wixbo1ie","name":"llm-d-x3wixbo1ie-vllm-sim","reconcileID":"c7859438-0f0f-40fa-9119-2d245c4d1040","inferenceModel":{"name":"llm-d-x3wixbo1ie-vllm-sim","namespace":"llm-d-x3wixbo1ie"}} | |
| 2025-06-24T04:07:54.3447298Z {"level":"Level(-2)","ts":"2025-06-24T04:07:39Z","caller":"controller/inferencemodel_reconciler.go:70","msg":"Added/Updated InferenceModel","controller":"inferencemodel","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferenceModel","InferenceModel":{"name":"llm-d-x3wixbo1ie-vllm-sim","namespace":"llm-d-x3wixbo1ie"},"namespace":"llm-d-x3wixbo1ie","name":"llm-d-x3wixbo1ie-vllm-sim","reconcileID":"c7859438-0f0f-40fa-9119-2d245c4d1040","inferenceModel":{"name":"llm-d-x3wixbo1ie-vllm-sim","namespace":"llm-d-x3wixbo1ie"},"poolRef":{"group":"inference.networking.x-k8s.io","kind":"InferencePool","name":"llm-d-x3wixbo1ie-vllm-sim-inference-pool"},"modelName":"food-review"} | |
| 2025-06-24T04:07:54.3454023Z {"level":"Level(-2)","ts":"2025-06-24T04:07:39Z","caller":"controller/inferencepool_reconciler.go:45","msg":"Reconciling InferencePool","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool","InferencePool":{"name":"llm-d-x3wixbo1ie-vllm-sim-inference-pool","namespace":"llm-d-x3wixbo1ie"},"namespace":"llm-d-x3wixbo1ie","name":"llm-d-x3wixbo1ie-vllm-sim-inference-pool","reconcileID":"939d5e67-fd86-4b0a-ad94-e1610a2c45cd","inferencePool":{"name":"llm-d-x3wixbo1ie-vllm-sim-inference-pool","namespace":"llm-d-x3wixbo1ie"}} | |
| 2025-06-24T04:07:54.3458852Z {"level":"Level(-4)","ts":"2025-06-24T04:07:39Z","caller":"datastore/datastore.go:125","msg":"Updating inference pool endpoints","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool","InferencePool":{"name":"llm-d-x3wixbo1ie-vllm-sim-inference-pool","namespace":"llm-d-x3wixbo1ie"},"namespace":"llm-d-x3wixbo1ie","name":"llm-d-x3wixbo1ie-vllm-sim-inference-pool","reconcileID":"939d5e67-fd86-4b0a-ad94-e1610a2c45cd","inferencePool":{"name":"llm-d-x3wixbo1ie-vllm-sim-inference-pool","namespace":"llm-d-x3wixbo1ie"},"selector":{"llm-d.ai/inferenceServing":"true","llm-d.ai/model":"food-review"}} | |
| 2025-06-24T04:07:54.3461389Z {"level":"info","ts":"2025-06-24T04:07:40Z","caller":"runnable/grpc.go:19","msg":"gRPC server starting","name":"ext-proc"} | |
| 2025-06-24T04:07:54.3462191Z {"level":"info","ts":"2025-06-24T04:07:40Z","caller":"runnable/grpc.go:28","msg":"gRPC server listening","name":"ext-proc","port":9002} | |
| 2025-06-24T04:07:54.3466141Z {"level":"Level(-3)","ts":"2025-06-24T04:07:40Z","caller":"controller/pod_reconciler.go:51","msg":"Pod being reconciled","controller":"pod","controllerGroup":"","controllerKind":"Pod","Pod":{"name":"llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt","namespace":"llm-d-x3wixbo1ie"},"namespace":"llm-d-x3wixbo1ie","name":"llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt","reconcileID":"70d1657f-3022-4c8d-9d9b-d88372ba8740","name":{"name":"llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt","namespace":"llm-d-x3wixbo1ie"}} | |
| 2025-06-24T04:07:54.3471828Z {"level":"Level(-4)","ts":"2025-06-24T04:07:40Z","caller":"controller/pod_reconciler.go:96","msg":"Pod removed or not added","controller":"pod","controllerGroup":"","controllerKind":"Pod","Pod":{"name":"llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt","namespace":"llm-d-x3wixbo1ie"},"namespace":"llm-d-x3wixbo1ie","name":"llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt","reconcileID":"70d1657f-3022-4c8d-9d9b-d88372ba8740","name":{"name":"llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt","namespace":"llm-d-x3wixbo1ie"}} | |
| 2025-06-24T04:07:54.3477030Z {"level":"Level(-3)","ts":"2025-06-24T04:07:40Z","caller":"controller/pod_reconciler.go:51","msg":"Pod being reconciled","controller":"pod","controllerGroup":"","controllerKind":"Pod","Pod":{"name":"llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs","namespace":"llm-d-x3wixbo1ie"},"namespace":"llm-d-x3wixbo1ie","name":"llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs","reconcileID":"f50f6c7b-be03-4990-8152-89ca055a153b","name":{"name":"llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs","namespace":"llm-d-x3wixbo1ie"}} | |
| 2025-06-24T04:07:54.3482816Z {"level":"Level(-2)","ts":"2025-06-24T04:07:40Z","caller":"controller/pod_reconciler.go:102","msg":"Pod already exists","controller":"pod","controllerGroup":"","controllerKind":"Pod","Pod":{"name":"llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs","namespace":"llm-d-x3wixbo1ie"},"namespace":"llm-d-x3wixbo1ie","name":"llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs","reconcileID":"f50f6c7b-be03-4990-8152-89ca055a153b","name":{"name":"llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs","namespace":"llm-d-x3wixbo1ie"}} | |
| 2025-06-24T04:07:54.3487314Z {"level":"Level(-2)","ts":"2025-06-24T04:07:40Z","caller":"metrics/pod_metrics.go:92","msg":"Starting refresher","pod":{"name":"llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs","namespace":"llm-d-x3wixbo1ie"},"pod":"{NamespacedName:llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs Address:10.244.0.24 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:prefill pod-template-hash:bff74c677]}"} | |
| 2025-06-24T04:07:54.3490705Z {"level":"Level(-3)","ts":"2025-06-24T04:07:41Z","caller":"controller/pod_reconciler.go:51","msg":"Pod being reconciled","controller":"pod","controllerGroup":"","controllerKind":"Pod","Pod":{"name":"llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt","namespace":"llm-d-x3wixbo1ie"},"namespace":"llm-d-x3wixbo1ie","name":"llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt","reconcileID":"562514a8-6f27-48e1-9d49-e2e8e7fe6def","name":{"name":"llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt","namespace":"llm-d-x3wixbo1ie"}} | |
| 2025-06-24T04:07:54.3493728Z {"level":"Level(-2)","ts":"2025-06-24T04:07:41Z","caller":"controller/pod_reconciler.go:102","msg":"Pod already exists","controller":"pod","controllerGroup":"","controllerKind":"Pod","Pod":{"name":"llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt","namespace":"llm-d-x3wixbo1ie"},"namespace":"llm-d-x3wixbo1ie","name":"llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt","reconcileID":"562514a8-6f27-48e1-9d49-e2e8e7fe6def","name":{"name":"llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt","namespace":"llm-d-x3wixbo1ie"}} | |
| 2025-06-24T04:07:54.3496877Z {"level":"Level(-2)","ts":"2025-06-24T04:07:41Z","caller":"metrics/pod_metrics.go:92","msg":"Starting refresher","pod":{"name":"llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt","namespace":"llm-d-x3wixbo1ie"},"pod":"{NamespacedName:llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt Address:10.244.0.25 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:decode pod-template-hash:54dd48fd6c]}"} | |
| 2025-06-24T04:07:54.3500711Z {"level":"Level(-4)","ts":"2025-06-24T04:07:50Z","caller":"requestcontrol/director.go:150","msg":"LLM response assembled","x-request-id":"42cab368-9e9d-4859-9e79-91cb60f65665","response":{"RequestId":"","Headers":{":status":"200","content-length":"237","content-type":"application/json","date":"Tue, 24 Jun 2025 04:07:50 GMT","server":"fasthttp","x-envoy-upstream-service-time":"0"},"Body":"","IsStreaming":false,"EndOfStream":false}} | |
| 2025-06-24T04:07:54.3515359Z {"level":"Level(-4)","ts":"2025-06-24T04:07:51Z","caller":"requestcontrol/director.go:94","msg":"LLM request assembled","x-request-id":"10b44d56-7b48-4914-8817-6a97e03ce524","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-x3wixbo1ie-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-x3wixbo1ie-vllm-sim-inference-pool-ip-b285da48.llm-d-x3wixbo1ie.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC14M3dpeGJvMWllLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc1NzY1NDc2ODgtczdsd3gKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXgzd2l4Ym8xaWUKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXgzd2l4Ym8xaWUvZGVwbG95bWVudHMvbGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXgzd2l4Ym8xaWUtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.21~llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx.llm-d-x3wixbo1ie~llm-d-x3wixbo1ie.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:10b44d56-7b48-4914-8817-6a97e03ce524]"} | |
| 2025-06-24T04:07:54.3537750Z {"level":"Level(-4)","ts":"2025-06-24T04:07:51Z","logger":"PD","caller":"pd/scheduler.go:103","msg":"Disagregated prefill/decode disabled - scheduling to decode worker only","x-request-id":"10b44d56-7b48-4914-8817-6a97e03ce524","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-x3wixbo1ie-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-x3wixbo1ie-vllm-sim-inference-pool-ip-b285da48.llm-d-x3wixbo1ie.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC14M3dpeGJvMWllLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc1NzY1NDc2ODgtczdsd3gKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXgzd2l4Ym8xaWUKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXgzd2l4Ym8xaWUvZGVwbG95bWVudHMvbGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXgzd2l4Ym8xaWUtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.21~llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx.llm-d-x3wixbo1ie~llm-d-x3wixbo1ie.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:10b44d56-7b48-4914-8817-6a97e03ce524]"} | |
| 2025-06-24T04:07:54.3559289Z {"level":"Level(-4)","ts":"2025-06-24T04:07:51Z","caller":"scheduling/scheduler.go:119","msg":"Scheduling a request, Metrics: [{Pod:{NamespacedName:llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs Address:10.244.0.24 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:prefill pod-template-hash:bff74c677]} MetricsState:{ActiveModels:map[] WaitingModels:map[] MaxActiveModels:0 RunningQueueSize:0 WaitingQueueSize:0 KVCacheUsagePercent:0 KvCacheMaxTokenCapacity:0 UpdateTime:2025-06-24 04:07:51.047225407 +0000 UTC m=+11.865875956}} {Pod:{NamespacedName:llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt Address:10.244.0.25 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:decode pod-template-hash:54dd48fd6c]} MetricsState:{ActiveModels:map[] WaitingModels:map[] MaxActiveModels:0 RunningQueueSize:0 WaitingQueueSize:0 KVCacheUsagePercent:0 KvCacheMaxTokenCapacity:0 UpdateTime:2025-06-24 04:07:51.040496513 +0000 UTC m=+11.859147052}}]","x-request-id":"10b44d56-7b48-4914-8817-6a97e03ce524","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-x3wixbo1ie-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-x3wixbo1ie-vllm-sim-inference-pool-ip-b285da48.llm-d-x3wixbo1ie.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC14M3dpeGJvMWllLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc1NzY1NDc2ODgtczdsd3gKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXgzd2l4Ym8xaWUKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXgzd2l4Ym8xaWUvZGVwbG95bWVudHMvbGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXgzd2l4Ym8xaWUtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.21~llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx.llm-d-x3wixbo1ie~llm-d-x3wixbo1ie.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:10b44d56-7b48-4914-8817-6a97e03ce524]"} | |
| 2025-06-24T04:07:54.3583038Z {"level":"Level(-4)","ts":"2025-06-24T04:07:51Z","caller":"scheduling/scheduler.go:149","msg":"Before running filter plugins","x-request-id":"10b44d56-7b48-4914-8817-6a97e03ce524","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-x3wixbo1ie-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-x3wixbo1ie-vllm-sim-inference-pool-ip-b285da48.llm-d-x3wixbo1ie.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC14M3dpeGJvMWllLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc1NzY1NDc2ODgtczdsd3gKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXgzd2l4Ym8xaWUKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXgzd2l4Ym8xaWUvZGVwbG95bWVudHMvbGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXgzd2l4Ym8xaWUtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.21~llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx.llm-d-x3wixbo1ie~llm-d-x3wixbo1ie.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:10b44d56-7b48-4914-8817-6a97e03ce524]","pods":[{"NamespacedName":{"Namespace":"llm-d-x3wixbo1ie","Name":"llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs"},"Address":"10.244.0.24","Labels":{"llm-d.ai/inferenceServing":"true","llm-d.ai/model":"food-review","llm-d.ai/role":"prefill","pod-template-hash":"bff74c677"},"ActiveModels":{},"WaitingModels":{},"MaxActiveModels":0,"RunningQueueSize":0,"WaitingQueueSize":0,"KVCacheUsagePercent":0,"KvCacheMaxTokenCapacity":0,"UpdateTime":"2025-06-24T04:07:51.047225407Z"},{"NamespacedName":{"Namespace":"llm-d-x3wixbo1ie","Name":"llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt"},"Address":"10.244.0.25","Labels":{"llm-d.ai/inferenceServing":"true","llm-d.ai/model":"food-review","llm-d.ai/role":"decode","pod-template-hash":"54dd48fd6c"},"ActiveModels":{},"WaitingModels":{},"MaxActiveModels":0,"RunningQueueSize":0,"WaitingQueueSize":0,"KVCacheUsagePercent":0,"KvCacheMaxTokenCapacity":0,"UpdateTime":"2025-06-24T04:07:51.040496513Z"}]} | |
| 2025-06-24T04:07:54.3603613Z {"level":"Level(-4)","ts":"2025-06-24T04:07:51Z","caller":"scheduling/scheduler.go:152","msg":"Running filter plugin","x-request-id":"10b44d56-7b48-4914-8817-6a97e03ce524","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-x3wixbo1ie-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-x3wixbo1ie-vllm-sim-inference-pool-ip-b285da48.llm-d-x3wixbo1ie.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC14M3dpeGJvMWllLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc1NzY1NDc2ODgtczdsd3gKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXgzd2l4Ym8xaWUKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXgzd2l4Ym8xaWUvZGVwbG95bWVudHMvbGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXgzd2l4Ym8xaWUtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.21~llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx.llm-d-x3wixbo1ie~llm-d-x3wixbo1ie.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:10b44d56-7b48-4914-8817-6a97e03ce524]","plugin":"decode-filter"} | |
| 2025-06-24T04:07:54.3625985Z {"level":"Level(-4)","ts":"2025-06-24T04:07:51Z","caller":"scheduling/scheduler.go:156","msg":"Filter plugin result","x-request-id":"10b44d56-7b48-4914-8817-6a97e03ce524","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-x3wixbo1ie-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-x3wixbo1ie-vllm-sim-inference-pool-ip-b285da48.llm-d-x3wixbo1ie.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC14M3dpeGJvMWllLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc1NzY1NDc2ODgtczdsd3gKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXgzd2l4Ym8xaWUKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXgzd2l4Ym8xaWUvZGVwbG95bWVudHMvbGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXgzd2l4Ym8xaWUtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.21~llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx.llm-d-x3wixbo1ie~llm-d-x3wixbo1ie.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:10b44d56-7b48-4914-8817-6a97e03ce524]","plugin":"decode-filter","pods":[{"NamespacedName":{"Namespace":"llm-d-x3wixbo1ie","Name":"llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt"},"Address":"10.244.0.25","Labels":{"llm-d.ai/inferenceServing":"true","llm-d.ai/model":"food-review","llm-d.ai/role":"decode","pod-template-hash":"54dd48fd6c"},"ActiveModels":{},"WaitingModels":{},"MaxActiveModels":0,"RunningQueueSize":0,"WaitingQueueSize":0,"KVCacheUsagePercent":0,"KvCacheMaxTokenCapacity":0,"UpdateTime":"2025-06-24T04:07:51.040496513Z"}]} | |
| 2025-06-24T04:07:54.3648596Z {"level":"Level(-4)","ts":"2025-06-24T04:07:51Z","caller":"scheduling/scheduler.go:161","msg":"After running filter plugins","x-request-id":"10b44d56-7b48-4914-8817-6a97e03ce524","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-x3wixbo1ie-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-x3wixbo1ie-vllm-sim-inference-pool-ip-b285da48.llm-d-x3wixbo1ie.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC14M3dpeGJvMWllLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc1NzY1NDc2ODgtczdsd3gKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXgzd2l4Ym8xaWUKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXgzd2l4Ym8xaWUvZGVwbG95bWVudHMvbGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXgzd2l4Ym8xaWUtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.21~llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx.llm-d-x3wixbo1ie~llm-d-x3wixbo1ie.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:10b44d56-7b48-4914-8817-6a97e03ce524]"} | |
| 2025-06-24T04:07:54.3667863Z {"level":"Level(-4)","ts":"2025-06-24T04:07:51Z","caller":"scheduling/scheduler.go:168","msg":"Before running scorer plugins","x-request-id":"10b44d56-7b48-4914-8817-6a97e03ce524","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-x3wixbo1ie-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-x3wixbo1ie-vllm-sim-inference-pool-ip-b285da48.llm-d-x3wixbo1ie.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC14M3dpeGJvMWllLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc1NzY1NDc2ODgtczdsd3gKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXgzd2l4Ym8xaWUKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXgzd2l4Ym8xaWUvZGVwbG95bWVudHMvbGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXgzd2l4Ym8xaWUtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.21~llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx.llm-d-x3wixbo1ie~llm-d-x3wixbo1ie.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:10b44d56-7b48-4914-8817-6a97e03ce524]","pods":[{"NamespacedName":{"Namespace":"llm-d-x3wixbo1ie","Name":"llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt"},"Address":"10.244.0.25","Labels":{"llm-d.ai/inferenceServing":"true","llm-d.ai/model":"food-review","llm-d.ai/role":"decode","pod-template-hash":"54dd48fd6c"},"ActiveModels":{},"WaitingModels":{},"MaxActiveModels":0,"RunningQueueSize":0,"WaitingQueueSize":0,"KVCacheUsagePercent":0,"KvCacheMaxTokenCapacity":0,"UpdateTime":"2025-06-24T04:07:51.040496513Z"}]} | |
| 2025-06-24T04:07:54.3686333Z {"level":"Level(-4)","ts":"2025-06-24T04:07:51Z","caller":"scheduling/scheduler.go:176","msg":"Running scorer","x-request-id":"10b44d56-7b48-4914-8817-6a97e03ce524","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-x3wixbo1ie-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-x3wixbo1ie-vllm-sim-inference-pool-ip-b285da48.llm-d-x3wixbo1ie.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC14M3dpeGJvMWllLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc1NzY1NDc2ODgtczdsd3gKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXgzd2l4Ym8xaWUKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXgzd2l4Ym8xaWUvZGVwbG95bWVudHMvbGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXgzd2l4Ym8xaWUtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.21~llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx.llm-d-x3wixbo1ie~llm-d-x3wixbo1ie.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:10b44d56-7b48-4914-8817-6a97e03ce524]","scorer":"load-aware-scorer"} | |
| 2025-06-24T04:07:54.3710288Z {"level":"Level(-4)","ts":"2025-06-24T04:07:51Z","caller":"scheduling/scheduler.go:183","msg":"After running scorer","x-request-id":"10b44d56-7b48-4914-8817-6a97e03ce524","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-x3wixbo1ie-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-x3wixbo1ie-vllm-sim-inference-pool-ip-b285da48.llm-d-x3wixbo1ie.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC14M3dpeGJvMWllLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc1NzY1NDc2ODgtczdsd3gKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXgzd2l4Ym8xaWUKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXgzd2l4Ym8xaWUvZGVwbG95bWVudHMvbGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXgzd2l4Ym8xaWUtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.21~llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx.llm-d-x3wixbo1ie~llm-d-x3wixbo1ie.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:10b44d56-7b48-4914-8817-6a97e03ce524]","scorer":"load-aware-scorer"} | |
| 2025-06-24T04:07:54.3728116Z {"level":"Level(-4)","ts":"2025-06-24T04:07:51Z","caller":"scheduling/scheduler.go:176","msg":"Running scorer","x-request-id":"10b44d56-7b48-4914-8817-6a97e03ce524","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-x3wixbo1ie-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-x3wixbo1ie-vllm-sim-inference-pool-ip-b285da48.llm-d-x3wixbo1ie.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC14M3dpeGJvMWllLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc1NzY1NDc2ODgtczdsd3gKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXgzd2l4Ym8xaWUKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXgzd2l4Ym8xaWUvZGVwbG95bWVudHMvbGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXgzd2l4Ym8xaWUtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.21~llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx.llm-d-x3wixbo1ie~llm-d-x3wixbo1ie.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:10b44d56-7b48-4914-8817-6a97e03ce524]","scorer":"prefix-aware-scorer"} | |
| 2025-06-24T04:07:54.3737226Z {"level":"Level(-4)","ts":"2025-06-24T04:07:51Z","logger":"prefix-aware-scorer","caller":"scorer/prefix_aware.go:69","msg":"Got pod scores","x-request-id":"10b44d56-7b48-4914-8817-6a97e03ce524","scores":null} | |
| 2025-06-24T04:07:54.3738252Z {"level":"Level(-4)","ts":"2025-06-24T04:07:51Z","logger":"prefix-aware-scorer","caller":"scorer/prefix_aware.go:72","msg":"No scores found for pods","x-request-id":"10b44d56-7b48-4914-8817-6a97e03ce524"} | |
| 2025-06-24T04:07:54.3746961Z {"level":"Level(-4)","ts":"2025-06-24T04:07:51Z","caller":"scheduling/scheduler.go:183","msg":"After running scorer","x-request-id":"10b44d56-7b48-4914-8817-6a97e03ce524","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-x3wixbo1ie-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-x3wixbo1ie-vllm-sim-inference-pool-ip-b285da48.llm-d-x3wixbo1ie.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC14M3dpeGJvMWllLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc1NzY1NDc2ODgtczdsd3gKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXgzd2l4Ym8xaWUKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXgzd2l4Ym8xaWUvZGVwbG95bWVudHMvbGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXgzd2l4Ym8xaWUtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.21~llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx.llm-d-x3wixbo1ie~llm-d-x3wixbo1ie.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:10b44d56-7b48-4914-8817-6a97e03ce524]","scorer":"prefix-aware-scorer"} | |
| 2025-06-24T04:07:54.3765647Z {"level":"Level(-4)","ts":"2025-06-24T04:07:51Z","caller":"scheduling/scheduler.go:185","msg":"After running scorer plugins","x-request-id":"10b44d56-7b48-4914-8817-6a97e03ce524","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-x3wixbo1ie-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-x3wixbo1ie-vllm-sim-inference-pool-ip-b285da48.llm-d-x3wixbo1ie.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC14M3dpeGJvMWllLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc1NzY1NDc2ODgtczdsd3gKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXgzd2l4Ym8xaWUKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXgzd2l4Ym8xaWUvZGVwbG95bWVudHMvbGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXgzd2l4Ym8xaWUtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.21~llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx.llm-d-x3wixbo1ie~llm-d-x3wixbo1ie.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:10b44d56-7b48-4914-8817-6a97e03ce524]"} | |
| 2025-06-24T04:07:54.3784905Z {"level":"Level(-4)","ts":"2025-06-24T04:07:51Z","caller":"scheduling/scheduler.go:199","msg":"Before running picker plugin","x-request-id":"10b44d56-7b48-4914-8817-6a97e03ce524","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-x3wixbo1ie-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-x3wixbo1ie-vllm-sim-inference-pool-ip-b285da48.llm-d-x3wixbo1ie.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC14M3dpeGJvMWllLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc1NzY1NDc2ODgtczdsd3gKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXgzd2l4Ym8xaWUKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXgzd2l4Ym8xaWUvZGVwbG95bWVudHMvbGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXgzd2l4Ym8xaWUtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.21~llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx.llm-d-x3wixbo1ie~llm-d-x3wixbo1ie.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:10b44d56-7b48-4914-8817-6a97e03ce524]","pods weighted score":"map[{Pod:{NamespacedName:llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt Address:10.244.0.25 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:decode pod-template-hash:54dd48fd6c]} MetricsState:{ActiveModels:map[] WaitingModels:map[] MaxActiveModels:0 RunningQueueSize:0 WaitingQueueSize:0 KVCacheUsagePercent:0 KvCacheMaxTokenCapacity:0 UpdateTime:2025-06-24 04:07:51.040496513 +0000 UTC m=+11.859147052}}:0.5]"} | |
| 2025-06-24T04:07:54.3815479Z {"level":"Level(-4)","ts":"2025-06-24T04:07:51Z","caller":"picker/max_score_picker.go:47","msg":"Selecting a pod with the max score from 1 candidates: [{Pod:{NamespacedName:llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt Address:10.244.0.25 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:decode pod-template-hash:54dd48fd6c]} MetricsState:{ActiveModels:map[] WaitingModels:map[] MaxActiveModels:0 RunningQueueSize:0 WaitingQueueSize:0 KVCacheUsagePercent:0 KvCacheMaxTokenCapacity:0 UpdateTime:2025-06-24 04:07:51.040496513 +0000 UTC m=+11.859147052}}]","x-request-id":"10b44d56-7b48-4914-8817-6a97e03ce524","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-x3wixbo1ie-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-x3wixbo1ie-vllm-sim-inference-pool-ip-b285da48.llm-d-x3wixbo1ie.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC14M3dpeGJvMWllLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc1NzY1NDc2ODgtczdsd3gKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXgzd2l4Ym8xaWUKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXgzd2l4Ym8xaWUvZGVwbG95bWVudHMvbGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXgzd2l4Ym8xaWUtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.21~llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx.llm-d-x3wixbo1ie~llm-d-x3wixbo1ie.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:10b44d56-7b48-4914-8817-6a97e03ce524]"} | |
| 2025-06-24T04:07:54.3846397Z {"level":"Level(-4)","ts":"2025-06-24T04:07:51Z","caller":"scheduling/scheduler.go:203","msg":"After running picker plugin","x-request-id":"10b44d56-7b48-4914-8817-6a97e03ce524","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-x3wixbo1ie-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-x3wixbo1ie-vllm-sim-inference-pool-ip-b285da48.llm-d-x3wixbo1ie.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC14M3dpeGJvMWllLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc1NzY1NDc2ODgtczdsd3gKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXgzd2l4Ym8xaWUKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXgzd2l4Ym8xaWUvZGVwbG95bWVudHMvbGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXgzd2l4Ym8xaWUtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.21~llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx.llm-d-x3wixbo1ie~llm-d-x3wixbo1ie.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:10b44d56-7b48-4914-8817-6a97e03ce524]","result":{"TargetPod":{"Pod":{"NamespacedName":{"Namespace":"llm-d-x3wixbo1ie","Name":"llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt"},"Address":"10.244.0.25","Labels":{"llm-d.ai/inferenceServing":"true","llm-d.ai/model":"food-review","llm-d.ai/role":"decode","pod-template-hash":"54dd48fd6c"},"ActiveModels":{},"WaitingModels":{},"MaxActiveModels":0,"RunningQueueSize":0,"WaitingQueueSize":0,"KVCacheUsagePercent":0,"KvCacheMaxTokenCapacity":0,"UpdateTime":"2025-06-24T04:07:51.040496513Z"},"Score":0.5}}} | |
| 2025-06-24T04:07:54.3877035Z {"level":"Level(-4)","ts":"2025-06-24T04:07:51Z","caller":"scheduling/scheduler.go:210","msg":"Running post-schedule plugin","x-request-id":"10b44d56-7b48-4914-8817-6a97e03ce524","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-x3wixbo1ie-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-x3wixbo1ie-vllm-sim-inference-pool-ip-b285da48.llm-d-x3wixbo1ie.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC14M3dpeGJvMWllLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc1NzY1NDc2ODgtczdsd3gKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXgzd2l4Ym8xaWUKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXgzd2l4Ym8xaWUvZGVwbG95bWVudHMvbGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXgzd2l4Ym8xaWUtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.21~llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx.llm-d-x3wixbo1ie~llm-d-x3wixbo1ie.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:10b44d56-7b48-4914-8817-6a97e03ce524]","plugin":"prefix-aware-scorer"} | |
| 2025-06-24T04:07:54.3909534Z {"level":"info","ts":"2025-06-24T04:07:51Z","logger":"prefix-aware-scorer","caller":"scorer/prefix_aware.go:106","msg":"PostResponse called","x-request-id":"10b44d56-7b48-4914-8817-6a97e03ce524","req":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-x3wixbo1ie-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-x3wixbo1ie-vllm-sim-inference-pool-ip-b285da48.llm-d-x3wixbo1ie.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC14M3dpeGJvMWllLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc1NzY1NDc2ODgtczdsd3gKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXgzd2l4Ym8xaWUKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXgzd2l4Ym8xaWUvZGVwbG95bWVudHMvbGxtLWQteDN3aXhibzFpZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXgzd2l4Ym8xaWUtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.21~llm-d-x3wixbo1ie-inference-gateway-istio-7576547688-s7lwx.llm-d-x3wixbo1ie~llm-d-x3wixbo1ie.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:10b44d56-7b48-4914-8817-6a97e03ce524]","pod":"{Pod:{NamespacedName:llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt Address:10.244.0.25 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:decode pod-template-hash:54dd48fd6c]} MetricsState:{ActiveModels:map[] WaitingModels:map[] MaxActiveModels:0 RunningQueueSize:0 WaitingQueueSize:0 KVCacheUsagePercent:0 KvCacheMaxTokenCapacity:0 UpdateTime:2025-06-24 04:07:51.040496513 +0000 UTC m=+11.859147052}}"} | |
| 2025-06-24T04:07:54.3925741Z {"level":"Level(-2)","ts":"2025-06-24T04:07:51Z","caller":"requestcontrol/director.go:135","msg":"Request handled","x-request-id":"10b44d56-7b48-4914-8817-6a97e03ce524","model":"food-review","targetModel":"food-review","endpoint":"{NamespacedName:llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-vllm-sim-decode-54dd48fd6c-7f8mt Address:10.244.0.25 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:decode pod-template-hash:54dd48fd6c]}"} | |
| 2025-06-24T04:07:54.3930046Z {"level":"Level(-4)","ts":"2025-06-24T04:07:51Z","caller":"requestcontrol/director.go:150","msg":"LLM response assembled","x-request-id":"10b44d56-7b48-4914-8817-6a97e03ce524","response":{"RequestId":"10b44d56-7b48-4914-8817-6a97e03ce524","Headers":{":status":"200","content-length":"243","content-type":"application/json","date":"Tue, 24 Jun 2025 04:07:50 GMT","server":"fasthttp","x-envoy-upstream-service-time":"0"},"Body":"","IsStreaming":false,"EndOfStream":false}} | |
| 2025-06-24T04:07:54.3931583Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:54.3932230Z <== Logs of container llm-d-x3wixbo1ie-vllm-sim-epp-7bd6f8cffc-vdwtj | |
| 2025-06-24T04:07:54.3932981Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:54.3933721Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:54.3934700Z ==> Description of pod llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs | |
| 2025-06-24T04:07:54.3935250Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:54.3936015Z >>> kubectl --request-timeout=30s describe pod llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs --namespace llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:54.4031245Z Name: llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs | |
| 2025-06-24T04:07:54.4031898Z Namespace: llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:54.4032284Z Priority: 0 | |
| 2025-06-24T04:07:54.4032658Z Service Account: llm-d-x3wixbo1ie-vllm-sim-sa | |
| 2025-06-24T04:07:54.4033186Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T04:07:54.4033683Z Start Time: Tue, 24 Jun 2025 04:07:38 +0000 | |
| 2025-06-24T04:07:54.4034158Z Labels: llm-d.ai/inferenceServing=true | |
| 2025-06-24T04:07:54.4034611Z llm-d.ai/model=food-review | |
| 2025-06-24T04:07:54.4034952Z llm-d.ai/role=prefill | |
| 2025-06-24T04:07:54.4035240Z pod-template-hash=bff74c677 | |
| 2025-06-24T04:07:54.4035611Z Annotations: <none> | |
| 2025-06-24T04:07:54.4035818Z Status: Running | |
| 2025-06-24T04:07:54.4036008Z IP: 10.244.0.24 | |
| 2025-06-24T04:07:54.4036541Z IPs: | |
| 2025-06-24T04:07:54.4036689Z IP: 10.244.0.24 | |
| 2025-06-24T04:07:54.4037001Z Controlled By: ReplicaSet/llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677 | |
| 2025-06-24T04:07:54.4037327Z Containers: | |
| 2025-06-24T04:07:54.4037484Z vllm: | |
| 2025-06-24T04:07:54.4037845Z Container ID: containerd://47f6ca84c597358ac65544313a15fdb45d6ca56e030b16a289ff07c3262e4698 | |
| 2025-06-24T04:07:54.4038311Z Image: ghcr.io/llm-d/llm-d-inference-sim:0.0.4 | |
| 2025-06-24T04:07:54.4038817Z Image ID: ghcr.io/llm-d/llm-d-inference-sim@sha256:5995c4dde42888844812359c121899c1d12e647588ed58fef206c3c653315338 | |
| 2025-06-24T04:07:54.4039270Z Port: 5557/TCP | |
| 2025-06-24T04:07:54.4039474Z Host Port: 0/TCP | |
| 2025-06-24T04:07:54.4039655Z Args: | |
| 2025-06-24T04:07:54.4040003Z --model | |
| 2025-06-24T04:07:54.4040209Z food-review | |
| 2025-06-24T04:07:54.4040386Z --port | |
| 2025-06-24T04:07:54.4040539Z 8000 | |
| 2025-06-24T04:07:54.4040699Z State: Running | |
| 2025-06-24T04:07:54.4040927Z Started: Tue, 24 Jun 2025 04:07:39 +0000 | |
| 2025-06-24T04:07:54.4041177Z Ready: True | |
| 2025-06-24T04:07:54.4041367Z Restart Count: 0 | |
| 2025-06-24T04:07:54.4041537Z Environment: | |
| 2025-06-24T04:07:54.4041704Z HOME: /home | |
| 2025-06-24T04:07:54.4041861Z Mounts: | |
| 2025-06-24T04:07:54.4042022Z /home from home (rw) | |
| 2025-06-24T04:07:54.4042357Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-7m67n (ro) | |
| 2025-06-24T04:07:54.4042718Z Conditions: | |
| 2025-06-24T04:07:54.4042885Z Type Status | |
| 2025-06-24T04:07:54.4043128Z PodReadyToStartContainers True | |
| 2025-06-24T04:07:54.4043365Z Initialized True | |
| 2025-06-24T04:07:54.4043592Z Ready True | |
| 2025-06-24T04:07:54.4043811Z ContainersReady True | |
| 2025-06-24T04:07:54.4044031Z PodScheduled True | |
| 2025-06-24T04:07:54.4044231Z Volumes: | |
| 2025-06-24T04:07:54.4044385Z home: | |
| 2025-06-24T04:07:54.4044642Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T04:07:54.4044969Z Medium: | |
| 2025-06-24T04:07:54.4045151Z SizeLimit: <unset> | |
| 2025-06-24T04:07:54.4045354Z kube-api-access-7m67n: | |
| 2025-06-24T04:07:54.4045684Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T04:07:54.4046048Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T04:07:54.4046301Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T04:07:54.4046694Z ConfigMapOptional: <nil> | |
| 2025-06-24T04:07:54.4046974Z DownwardAPI: true | |
| 2025-06-24T04:07:54.4047197Z QoS Class: BestEffort | |
| 2025-06-24T04:07:54.4047430Z Node-Selectors: <none> | |
| 2025-06-24T04:07:54.4047922Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T04:07:54.4048346Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T04:07:54.4048642Z Events: | |
| 2025-06-24T04:07:54.4048832Z Type Reason Age From Message | |
| 2025-06-24T04:07:54.4049108Z ---- ------ ---- ---- ------- | |
| 2025-06-24T04:07:54.4049893Z Normal Scheduled 16s default-scheduler Successfully assigned llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs to chart-testing-control-plane | |
| 2025-06-24T04:07:54.4050770Z Normal Pulled 15s kubelet Container image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" already present on machine | |
| 2025-06-24T04:07:54.4051295Z Normal Created 15s kubelet Created container vllm | |
| 2025-06-24T04:07:54.4051656Z Normal Started 15s kubelet Started container vllm | |
| 2025-06-24T04:07:54.4056063Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:54.4056806Z <== Description of pod llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs | |
| 2025-06-24T04:07:54.4057381Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:54.4058977Z >>> kubectl --request-timeout=30s get pods llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs --no-headers --namespace llm-d-x3wixbo1ie --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T04:07:54.4599114Z >>> kubectl --request-timeout=30s get pods llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs --no-headers --namespace llm-d-x3wixbo1ie --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T04:07:54.5143427Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:54.5144719Z ==> Logs of container llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs | |
| 2025-06-24T04:07:54.5145674Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:54.5159404Z >>> kubectl --request-timeout=30s logs llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs --namespace llm-d-x3wixbo1ie --container vllm | |
| 2025-06-24T04:07:54.5680468Z I0624 04:07:39.327272 1 cmd.go:36] "Start vllm simulator" | |
| 2025-06-24T04:07:54.5681123Z I0624 04:07:39.327637 1 simulator.go:135] "Server starting" port=8000 | |
| 2025-06-24T04:07:54.5701487Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:54.5702361Z <== Logs of container llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-dtqjs | |
| 2025-06-24T04:07:54.5703164Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:54.5703635Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:54.5704054Z ==> Description of pod llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-nx9ff | |
| 2025-06-24T04:07:54.5704464Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:54.5705212Z >>> kubectl --request-timeout=30s describe pod llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-nx9ff --namespace llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:54.6283959Z Name: llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-nx9ff | |
| 2025-06-24T04:07:54.6284570Z Namespace: llm-d-x3wixbo1ie | |
| 2025-06-24T04:07:54.6284970Z Priority: 0 | |
| 2025-06-24T04:07:54.6285383Z Service Account: llm-d-x3wixbo1ie-vllm-sim-sa | |
| 2025-06-24T04:07:54.6285896Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T04:07:54.6286375Z Start Time: Tue, 24 Jun 2025 04:07:00 +0000 | |
| 2025-06-24T04:07:54.6286842Z Labels: llm-d.ai/inferenceServing=true | |
| 2025-06-24T04:07:54.6287804Z llm-d.ai/model=food-review | |
| 2025-06-24T04:07:54.6288216Z llm-d.ai/role=prefill | |
| 2025-06-24T04:07:54.6288612Z pod-template-hash=bff74c677 | |
| 2025-06-24T04:07:54.6289022Z Annotations: <none> | |
| 2025-06-24T04:07:54.6289416Z Status: Terminating (lasts <invalid>) | |
| 2025-06-24T04:07:54.6290111Z Termination Grace Period: 30s | |
| 2025-06-24T04:07:54.6290462Z IP: 10.244.0.19 | |
| 2025-06-24T04:07:54.6290778Z IPs: | |
| 2025-06-24T04:07:54.6291013Z IP: 10.244.0.19 | |
| 2025-06-24T04:07:54.6291494Z Controlled By: ReplicaSet/llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677 | |
| 2025-06-24T04:07:54.6292029Z Containers: | |
| 2025-06-24T04:07:54.6292261Z vllm: | |
| 2025-06-24T04:07:54.6292823Z Container ID: containerd://7426c0d7482af9be8435b1c68309962227aa25497a79c744db832d4407b9aed7 | |
| 2025-06-24T04:07:54.6293579Z Image: ghcr.io/llm-d/llm-d-inference-sim:0.0.4 | |
| 2025-06-24T04:07:54.6294398Z Image ID: ghcr.io/llm-d/llm-d-inference-sim@sha256:5995c4dde42888844812359c121899c1d12e647588ed58fef206c3c653315338 | |
| 2025-06-24T04:07:54.6295145Z Port: 5557/TCP | |
| 2025-06-24T04:07:54.6295458Z Host Port: 0/TCP | |
| 2025-06-24T04:07:54.6295963Z Args: | |
| 2025-06-24T04:07:54.6296200Z --model | |
| 2025-06-24T04:07:54.6296456Z food-review | |
| 2025-06-24T04:07:54.6296716Z --port | |
| 2025-06-24T04:07:54.6296960Z 8000 | |
| 2025-06-24T04:07:54.6297214Z State: Running | |
| 2025-06-24T04:07:54.6297559Z Started: Tue, 24 Jun 2025 04:07:09 +0000 | |
| 2025-06-24T04:07:54.6297949Z Ready: True | |
| 2025-06-24T04:07:54.6298242Z Restart Count: 0 | |
| 2025-06-24T04:07:54.6298531Z Environment: | |
| 2025-06-24T04:07:54.6298787Z HOME: /home | |
| 2025-06-24T04:07:54.6299047Z Mounts: | |
| 2025-06-24T04:07:54.6299294Z /home from home (rw) | |
| 2025-06-24T04:07:54.6300020Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-95ccq (ro) | |
| 2025-06-24T04:07:54.6300628Z Conditions: | |
| 2025-06-24T04:07:54.6300893Z Type Status | |
| 2025-06-24T04:07:54.6301275Z PodReadyToStartContainers True | |
| 2025-06-24T04:07:54.6301657Z Initialized True | |
| 2025-06-24T04:07:54.6302008Z Ready True | |
| 2025-06-24T04:07:54.6302365Z ContainersReady True | |
| 2025-06-24T04:07:54.6302726Z PodScheduled True | |
| 2025-06-24T04:07:54.6303055Z Volumes: | |
| 2025-06-24T04:07:54.6303297Z home: | |
| 2025-06-24T04:07:54.6303686Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T04:07:54.6304181Z Medium: | |
| 2025-06-24T04:07:54.6304440Z SizeLimit: <unset> | |
| 2025-06-24T04:07:54.6304743Z kube-api-access-95ccq: | |
| 2025-06-24T04:07:54.6305341Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T04:07:54.6305923Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T04:07:54.6306335Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T04:07:54.6306764Z ConfigMapOptional: <nil> | |
| 2025-06-24T04:07:54.6307145Z DownwardAPI: true | |
| 2025-06-24T04:07:54.6307510Z QoS Class: BestEffort | |
| 2025-06-24T04:07:54.6307895Z Node-Selectors: <none> | |
| 2025-06-24T04:07:54.6308440Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T04:07:54.6309102Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T04:07:54.6309611Z Events: | |
| 2025-06-24T04:07:54.6310061Z Type Reason Age From Message | |
| 2025-06-24T04:07:54.6310506Z ---- ------ ---- ---- ------- | |
| 2025-06-24T04:07:54.6311960Z Normal Scheduled 54s default-scheduler Successfully assigned llm-d-x3wixbo1ie/llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-nx9ff to chart-testing-control-plane | |
| 2025-06-24T04:07:54.6313435Z Normal Pulling 53s kubelet Pulling image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" | |
| 2025-06-24T04:07:54.6314909Z Normal Pulled 46s kubelet Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" in 683ms (7.408s including waiting). Image size: 87011014 bytes. | |
| 2025-06-24T04:07:54.6316030Z Normal Created 46s kubelet Created container vllm | |
| 2025-06-24T04:07:54.6316657Z Normal Started 45s kubelet Started container vllm | |
| 2025-06-24T04:07:54.6317266Z Normal Killing 16s kubelet Stopping container vllm | |
| 2025-06-24T04:07:54.6317663Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:54.6318174Z <== Description of pod llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-nx9ff | |
| 2025-06-24T04:07:54.6318582Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:07:54.6319363Z >>> kubectl --request-timeout=30s get pods llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-nx9ff --no-headers --namespace llm-d-x3wixbo1ie --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T04:07:54.6846357Z >>> kubectl --request-timeout=30s get pods llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-nx9ff --no-headers --namespace llm-d-x3wixbo1ie --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T04:07:54.7370836Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:54.7371710Z ==> Logs of container llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-nx9ff | |
| 2025-06-24T04:07:54.7372228Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:54.7372962Z >>> kubectl --request-timeout=30s logs llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-nx9ff --namespace llm-d-x3wixbo1ie --container vllm | |
| 2025-06-24T04:07:54.7903809Z I0624 04:07:09.067551 1 cmd.go:36] "Start vllm simulator" | |
| 2025-06-24T04:07:54.7910849Z I0624 04:07:09.067706 1 simulator.go:135] "Server starting" port=8000 | |
| 2025-06-24T04:07:54.7911556Z I0624 04:07:38.418028 1 simulator.go:294] "reqProcessingWorker stopped:" worker id=5 | |
| 2025-06-24T04:07:54.7912150Z I0624 04:07:38.418073 1 simulator.go:294] "reqProcessingWorker stopped:" worker id=4 | |
| 2025-06-24T04:07:54.7912605Z I0624 04:07:38.418100 1 simulator.go:294] "reqProcessingWorker stopped:" worker id=3 | |
| 2025-06-24T04:07:54.7913035Z I0624 04:07:38.418118 1 simulator.go:294] "reqProcessingWorker stopped:" worker id=1 | |
| 2025-06-24T04:07:54.7913476Z I0624 04:07:38.418125 1 simulator.go:294] "reqProcessingWorker stopped:" worker id=2 | |
| 2025-06-24T04:07:54.7926184Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:54.7927262Z <== Logs of container llm-d-x3wixbo1ie-vllm-sim-prefill-bff74c677-nx9ff | |
| 2025-06-24T04:07:54.7928109Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:07:54.7928695Z ======================================================================================================================== | |
| 2025-06-24T04:07:54.7929115Z Deleting release "llm-d-x3wixbo1ie"... | |
| 2025-06-24T04:07:54.7929493Z >>> helm uninstall llm-d-x3wixbo1ie --namespace llm-d-x3wixbo1ie --timeout 500s | |
| 2025-06-24T04:07:55.3690997Z release "llm-d-x3wixbo1ie" uninstalled | |
| 2025-06-24T04:07:55.3741938Z Deleting namespace "llm-d-x3wixbo1ie"... | |
| 2025-06-24T04:07:55.3748793Z >>> kubectl --request-timeout=30s delete namespace llm-d-x3wixbo1ie --timeout 180s | |
| 2025-06-24T04:07:55.4628070Z namespace "llm-d-x3wixbo1ie" deleted | |
| 2025-06-24T04:08:32.4368084Z >>> kubectl --request-timeout=30s get namespace llm-d-x3wixbo1ie | |
| 2025-06-24T04:08:32.4893748Z Namespace "llm-d-x3wixbo1ie" terminated. | |
| 2025-06-24T04:08:32.4894660Z Testing upgrades of chart "llm-d => (version: \"1.0.21\", path: \"charts/llm-d\")" relative to previous revision "llm-d => (version: \"1.0.21\", path: \"charts/llm-d\")"... | |
| 2025-06-24T04:08:32.4895714Z | |
| 2025-06-24T04:08:32.4896148Z Installing chart "llm-d => (version: \"1.0.21\", path: \"charts/llm-d\")" with values file "charts/llm-d/ci/default-values.yaml"... | |
| 2025-06-24T04:08:32.4896527Z | |
| 2025-06-24T04:08:32.4896685Z Creating namespace "llm-d-4crf2glv0w"... | |
| 2025-06-24T04:08:32.4897065Z >>> kubectl --request-timeout=30s create namespace llm-d-4crf2glv0w | |
| 2025-06-24T04:08:32.5370919Z namespace/llm-d-4crf2glv0w created | |
| 2025-06-24T04:08:32.5393861Z >>> helm install llm-d-4crf2glv0w charts/llm-d --namespace llm-d-4crf2glv0w --wait --values charts/llm-d/ci/default-values.yaml --timeout 500s | |
| 2025-06-24T04:08:59.6033224Z NAME: llm-d-4crf2glv0w | |
| 2025-06-24T04:08:59.6033814Z LAST DEPLOYED: Tue Jun 24 04:08:32 2025 | |
| 2025-06-24T04:08:59.6034423Z NAMESPACE: llm-d-4crf2glv0w | |
| 2025-06-24T04:08:59.6034810Z STATUS: deployed | |
| 2025-06-24T04:08:59.6035107Z REVISION: 1 | |
| 2025-06-24T04:08:59.6035358Z NOTES: | |
| 2025-06-24T04:08:59.6035649Z Thank you for installing llm-d. | |
| 2025-06-24T04:08:59.6035901Z | |
| 2025-06-24T04:08:59.6036094Z Your release is named `llm-d-4crf2glv0w`. | |
| 2025-06-24T04:08:59.6036400Z | |
| 2025-06-24T04:08:59.6036547Z To learn more about the release, try: | |
| 2025-06-24T04:08:59.6036817Z | |
| 2025-06-24T04:08:59.6036921Z ```bash | |
| 2025-06-24T04:08:59.6037200Z $ helm status llm-d-4crf2glv0w | |
| 2025-06-24T04:08:59.6038017Z $ helm get all llm-d-4crf2glv0w | |
| 2025-06-24T04:08:59.6038352Z ``` | |
| 2025-06-24T04:08:59.6038490Z | |
| 2025-06-24T04:08:59.6038496Z | |
| 2025-06-24T04:08:59.6038690Z Following presets are available to your users: | |
| 2025-06-24T04:08:59.6039010Z | |
| 2025-06-24T04:08:59.6039016Z | |
| 2025-06-24T04:08:59.6039022Z | |
| 2025-06-24T04:08:59.6039313Z | Name | Description | | |
| 2025-06-24T04:08:59.6040404Z | ----------------------------------------------------------------- | ----------------------------------------------------------------------------------------------- | | |
| 2025-06-24T04:08:59.6041362Z | basic-gpu-preset | Basic gpu inference | | |
| 2025-06-24T04:08:59.6042443Z | basic-gpu-with-nixl-preset | GPU inference with NIXL P/D KV transfer and cache offloading | | |
| 2025-06-24T04:08:59.6043862Z | basic-gpu-with-nixl-and-redis-lookup-preset | GPU inference with NIXL P/D KV transfer, cache offloading and Redis lookup server | | |
| 2025-06-24T04:08:59.6045016Z | basic-sim-preset | Basic simulation | | |
| 2025-06-24T04:08:59.6045523Z | |
| 2025-06-24T04:08:59.6045685Z To provision a `ModelService`, create a new CR: | |
| 2025-06-24T04:08:59.6045976Z | |
| 2025-06-24T04:08:59.6046070Z ```yaml | |
| 2025-06-24T04:08:59.6046320Z apiVersion: llm-d.ai/v1alpha1 | |
| 2025-06-24T04:08:59.6046648Z kind: ModelService | |
| 2025-06-24T04:08:59.6046910Z metadata: | |
| 2025-06-24T04:08:59.6047144Z name: <name> | |
| 2025-06-24T04:08:59.6047385Z spec: | |
| 2025-06-24T04:08:59.6047632Z decoupleScaling: false | |
| 2025-06-24T04:08:59.6047941Z baseConfigMapRef: | |
| 2025-06-24T04:08:59.6048315Z name: basic-gpu-with-nixl-and-redis-lookup-preset | |
| 2025-06-24T04:08:59.6048771Z routing: | |
| 2025-06-24T04:08:59.6049036Z modelName: <model_name> | |
| 2025-06-24T04:08:59.6049368Z modelArtifacts: | |
| 2025-06-24T04:08:59.6049687Z uri: pvc://<pvc_name>/<path_to_model> | |
| 2025-06-24T04:08:59.6050217Z decode: | |
| 2025-06-24T04:08:59.6050468Z replicas: 1 | |
| 2025-06-24T04:08:59.6050735Z containers: | |
| 2025-06-24T04:08:59.6051005Z - name: "vllm" | |
| 2025-06-24T04:08:59.6051273Z args: | |
| 2025-06-24T04:08:59.6051518Z - "--model" | |
| 2025-06-24T04:08:59.6051780Z - <model_name> | |
| 2025-06-24T04:08:59.6052050Z prefill: | |
| 2025-06-24T04:08:59.6052283Z replicas: 1 | |
| 2025-06-24T04:08:59.6052552Z containers: | |
| 2025-06-24T04:08:59.6052813Z - name: "vllm" | |
| 2025-06-24T04:08:59.6053294Z args: | |
| 2025-06-24T04:08:59.6053530Z - "--model" | |
| 2025-06-24T04:08:59.6053771Z - <model_name> | |
| 2025-06-24T04:08:59.6054008Z ``` | |
| 2025-06-24T04:08:59.6080461Z >>> kubectl --request-timeout=30s get deployments --namespace llm-d-4crf2glv0w --selector --output jsonpath={.items[*].metadata.name} | |
| 2025-06-24T04:08:59.6661047Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-4crf2glv0w-inference-gateway-istio --namespace llm-d-4crf2glv0w | |
| 2025-06-24T04:08:59.7418688Z deployment "llm-d-4crf2glv0w-inference-gateway-istio" successfully rolled out | |
| 2025-06-24T04:08:59.7501113Z >>> kubectl --request-timeout=30s get deployment llm-d-4crf2glv0w-inference-gateway-istio --namespace llm-d-4crf2glv0w --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T04:08:59.8378190Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-4crf2glv0w-modelservice --namespace llm-d-4crf2glv0w | |
| 2025-06-24T04:08:59.8989220Z deployment "llm-d-4crf2glv0w-modelservice" successfully rolled out | |
| 2025-06-24T04:08:59.9012651Z >>> kubectl --request-timeout=30s get deployment llm-d-4crf2glv0w-modelservice --namespace llm-d-4crf2glv0w --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T04:08:59.9563208Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-4crf2glv0w-redis-master --namespace llm-d-4crf2glv0w | |
| 2025-06-24T04:09:00.0163029Z deployment "llm-d-4crf2glv0w-redis-master" successfully rolled out | |
| 2025-06-24T04:09:00.0189724Z >>> kubectl --request-timeout=30s get deployment llm-d-4crf2glv0w-redis-master --namespace llm-d-4crf2glv0w --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T04:09:00.0710320Z >>> helm test llm-d-4crf2glv0w --namespace llm-d-4crf2glv0w --timeout 500s | |
| 2025-06-24T04:09:14.6514782Z NAME: llm-d-4crf2glv0w | |
| 2025-06-24T04:09:14.6516882Z LAST DEPLOYED: Tue Jun 24 04:08:32 2025 | |
| 2025-06-24T04:09:14.6517359Z NAMESPACE: llm-d-4crf2glv0w | |
| 2025-06-24T04:09:14.6517711Z STATUS: deployed | |
| 2025-06-24T04:09:14.6518112Z REVISION: 1 | |
| 2025-06-24T04:09:14.6518490Z TEST SUITE: llm-d-4crf2glv0w-test-connection | |
| 2025-06-24T04:09:14.6518984Z Last Started: Tue Jun 24 04:09:00 2025 | |
| 2025-06-24T04:09:14.6519401Z Last Completed: Tue Jun 24 04:09:14 2025 | |
| 2025-06-24T04:09:14.6520033Z Phase: Succeeded | |
| 2025-06-24T04:09:14.6520548Z TEST SUITE: llm-d-4crf2glv0w-vllm-sim | |
| 2025-06-24T04:09:14.6520973Z Last Started: Tue Jun 24 04:09:00 2025 | |
| 2025-06-24T04:09:14.6521377Z Last Completed: Tue Jun 24 04:09:00 2025 | |
| 2025-06-24T04:09:14.6521766Z Phase: Succeeded | |
| 2025-06-24T04:09:14.6522122Z TEST SUITE: llm-d-4crf2glv0w-vllm-sim | |
| 2025-06-24T04:09:14.6522540Z Last Started: Tue Jun 24 04:09:00 2025 | |
| 2025-06-24T04:09:14.6522937Z Last Completed: Tue Jun 24 04:09:00 2025 | |
| 2025-06-24T04:09:14.6523325Z Phase: Succeeded | |
| 2025-06-24T04:09:14.6523626Z NOTES: | |
| 2025-06-24T04:09:14.6523903Z Thank you for installing llm-d. | |
| 2025-06-24T04:09:14.6524145Z | |
| 2025-06-24T04:09:14.6524301Z Your release is named `llm-d-4crf2glv0w`. | |
| 2025-06-24T04:09:14.6524593Z | |
| 2025-06-24T04:09:14.6524744Z To learn more about the release, try: | |
| 2025-06-24T04:09:14.6525015Z | |
| 2025-06-24T04:09:14.6525124Z ```bash | |
| 2025-06-24T04:09:14.6525405Z $ helm status llm-d-4crf2glv0w | |
| 2025-06-24T04:09:14.6525773Z $ helm get all llm-d-4crf2glv0w | |
| 2025-06-24T04:09:14.6526106Z ``` | |
| 2025-06-24T04:09:14.6526243Z | |
| 2025-06-24T04:09:14.6526249Z | |
| 2025-06-24T04:09:14.6526421Z Following presets are available to your users: | |
| 2025-06-24T04:09:14.6526738Z | |
| 2025-06-24T04:09:14.6526745Z | |
| 2025-06-24T04:09:14.6526750Z | |
| 2025-06-24T04:09:14.6527037Z | Name | Description | | |
| 2025-06-24T04:09:14.6527815Z | ----------------------------------------------------------------- | ----------------------------------------------------------------------------------------------- | | |
| 2025-06-24T04:09:14.6529032Z | basic-gpu-preset | Basic gpu inference | | |
| 2025-06-24T04:09:14.6530195Z | basic-gpu-with-nixl-preset | GPU inference with NIXL P/D KV transfer and cache offloading | | |
| 2025-06-24T04:09:14.6531534Z | basic-gpu-with-nixl-and-redis-lookup-preset | GPU inference with NIXL P/D KV transfer, cache offloading and Redis lookup server | | |
| 2025-06-24T04:09:14.6532797Z | basic-sim-preset | Basic simulation | | |
| 2025-06-24T04:09:14.6533313Z | |
| 2025-06-24T04:09:14.6533498Z To provision a `ModelService`, create a new CR: | |
| 2025-06-24T04:09:14.6533817Z | |
| 2025-06-24T04:09:14.6533925Z ```yaml | |
| 2025-06-24T04:09:14.6534208Z apiVersion: llm-d.ai/v1alpha1 | |
| 2025-06-24T04:09:14.6534557Z kind: ModelService | |
| 2025-06-24T04:09:14.6534845Z metadata: | |
| 2025-06-24T04:09:14.6535092Z name: <name> | |
| 2025-06-24T04:09:14.6535369Z spec: | |
| 2025-06-24T04:09:14.6535633Z decoupleScaling: false | |
| 2025-06-24T04:09:14.6535968Z baseConfigMapRef: | |
| 2025-06-24T04:09:14.6536364Z name: basic-gpu-with-nixl-and-redis-lookup-preset | |
| 2025-06-24T04:09:14.6536806Z routing: | |
| 2025-06-24T04:09:14.6537315Z modelName: <model_name> | |
| 2025-06-24T04:09:14.6537617Z modelArtifacts: | |
| 2025-06-24T04:09:14.6537901Z uri: pvc://<pvc_name>/<path_to_model> | |
| 2025-06-24T04:09:14.6538233Z decode: | |
| 2025-06-24T04:09:14.6538452Z replicas: 1 | |
| 2025-06-24T04:09:14.6538691Z containers: | |
| 2025-06-24T04:09:14.6538956Z - name: "vllm" | |
| 2025-06-24T04:09:14.6539230Z args: | |
| 2025-06-24T04:09:14.6539480Z - "--model" | |
| 2025-06-24T04:09:14.6539755Z - <model_name> | |
| 2025-06-24T04:09:14.6540188Z prefill: | |
| 2025-06-24T04:09:14.6540437Z replicas: 1 | |
| 2025-06-24T04:09:14.6540709Z containers: | |
| 2025-06-24T04:09:14.6540974Z - name: "vllm" | |
| 2025-06-24T04:09:14.6541222Z args: | |
| 2025-06-24T04:09:14.6541458Z - "--model" | |
| 2025-06-24T04:09:14.6541716Z - <model_name> | |
| 2025-06-24T04:09:14.6541971Z ``` | |
| 2025-06-24T04:09:14.6550128Z >>> helm upgrade llm-d-4crf2glv0w charts/llm-d --namespace llm-d-4crf2glv0w --reuse-values --wait --timeout 500s | |
| 2025-06-24T04:09:16.1491826Z Error: UPGRADE FAILED: cannot patch "llm-d-4crf2glv0w-vllm-sim" with kind DestinationRule: Internal error occurred: failed calling webhook "validation.istio.io": failed to call webhook: Post "https://istiod.istio-system.svc:443/validate?timeout=10s": dial tcp 10.96.220.134:443: connect: connection refused | |
| 2025-06-24T04:09:16.1493881Z ======================================================================================================================== | |
| 2025-06-24T04:09:16.1494449Z ........................................................................................................................ | |
| 2025-06-24T04:09:16.1494978Z ==> Events of namespace llm-d-4crf2glv0w | |
| 2025-06-24T04:09:16.1495513Z ........................................................................................................................ | |
| 2025-06-24T04:09:16.1496337Z >>> kubectl --request-timeout=30s get events --output wide --namespace llm-d-4crf2glv0w --sort-by lastTimestamp | |
| 2025-06-24T04:09:16.2568456Z LAST SEEN TYPE REASON OBJECT SUBOBJECT SOURCE MESSAGE FIRST SEEN COUNT NAME | |
| 2025-06-24T04:09:16.2576012Z 43s Normal Pulled pod/llm-d-4crf2glv0w-redis-master-6675977f4-8lvc4 spec.containers{redis} kubelet, chart-testing-control-plane Container image "quay.io/sclorg/redis-7-c9s:c9s" already present on machine 43s 1 llm-d-4crf2glv0w-redis-master-6675977f4-8lvc4.184bdf09ecbf677f | |
| 2025-06-24T04:09:16.2592783Z 43s Normal Pulled pod/llm-d-4crf2glv0w-inference-gateway-istio-67b7b96948-4hhqh spec.containers{istio-proxy} kubelet, chart-testing-control-plane Container image "gcr.io/istio-testing/proxyv2:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d" already present on machine 43s 1 llm-d-4crf2glv0w-inference-gateway-istio-67b7b96948-4hhqh.184bdf09eed9a807 | |
| 2025-06-24T04:09:16.2599210Z 43s Normal Created pod/llm-d-4crf2glv0w-inference-gateway-istio-67b7b96948-4hhqh spec.containers{istio-proxy} kubelet, chart-testing-control-plane Created container istio-proxy 43s 1 llm-d-4crf2glv0w-inference-gateway-istio-67b7b96948-4hhqh.184bdf09efbcc325 | |
| 2025-06-24T04:09:16.2602943Z 43s Normal Scheduled pod/llm-d-4crf2glv0w-inference-gateway-istio-67b7b96948-4hhqh default-scheduler Successfully assigned llm-d-4crf2glv0w/llm-d-4crf2glv0w-inference-gateway-istio-67b7b96948-4hhqh to chart-testing-control-plane 43s 1 llm-d-4crf2glv0w-inference-gateway-istio-67b7b96948-4hhqh.184bdf09d5aafb93 | |
| 2025-06-24T04:09:16.2609721Z 43s Normal SuccessfulCreate replicaset/llm-d-4crf2glv0w-inference-gateway-istio-67b7b96948 replicaset-controller Created pod: llm-d-4crf2glv0w-inference-gateway-istio-67b7b96948-4hhqh 43s 1 llm-d-4crf2glv0w-inference-gateway-istio-67b7b96948.184bdf09d56d42a0 | |
| 2025-06-24T04:09:16.2620314Z 43s Normal ScalingReplicaSet deployment/llm-d-4crf2glv0w-inference-gateway-istio deployment-controller Scaled up replica set llm-d-4crf2glv0w-inference-gateway-istio-67b7b96948 to 1 43s 1 llm-d-4crf2glv0w-inference-gateway-istio.184bdf09d4c3f93a | |
| 2025-06-24T04:09:16.2624029Z 43s Normal Scheduled pod/llm-d-4crf2glv0w-modelservice-789fc45b8b-xckbq default-scheduler Successfully assigned llm-d-4crf2glv0w/llm-d-4crf2glv0w-modelservice-789fc45b8b-xckbq to chart-testing-control-plane 43s 1 llm-d-4crf2glv0w-modelservice-789fc45b8b-xckbq.184bdf09d2295de9 | |
| 2025-06-24T04:09:16.2627572Z 43s Normal Pulling pod/llm-d-4crf2glv0w-modelservice-789fc45b8b-xckbq spec.containers{manager} kubelet, chart-testing-control-plane Pulling image "ghcr.io/llm-d/llm-d-model-service:0.0.10" 43s 1 llm-d-4crf2glv0w-modelservice-789fc45b8b-xckbq.184bdf09f003ae66 | |
| 2025-06-24T04:09:16.2662172Z 43s Normal ScalingReplicaSet deployment/llm-d-4crf2glv0w-redis-master deployment-controller Scaled up replica set llm-d-4crf2glv0w-redis-master-6675977f4 to 1 43s 1 llm-d-4crf2glv0w-redis-master.184bdf09d03e771e | |
| 2025-06-24T04:09:16.2665287Z 43s Normal SuccessfulCreate replicaset/llm-d-4crf2glv0w-redis-master-6675977f4 replicaset-controller Created pod: llm-d-4crf2glv0w-redis-master-6675977f4-8lvc4 43s 1 llm-d-4crf2glv0w-redis-master-6675977f4.184bdf09d174ba19 | |
| 2025-06-24T04:09:16.2678710Z 43s Normal Created pod/llm-d-4crf2glv0w-redis-master-6675977f4-8lvc4 spec.containers{redis} kubelet, chart-testing-control-plane Created container redis 43s 1 llm-d-4crf2glv0w-redis-master-6675977f4-8lvc4.184bdf09edd37cf6 | |
| 2025-06-24T04:09:16.2682423Z 43s Normal SuccessfulCreate replicaset/llm-d-4crf2glv0w-modelservice-789fc45b8b replicaset-controller Created pod: llm-d-4crf2glv0w-modelservice-789fc45b8b-xckbq 43s 1 llm-d-4crf2glv0w-modelservice-789fc45b8b.184bdf09d16be85e | |
| 2025-06-24T04:09:16.2685364Z 43s Normal ScalingReplicaSet deployment/llm-d-4crf2glv0w-modelservice deployment-controller Scaled up replica set llm-d-4crf2glv0w-modelservice-789fc45b8b to 1 43s 1 llm-d-4crf2glv0w-modelservice.184bdf09d0488bb9 | |
| 2025-06-24T04:09:16.2688517Z 43s Normal Scheduled pod/llm-d-4crf2glv0w-redis-master-6675977f4-8lvc4 default-scheduler Successfully assigned llm-d-4crf2glv0w/llm-d-4crf2glv0w-redis-master-6675977f4-8lvc4 to chart-testing-control-plane 43s 1 llm-d-4crf2glv0w-redis-master-6675977f4-8lvc4.184bdf09d22ee88a | |
| 2025-06-24T04:09:16.2692472Z 42s Normal Pulled pod/llm-d-4crf2glv0w-modelservice-789fc45b8b-xckbq spec.containers{manager} kubelet, chart-testing-control-plane Successfully pulled image "ghcr.io/llm-d/llm-d-model-service:0.0.10" in 149ms (150ms including waiting). Image size: 115030935 bytes. 42s 1 llm-d-4crf2glv0w-modelservice-789fc45b8b-xckbq.184bdf09f8f4c542 | |
| 2025-06-24T04:09:16.2695942Z 42s Normal Started pod/llm-d-4crf2glv0w-modelservice-789fc45b8b-xckbq spec.containers{manager} kubelet, chart-testing-control-plane Started container manager 42s 1 llm-d-4crf2glv0w-modelservice-789fc45b8b-xckbq.184bdf0a0790faf2 | |
| 2025-06-24T04:09:16.2747825Z 42s Normal Started pod/llm-d-4crf2glv0w-redis-master-6675977f4-8lvc4 spec.containers{redis} kubelet, chart-testing-control-plane Started container redis 42s 1 llm-d-4crf2glv0w-redis-master-6675977f4-8lvc4.184bdf09fe55b345 | |
| 2025-06-24T04:09:16.2762565Z 42s Normal Created pod/llm-d-4crf2glv0w-modelservice-789fc45b8b-xckbq spec.containers{manager} kubelet, chart-testing-control-plane Created container manager 42s 1 llm-d-4crf2glv0w-modelservice-789fc45b8b-xckbq.184bdf09f98e864f | |
| 2025-06-24T04:09:16.2772504Z 42s Normal Started pod/llm-d-4crf2glv0w-inference-gateway-istio-67b7b96948-4hhqh spec.containers{istio-proxy} kubelet, chart-testing-control-plane Started container istio-proxy 42s 1 llm-d-4crf2glv0w-inference-gateway-istio-67b7b96948-4hhqh.184bdf09f506a116 | |
| 2025-06-24T04:09:16.2776304Z 16s Normal Scheduled pod/llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq default-scheduler Successfully assigned llm-d-4crf2glv0w/llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq to chart-testing-control-plane 16s 1 llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq.184bdf1030b331df | |
| 2025-06-24T04:09:16.2779717Z 16s Normal ScalingReplicaSet deployment/llm-d-4crf2glv0w-vllm-sim-prefill deployment-controller Scaled up replica set llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc to 1 16s 1 llm-d-4crf2glv0w-vllm-sim-prefill.184bdf10214474b0 | |
| 2025-06-24T04:09:16.2813108Z 16s Normal SuccessfulCreate replicaset/llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc replicaset-controller Created pod: llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc-gx8r8 16s 1 llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc.184bdf102a82f5a8 | |
| 2025-06-24T04:09:16.2816966Z 16s Warning FailedCreate replicaset/llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc replicaset-controller Error creating: pods "llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc-" is forbidden: error looking up service account llm-d-4crf2glv0w/llm-d-4crf2glv0w-vllm-sim-sa: serviceaccount "llm-d-4crf2glv0w-vllm-sim-sa" not found 16s 5 llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc.184bdf1021e18373 | |
| 2025-06-24T04:09:16.2851214Z 16s Normal Scheduled pod/llm-d-4crf2glv0w-test-connection default-scheduler Successfully assigned llm-d-4crf2glv0w/llm-d-4crf2glv0w-test-connection to chart-testing-control-plane 16s 1 llm-d-4crf2glv0w-test-connection.184bdf102cd2de48 | |
| 2025-06-24T04:09:16.2854620Z 16s Normal ScalingReplicaSet deployment/llm-d-4crf2glv0w-vllm-sim-decode deployment-controller Scaled up replica set llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f to 1 16s 1 llm-d-4crf2glv0w-vllm-sim-decode.184bdf10220c0651 | |
| 2025-06-24T04:09:16.2857956Z 16s Normal Scheduled pod/llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc-gx8r8 default-scheduler Successfully assigned llm-d-4crf2glv0w/llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc-gx8r8 to chart-testing-control-plane 16s 1 llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc-gx8r8.184bdf102abd667c | |
| 2025-06-24T04:09:16.2861281Z 16s Normal ScalingReplicaSet deployment/llm-d-4crf2glv0w-vllm-sim-epp deployment-controller Scaled up replica set llm-d-4crf2glv0w-vllm-sim-epp-64bb766589 to 1 16s 1 llm-d-4crf2glv0w-vllm-sim-epp.184bdf10240774cc | |
| 2025-06-24T04:09:16.2864347Z 16s Normal SuccessfulCreate replicaset/llm-d-4crf2glv0w-vllm-sim-epp-64bb766589 replicaset-controller Created pod: llm-d-4crf2glv0w-vllm-sim-epp-64bb766589-p6xc2 16s 1 llm-d-4crf2glv0w-vllm-sim-epp-64bb766589.184bdf1025cea8d3 | |
| 2025-06-24T04:09:16.2867889Z 16s Warning FailedCreate replicaset/llm-d-4crf2glv0w-vllm-sim-epp-64bb766589 replicaset-controller Error creating: pods "llm-d-4crf2glv0w-vllm-sim-epp-64bb766589-" is forbidden: error looking up service account llm-d-4crf2glv0w/llm-d-4crf2glv0w-vllm-sim-epp-sa: serviceaccount "llm-d-4crf2glv0w-vllm-sim-epp-sa" not found 16s 1 llm-d-4crf2glv0w-vllm-sim-epp-64bb766589.184bdf10247567b8 | |
| 2025-06-24T04:09:16.2871954Z 16s Normal Scheduled pod/llm-d-4crf2glv0w-vllm-sim-epp-64bb766589-p6xc2 default-scheduler Successfully assigned llm-d-4crf2glv0w/llm-d-4crf2glv0w-vllm-sim-epp-64bb766589-p6xc2 to chart-testing-control-plane 16s 1 llm-d-4crf2glv0w-vllm-sim-epp-64bb766589-p6xc2.184bdf102618d95d | |
| 2025-06-24T04:09:16.2917118Z 16s Warning FailedCreate replicaset/llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f replicaset-controller Error creating: pods "llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-" is forbidden: error looking up service account llm-d-4crf2glv0w/llm-d-4crf2glv0w-vllm-sim-sa: serviceaccount "llm-d-4crf2glv0w-vllm-sim-sa" not found 16s 5 llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f.184bdf1022adde5e | |
| 2025-06-24T04:09:16.2927620Z 16s Normal SuccessfulCreate replicaset/llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f replicaset-controller Created pod: llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq 16s 1 llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f.184bdf1030773396 | |
| 2025-06-24T04:09:16.2953335Z 15s Normal Pulled pod/llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq spec.initContainers{routing-proxy} kubelet, chart-testing-control-plane Container image "ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6" already present on machine 15s 1 llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq.184bdf104a2d1aef | |
| 2025-06-24T04:09:16.2957056Z 15s Normal Pulled pod/llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq spec.containers{vllm} kubelet, chart-testing-control-plane Container image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" already present on machine 15s 1 llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq.184bdf105687fed5 | |
| 2025-06-24T04:09:16.2960663Z 15s Normal Pulling pod/llm-d-4crf2glv0w-vllm-sim-epp-64bb766589-p6xc2 spec.containers{epp} kubelet, chart-testing-control-plane Pulling image "ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4" 15s 1 llm-d-4crf2glv0w-vllm-sim-epp-64bb766589-p6xc2.184bdf103eca342b | |
| 2025-06-24T04:09:16.2964372Z 15s Normal Pulled pod/llm-d-4crf2glv0w-vllm-sim-epp-64bb766589-p6xc2 spec.containers{epp} kubelet, chart-testing-control-plane Successfully pulled image "ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4" in 257ms (257ms including waiting). Image size: 119587259 bytes. 15s 1 llm-d-4crf2glv0w-vllm-sim-epp-64bb766589-p6xc2.184bdf104e28fdf8 | |
| 2025-06-24T04:09:16.2967902Z 15s Normal Created pod/llm-d-4crf2glv0w-vllm-sim-epp-64bb766589-p6xc2 spec.containers{epp} kubelet, chart-testing-control-plane Created container epp 15s 1 llm-d-4crf2glv0w-vllm-sim-epp-64bb766589-p6xc2.184bdf104ea6507d | |
| 2025-06-24T04:09:16.2974424Z 15s Normal Started pod/llm-d-4crf2glv0w-vllm-sim-epp-64bb766589-p6xc2 spec.containers{epp} kubelet, chart-testing-control-plane Started container epp 15s 1 llm-d-4crf2glv0w-vllm-sim-epp-64bb766589-p6xc2.184bdf1053f94646 | |
| 2025-06-24T04:09:16.2977437Z 15s Normal Created pod/llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq spec.containers{vllm} kubelet, chart-testing-control-plane Created container vllm 15s 1 llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq.184bdf10575e708d | |
| 2025-06-24T04:09:16.2980646Z 15s Normal Started pod/llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq spec.containers{vllm} kubelet, chart-testing-control-plane Started container vllm 15s 1 llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq.184bdf105eb673bb | |
| 2025-06-24T04:09:16.2983936Z 15s Normal Started pod/llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq spec.initContainers{routing-proxy} kubelet, chart-testing-control-plane Started container routing-proxy 15s 1 llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq.184bdf1050c9f805 | |
| 2025-06-24T04:09:16.2987294Z 15s Normal Created pod/llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq spec.initContainers{routing-proxy} kubelet, chart-testing-control-plane Created container routing-proxy 15s 1 llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq.184bdf104ab93873 | |
| 2025-06-24T04:09:16.2991053Z 15s Normal Pulled pod/llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc-gx8r8 spec.containers{vllm} kubelet, chart-testing-control-plane Container image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" already present on machine 15s 1 llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc-gx8r8.184bdf10451a0b0f | |
| 2025-06-24T04:09:16.2994602Z 15s Normal Created pod/llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc-gx8r8 spec.containers{vllm} kubelet, chart-testing-control-plane Created container vllm 15s 1 llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc-gx8r8.184bdf1045be1f07 | |
| 2025-06-24T04:09:16.2997579Z 15s Normal Started pod/llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc-gx8r8 spec.containers{vllm} kubelet, chart-testing-control-plane Started container vllm 15s 1 llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc-gx8r8.184bdf104ce12256 | |
| 2025-06-24T04:09:16.3001267Z 12s Normal Created pod/llm-d-4crf2glv0w-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Created container curl 12s 1 llm-d-4crf2glv0w-test-connection.184bdf10f5e2ce99 | |
| 2025-06-24T04:09:16.3003935Z 12s Normal Pulled pod/llm-d-4crf2glv0w-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Container image "quay.io/curl/curl:latest" already present on machine 12s 1 llm-d-4crf2glv0w-test-connection.184bdf10f534d7bd | |
| 2025-06-24T04:09:16.3006629Z 5s Normal Started pod/llm-d-4crf2glv0w-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Started container curl 5s 1 llm-d-4crf2glv0w-test-connection.184bdf12b952dd83 | |
| 2025-06-24T04:09:16.3009431Z ........................................................................................................................ | |
| 2025-06-24T04:09:16.3010908Z <== Events of namespace llm-d-4crf2glv0w | |
| 2025-06-24T04:09:16.3011464Z ........................................................................................................................ | |
| 2025-06-24T04:09:16.3012515Z >>> kubectl --request-timeout=30s get pods --no-headers --namespace llm-d-4crf2glv0w --selector --output jsonpath={.items[*].metadata.name} | |
| 2025-06-24T04:09:16.3536187Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:16.3537728Z ==> Description of pod llm-d-4crf2glv0w-inference-gateway-istio-67b7b96948-4hhqh | |
| 2025-06-24T04:09:16.3538453Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:16.3539606Z >>> kubectl --request-timeout=30s describe pod llm-d-4crf2glv0w-inference-gateway-istio-67b7b96948-4hhqh --namespace llm-d-4crf2glv0w | |
| 2025-06-24T04:09:16.4119743Z Name: llm-d-4crf2glv0w-inference-gateway-istio-67b7b96948-4hhqh | |
| 2025-06-24T04:09:16.4120683Z Namespace: llm-d-4crf2glv0w | |
| 2025-06-24T04:09:16.4121431Z Priority: 0 | |
| 2025-06-24T04:09:16.4130813Z Service Account: llm-d-4crf2glv0w-inference-gateway-istio | |
| 2025-06-24T04:09:16.4131516Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T04:09:16.4132080Z Start Time: Tue, 24 Jun 2025 04:08:33 +0000 | |
| 2025-06-24T04:09:16.4132680Z Labels: app.kubernetes.io/component=inference-gateway | |
| 2025-06-24T04:09:16.4133371Z app.kubernetes.io/gateway=llm-d-4crf2glv0w-inference-gateway | |
| 2025-06-24T04:09:16.4136032Z app.kubernetes.io/instance=llm-d-4crf2glv0w | |
| 2025-06-24T04:09:16.4136857Z app.kubernetes.io/managed-by=Helm | |
| 2025-06-24T04:09:16.4137497Z app.kubernetes.io/name=llm-d | |
| 2025-06-24T04:09:16.4137988Z app.kubernetes.io/version=0.1 | |
| 2025-06-24T04:09:16.4138528Z gateway.istio.io/managed=istio.io-gateway-controller | |
| 2025-06-24T04:09:16.4139267Z gateway.networking.k8s.io/gateway-name=llm-d-4crf2glv0w-inference-gateway | |
| 2025-06-24T04:09:16.4140100Z helm.sh/chart=llm-d-1.0.21 | |
| 2025-06-24T04:09:16.4140930Z istio.io/enable-inference-extproc=true | |
| 2025-06-24T04:09:16.4141966Z pod-template-hash=67b7b96948 | |
| 2025-06-24T04:09:16.4143169Z service.istio.io/canonical-name=llm-d-4crf2glv0w-inference-gateway-istio | |
| 2025-06-24T04:09:16.4144063Z service.istio.io/canonical-revision=latest | |
| 2025-06-24T04:09:16.4144549Z sidecar.istio.io/inject=false | |
| 2025-06-24T04:09:16.4144993Z Annotations: istio.io/rev: default | |
| 2025-06-24T04:09:16.4145427Z meta.helm.sh/release-name: llm-d-4crf2glv0w | |
| 2025-06-24T04:09:16.4145944Z meta.helm.sh/release-namespace: llm-d-4crf2glv0w | |
| 2025-06-24T04:09:16.4146460Z networking.istio.io/service-type: ClusterIP | |
| 2025-06-24T04:09:16.4146934Z prometheus.io/path: /stats/prometheus | |
| 2025-06-24T04:09:16.4147379Z prometheus.io/port: 15020 | |
| 2025-06-24T04:09:16.4147821Z prometheus.io/scrape: true | |
| 2025-06-24T04:09:16.4148210Z Status: Running | |
| 2025-06-24T04:09:16.4148523Z IP: 10.244.0.28 | |
| 2025-06-24T04:09:16.4148845Z IPs: | |
| 2025-06-24T04:09:16.4149120Z IP: 10.244.0.28 | |
| 2025-06-24T04:09:16.4149684Z Controlled By: ReplicaSet/llm-d-4crf2glv0w-inference-gateway-istio-67b7b96948 | |
| 2025-06-24T04:09:16.4151170Z Containers: | |
| 2025-06-24T04:09:16.4151478Z istio-proxy: | |
| 2025-06-24T04:09:16.4153175Z Container ID: containerd://109b91d3fd3a4e115a4eddb6cccdd7501193829723d0c8076111d3cb5199432e | |
| 2025-06-24T04:09:16.4155620Z Image: gcr.io/istio-testing/proxyv2:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d | |
| 2025-06-24T04:09:16.4157935Z Image ID: gcr.io/istio-testing/proxyv2@sha256:f8b9447198a9e52e5c928cc735536a41ad416afa2a7a674056b1e24c5789607c | |
| 2025-06-24T04:09:16.4159261Z Ports: 15020/TCP, 15021/TCP, 15090/TCP | |
| 2025-06-24T04:09:16.4160207Z Host Ports: 0/TCP, 0/TCP, 0/TCP | |
| 2025-06-24T04:09:16.4160613Z Args: | |
| 2025-06-24T04:09:16.4161097Z proxy | |
| 2025-06-24T04:09:16.4161358Z router | |
| 2025-06-24T04:09:16.4161837Z --domain | |
| 2025-06-24T04:09:16.4162166Z $(POD_NAMESPACE).svc.cluster.local | |
| 2025-06-24T04:09:16.4162819Z --proxyLogLevel | |
| 2025-06-24T04:09:16.4163147Z warning | |
| 2025-06-24T04:09:16.4163769Z --proxyComponentLogLevel | |
| 2025-06-24T04:09:16.4164426Z misc:error | |
| 2025-06-24T04:09:16.4164772Z --log_output_level | |
| 2025-06-24T04:09:16.4165481Z default:info | |
| 2025-06-24T04:09:16.4165816Z State: Running | |
| 2025-06-24T04:09:16.4166484Z Started: Tue, 24 Jun 2025 04:08:34 +0000 | |
| 2025-06-24T04:09:16.4167207Z Ready: True | |
| 2025-06-24T04:09:16.4167569Z Restart Count: 0 | |
| 2025-06-24T04:09:16.4168160Z Limits: | |
| 2025-06-24T04:09:16.4168434Z cpu: 2 | |
| 2025-06-24T04:09:16.4169013Z memory: 1Gi | |
| 2025-06-24T04:09:16.4169329Z Requests: | |
| 2025-06-24T04:09:16.4170744Z cpu: 100m | |
| 2025-06-24T04:09:16.4171543Z memory: 128Mi | |
| 2025-06-24T04:09:16.4172234Z Readiness: http-get http://:15021/healthz/ready delay=0s timeout=1s period=15s #success=1 #failure=4 | |
| 2025-06-24T04:09:16.4173316Z Startup: http-get http://:15021/healthz/ready delay=1s timeout=1s period=1s #success=1 #failure=30 | |
| 2025-06-24T04:09:16.4173977Z Environment: | |
| 2025-06-24T04:09:16.4174303Z PILOT_CERT_PROVIDER: istiod | |
| 2025-06-24T04:09:16.4174774Z CA_ADDR: istiod.istio-system.svc:15012 | |
| 2025-06-24T04:09:16.4175621Z POD_NAME: llm-d-4crf2glv0w-inference-gateway-istio-67b7b96948-4hhqh (v1:metadata.name) | |
| 2025-06-24T04:09:16.4176499Z POD_NAMESPACE: llm-d-4crf2glv0w (v1:metadata.namespace) | |
| 2025-06-24T04:09:16.4177061Z INSTANCE_IP: (v1:status.podIP) | |
| 2025-06-24T04:09:16.4177613Z SERVICE_ACCOUNT: (v1:spec.serviceAccountName) | |
| 2025-06-24T04:09:16.4178143Z HOST_IP: (v1:status.hostIP) | |
| 2025-06-24T04:09:16.4178633Z ISTIO_CPU_LIMIT: 2 (limits.cpu) | |
| 2025-06-24T04:09:16.4179354Z PROXY_CONFIG: {} | |
| 2025-06-24T04:09:16.4180713Z | |
| 2025-06-24T04:09:16.4181151Z ISTIO_META_POD_PORTS: [] | |
| 2025-06-24T04:09:16.4181602Z ISTIO_META_APP_CONTAINERS: | |
| 2025-06-24T04:09:16.4182111Z GOMEMLIMIT: 1073741824 (limits.memory) | |
| 2025-06-24T04:09:16.4182651Z GOMAXPROCS: 2 (limits.cpu) | |
| 2025-06-24T04:09:16.4183098Z ISTIO_META_CLUSTER_ID: Kubernetes | |
| 2025-06-24T04:09:16.4183550Z ISTIO_META_NODE_NAME: (v1:spec.nodeName) | |
| 2025-06-24T04:09:16.4184014Z ISTIO_META_INTERCEPTION_MODE: REDIRECT | |
| 2025-06-24T04:09:16.4184568Z ISTIO_META_WORKLOAD_NAME: llm-d-4crf2glv0w-inference-gateway-istio | |
| 2025-06-24T04:09:16.4186186Z ISTIO_META_OWNER: kubernetes://apis/apps/v1/namespaces/llm-d-4crf2glv0w/deployments/llm-d-4crf2glv0w-inference-gateway-istio | |
| 2025-06-24T04:09:16.4187123Z ISTIO_META_MESH_ID: cluster.local | |
| 2025-06-24T04:09:16.4187578Z TRUST_DOMAIN: cluster.local | |
| 2025-06-24T04:09:16.4187971Z Mounts: | |
| 2025-06-24T04:09:16.4188517Z /etc/istio/pod from istio-podinfo (rw) | |
| 2025-06-24T04:09:16.4189355Z /etc/istio/proxy from istio-envoy (rw) | |
| 2025-06-24T04:09:16.4190135Z /var/lib/istio/data from istio-data (rw) | |
| 2025-06-24T04:09:16.4190939Z /var/run/secrets/credential-uds from credential-socket (rw) | |
| 2025-06-24T04:09:16.4191734Z /var/run/secrets/istio from istiod-ca-cert (rw) | |
| 2025-06-24T04:09:16.4192683Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-4s92q (ro) | |
| 2025-06-24T04:09:16.4193405Z /var/run/secrets/tokens from istio-token (rw) | |
| 2025-06-24T04:09:16.4194050Z /var/run/secrets/workload-spiffe-credentials from workload-certs (rw) | |
| 2025-06-24T04:09:16.4194820Z /var/run/secrets/workload-spiffe-uds from workload-socket (rw) | |
| 2025-06-24T04:09:16.4195368Z Conditions: | |
| 2025-06-24T04:09:16.4195663Z Type Status | |
| 2025-06-24T04:09:16.4196068Z PodReadyToStartContainers True | |
| 2025-06-24T04:09:16.4196480Z Initialized True | |
| 2025-06-24T04:09:16.4196852Z Ready True | |
| 2025-06-24T04:09:16.4197228Z ContainersReady True | |
| 2025-06-24T04:09:16.4197620Z PodScheduled True | |
| 2025-06-24T04:09:16.4197973Z Volumes: | |
| 2025-06-24T04:09:16.4198246Z workload-socket: | |
| 2025-06-24T04:09:16.4198717Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T04:09:16.4199271Z Medium: | |
| 2025-06-24T04:09:16.4199561Z SizeLimit: <unset> | |
| 2025-06-24T04:09:16.4200111Z credential-socket: | |
| 2025-06-24T04:09:16.4203163Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T04:09:16.4203769Z Medium: | |
| 2025-06-24T04:09:16.4204080Z SizeLimit: <unset> | |
| 2025-06-24T04:09:16.4204679Z workload-certs: | |
| 2025-06-24T04:09:16.4205209Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T04:09:16.4205788Z Medium: | |
| 2025-06-24T04:09:16.4206107Z SizeLimit: <unset> | |
| 2025-06-24T04:09:16.4206437Z istio-envoy: | |
| 2025-06-24T04:09:16.4206891Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T04:09:16.4207449Z Medium: Memory | |
| 2025-06-24T04:09:16.4207760Z SizeLimit: <unset> | |
| 2025-06-24T04:09:16.4208086Z istio-data: | |
| 2025-06-24T04:09:16.4208540Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T04:09:16.4209119Z Medium: | |
| 2025-06-24T04:09:16.4209404Z SizeLimit: <unset> | |
| 2025-06-24T04:09:16.4209748Z istio-podinfo: | |
| 2025-06-24T04:09:16.4210586Z Type: DownwardAPI (a volume populated by information about the pod) | |
| 2025-06-24T04:09:16.4211118Z Items: | |
| 2025-06-24T04:09:16.4211415Z metadata.labels -> labels | |
| 2025-06-24T04:09:16.4211800Z metadata.annotations -> annotations | |
| 2025-06-24T04:09:16.4212201Z istio-token: | |
| 2025-06-24T04:09:16.4212701Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T04:09:16.4213351Z TokenExpirationSeconds: 43200 | |
| 2025-06-24T04:09:16.4213755Z istiod-ca-cert: | |
| 2025-06-24T04:09:16.4214170Z Type: ConfigMap (a volume populated by a ConfigMap) | |
| 2025-06-24T04:09:16.4214664Z Name: istio-ca-root-cert | |
| 2025-06-24T04:09:16.4215038Z Optional: false | |
| 2025-06-24T04:09:16.4215372Z kube-api-access-4s92q: | |
| 2025-06-24T04:09:16.4215942Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T04:09:16.4216596Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T04:09:16.4217020Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T04:09:16.4217459Z ConfigMapOptional: <nil> | |
| 2025-06-24T04:09:16.4217849Z DownwardAPI: true | |
| 2025-06-24T04:09:16.4218242Z QoS Class: Burstable | |
| 2025-06-24T04:09:16.4218694Z Node-Selectors: <none> | |
| 2025-06-24T04:09:16.4219272Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T04:09:16.4220204Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T04:09:16.4220721Z Events: | |
| 2025-06-24T04:09:16.4221004Z Type Reason Age From Message | |
| 2025-06-24T04:09:16.4221295Z ---- ------ ---- ---- ------- | |
| 2025-06-24T04:09:16.4222016Z Normal Scheduled 43s default-scheduler Successfully assigned llm-d-4crf2glv0w/llm-d-4crf2glv0w-inference-gateway-istio-67b7b96948-4hhqh to chart-testing-control-plane | |
| 2025-06-24T04:09:16.4223723Z Normal Pulled 43s kubelet Container image "gcr.io/istio-testing/proxyv2:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d" already present on machine | |
| 2025-06-24T04:09:16.4224888Z Normal Created 43s kubelet Created container istio-proxy | |
| 2025-06-24T04:09:16.4225614Z Normal Started 42s kubelet Started container istio-proxy | |
| 2025-06-24T04:09:16.4226230Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:16.4226860Z <== Description of pod llm-d-4crf2glv0w-inference-gateway-istio-67b7b96948-4hhqh | |
| 2025-06-24T04:09:16.4227502Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:16.4228488Z >>> kubectl --request-timeout=30s get pods llm-d-4crf2glv0w-inference-gateway-istio-67b7b96948-4hhqh --no-headers --namespace llm-d-4crf2glv0w --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T04:09:16.5010796Z >>> kubectl --request-timeout=30s get pods llm-d-4crf2glv0w-inference-gateway-istio-67b7b96948-4hhqh --no-headers --namespace llm-d-4crf2glv0w --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T04:09:16.5579170Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:16.5580867Z ==> Logs of container llm-d-4crf2glv0w-inference-gateway-istio-67b7b96948-4hhqh | |
| 2025-06-24T04:09:16.5581517Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:16.5582582Z >>> kubectl --request-timeout=30s logs llm-d-4crf2glv0w-inference-gateway-istio-67b7b96948-4hhqh --namespace llm-d-4crf2glv0w --container istio-proxy | |
| 2025-06-24T04:09:16.6126832Z 2025-06-24T04:08:34.028356Z info FLAG: --concurrency="0" | |
| 2025-06-24T04:09:16.6127721Z 2025-06-24T04:08:34.028378Z info FLAG: --domain="llm-d-4crf2glv0w.svc.cluster.local" | |
| 2025-06-24T04:09:16.6128511Z 2025-06-24T04:08:34.028493Z info FLAG: --help="false" | |
| 2025-06-24T04:09:16.6129074Z 2025-06-24T04:08:34.028528Z info FLAG: --log_as_json="false" | |
| 2025-06-24T04:09:16.6129650Z 2025-06-24T04:08:34.028537Z info FLAG: --log_caller="" | |
| 2025-06-24T04:09:16.6130443Z 2025-06-24T04:08:34.028541Z info FLAG: --log_output_level="default:info" | |
| 2025-06-24T04:09:16.6131146Z 2025-06-24T04:08:34.028549Z info FLAG: --log_stacktrace_level="default:none" | |
| 2025-06-24T04:09:16.6131781Z 2025-06-24T04:08:34.028558Z info FLAG: --log_target="[stdout]" | |
| 2025-06-24T04:09:16.6132376Z 2025-06-24T04:08:34.028561Z info FLAG: --meshConfig="./etc/istio/config/mesh" | |
| 2025-06-24T04:09:16.6132957Z 2025-06-24T04:08:34.028564Z info FLAG: --outlierLogPath="" | |
| 2025-06-24T04:09:16.6133451Z 2025-06-24T04:08:34.028567Z info FLAG: --profiling="true" | |
| 2025-06-24T04:09:16.6134018Z 2025-06-24T04:08:34.028575Z info FLAG: --proxyComponentLogLevel="misc:error" | |
| 2025-06-24T04:09:16.6134629Z 2025-06-24T04:08:34.028679Z info FLAG: --proxyLogLevel="warning" | |
| 2025-06-24T04:09:16.6135221Z 2025-06-24T04:08:34.029150Z info FLAG: --serviceCluster="istio-proxy" | |
| 2025-06-24T04:09:16.6135755Z 2025-06-24T04:08:34.029160Z info FLAG: --stsPort="0" | |
| 2025-06-24T04:09:16.6136215Z 2025-06-24T04:08:34.029162Z info FLAG: --templateFile="" | |
| 2025-06-24T04:09:16.6136733Z 2025-06-24T04:08:34.029165Z info FLAG: --tokenManagerPlugin="" | |
| 2025-06-24T04:09:16.6137216Z 2025-06-24T04:08:34.029178Z info FLAG: --vklog="0" | |
| 2025-06-24T04:09:16.6138190Z 2025-06-24T04:08:34.029183Z info Version 1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d-9befed2f1439d883120f8de70fd70d84ca0ebc3d-Clean | |
| 2025-06-24T04:09:16.6139291Z 2025-06-24T04:08:34.029190Z info Set max file descriptors (ulimit -n) to: 1048576 | |
| 2025-06-24T04:09:16.6140903Z 2025-06-24T04:08:34.029374Z info Proxy role ips=[10.244.0.28] type=router id=llm-d-4crf2glv0w-inference-gateway-istio-67b7b96948-4hhqh.llm-d-4crf2glv0w domain=llm-d-4crf2glv0w.svc.cluster.local | |
| 2025-06-24T04:09:16.6142186Z 2025-06-24T04:08:34.029433Z info Apply proxy config from env {} | |
| 2025-06-24T04:09:16.6142848Z | |
| 2025-06-24T04:09:16.6143133Z 2025-06-24T04:08:34.030270Z info cpu limit detected as 2, setting concurrency | |
| 2025-06-24T04:09:16.6143842Z 2025-06-24T04:08:34.030482Z info Effective config: binaryPath: /usr/local/bin/envoy | |
| 2025-06-24T04:09:16.6144414Z concurrency: 2 | |
| 2025-06-24T04:09:16.6144708Z configPath: ./etc/istio/proxy | |
| 2025-06-24T04:09:16.6145078Z controlPlaneAuthPolicy: MUTUAL_TLS | |
| 2025-06-24T04:09:16.6145525Z discoveryAddress: istiod.istio-system.svc:15012 | |
| 2025-06-24T04:09:16.6146007Z drainDuration: 45s | |
| 2025-06-24T04:09:16.6146310Z proxyAdminPort: 15000 | |
| 2025-06-24T04:09:16.6146637Z serviceCluster: istio-proxy | |
| 2025-06-24T04:09:16.6146977Z statNameLength: 189 | |
| 2025-06-24T04:09:16.6147264Z statusPort: 15020 | |
| 2025-06-24T04:09:16.6147572Z terminationDrainDuration: 5s | |
| 2025-06-24T04:09:16.6147814Z | |
| 2025-06-24T04:09:16.6148026Z 2025-06-24T04:08:34.030495Z info JWT policy is third-party-jwt | |
| 2025-06-24T04:09:16.6148752Z 2025-06-24T04:08:34.030498Z info using credential fetcher of JWT type in cluster.local trust domain | |
| 2025-06-24T04:09:16.6149465Z 2025-06-24T04:08:34.030607Z info platform detected is Azure | |
| 2025-06-24T04:09:16.6150140Z 2025-06-24T04:08:34.045177Z info Opening status port 15020 | |
| 2025-06-24T04:09:16.6150725Z 2025-06-24T04:08:34.045195Z info Starting default Istio SDS Server | |
| 2025-06-24T04:09:16.6151690Z 2025-06-24T04:08:34.045760Z info CA Endpoint istiod.istio-system.svc:15012, provider Citadel | |
| 2025-06-24T04:09:16.6152752Z 2025-06-24T04:08:34.045791Z info Using CA istiod.istio-system.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem | |
| 2025-06-24T04:09:16.6154000Z 2025-06-24T04:08:34.046809Z info xdsproxy Initializing with upstream address "istiod.istio-system.svc:15012" and cluster "Kubernetes" | |
| 2025-06-24T04:09:16.6155100Z 2025-06-24T04:08:34.049359Z info Pilot SAN: [istiod.istio-system.svc] | |
| 2025-06-24T04:09:16.6155760Z 2025-06-24T04:08:34.050451Z info Starting proxy agent | |
| 2025-06-24T04:09:16.6157378Z 2025-06-24T04:08:34.050554Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] | |
| 2025-06-24T04:09:16.6159452Z 2025-06-24T04:08:34.051963Z info sds Starting SDS grpc server | |
| 2025-06-24T04:09:16.6160642Z 2025-06-24T04:08:34.052173Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" | |
| 2025-06-24T04:09:16.6163042Z 2025-06-24T04:08:34.107585Z warning envoy main external/envoy/source/server/server.cc:874 Usage of the deprecated runtime key overload.global_downstream_max_connections, consider switching to `envoy.resource_monitors.global_downstream_max_connections` instead.This runtime key will be removed in future. thread=20 | |
| 2025-06-24T04:09:16.6166270Z 2025-06-24T04:08:34.107921Z warning envoy main external/envoy/source/server/server.cc:970 There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. thread=20 | |
| 2025-06-24T04:09:16.6168450Z 2025-06-24T04:08:34.114355Z info xdsproxy connected to delta upstream XDS server: istiod.istio-system.svc:15012 id=1 | |
| 2025-06-24T04:09:16.6169371Z 2025-06-24T04:08:34.143826Z info ads ADS: new connection for node:1 | |
| 2025-06-24T04:09:16.6170164Z 2025-06-24T04:08:34.144382Z info ads ADS: new connection for node:2 | |
| 2025-06-24T04:09:16.6171191Z 2025-06-24T04:08:34.470495Z info cache generated new workload certificate resourceName=default latency=422.674627ms ttl=23h59m59.529509393s | |
| 2025-06-24T04:09:16.6172304Z 2025-06-24T04:08:34.470934Z info cache Root cert has changed, start rotating root cert | |
| 2025-06-24T04:09:16.6173207Z 2025-06-24T04:08:34.471338Z info cache returned workload certificate from cache ttl=23h59m59.529032958s | |
| 2025-06-24T04:09:16.6174443Z 2025-06-24T04:08:34.472061Z info cache returned workload trust anchor from cache ttl=23h59m59.527941564s | |
| 2025-06-24T04:09:16.6175461Z 2025-06-24T04:08:34.472172Z info cache returned workload trust anchor from cache ttl=23h59m59.527829897s | |
| 2025-06-24T04:09:16.6176469Z 2025-06-24T04:08:34.472499Z info cache returned workload trust anchor from cache ttl=23h59m59.527502258s | |
| 2025-06-24T04:09:16.6177327Z 2025-06-24T04:08:35.812618Z info Readiness succeeded in 1.786128232s | |
| 2025-06-24T04:09:16.6177920Z 2025-06-24T04:08:35.812935Z info Envoy proxy is ready | |
| 2025-06-24T04:09:16.6179305Z 2025-06-24T04:09:00.481452Z warn xdsproxy upstream terminated with unexpected error rpc error: code = Unavailable desc = error reading from server: read tcp 10.244.0.28:47530->10.96.220.134:15012: read: connection reset by peer id=1 | |
| 2025-06-24T04:09:16.6181249Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:16.6182109Z <== Logs of container llm-d-4crf2glv0w-inference-gateway-istio-67b7b96948-4hhqh | |
| 2025-06-24T04:09:16.6182933Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:16.6183642Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:16.6184535Z ==> Description of pod llm-d-4crf2glv0w-modelservice-789fc45b8b-xckbq | |
| 2025-06-24T04:09:16.6185223Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:16.6186222Z >>> kubectl --request-timeout=30s describe pod llm-d-4crf2glv0w-modelservice-789fc45b8b-xckbq --namespace llm-d-4crf2glv0w | |
| 2025-06-24T04:09:16.6735423Z Name: llm-d-4crf2glv0w-modelservice-789fc45b8b-xckbq | |
| 2025-06-24T04:09:16.6735984Z Namespace: llm-d-4crf2glv0w | |
| 2025-06-24T04:09:16.6736334Z Priority: 0 | |
| 2025-06-24T04:09:16.6736793Z Service Account: llm-d-4crf2glv0w-llm-d-4crf2glv0w-modelservice | |
| 2025-06-24T04:09:16.6737405Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T04:09:16.6737861Z Start Time: Tue, 24 Jun 2025 04:08:33 +0000 | |
| 2025-06-24T04:09:16.6738328Z Labels: app.kubernetes.io/component=modelservice | |
| 2025-06-24T04:09:16.6738815Z app.kubernetes.io/instance=llm-d-4crf2glv0w | |
| 2025-06-24T04:09:16.6739272Z app.kubernetes.io/managed-by=Helm | |
| 2025-06-24T04:09:16.6739675Z app.kubernetes.io/name=llm-d | |
| 2025-06-24T04:09:16.6740254Z app.kubernetes.io/version=0.1 | |
| 2025-06-24T04:09:16.6740666Z control-plane=controller-manager | |
| 2025-06-24T04:09:16.6741065Z helm.sh/chart=llm-d-1.0.21 | |
| 2025-06-24T04:09:16.6741451Z pod-template-hash=789fc45b8b | |
| 2025-06-24T04:09:16.6741819Z Annotations: <none> | |
| 2025-06-24T04:09:16.6742120Z Status: Running | |
| 2025-06-24T04:09:16.6742433Z SeccompProfile: RuntimeDefault | |
| 2025-06-24T04:09:16.6742771Z IP: 10.244.0.26 | |
| 2025-06-24T04:09:16.6743159Z IPs: | |
| 2025-06-24T04:09:16.6743409Z IP: 10.244.0.26 | |
| 2025-06-24T04:09:16.6743872Z Controlled By: ReplicaSet/llm-d-4crf2glv0w-modelservice-789fc45b8b | |
| 2025-06-24T04:09:16.6744376Z Containers: | |
| 2025-06-24T04:09:16.6744623Z manager: | |
| 2025-06-24T04:09:16.6745218Z Container ID: containerd://0288847b0428f101a29c0eff7171832ad5752c80bf4f07ec7f61811429c0dd95 | |
| 2025-06-24T04:09:16.6746001Z Image: ghcr.io/llm-d/llm-d-model-service:0.0.10 | |
| 2025-06-24T04:09:16.6746874Z Image ID: ghcr.io/llm-d/llm-d-model-service@sha256:4d38789615184aa173eaf0c085ecd7f3dc0f3970af5e97ecb4b25fdfcf54b82e | |
| 2025-06-24T04:09:16.6747651Z Port: <none> | |
| 2025-06-24T04:09:16.6747955Z Host Port: <none> | |
| 2025-06-24T04:09:16.6748252Z Command: | |
| 2025-06-24T04:09:16.6748497Z /manager | |
| 2025-06-24T04:09:16.6748739Z Args: | |
| 2025-06-24T04:09:16.6749010Z --leader-elect=false | |
| 2025-06-24T04:09:16.6749361Z --health-probe-bind-address=:8081 | |
| 2025-06-24T04:09:16.6749757Z --epp-cluster-role | |
| 2025-06-24T04:09:16.6750689Z llm-d-4crf2glv0w-modelservice-endpoint-picker | |
| 2025-06-24T04:09:16.6751151Z --epp-pull-secrets | |
| 2025-06-24T04:09:16.6751442Z | |
| 2025-06-24T04:09:16.6751692Z --pd-pull-secrets | |
| 2025-06-24T04:09:16.6751971Z | |
| 2025-06-24T04:09:16.6752220Z State: Running | |
| 2025-06-24T04:09:16.6752571Z Started: Tue, 24 Jun 2025 04:08:34 +0000 | |
| 2025-06-24T04:09:16.6752963Z Ready: True | |
| 2025-06-24T04:09:16.6753279Z Restart Count: 0 | |
| 2025-06-24T04:09:16.6753561Z Limits: | |
| 2025-06-24T04:09:16.6753810Z cpu: 250m | |
| 2025-06-24T04:09:16.6754086Z memory: 250Mi | |
| 2025-06-24T04:09:16.6754369Z Requests: | |
| 2025-06-24T04:09:16.6754621Z cpu: 100m | |
| 2025-06-24T04:09:16.6754914Z memory: 100Mi | |
| 2025-06-24T04:09:16.6755456Z Liveness: http-get http://:8081/healthz delay=15s timeout=1s period=20s #success=1 #failure=3 | |
| 2025-06-24T04:09:16.6756359Z Readiness: http-get http://:8081/readyz delay=5s timeout=1s period=10s #success=1 #failure=3 | |
| 2025-06-24T04:09:16.6757026Z Environment: <none> | |
| 2025-06-24T04:09:16.6757331Z Mounts: | |
| 2025-06-24T04:09:16.6757858Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-6bkrs (ro) | |
| 2025-06-24T04:09:16.6758446Z Conditions: | |
| 2025-06-24T04:09:16.6758894Z Type Status | |
| 2025-06-24T04:09:16.6759272Z PodReadyToStartContainers True | |
| 2025-06-24T04:09:16.6759637Z Initialized True | |
| 2025-06-24T04:09:16.6760124Z Ready True | |
| 2025-06-24T04:09:16.6760532Z ContainersReady True | |
| 2025-06-24T04:09:16.6760924Z PodScheduled True | |
| 2025-06-24T04:09:16.6761255Z Volumes: | |
| 2025-06-24T04:09:16.6761518Z kube-api-access-6bkrs: | |
| 2025-06-24T04:09:16.6762095Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T04:09:16.6762745Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T04:09:16.6763157Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T04:09:16.6763617Z ConfigMapOptional: <nil> | |
| 2025-06-24T04:09:16.6764003Z DownwardAPI: true | |
| 2025-06-24T04:09:16.6764590Z QoS Class: Burstable | |
| 2025-06-24T04:09:16.6764989Z Node-Selectors: <none> | |
| 2025-06-24T04:09:16.6765564Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T04:09:16.6766201Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T04:09:16.6766662Z Events: | |
| 2025-06-24T04:09:16.6766989Z Type Reason Age From Message | |
| 2025-06-24T04:09:16.6767463Z ---- ------ ---- ---- ------- | |
| 2025-06-24T04:09:16.6768599Z Normal Scheduled 43s default-scheduler Successfully assigned llm-d-4crf2glv0w/llm-d-4crf2glv0w-modelservice-789fc45b8b-xckbq to chart-testing-control-plane | |
| 2025-06-24T04:09:16.6770546Z Normal Pulling 43s kubelet Pulling image "ghcr.io/llm-d/llm-d-model-service:0.0.10" | |
| 2025-06-24T04:09:16.6771861Z Normal Pulled 42s kubelet Successfully pulled image "ghcr.io/llm-d/llm-d-model-service:0.0.10" in 149ms (150ms including waiting). Image size: 115030935 bytes. | |
| 2025-06-24T04:09:16.6773054Z Normal Created 42s kubelet Created container manager | |
| 2025-06-24T04:09:16.6773751Z Normal Started 42s kubelet Started container manager | |
| 2025-06-24T04:09:16.6774484Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:16.6775212Z <== Description of pod llm-d-4crf2glv0w-modelservice-789fc45b8b-xckbq | |
| 2025-06-24T04:09:16.6775897Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:16.6777254Z >>> kubectl --request-timeout=30s get pods llm-d-4crf2glv0w-modelservice-789fc45b8b-xckbq --no-headers --namespace llm-d-4crf2glv0w --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T04:09:16.7288093Z >>> kubectl --request-timeout=30s get pods llm-d-4crf2glv0w-modelservice-789fc45b8b-xckbq --no-headers --namespace llm-d-4crf2glv0w --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T04:09:16.7827959Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:16.7828893Z ==> Logs of container llm-d-4crf2glv0w-modelservice-789fc45b8b-xckbq | |
| 2025-06-24T04:09:16.7829653Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:16.7830839Z >>> kubectl --request-timeout=30s logs llm-d-4crf2glv0w-modelservice-789fc45b8b-xckbq --namespace llm-d-4crf2glv0w --container manager | |
| 2025-06-24T04:09:16.8378288Z {"level":"info","ts":"2025-06-24T04:08:34.428658768Z","logger":"setup","caller":"cmd/root.go:272","msg":"starting manager"} | |
| 2025-06-24T04:09:16.8380300Z {"level":"info","ts":"2025-06-24T04:08:34.51185607Z","caller":"manager/server.go:83","msg":"starting server","name":"health probe","addr":"[::]:8081"} | |
| 2025-06-24T04:09:16.8382285Z {"level":"info","ts":"2025-06-24T04:08:34.512483142Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1.RoleBinding"} | |
| 2025-06-24T04:09:16.8385395Z {"level":"info","ts":"2025-06-24T04:08:34.51253011Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1alpha1.ModelService"} | |
| 2025-06-24T04:09:16.8388039Z {"level":"info","ts":"2025-06-24T04:08:34.512568541Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1alpha1.ModelService"} | |
| 2025-06-24T04:09:16.8390752Z {"level":"info","ts":"2025-06-24T04:08:34.512595772Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1.Deployment"} | |
| 2025-06-24T04:09:16.8393006Z {"level":"info","ts":"2025-06-24T04:08:34.51260512Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1.Service"} | |
| 2025-06-24T04:09:16.8394656Z {"level":"info","ts":"2025-06-24T04:08:34.513620784Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1.ServiceAccount"} | |
| 2025-06-24T04:09:16.8397146Z {"level":"info","ts":"2025-06-24T04:08:34.513671098Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1.ConfigMap"} | |
| 2025-06-24T04:09:16.8399650Z {"level":"info","ts":"2025-06-24T04:08:34.514547766Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1alpha2.InferenceModel"} | |
| 2025-06-24T04:09:16.8402705Z {"level":"info","ts":"2025-06-24T04:08:34.514574406Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1alpha2.InferencePool"} | |
| 2025-06-24T04:09:16.8405647Z {"level":"info","ts":"2025-06-24T04:08:34.625575965Z","caller":"controller/controller.go:239","msg":"Starting Controller","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService"} | |
| 2025-06-24T04:09:16.8407997Z {"level":"info","ts":"2025-06-24T04:08:34.625615629Z","caller":"controller/controller.go:248","msg":"Starting workers","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","worker count":1} | |
| 2025-06-24T04:09:16.8409516Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:16.8410461Z <== Logs of container llm-d-4crf2glv0w-modelservice-789fc45b8b-xckbq | |
| 2025-06-24T04:09:16.8411190Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:16.8411598Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:16.8412001Z ==> Description of pod llm-d-4crf2glv0w-redis-master-6675977f4-8lvc4 | |
| 2025-06-24T04:09:16.8412501Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:16.8413192Z >>> kubectl --request-timeout=30s describe pod llm-d-4crf2glv0w-redis-master-6675977f4-8lvc4 --namespace llm-d-4crf2glv0w | |
| 2025-06-24T04:09:16.9085755Z Name: llm-d-4crf2glv0w-redis-master-6675977f4-8lvc4 | |
| 2025-06-24T04:09:16.9086650Z Namespace: llm-d-4crf2glv0w | |
| 2025-06-24T04:09:16.9087050Z Priority: 0 | |
| 2025-06-24T04:09:16.9087770Z Service Account: llm-d-4crf2glv0w-redis-master | |
| 2025-06-24T04:09:16.9088801Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T04:09:16.9089299Z Start Time: Tue, 24 Jun 2025 04:08:33 +0000 | |
| 2025-06-24T04:09:16.9089982Z Labels: app.kubernetes.io/component=master | |
| 2025-06-24T04:09:16.9090507Z app.kubernetes.io/instance=llm-d-4crf2glv0w | |
| 2025-06-24T04:09:16.9091019Z app.kubernetes.io/managed-by=Helm | |
| 2025-06-24T04:09:16.9091377Z app.kubernetes.io/name=redis | |
| 2025-06-24T04:09:16.9091638Z app.kubernetes.io/version=7.4.3 | |
| 2025-06-24T04:09:16.9091889Z helm.sh/chart=redis-20.13.4 | |
| 2025-06-24T04:09:16.9092148Z pod-template-hash=6675977f4 | |
| 2025-06-24T04:09:16.9092599Z Annotations: checksum/configmap: 2a9ab4a5432825504d910f022638674ce88eaefe9f9f595ad8bc107377d104fb | |
| 2025-06-24T04:09:16.9093192Z checksum/health: aff24913d801436ea469d8d374b2ddb3ec4c43ee7ab24663d5f8ff1a1b6991a9 | |
| 2025-06-24T04:09:16.9093739Z checksum/scripts: bdec350b84a1ace7cc118db113a21c9f160bde3425b07714e1c0c1da722621cf | |
| 2025-06-24T04:09:16.9094272Z checksum/secret: 44136fa355b3678a1146ad16f7e8649e94fb4fc21fe77e8310c060f61caaff8a | |
| 2025-06-24T04:09:16.9094644Z Status: Running | |
| 2025-06-24T04:09:16.9094842Z IP: 10.244.0.27 | |
| 2025-06-24T04:09:16.9095025Z IPs: | |
| 2025-06-24T04:09:16.9095178Z IP: 10.244.0.27 | |
| 2025-06-24T04:09:16.9095466Z Controlled By: ReplicaSet/llm-d-4crf2glv0w-redis-master-6675977f4 | |
| 2025-06-24T04:09:16.9095774Z Containers: | |
| 2025-06-24T04:09:16.9095926Z redis: | |
| 2025-06-24T04:09:16.9096287Z Container ID: containerd://9466be890730c177a19bf289c9faf409fc6eb87b13ef7f5c2f2bf3f65eaea8e3 | |
| 2025-06-24T04:09:16.9096735Z Image: quay.io/sclorg/redis-7-c9s:c9s | |
| 2025-06-24T04:09:16.9097207Z Image ID: quay.io/sclorg/redis-7-c9s@sha256:d772acab11507231a2b152850f47c8b9b859dedb6652ca624949e97cb28c5e6f | |
| 2025-06-24T04:09:16.9097741Z Port: 6379/TCP | |
| 2025-06-24T04:09:16.9098108Z Host Port: 0/TCP | |
| 2025-06-24T04:09:16.9098373Z SeccompProfile: RuntimeDefault | |
| 2025-06-24T04:09:16.9098589Z Command: | |
| 2025-06-24T04:09:16.9098745Z /bin/bash | |
| 2025-06-24T04:09:16.9098896Z Args: | |
| 2025-06-24T04:09:16.9099045Z -ec | |
| 2025-06-24T04:09:16.9099251Z /opt/bitnami/scripts/start-scripts/start-master.sh | |
| 2025-06-24T04:09:16.9099518Z State: Running | |
| 2025-06-24T04:09:16.9099730Z Started: Tue, 24 Jun 2025 04:08:34 +0000 | |
| 2025-06-24T04:09:16.9100263Z Ready: True | |
| 2025-06-24T04:09:16.9100465Z Restart Count: 0 | |
| 2025-06-24T04:09:16.9100637Z Limits: | |
| 2025-06-24T04:09:16.9100795Z cpu: 250m | |
| 2025-06-24T04:09:16.9100961Z memory: 256Mi | |
| 2025-06-24T04:09:16.9101338Z Requests: | |
| 2025-06-24T04:09:16.9101502Z cpu: 100m | |
| 2025-06-24T04:09:16.9101672Z memory: 128Mi | |
| 2025-06-24T04:09:16.9102086Z Liveness: exec [/bin/bash -ec /health/ping_liveness_local.sh 5] delay=20s timeout=6s period=5s #success=1 #failure=5 | |
| 2025-06-24T04:09:16.9102912Z Readiness: exec [/bin/bash -ec /health/ping_readiness_local.sh 1] delay=20s timeout=2s period=5s #success=1 #failure=5 | |
| 2025-06-24T04:09:16.9103353Z Environment: | |
| 2025-06-24T04:09:16.9103531Z BITNAMI_DEBUG: false | |
| 2025-06-24T04:09:16.9103767Z REDIS_REPLICATION_MODE: master | |
| 2025-06-24T04:09:16.9103999Z ALLOW_EMPTY_PASSWORD: yes | |
| 2025-06-24T04:09:16.9104248Z REDIS_TLS_ENABLED: no | |
| 2025-06-24T04:09:16.9104471Z REDIS_PORT: 6379 | |
| 2025-06-24T04:09:16.9104673Z Mounts: | |
| 2025-06-24T04:09:16.9104847Z /data from redis-data (rw) | |
| 2025-06-24T04:09:16.9105057Z /health from health (rw) | |
| 2025-06-24T04:09:16.9105362Z /opt/bitnami/redis/etc/ from empty-dir (rw,path="app-conf-dir") | |
| 2025-06-24T04:09:16.9105705Z /opt/bitnami/redis/mounted-etc from config (rw) | |
| 2025-06-24T04:09:16.9106039Z /opt/bitnami/scripts/start-scripts from start-scripts (rw) | |
| 2025-06-24T04:09:16.9106356Z /tmp from empty-dir (rw,path="tmp-dir") | |
| 2025-06-24T04:09:16.9106719Z Conditions: | |
| 2025-06-24T04:09:16.9106886Z Type Status | |
| 2025-06-24T04:09:16.9107116Z PodReadyToStartContainers True | |
| 2025-06-24T04:09:16.9107363Z Initialized True | |
| 2025-06-24T04:09:16.9107736Z Ready True | |
| 2025-06-24T04:09:16.9108118Z ContainersReady True | |
| 2025-06-24T04:09:16.9108536Z PodScheduled True | |
| 2025-06-24T04:09:16.9108909Z Volumes: | |
| 2025-06-24T04:09:16.9109185Z start-scripts: | |
| 2025-06-24T04:09:16.9109584Z Type: ConfigMap (a volume populated by a ConfigMap) | |
| 2025-06-24T04:09:16.9110343Z Name: llm-d-4crf2glv0w-redis-scripts | |
| 2025-06-24T04:09:16.9110757Z Optional: false | |
| 2025-06-24T04:09:16.9111058Z health: | |
| 2025-06-24T04:09:16.9111403Z Type: ConfigMap (a volume populated by a ConfigMap) | |
| 2025-06-24T04:09:16.9111903Z Name: llm-d-4crf2glv0w-redis-health | |
| 2025-06-24T04:09:16.9112302Z Optional: false | |
| 2025-06-24T04:09:16.9112596Z config: | |
| 2025-06-24T04:09:16.9112933Z Type: ConfigMap (a volume populated by a ConfigMap) | |
| 2025-06-24T04:09:16.9113454Z Name: llm-d-4crf2glv0w-redis-configuration | |
| 2025-06-24T04:09:16.9113938Z Optional: false | |
| 2025-06-24T04:09:16.9114120Z empty-dir: | |
| 2025-06-24T04:09:16.9114384Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T04:09:16.9114702Z Medium: | |
| 2025-06-24T04:09:16.9126973Z SizeLimit: <unset> | |
| 2025-06-24T04:09:16.9127308Z redis-data: | |
| 2025-06-24T04:09:16.9127629Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T04:09:16.9128224Z Medium: | |
| 2025-06-24T04:09:16.9128466Z SizeLimit: <unset> | |
| 2025-06-24T04:09:16.9128844Z QoS Class: Burstable | |
| 2025-06-24T04:09:16.9129057Z Node-Selectors: <none> | |
| 2025-06-24T04:09:16.9129389Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T04:09:16.9130260Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T04:09:16.9130748Z Events: | |
| 2025-06-24T04:09:16.9130950Z Type Reason Age From Message | |
| 2025-06-24T04:09:16.9131357Z ---- ------ ---- ---- ------- | |
| 2025-06-24T04:09:16.9132211Z Normal Scheduled 43s default-scheduler Successfully assigned llm-d-4crf2glv0w/llm-d-4crf2glv0w-redis-master-6675977f4-8lvc4 to chart-testing-control-plane | |
| 2025-06-24T04:09:16.9133125Z Normal Pulled 43s kubelet Container image "quay.io/sclorg/redis-7-c9s:c9s" already present on machine | |
| 2025-06-24T04:09:16.9133648Z Normal Created 43s kubelet Created container redis | |
| 2025-06-24T04:09:16.9134299Z Normal Started 42s kubelet Started container redis | |
| 2025-06-24T04:09:16.9134824Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:16.9135289Z <== Description of pod llm-d-4crf2glv0w-redis-master-6675977f4-8lvc4 | |
| 2025-06-24T04:09:16.9135846Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:16.9136977Z >>> kubectl --request-timeout=30s get pods llm-d-4crf2glv0w-redis-master-6675977f4-8lvc4 --no-headers --namespace llm-d-4crf2glv0w --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T04:09:16.9621072Z >>> kubectl --request-timeout=30s get pods llm-d-4crf2glv0w-redis-master-6675977f4-8lvc4 --no-headers --namespace llm-d-4crf2glv0w --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T04:09:17.0136782Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:17.0137675Z ==> Logs of container llm-d-4crf2glv0w-redis-master-6675977f4-8lvc4 | |
| 2025-06-24T04:09:17.0138462Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:17.0139613Z >>> kubectl --request-timeout=30s logs llm-d-4crf2glv0w-redis-master-6675977f4-8lvc4 --namespace llm-d-4crf2glv0w --container redis | |
| 2025-06-24T04:09:17.0680919Z 1:C 24 Jun 2025 04:08:34.251 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo | |
| 2025-06-24T04:09:17.0681733Z 1:C 24 Jun 2025 04:08:34.251 # Redis version=7.0.12, bits=64, commit=00000000, modified=0, pid=1, just started | |
| 2025-06-24T04:09:17.0682395Z 1:C 24 Jun 2025 04:08:34.251 # Configuration loaded | |
| 2025-06-24T04:09:17.0682889Z 1:M 24 Jun 2025 04:08:34.252 * monotonic clock: POSIX clock_gettime | |
| 2025-06-24T04:09:17.0683425Z 1:M 24 Jun 2025 04:08:34.252 * Running mode=standalone, port=6379. | |
| 2025-06-24T04:09:17.0683901Z 1:M 24 Jun 2025 04:08:34.252 # Server initialized | |
| 2025-06-24T04:09:17.0684523Z 1:M 24 Jun 2025 04:08:34.253 * Creating AOF base file appendonly.aof.1.base.rdb on server start | |
| 2025-06-24T04:09:17.0685284Z 1:M 24 Jun 2025 04:08:34.254 * Creating AOF incr file appendonly.aof.1.incr.aof on server start | |
| 2025-06-24T04:09:17.0685892Z 1:M 24 Jun 2025 04:08:34.254 * Ready to accept connections | |
| 2025-06-24T04:09:17.0706519Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:17.0711367Z <== Logs of container llm-d-4crf2glv0w-redis-master-6675977f4-8lvc4 | |
| 2025-06-24T04:09:17.0712346Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:17.0713421Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:17.0714110Z ==> Description of pod llm-d-4crf2glv0w-test-connection | |
| 2025-06-24T04:09:17.0715781Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:17.0716745Z >>> kubectl --request-timeout=30s describe pod llm-d-4crf2glv0w-test-connection --namespace llm-d-4crf2glv0w | |
| 2025-06-24T04:09:17.1284037Z Name: llm-d-4crf2glv0w-test-connection | |
| 2025-06-24T04:09:17.1284658Z Namespace: llm-d-4crf2glv0w | |
| 2025-06-24T04:09:17.1285049Z Priority: 0 | |
| 2025-06-24T04:09:17.1285365Z Service Account: default | |
| 2025-06-24T04:09:17.1285753Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T04:09:17.1286078Z Start Time: Tue, 24 Jun 2025 04:09:00 +0000 | |
| 2025-06-24T04:09:17.1286349Z Labels: <none> | |
| 2025-06-24T04:09:17.1286568Z Annotations: helm.sh/hook: test | |
| 2025-06-24T04:09:17.1286809Z helm.sh/hook-weight: 1 | |
| 2025-06-24T04:09:17.1287046Z Status: Succeeded | |
| 2025-06-24T04:09:17.1287260Z SeccompProfile: RuntimeDefault | |
| 2025-06-24T04:09:17.1287483Z IP: 10.244.0.31 | |
| 2025-06-24T04:09:17.1287668Z IPs: | |
| 2025-06-24T04:09:17.1287814Z IP: 10.244.0.31 | |
| 2025-06-24T04:09:17.1288374Z Containers: | |
| 2025-06-24T04:09:17.1288537Z curl: | |
| 2025-06-24T04:09:17.1288921Z Container ID: containerd://c06ebf4dbc632edcf59e6f75ede9e4ac7c4756e8e2a693eabbe8610583e51aea | |
| 2025-06-24T04:09:17.1289364Z Image: quay.io/curl/curl:latest | |
| 2025-06-24T04:09:17.1290125Z Image ID: quay.io/curl/curl@sha256:f95026f35f8e40ca1c11738a1c5710baadf4b8cafabab9738dadbf9fb99084a9 | |
| 2025-06-24T04:09:17.1290622Z Port: <none> | |
| 2025-06-24T04:09:17.1290819Z Host Port: <none> | |
| 2025-06-24T04:09:17.1290993Z Command: | |
| 2025-06-24T04:09:17.1291145Z /bin/sh | |
| 2025-06-24T04:09:17.1291305Z -c | |
| 2025-06-24T04:09:17.1291447Z Args: | |
| 2025-06-24T04:09:17.1291930Z echo -e "\e[32m🥷 Waiting for pods to come up\e[0m" | |
| 2025-06-24T04:09:17.1292190Z echo "" | |
| 2025-06-24T04:09:17.1292739Z curl --connect-timeout 5 --max-time 20 --retry 20 --retry-delay 10 --retry-max-time 60 --retry-all-errors http://llm-d-4crf2glv0w-inference-gateway-istio/v1/models | |
| 2025-06-24T04:09:17.1293529Z | |
| 2025-06-24T04:09:17.1293692Z echo "" | |
| 2025-06-24T04:09:17.1293843Z echo "" | |
| 2025-06-24T04:09:17.1294277Z echo -e "\e[32m🥷 Basic chat validation\e[0m" | |
| 2025-06-24T04:09:17.1294660Z echo "" | |
| 2025-06-24T04:09:17.1296021Z curl --connect-timeout 5 --max-time 20 --retry 20 --retry-delay 10 --retry-max-time 60 --retry-all-errors http://llm-d-4crf2glv0w-inference-gateway-istio/v1/chat/completions \ | |
| 2025-06-24T04:09:17.1297228Z -H 'accept: application/json' \ | |
| 2025-06-24T04:09:17.1297736Z -H 'Content-Type: application/json' \ | |
| 2025-06-24T04:09:17.1298397Z -d '{"model":"food-review","messages":[{"content":"Say hi","role":"user"}],"stream":false}' | |
| 2025-06-24T04:09:17.1299035Z | |
| 2025-06-24T04:09:17.1299355Z State: Terminated | |
| 2025-06-24T04:09:17.1299744Z Reason: Completed | |
| 2025-06-24T04:09:17.1300302Z Exit Code: 0 | |
| 2025-06-24T04:09:17.1300666Z Started: Tue, 24 Jun 2025 04:09:11 +0000 | |
| 2025-06-24T04:09:17.1301179Z Finished: Tue, 24 Jun 2025 04:09:13 +0000 | |
| 2025-06-24T04:09:17.1301638Z Ready: False | |
| 2025-06-24T04:09:17.1301988Z Restart Count: 0 | |
| 2025-06-24T04:09:17.1302312Z Limits: | |
| 2025-06-24T04:09:17.1302598Z cpu: 10m | |
| 2025-06-24T04:09:17.1302897Z memory: 20Mi | |
| 2025-06-24T04:09:17.1303181Z Requests: | |
| 2025-06-24T04:09:17.1303442Z cpu: 10m | |
| 2025-06-24T04:09:17.1303741Z memory: 20Mi | |
| 2025-06-24T04:09:17.1304276Z Liveness: exec [ls /usr/bin/curl] delay=0s timeout=1s period=10s #success=1 #failure=3 | |
| 2025-06-24T04:09:17.1304904Z Environment: <none> | |
| 2025-06-24T04:09:17.1305213Z Mounts: | |
| 2025-06-24T04:09:17.1305720Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-qljf8 (ro) | |
| 2025-06-24T04:09:17.1306353Z Conditions: | |
| 2025-06-24T04:09:17.1306639Z Type Status | |
| 2025-06-24T04:09:17.1307044Z PodReadyToStartContainers False | |
| 2025-06-24T04:09:17.1307450Z Initialized True | |
| 2025-06-24T04:09:17.1307836Z Ready False | |
| 2025-06-24T04:09:17.1310754Z ContainersReady False | |
| 2025-06-24T04:09:17.1311334Z PodScheduled True | |
| 2025-06-24T04:09:17.1311718Z Volumes: | |
| 2025-06-24T04:09:17.1312032Z kube-api-access-qljf8: | |
| 2025-06-24T04:09:17.1312562Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T04:09:17.1313093Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T04:09:17.1313530Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T04:09:17.1313963Z ConfigMapOptional: <nil> | |
| 2025-06-24T04:09:17.1314351Z DownwardAPI: true | |
| 2025-06-24T04:09:17.1314713Z QoS Class: Guaranteed | |
| 2025-06-24T04:09:17.1315107Z Node-Selectors: <none> | |
| 2025-06-24T04:09:17.1315671Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T04:09:17.1316640Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T04:09:17.1317178Z Events: | |
| 2025-06-24T04:09:17.1317489Z Type Reason Age From Message | |
| 2025-06-24T04:09:17.1317961Z ---- ------ ---- ---- ------- | |
| 2025-06-24T04:09:17.1319035Z Normal Scheduled 17s default-scheduler Successfully assigned llm-d-4crf2glv0w/llm-d-4crf2glv0w-test-connection to chart-testing-control-plane | |
| 2025-06-24T04:09:17.1320724Z Normal Pulled 13s kubelet Container image "quay.io/curl/curl:latest" already present on machine | |
| 2025-06-24T04:09:17.1321640Z Normal Created 13s kubelet Created container curl | |
| 2025-06-24T04:09:17.1322272Z Normal Started 6s kubelet Started container curl | |
| 2025-06-24T04:09:17.1322930Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:17.1323552Z <== Description of pod llm-d-4crf2glv0w-test-connection | |
| 2025-06-24T04:09:17.1324174Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:17.1325426Z >>> kubectl --request-timeout=30s get pods llm-d-4crf2glv0w-test-connection --no-headers --namespace llm-d-4crf2glv0w --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T04:09:17.1841205Z >>> kubectl --request-timeout=30s get pods llm-d-4crf2glv0w-test-connection --no-headers --namespace llm-d-4crf2glv0w --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T04:09:17.2374314Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:17.2375993Z ==> Logs of container llm-d-4crf2glv0w-test-connection | |
| 2025-06-24T04:09:17.2376792Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:17.2377891Z >>> kubectl --request-timeout=30s logs llm-d-4crf2glv0w-test-connection --namespace llm-d-4crf2glv0w --container curl | |
| 2025-06-24T04:09:17.2914611Z [32m🥷 Waiting for pods to come up[0m | |
| 2025-06-24T04:09:17.2920714Z | |
| 2025-06-24T04:09:17.2921149Z % Total % Received % Xferd Average Speed Time Time Time Current | |
| 2025-06-24T04:09:17.2921816Z Dload Upload Total Spent Left Speed | |
| 2025-06-24T04:09:17.2922179Z | |
| 2025-06-24T04:09:17.2922348Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 | |
| 2025-06-24T04:09:17.2922802Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 | |
| 2025-06-24T04:09:17.2923092Z | |
| 2025-06-24T04:09:17.2923098Z | |
| 2025-06-24T04:09:17.2923362Z [32m🥷 Basic chat validation[0m | |
| 2025-06-24T04:09:17.2923607Z | |
| 2025-06-24T04:09:17.2923884Z % Total % Received % Xferd Average Speed Time Time Time Current | |
| 2025-06-24T04:09:17.2924453Z Dload Upload Total Spent Left Speed | |
| 2025-06-24T04:09:17.2924765Z | |
| 2025-06-24T04:09:17.2924927Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 | |
| 2025-06-24T04:09:17.2925392Z 100 86 0 0 100 86 0 430 --:--:-- --:--:-- --:--:-- 432 | |
| 2025-06-24T04:09:17.2940376Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:17.2942103Z <== Logs of container llm-d-4crf2glv0w-test-connection | |
| 2025-06-24T04:09:17.2942821Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:17.2943540Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:17.2944259Z ==> Description of pod llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq | |
| 2025-06-24T04:09:17.2944966Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:17.2946451Z >>> kubectl --request-timeout=30s describe pod llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq --namespace llm-d-4crf2glv0w | |
| 2025-06-24T04:09:17.3488613Z Name: llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq | |
| 2025-06-24T04:09:17.3489227Z Namespace: llm-d-4crf2glv0w | |
| 2025-06-24T04:09:17.3490596Z Priority: 0 | |
| 2025-06-24T04:09:17.3490995Z Service Account: llm-d-4crf2glv0w-vllm-sim-sa | |
| 2025-06-24T04:09:17.3491502Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T04:09:17.3491995Z Start Time: Tue, 24 Jun 2025 04:09:00 +0000 | |
| 2025-06-24T04:09:17.3492460Z Labels: llm-d.ai/inferenceServing=true | |
| 2025-06-24T04:09:17.3492912Z llm-d.ai/model=food-review | |
| 2025-06-24T04:09:17.3493321Z llm-d.ai/role=decode | |
| 2025-06-24T04:09:17.3493723Z pod-template-hash=ffb5c945f | |
| 2025-06-24T04:09:17.3494132Z Annotations: <none> | |
| 2025-06-24T04:09:17.3494409Z Status: Running | |
| 2025-06-24T04:09:17.3494620Z IP: 10.244.0.32 | |
| 2025-06-24T04:09:17.3494807Z IPs: | |
| 2025-06-24T04:09:17.3494973Z IP: 10.244.0.32 | |
| 2025-06-24T04:09:17.3495278Z Controlled By: ReplicaSet/llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f | |
| 2025-06-24T04:09:17.3495613Z Init Containers: | |
| 2025-06-24T04:09:17.3495786Z routing-proxy: | |
| 2025-06-24T04:09:17.3496576Z Container ID: containerd://f69fea81b6fbed2758d6fa2454a487adb271be53c624365707101e35fd54de9b | |
| 2025-06-24T04:09:17.3497060Z Image: ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6 | |
| 2025-06-24T04:09:17.3497598Z Image ID: ghcr.io/llm-d/llm-d-routing-sidecar@sha256:7f3db0d03f3b3b16ec2a0e8d0d855bb7db83ef8d670dd9027f194e772a87856b | |
| 2025-06-24T04:09:17.3498078Z Port: 8000/TCP | |
| 2025-06-24T04:09:17.3498282Z Host Port: 0/TCP | |
| 2025-06-24T04:09:17.3498464Z Args: | |
| 2025-06-24T04:09:17.3498629Z --port=8000 | |
| 2025-06-24T04:09:17.3498806Z --vllm-port=8001 | |
| 2025-06-24T04:09:17.3498992Z State: Running | |
| 2025-06-24T04:09:17.3499202Z Started: Tue, 24 Jun 2025 04:09:01 +0000 | |
| 2025-06-24T04:09:17.3499463Z Ready: True | |
| 2025-06-24T04:09:17.3499652Z Restart Count: 0 | |
| 2025-06-24T04:09:17.3500053Z Environment: <none> | |
| 2025-06-24T04:09:17.3500267Z Mounts: | |
| 2025-06-24T04:09:17.3500567Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-dkxjm (ro) | |
| 2025-06-24T04:09:17.3500934Z Containers: | |
| 2025-06-24T04:09:17.3501081Z vllm: | |
| 2025-06-24T04:09:17.3501444Z Container ID: containerd://28ddf2b3484a5abd0a1dda97a24dee4ba288ef9dda5c9eddc54772f1af35a5eb | |
| 2025-06-24T04:09:17.3501911Z Image: ghcr.io/llm-d/llm-d-inference-sim:0.0.4 | |
| 2025-06-24T04:09:17.3502414Z Image ID: ghcr.io/llm-d/llm-d-inference-sim@sha256:5995c4dde42888844812359c121899c1d12e647588ed58fef206c3c653315338 | |
| 2025-06-24T04:09:17.3502870Z Port: 5557/TCP | |
| 2025-06-24T04:09:17.3503071Z Host Port: 0/TCP | |
| 2025-06-24T04:09:17.3503252Z Args: | |
| 2025-06-24T04:09:17.3503398Z --model | |
| 2025-06-24T04:09:17.3503558Z food-review | |
| 2025-06-24T04:09:17.3503717Z --port | |
| 2025-06-24T04:09:17.3503874Z 8001 | |
| 2025-06-24T04:09:17.3504024Z State: Running | |
| 2025-06-24T04:09:17.3504238Z Started: Tue, 24 Jun 2025 04:09:01 +0000 | |
| 2025-06-24T04:09:17.3504473Z Ready: True | |
| 2025-06-24T04:09:17.3504659Z Restart Count: 0 | |
| 2025-06-24T04:09:17.3504829Z Environment: | |
| 2025-06-24T04:09:17.3505004Z HOME: /home | |
| 2025-06-24T04:09:17.3505170Z Mounts: | |
| 2025-06-24T04:09:17.3505327Z /home from home (rw) | |
| 2025-06-24T04:09:17.3505661Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-dkxjm (ro) | |
| 2025-06-24T04:09:17.3506034Z Conditions: | |
| 2025-06-24T04:09:17.3506196Z Type Status | |
| 2025-06-24T04:09:17.3506430Z PodReadyToStartContainers True | |
| 2025-06-24T04:09:17.3506662Z Initialized True | |
| 2025-06-24T04:09:17.3506864Z Ready True | |
| 2025-06-24T04:09:17.3507078Z ContainersReady True | |
| 2025-06-24T04:09:17.3507294Z PodScheduled True | |
| 2025-06-24T04:09:17.3507645Z Volumes: | |
| 2025-06-24T04:09:17.3507802Z home: | |
| 2025-06-24T04:09:17.3508079Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T04:09:17.3508640Z Medium: | |
| 2025-06-24T04:09:17.3508955Z SizeLimit: <unset> | |
| 2025-06-24T04:09:17.3509313Z kube-api-access-dkxjm: | |
| 2025-06-24T04:09:17.3510009Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T04:09:17.3510659Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T04:09:17.3511098Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T04:09:17.3511524Z ConfigMapOptional: <nil> | |
| 2025-06-24T04:09:17.3512075Z DownwardAPI: true | |
| 2025-06-24T04:09:17.3512443Z QoS Class: BestEffort | |
| 2025-06-24T04:09:17.3512853Z Node-Selectors: <none> | |
| 2025-06-24T04:09:17.3513421Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T04:09:17.3514110Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T04:09:17.3514522Z Events: | |
| 2025-06-24T04:09:17.3514713Z Type Reason Age From Message | |
| 2025-06-24T04:09:17.3514992Z ---- ------ ---- ---- ------- | |
| 2025-06-24T04:09:17.3515988Z Normal Scheduled 17s default-scheduler Successfully assigned llm-d-4crf2glv0w/llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq to chart-testing-control-plane | |
| 2025-06-24T04:09:17.3517035Z Normal Pulled 16s kubelet Container image "ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6" already present on machine | |
| 2025-06-24T04:09:17.3517657Z Normal Created 16s kubelet Created container routing-proxy | |
| 2025-06-24T04:09:17.3518104Z Normal Started 16s kubelet Started container routing-proxy | |
| 2025-06-24T04:09:17.3518746Z Normal Pulled 16s kubelet Container image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" already present on machine | |
| 2025-06-24T04:09:17.3519358Z Normal Created 16s kubelet Created container vllm | |
| 2025-06-24T04:09:17.3519724Z Normal Started 16s kubelet Started container vllm | |
| 2025-06-24T04:09:17.3520543Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:17.3520984Z <== Description of pod llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq | |
| 2025-06-24T04:09:17.3521501Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:17.3522543Z >>> kubectl --request-timeout=30s get pods llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq --no-headers --namespace llm-d-4crf2glv0w --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T04:09:17.4037543Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:17.4038384Z ==> Logs of init container llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq | |
| 2025-06-24T04:09:17.4039132Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:17.4040434Z >>> kubectl --request-timeout=30s logs llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq --namespace llm-d-4crf2glv0w --container routing-proxy | |
| 2025-06-24T04:09:17.4585150Z I0624 04:09:01.332514 1 cmd.go:51] "p/d connector validated" connector="nixl" | |
| 2025-06-24T04:09:17.4585983Z I0624 04:09:01.333290 1 proxy.go:115] "starting" logger="proxy server" addr="[::]:8000" | |
| 2025-06-24T04:09:17.4606511Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:17.4607293Z <== Logs of init container llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq | |
| 2025-06-24T04:09:17.4607965Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:17.4610038Z >>> kubectl --request-timeout=30s get pods llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq --no-headers --namespace llm-d-4crf2glv0w --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T04:09:17.5138279Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:17.5139168Z ==> Logs of container llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq | |
| 2025-06-24T04:09:17.5140188Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:17.5141196Z >>> kubectl --request-timeout=30s logs llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq --namespace llm-d-4crf2glv0w --container vllm | |
| 2025-06-24T04:09:17.5655019Z I0624 04:09:01.566152 1 cmd.go:36] "Start vllm simulator" | |
| 2025-06-24T04:09:17.5655726Z I0624 04:09:01.566290 1 simulator.go:135] "Server starting" port=8001 | |
| 2025-06-24T04:09:17.5675546Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:17.5676390Z <== Logs of container llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq | |
| 2025-06-24T04:09:17.5677164Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:17.5678248Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:17.5678893Z ==> Description of pod llm-d-4crf2glv0w-vllm-sim-epp-64bb766589-p6xc2 | |
| 2025-06-24T04:09:17.5679558Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:17.5680433Z >>> kubectl --request-timeout=30s describe pod llm-d-4crf2glv0w-vllm-sim-epp-64bb766589-p6xc2 --namespace llm-d-4crf2glv0w | |
| 2025-06-24T04:09:17.6232233Z Name: llm-d-4crf2glv0w-vllm-sim-epp-64bb766589-p6xc2 | |
| 2025-06-24T04:09:17.6233143Z Namespace: llm-d-4crf2glv0w | |
| 2025-06-24T04:09:17.6233547Z Priority: 0 | |
| 2025-06-24T04:09:17.6233836Z Service Account: llm-d-4crf2glv0w-vllm-sim-epp-sa | |
| 2025-06-24T04:09:17.6234174Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T04:09:17.6234476Z Start Time: Tue, 24 Jun 2025 04:09:00 +0000 | |
| 2025-06-24T04:09:17.6234848Z Labels: app.kubernetes.io/gateway=llm-d-4crf2glv0w-inference-gateway | |
| 2025-06-24T04:09:17.6235219Z llm-d.ai/epp=llm-d-4crf2glv0w-vllm-sim-epp | |
| 2025-06-24T04:09:17.6235501Z pod-template-hash=64bb766589 | |
| 2025-06-24T04:09:17.6235735Z Annotations: <none> | |
| 2025-06-24T04:09:17.6235939Z Status: Running | |
| 2025-06-24T04:09:17.6236125Z IP: 10.244.0.29 | |
| 2025-06-24T04:09:17.6236492Z IPs: | |
| 2025-06-24T04:09:17.6236695Z IP: 10.244.0.29 | |
| 2025-06-24T04:09:17.6236993Z Controlled By: ReplicaSet/llm-d-4crf2glv0w-vllm-sim-epp-64bb766589 | |
| 2025-06-24T04:09:17.6237303Z Containers: | |
| 2025-06-24T04:09:17.6237455Z epp: | |
| 2025-06-24T04:09:17.6237819Z Container ID: containerd://bfe323877d1e9d115d16838288a24b8966f3ba1b6ba8128a3c5b025586a55382 | |
| 2025-06-24T04:09:17.6238319Z Image: ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4 | |
| 2025-06-24T04:09:17.6238884Z Image ID: ghcr.io/llm-d/llm-d-inference-scheduler@sha256:d5d2492ee51c76bc78bb9dc1219dd7fba1fd70afe466c76860a6cd40ddf0c6f5 | |
| 2025-06-24T04:09:17.6239404Z Ports: 9002/TCP, 9003/TCP, 9090/TCP | |
| 2025-06-24T04:09:17.6239660Z Host Ports: 0/TCP, 0/TCP, 0/TCP | |
| 2025-06-24T04:09:17.6240184Z Args: | |
| 2025-06-24T04:09:17.6240352Z --poolName | |
| 2025-06-24T04:09:17.6240568Z llm-d-4crf2glv0w-vllm-sim-inference-pool | |
| 2025-06-24T04:09:17.6240830Z --poolNamespace | |
| 2025-06-24T04:09:17.6241013Z llm-d-4crf2glv0w | |
| 2025-06-24T04:09:17.6241189Z -v | |
| 2025-06-24T04:09:17.6241333Z 4 | |
| 2025-06-24T04:09:17.6241618Z --zap-encoder | |
| 2025-06-24T04:09:17.6241919Z json | |
| 2025-06-24T04:09:17.6242197Z --grpcPort | |
| 2025-06-24T04:09:17.6242488Z 9002 | |
| 2025-06-24T04:09:17.6242956Z --grpcHealthPort | |
| 2025-06-24T04:09:17.6243143Z 9003 | |
| 2025-06-24T04:09:17.6243293Z State: Running | |
| 2025-06-24T04:09:17.6243512Z Started: Tue, 24 Jun 2025 04:09:01 +0000 | |
| 2025-06-24T04:09:17.6243750Z Ready: True | |
| 2025-06-24T04:09:17.6243943Z Restart Count: 0 | |
| 2025-06-24T04:09:17.6244113Z Requests: | |
| 2025-06-24T04:09:17.6244273Z cpu: 256m | |
| 2025-06-24T04:09:17.6244440Z memory: 128Mi | |
| 2025-06-24T04:09:17.6244881Z Liveness: grpc <pod>:9003 envoy.service.ext_proc.v3.ExternalProcessor delay=5s timeout=1s period=10s #success=1 #failure=3 | |
| 2025-06-24T04:09:17.6245593Z Readiness: grpc <pod>:9003 envoy.service.ext_proc.v3.ExternalProcessor delay=5s timeout=1s period=10s #success=1 #failure=3 | |
| 2025-06-24T04:09:17.6246052Z Environment: | |
| 2025-06-24T04:09:17.6246247Z ENABLE_KVCACHE_AWARE_SCORER: false | |
| 2025-06-24T04:09:17.6246506Z ENABLE_LOAD_AWARE_SCORER: true | |
| 2025-06-24T04:09:17.6246764Z ENABLE_PREFIX_AWARE_SCORER: true | |
| 2025-06-24T04:09:17.6247033Z ENABLE_SESSION_AWARE_SCORER: false | |
| 2025-06-24T04:09:17.6247425Z KVCACHE_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T04:09:17.6247884Z KVCACHE_INDEXER_REDIS_ADDR: llm-d-4crf2glv0w-redis-master.llm-d-4crf2glv0w.svc.cluster.local:8100 | |
| 2025-06-24T04:09:17.6248495Z LOAD_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T04:09:17.6248739Z PD_ENABLED: false | |
| 2025-06-24T04:09:17.6248983Z PD_PROMPT_LEN_THRESHOLD: 10 | |
| 2025-06-24T04:09:17.6249243Z PREFILL_ENABLE_KVCACHE_AWARE_SCORER: false | |
| 2025-06-24T04:09:17.6249499Z PREFILL_ENABLE_LOAD_AWARE_SCORER: false | |
| 2025-06-24T04:09:17.6249756Z PREFILL_ENABLE_PREFIX_AWARE_SCORER: false | |
| 2025-06-24T04:09:17.6250327Z PREFILL_ENABLE_SESSION_AWARE_SCORER: false | |
| 2025-06-24T04:09:17.6250581Z PREFILL_KVCACHE_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T04:09:17.6251053Z PREFILL_KVCACHE_INDEXER_REDIS_ADDR: llm-d-4crf2glv0w-redis-master.llm-d-4crf2glv0w.svc.cluster.local:8100 | |
| 2025-06-24T04:09:17.6251521Z PREFILL_LOAD_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T04:09:17.6251770Z PREFILL_PREFIX_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T04:09:17.6252007Z PREFILL_SESSION_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T04:09:17.6252257Z PREFIX_AWARE_SCORER_WEIGHT: 2 | |
| 2025-06-24T04:09:17.6252495Z SESSION_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T04:09:17.6252708Z Mounts: | |
| 2025-06-24T04:09:17.6253005Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-tsvgg (ro) | |
| 2025-06-24T04:09:17.6253481Z Conditions: | |
| 2025-06-24T04:09:17.6253754Z Type Status | |
| 2025-06-24T04:09:17.6254148Z PodReadyToStartContainers True | |
| 2025-06-24T04:09:17.6254555Z Initialized True | |
| 2025-06-24T04:09:17.6254927Z Ready True | |
| 2025-06-24T04:09:17.6255321Z ContainersReady True | |
| 2025-06-24T04:09:17.6255720Z PodScheduled True | |
| 2025-06-24T04:09:17.6256060Z Volumes: | |
| 2025-06-24T04:09:17.6256352Z kube-api-access-tsvgg: | |
| 2025-06-24T04:09:17.6256883Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T04:09:17.6257511Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T04:09:17.6257761Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T04:09:17.6258129Z ConfigMapOptional: <nil> | |
| 2025-06-24T04:09:17.6258352Z DownwardAPI: true | |
| 2025-06-24T04:09:17.6258571Z QoS Class: Burstable | |
| 2025-06-24T04:09:17.6258913Z Node-Selectors: <none> | |
| 2025-06-24T04:09:17.6259497Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T04:09:17.6260321Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T04:09:17.6260733Z Events: | |
| 2025-06-24T04:09:17.6260933Z Type Reason Age From Message | |
| 2025-06-24T04:09:17.6261421Z ---- ------ ---- ---- ------- | |
| 2025-06-24T04:09:17.6262177Z Normal Scheduled 17s default-scheduler Successfully assigned llm-d-4crf2glv0w/llm-d-4crf2glv0w-vllm-sim-epp-64bb766589-p6xc2 to chart-testing-control-plane | |
| 2025-06-24T04:09:17.6263149Z Normal Pulling 16s kubelet Pulling image "ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4" | |
| 2025-06-24T04:09:17.6264035Z Normal Pulled 16s kubelet Successfully pulled image "ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4" in 257ms (257ms including waiting). Image size: 119587259 bytes. | |
| 2025-06-24T04:09:17.6264801Z Normal Created 16s kubelet Created container epp | |
| 2025-06-24T04:09:17.6265155Z Normal Started 16s kubelet Started container epp | |
| 2025-06-24T04:09:17.6265620Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:17.6266025Z <== Description of pod llm-d-4crf2glv0w-vllm-sim-epp-64bb766589-p6xc2 | |
| 2025-06-24T04:09:17.6266527Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:17.6267374Z >>> kubectl --request-timeout=30s get pods llm-d-4crf2glv0w-vllm-sim-epp-64bb766589-p6xc2 --no-headers --namespace llm-d-4crf2glv0w --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T04:09:17.6759286Z >>> kubectl --request-timeout=30s get pods llm-d-4crf2glv0w-vllm-sim-epp-64bb766589-p6xc2 --no-headers --namespace llm-d-4crf2glv0w --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T04:09:17.7311672Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:17.7313019Z ==> Logs of container llm-d-4crf2glv0w-vllm-sim-epp-64bb766589-p6xc2 | |
| 2025-06-24T04:09:17.7313844Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:17.7314553Z >>> kubectl --request-timeout=30s logs llm-d-4crf2glv0w-vllm-sim-epp-64bb766589-p6xc2 --namespace llm-d-4crf2glv0w --container epp | |
| 2025-06-24T04:09:17.7859515Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"epp/main.go:146","msg":"Flags processed","flags":{"DestinationEndpointHintMetadataNamespace":"envoy.lb","certPath":"","destinationEndpointHintKey":"x-gateway-destination-endpoint","grpcHealthPort":9003,"grpcPort":9002,"kubeconfig":"","kvCacheUsagePercentageMetric":"vllm:gpu_cache_usage_perc","loraInfoMetric":"vllm:lora_requests_info","metricsPort":9090,"poolName":"llm-d-4crf2glv0w-vllm-sim-inference-pool","poolNamespace":"llm-d-4crf2glv0w","refreshMetricsInterval":50000000,"refreshPrometheusMetricsInterval":5000000000,"secureServing":true,"totalQueuedRequestsMetric":"vllm:num_requests_waiting","v":4,"zap-devel":true,"zap-encoder":{},"zap-log-level":{},"zap-stacktrace-level":{},"zap-time-encoding":{}}} | |
| 2025-06-24T04:09:17.7864413Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"ENABLE_KVCACHE_AWARE_SCORER","value":"false"} | |
| 2025-06-24T04:09:17.7865963Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"KVCACHE_AWARE_SCORER"} | |
| 2025-06-24T04:09:17.7867413Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"ENABLE_LOAD_AWARE_SCORER","value":"true"} | |
| 2025-06-24T04:09:17.7868853Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"LOAD_AWARE_SCORER_WEIGHT","value":1} | |
| 2025-06-24T04:09:17.7870443Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"config/config.go:115","msg":"Initialized plugin","plugin":"LOAD_AWARE_SCORER","weight":1} | |
| 2025-06-24T04:09:17.7872101Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"ENABLE_PREFIX_AWARE_SCORER","value":"true"} | |
| 2025-06-24T04:09:17.7873611Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PREFIX_AWARE_SCORER_WEIGHT","value":2} | |
| 2025-06-24T04:09:17.7875107Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"config/config.go:115","msg":"Initialized plugin","plugin":"PREFIX_AWARE_SCORER","weight":2} | |
| 2025-06-24T04:09:17.7876534Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"ENABLE_SESSION_AWARE_SCORER","value":"false"} | |
| 2025-06-24T04:09:17.7878024Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"SESSION_AWARE_SCORER"} | |
| 2025-06-24T04:09:17.7879604Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_LEAST_KVCACHE_FILTER","defaultValue":"false"} | |
| 2025-06-24T04:09:17.7881370Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LEAST_KVCACHE_FILTER"} | |
| 2025-06-24T04:09:17.7883131Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_LEAST_QUEUE_FILTER","defaultValue":"false"} | |
| 2025-06-24T04:09:17.7884816Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LEAST_QUEUE_FILTER"} | |
| 2025-06-24T04:09:17.7886504Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_LORA_AFFINITY_FILTER","defaultValue":"false"} | |
| 2025-06-24T04:09:17.7888086Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LORA_AFFINITY_FILTER"} | |
| 2025-06-24T04:09:17.7889554Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_LOW_QUEUE_FILTER","defaultValue":"false"} | |
| 2025-06-24T04:09:17.7891283Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LOW_QUEUE_FILTER"} | |
| 2025-06-24T04:09:17.7893489Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_SHEDDABLE_CAPACITY_FILTER","defaultValue":"false"} | |
| 2025-06-24T04:09:17.7895408Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_SHEDDABLE_CAPACITY_FILTER"} | |
| 2025-06-24T04:09:17.7897045Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_KVCACHE_UTILIZATION_SCORER","defaultValue":"false"} | |
| 2025-06-24T04:09:17.7898768Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_KVCACHE_UTILIZATION_SCORER"} | |
| 2025-06-24T04:09:17.7900611Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_QUEUE_SCORER","defaultValue":"false"} | |
| 2025-06-24T04:09:17.7902254Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_QUEUE_SCORER"} | |
| 2025-06-24T04:09:17.7904112Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_PREFIX_SCORER","defaultValue":"false"} | |
| 2025-06-24T04:09:17.7905885Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_PREFIX_SCORER"} | |
| 2025-06-24T04:09:17.7907562Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PREFILL_ENABLE_KVCACHE_AWARE_SCORER","value":"false"} | |
| 2025-06-24T04:09:17.7909222Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"KVCACHE_AWARE_SCORER"} | |
| 2025-06-24T04:09:17.7911036Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PREFILL_ENABLE_LOAD_AWARE_SCORER","value":"false"} | |
| 2025-06-24T04:09:17.7912680Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"LOAD_AWARE_SCORER"} | |
| 2025-06-24T04:09:17.7914531Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PREFILL_ENABLE_PREFIX_AWARE_SCORER","value":"false"} | |
| 2025-06-24T04:09:17.7916091Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"PREFIX_AWARE_SCORER"} | |
| 2025-06-24T04:09:17.7917821Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PREFILL_ENABLE_SESSION_AWARE_SCORER","value":"false"} | |
| 2025-06-24T04:09:17.7919464Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"SESSION_AWARE_SCORER"} | |
| 2025-06-24T04:09:17.7921375Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_LEAST_KVCACHE_FILTER","defaultValue":"false"} | |
| 2025-06-24T04:09:17.7923071Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LEAST_KVCACHE_FILTER"} | |
| 2025-06-24T04:09:17.7924750Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_LEAST_QUEUE_FILTER","defaultValue":"false"} | |
| 2025-06-24T04:09:17.7927010Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LEAST_QUEUE_FILTER"} | |
| 2025-06-24T04:09:17.7929184Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_LORA_AFFINITY_FILTER","defaultValue":"false"} | |
| 2025-06-24T04:09:17.7931105Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LORA_AFFINITY_FILTER"} | |
| 2025-06-24T04:09:17.7932820Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_LOW_QUEUE_FILTER","defaultValue":"false"} | |
| 2025-06-24T04:09:17.7934555Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LOW_QUEUE_FILTER"} | |
| 2025-06-24T04:09:17.7936524Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_SHEDDABLE_CAPACITY_FILTER","defaultValue":"false"} | |
| 2025-06-24T04:09:17.7938333Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_SHEDDABLE_CAPACITY_FILTER"} | |
| 2025-06-24T04:09:17.7940299Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_KVCACHE_UTILIZATION_SCORER","defaultValue":"false"} | |
| 2025-06-24T04:09:17.7943041Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_KVCACHE_UTILIZATION_SCORER"} | |
| 2025-06-24T04:09:17.7945486Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_QUEUE_SCORER","defaultValue":"false"} | |
| 2025-06-24T04:09:17.7947255Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_QUEUE_SCORER"} | |
| 2025-06-24T04:09:17.7948962Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_PREFIX_SCORER","defaultValue":"false"} | |
| 2025-06-24T04:09:17.7951374Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_PREFIX_SCORER"} | |
| 2025-06-24T04:09:17.7952952Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PD_ENABLED","value":"false"} | |
| 2025-06-24T04:09:17.7954498Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PD_PROMPT_LEN_THRESHOLD","value":10} | |
| 2025-06-24T04:09:17.7956601Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFIX_SCORER_BLOCK_SIZE","defaultValue":256} | |
| 2025-06-24T04:09:17.7958347Z {"level":"info","ts":"2025-06-24T04:09:01Z","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"LOAD_AWARE_SCORER_QUEUE_THRESHOLD","defaultValue":128} | |
| 2025-06-24T04:09:17.7959976Z {"level":"info","ts":"2025-06-24T04:09:01Z","caller":"scorer/prefix_aware.go:154","msg":"Prefix aware scorer cleanup started"} | |
| 2025-06-24T04:09:17.7961081Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"setup","caller":"epp/main.go:224","msg":"Controller manager starting"} | |
| 2025-06-24T04:09:17.7962232Z {"level":"info","ts":"2025-06-24T04:09:01Z","caller":"manager/server.go:83","msg":"starting server","name":"metrics","addr":":9090"} | |
| 2025-06-24T04:09:17.7963520Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"controller-runtime.metrics","caller":"server/server.go:208","msg":"Starting metrics server"} | |
| 2025-06-24T04:09:17.7965078Z {"level":"info","ts":"2025-06-24T04:09:01Z","logger":"controller-runtime.metrics","caller":"server/server.go:247","msg":"Serving metrics server","bindAddress":":8080","secure":false} | |
| 2025-06-24T04:09:17.7966434Z {"level":"info","ts":"2025-06-24T04:09:01Z","caller":"runnable/grpc.go:26","msg":"gRPC server starting","name":"health"} | |
| 2025-06-24T04:09:17.7967514Z {"level":"info","ts":"2025-06-24T04:09:01Z","caller":"runnable/grpc.go:34","msg":"gRPC server listening","name":"health","port":9003} | |
| 2025-06-24T04:09:17.7969476Z {"level":"info","ts":"2025-06-24T04:09:01Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool","source":"kind source: *v1alpha2.InferencePool"} | |
| 2025-06-24T04:09:17.7972045Z {"level":"info","ts":"2025-06-24T04:09:01Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"pod","controllerGroup":"","controllerKind":"Pod","source":"kind source: *v1.Pod"} | |
| 2025-06-24T04:09:17.7973671Z {"level":"info","ts":"2025-06-24T04:09:01Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"inferencemodel","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferenceModel","source":"kind source: *v1alpha2.InferenceModel"} | |
| 2025-06-24T04:09:17.7974929Z {"level":"info","ts":"2025-06-24T04:09:01Z","caller":"controller/controller.go:239","msg":"Starting Controller","controller":"pod","controllerGroup":"","controllerKind":"Pod"} | |
| 2025-06-24T04:09:17.7975869Z {"level":"info","ts":"2025-06-24T04:09:01Z","caller":"controller/controller.go:248","msg":"Starting workers","controller":"pod","controllerGroup":"","controllerKind":"Pod","worker count":1} | |
| 2025-06-24T04:09:17.7977001Z {"level":"info","ts":"2025-06-24T04:09:01Z","caller":"controller/controller.go:239","msg":"Starting Controller","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool"} | |
| 2025-06-24T04:09:17.7979072Z {"level":"info","ts":"2025-06-24T04:09:01Z","caller":"controller/controller.go:239","msg":"Starting Controller","controller":"inferencemodel","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferenceModel"} | |
| 2025-06-24T04:09:17.7981727Z {"level":"info","ts":"2025-06-24T04:09:01Z","caller":"controller/controller.go:248","msg":"Starting workers","controller":"inferencemodel","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferenceModel","worker count":1} | |
| 2025-06-24T04:09:17.7984195Z {"level":"info","ts":"2025-06-24T04:09:01Z","caller":"controller/controller.go:248","msg":"Starting workers","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool","worker count":1} | |
| 2025-06-24T04:09:17.7987298Z {"level":"Level(-2)","ts":"2025-06-24T04:09:01Z","caller":"controller/inferencemodel_reconciler.go:47","msg":"Reconciling InferenceModel","controller":"inferencemodel","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferenceModel","InferenceModel":{"name":"llm-d-4crf2glv0w-vllm-sim","namespace":"llm-d-4crf2glv0w"},"namespace":"llm-d-4crf2glv0w","name":"llm-d-4crf2glv0w-vllm-sim","reconcileID":"68ff44c8-50d3-470a-9f81-fef49918e440","inferenceModel":{"name":"llm-d-4crf2glv0w-vllm-sim","namespace":"llm-d-4crf2glv0w"}} | |
| 2025-06-24T04:09:17.7991358Z {"level":"Level(-2)","ts":"2025-06-24T04:09:01Z","caller":"controller/inferencemodel_reconciler.go:70","msg":"Added/Updated InferenceModel","controller":"inferencemodel","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferenceModel","InferenceModel":{"name":"llm-d-4crf2glv0w-vllm-sim","namespace":"llm-d-4crf2glv0w"},"namespace":"llm-d-4crf2glv0w","name":"llm-d-4crf2glv0w-vllm-sim","reconcileID":"68ff44c8-50d3-470a-9f81-fef49918e440","inferenceModel":{"name":"llm-d-4crf2glv0w-vllm-sim","namespace":"llm-d-4crf2glv0w"},"poolRef":{"group":"inference.networking.x-k8s.io","kind":"InferencePool","name":"llm-d-4crf2glv0w-vllm-sim-inference-pool"},"modelName":"food-review"} | |
| 2025-06-24T04:09:17.7995070Z {"level":"Level(-2)","ts":"2025-06-24T04:09:01Z","caller":"controller/inferencepool_reconciler.go:45","msg":"Reconciling InferencePool","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool","InferencePool":{"name":"llm-d-4crf2glv0w-vllm-sim-inference-pool","namespace":"llm-d-4crf2glv0w"},"namespace":"llm-d-4crf2glv0w","name":"llm-d-4crf2glv0w-vllm-sim-inference-pool","reconcileID":"a1744011-9716-4552-8f1f-1d7f22657d0c","inferencePool":{"name":"llm-d-4crf2glv0w-vllm-sim-inference-pool","namespace":"llm-d-4crf2glv0w"}} | |
| 2025-06-24T04:09:17.8001592Z {"level":"Level(-4)","ts":"2025-06-24T04:09:01Z","caller":"datastore/datastore.go:125","msg":"Updating inference pool endpoints","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool","InferencePool":{"name":"llm-d-4crf2glv0w-vllm-sim-inference-pool","namespace":"llm-d-4crf2glv0w"},"namespace":"llm-d-4crf2glv0w","name":"llm-d-4crf2glv0w-vllm-sim-inference-pool","reconcileID":"a1744011-9716-4552-8f1f-1d7f22657d0c","inferencePool":{"name":"llm-d-4crf2glv0w-vllm-sim-inference-pool","namespace":"llm-d-4crf2glv0w"},"selector":{"llm-d.ai/inferenceServing":"true","llm-d.ai/model":"food-review"}} | |
| 2025-06-24T04:09:17.8008479Z {"level":"Level(-4)","ts":"2025-06-24T04:09:01Z","caller":"datastore/datastore.go:311","msg":"Pod already exists","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool","InferencePool":{"name":"llm-d-4crf2glv0w-vllm-sim-inference-pool","namespace":"llm-d-4crf2glv0w"},"namespace":"llm-d-4crf2glv0w","name":"llm-d-4crf2glv0w-vllm-sim-inference-pool","reconcileID":"a1744011-9716-4552-8f1f-1d7f22657d0c","inferencePool":{"name":"llm-d-4crf2glv0w-vllm-sim-inference-pool","namespace":"llm-d-4crf2glv0w"},"name":{"name":"llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc-gx8r8","namespace":"llm-d-4crf2glv0w"}} | |
| 2025-06-24T04:09:17.8014460Z {"level":"Level(-2)","ts":"2025-06-24T04:09:01Z","caller":"metrics/pod_metrics.go:92","msg":"Starting refresher","pod":{"name":"llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc-gx8r8","namespace":"llm-d-4crf2glv0w"},"pod":"{NamespacedName:llm-d-4crf2glv0w/llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc-gx8r8 Address:10.244.0.30 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:prefill pod-template-hash:5cf457ccc]}"} | |
| 2025-06-24T04:09:17.8019669Z {"level":"Level(-3)","ts":"2025-06-24T04:09:02Z","caller":"controller/pod_reconciler.go:51","msg":"Pod being reconciled","controller":"pod","controllerGroup":"","controllerKind":"Pod","Pod":{"name":"llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq","namespace":"llm-d-4crf2glv0w"},"namespace":"llm-d-4crf2glv0w","name":"llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq","reconcileID":"d4f880ce-a236-4923-b16c-d2a6a30d6d5a","name":{"name":"llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq","namespace":"llm-d-4crf2glv0w"}} | |
| 2025-06-24T04:09:17.8025204Z {"level":"Level(-2)","ts":"2025-06-24T04:09:02Z","caller":"controller/pod_reconciler.go:102","msg":"Pod already exists","controller":"pod","controllerGroup":"","controllerKind":"Pod","Pod":{"name":"llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq","namespace":"llm-d-4crf2glv0w"},"namespace":"llm-d-4crf2glv0w","name":"llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq","reconcileID":"d4f880ce-a236-4923-b16c-d2a6a30d6d5a","name":{"name":"llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq","namespace":"llm-d-4crf2glv0w"}} | |
| 2025-06-24T04:09:17.8030294Z {"level":"Level(-2)","ts":"2025-06-24T04:09:02Z","caller":"metrics/pod_metrics.go:92","msg":"Starting refresher","pod":{"name":"llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq","namespace":"llm-d-4crf2glv0w"},"pod":"{NamespacedName:llm-d-4crf2glv0w/llm-d-4crf2glv0w-vllm-sim-decode-ffb5c945f-7xglq Address:10.244.0.32 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:decode pod-template-hash:ffb5c945f]}"} | |
| 2025-06-24T04:09:17.8033078Z {"level":"info","ts":"2025-06-24T04:09:05Z","caller":"runnable/grpc.go:19","msg":"gRPC server starting","name":"ext-proc"} | |
| 2025-06-24T04:09:17.8034200Z {"level":"info","ts":"2025-06-24T04:09:05Z","caller":"runnable/grpc.go:28","msg":"gRPC server listening","name":"ext-proc","port":9002} | |
| 2025-06-24T04:09:17.8038019Z {"level":"Level(-2)","ts":"2025-06-24T04:09:16Z","caller":"controller/inferencepool_reconciler.go:45","msg":"Reconciling InferencePool","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool","InferencePool":{"name":"llm-d-4crf2glv0w-vllm-sim-inference-pool","namespace":"llm-d-4crf2glv0w"},"namespace":"llm-d-4crf2glv0w","name":"llm-d-4crf2glv0w-vllm-sim-inference-pool","reconcileID":"86c1f19d-dd50-4b35-8b3c-7dd761f25f52","inferencePool":{"name":"llm-d-4crf2glv0w-vllm-sim-inference-pool","namespace":"llm-d-4crf2glv0w"}} | |
| 2025-06-24T04:09:17.8042127Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:17.8042920Z <== Logs of container llm-d-4crf2glv0w-vllm-sim-epp-64bb766589-p6xc2 | |
| 2025-06-24T04:09:17.8043677Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:17.8044425Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:17.8045143Z ==> Description of pod llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc-gx8r8 | |
| 2025-06-24T04:09:17.8045854Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:17.8046856Z >>> kubectl --request-timeout=30s describe pod llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc-gx8r8 --namespace llm-d-4crf2glv0w | |
| 2025-06-24T04:09:17.8706490Z Name: llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc-gx8r8 | |
| 2025-06-24T04:09:17.8710492Z Namespace: llm-d-4crf2glv0w | |
| 2025-06-24T04:09:17.8711147Z Priority: 0 | |
| 2025-06-24T04:09:17.8711585Z Service Account: llm-d-4crf2glv0w-vllm-sim-sa | |
| 2025-06-24T04:09:17.8712085Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T04:09:17.8712976Z Start Time: Tue, 24 Jun 2025 04:09:00 +0000 | |
| 2025-06-24T04:09:17.8713426Z Labels: llm-d.ai/inferenceServing=true | |
| 2025-06-24T04:09:17.8713868Z llm-d.ai/model=food-review | |
| 2025-06-24T04:09:17.8714260Z llm-d.ai/role=prefill | |
| 2025-06-24T04:09:17.8714665Z pod-template-hash=5cf457ccc | |
| 2025-06-24T04:09:17.8715061Z Annotations: <none> | |
| 2025-06-24T04:09:17.8715368Z Status: Running | |
| 2025-06-24T04:09:17.8715677Z IP: 10.244.0.30 | |
| 2025-06-24T04:09:17.8715975Z IPs: | |
| 2025-06-24T04:09:17.8716215Z IP: 10.244.0.30 | |
| 2025-06-24T04:09:17.8716718Z Controlled By: ReplicaSet/llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc | |
| 2025-06-24T04:09:17.8717276Z Containers: | |
| 2025-06-24T04:09:17.8717516Z vllm: | |
| 2025-06-24T04:09:17.8718122Z Container ID: containerd://99b70ad1326bdc8cfe9cf4e4ea95f547be1e5228f09a77e5b64170e0971629f6 | |
| 2025-06-24T04:09:17.8718921Z Image: ghcr.io/llm-d/llm-d-inference-sim:0.0.4 | |
| 2025-06-24T04:09:17.8719770Z Image ID: ghcr.io/llm-d/llm-d-inference-sim@sha256:5995c4dde42888844812359c121899c1d12e647588ed58fef206c3c653315338 | |
| 2025-06-24T04:09:17.8720720Z Port: 5557/TCP | |
| 2025-06-24T04:09:17.8721039Z Host Port: 0/TCP | |
| 2025-06-24T04:09:17.8721336Z Args: | |
| 2025-06-24T04:09:17.8721575Z --model | |
| 2025-06-24T04:09:17.8721860Z food-review | |
| 2025-06-24T04:09:17.8722128Z --port | |
| 2025-06-24T04:09:17.8722369Z 8000 | |
| 2025-06-24T04:09:17.8722618Z State: Running | |
| 2025-06-24T04:09:17.8723083Z Started: Tue, 24 Jun 2025 04:09:01 +0000 | |
| 2025-06-24T04:09:17.8723480Z Ready: True | |
| 2025-06-24T04:09:17.8723777Z Restart Count: 0 | |
| 2025-06-24T04:09:17.8724073Z Environment: | |
| 2025-06-24T04:09:17.8724338Z HOME: /home | |
| 2025-06-24T04:09:17.8724600Z Mounts: | |
| 2025-06-24T04:09:17.8724852Z /home from home (rw) | |
| 2025-06-24T04:09:17.8725406Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-kn747 (ro) | |
| 2025-06-24T04:09:17.8726041Z Conditions: | |
| 2025-06-24T04:09:17.8726303Z Type Status | |
| 2025-06-24T04:09:17.8726715Z PodReadyToStartContainers True | |
| 2025-06-24T04:09:17.8727104Z Initialized True | |
| 2025-06-24T04:09:17.8727480Z Ready True | |
| 2025-06-24T04:09:17.8727836Z ContainersReady True | |
| 2025-06-24T04:09:17.8728199Z PodScheduled True | |
| 2025-06-24T04:09:17.8728529Z Volumes: | |
| 2025-06-24T04:09:17.8728771Z home: | |
| 2025-06-24T04:09:17.8729162Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T04:09:17.8729607Z Medium: | |
| 2025-06-24T04:09:17.8730012Z SizeLimit: <unset> | |
| 2025-06-24T04:09:17.8730600Z kube-api-access-kn747: | |
| 2025-06-24T04:09:17.8731176Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T04:09:17.8731783Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T04:09:17.8732185Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T04:09:17.8732603Z ConfigMapOptional: <nil> | |
| 2025-06-24T04:09:17.8732995Z DownwardAPI: true | |
| 2025-06-24T04:09:17.8733349Z QoS Class: BestEffort | |
| 2025-06-24T04:09:17.8733754Z Node-Selectors: <none> | |
| 2025-06-24T04:09:17.8734330Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T04:09:17.8735083Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T04:09:17.8735598Z Events: | |
| 2025-06-24T04:09:17.8735926Z Type Reason Age From Message | |
| 2025-06-24T04:09:17.8736409Z ---- ------ ---- ---- ------- | |
| 2025-06-24T04:09:17.8737608Z Normal Scheduled 17s default-scheduler Successfully assigned llm-d-4crf2glv0w/llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc-gx8r8 to chart-testing-control-plane | |
| 2025-06-24T04:09:17.8739157Z Normal Pulled 16s kubelet Container image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" already present on machine | |
| 2025-06-24T04:09:17.8741118Z Normal Created 16s kubelet Created container vllm | |
| 2025-06-24T04:09:17.8741737Z Normal Started 16s kubelet Started container vllm | |
| 2025-06-24T04:09:17.8751181Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:17.8751954Z <== Description of pod llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc-gx8r8 | |
| 2025-06-24T04:09:17.8752685Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T04:09:17.8754079Z >>> kubectl --request-timeout=30s get pods llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc-gx8r8 --no-headers --namespace llm-d-4crf2glv0w --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T04:09:17.9373439Z >>> kubectl --request-timeout=30s get pods llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc-gx8r8 --no-headers --namespace llm-d-4crf2glv0w --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T04:09:17.9884494Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:17.9885666Z ==> Logs of container llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc-gx8r8 | |
| 2025-06-24T04:09:17.9886434Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:17.9887462Z >>> kubectl --request-timeout=30s logs llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc-gx8r8 --namespace llm-d-4crf2glv0w --container vllm | |
| 2025-06-24T04:09:18.0402665Z I0624 04:09:01.262605 1 cmd.go:36] "Start vllm simulator" | |
| 2025-06-24T04:09:18.0403339Z I0624 04:09:01.262785 1 simulator.go:135] "Server starting" port=8000 | |
| 2025-06-24T04:09:18.0425596Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:18.0426472Z <== Logs of container llm-d-4crf2glv0w-vllm-sim-prefill-5cf457ccc-gx8r8 | |
| 2025-06-24T04:09:18.0427296Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:18.0427933Z ======================================================================================================================== | |
| 2025-06-24T04:09:18.0428319Z Deleting release "llm-d-4crf2glv0w"... | |
| 2025-06-24T04:09:18.0428891Z >>> helm uninstall llm-d-4crf2glv0w --namespace llm-d-4crf2glv0w --timeout 500s | |
| 2025-06-24T04:09:18.6156696Z release "llm-d-4crf2glv0w" uninstalled | |
| 2025-06-24T04:09:18.6199358Z Deleting namespace "llm-d-4crf2glv0w"... | |
| 2025-06-24T04:09:18.6202681Z >>> kubectl --request-timeout=30s delete namespace llm-d-4crf2glv0w --timeout 180s | |
| 2025-06-24T04:09:18.6872852Z namespace "llm-d-4crf2glv0w" deleted | |
| 2025-06-24T04:09:56.8287133Z >>> kubectl --request-timeout=30s get namespace llm-d-4crf2glv0w | |
| 2025-06-24T04:09:56.8800039Z Namespace "llm-d-4crf2glv0w" terminated. | |
| 2025-06-24T04:09:56.8800645Z >>> git worktree remove ./ct-previous-revision790133394 | |
| 2025-06-24T04:09:56.8983217Z Error: failed installing charts: failed processing charts | |
| 2025-06-24T04:09:56.8983639Z | |
| 2025-06-24T04:09:56.8983970Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:56.8985122Z ✖︎ llm-d => (version: "1.0.21", path: "charts/llm-d") > failed waiting for process: exit status 1 | |
| 2025-06-24T04:09:56.8985907Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T04:09:56.8986576Z failed installing charts: failed processing charts | |
| 2025-06-24T04:09:56.9008099Z ##[error]Process completed with exit code 1. | |
| 2025-06-24T04:09:56.9068766Z Post job cleanup. | |
| 2025-06-24T04:09:56.9431789Z Error response from daemon: No such container: kind-registry | |
| 2025-06-24T04:09:56.9577197Z Deleting cluster "chart-testing" ... | |
| 2025-06-24T04:09:59.4311029Z Deleted nodes: ["chart-testing-control-plane"] | |
| 2025-06-24T04:09:59.4402943Z Post job cleanup. | |
| 2025-06-24T04:09:59.5330541Z [command]/usr/bin/git version | |
| 2025-06-24T04:09:59.5373640Z git version 2.49.0 | |
| 2025-06-24T04:09:59.5415454Z Temporarily overriding HOME='/home/runner/work/_temp/e82ba046-600e-4384-949d-87fa3004d377' before making global git config changes | |
| 2025-06-24T04:09:59.5416370Z Adding repository directory to the temporary git global config as a safe directory | |
| 2025-06-24T04:09:59.5420446Z [command]/usr/bin/git config --global --add safe.directory /home/runner/work/llm-d-deployer/llm-d-deployer | |
| 2025-06-24T04:09:59.5456990Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand | |
| 2025-06-24T04:09:59.5488797Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" | |
| 2025-06-24T04:09:59.5715284Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader | |
| 2025-06-24T04:09:59.5735423Z http.https://github.com/.extraheader | |
| 2025-06-24T04:09:59.5748306Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader | |
| 2025-06-24T04:09:59.5779456Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" | |
| 2025-06-24T04:09:59.6104141Z Cleaning up orphan processes |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment