Last active
June 24, 2025 03:20
-
-
Save nerdalert/f302eeb7699bd2a561a7e70ec530399d to your computer and use it in GitHub Desktop.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2025-06-24T02:53:43.4754220Z Current runner version: '2.325.0' | |
| 2025-06-24T02:53:43.4782172Z ##[group]Operating System | |
| 2025-06-24T02:53:43.4783684Z Ubuntu | |
| 2025-06-24T02:53:43.4784437Z 24.04.2 | |
| 2025-06-24T02:53:43.4785176Z LTS | |
| 2025-06-24T02:53:43.4785895Z ##[endgroup] | |
| 2025-06-24T02:53:43.4786846Z ##[group]Runner Image | |
| 2025-06-24T02:53:43.4787746Z Image: ubuntu-24.04 | |
| 2025-06-24T02:53:43.4788600Z Version: 20250615.1.0 | |
| 2025-06-24T02:53:43.4790596Z Included Software: https://github.com/actions/runner-images/blob/ubuntu24/20250615.1/images/ubuntu/Ubuntu2404-Readme.md | |
| 2025-06-24T02:53:43.4793229Z Image Release: https://github.com/actions/runner-images/releases/tag/ubuntu24%2F20250615.1 | |
| 2025-06-24T02:53:43.4794836Z ##[endgroup] | |
| 2025-06-24T02:53:43.4795840Z ##[group]Runner Image Provisioner | |
| 2025-06-24T02:53:43.4796881Z 2.0.437.1 | |
| 2025-06-24T02:53:43.4797642Z ##[endgroup] | |
| 2025-06-24T02:53:43.4799478Z ##[group]GITHUB_TOKEN Permissions | |
| 2025-06-24T02:53:43.4802260Z Contents: read | |
| 2025-06-24T02:53:43.4803458Z Metadata: read | |
| 2025-06-24T02:53:43.4804592Z PullRequests: read | |
| 2025-06-24T02:53:43.4805754Z ##[endgroup] | |
| 2025-06-24T02:53:43.4808650Z Secret source: Actions | |
| 2025-06-24T02:53:43.4810063Z Prepare workflow directory | |
| 2025-06-24T02:53:43.5267881Z Prepare all required actions | |
| 2025-06-24T02:53:43.5323630Z Getting action download info | |
| 2025-06-24T02:53:43.8554718Z Download action repository 'actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683' (SHA:11bd71901bbe5b1630ceea73d27597364c9af683) | |
| 2025-06-24T02:53:43.9438390Z Download action repository 'azure/setup-helm@5119fcb9089d432beecbf79bb2c7915207344b78' (SHA:5119fcb9089d432beecbf79bb2c7915207344b78) | |
| 2025-06-24T02:53:44.1336846Z Download action repository 'actions/setup-python@8d9ed9ac5c53483de85588cdf95a591a75ab9f55' (SHA:8d9ed9ac5c53483de85588cdf95a591a75ab9f55) | |
| 2025-06-24T02:53:44.2583669Z Download action repository 'helm/chart-testing-action@0d28d3144d3a25ea2cc349d6e59901c4ff469b3b' (SHA:0d28d3144d3a25ea2cc349d6e59901c4ff469b3b) | |
| 2025-06-24T02:53:44.4437864Z Download action repository 'helm/kind-action@a1b0e391336a6ee6713a0583f8c6240d70863de3' (SHA:a1b0e391336a6ee6713a0583f8c6240d70863de3) | |
| 2025-06-24T02:53:44.7129028Z Getting action download info | |
| 2025-06-24T02:53:44.8184426Z Download action repository 'sigstore/cosign-installer@dc72c7d5c4d10cd6bcb8cf6e3fd625a9e5e537da' (SHA:dc72c7d5c4d10cd6bcb8cf6e3fd625a9e5e537da) | |
| 2025-06-24T02:53:45.0457441Z Complete job name: Test Latest Release | |
| 2025-06-24T02:53:45.1282950Z ##[group]Run actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 | |
| 2025-06-24T02:53:45.1284611Z with: | |
| 2025-06-24T02:53:45.1285343Z fetch-depth: 0 | |
| 2025-06-24T02:53:45.1286150Z persist-credentials: true | |
| 2025-06-24T02:53:45.1287089Z repository: llm-d/llm-d-deployer | |
| 2025-06-24T02:53:45.1288309Z token: *** | |
| 2025-06-24T02:53:45.1289072Z ssh-strict: true | |
| 2025-06-24T02:53:45.1289839Z ssh-user: git | |
| 2025-06-24T02:53:45.1290563Z clean: true | |
| 2025-06-24T02:53:45.1291355Z sparse-checkout-cone-mode: true | |
| 2025-06-24T02:53:45.1292313Z fetch-tags: false | |
| 2025-06-24T02:53:45.1293256Z show-progress: true | |
| 2025-06-24T02:53:45.1294060Z lfs: false | |
| 2025-06-24T02:53:45.1294784Z submodules: false | |
| 2025-06-24T02:53:45.1295582Z set-safe-directory: true | |
| 2025-06-24T02:53:45.1296699Z ##[endgroup] | |
| 2025-06-24T02:53:45.3188441Z Syncing repository: llm-d/llm-d-deployer | |
| 2025-06-24T02:53:45.3191095Z ##[group]Getting Git version info | |
| 2025-06-24T02:53:45.3193125Z Working directory is '/home/runner/work/llm-d-deployer/llm-d-deployer' | |
| 2025-06-24T02:53:45.3195117Z [command]/usr/bin/git version | |
| 2025-06-24T02:53:45.3234475Z git version 2.49.0 | |
| 2025-06-24T02:53:45.3262089Z ##[endgroup] | |
| 2025-06-24T02:53:45.3276156Z Temporarily overriding HOME='/home/runner/work/_temp/61c039bb-b5e9-4616-9bc3-245e6e87e87c' before making global git config changes | |
| 2025-06-24T02:53:45.3278927Z Adding repository directory to the temporary git global config as a safe directory | |
| 2025-06-24T02:53:45.3288084Z [command]/usr/bin/git config --global --add safe.directory /home/runner/work/llm-d-deployer/llm-d-deployer | |
| 2025-06-24T02:53:45.3321759Z Deleting the contents of '/home/runner/work/llm-d-deployer/llm-d-deployer' | |
| 2025-06-24T02:53:45.3325465Z ##[group]Initializing the repository | |
| 2025-06-24T02:53:45.3329572Z [command]/usr/bin/git init /home/runner/work/llm-d-deployer/llm-d-deployer | |
| 2025-06-24T02:53:45.3414417Z hint: Using 'master' as the name for the initial branch. This default branch name | |
| 2025-06-24T02:53:45.3416511Z hint: is subject to change. To configure the initial branch name to use in all | |
| 2025-06-24T02:53:45.3418733Z hint: of your new repositories, which will suppress this warning, call: | |
| 2025-06-24T02:53:45.3420417Z hint: | |
| 2025-06-24T02:53:45.3421985Z hint: git config --global init.defaultBranch <name> | |
| 2025-06-24T02:53:45.3424177Z hint: | |
| 2025-06-24T02:53:45.3426049Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and | |
| 2025-06-24T02:53:45.3429123Z hint: 'development'. The just-created branch can be renamed via this command: | |
| 2025-06-24T02:53:45.3431533Z hint: | |
| 2025-06-24T02:53:45.3433369Z hint: git branch -m <name> | |
| 2025-06-24T02:53:45.3435990Z Initialized empty Git repository in /home/runner/work/llm-d-deployer/llm-d-deployer/.git/ | |
| 2025-06-24T02:53:45.3440649Z [command]/usr/bin/git remote add origin https://github.com/llm-d/llm-d-deployer | |
| 2025-06-24T02:53:45.3467403Z ##[endgroup] | |
| 2025-06-24T02:53:45.3469773Z ##[group]Disabling automatic garbage collection | |
| 2025-06-24T02:53:45.3471560Z [command]/usr/bin/git config --local gc.auto 0 | |
| 2025-06-24T02:53:45.3500063Z ##[endgroup] | |
| 2025-06-24T02:53:45.3501340Z ##[group]Setting up auth | |
| 2025-06-24T02:53:45.3507080Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand | |
| 2025-06-24T02:53:45.3540395Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" | |
| 2025-06-24T02:53:45.3845476Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader | |
| 2025-06-24T02:53:45.3874729Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" | |
| 2025-06-24T02:53:45.4094879Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** | |
| 2025-06-24T02:53:45.4130072Z ##[endgroup] | |
| 2025-06-24T02:53:45.4131641Z ##[group]Fetching the repository | |
| 2025-06-24T02:53:45.4139139Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --no-recurse-submodules origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* | |
| 2025-06-24T02:53:45.8103395Z From https://github.com/llm-d/llm-d-deployer | |
| 2025-06-24T02:53:45.8114625Z * [new branch] gh-pages -> origin/gh-pages | |
| 2025-06-24T02:53:45.8117302Z * [new branch] heterogeneous-p-and-d -> origin/heterogeneous-p-and-d | |
| 2025-06-24T02:53:45.8119785Z * [new branch] main -> origin/main | |
| 2025-06-24T02:53:45.8122202Z * [new branch] mkdn-link-checker1 -> origin/mkdn-link-checker1 | |
| 2025-06-24T02:53:45.8125239Z * [new branch] onboarding-flows -> origin/onboarding-flows | |
| 2025-06-24T02:53:45.8127581Z * [new tag] llm-d-1.0.0 -> llm-d-1.0.0 | |
| 2025-06-24T02:53:45.8129616Z * [new tag] llm-d-1.0.1 -> llm-d-1.0.1 | |
| 2025-06-24T02:53:45.8131683Z * [new tag] llm-d-1.0.10 -> llm-d-1.0.10 | |
| 2025-06-24T02:53:45.8133950Z * [new tag] llm-d-1.0.11 -> llm-d-1.0.11 | |
| 2025-06-24T02:53:45.8135973Z * [new tag] llm-d-1.0.12 -> llm-d-1.0.12 | |
| 2025-06-24T02:53:45.8138158Z * [new tag] llm-d-1.0.13 -> llm-d-1.0.13 | |
| 2025-06-24T02:53:45.8140202Z * [new tag] llm-d-1.0.14 -> llm-d-1.0.14 | |
| 2025-06-24T02:53:45.8142219Z * [new tag] llm-d-1.0.15 -> llm-d-1.0.15 | |
| 2025-06-24T02:53:45.8144459Z * [new tag] llm-d-1.0.16 -> llm-d-1.0.16 | |
| 2025-06-24T02:53:45.8146456Z * [new tag] llm-d-1.0.17 -> llm-d-1.0.17 | |
| 2025-06-24T02:53:45.8148829Z * [new tag] llm-d-1.0.18 -> llm-d-1.0.18 | |
| 2025-06-24T02:53:45.8150845Z * [new tag] llm-d-1.0.19 -> llm-d-1.0.19 | |
| 2025-06-24T02:53:45.8153090Z * [new tag] llm-d-1.0.2 -> llm-d-1.0.2 | |
| 2025-06-24T02:53:45.8155114Z * [new tag] llm-d-1.0.20 -> llm-d-1.0.20 | |
| 2025-06-24T02:53:45.8157197Z * [new tag] llm-d-1.0.3 -> llm-d-1.0.3 | |
| 2025-06-24T02:53:45.8159209Z * [new tag] llm-d-1.0.4 -> llm-d-1.0.4 | |
| 2025-06-24T02:53:45.8161187Z * [new tag] llm-d-1.0.5 -> llm-d-1.0.5 | |
| 2025-06-24T02:53:45.8163420Z * [new tag] llm-d-1.0.6 -> llm-d-1.0.6 | |
| 2025-06-24T02:53:45.8165438Z * [new tag] llm-d-1.0.7 -> llm-d-1.0.7 | |
| 2025-06-24T02:53:45.8167436Z * [new tag] llm-d-1.0.8 -> llm-d-1.0.8 | |
| 2025-06-24T02:53:45.8169441Z * [new tag] llm-d-1.0.9 -> llm-d-1.0.9 | |
| 2025-06-24T02:53:45.8185199Z [command]/usr/bin/git tag --list llm-d-1.0.20 | |
| 2025-06-24T02:53:45.8216726Z llm-d-1.0.20 | |
| 2025-06-24T02:53:45.8229636Z [command]/usr/bin/git rev-parse refs/tags/llm-d-1.0.20 | |
| 2025-06-24T02:53:45.8253680Z 4ef77d318945c21b40f75c3c1cd9453934981cc3 | |
| 2025-06-24T02:53:45.8264054Z ##[endgroup] | |
| 2025-06-24T02:53:45.8266242Z ##[group]Determining the checkout info | |
| 2025-06-24T02:53:45.8268742Z ##[endgroup] | |
| 2025-06-24T02:53:45.8270250Z [command]/usr/bin/git sparse-checkout disable | |
| 2025-06-24T02:53:45.8316460Z [command]/usr/bin/git config --local --unset-all extensions.worktreeConfig | |
| 2025-06-24T02:53:45.8349437Z ##[group]Checking out the ref | |
| 2025-06-24T02:53:45.8354339Z [command]/usr/bin/git checkout --progress --force refs/tags/llm-d-1.0.20 | |
| 2025-06-24T02:53:45.8521549Z Note: switching to 'refs/tags/llm-d-1.0.20'. | |
| 2025-06-24T02:53:45.8523437Z | |
| 2025-06-24T02:53:45.8524911Z You are in 'detached HEAD' state. You can look around, make experimental | |
| 2025-06-24T02:53:45.8527819Z changes and commit them, and you can discard any commits you make in this | |
| 2025-06-24T02:53:45.8530678Z state without impacting any branches by switching back to a branch. | |
| 2025-06-24T02:53:45.8532626Z | |
| 2025-06-24T02:53:45.8533733Z If you want to create a new branch to retain commits you create, you may | |
| 2025-06-24T02:53:45.8536315Z do so (now or later) by using -c with the switch command. Example: | |
| 2025-06-24T02:53:45.8537853Z | |
| 2025-06-24T02:53:45.8538504Z git switch -c <new-branch-name> | |
| 2025-06-24T02:53:45.8539885Z | |
| 2025-06-24T02:53:45.8540541Z Or undo this operation with: | |
| 2025-06-24T02:53:45.8541551Z | |
| 2025-06-24T02:53:45.8542093Z git switch - | |
| 2025-06-24T02:53:45.8543056Z | |
| 2025-06-24T02:53:45.8544294Z Turn off this advice by setting config variable advice.detachedHead to false | |
| 2025-06-24T02:53:45.8546101Z | |
| 2025-06-24T02:53:45.8547660Z HEAD is now at 4ef77d3 Add the ability to define envs to the vLLM containers in sample app (#301) | |
| 2025-06-24T02:53:45.8553159Z ##[endgroup] | |
| 2025-06-24T02:53:45.8572267Z [command]/usr/bin/git log -1 --format=%H | |
| 2025-06-24T02:53:45.8600626Z 4ef77d318945c21b40f75c3c1cd9453934981cc3 | |
| 2025-06-24T02:53:45.8878062Z ##[group]Run azure/setup-helm@5119fcb9089d432beecbf79bb2c7915207344b78 | |
| 2025-06-24T02:53:45.8879309Z with: | |
| 2025-06-24T02:53:45.8879967Z version: v3.10.0 | |
| 2025-06-24T02:53:45.8880677Z ##[endgroup] | |
| 2025-06-24T02:53:45.9403390Z ##[group]Downloading v3.10.0 | |
| 2025-06-24T02:53:46.1220996Z [command]/usr/bin/unzip -o -q /home/runner/work/_temp/00b2d2f5-ad64-4caf-9e11-25340d3a29c9 | |
| 2025-06-24T02:53:46.4921105Z ##[endgroup] | |
| 2025-06-24T02:53:46.4925408Z Helm tool version 'v3.10.0' has been cached at /opt/hostedtoolcache/helm/3.10.0/x64/linux-amd64/helm | |
| 2025-06-24T02:53:46.5130945Z ##[group]Run actions/setup-python@8d9ed9ac5c53483de85588cdf95a591a75ab9f55 | |
| 2025-06-24T02:53:46.5131338Z with: | |
| 2025-06-24T02:53:46.5131524Z python-version: 3.13 | |
| 2025-06-24T02:53:46.5131722Z check-latest: false | |
| 2025-06-24T02:53:46.5132142Z token: *** | |
| 2025-06-24T02:53:46.5132547Z update-environment: true | |
| 2025-06-24T02:53:46.5132840Z allow-prereleases: false | |
| 2025-06-24T02:53:46.5133052Z freethreaded: false | |
| 2025-06-24T02:53:46.5133446Z ##[endgroup] | |
| 2025-06-24T02:53:46.6800825Z ##[group]Installed versions | |
| 2025-06-24T02:53:46.6859153Z Successfully set up CPython (3.13.5) | |
| 2025-06-24T02:53:46.6859670Z ##[endgroup] | |
| 2025-06-24T02:53:46.6982213Z ##[group]Run helm/chart-testing-action@0d28d3144d3a25ea2cc349d6e59901c4ff469b3b | |
| 2025-06-24T02:53:46.6983240Z with: | |
| 2025-06-24T02:53:46.6983424Z version: 3.12.0 | |
| 2025-06-24T02:53:46.6983609Z yamllint_version: 1.33.0 | |
| 2025-06-24T02:53:46.6983827Z yamale_version: 4.0.4 | |
| 2025-06-24T02:53:46.6984011Z env: | |
| 2025-06-24T02:53:46.6984341Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:46.6984926Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T02:53:46.6985399Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:46.6985747Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:46.6986081Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:46.6986427Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T02:53:46.6986781Z ##[endgroup] | |
| 2025-06-24T02:53:46.7216829Z ##[group]Run sigstore/cosign-installer@dc72c7d5c4d10cd6bcb8cf6e3fd625a9e5e537da | |
| 2025-06-24T02:53:46.7217202Z with: | |
| 2025-06-24T02:53:46.7217378Z cosign-release: v2.4.1 | |
| 2025-06-24T02:53:46.7217582Z install-dir: $HOME/.cosign | |
| 2025-06-24T02:53:46.7217791Z use-sudo: false | |
| 2025-06-24T02:53:46.7217956Z env: | |
| 2025-06-24T02:53:46.7218184Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:46.7218600Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T02:53:46.7219000Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:46.7219335Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:46.7219671Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:46.7220001Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T02:53:46.7220289Z ##[endgroup] | |
| 2025-06-24T02:53:46.7272613Z ##[group]Run #!/bin/bash | |
| 2025-06-24T02:53:46.7273285Z [36;1m#!/bin/bash[0m | |
| 2025-06-24T02:53:46.7273499Z [36;1m# cosign install script[0m | |
| 2025-06-24T02:53:46.7273767Z [36;1mshopt -s expand_aliases[0m | |
| 2025-06-24T02:53:46.7274005Z [36;1mif [ -z "$NO_COLOR" ]; then[0m | |
| 2025-06-24T02:53:46.7274307Z [36;1m alias log_info="echo -e \"\033[1;32mINFO\033[0m:\""[0m | |
| 2025-06-24T02:53:46.7274643Z [36;1m alias log_error="echo -e \"\033[1;31mERROR\033[0m:\""[0m | |
| 2025-06-24T02:53:46.7274920Z [36;1melse[0m | |
| 2025-06-24T02:53:46.7275113Z [36;1m alias log_info="echo \"INFO:\""[0m | |
| 2025-06-24T02:53:46.7275375Z [36;1m alias log_error="echo \"ERROR:\""[0m | |
| 2025-06-24T02:53:46.7275619Z [36;1mfi[0m | |
| 2025-06-24T02:53:46.7275776Z [36;1mset -e[0m | |
| 2025-06-24T02:53:46.7275947Z [36;1m[0m | |
| 2025-06-24T02:53:46.7276117Z [36;1mmkdir -p $HOME/.cosign[0m | |
| 2025-06-24T02:53:46.7276327Z [36;1m[0m | |
| 2025-06-24T02:53:46.7276492Z [36;1mif [[ v2.4.1 == "main" ]]; then[0m | |
| 2025-06-24T02:53:46.7276831Z [36;1m log_info "installing cosign via 'go install' from its main version"[0m | |
| 2025-06-24T02:53:46.7277183Z [36;1m GOBIN=$(go env GOPATH)/bin[0m | |
| 2025-06-24T02:53:46.7277478Z [36;1m go install github.com/sigstore/cosign/cmd/cosign@main[0m | |
| 2025-06-24T02:53:46.7277809Z [36;1m ln -s $GOBIN/cosign $HOME/.cosign/cosign[0m | |
| 2025-06-24T02:53:46.7278058Z [36;1m exit 0[0m | |
| 2025-06-24T02:53:46.7278232Z [36;1mfi[0m | |
| 2025-06-24T02:53:46.7278382Z [36;1m[0m | |
| 2025-06-24T02:53:46.7278546Z [36;1mshaprog() {[0m | |
| 2025-06-24T02:53:46.7278732Z [36;1m case Linux in[0m | |
| 2025-06-24T02:53:46.7278929Z [36;1m Linux|linux)[0m | |
| 2025-06-24T02:53:46.7279150Z [36;1m sha256sum $1 | cut -d' ' -f1[0m | |
| 2025-06-24T02:53:46.7279379Z [36;1m ;;[0m | |
| 2025-06-24T02:53:46.7279552Z [36;1m macOS|macos)[0m | |
| 2025-06-24T02:53:46.7279760Z [36;1m shasum -a256 $1 | cut -d' ' -f1[0m | |
| 2025-06-24T02:53:46.7279992Z [36;1m ;;[0m | |
| 2025-06-24T02:53:46.7280161Z [36;1m Windows|windows)[0m | |
| 2025-06-24T02:53:46.7280610Z [36;1m powershell -command "(Get-FileHash $1 -Algorithm SHA256 | Select-Object -ExpandProperty Hash).ToLower()"[0m | |
| 2025-06-24T02:53:46.7281245Z [36;1m ;;[0m | |
| 2025-06-24T02:53:46.7281553Z [36;1m *)[0m | |
| 2025-06-24T02:53:46.7281757Z [36;1m log_error "unsupported OS Linux"[0m | |
| 2025-06-24T02:53:46.7282003Z [36;1m exit 1[0m | |
| 2025-06-24T02:53:46.7282182Z [36;1m ;;[0m | |
| 2025-06-24T02:53:46.7282509Z [36;1m esac[0m | |
| 2025-06-24T02:53:46.7282681Z [36;1m}[0m | |
| 2025-06-24T02:53:46.7282831Z [36;1m[0m | |
| 2025-06-24T02:53:46.7283007Z [36;1mbootstrap_version='v2.4.1'[0m | |
| 2025-06-24T02:53:46.7283433Z [36;1mbootstrap_linux_amd64_sha='8b24b946dd5809c6bd93de08033bcf6bc0ed7d336b7785787c080f574b89249b'[0m | |
| 2025-06-24T02:53:46.7284042Z [36;1mbootstrap_linux_arm_sha='541fd175fae792a154fa2fa025146e3d4691e2dd97717fa9ace35677a88489e7'[0m | |
| 2025-06-24T02:53:46.7284646Z [36;1mbootstrap_linux_arm64_sha='3b2e2e3854d0356c45fe6607047526ccd04742d20bd44afb5be91fa2a6e7cb4a'[0m | |
| 2025-06-24T02:53:46.7285244Z [36;1mbootstrap_darwin_amd64_sha='666032ca283da92b6f7953965688fd51200fdc891a86c19e05c98b898ea0af4e'[0m | |
| 2025-06-24T02:53:46.7285869Z [36;1mbootstrap_darwin_arm64_sha='13343856b69f70388c4fe0b986a31dde5958e444b41be22d785d3dc5e1a9cc62'[0m | |
| 2025-06-24T02:53:46.7286471Z [36;1mbootstrap_windows_amd64_sha='8d57f8a42a981d27290c4227271fa9f0f62ca6630eb4a21d316bd6b01405b87c'[0m | |
| 2025-06-24T02:53:46.7286905Z [36;1mcosign_executable_name=cosign[0m | |
| 2025-06-24T02:53:46.7287135Z [36;1m[0m | |
| 2025-06-24T02:53:46.7287310Z [36;1mtrap "popd >/dev/null" EXIT[0m | |
| 2025-06-24T02:53:46.7287535Z [36;1m[0m | |
| 2025-06-24T02:53:46.7287760Z [36;1mpushd $HOME/.cosign > /dev/null[0m | |
| 2025-06-24T02:53:46.7287983Z [36;1m[0m | |
| 2025-06-24T02:53:46.7288145Z [36;1mcase Linux in[0m | |
| 2025-06-24T02:53:46.7288336Z [36;1m Linux|linux)[0m | |
| 2025-06-24T02:53:46.7288527Z [36;1m case X64 in[0m | |
| 2025-06-24T02:53:46.7288712Z [36;1m X64|amd64)[0m | |
| 2025-06-24T02:53:46.7288949Z [36;1m bootstrap_filename='cosign-linux-amd64'[0m | |
| 2025-06-24T02:53:46.7289269Z [36;1m bootstrap_sha=${bootstrap_linux_amd64_sha}[0m | |
| 2025-06-24T02:53:46.7289591Z [36;1m desired_cosign_filename='cosign-linux-amd64'[0m | |
| 2025-06-24T02:53:46.7289972Z [36;1m # v0.6.0 had different filename structures from all other releases[0m | |
| 2025-06-24T02:53:46.7290314Z [36;1m if [[ v2.4.1 == 'v0.6.0' ]]; then[0m | |
| 2025-06-24T02:53:46.7290642Z [36;1m desired_cosign_filename='cosign_linux_amd64_0.6.0_linux_amd64'[0m | |
| 2025-06-24T02:53:46.7291080Z [36;1m desired_cosign_v060_signature='cosign_linux_amd64_0.6.0_linux_amd64.sig'[0m | |
| 2025-06-24T02:53:46.7291415Z [36;1m fi[0m | |
| 2025-06-24T02:53:46.7291588Z [36;1m ;;[0m | |
| 2025-06-24T02:53:46.7291749Z [36;1m[0m | |
| 2025-06-24T02:53:46.7291909Z [36;1m ARM|arm)[0m | |
| 2025-06-24T02:53:46.7292132Z [36;1m bootstrap_filename='cosign-linux-arm'[0m | |
| 2025-06-24T02:53:46.7292568Z [36;1m bootstrap_sha=${bootstrap_linux_arm_sha}[0m | |
| 2025-06-24T02:53:46.7292876Z [36;1m desired_cosign_filename='cosign-linux-arm'[0m | |
| 2025-06-24T02:53:46.7293161Z [36;1m if [[ v2.4.1 == 'v0.6.0' ]]; then[0m | |
| 2025-06-24T02:53:46.7293464Z [36;1m log_error "linux-arm build not available at v0.6.0"[0m | |
| 2025-06-24T02:53:46.7293743Z [36;1m exit 1[0m | |
| 2025-06-24T02:53:46.7293929Z [36;1m fi[0m | |
| 2025-06-24T02:53:46.7294091Z [36;1m ;;[0m | |
| 2025-06-24T02:53:46.7294255Z [36;1m[0m | |
| 2025-06-24T02:53:46.7294411Z [36;1m ARM64|arm64)[0m | |
| 2025-06-24T02:53:46.7294655Z [36;1m bootstrap_filename='cosign-linux-arm64'[0m | |
| 2025-06-24T02:53:46.7294953Z [36;1m bootstrap_sha=${bootstrap_linux_arm64_sha}[0m | |
| 2025-06-24T02:53:46.7295267Z [36;1m desired_cosign_filename='cosign-linux-arm64'[0m | |
| 2025-06-24T02:53:46.7295553Z [36;1m if [[ v2.4.1 == 'v0.6.0' ]]; then[0m | |
| 2025-06-24T02:53:46.7295847Z [36;1m log_error "linux-arm64 build not available at v0.6.0"[0m | |
| 2025-06-24T02:53:46.7296166Z [36;1m exit 1[0m | |
| 2025-06-24T02:53:46.7296484Z [36;1m fi[0m | |
| 2025-06-24T02:53:46.7296655Z [36;1m ;;[0m | |
| 2025-06-24T02:53:46.7296816Z [36;1m[0m | |
| 2025-06-24T02:53:46.7296969Z [36;1m *)[0m | |
| 2025-06-24T02:53:46.7297293Z [36;1m log_error "unsupported architecture X64"[0m | |
| 2025-06-24T02:53:46.7297551Z [36;1m exit 1[0m | |
| 2025-06-24T02:53:46.7297733Z [36;1m ;;[0m | |
| 2025-06-24T02:53:46.7297891Z [36;1m esac[0m | |
| 2025-06-24T02:53:46.7298052Z [36;1m ;;[0m | |
| 2025-06-24T02:53:46.7298206Z [36;1m[0m | |
| 2025-06-24T02:53:46.7298365Z [36;1m macOS|macos)[0m | |
| 2025-06-24T02:53:46.7298545Z [36;1m case X64 in[0m | |
| 2025-06-24T02:53:46.7298735Z [36;1m X64|amd64)[0m | |
| 2025-06-24T02:53:46.7298959Z [36;1m bootstrap_filename='cosign-darwin-amd64'[0m | |
| 2025-06-24T02:53:46.7299268Z [36;1m bootstrap_sha=${bootstrap_darwin_amd64_sha}[0m | |
| 2025-06-24T02:53:46.7299592Z [36;1m desired_cosign_filename='cosign-darwin-amd64'[0m | |
| 2025-06-24T02:53:46.7299957Z [36;1m # v0.6.0 had different filename structures from all other releases[0m | |
| 2025-06-24T02:53:46.7300293Z [36;1m if [[ v2.4.1 == 'v0.6.0' ]]; then[0m | |
| 2025-06-24T02:53:46.7300619Z [36;1m desired_cosign_filename='cosign_darwin_amd64_0.6.0_darwin_amd64'[0m | |
| 2025-06-24T02:53:46.7301067Z [36;1m desired_cosign_v060_signature='cosign_darwin_amd64_0.6.0_darwin_amd64.sig'[0m | |
| 2025-06-24T02:53:46.7301410Z [36;1m fi[0m | |
| 2025-06-24T02:53:46.7301574Z [36;1m ;;[0m | |
| 2025-06-24T02:53:46.7301737Z [36;1m[0m | |
| 2025-06-24T02:53:46.7301889Z [36;1m ARM64|arm64)[0m | |
| 2025-06-24T02:53:46.7302126Z [36;1m bootstrap_filename='cosign-darwin-arm64'[0m | |
| 2025-06-24T02:53:46.7302532Z [36;1m bootstrap_sha=${bootstrap_darwin_arm64_sha}[0m | |
| 2025-06-24T02:53:46.7302856Z [36;1m desired_cosign_filename='cosign-darwin-arm64'[0m | |
| 2025-06-24T02:53:46.7303224Z [36;1m # v0.6.0 had different filename structures from all other releases[0m | |
| 2025-06-24T02:53:46.7303547Z [36;1m if [[ v2.4.1 == 'v0.6.0' ]]; then[0m | |
| 2025-06-24T02:53:46.7303874Z [36;1m desired_cosign_filename='cosign_darwin_arm64_0.6.0_darwin_arm64'[0m | |
| 2025-06-24T02:53:46.7304308Z [36;1m desired_cosign_v060_signature='cosign_darwin_arm64_0.6.0_darwin_arm64.sig'[0m | |
| 2025-06-24T02:53:46.7304653Z [36;1m fi[0m | |
| 2025-06-24T02:53:46.7304817Z [36;1m ;;[0m | |
| 2025-06-24T02:53:46.7304981Z [36;1m[0m | |
| 2025-06-24T02:53:46.7305131Z [36;1m *)[0m | |
| 2025-06-24T02:53:46.7305339Z [36;1m log_error "unsupported architecture X64"[0m | |
| 2025-06-24T02:53:46.7305597Z [36;1m exit 1[0m | |
| 2025-06-24T02:53:46.7305795Z [36;1m ;;[0m | |
| 2025-06-24T02:53:46.7305954Z [36;1m esac[0m | |
| 2025-06-24T02:53:46.7306117Z [36;1m ;;[0m | |
| 2025-06-24T02:53:46.7306272Z [36;1m[0m | |
| 2025-06-24T02:53:46.7306435Z [36;1m Windows|windows)[0m | |
| 2025-06-24T02:53:46.7306632Z [36;1m case X64 in[0m | |
| 2025-06-24T02:53:46.7306823Z [36;1m X64|amd64)[0m | |
| 2025-06-24T02:53:46.7307062Z [36;1m bootstrap_filename='cosign-windows-amd64.exe'[0m | |
| 2025-06-24T02:53:46.7307390Z [36;1m bootstrap_sha=${bootstrap_windows_amd64_sha}[0m | |
| 2025-06-24T02:53:46.7307729Z [36;1m desired_cosign_filename='cosign-windows-amd64.exe'[0m | |
| 2025-06-24T02:53:46.7308049Z [36;1m cosign_executable_name=cosign.exe[0m | |
| 2025-06-24T02:53:46.7308392Z [36;1m # v0.6.0 had different filename structures from all other releases[0m | |
| 2025-06-24T02:53:46.7308720Z [36;1m if [[ v2.4.1 == 'v0.6.0' ]]; then[0m | |
| 2025-06-24T02:53:46.7309072Z [36;1m desired_cosign_filename='cosign_windows_amd64_0.6.0_windows_amd64.exe'[0m | |
| 2025-06-24T02:53:46.7309557Z [36;1m desired_cosign_v060_signature='cosign_windows_amd64_0.6.0_windows_amd64.exe.sig'[0m | |
| 2025-06-24T02:53:46.7309912Z [36;1m fi[0m | |
| 2025-06-24T02:53:46.7310084Z [36;1m ;;[0m | |
| 2025-06-24T02:53:46.7310244Z [36;1m *)[0m | |
| 2025-06-24T02:53:46.7310459Z [36;1m log_error "unsupported architecture X64"[0m | |
| 2025-06-24T02:53:46.7310714Z [36;1m exit 1[0m | |
| 2025-06-24T02:53:46.7311021Z [36;1m ;;[0m | |
| 2025-06-24T02:53:46.7311180Z [36;1m esac[0m | |
| 2025-06-24T02:53:46.7311341Z [36;1m ;;[0m | |
| 2025-06-24T02:53:46.7311501Z [36;1m *)[0m | |
| 2025-06-24T02:53:46.7311793Z [36;1m log_error "unsupported os Linux"[0m | |
| 2025-06-24T02:53:46.7312038Z [36;1m exit 1[0m | |
| 2025-06-24T02:53:46.7312201Z [36;1m ;;[0m | |
| 2025-06-24T02:53:46.7312510Z [36;1mesac[0m | |
| 2025-06-24T02:53:46.7312667Z [36;1m[0m | |
| 2025-06-24T02:53:46.7312823Z [36;1mSUDO=[0m | |
| 2025-06-24T02:53:46.7313059Z [36;1mif [[ "false" == "true" ]] && command -v sudo >/dev/null; then[0m | |
| 2025-06-24T02:53:46.7313352Z [36;1m SUDO=sudo[0m | |
| 2025-06-24T02:53:46.7313523Z [36;1mfi[0m | |
| 2025-06-24T02:53:46.7313680Z [36;1m[0m | |
| 2025-06-24T02:53:46.7313906Z [36;1mexpected_bootstrap_version_digest=${bootstrap_sha}[0m | |
| 2025-06-24T02:53:46.7314748Z [36;1mlog_info "Downloading bootstrap version '${bootstrap_version}' of cosign to verify version to be installed...\n https://github.com/sigstore/cosign/releases/download/${bootstrap_version}/${bootstrap_filename}"[0m | |
| 2025-06-24T02:53:46.7315877Z [36;1m$SUDO curl -fsL https://github.com/sigstore/cosign/releases/download/${bootstrap_version}/${bootstrap_filename} -o ${cosign_executable_name}[0m | |
| 2025-06-24T02:53:46.7316515Z [36;1mshaBootstrap=$(shaprog ${cosign_executable_name});[0m | |
| 2025-06-24T02:53:46.7316895Z [36;1mif [[ $shaBootstrap != ${expected_bootstrap_version_digest} ]]; then[0m | |
| 2025-06-24T02:53:46.7317297Z [36;1m log_error "Unable to validate cosign version: 'v2.4.1'"[0m | |
| 2025-06-24T02:53:46.7317581Z [36;1m exit 1[0m | |
| 2025-06-24T02:53:46.7317750Z [36;1mfi[0m | |
| 2025-06-24T02:53:46.7317937Z [36;1m$SUDO chmod +x ${cosign_executable_name}[0m | |
| 2025-06-24T02:53:46.7318183Z [36;1m[0m | |
| 2025-06-24T02:53:46.7318461Z [36;1m# If the bootstrap and specified `cosign` releases are the same, we're done.[0m | |
| 2025-06-24T02:53:46.7318851Z [36;1mif [[ v2.4.1 == ${bootstrap_version} ]]; then[0m | |
| 2025-06-24T02:53:46.7319324Z [36;1m log_info "bootstrap version successfully verified and matches requested version so nothing else to do"[0m | |
| 2025-06-24T02:53:46.7319755Z [36;1m exit 0[0m | |
| 2025-06-24T02:53:46.7319917Z [36;1mfi[0m | |
| 2025-06-24T02:53:46.7320070Z [36;1m[0m | |
| 2025-06-24T02:53:46.7320286Z [36;1msemver='^v([0-9]+\.){0,2}(\*|[0-9]+)(-?r?c?)(\.[0-9]+)$'[0m | |
| 2025-06-24T02:53:46.7320565Z [36;1mif [[ v2.4.1 =~ $semver ]]; then[0m | |
| 2025-06-24T02:53:46.7320852Z [36;1m log_info "Custom cosign version 'v2.4.1' requested"[0m | |
| 2025-06-24T02:53:46.7321120Z [36;1melse[0m | |
| 2025-06-24T02:53:46.7321380Z [36;1m log_error "Unable to validate requested cosign version: 'v2.4.1'"[0m | |
| 2025-06-24T02:53:46.7321696Z [36;1m exit 1[0m | |
| 2025-06-24T02:53:46.7321852Z [36;1mfi[0m | |
| 2025-06-24T02:53:46.7322001Z [36;1m[0m | |
| 2025-06-24T02:53:46.7322184Z [36;1m# Download custom cosign[0m | |
| 2025-06-24T02:53:46.7322938Z [36;1mlog_info "Downloading platform-specific version 'v2.4.1' of cosign...\n https://github.com/sigstore/cosign/releases/download/v2.4.1/${desired_cosign_filename}"[0m | |
| 2025-06-24T02:53:46.7323846Z [36;1m$SUDO curl -fsL https://github.com/sigstore/cosign/releases/download/v2.4.1/${desired_cosign_filename} -o cosign_v2.4.1[0m | |
| 2025-06-24T02:53:46.7324381Z [36;1mshaCustom=$(shaprog cosign_v2.4.1);[0m | |
| 2025-06-24T02:53:46.7324612Z [36;1m[0m | |
| 2025-06-24T02:53:46.7324799Z [36;1m# same hash means it is the same release[0m | |
| 2025-06-24T02:53:46.7325080Z [36;1mif [[ $shaCustom != $shaBootstrap ]]; then[0m | |
| 2025-06-24T02:53:46.7325379Z [36;1m if [[ v2.4.1 == 'v0.6.0' && Linux == 'Linux' ]]; then[0m | |
| 2025-06-24T02:53:46.7325715Z [36;1m # v0.6.0's linux release has a dependency on `libpcsclite1`[0m | |
| 2025-06-24T02:53:46.7326089Z [36;1m log_info "Installing libpcsclite1 package if necessary..."[0m | |
| 2025-06-24T02:53:46.7326398Z [36;1m set +e[0m | |
| 2025-06-24T02:53:46.7326589Z [36;1m sudo dpkg -s libpcsclite1[0m | |
| 2025-06-24T02:53:46.7326828Z [36;1m if [ $? -eq 0 ]; then[0m | |
| 2025-06-24T02:53:46.7327108Z [36;1m log_info "libpcsclite1 package is already installed"[0m | |
| 2025-06-24T02:53:46.7327513Z [36;1m else[0m | |
| 2025-06-24T02:53:46.7327796Z [36;1m log_info "libpcsclite1 package is not installed, installing it now."[0m | |
| 2025-06-24T02:53:46.7328257Z [36;1m sudo apt-get update -q -q[0m | |
| 2025-06-24T02:53:46.7328541Z [36;1m sudo apt-get install -yq libpcsclite1[0m | |
| 2025-06-24T02:53:46.7328786Z [36;1m fi[0m | |
| 2025-06-24T02:53:46.7328956Z [36;1m set -e[0m | |
| 2025-06-24T02:53:46.7329127Z [36;1m fi[0m | |
| 2025-06-24T02:53:46.7329284Z [36;1m[0m | |
| 2025-06-24T02:53:46.7329455Z [36;1m if [[ v2.4.1 == 'v0.6.0' ]]; then[0m | |
| 2025-06-24T02:53:46.7330145Z [36;1m log_info "Downloading detached signature for platform-specific 'v2.4.1' of cosign...\n https://github.com/sigstore/cosign/releases/download/v2.4.1/${desired_cosign_v060_signature}"[0m | |
| 2025-06-24T02:53:46.7331173Z [36;1m $SUDO curl -fsL https://github.com/sigstore/cosign/releases/download/v2.4.1/${desired_cosign_v060_signature} -o ${desired_cosign_filename}.sig[0m | |
| 2025-06-24T02:53:46.7331741Z [36;1m else[0m | |
| 2025-06-24T02:53:46.7332466Z [36;1m log_info "Downloading detached signature for platform-specific 'v2.4.1' of cosign...\n https://github.com/sigstore/cosign/releases/download/v2.4.1/${desired_cosign_filename}.sig"[0m | |
| 2025-06-24T02:53:46.7333376Z [36;1m $SUDO curl -fsLO https://github.com/sigstore/cosign/releases/download/v2.4.1/${desired_cosign_filename}.sig[0m | |
| 2025-06-24T02:53:46.7333832Z [36;1m fi[0m | |
| 2025-06-24T02:53:46.7333992Z [36;1m[0m | |
| 2025-06-24T02:53:46.7334156Z [36;1m if [[ v2.4.1 < 'v0.6.0' ]]; then[0m | |
| 2025-06-24T02:53:46.7334736Z [36;1m log_info "Downloading cosign public key 'v2.4.1' of cosign...\n https://raw.githubusercontent.com/sigstore/cosign/v2.4.1/.github/workflows/cosign.pub"[0m | |
| 2025-06-24T02:53:46.7335556Z [36;1m RELEASE_COSIGN_PUB_KEY=https://raw.githubusercontent.com/sigstore/cosign/v2.4.1/.github/workflows/cosign.pub[0m | |
| 2025-06-24T02:53:46.7336213Z [36;1m RELEASE_COSIGN_PUB_KEY_SHA='4aa4bd19530a4929d758a9896255aef2c82f1a3a9f4b000034c6df4307c14f9e'[0m | |
| 2025-06-24T02:53:46.7336627Z [36;1m else[0m | |
| 2025-06-24T02:53:46.7337142Z [36;1m log_info "Downloading cosign public key 'v2.4.1' of cosign...\n https://raw.githubusercontent.com/sigstore/cosign/v2.4.1/release/release-cosign.pub"[0m | |
| 2025-06-24T02:53:46.7337937Z [36;1m RELEASE_COSIGN_PUB_KEY=https://raw.githubusercontent.com/sigstore/cosign/v2.4.1/release/release-cosign.pub[0m | |
| 2025-06-24T02:53:46.7338581Z [36;1m RELEASE_COSIGN_PUB_KEY_SHA='f4cea466e5e887a45da5031757fa1d32655d83420639dc1758749b744179f126'[0m | |
| 2025-06-24T02:53:46.7338975Z [36;1m fi[0m | |
| 2025-06-24T02:53:46.7339132Z [36;1m[0m | |
| 2025-06-24T02:53:46.7339366Z [36;1m log_info "Verifying public key matches expected value"[0m | |
| 2025-06-24T02:53:46.7339725Z [36;1m $SUDO curl -fsL $RELEASE_COSIGN_PUB_KEY -o public.key[0m | |
| 2025-06-24T02:53:46.7340046Z [36;1m sha_fetched_key=$(shaprog public.key)[0m | |
| 2025-06-24T02:53:46.7340364Z [36;1m if [[ $sha_fetched_key != $RELEASE_COSIGN_PUB_KEY_SHA ]]; then[0m | |
| 2025-06-24T02:53:46.7340780Z [36;1m log_error "Fetched public key does not match expected digest, exiting"[0m | |
| 2025-06-24T02:53:46.7341118Z [36;1m exit 1[0m | |
| 2025-06-24T02:53:46.7341289Z [36;1m fi[0m | |
| 2025-06-24T02:53:46.7341447Z [36;1m[0m | |
| 2025-06-24T02:53:46.7341739Z [36;1m log_info "Using bootstrap cosign to verify signature of desired cosign version"[0m | |
| 2025-06-24T02:53:46.7342464Z [36;1m ./cosign verify-blob --insecure-ignore-tlog --key public.key --signature ${desired_cosign_filename}.sig cosign_v2.4.1[0m | |
| 2025-06-24T02:53:46.7342942Z [36;1m[0m | |
| 2025-06-24T02:53:46.7343109Z [36;1m $SUDO rm cosign[0m | |
| 2025-06-24T02:53:46.7343355Z [36;1m $SUDO mv cosign_v2.4.1 ${cosign_executable_name}[0m | |
| 2025-06-24T02:53:46.7343662Z [36;1m $SUDO chmod +x ${cosign_executable_name}[0m | |
| 2025-06-24T02:53:46.7343939Z [36;1m log_info "Installation complete!"[0m | |
| 2025-06-24T02:53:46.7344170Z [36;1mfi[0m | |
| 2025-06-24T02:53:46.7439732Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} | |
| 2025-06-24T02:53:46.7440253Z env: | |
| 2025-06-24T02:53:46.7440499Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:46.7441005Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T02:53:46.7441399Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:46.7441740Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:46.7442078Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:46.7442572Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T02:53:46.7442860Z ##[endgroup] | |
| 2025-06-24T02:53:46.7560459Z [1;32mINFO[0m: Downloading bootstrap version 'v2.4.1' of cosign to verify version to be installed... | |
| 2025-06-24T02:53:46.7561114Z https://github.com/sigstore/cosign/releases/download/v2.4.1/cosign-linux-amd64 | |
| 2025-06-24T02:53:47.2575208Z [1;32mINFO[0m: bootstrap version successfully verified and matches requested version so nothing else to do | |
| 2025-06-24T02:53:47.2633544Z ##[group]Run echo "$HOME/.cosign" >> $GITHUB_PATH | |
| 2025-06-24T02:53:47.2633902Z [36;1mecho "$HOME/.cosign" >> $GITHUB_PATH[0m | |
| 2025-06-24T02:53:47.2692139Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} | |
| 2025-06-24T02:53:47.2692668Z env: | |
| 2025-06-24T02:53:47.2692921Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:47.2693337Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T02:53:47.2693726Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:47.2694074Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:47.2694414Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:47.2694760Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T02:53:47.2695050Z ##[endgroup] | |
| 2025-06-24T02:53:47.2808695Z ##[group]Run cd $GITHUB_ACTION_PATH \ | |
| 2025-06-24T02:53:47.2808984Z [36;1mcd $GITHUB_ACTION_PATH \[0m | |
| 2025-06-24T02:53:47.2809220Z [36;1m&& ./ct.sh \[0m | |
| 2025-06-24T02:53:47.2809461Z [36;1m --version 3.12.0 \[0m | |
| 2025-06-24T02:53:47.2809708Z [36;1m --yamllint-version 1.33.0 \[0m | |
| 2025-06-24T02:53:47.2809966Z [36;1m --yamale-version 4.0.4[0m | |
| 2025-06-24T02:53:47.2864756Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} | |
| 2025-06-24T02:53:47.2865079Z env: | |
| 2025-06-24T02:53:47.2865311Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:47.2865705Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T02:53:47.2866107Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:47.2866452Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:47.2866803Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:47.2867141Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T02:53:47.2867426Z ##[endgroup] | |
| 2025-06-24T02:53:47.2994080Z Installing chart-testing v3.12.0... | |
| 2025-06-24T02:53:48.2923873Z Verified OK | |
| 2025-06-24T02:53:48.3959551Z Creating virtual Python environment... | |
| 2025-06-24T02:53:50.9943586Z Activating virtual environment... | |
| 2025-06-24T02:53:50.9960559Z Installing yamllint... | |
| 2025-06-24T02:53:51.4300498Z Collecting yamllint==1.33.0 | |
| 2025-06-24T02:53:51.4805922Z Downloading yamllint-1.33.0-py3-none-any.whl.metadata (4.2 kB) | |
| 2025-06-24T02:53:51.5011772Z Collecting pathspec>=0.5.3 (from yamllint==1.33.0) | |
| 2025-06-24T02:53:51.5081559Z Downloading pathspec-0.12.1-py3-none-any.whl.metadata (21 kB) | |
| 2025-06-24T02:53:51.5589864Z Collecting pyyaml (from yamllint==1.33.0) | |
| 2025-06-24T02:53:51.5660818Z Downloading PyYAML-6.0.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (2.1 kB) | |
| 2025-06-24T02:53:51.5783931Z Downloading yamllint-1.33.0-py3-none-any.whl (65 kB) | |
| 2025-06-24T02:53:51.5959246Z Downloading pathspec-0.12.1-py3-none-any.whl (31 kB) | |
| 2025-06-24T02:53:51.6080057Z Downloading PyYAML-6.0.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (759 kB) | |
| 2025-06-24T02:53:51.6271719Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 759.5/759.5 kB 48.5 MB/s eta 0:00:00 | |
| 2025-06-24T02:53:51.6403941Z Installing collected packages: pyyaml, pathspec, yamllint | |
| 2025-06-24T02:53:51.7468107Z | |
| 2025-06-24T02:53:51.7480110Z Successfully installed pathspec-0.12.1 pyyaml-6.0.2 yamllint-1.33.0 | |
| 2025-06-24T02:53:51.8749305Z Installing Yamale... | |
| 2025-06-24T02:53:52.2983334Z Collecting yamale==4.0.4 | |
| 2025-06-24T02:53:52.3429446Z Downloading yamale-4.0.4-py3-none-any.whl.metadata (20 kB) | |
| 2025-06-24T02:53:52.3514207Z Requirement already satisfied: pyyaml in /opt/hostedtoolcache/ct/3.12.0/amd64/venv/lib/python3.13/site-packages (from yamale==4.0.4) (6.0.2) | |
| 2025-06-24T02:53:52.3600828Z Downloading yamale-4.0.4-py3-none-any.whl (55 kB) | |
| 2025-06-24T02:53:52.3800140Z Installing collected packages: yamale | |
| 2025-06-24T02:53:52.4244292Z Successfully installed yamale-4.0.4 | |
| 2025-06-24T02:53:52.4699818Z Adding ct directory to PATH... | |
| 2025-06-24T02:53:52.4700792Z Setting CT_CONFIG_DIR... | |
| 2025-06-24T02:53:52.4701721Z Configuring environment variables for virtual environment for subsequent workflow steps... | |
| 2025-06-24T02:53:52.4726955Z Version: v3.12.0 | |
| 2025-06-24T02:53:52.4727449Z Git commit: d6991035017d7ac0e3dec3d1b5ad2e5f18674b32 | |
| 2025-06-24T02:53:52.4728093Z Date: 2025-01-13T12:22:07Z | |
| 2025-06-24T02:53:52.4728684Z License: Apache 2.0 | |
| 2025-06-24T02:53:52.4767142Z ##[group]Run changed=$(ct list-changed --target-branch "$TARGET_BRANCH") | |
| 2025-06-24T02:53:52.4767613Z [36;1mchanged=$(ct list-changed --target-branch "$TARGET_BRANCH")[0m | |
| 2025-06-24T02:53:52.4767953Z [36;1mif [[ -n "$changed" ]]; then[0m | |
| 2025-06-24T02:53:52.4768217Z [36;1m echo "changed=true" >> "$GITHUB_OUTPUT"[0m | |
| 2025-06-24T02:53:52.4768469Z [36;1mfi[0m | |
| 2025-06-24T02:53:52.4828052Z shell: /usr/bin/bash -e {0} | |
| 2025-06-24T02:53:52.4828294Z env: | |
| 2025-06-24T02:53:52.4828521Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:52.4828911Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T02:53:52.4829302Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:52.4829642Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:52.4829968Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:52.4830319Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T02:53:52.4830635Z CT_CONFIG_DIR: /opt/hostedtoolcache/ct/3.12.0/amd64/etc | |
| 2025-06-24T02:53:52.4830937Z VIRTUAL_ENV: /opt/hostedtoolcache/ct/3.12.0/amd64/venv | |
| 2025-06-24T02:53:52.4831194Z TARGET_BRANCH: main^ | |
| 2025-06-24T02:53:52.4831380Z ##[endgroup] | |
| 2025-06-24T02:53:52.5377351Z ##[group]Run helm repo add ingress-nginx "https://kubernetes.github.io/ingress-nginx" | |
| 2025-06-24T02:53:52.5377919Z [36;1mhelm repo add ingress-nginx "https://kubernetes.github.io/ingress-nginx"[0m | |
| 2025-06-24T02:53:52.5378374Z [36;1mhelm repo add bitnami "https://charts.bitnami.com/bitnami"[0m | |
| 2025-06-24T02:53:52.5378703Z [36;1mhelm repo update[0m | |
| 2025-06-24T02:53:52.5437562Z shell: /usr/bin/bash -e {0} | |
| 2025-06-24T02:53:52.5437798Z env: | |
| 2025-06-24T02:53:52.5438035Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:52.5438554Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T02:53:52.5438927Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:52.5439259Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:52.5439583Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:52.5439933Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T02:53:52.5440295Z CT_CONFIG_DIR: /opt/hostedtoolcache/ct/3.12.0/amd64/etc | |
| 2025-06-24T02:53:52.5440597Z VIRTUAL_ENV: /opt/hostedtoolcache/ct/3.12.0/amd64/venv | |
| 2025-06-24T02:53:52.5440859Z ##[endgroup] | |
| 2025-06-24T02:53:52.6969099Z "ingress-nginx" has been added to your repositories | |
| 2025-06-24T02:53:55.3776037Z "bitnami" has been added to your repositories | |
| 2025-06-24T02:53:55.4127807Z Hang tight while we grab the latest from your chart repositories... | |
| 2025-06-24T02:53:55.4706721Z ...Successfully got an update from the "ingress-nginx" chart repository | |
| 2025-06-24T02:53:57.9754176Z ...Successfully got an update from the "bitnami" chart repository | |
| 2025-06-24T02:53:57.9755217Z Update Complete. ⎈Happy Helming!⎈ | |
| 2025-06-24T02:53:57.9878238Z ##[group]Run helm/kind-action@a1b0e391336a6ee6713a0583f8c6240d70863de3 | |
| 2025-06-24T02:53:57.9878589Z with: | |
| 2025-06-24T02:53:57.9878796Z config: helpers/kind-testing/kind-config.yaml | |
| 2025-06-24T02:53:57.9879046Z version: v0.26.0 | |
| 2025-06-24T02:53:57.9879233Z cluster_name: chart-testing | |
| 2025-06-24T02:53:57.9879434Z wait: 60s | |
| 2025-06-24T02:53:57.9879581Z verbosity: 0 | |
| 2025-06-24T02:53:57.9879748Z kubectl_version: v1.31.4 | |
| 2025-06-24T02:53:57.9879934Z registry: false | |
| 2025-06-24T02:53:57.9880115Z registry_image: registry:2 | |
| 2025-06-24T02:53:57.9880322Z registry_name: kind-registry | |
| 2025-06-24T02:53:57.9880526Z registry_port: 5000 | |
| 2025-06-24T02:53:57.9880711Z registry_enable_delete: false | |
| 2025-06-24T02:53:57.9880936Z ignore_failed_clean: false | |
| 2025-06-24T02:53:57.9881118Z env: | |
| 2025-06-24T02:53:57.9881339Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:57.9881720Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T02:53:57.9882111Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:57.9882678Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:57.9883008Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:53:57.9883330Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T02:53:57.9883638Z CT_CONFIG_DIR: /opt/hostedtoolcache/ct/3.12.0/amd64/etc | |
| 2025-06-24T02:53:57.9883938Z VIRTUAL_ENV: /opt/hostedtoolcache/ct/3.12.0/amd64/venv | |
| 2025-06-24T02:53:57.9884191Z ##[endgroup] | |
| 2025-06-24T02:53:58.0220791Z Installing kind... | |
| 2025-06-24T02:53:58.0236285Z /opt/hostedtoolcache/kind/v0.26.0/amd64/kind/bin ~/work/llm-d-deployer/llm-d-deployer | |
| 2025-06-24T02:53:58.4500568Z kind-linux-amd64: OK | |
| 2025-06-24T02:53:58.4540139Z ~/work/llm-d-deployer/llm-d-deployer | |
| 2025-06-24T02:53:58.4540631Z Adding kind directory to PATH... | |
| 2025-06-24T02:53:58.4541037Z Installing kubectl... | |
| 2025-06-24T02:53:58.8600662Z Adding kubectl directory to PATH... | |
| 2025-06-24T02:53:58.8621475Z kind v0.26.0 go1.23.4 linux/amd64 | |
| 2025-06-24T02:53:58.8989407Z Client Version: v1.31.4 | |
| 2025-06-24T02:53:58.8989805Z Kustomize Version: v5.4.2 | |
| 2025-06-24T02:53:58.9007513Z Creating kind cluster... | |
| 2025-06-24T02:53:59.1917068Z Creating cluster "chart-testing" ... | |
| 2025-06-24T02:53:59.1917854Z • Ensuring node image (kindest/node:v1.30.0) 🖼 ... | |
| 2025-06-24T02:54:09.0699072Z ✓ Ensuring node image (kindest/node:v1.30.0) 🖼 | |
| 2025-06-24T02:54:09.0699648Z • Preparing nodes 📦 ... | |
| 2025-06-24T02:54:10.9527892Z ✓ Preparing nodes 📦 | |
| 2025-06-24T02:54:10.9790666Z • Writing configuration 📜 ... | |
| 2025-06-24T02:54:11.1444720Z ✓ Writing configuration 📜 | |
| 2025-06-24T02:54:11.1445325Z • Starting control-plane 🕹️ ... | |
| 2025-06-24T02:54:21.9458159Z ✓ Starting control-plane 🕹️ | |
| 2025-06-24T02:54:21.9458705Z • Installing CNI 🔌 ... | |
| 2025-06-24T02:54:22.2333357Z ✓ Installing CNI 🔌 | |
| 2025-06-24T02:54:22.2333863Z • Installing StorageClass 💾 ... | |
| 2025-06-24T02:54:22.5249905Z ✓ Installing StorageClass 💾 | |
| 2025-06-24T02:54:22.5510404Z • Waiting ≤ 1m0s for control-plane = Ready ⏳ ... | |
| 2025-06-24T02:54:40.3152271Z ✓ Waiting ≤ 1m0s for control-plane = Ready ⏳ | |
| 2025-06-24T02:54:40.3153383Z • Ready after 18s 💚 | |
| 2025-06-24T02:54:40.4528851Z Set kubectl context to "kind-chart-testing" | |
| 2025-06-24T02:54:40.4529413Z You can now use your cluster with: | |
| 2025-06-24T02:54:40.4529672Z | |
| 2025-06-24T02:54:40.4529868Z kubectl cluster-info --context kind-chart-testing | |
| 2025-06-24T02:54:40.4530176Z | |
| 2025-06-24T02:54:40.4530545Z Thanks for using kind! 😊 | |
| 2025-06-24T02:54:40.4602283Z ##[group]Run export defaultScProvisioner=$(kubectl get storageclass -o jsonpath='{.items[?(@.metadata.annotations.storageclass\.kubernetes\.io/is-default-class=="true")].provisioner}') | |
| 2025-06-24T02:54:40.4604097Z [36;1mexport defaultScProvisioner=$(kubectl get storageclass -o jsonpath='{.items[?(@.metadata.annotations.storageclass\.kubernetes\.io/is-default-class=="true")].provisioner}')[0m | |
| 2025-06-24T02:54:40.4604833Z [36;1mif [[ -z "$defaultScProvisioner" ]]; then[0m | |
| 2025-06-24T02:54:40.4605528Z [36;1m echo "No default storage class found or it has no provisioner. Exiting early because the test using the custom Storage Class will likely fail. Use a cluster that has a default storage class."[0m | |
| 2025-06-24T02:54:40.4606169Z [36;1m exit 1[0m | |
| 2025-06-24T02:54:40.4606326Z [36;1mfi[0m | |
| 2025-06-24T02:54:40.4606571Z [36;1mecho "[INFO] defaultScProvisioner=$defaultScProvisioner"[0m | |
| 2025-06-24T02:54:40.4606854Z [36;1m[0m | |
| 2025-06-24T02:54:40.4607066Z [36;1mcat <<EOF | kubectl apply -f -[0m | |
| 2025-06-24T02:54:40.4607313Z [36;1mapiVersion: storage.k8s.io/v1[0m | |
| 2025-06-24T02:54:40.4607546Z [36;1mkind: StorageClass[0m | |
| 2025-06-24T02:54:40.4607737Z [36;1mmetadata:[0m | |
| 2025-06-24T02:54:40.4607922Z [36;1m name: custom-sc[0m | |
| 2025-06-24T02:54:40.4608237Z [36;1m# same provisioner as the one used by the default storage class on the cluster[0m | |
| 2025-06-24T02:54:40.4608599Z [36;1mprovisioner: $defaultScProvisioner[0m | |
| 2025-06-24T02:54:40.4608853Z [36;1mreclaimPolicy: Delete[0m | |
| 2025-06-24T02:54:40.4609088Z [36;1mvolumeBindingMode: WaitForFirstConsumer[0m | |
| 2025-06-24T02:54:40.4609336Z [36;1mEOF[0m | |
| 2025-06-24T02:54:40.4609483Z [36;1m[0m | |
| 2025-06-24T02:54:40.4609678Z [36;1mkubectl get storageclass custom-sc -o yaml[0m | |
| 2025-06-24T02:54:40.4671998Z shell: /usr/bin/bash -e {0} | |
| 2025-06-24T02:54:40.4672214Z env: | |
| 2025-06-24T02:54:40.4672700Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:54:40.4673146Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T02:54:40.4673547Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:54:40.4673875Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:54:40.4674215Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:54:40.4674553Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T02:54:40.4674895Z CT_CONFIG_DIR: /opt/hostedtoolcache/ct/3.12.0/amd64/etc | |
| 2025-06-24T02:54:40.4675201Z VIRTUAL_ENV: /opt/hostedtoolcache/ct/3.12.0/amd64/venv | |
| 2025-06-24T02:54:40.4675453Z ##[endgroup] | |
| 2025-06-24T02:54:40.5289478Z [INFO] defaultScProvisioner=rancher.io/local-path | |
| 2025-06-24T02:54:40.5957378Z storageclass.storage.k8s.io/custom-sc created | |
| 2025-06-24T02:54:40.6585409Z apiVersion: storage.k8s.io/v1 | |
| 2025-06-24T02:54:40.6589789Z kind: StorageClass | |
| 2025-06-24T02:54:40.6590119Z metadata: | |
| 2025-06-24T02:54:40.6590361Z annotations: | |
| 2025-06-24T02:54:40.6590738Z kubectl.kubernetes.io/last-applied-configuration: | | |
| 2025-06-24T02:54:40.6591974Z {"apiVersion":"storage.k8s.io/v1","kind":"StorageClass","metadata":{"annotations":{},"name":"custom-sc"},"provisioner":"rancher.io/local-path","reclaimPolicy":"Delete","volumeBindingMode":"WaitForFirstConsumer"} | |
| 2025-06-24T02:54:40.6593286Z creationTimestamp: "2025-06-24T02:54:40Z" | |
| 2025-06-24T02:54:40.6593657Z name: custom-sc | |
| 2025-06-24T02:54:40.6593938Z resourceVersion: "450" | |
| 2025-06-24T02:54:40.6594268Z uid: c2d30c24-3b81-4e5a-9ce8-c8e3edf38e68 | |
| 2025-06-24T02:54:40.6594652Z provisioner: rancher.io/local-path | |
| 2025-06-24T02:54:40.6595004Z reclaimPolicy: Delete | |
| 2025-06-24T02:54:40.6595326Z volumeBindingMode: WaitForFirstConsumer | |
| 2025-06-24T02:54:40.6667542Z ##[group]Run helm install ingress-nginx/ingress-nginx --generate-name \ | |
| 2025-06-24T02:54:40.6668362Z [36;1mhelm install ingress-nginx/ingress-nginx --generate-name \[0m | |
| 2025-06-24T02:54:40.6669006Z [36;1m --set controller.service.type='NodePort' \[0m | |
| 2025-06-24T02:54:40.6669594Z [36;1m --set controller.admissionWebhooks.enabled=false[0m | |
| 2025-06-24T02:54:40.6772742Z shell: /usr/bin/bash -e {0} | |
| 2025-06-24T02:54:40.6773123Z env: | |
| 2025-06-24T02:54:40.6773504Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:54:40.6774438Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T02:54:40.6775072Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:54:40.6775659Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:54:40.6776253Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:54:40.6776864Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T02:54:40.6777507Z CT_CONFIG_DIR: /opt/hostedtoolcache/ct/3.12.0/amd64/etc | |
| 2025-06-24T02:54:40.6778079Z VIRTUAL_ENV: /opt/hostedtoolcache/ct/3.12.0/amd64/venv | |
| 2025-06-24T02:54:40.6778570Z ##[endgroup] | |
| 2025-06-24T02:54:41.8791151Z NAME: ingress-nginx-1750733680 | |
| 2025-06-24T02:54:41.8796374Z LAST DEPLOYED: Tue Jun 24 02:54:40 2025 | |
| 2025-06-24T02:54:41.8801076Z NAMESPACE: default | |
| 2025-06-24T02:54:41.8811180Z STATUS: deployed | |
| 2025-06-24T02:54:41.8815130Z REVISION: 1 | |
| 2025-06-24T02:54:41.8819076Z TEST SUITE: None | |
| 2025-06-24T02:54:41.8823046Z NOTES: | |
| 2025-06-24T02:54:41.8828415Z The ingress-nginx controller has been installed. | |
| 2025-06-24T02:54:41.8833896Z Get the application URL by running these commands: | |
| 2025-06-24T02:54:41.8834984Z export HTTP_NODE_PORT=$(kubectl get service --namespace default ingress-nginx-1750733680-controller --output jsonpath="{.spec.ports[0].nodePort}") | |
| 2025-06-24T02:54:41.8836603Z export HTTPS_NODE_PORT=$(kubectl get service --namespace default ingress-nginx-1750733680-controller --output jsonpath="{.spec.ports[1].nodePort}") | |
| 2025-06-24T02:54:41.8837865Z export NODE_IP="$(kubectl get nodes --output jsonpath="{.items[0].status.addresses[1].address}")" | |
| 2025-06-24T02:54:41.8838423Z | |
| 2025-06-24T02:54:41.8838787Z echo "Visit http://${NODE_IP}:${HTTP_NODE_PORT} to access your application via HTTP." | |
| 2025-06-24T02:54:41.8844629Z echo "Visit https://${NODE_IP}:${HTTPS_NODE_PORT} to access your application via HTTPS." | |
| 2025-06-24T02:54:41.8845153Z | |
| 2025-06-24T02:54:41.8845364Z An example Ingress that makes use of the controller: | |
| 2025-06-24T02:54:41.8845870Z apiVersion: networking.k8s.io/v1 | |
| 2025-06-24T02:54:41.8846253Z kind: Ingress | |
| 2025-06-24T02:54:41.8846535Z metadata: | |
| 2025-06-24T02:54:41.8846791Z name: example | |
| 2025-06-24T02:54:41.8847085Z namespace: foo | |
| 2025-06-24T02:54:41.8847362Z spec: | |
| 2025-06-24T02:54:41.8847637Z ingressClassName: nginx | |
| 2025-06-24T02:54:41.8848011Z rules: | |
| 2025-06-24T02:54:41.8848297Z - host: www.example.com | |
| 2025-06-24T02:54:41.8848611Z http: | |
| 2025-06-24T02:54:41.8848792Z paths: | |
| 2025-06-24T02:54:41.8848992Z - pathType: Prefix | |
| 2025-06-24T02:54:41.8849201Z backend: | |
| 2025-06-24T02:54:41.8849382Z service: | |
| 2025-06-24T02:54:41.8849579Z name: exampleService | |
| 2025-06-24T02:54:41.8849814Z port: | |
| 2025-06-24T02:54:41.8849997Z number: 80 | |
| 2025-06-24T02:54:41.8850205Z path: / | |
| 2025-06-24T02:54:41.8850488Z # This section is only required if TLS is to be enabled for the Ingress | |
| 2025-06-24T02:54:41.8850816Z tls: | |
| 2025-06-24T02:54:41.8850974Z - hosts: | |
| 2025-06-24T02:54:41.8851151Z - www.example.com | |
| 2025-06-24T02:54:41.8851369Z secretName: example-tls | |
| 2025-06-24T02:54:41.8851513Z | |
| 2025-06-24T02:54:41.8851768Z If TLS is enabled for the Ingress, a Secret containing the certificate and key must also be provided: | |
| 2025-06-24T02:54:41.8852136Z | |
| 2025-06-24T02:54:41.8852206Z apiVersion: v1 | |
| 2025-06-24T02:54:41.8852949Z kind: Secret | |
| 2025-06-24T02:54:41.8853207Z metadata: | |
| 2025-06-24T02:54:41.8853391Z name: example-tls | |
| 2025-06-24T02:54:41.8853588Z namespace: foo | |
| 2025-06-24T02:54:41.8853897Z data: | |
| 2025-06-24T02:54:41.8854079Z tls.crt: <base64 encoded cert> | |
| 2025-06-24T02:54:41.8854317Z tls.key: <base64 encoded key> | |
| 2025-06-24T02:54:41.8854692Z type: kubernetes.io/tls | |
| 2025-06-24T02:54:41.8893710Z ##[group]Run curl -L "https://github.com/operator-framework/operator-lifecycle-manager/releases/download/${OLM_VERSION}/install.sh" -o install-olm.sh | |
| 2025-06-24T02:54:41.8895721Z [36;1mcurl -L "https://github.com/operator-framework/operator-lifecycle-manager/releases/download/${OLM_VERSION}/install.sh" -o install-olm.sh[0m | |
| 2025-06-24T02:54:41.8896804Z [36;1mchmod +x install-olm.sh[0m | |
| 2025-06-24T02:54:41.8897249Z [36;1m./install-olm.sh "${OLM_VERSION}"[0m | |
| 2025-06-24T02:54:41.8985165Z shell: /usr/bin/bash -e {0} | |
| 2025-06-24T02:54:41.8985409Z env: | |
| 2025-06-24T02:54:41.8985657Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:54:41.8986058Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T02:54:41.8986446Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:54:41.8986795Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:54:41.8987182Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:54:41.8987514Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T02:54:41.8987841Z CT_CONFIG_DIR: /opt/hostedtoolcache/ct/3.12.0/amd64/etc | |
| 2025-06-24T02:54:41.8988155Z VIRTUAL_ENV: /opt/hostedtoolcache/ct/3.12.0/amd64/venv | |
| 2025-06-24T02:54:41.8988413Z OLM_VERSION: v0.31.0 | |
| 2025-06-24T02:54:41.8988605Z ##[endgroup] | |
| 2025-06-24T02:54:41.9173721Z % Total % Received % Xferd Average Speed Time Time Time Current | |
| 2025-06-24T02:54:41.9176230Z Dload Upload Total Spent Left Speed | |
| 2025-06-24T02:54:41.9176796Z | |
| 2025-06-24T02:54:42.0527374Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 | |
| 2025-06-24T02:54:42.0528317Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 | |
| 2025-06-24T02:54:42.1444625Z | |
| 2025-06-24T02:54:42.1445229Z 100 1886 100 1886 0 0 8275 0 --:--:-- --:--:-- --:--:-- 8275 | |
| 2025-06-24T02:54:42.1445964Z 100 1886 100 1886 0 0 8273 0 --:--:-- --:--:-- --:--:-- 0 | |
| 2025-06-24T02:54:42.5406078Z customresourcedefinition.apiextensions.k8s.io/catalogsources.operators.coreos.com created | |
| 2025-06-24T02:54:42.6917839Z customresourcedefinition.apiextensions.k8s.io/clusterserviceversions.operators.coreos.com created | |
| 2025-06-24T02:54:42.7058327Z customresourcedefinition.apiextensions.k8s.io/installplans.operators.coreos.com created | |
| 2025-06-24T02:54:42.7171282Z customresourcedefinition.apiextensions.k8s.io/olmconfigs.operators.coreos.com created | |
| 2025-06-24T02:54:42.7328081Z customresourcedefinition.apiextensions.k8s.io/operatorconditions.operators.coreos.com created | |
| 2025-06-24T02:54:42.7468767Z customresourcedefinition.apiextensions.k8s.io/operatorgroups.operators.coreos.com created | |
| 2025-06-24T02:54:42.7664498Z customresourcedefinition.apiextensions.k8s.io/operators.operators.coreos.com created | |
| 2025-06-24T02:54:42.8815688Z customresourcedefinition.apiextensions.k8s.io/subscriptions.operators.coreos.com created | |
| 2025-06-24T02:54:43.2290129Z customresourcedefinition.apiextensions.k8s.io/catalogsources.operators.coreos.com condition met | |
| 2025-06-24T02:54:43.4548276Z customresourcedefinition.apiextensions.k8s.io/clusterserviceversions.operators.coreos.com condition met | |
| 2025-06-24T02:54:43.5616681Z customresourcedefinition.apiextensions.k8s.io/installplans.operators.coreos.com condition met | |
| 2025-06-24T02:54:43.6679566Z customresourcedefinition.apiextensions.k8s.io/olmconfigs.operators.coreos.com condition met | |
| 2025-06-24T02:54:43.7736640Z customresourcedefinition.apiextensions.k8s.io/operatorconditions.operators.coreos.com condition met | |
| 2025-06-24T02:54:43.8813136Z customresourcedefinition.apiextensions.k8s.io/operatorgroups.operators.coreos.com condition met | |
| 2025-06-24T02:54:43.9863075Z customresourcedefinition.apiextensions.k8s.io/operators.operators.coreos.com condition met | |
| 2025-06-24T02:54:44.1217337Z customresourcedefinition.apiextensions.k8s.io/subscriptions.operators.coreos.com condition met | |
| 2025-06-24T02:54:44.3827482Z namespace/olm created | |
| 2025-06-24T02:54:44.4358246Z namespace/operators created | |
| 2025-06-24T02:54:44.4866088Z serviceaccount/olm-operator-serviceaccount created | |
| 2025-06-24T02:54:44.5034588Z clusterrole.rbac.authorization.k8s.io/system:controller:operator-lifecycle-manager created | |
| 2025-06-24T02:54:44.5124287Z clusterrolebinding.rbac.authorization.k8s.io/olm-operator-binding-olm created | |
| 2025-06-24T02:54:46.5439400Z olmconfig.operators.coreos.com/cluster created | |
| 2025-06-24T02:54:46.5694284Z deployment.apps/olm-operator created | |
| 2025-06-24T02:54:46.6015628Z deployment.apps/catalog-operator created | |
| 2025-06-24T02:54:46.6142730Z clusterrole.rbac.authorization.k8s.io/aggregate-olm-edit created | |
| 2025-06-24T02:54:46.6302546Z clusterrole.rbac.authorization.k8s.io/aggregate-olm-view created | |
| 2025-06-24T02:54:46.6844853Z operatorgroup.operators.coreos.com/global-operators created | |
| 2025-06-24T02:54:46.6918783Z operatorgroup.operators.coreos.com/olm-operators created | |
| 2025-06-24T02:54:46.7404122Z clusterserviceversion.operators.coreos.com/packageserver created | |
| 2025-06-24T02:54:46.7697118Z catalogsource.operators.coreos.com/operatorhubio-catalog created | |
| 2025-06-24T02:54:46.8256656Z Waiting for deployment "olm-operator" rollout to finish: 0 of 1 updated replicas are available... | |
| 2025-06-24T02:54:50.3195734Z deployment "olm-operator" successfully rolled out | |
| 2025-06-24T02:54:50.4080187Z Waiting for deployment "catalog-operator" rollout to finish: 0 of 1 updated replicas are available... | |
| 2025-06-24T02:54:51.3297498Z deployment "catalog-operator" successfully rolled out | |
| 2025-06-24T02:54:51.3924841Z Package server phase: Installing | |
| 2025-06-24T02:55:01.4450896Z Package server phase: Succeeded | |
| 2025-06-24T02:55:01.4986863Z deployment "packageserver" successfully rolled out | |
| 2025-06-24T02:55:01.5040097Z ##[group]Run ./chart-dependencies/ci-deps.sh | |
| 2025-06-24T02:55:01.5040617Z [36;1m./chart-dependencies/ci-deps.sh[0m | |
| 2025-06-24T02:55:01.5101092Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} | |
| 2025-06-24T02:55:01.5101387Z env: | |
| 2025-06-24T02:55:01.5101618Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:55:01.5101997Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T02:55:01.5102869Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:55:01.5103296Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:55:01.5103642Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:55:01.5104111Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T02:55:01.5104437Z CT_CONFIG_DIR: /opt/hostedtoolcache/ct/3.12.0/amd64/etc | |
| 2025-06-24T02:55:01.5104756Z VIRTUAL_ENV: /opt/hostedtoolcache/ct/3.12.0/amd64/venv | |
| 2025-06-24T02:55:01.5105016Z ##[endgroup] | |
| 2025-06-24T02:55:01.5518269Z [32m✅ 📜 Base CRDs: Installing...[0m | |
| 2025-06-24T02:55:02.6487758Z customresourcedefinition.apiextensions.k8s.io/gatewayclasses.gateway.networking.k8s.io created | |
| 2025-06-24T02:55:02.8452159Z customresourcedefinition.apiextensions.k8s.io/gateways.gateway.networking.k8s.io created | |
| 2025-06-24T02:55:02.9664289Z customresourcedefinition.apiextensions.k8s.io/grpcroutes.gateway.networking.k8s.io created | |
| 2025-06-24T02:55:03.5663114Z customresourcedefinition.apiextensions.k8s.io/httproutes.gateway.networking.k8s.io created | |
| 2025-06-24T02:55:03.5776320Z customresourcedefinition.apiextensions.k8s.io/referencegrants.gateway.networking.k8s.io created | |
| 2025-06-24T02:55:03.5844858Z [32m✅ 🚪 GAIE CRDs: Installing...[0m | |
| 2025-06-24T02:55:04.4356535Z customresourcedefinition.apiextensions.k8s.io/inferencemodels.inference.networking.x-k8s.io created | |
| 2025-06-24T02:55:04.4451554Z customresourcedefinition.apiextensions.k8s.io/inferencepools.inference.networking.x-k8s.io created | |
| 2025-06-24T02:55:04.4494495Z [32m✅ 🎒 Gateway provider 'istio[0m[32m': Installing...[0m[0m | |
| 2025-06-24T02:55:04.4855089Z Release "istio-base" does not exist. Installing it now. | |
| 2025-06-24T02:55:05.5212685Z Pulled: gcr.io/istio-testing/charts/base:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d | |
| 2025-06-24T02:55:05.5213588Z Digest: sha256:d022e2d190b4acdb5abbf160e34a63b5bbd94d4c76ef8ec46bcb48c1e6e6c9c5 | |
| 2025-06-24T02:55:07.1699447Z NAME: istio-base | |
| 2025-06-24T02:55:07.1701120Z LAST DEPLOYED: Tue Jun 24 02:55:05 2025 | |
| 2025-06-24T02:55:07.1703196Z NAMESPACE: istio-system | |
| 2025-06-24T02:55:07.1703527Z STATUS: deployed | |
| 2025-06-24T02:55:07.1703812Z REVISION: 1 | |
| 2025-06-24T02:55:07.1704069Z TEST SUITE: None | |
| 2025-06-24T02:55:07.1704339Z NOTES: | |
| 2025-06-24T02:55:07.1704620Z Istio base successfully installed! | |
| 2025-06-24T02:55:07.1704888Z | |
| 2025-06-24T02:55:07.1705034Z To learn more about the release, try: | |
| 2025-06-24T02:55:07.1705467Z $ helm status istio-base -n istio-system | |
| 2025-06-24T02:55:07.1705912Z $ helm get all istio-base -n istio-system | |
| 2025-06-24T02:55:07.2475610Z Release "istiod" does not exist. Installing it now. | |
| 2025-06-24T02:55:08.2553457Z Pulled: gcr.io/istio-testing/charts/istiod:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d | |
| 2025-06-24T02:55:08.2554493Z Digest: sha256:b6a16f2823041fe7410e0fc089283902dd4795e9e1eaac2406f985fba111993a | |
| 2025-06-24T02:55:16.3750526Z NAME: istiod | |
| 2025-06-24T02:55:16.3750918Z LAST DEPLOYED: Tue Jun 24 02:55:08 2025 | |
| 2025-06-24T02:55:16.3751345Z NAMESPACE: istio-system | |
| 2025-06-24T02:55:16.3751703Z STATUS: deployed | |
| 2025-06-24T02:55:16.3751986Z REVISION: 1 | |
| 2025-06-24T02:55:16.3752266Z TEST SUITE: None | |
| 2025-06-24T02:55:16.3752744Z NOTES: | |
| 2025-06-24T02:55:16.3753045Z "istiod" successfully installed! | |
| 2025-06-24T02:55:16.3753298Z | |
| 2025-06-24T02:55:16.3753444Z To learn more about the release, try: | |
| 2025-06-24T02:55:16.3753868Z $ helm status istiod -n istio-system | |
| 2025-06-24T02:55:16.3754278Z $ helm get all istiod -n istio-system | |
| 2025-06-24T02:55:16.3754555Z | |
| 2025-06-24T02:55:16.3754666Z Next steps: | |
| 2025-06-24T02:55:16.3755539Z * Deploy a Gateway: https://istio.io/latest/docs/setup/additional-setup/gateway/ | |
| 2025-06-24T02:55:16.3756251Z * Try out our tasks to get started on common configurations: | |
| 2025-06-24T02:55:16.3756829Z * https://istio.io/latest/docs/tasks/traffic-management | |
| 2025-06-24T02:55:16.3757350Z * https://istio.io/latest/docs/tasks/security/ | |
| 2025-06-24T02:55:16.3757886Z * https://istio.io/latest/docs/tasks/policy-enforcement/ | |
| 2025-06-24T02:55:16.3758654Z * Review the list of actively supported releases, CVE publications and our hardening guide: | |
| 2025-06-24T02:55:16.3759419Z * https://istio.io/latest/docs/releases/supported-releases/ | |
| 2025-06-24T02:55:16.3759999Z * https://istio.io/latest/news/security/ | |
| 2025-06-24T02:55:16.3760502Z * https://istio.io/latest/docs/ops/best-practices/security/ | |
| 2025-06-24T02:55:16.3760864Z | |
| 2025-06-24T02:55:16.3761082Z For further documentation see https://istio.io website | |
| 2025-06-24T02:55:16.3828227Z ##[group]Run ct install \ | |
| 2025-06-24T02:55:16.3828789Z [36;1mct install \[0m | |
| 2025-06-24T02:55:16.3829410Z [36;1m --debug \[0m | |
| 2025-06-24T02:55:16.3829882Z [36;1m --config ct-install.yaml \[0m | |
| 2025-06-24T02:55:16.3830432Z [36;1m --upgrade \[0m | |
| 2025-06-24T02:55:16.3831066Z [36;1m --target-branch "$TARGET_BRANCH"[0m | |
| 2025-06-24T02:55:16.3908550Z shell: /usr/bin/bash -e {0} | |
| 2025-06-24T02:55:16.3908902Z env: | |
| 2025-06-24T02:55:16.3909203Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:55:16.3909750Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T02:55:16.3910203Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:55:16.3910662Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:55:16.3911121Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T02:55:16.3911519Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T02:55:16.3912002Z CT_CONFIG_DIR: /opt/hostedtoolcache/ct/3.12.0/amd64/etc | |
| 2025-06-24T02:55:16.3912634Z VIRTUAL_ENV: /opt/hostedtoolcache/ct/3.12.0/amd64/venv | |
| 2025-06-24T02:55:16.3913048Z TARGET_BRANCH: main^ | |
| 2025-06-24T02:55:16.3913295Z ##[endgroup] | |
| 2025-06-24T02:55:16.4022193Z Installing charts... | |
| 2025-06-24T02:55:16.4025844Z >>> helm version --template {{ .Version }} | |
| 2025-06-24T02:55:16.4279581Z >>> git rev-parse --is-inside-work-tree | |
| 2025-06-24T02:55:16.4295976Z >>> git rev-parse --verify origin/main^ | |
| 2025-06-24T02:55:16.4313533Z >>> git merge-base origin/main^ HEAD | |
| 2025-06-24T02:55:16.4331419Z >>> git diff --find-renames --name-only 13794f26508e0c743670e5b3765933346bb63181 -- charts | |
| 2025-06-24T02:55:16.4391011Z | |
| 2025-06-24T02:55:16.4392259Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:55:16.4393263Z Charts to be processed: | |
| 2025-06-24T02:55:16.4393980Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:55:16.4394707Z llm-d => (version: "1.0.20", path: "charts/llm-d") | |
| 2025-06-24T02:55:16.4395164Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:55:16.4395538Z | |
| 2025-06-24T02:55:16.4395761Z >>> git rev-parse --is-inside-work-tree | |
| 2025-06-24T02:55:16.4405679Z >>> git rev-parse --verify origin/main^ | |
| 2025-06-24T02:55:16.4421128Z >>> git merge-base origin/main^ HEAD | |
| 2025-06-24T02:55:16.4438151Z >>> git worktree add ./ct-previous-revision820086721 13794f26508e0c743670e5b3765933346bb63181 | |
| 2025-06-24T02:55:16.4628804Z HEAD is now at 13794f2 Detect minikube context for uninstall (#278) | |
| 2025-06-24T02:55:16.4635266Z Preparing worktree (detached HEAD 13794f2) | |
| 2025-06-24T02:55:16.4635991Z >>> helm dependency build ct-previous-revision820086721/charts/llm-d | |
| 2025-06-24T02:55:16.4882695Z Hang tight while we grab the latest from your chart repositories... | |
| 2025-06-24T02:55:16.5495788Z ...Successfully got an update from the "ingress-nginx" chart repository | |
| 2025-06-24T02:55:19.1724801Z ...Successfully got an update from the "bitnami" chart repository | |
| 2025-06-24T02:55:19.1725639Z Update Complete. ⎈Happy Helming!⎈ | |
| 2025-06-24T02:55:21.5499569Z Saving 2 charts | |
| 2025-06-24T02:55:21.5500494Z Downloading common from repo https://charts.bitnami.com/bitnami | |
| 2025-06-24T02:55:24.0653683Z Downloading redis from repo https://charts.bitnami.com/bitnami | |
| 2025-06-24T02:55:24.2809780Z Pulled: registry-1.docker.io/bitnamicharts/redis:20.13.4 | |
| 2025-06-24T02:55:24.2811594Z Digest: sha256:6a389e13237e8e639ec0d445e785aa246b57bfce711b087033a196a291d5c8d7 | |
| 2025-06-24T02:55:24.2874979Z Deleting outdated charts | |
| 2025-06-24T02:55:24.3003929Z >>> helm dependency build charts/llm-d | |
| 2025-06-24T02:55:24.3273810Z Hang tight while we grab the latest from your chart repositories... | |
| 2025-06-24T02:55:24.3854005Z ...Successfully got an update from the "ingress-nginx" chart repository | |
| 2025-06-24T02:55:27.0165816Z ...Successfully got an update from the "bitnami" chart repository | |
| 2025-06-24T02:55:27.0166969Z Update Complete. ⎈Happy Helming!⎈ | |
| 2025-06-24T02:55:29.4018861Z Saving 2 charts | |
| 2025-06-24T02:55:29.4019691Z Downloading common from repo https://charts.bitnami.com/bitnami | |
| 2025-06-24T02:55:31.7910876Z Downloading redis from repo https://charts.bitnami.com/bitnami | |
| 2025-06-24T02:55:32.0990700Z Pulled: registry-1.docker.io/bitnamicharts/redis:20.13.4 | |
| 2025-06-24T02:55:32.0991651Z Digest: sha256:6a389e13237e8e639ec0d445e785aa246b57bfce711b087033a196a291d5c8d7 | |
| 2025-06-24T02:55:32.1059041Z Deleting outdated charts | |
| 2025-06-24T02:55:32.1115506Z >>> git cat-file -e origin/main^:charts/llm-d/Chart.yaml | |
| 2025-06-24T02:55:32.1134918Z >>> git show origin/main^:charts/llm-d/Chart.yaml | |
| 2025-06-24T02:55:32.1158146Z Testing upgrades of chart "llm-d => (version: \"1.0.20\", path: \"charts/llm-d\")" relative to previous revision "llm-d => (version: \"1.0.19\", path: \"ct-previous-revision820086721/charts/llm-d\")"... | |
| 2025-06-24T02:55:32.1159286Z | |
| 2025-06-24T02:55:32.1160027Z Installing chart "llm-d => (version: \"1.0.19\", path: \"ct-previous-revision820086721/charts/llm-d\")" with values file "ct-previous-revision820086721/charts/llm-d/ci/default-values.yaml"... | |
| 2025-06-24T02:55:32.1160741Z | |
| 2025-06-24T02:55:32.1160916Z Creating namespace "llm-d-pt8s89ylyl"... | |
| 2025-06-24T02:55:32.1161315Z >>> kubectl --request-timeout=30s create namespace llm-d-pt8s89ylyl | |
| 2025-06-24T02:55:32.1618704Z namespace/llm-d-pt8s89ylyl created | |
| 2025-06-24T02:55:32.1667492Z >>> helm install llm-d-pt8s89ylyl ct-previous-revision820086721/charts/llm-d --namespace llm-d-pt8s89ylyl --wait --values ct-previous-revision820086721/charts/llm-d/ci/default-values.yaml --timeout 500s | |
| 2025-06-24T02:56:01.8711331Z NAME: llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:01.8711920Z LAST DEPLOYED: Tue Jun 24 02:55:34 2025 | |
| 2025-06-24T02:56:01.8712653Z NAMESPACE: llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:01.8713202Z STATUS: deployed | |
| 2025-06-24T02:56:01.8713649Z REVISION: 1 | |
| 2025-06-24T02:56:01.8714018Z NOTES: | |
| 2025-06-24T02:56:01.8714465Z Thank you for installing llm-d. | |
| 2025-06-24T02:56:01.8714854Z | |
| 2025-06-24T02:56:01.8715126Z Your release is named `llm-d-pt8s89ylyl`. | |
| 2025-06-24T02:56:01.8715470Z | |
| 2025-06-24T02:56:01.8715681Z To learn more about the release, try: | |
| 2025-06-24T02:56:01.8716068Z | |
| 2025-06-24T02:56:01.8716230Z ```bash | |
| 2025-06-24T02:56:01.8716670Z $ helm status llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:01.8717107Z $ helm get all llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:01.8717620Z ``` | |
| 2025-06-24T02:56:01.8717793Z | |
| 2025-06-24T02:56:01.8717800Z | |
| 2025-06-24T02:56:01.8718064Z Following presets are available to your users: | |
| 2025-06-24T02:56:01.8718429Z | |
| 2025-06-24T02:56:01.8718435Z | |
| 2025-06-24T02:56:01.8718441Z | |
| 2025-06-24T02:56:01.8718769Z | Name | Description | | |
| 2025-06-24T02:56:01.8719849Z | ----------------------------------------------------------------- | ----------------------------------------------------------------------------------------------- | | |
| 2025-06-24T02:56:01.8720882Z | basic-gpu-preset | Basic gpu inference | | |
| 2025-06-24T02:56:01.8722029Z | basic-gpu-with-nixl-preset | GPU inference with NIXL P/D KV transfer and cache offloading | | |
| 2025-06-24T02:56:01.8723710Z | basic-gpu-with-nixl-and-redis-lookup-preset | GPU inference with NIXL P/D KV transfer, cache offloading and Redis lookup server | | |
| 2025-06-24T02:56:01.8724916Z | basic-sim-preset | Basic simulation | | |
| 2025-06-24T02:56:01.8725410Z | |
| 2025-06-24T02:56:01.8725614Z To provision a `ModelService`, create a new CR: | |
| 2025-06-24T02:56:01.8726031Z | |
| 2025-06-24T02:56:01.8726225Z ```yaml | |
| 2025-06-24T02:56:01.8726930Z apiVersion: llm-d.ai/v1alpha1 | |
| 2025-06-24T02:56:01.8727416Z kind: ModelService | |
| 2025-06-24T02:56:01.8727905Z metadata: | |
| 2025-06-24T02:56:01.8728233Z name: <name> | |
| 2025-06-24T02:56:01.8728606Z spec: | |
| 2025-06-24T02:56:01.8729062Z decoupleScaling: false | |
| 2025-06-24T02:56:01.8729532Z baseConfigMapRef: | |
| 2025-06-24T02:56:01.8729995Z name: basic-gpu-with-nixl-and-redis-lookup-preset | |
| 2025-06-24T02:56:01.8730603Z routing: | |
| 2025-06-24T02:56:01.8730965Z modelName: <model_name> | |
| 2025-06-24T02:56:01.8731407Z modelArtifacts: | |
| 2025-06-24T02:56:01.8731931Z uri: pvc://<pvc_name>/<path_to_model> | |
| 2025-06-24T02:56:01.8732730Z decode: | |
| 2025-06-24T02:56:01.8733145Z replicas: 1 | |
| 2025-06-24T02:56:01.8733480Z containers: | |
| 2025-06-24T02:56:01.8733973Z - name: "vllm" | |
| 2025-06-24T02:56:01.8734307Z args: | |
| 2025-06-24T02:56:01.8734678Z - "--model" | |
| 2025-06-24T02:56:01.8735085Z - <model_name> | |
| 2025-06-24T02:56:01.8735461Z prefill: | |
| 2025-06-24T02:56:01.8735764Z replicas: 1 | |
| 2025-06-24T02:56:01.8736198Z containers: | |
| 2025-06-24T02:56:01.8736563Z - name: "vllm" | |
| 2025-06-24T02:56:01.8736926Z args: | |
| 2025-06-24T02:56:01.8737330Z - "--model" | |
| 2025-06-24T02:56:01.8737662Z - <model_name> | |
| 2025-06-24T02:56:01.8738025Z ``` | |
| 2025-06-24T02:56:01.8761444Z >>> kubectl --request-timeout=30s get deployments --namespace llm-d-pt8s89ylyl --selector --output jsonpath={.items[*].metadata.name} | |
| 2025-06-24T02:56:01.9312653Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-pt8s89ylyl-inference-gateway-istio --namespace llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:01.9921672Z deployment "llm-d-pt8s89ylyl-inference-gateway-istio" successfully rolled out | |
| 2025-06-24T02:56:01.9946497Z >>> kubectl --request-timeout=30s get deployment llm-d-pt8s89ylyl-inference-gateway-istio --namespace llm-d-pt8s89ylyl --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T02:56:02.0446676Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-pt8s89ylyl-modelservice --namespace llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:02.0985236Z deployment "llm-d-pt8s89ylyl-modelservice" successfully rolled out | |
| 2025-06-24T02:56:02.1008028Z >>> kubectl --request-timeout=30s get deployment llm-d-pt8s89ylyl-modelservice --namespace llm-d-pt8s89ylyl --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T02:56:02.1506495Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-pt8s89ylyl-redis-master --namespace llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:02.2123730Z deployment "llm-d-pt8s89ylyl-redis-master" successfully rolled out | |
| 2025-06-24T02:56:02.2150094Z >>> kubectl --request-timeout=30s get deployment llm-d-pt8s89ylyl-redis-master --namespace llm-d-pt8s89ylyl --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T02:56:02.2632160Z >>> helm test llm-d-pt8s89ylyl --namespace llm-d-pt8s89ylyl --timeout 500s | |
| 2025-06-24T02:56:23.6615742Z NAME: llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:23.6616557Z LAST DEPLOYED: Tue Jun 24 02:55:34 2025 | |
| 2025-06-24T02:56:23.6617135Z NAMESPACE: llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:23.6620078Z STATUS: deployed | |
| 2025-06-24T02:56:23.6620682Z REVISION: 1 | |
| 2025-06-24T02:56:23.6621191Z TEST SUITE: llm-d-pt8s89ylyl-test-connection | |
| 2025-06-24T02:56:23.6622230Z Last Started: Tue Jun 24 02:56:02 2025 | |
| 2025-06-24T02:56:23.6623165Z Last Completed: Tue Jun 24 02:56:23 2025 | |
| 2025-06-24T02:56:23.6625332Z Phase: Succeeded | |
| 2025-06-24T02:56:23.6626100Z TEST SUITE: llm-d-pt8s89ylyl-vllm-sim | |
| 2025-06-24T02:56:23.6626887Z Last Started: Tue Jun 24 02:56:02 2025 | |
| 2025-06-24T02:56:23.6627517Z Last Completed: Tue Jun 24 02:56:02 2025 | |
| 2025-06-24T02:56:23.6628940Z Phase: Succeeded | |
| 2025-06-24T02:56:23.6629647Z TEST SUITE: llm-d-pt8s89ylyl-vllm-sim | |
| 2025-06-24T02:56:23.6630315Z Last Started: Tue Jun 24 02:56:02 2025 | |
| 2025-06-24T02:56:23.6631313Z Last Completed: Tue Jun 24 02:56:02 2025 | |
| 2025-06-24T02:56:23.6631805Z Phase: Succeeded | |
| 2025-06-24T02:56:23.6632185Z NOTES: | |
| 2025-06-24T02:56:23.6632632Z Thank you for installing llm-d. | |
| 2025-06-24T02:56:23.6632888Z | |
| 2025-06-24T02:56:23.6633492Z Your release is named `llm-d-pt8s89ylyl`. | |
| 2025-06-24T02:56:23.6633960Z | |
| 2025-06-24T02:56:23.6634774Z To learn more about the release, try: | |
| 2025-06-24T02:56:23.6635050Z | |
| 2025-06-24T02:56:23.6635150Z ```bash | |
| 2025-06-24T02:56:23.6635424Z $ helm status llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:23.6635769Z $ helm get all llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:23.6635981Z ``` | |
| 2025-06-24T02:56:23.6636066Z | |
| 2025-06-24T02:56:23.6636070Z | |
| 2025-06-24T02:56:23.6636188Z Following presets are available to your users: | |
| 2025-06-24T02:56:23.6636382Z | |
| 2025-06-24T02:56:23.6636395Z | |
| 2025-06-24T02:56:23.6636399Z | |
| 2025-06-24T02:56:23.6636573Z | Name | Description | | |
| 2025-06-24T02:56:23.6637061Z | ----------------------------------------------------------------- | ----------------------------------------------------------------------------------------------- | | |
| 2025-06-24T02:56:23.6637598Z | basic-gpu-preset | Basic gpu inference | | |
| 2025-06-24T02:56:23.6638228Z | basic-gpu-with-nixl-preset | GPU inference with NIXL P/D KV transfer and cache offloading | | |
| 2025-06-24T02:56:23.6639230Z | basic-gpu-with-nixl-and-redis-lookup-preset | GPU inference with NIXL P/D KV transfer, cache offloading and Redis lookup server | | |
| 2025-06-24T02:56:23.6640305Z | basic-sim-preset | Basic simulation | | |
| 2025-06-24T02:56:23.6640673Z | |
| 2025-06-24T02:56:23.6640857Z To provision a `ModelService`, create a new CR: | |
| 2025-06-24T02:56:23.6641045Z | |
| 2025-06-24T02:56:23.6641112Z ```yaml | |
| 2025-06-24T02:56:23.6641276Z apiVersion: llm-d.ai/v1alpha1 | |
| 2025-06-24T02:56:23.6641537Z kind: ModelService | |
| 2025-06-24T02:56:23.6641775Z metadata: | |
| 2025-06-24T02:56:23.6641933Z name: <name> | |
| 2025-06-24T02:56:23.6642117Z spec: | |
| 2025-06-24T02:56:23.6642282Z decoupleScaling: false | |
| 2025-06-24T02:56:23.6642737Z baseConfigMapRef: | |
| 2025-06-24T02:56:23.6642977Z name: basic-gpu-with-nixl-and-redis-lookup-preset | |
| 2025-06-24T02:56:23.6643312Z routing: | |
| 2025-06-24T02:56:23.6643580Z modelName: <model_name> | |
| 2025-06-24T02:56:23.6643915Z modelArtifacts: | |
| 2025-06-24T02:56:23.6644151Z uri: pvc://<pvc_name>/<path_to_model> | |
| 2025-06-24T02:56:23.6644419Z decode: | |
| 2025-06-24T02:56:23.6644638Z replicas: 1 | |
| 2025-06-24T02:56:23.6644800Z containers: | |
| 2025-06-24T02:56:23.6644957Z - name: "vllm" | |
| 2025-06-24T02:56:23.6645139Z args: | |
| 2025-06-24T02:56:23.6645394Z - "--model" | |
| 2025-06-24T02:56:23.6645571Z - <model_name> | |
| 2025-06-24T02:56:23.6645746Z prefill: | |
| 2025-06-24T02:56:23.6645906Z replicas: 1 | |
| 2025-06-24T02:56:23.6646182Z containers: | |
| 2025-06-24T02:56:23.6646351Z - name: "vllm" | |
| 2025-06-24T02:56:23.6646525Z args: | |
| 2025-06-24T02:56:23.6646672Z - "--model" | |
| 2025-06-24T02:56:23.6646843Z - <model_name> | |
| 2025-06-24T02:56:23.6647006Z ``` | |
| 2025-06-24T02:56:23.6649963Z >>> helm upgrade llm-d-pt8s89ylyl charts/llm-d --namespace llm-d-pt8s89ylyl --reuse-values --wait --timeout 500s | |
| 2025-06-24T02:56:37.1807631Z Release "llm-d-pt8s89ylyl" has been upgraded. Happy Helming! | |
| 2025-06-24T02:56:37.1808002Z NAME: llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:37.1808241Z LAST DEPLOYED: Tue Jun 24 02:56:24 2025 | |
| 2025-06-24T02:56:37.1808502Z NAMESPACE: llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:37.1808735Z STATUS: deployed | |
| 2025-06-24T02:56:37.1808905Z REVISION: 2 | |
| 2025-06-24T02:56:37.1809054Z NOTES: | |
| 2025-06-24T02:56:37.1809348Z Thank you for installing llm-d. | |
| 2025-06-24T02:56:37.1809514Z | |
| 2025-06-24T02:56:37.1809621Z Your release is named `llm-d-pt8s89ylyl`. | |
| 2025-06-24T02:56:37.1809800Z | |
| 2025-06-24T02:56:37.1809936Z To learn more about the release, try: | |
| 2025-06-24T02:56:37.1810103Z | |
| 2025-06-24T02:56:37.1810180Z ```bash | |
| 2025-06-24T02:56:37.1810754Z $ helm status llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:37.1811202Z $ helm get all llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:37.1811414Z ``` | |
| 2025-06-24T02:56:37.1811500Z | |
| 2025-06-24T02:56:37.1811504Z | |
| 2025-06-24T02:56:37.1811678Z Following presets are available to your users: | |
| 2025-06-24T02:56:37.1811983Z | |
| 2025-06-24T02:56:37.1811989Z | |
| 2025-06-24T02:56:37.1811995Z | |
| 2025-06-24T02:56:37.1812280Z | Name | Description | | |
| 2025-06-24T02:56:37.1813360Z | ----------------------------------------------------------------- | ----------------------------------------------------------------------------------------------- | | |
| 2025-06-24T02:56:37.1814312Z | basic-gpu-preset | Basic gpu inference | | |
| 2025-06-24T02:56:37.1815411Z | basic-gpu-with-nixl-preset | GPU inference with NIXL P/D KV transfer and cache offloading | | |
| 2025-06-24T02:56:37.1816781Z | basic-gpu-with-nixl-and-redis-lookup-preset | GPU inference with NIXL P/D KV transfer, cache offloading and Redis lookup server | | |
| 2025-06-24T02:56:37.1817512Z | basic-sim-preset | Basic simulation | | |
| 2025-06-24T02:56:37.1818023Z | |
| 2025-06-24T02:56:37.1818133Z To provision a `ModelService`, create a new CR: | |
| 2025-06-24T02:56:37.1818318Z | |
| 2025-06-24T02:56:37.1818379Z ```yaml | |
| 2025-06-24T02:56:37.1818544Z apiVersion: llm-d.ai/v1alpha1 | |
| 2025-06-24T02:56:37.1818753Z kind: ModelService | |
| 2025-06-24T02:56:37.1818920Z metadata: | |
| 2025-06-24T02:56:37.1819073Z name: <name> | |
| 2025-06-24T02:56:37.1819224Z spec: | |
| 2025-06-24T02:56:37.1819389Z decoupleScaling: false | |
| 2025-06-24T02:56:37.1819589Z baseConfigMapRef: | |
| 2025-06-24T02:56:37.1819829Z name: basic-gpu-with-nixl-and-redis-lookup-preset | |
| 2025-06-24T02:56:37.1820091Z routing: | |
| 2025-06-24T02:56:37.1820256Z modelName: <model_name> | |
| 2025-06-24T02:56:37.1820448Z modelArtifacts: | |
| 2025-06-24T02:56:37.1820645Z uri: pvc://<pvc_name>/<path_to_model> | |
| 2025-06-24T02:56:37.1820868Z decode: | |
| 2025-06-24T02:56:37.1821022Z replicas: 1 | |
| 2025-06-24T02:56:37.1821288Z containers: | |
| 2025-06-24T02:56:37.1821528Z - name: "vllm" | |
| 2025-06-24T02:56:37.1821700Z args: | |
| 2025-06-24T02:56:37.1821853Z - "--model" | |
| 2025-06-24T02:56:37.1822023Z - <model_name> | |
| 2025-06-24T02:56:37.1822190Z prefill: | |
| 2025-06-24T02:56:37.1822513Z replicas: 1 | |
| 2025-06-24T02:56:37.1822725Z containers: | |
| 2025-06-24T02:56:37.1822890Z - name: "vllm" | |
| 2025-06-24T02:56:37.1823049Z args: | |
| 2025-06-24T02:56:37.1823200Z - "--model" | |
| 2025-06-24T02:56:37.1823361Z - <model_name> | |
| 2025-06-24T02:56:37.1823526Z ``` | |
| 2025-06-24T02:56:37.1847165Z >>> kubectl --request-timeout=30s get deployments --namespace llm-d-pt8s89ylyl --selector --output jsonpath={.items[*].metadata.name} | |
| 2025-06-24T02:56:37.2467803Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-pt8s89ylyl-inference-gateway-istio --namespace llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:37.3093841Z deployment "llm-d-pt8s89ylyl-inference-gateway-istio" successfully rolled out | |
| 2025-06-24T02:56:37.3126791Z >>> kubectl --request-timeout=30s get deployment llm-d-pt8s89ylyl-inference-gateway-istio --namespace llm-d-pt8s89ylyl --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T02:56:37.3626923Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-pt8s89ylyl-modelservice --namespace llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:37.4190031Z deployment "llm-d-pt8s89ylyl-modelservice" successfully rolled out | |
| 2025-06-24T02:56:37.4214829Z >>> kubectl --request-timeout=30s get deployment llm-d-pt8s89ylyl-modelservice --namespace llm-d-pt8s89ylyl --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T02:56:37.4739603Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-pt8s89ylyl-redis-master --namespace llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:37.5321433Z deployment "llm-d-pt8s89ylyl-redis-master" successfully rolled out | |
| 2025-06-24T02:56:37.5344117Z >>> kubectl --request-timeout=30s get deployment llm-d-pt8s89ylyl-redis-master --namespace llm-d-pt8s89ylyl --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T02:56:37.5868367Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-pt8s89ylyl-vllm-sim-decode --namespace llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:37.6465387Z deployment "llm-d-pt8s89ylyl-vllm-sim-decode" successfully rolled out | |
| 2025-06-24T02:56:37.6490568Z >>> kubectl --request-timeout=30s get deployment llm-d-pt8s89ylyl-vllm-sim-decode --namespace llm-d-pt8s89ylyl --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T02:56:37.6999318Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-pt8s89ylyl-vllm-sim-epp --namespace llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:37.7564389Z deployment "llm-d-pt8s89ylyl-vllm-sim-epp" successfully rolled out | |
| 2025-06-24T02:56:37.7588917Z >>> kubectl --request-timeout=30s get deployment llm-d-pt8s89ylyl-vllm-sim-epp --namespace llm-d-pt8s89ylyl --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T02:56:37.8096259Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-pt8s89ylyl-vllm-sim-prefill --namespace llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:37.8661670Z deployment "llm-d-pt8s89ylyl-vllm-sim-prefill" successfully rolled out | |
| 2025-06-24T02:56:37.8685318Z >>> kubectl --request-timeout=30s get deployment llm-d-pt8s89ylyl-vllm-sim-prefill --namespace llm-d-pt8s89ylyl --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T02:56:37.9202268Z >>> helm test llm-d-pt8s89ylyl --namespace llm-d-pt8s89ylyl --timeout 500s | |
| 2025-06-24T02:56:52.7567256Z NAME: llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:52.7577914Z LAST DEPLOYED: Tue Jun 24 02:56:24 2025 | |
| 2025-06-24T02:56:52.7578321Z NAMESPACE: llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:52.7578647Z STATUS: deployed | |
| 2025-06-24T02:56:52.7578956Z REVISION: 2 | |
| 2025-06-24T02:56:52.7579279Z TEST SUITE: llm-d-pt8s89ylyl-test-connection | |
| 2025-06-24T02:56:52.7579717Z Last Started: Tue Jun 24 02:56:38 2025 | |
| 2025-06-24T02:56:52.7580104Z Last Completed: Tue Jun 24 02:56:52 2025 | |
| 2025-06-24T02:56:52.7580491Z Phase: Succeeded | |
| 2025-06-24T02:56:52.7580843Z TEST SUITE: llm-d-pt8s89ylyl-vllm-sim | |
| 2025-06-24T02:56:52.7581251Z Last Started: Tue Jun 24 02:56:38 2025 | |
| 2025-06-24T02:56:52.7581646Z Last Completed: Tue Jun 24 02:56:38 2025 | |
| 2025-06-24T02:56:52.7582041Z Phase: Succeeded | |
| 2025-06-24T02:56:52.7582539Z TEST SUITE: llm-d-pt8s89ylyl-vllm-sim | |
| 2025-06-24T02:56:52.7582949Z Last Started: Tue Jun 24 02:56:38 2025 | |
| 2025-06-24T02:56:52.7583336Z Last Completed: Tue Jun 24 02:56:38 2025 | |
| 2025-06-24T02:56:52.7583610Z Phase: Succeeded | |
| 2025-06-24T02:56:52.7583808Z NOTES: | |
| 2025-06-24T02:56:52.7583983Z Thank you for installing llm-d. | |
| 2025-06-24T02:56:52.7584237Z | |
| 2025-06-24T02:56:52.7584385Z Your release is named `llm-d-pt8s89ylyl`. | |
| 2025-06-24T02:56:52.7584566Z | |
| 2025-06-24T02:56:52.7584653Z To learn more about the release, try: | |
| 2025-06-24T02:56:52.7584818Z | |
| 2025-06-24T02:56:52.7584880Z ```bash | |
| 2025-06-24T02:56:52.7585052Z $ helm status llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:52.7585286Z $ helm get all llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:52.7585486Z ``` | |
| 2025-06-24T02:56:52.7585567Z | |
| 2025-06-24T02:56:52.7585571Z | |
| 2025-06-24T02:56:52.7585687Z Following presets are available to your users: | |
| 2025-06-24T02:56:52.7585878Z | |
| 2025-06-24T02:56:52.7585882Z | |
| 2025-06-24T02:56:52.7585891Z | |
| 2025-06-24T02:56:52.7586061Z | Name | Description | | |
| 2025-06-24T02:56:52.7586544Z | ----------------------------------------------------------------- | ----------------------------------------------------------------------------------------------- | | |
| 2025-06-24T02:56:52.7587331Z | basic-gpu-preset | Basic gpu inference | | |
| 2025-06-24T02:56:52.7588014Z | basic-gpu-with-nixl-preset | GPU inference with NIXL P/D KV transfer and cache offloading | | |
| 2025-06-24T02:56:52.7600824Z | basic-gpu-with-nixl-and-redis-lookup-preset | GPU inference with NIXL P/D KV transfer, cache offloading and Redis lookup server | | |
| 2025-06-24T02:56:52.7601782Z | basic-sim-preset | Basic simulation | | |
| 2025-06-24T02:56:52.7602287Z | |
| 2025-06-24T02:56:52.7602640Z To provision a `ModelService`, create a new CR: | |
| 2025-06-24T02:56:52.7602946Z | |
| 2025-06-24T02:56:52.7603064Z ```yaml | |
| 2025-06-24T02:56:52.7603329Z apiVersion: llm-d.ai/v1alpha1 | |
| 2025-06-24T02:56:52.7603556Z kind: ModelService | |
| 2025-06-24T02:56:52.7603740Z metadata: | |
| 2025-06-24T02:56:52.7603896Z name: <name> | |
| 2025-06-24T02:56:52.7604049Z spec: | |
| 2025-06-24T02:56:52.7604217Z decoupleScaling: false | |
| 2025-06-24T02:56:52.7604418Z baseConfigMapRef: | |
| 2025-06-24T02:56:52.7604666Z name: basic-gpu-with-nixl-and-redis-lookup-preset | |
| 2025-06-24T02:56:52.7604942Z routing: | |
| 2025-06-24T02:56:52.7605104Z modelName: <model_name> | |
| 2025-06-24T02:56:52.7605323Z modelArtifacts: | |
| 2025-06-24T02:56:52.7605835Z uri: pvc://<pvc_name>/<path_to_model> | |
| 2025-06-24T02:56:52.7606243Z decode: | |
| 2025-06-24T02:56:52.7607195Z replicas: 1 | |
| 2025-06-24T02:56:52.7607481Z containers: | |
| 2025-06-24T02:56:52.7607944Z - name: "vllm" | |
| 2025-06-24T02:56:52.7608241Z args: | |
| 2025-06-24T02:56:52.7608874Z - "--model" | |
| 2025-06-24T02:56:52.7609130Z - <model_name> | |
| 2025-06-24T02:56:52.7609312Z prefill: | |
| 2025-06-24T02:56:52.7609470Z replicas: 1 | |
| 2025-06-24T02:56:52.7609636Z containers: | |
| 2025-06-24T02:56:52.7609838Z - name: "vllm" | |
| 2025-06-24T02:56:52.7610130Z args: | |
| 2025-06-24T02:56:52.7610391Z - "--model" | |
| 2025-06-24T02:56:52.7610672Z - <model_name> | |
| 2025-06-24T02:56:52.7610932Z ``` | |
| 2025-06-24T02:56:52.7611240Z ======================================================================================================================== | |
| 2025-06-24T02:56:52.7611707Z ........................................................................................................................ | |
| 2025-06-24T02:56:52.7612150Z ==> Events of namespace llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:52.7612812Z ........................................................................................................................ | |
| 2025-06-24T02:56:52.7613564Z >>> kubectl --request-timeout=30s get events --output wide --namespace llm-d-pt8s89ylyl --sort-by lastTimestamp | |
| 2025-06-24T02:56:52.8237263Z LAST SEEN TYPE REASON OBJECT SUBOBJECT SOURCE MESSAGE FIRST SEEN COUNT NAME | |
| 2025-06-24T02:56:52.8239932Z 77s Normal Scheduled pod/llm-d-pt8s89ylyl-inference-gateway-istio-78996d97b-dlhxr default-scheduler Successfully assigned llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-inference-gateway-istio-78996d97b-dlhxr to chart-testing-control-plane 77s 1 llm-d-pt8s89ylyl-inference-gateway-istio-78996d97b-dlhxr.184bdb0e90a40cb6 | |
| 2025-06-24T02:56:52.8243783Z 77s Normal SuccessfulCreate replicaset/llm-d-pt8s89ylyl-modelservice-6f6665c8f replicaset-controller Created pod: llm-d-pt8s89ylyl-modelservice-6f6665c8f-rwh88 77s 1 llm-d-pt8s89ylyl-modelservice-6f6665c8f.184bdb0e8b61e54a | |
| 2025-06-24T02:56:52.8246907Z 77s Normal Scheduled pod/llm-d-pt8s89ylyl-modelservice-6f6665c8f-rwh88 default-scheduler Successfully assigned llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-modelservice-6f6665c8f-rwh88 to chart-testing-control-plane 77s 1 llm-d-pt8s89ylyl-modelservice-6f6665c8f-rwh88.184bdb0e8c3b31e8 | |
| 2025-06-24T02:56:52.8250380Z 77s Normal Scheduled pod/llm-d-pt8s89ylyl-redis-master-66f9b5dfdf-56pqk default-scheduler Successfully assigned llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-redis-master-66f9b5dfdf-56pqk to chart-testing-control-plane 77s 1 llm-d-pt8s89ylyl-redis-master-66f9b5dfdf-56pqk.184bdb0e8c1e5a8f | |
| 2025-06-24T02:56:52.8253653Z 77s Normal ScalingReplicaSet deployment/llm-d-pt8s89ylyl-modelservice deployment-controller Scaled up replica set llm-d-pt8s89ylyl-modelservice-6f6665c8f to 1 77s 1 llm-d-pt8s89ylyl-modelservice.184bdb0e8ae841e6 | |
| 2025-06-24T02:56:52.8256486Z 77s Normal ScalingReplicaSet deployment/llm-d-pt8s89ylyl-redis-master deployment-controller Scaled up replica set llm-d-pt8s89ylyl-redis-master-66f9b5dfdf to 1 77s 1 llm-d-pt8s89ylyl-redis-master.184bdb0e8b20e435 | |
| 2025-06-24T02:56:52.8259468Z 77s Normal SuccessfulCreate replicaset/llm-d-pt8s89ylyl-inference-gateway-istio-78996d97b replicaset-controller Created pod: llm-d-pt8s89ylyl-inference-gateway-istio-78996d97b-dlhxr 77s 1 llm-d-pt8s89ylyl-inference-gateway-istio-78996d97b.184bdb0e904341ac | |
| 2025-06-24T02:56:52.8262900Z 77s Normal SuccessfulCreate replicaset/llm-d-pt8s89ylyl-redis-master-66f9b5dfdf replicaset-controller Created pod: llm-d-pt8s89ylyl-redis-master-66f9b5dfdf-56pqk 77s 1 llm-d-pt8s89ylyl-redis-master-66f9b5dfdf.184bdb0e8badbe4a | |
| 2025-06-24T02:56:52.8265912Z 77s Normal ScalingReplicaSet deployment/llm-d-pt8s89ylyl-inference-gateway-istio deployment-controller Scaled up replica set llm-d-pt8s89ylyl-inference-gateway-istio-78996d97b to 1 77s 1 llm-d-pt8s89ylyl-inference-gateway-istio.184bdb0e8f96b14d | |
| 2025-06-24T02:56:52.8269128Z 76s Normal Pulling pod/llm-d-pt8s89ylyl-redis-master-66f9b5dfdf-56pqk spec.containers{redis} kubelet, chart-testing-control-plane Pulling image "quay.io/sclorg/redis-7-c9s:c9s" 76s 1 llm-d-pt8s89ylyl-redis-master-66f9b5dfdf-56pqk.184bdb0ea4d62a8b | |
| 2025-06-24T02:56:52.8272723Z 76s Normal Pulling pod/llm-d-pt8s89ylyl-inference-gateway-istio-78996d97b-dlhxr spec.containers{istio-proxy} kubelet, chart-testing-control-plane Pulling image "gcr.io/istio-testing/proxyv2:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d" 76s 1 llm-d-pt8s89ylyl-inference-gateway-istio-78996d97b-dlhxr.184bdb0eb9a1b191 | |
| 2025-06-24T02:56:52.8276231Z 76s Normal Pulling pod/llm-d-pt8s89ylyl-modelservice-6f6665c8f-rwh88 spec.containers{manager} kubelet, chart-testing-control-plane Pulling image "ghcr.io/llm-d/llm-d-model-service:0.0.10" 76s 1 llm-d-pt8s89ylyl-modelservice-6f6665c8f-rwh88.184bdb0ea5d8ded9 | |
| 2025-06-24T02:56:52.8279149Z 73s Normal Created pod/llm-d-pt8s89ylyl-redis-master-66f9b5dfdf-56pqk spec.containers{redis} kubelet, chart-testing-control-plane Created container redis 73s 1 llm-d-pt8s89ylyl-redis-master-66f9b5dfdf-56pqk.184bdb0f8101285b | |
| 2025-06-24T02:56:52.8282637Z 73s Normal Pulled pod/llm-d-pt8s89ylyl-redis-master-66f9b5dfdf-56pqk spec.containers{redis} kubelet, chart-testing-control-plane Successfully pulled image "quay.io/sclorg/redis-7-c9s:c9s" in 3.673s (3.673s including waiting). Image size: 97229638 bytes. 73s 1 llm-d-pt8s89ylyl-redis-master-66f9b5dfdf-56pqk.184bdb0f7fce17d2 | |
| 2025-06-24T02:56:52.8285835Z 72s Normal Started pod/llm-d-pt8s89ylyl-redis-master-66f9b5dfdf-56pqk spec.containers{redis} kubelet, chart-testing-control-plane Started container redis 72s 1 llm-d-pt8s89ylyl-redis-master-66f9b5dfdf-56pqk.184bdb0f8e5181e4 | |
| 2025-06-24T02:56:52.8288645Z 70s Normal Created pod/llm-d-pt8s89ylyl-modelservice-6f6665c8f-rwh88 spec.containers{manager} kubelet, chart-testing-control-plane Created container manager 70s 1 llm-d-pt8s89ylyl-modelservice-6f6665c8f-rwh88.184bdb103830e578 | |
| 2025-06-24T02:56:52.8292022Z 70s Normal Pulled pod/llm-d-pt8s89ylyl-modelservice-6f6665c8f-rwh88 spec.containers{manager} kubelet, chart-testing-control-plane Successfully pulled image "ghcr.io/llm-d/llm-d-model-service:0.0.10" in 3.084s (6.741s including waiting). Image size: 115030935 bytes. 70s 1 llm-d-pt8s89ylyl-modelservice-6f6665c8f-rwh88.184bdb1037ae9762 | |
| 2025-06-24T02:56:52.8295475Z 69s Normal Started pod/llm-d-pt8s89ylyl-modelservice-6f6665c8f-rwh88 spec.containers{manager} kubelet, chart-testing-control-plane Started container manager 69s 1 llm-d-pt8s89ylyl-modelservice-6f6665c8f-rwh88.184bdb104776f340 | |
| 2025-06-24T02:56:52.8299014Z 67s Normal Pulled pod/llm-d-pt8s89ylyl-inference-gateway-istio-78996d97b-dlhxr spec.containers{istio-proxy} kubelet, chart-testing-control-plane Successfully pulled image "gcr.io/istio-testing/proxyv2:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d" in 2.468s (8.878s including waiting). Image size: 107788353 bytes. 67s 1 llm-d-pt8s89ylyl-inference-gateway-istio-78996d97b-dlhxr.184bdb10cad65b73 | |
| 2025-06-24T02:56:52.8302852Z 67s Normal Started pod/llm-d-pt8s89ylyl-inference-gateway-istio-78996d97b-dlhxr spec.containers{istio-proxy} kubelet, chart-testing-control-plane Started container istio-proxy 67s 1 llm-d-pt8s89ylyl-inference-gateway-istio-78996d97b-dlhxr.184bdb10d05e95f2 | |
| 2025-06-24T02:56:52.8305843Z 67s Normal Created pod/llm-d-pt8s89ylyl-inference-gateway-istio-78996d97b-dlhxr spec.containers{istio-proxy} kubelet, chart-testing-control-plane Created container istio-proxy 67s 1 llm-d-pt8s89ylyl-inference-gateway-istio-78996d97b-dlhxr.184bdb10cb5b8966 | |
| 2025-06-24T02:56:52.8308794Z 50s Normal ScalingReplicaSet deployment/llm-d-pt8s89ylyl-vllm-sim-decode deployment-controller Scaled up replica set llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c to 1 50s 1 llm-d-pt8s89ylyl-vllm-sim-decode.184bdb14dd0daec3 | |
| 2025-06-24T02:56:52.8311420Z 50s Normal ScalingReplicaSet deployment/llm-d-pt8s89ylyl-vllm-sim-epp deployment-controller Scaled up replica set llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f to 1 50s 1 llm-d-pt8s89ylyl-vllm-sim-epp.184bdb14e1ee136e | |
| 2025-06-24T02:56:52.8314096Z 50s Normal ScalingReplicaSet deployment/llm-d-pt8s89ylyl-vllm-sim-prefill deployment-controller Scaled up replica set llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89 to 1 50s 1 llm-d-pt8s89ylyl-vllm-sim-prefill.184bdb14dc2f8e06 | |
| 2025-06-24T02:56:52.8317663Z 50s Warning FailedCreate replicaset/llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f replicaset-controller Error creating: pods "llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-" is forbidden: error looking up service account llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-vllm-sim-epp-sa: serviceaccount "llm-d-pt8s89ylyl-vllm-sim-epp-sa" not found 50s 2 llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f.184bdb14e2a8454b | |
| 2025-06-24T02:56:52.8322501Z 49s Warning FailedCreate replicaset/llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89 replicaset-controller Error creating: pods "llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-" is forbidden: error looking up service account llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-vllm-sim-sa: serviceaccount "llm-d-pt8s89ylyl-vllm-sim-sa" not found 50s 7 llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89.184bdb14dd101460 | |
| 2025-06-24T02:56:52.8325888Z 49s Normal Scheduled pod/llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-l5lbz default-scheduler Successfully assigned llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-l5lbz to chart-testing-control-plane 49s 1 llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-l5lbz.184bdb1512f8c2bf | |
| 2025-06-24T02:56:52.8328836Z 49s Warning FailedCreate replicaset/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c replicaset-controller Error creating: pods "llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-" is forbidden: error looking up service account llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-vllm-sim-sa: serviceaccount "llm-d-pt8s89ylyl-vllm-sim-sa" not found 50s 7 llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c.184bdb14dd22e975 | |
| 2025-06-24T02:56:52.8331401Z 49s Normal Scheduled pod/llm-d-pt8s89ylyl-test-connection default-scheduler Successfully assigned llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-test-connection to chart-testing-control-plane 49s 1 llm-d-pt8s89ylyl-test-connection.184bdb14efbdf066 | |
| 2025-06-24T02:56:52.8333714Z 49s Normal SuccessfulCreate replicaset/llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f replicaset-controller Created pod: llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-tq4hr 49s 1 llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f.184bdb14eaf692bd | |
| 2025-06-24T02:56:52.8335806Z 49s Normal Scheduled pod/llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-tq4hr default-scheduler Successfully assigned llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-tq4hr to chart-testing-control-plane 49s 1 llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-tq4hr.184bdb14efaa6c07 | |
| 2025-06-24T02:56:52.8338509Z 49s Normal SuccessfulCreate replicaset/llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89 replicaset-controller Created pod: llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-l5lbz 49s 1 llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89.184bdb150d8faf38 | |
| 2025-06-24T02:56:52.8341269Z 49s Normal Scheduled pod/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t default-scheduler Successfully assigned llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t to chart-testing-control-plane 49s 1 llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t.184bdb151072f346 | |
| 2025-06-24T02:56:52.8343882Z 49s Normal SuccessfulCreate replicaset/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c replicaset-controller Created pod: llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t 49s 1 llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c.184bdb150d717e8d | |
| 2025-06-24T02:56:52.8346344Z 48s Normal Pulling pod/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t spec.initContainers{routing-proxy} kubelet, chart-testing-control-plane Pulling image "ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6" 48s 1 llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t.184bdb154c64c580 | |
| 2025-06-24T02:56:52.8348767Z 48s Normal Pulling pod/llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-l5lbz spec.containers{vllm} kubelet, chart-testing-control-plane Pulling image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" 48s 1 llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-l5lbz.184bdb154f8d9379 | |
| 2025-06-24T02:56:52.8351311Z 48s Normal Pulling pod/llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-tq4hr spec.containers{epp} kubelet, chart-testing-control-plane Pulling image "ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4" 48s 1 llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-tq4hr.184bdb15411996a8 | |
| 2025-06-24T02:56:52.8354126Z 45s Normal Pulled pod/llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-tq4hr spec.containers{epp} kubelet, chart-testing-control-plane Successfully pulled image "ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4" in 3.425s (3.425s including waiting). Image size: 119587259 bytes. 45s 1 llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-tq4hr.184bdb160d4be36b | |
| 2025-06-24T02:56:52.8356258Z 45s Normal Pulling pod/llm-d-pt8s89ylyl-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Pulling image "quay.io/curl/curl:latest" 45s 1 llm-d-pt8s89ylyl-test-connection.184bdb15f131d403 | |
| 2025-06-24T02:56:52.8357988Z 45s Normal Created pod/llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-tq4hr spec.containers{epp} kubelet, chart-testing-control-plane Created container epp 45s 1 llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-tq4hr.184bdb160dc742fc | |
| 2025-06-24T02:56:52.8359944Z 44s Normal Started pod/llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-tq4hr spec.containers{epp} kubelet, chart-testing-control-plane Started container epp 44s 1 llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-tq4hr.184bdb16134ab9a9 | |
| 2025-06-24T02:56:52.8362117Z 42s Normal Pulled pod/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t spec.initContainers{routing-proxy} kubelet, chart-testing-control-plane Successfully pulled image "ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6" in 3.074s (6.31s including waiting). Image size: 85265962 bytes. 42s 1 llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t.184bdb16c48dbc4f | |
| 2025-06-24T02:56:52.8364643Z 41s Normal Started pod/llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-l5lbz spec.containers{vllm} kubelet, chart-testing-control-plane Started container vllm 41s 1 llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-l5lbz.184bdb16e8060f21 | |
| 2025-06-24T02:56:52.8366834Z 41s Normal Pulled pod/llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-l5lbz spec.containers{vllm} kubelet, chart-testing-control-plane Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" in 503ms (6.76s including waiting). Image size: 87011014 bytes. 41s 1 llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-l5lbz.184bdb16e2896781 | |
| 2025-06-24T02:56:52.8369249Z 41s Normal Pulling pod/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t spec.containers{vllm} kubelet, chart-testing-control-plane Pulling image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" 41s 1 llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t.184bdb16df5cd009 | |
| 2025-06-24T02:56:52.8371306Z 41s Normal Started pod/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t spec.initContainers{routing-proxy} kubelet, chart-testing-control-plane Started container routing-proxy 41s 1 llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t.184bdb16cbe0a067 | |
| 2025-06-24T02:56:52.8373461Z 41s Normal Created pod/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t spec.initContainers{routing-proxy} kubelet, chart-testing-control-plane Created container routing-proxy 41s 1 llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t.184bdb16c50fe0fe | |
| 2025-06-24T02:56:52.8375352Z 41s Normal Created pod/llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-l5lbz spec.containers{vllm} kubelet, chart-testing-control-plane Created container vllm 41s 1 llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-l5lbz.184bdb16e320c3c2 | |
| 2025-06-24T02:56:52.8377646Z 40s Normal Pulled pod/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t spec.containers{vllm} kubelet, chart-testing-control-plane Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" in 124ms (1.229s including waiting). Image size: 87011014 bytes. 40s 1 llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t.184bdb1728a4244d | |
| 2025-06-24T02:56:52.8379947Z 40s Normal Pulled pod/llm-d-pt8s89ylyl-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Successfully pulled image "quay.io/curl/curl:latest" in 1.051s (5.1s including waiting). Image size: 9956545 bytes. 40s 1 llm-d-pt8s89ylyl-test-connection.184bdb172132a38c | |
| 2025-06-24T02:56:52.8381790Z 40s Normal Created pod/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t spec.containers{vllm} kubelet, chart-testing-control-plane Created container vllm 40s 1 llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t.184bdb1729162996 | |
| 2025-06-24T02:56:52.8384024Z 40s Normal Started pod/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t spec.containers{vllm} kubelet, chart-testing-control-plane Started container vllm 40s 1 llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t.184bdb172e17e9ae | |
| 2025-06-24T02:56:52.8386332Z 40s Normal Created pod/llm-d-pt8s89ylyl-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Created container curl 40s 1 llm-d-pt8s89ylyl-test-connection.184bdb1721ad4517 | |
| 2025-06-24T02:56:52.8387927Z 33s Normal Started pod/llm-d-pt8s89ylyl-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Started container curl 33s 1 llm-d-pt8s89ylyl-test-connection.184bdb18a802e8dd | |
| 2025-06-24T02:56:52.8389829Z 28s Normal Scheduled pod/llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz default-scheduler Successfully assigned llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz to chart-testing-control-plane 28s 1 llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz.184bdb1a04506c8a | |
| 2025-06-24T02:56:52.8392091Z 28s Normal SuccessfulCreate replicaset/llm-d-pt8s89ylyl-modelservice-688cc5c6b9 replicaset-controller Created pod: llm-d-pt8s89ylyl-modelservice-688cc5c6b9-fwqcm 28s 1 llm-d-pt8s89ylyl-modelservice-688cc5c6b9.184bdb19ff632246 | |
| 2025-06-24T02:56:52.8394286Z 28s Normal ScalingReplicaSet deployment/llm-d-pt8s89ylyl-modelservice deployment-controller Scaled up replica set llm-d-pt8s89ylyl-modelservice-688cc5c6b9 to 1 28s 1 llm-d-pt8s89ylyl-modelservice.184bdb19ff070532 | |
| 2025-06-24T02:56:52.8397436Z 28s Normal Scheduled pod/llm-d-pt8s89ylyl-modelservice-688cc5c6b9-fwqcm default-scheduler Successfully assigned llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-modelservice-688cc5c6b9-fwqcm to chart-testing-control-plane 28s 1 llm-d-pt8s89ylyl-modelservice-688cc5c6b9-fwqcm.184bdb19ffdcd35b | |
| 2025-06-24T02:56:52.8400807Z 28s Normal ScalingReplicaSet deployment/llm-d-pt8s89ylyl-inference-gateway-istio deployment-controller Scaled up replica set llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4 to 1 28s 1 llm-d-pt8s89ylyl-inference-gateway-istio.184bdb1a037ec9bf | |
| 2025-06-24T02:56:52.8403748Z 28s Normal SuccessfulCreate replicaset/llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4 replicaset-controller Created pod: llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz 28s 1 llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4.184bdb1a040c3dd9 | |
| 2025-06-24T02:56:52.8406760Z 27s Normal Created pod/llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz spec.containers{istio-proxy} kubelet, chart-testing-control-plane Created container istio-proxy 27s 1 llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz.184bdb1a1d29969b | |
| 2025-06-24T02:56:52.8409541Z 27s Normal Pulled pod/llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz spec.containers{istio-proxy} kubelet, chart-testing-control-plane Container image "gcr.io/istio-testing/proxyv2:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d" already present on machine 27s 1 llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz.184bdb1a1c8923a3 | |
| 2025-06-24T02:56:52.8412053Z 27s Normal Started pod/llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz spec.containers{istio-proxy} kubelet, chart-testing-control-plane Started container istio-proxy 27s 1 llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz.184bdb1a22ef65c4 | |
| 2025-06-24T02:56:52.8414160Z 27s Normal Pulling pod/llm-d-pt8s89ylyl-modelservice-688cc5c6b9-fwqcm spec.containers{manager} kubelet, chart-testing-control-plane Pulling image "ghcr.io/llm-d/llm-d-model-service:0.0.10" 27s 1 llm-d-pt8s89ylyl-modelservice-688cc5c6b9-fwqcm.184bdb1a18b9147d | |
| 2025-06-24T02:56:52.8416282Z 27s Normal Pulled pod/llm-d-pt8s89ylyl-modelservice-688cc5c6b9-fwqcm spec.containers{manager} kubelet, chart-testing-control-plane Successfully pulled image "ghcr.io/llm-d/llm-d-model-service:0.0.10" in 101ms (101ms including waiting). Image size: 115030935 bytes. 27s 1 llm-d-pt8s89ylyl-modelservice-688cc5c6b9-fwqcm.184bdb1a1ebf209b | |
| 2025-06-24T02:56:52.8418172Z 27s Normal Created pod/llm-d-pt8s89ylyl-modelservice-688cc5c6b9-fwqcm spec.containers{manager} kubelet, chart-testing-control-plane Created container manager 27s 1 llm-d-pt8s89ylyl-modelservice-688cc5c6b9-fwqcm.184bdb1a1f483839 | |
| 2025-06-24T02:56:52.8419797Z 27s Normal Started pod/llm-d-pt8s89ylyl-modelservice-688cc5c6b9-fwqcm spec.containers{manager} kubelet, chart-testing-control-plane Started container manager 27s 1 llm-d-pt8s89ylyl-modelservice-688cc5c6b9-fwqcm.184bdb1a2ea62d99 | |
| 2025-06-24T02:56:52.8421532Z 26s Normal Killing pod/llm-d-pt8s89ylyl-inference-gateway-istio-78996d97b-dlhxr spec.containers{istio-proxy} kubelet, chart-testing-control-plane Stopping container istio-proxy 26s 1 llm-d-pt8s89ylyl-inference-gateway-istio-78996d97b-dlhxr.184bdb1a62541902 | |
| 2025-06-24T02:56:52.8423692Z 26s Normal SuccessfulDelete replicaset/llm-d-pt8s89ylyl-inference-gateway-istio-78996d97b replicaset-controller Deleted pod: llm-d-pt8s89ylyl-inference-gateway-istio-78996d97b-dlhxr 26s 1 llm-d-pt8s89ylyl-inference-gateway-istio-78996d97b.184bdb1a624b7715 | |
| 2025-06-24T02:56:52.8425697Z 26s Normal ScalingReplicaSet deployment/llm-d-pt8s89ylyl-inference-gateway-istio deployment-controller Scaled down replica set llm-d-pt8s89ylyl-inference-gateway-istio-78996d97b to 0 from 1 26s 1 llm-d-pt8s89ylyl-inference-gateway-istio.184bdb1a61f30b27 | |
| 2025-06-24T02:56:52.8427423Z 17s Normal SuccessfulDelete replicaset/llm-d-pt8s89ylyl-modelservice-6f6665c8f replicaset-controller Deleted pod: llm-d-pt8s89ylyl-modelservice-6f6665c8f-rwh88 17s 1 llm-d-pt8s89ylyl-modelservice-6f6665c8f.184bdb1c68c70c1b | |
| 2025-06-24T02:56:52.8429193Z 17s Normal Killing pod/llm-d-pt8s89ylyl-modelservice-6f6665c8f-rwh88 spec.containers{manager} kubelet, chart-testing-control-plane Stopping container manager 17s 1 llm-d-pt8s89ylyl-modelservice-6f6665c8f-rwh88.184bdb1c686d7bc0 | |
| 2025-06-24T02:56:52.8430921Z 17s Normal ScalingReplicaSet deployment/llm-d-pt8s89ylyl-modelservice deployment-controller Scaled down replica set llm-d-pt8s89ylyl-modelservice-6f6665c8f to 0 from 1 17s 1 llm-d-pt8s89ylyl-modelservice.184bdb1c680835e3 | |
| 2025-06-24T02:56:52.8432816Z 14s Normal Scheduled pod/llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-6lhvm default-scheduler Successfully assigned llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-6lhvm to chart-testing-control-plane 14s 1 llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-6lhvm.184bdb1d301a371d | |
| 2025-06-24T02:56:52.8434758Z 14s Normal ScalingReplicaSet deployment/llm-d-pt8s89ylyl-vllm-sim-decode deployment-controller Scaled up replica set llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c to 1 14s 1 llm-d-pt8s89ylyl-vllm-sim-decode.184bdb1d2af201ff | |
| 2025-06-24T02:56:52.8436611Z 14s Normal Pulling pod/llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-6lhvm spec.containers{epp} kubelet, chart-testing-control-plane Pulling image "ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4" 14s 1 llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-6lhvm.184bdb1d488b203d | |
| 2025-06-24T02:56:52.8438948Z 14s Normal ScalingReplicaSet deployment/llm-d-pt8s89ylyl-vllm-sim-prefill deployment-controller Scaled up replica set llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89 to 1 14s 1 llm-d-pt8s89ylyl-vllm-sim-prefill.184bdb1d2acb9483 | |
| 2025-06-24T02:56:52.8441223Z 14s Normal Scheduled pod/llm-d-pt8s89ylyl-test-connection default-scheduler Successfully assigned llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-test-connection to chart-testing-control-plane 14s 1 llm-d-pt8s89ylyl-test-connection.184bdb1d38de67c0 | |
| 2025-06-24T02:56:52.8443640Z 14s Normal SuccessfulCreate replicaset/llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89 replicaset-controller Created pod: llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj 14s 1 llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89.184bdb1d34d60215 | |
| 2025-06-24T02:56:52.8446099Z 14s Normal SuccessfulCreate replicaset/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c replicaset-controller Created pod: llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq 14s 1 llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c.184bdb1d3d45c1a1 | |
| 2025-06-24T02:56:52.8450078Z 14s Warning FailedCreate replicaset/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c replicaset-controller Error creating: pods "llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-" is forbidden: error looking up service account llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-vllm-sim-sa: serviceaccount "llm-d-pt8s89ylyl-vllm-sim-sa" not found 14s 5 llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c.184bdb1d2bcfee9a | |
| 2025-06-24T02:56:52.8454750Z 14s Warning FailedCreate replicaset/llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89 replicaset-controller Error creating: pods "llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-" is forbidden: error looking up service account llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-vllm-sim-sa: serviceaccount "llm-d-pt8s89ylyl-vllm-sim-sa" not found 14s 5 llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89.184bdb1d2b1e1902 | |
| 2025-06-24T02:56:52.8457944Z 14s Normal Scheduled pod/llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj default-scheduler Successfully assigned llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj to chart-testing-control-plane 14s 1 llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj.184bdb1d3556cc20 | |
| 2025-06-24T02:56:52.8461407Z 14s Normal Killing pod/llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-l5lbz spec.containers{vllm} kubelet, chart-testing-control-plane Stopping container vllm 14s 1 llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-l5lbz.184bdb1d335a2695 | |
| 2025-06-24T02:56:52.8464755Z 14s Normal Killing pod/llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-tq4hr spec.containers{epp} kubelet, chart-testing-control-plane Stopping container epp 14s 1 llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-tq4hr.184bdb1d34e56c03 | |
| 2025-06-24T02:56:52.8467914Z 14s Normal Killing pod/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t spec.initContainers{routing-proxy} kubelet, chart-testing-control-plane Stopping container routing-proxy 14s 1 llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t.184bdb1d31eaf959 | |
| 2025-06-24T02:56:52.8471012Z 14s Normal Killing pod/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t spec.containers{vllm} kubelet, chart-testing-control-plane Stopping container vllm 14s 1 llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t.184bdb1d31f0c00a | |
| 2025-06-24T02:56:52.8474847Z 14s Warning FailedCreate replicaset/llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f replicaset-controller Error creating: pods "llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-" is forbidden: error looking up service account llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-vllm-sim-epp-sa: serviceaccount "llm-d-pt8s89ylyl-vllm-sim-epp-sa" not found 14s 1 llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f.184bdb1d2e4bf687 | |
| 2025-06-24T02:56:52.8478759Z 14s Normal SuccessfulCreate replicaset/llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f replicaset-controller Created pod: llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-6lhvm 14s 1 llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f.184bdb1d2fbd8a6c | |
| 2025-06-24T02:56:52.8483014Z 14s Normal Scheduled pod/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq default-scheduler Successfully assigned llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq to chart-testing-control-plane 14s 1 llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq.184bdb1d3d968f76 | |
| 2025-06-24T02:56:52.8486234Z 14s Normal ScalingReplicaSet deployment/llm-d-pt8s89ylyl-vllm-sim-epp deployment-controller Scaled up replica set llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f to 1 14s 1 llm-d-pt8s89ylyl-vllm-sim-epp.184bdb1d2e316303 | |
| 2025-06-24T02:56:52.8488953Z 13s Normal Created pod/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq spec.containers{vllm} kubelet, chart-testing-control-plane Created container vllm 13s 1 llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq.184bdb1d6a24627f | |
| 2025-06-24T02:56:52.8492816Z 13s Normal Started pod/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq spec.containers{vllm} kubelet, chart-testing-control-plane Started container vllm 13s 1 llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq.184bdb1d71e7dc2c | |
| 2025-06-24T02:56:52.8495638Z 13s Normal Created pod/llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj spec.containers{vllm} kubelet, chart-testing-control-plane Created container vllm 13s 1 llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj.184bdb1d4fe26f21 | |
| 2025-06-24T02:56:52.8498479Z 13s Normal Started pod/llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj spec.containers{vllm} kubelet, chart-testing-control-plane Started container vllm 13s 1 llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj.184bdb1d57b5cc64 | |
| 2025-06-24T02:56:52.8501873Z 13s Normal Pulled pod/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq spec.initContainers{routing-proxy} kubelet, chart-testing-control-plane Container image "ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6" already present on machine 13s 1 llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq.184bdb1d575c39bb | |
| 2025-06-24T02:56:52.8505562Z 13s Normal Created pod/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq spec.initContainers{routing-proxy} kubelet, chart-testing-control-plane Created container routing-proxy 13s 1 llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq.184bdb1d580c4ea9 | |
| 2025-06-24T02:56:52.8509465Z 13s Normal Started pod/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq spec.initContainers{routing-proxy} kubelet, chart-testing-control-plane Started container routing-proxy 13s 1 llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq.184bdb1d5db734dc | |
| 2025-06-24T02:56:52.8513416Z 13s Normal Pulled pod/llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-6lhvm spec.containers{epp} kubelet, chart-testing-control-plane Successfully pulled image "ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4" in 108ms (108ms including waiting). Image size: 119587259 bytes. 13s 1 llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-6lhvm.184bdb1d4efe465c | |
| 2025-06-24T02:56:52.8516855Z 13s Normal Created pod/llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-6lhvm spec.containers{epp} kubelet, chart-testing-control-plane Created container epp 13s 1 llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-6lhvm.184bdb1d500814f0 | |
| 2025-06-24T02:56:52.8519938Z 13s Normal Pulled pod/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq spec.containers{vllm} kubelet, chart-testing-control-plane Container image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" already present on machine 13s 1 llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq.184bdb1d694a7ae8 | |
| 2025-06-24T02:56:52.8523539Z 13s Normal Pulled pod/llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj spec.containers{vllm} kubelet, chart-testing-control-plane Container image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" already present on machine 13s 1 llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj.184bdb1d4eda98d6 | |
| 2025-06-24T02:56:52.8526642Z 13s Normal Started pod/llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-6lhvm spec.containers{epp} kubelet, chart-testing-control-plane Started container epp 13s 1 llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-6lhvm.184bdb1d5886786e | |
| 2025-06-24T02:56:52.8529457Z 10s Normal Created pod/llm-d-pt8s89ylyl-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Created container curl 10s 1 llm-d-pt8s89ylyl-test-connection.184bdb1e03a7c3d0 | |
| 2025-06-24T02:56:52.8532157Z 10s Normal Pulled pod/llm-d-pt8s89ylyl-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Container image "quay.io/curl/curl:latest" already present on machine 10s 1 llm-d-pt8s89ylyl-test-connection.184bdb1e032bfdf5 | |
| 2025-06-24T02:56:52.8534981Z 4s Normal Started pod/llm-d-pt8s89ylyl-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Started container curl 4s 1 llm-d-pt8s89ylyl-test-connection.184bdb1f7b6b865e | |
| 2025-06-24T02:56:52.8537432Z 1s Warning Unhealthy pod/llm-d-pt8s89ylyl-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Liveness probe failed: 1s 1 llm-d-pt8s89ylyl-test-connection.184bdb202efddb42 | |
| 2025-06-24T02:56:52.8539130Z ........................................................................................................................ | |
| 2025-06-24T02:56:52.8539673Z <== Events of namespace llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:52.8540183Z ........................................................................................................................ | |
| 2025-06-24T02:56:52.8541206Z >>> kubectl --request-timeout=30s get pods --no-headers --namespace llm-d-pt8s89ylyl --selector --output jsonpath={.items[*].metadata.name} | |
| 2025-06-24T02:56:52.8969773Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:52.8970612Z ==> Description of pod llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz | |
| 2025-06-24T02:56:52.8971366Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:52.8972572Z >>> kubectl --request-timeout=30s describe pod llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz --namespace llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:52.9536795Z Name: llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz | |
| 2025-06-24T02:56:52.9537743Z Namespace: llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:52.9538316Z Priority: 0 | |
| 2025-06-24T02:56:52.9538650Z Service Account: llm-d-pt8s89ylyl-inference-gateway-istio | |
| 2025-06-24T02:56:52.9539031Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T02:56:52.9539338Z Start Time: Tue, 24 Jun 2025 02:56:24 +0000 | |
| 2025-06-24T02:56:52.9539652Z Labels: app.kubernetes.io/component=inference-gateway | |
| 2025-06-24T02:56:52.9540031Z app.kubernetes.io/gateway=llm-d-pt8s89ylyl-inference-gateway | |
| 2025-06-24T02:56:52.9540452Z app.kubernetes.io/instance=llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:52.9540816Z app.kubernetes.io/managed-by=Helm | |
| 2025-06-24T02:56:52.9541094Z app.kubernetes.io/name=llm-d | |
| 2025-06-24T02:56:52.9541339Z app.kubernetes.io/version=0.1 | |
| 2025-06-24T02:56:52.9541640Z gateway.istio.io/managed=istio.io-gateway-controller | |
| 2025-06-24T02:56:52.9542049Z gateway.networking.k8s.io/gateway-name=llm-d-pt8s89ylyl-inference-gateway | |
| 2025-06-24T02:56:52.9542644Z helm.sh/chart=llm-d-1.0.20 | |
| 2025-06-24T02:56:52.9543256Z istio.io/enable-inference-extproc=true | |
| 2025-06-24T02:56:52.9543552Z pod-template-hash=84c799c9d4 | |
| 2025-06-24T02:56:52.9543959Z service.istio.io/canonical-name=llm-d-pt8s89ylyl-inference-gateway-istio | |
| 2025-06-24T02:56:52.9544350Z service.istio.io/canonical-revision=latest | |
| 2025-06-24T02:56:52.9544622Z sidecar.istio.io/inject=false | |
| 2025-06-24T02:56:52.9544878Z Annotations: istio.io/rev: default | |
| 2025-06-24T02:56:52.9545143Z meta.helm.sh/release-name: llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:52.9545456Z meta.helm.sh/release-namespace: llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:52.9545756Z networking.istio.io/service-type: ClusterIP | |
| 2025-06-24T02:56:52.9546040Z prometheus.io/path: /stats/prometheus | |
| 2025-06-24T02:56:52.9546301Z prometheus.io/port: 15020 | |
| 2025-06-24T02:56:52.9546543Z prometheus.io/scrape: true | |
| 2025-06-24T02:56:52.9546784Z Status: Running | |
| 2025-06-24T02:56:52.9546971Z IP: 10.244.0.20 | |
| 2025-06-24T02:56:52.9547153Z IPs: | |
| 2025-06-24T02:56:52.9547297Z IP: 10.244.0.20 | |
| 2025-06-24T02:56:52.9547629Z Controlled By: ReplicaSet/llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4 | |
| 2025-06-24T02:56:52.9547976Z Containers: | |
| 2025-06-24T02:56:52.9548136Z istio-proxy: | |
| 2025-06-24T02:56:52.9548529Z Container ID: containerd://6d895cf8b988aba7a64e360bece832f3eb82773626b33d2cfff679e900c6eaa8 | |
| 2025-06-24T02:56:52.9549098Z Image: gcr.io/istio-testing/proxyv2:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d | |
| 2025-06-24T02:56:52.9549849Z Image ID: gcr.io/istio-testing/proxyv2@sha256:f8b9447198a9e52e5c928cc735536a41ad416afa2a7a674056b1e24c5789607c | |
| 2025-06-24T02:56:52.9550318Z Ports: 15020/TCP, 15021/TCP, 15090/TCP | |
| 2025-06-24T02:56:52.9550578Z Host Ports: 0/TCP, 0/TCP, 0/TCP | |
| 2025-06-24T02:56:52.9550790Z Args: | |
| 2025-06-24T02:56:52.9550935Z proxy | |
| 2025-06-24T02:56:52.9551202Z router | |
| 2025-06-24T02:56:52.9551403Z --domain | |
| 2025-06-24T02:56:52.9551593Z $(POD_NAMESPACE).svc.cluster.local | |
| 2025-06-24T02:56:52.9551835Z --proxyLogLevel | |
| 2025-06-24T02:56:52.9552009Z warning | |
| 2025-06-24T02:56:52.9552178Z --proxyComponentLogLevel | |
| 2025-06-24T02:56:52.9552609Z misc:error | |
| 2025-06-24T02:56:52.9552787Z --log_output_level | |
| 2025-06-24T02:56:52.9552977Z default:info | |
| 2025-06-24T02:56:52.9553145Z State: Running | |
| 2025-06-24T02:56:52.9553366Z Started: Tue, 24 Jun 2025 02:56:25 +0000 | |
| 2025-06-24T02:56:52.9553617Z Ready: True | |
| 2025-06-24T02:56:52.9553802Z Restart Count: 0 | |
| 2025-06-24T02:56:52.9553978Z Limits: | |
| 2025-06-24T02:56:52.9554125Z cpu: 2 | |
| 2025-06-24T02:56:52.9554292Z memory: 1Gi | |
| 2025-06-24T02:56:52.9554452Z Requests: | |
| 2025-06-24T02:56:52.9554614Z cpu: 100m | |
| 2025-06-24T02:56:52.9554782Z memory: 128Mi | |
| 2025-06-24T02:56:52.9555159Z Readiness: http-get http://:15021/healthz/ready delay=0s timeout=1s period=15s #success=1 #failure=4 | |
| 2025-06-24T02:56:52.9555728Z Startup: http-get http://:15021/healthz/ready delay=1s timeout=1s period=1s #success=1 #failure=30 | |
| 2025-06-24T02:56:52.9556113Z Environment: | |
| 2025-06-24T02:56:52.9556303Z PILOT_CERT_PROVIDER: istiod | |
| 2025-06-24T02:56:52.9556581Z CA_ADDR: istiod.istio-system.svc:15012 | |
| 2025-06-24T02:56:52.9557033Z POD_NAME: llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz (v1:metadata.name) | |
| 2025-06-24T02:56:52.9557512Z POD_NAMESPACE: llm-d-pt8s89ylyl (v1:metadata.namespace) | |
| 2025-06-24T02:56:52.9557850Z INSTANCE_IP: (v1:status.podIP) | |
| 2025-06-24T02:56:52.9558169Z SERVICE_ACCOUNT: (v1:spec.serviceAccountName) | |
| 2025-06-24T02:56:52.9558481Z HOST_IP: (v1:status.hostIP) | |
| 2025-06-24T02:56:52.9558756Z ISTIO_CPU_LIMIT: 2 (limits.cpu) | |
| 2025-06-24T02:56:52.9559373Z PROXY_CONFIG: {} | |
| 2025-06-24T02:56:52.9559827Z | |
| 2025-06-24T02:56:52.9560230Z ISTIO_META_POD_PORTS: [] | |
| 2025-06-24T02:56:52.9560653Z ISTIO_META_APP_CONTAINERS: | |
| 2025-06-24T02:56:52.9561290Z GOMEMLIMIT: 1073741824 (limits.memory) | |
| 2025-06-24T02:56:52.9561919Z GOMAXPROCS: 2 (limits.cpu) | |
| 2025-06-24T02:56:52.9562533Z ISTIO_META_CLUSTER_ID: Kubernetes | |
| 2025-06-24T02:56:52.9563025Z ISTIO_META_NODE_NAME: (v1:spec.nodeName) | |
| 2025-06-24T02:56:52.9563527Z ISTIO_META_INTERCEPTION_MODE: REDIRECT | |
| 2025-06-24T02:56:52.9564073Z ISTIO_META_WORKLOAD_NAME: llm-d-pt8s89ylyl-inference-gateway-istio | |
| 2025-06-24T02:56:52.9565057Z ISTIO_META_OWNER: kubernetes://apis/apps/v1/namespaces/llm-d-pt8s89ylyl/deployments/llm-d-pt8s89ylyl-inference-gateway-istio | |
| 2025-06-24T02:56:52.9566020Z ISTIO_META_MESH_ID: cluster.local | |
| 2025-06-24T02:56:52.9566490Z TRUST_DOMAIN: cluster.local | |
| 2025-06-24T02:56:52.9566885Z Mounts: | |
| 2025-06-24T02:56:52.9567182Z /etc/istio/pod from istio-podinfo (rw) | |
| 2025-06-24T02:56:52.9567613Z /etc/istio/proxy from istio-envoy (rw) | |
| 2025-06-24T02:56:52.9568030Z /var/lib/istio/data from istio-data (rw) | |
| 2025-06-24T02:56:52.9568571Z /var/run/secrets/credential-uds from credential-socket (rw) | |
| 2025-06-24T02:56:52.9569134Z /var/run/secrets/istio from istiod-ca-cert (rw) | |
| 2025-06-24T02:56:52.9569993Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-bl677 (ro) | |
| 2025-06-24T02:56:52.9570976Z /var/run/secrets/tokens from istio-token (rw) | |
| 2025-06-24T02:56:52.9571642Z /var/run/secrets/workload-spiffe-credentials from workload-certs (rw) | |
| 2025-06-24T02:56:52.9572579Z /var/run/secrets/workload-spiffe-uds from workload-socket (rw) | |
| 2025-06-24T02:56:52.9573110Z Conditions: | |
| 2025-06-24T02:56:52.9573411Z Type Status | |
| 2025-06-24T02:56:52.9573804Z PodReadyToStartContainers True | |
| 2025-06-24T02:56:52.9574188Z Initialized True | |
| 2025-06-24T02:56:52.9574539Z Ready True | |
| 2025-06-24T02:56:52.9574890Z ContainersReady True | |
| 2025-06-24T02:56:52.9575260Z PodScheduled True | |
| 2025-06-24T02:56:52.9575600Z Volumes: | |
| 2025-06-24T02:56:52.9575862Z workload-socket: | |
| 2025-06-24T02:56:52.9576316Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T02:56:52.9576857Z Medium: | |
| 2025-06-24T02:56:52.9577146Z SizeLimit: <unset> | |
| 2025-06-24T02:56:52.9577466Z credential-socket: | |
| 2025-06-24T02:56:52.9577936Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T02:56:52.9578469Z Medium: | |
| 2025-06-24T02:56:52.9578755Z SizeLimit: <unset> | |
| 2025-06-24T02:56:52.9579065Z workload-certs: | |
| 2025-06-24T02:56:52.9579526Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T02:56:52.9580061Z Medium: | |
| 2025-06-24T02:56:52.9580356Z SizeLimit: <unset> | |
| 2025-06-24T02:56:52.9580662Z istio-envoy: | |
| 2025-06-24T02:56:52.9581098Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T02:56:52.9581631Z Medium: Memory | |
| 2025-06-24T02:56:52.9581950Z SizeLimit: <unset> | |
| 2025-06-24T02:56:52.9582262Z istio-data: | |
| 2025-06-24T02:56:52.9582858Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T02:56:52.9583356Z Medium: | |
| 2025-06-24T02:56:52.9583663Z SizeLimit: <unset> | |
| 2025-06-24T02:56:52.9583974Z istio-podinfo: | |
| 2025-06-24T02:56:52.9584442Z Type: DownwardAPI (a volume populated by information about the pod) | |
| 2025-06-24T02:56:52.9584975Z Items: | |
| 2025-06-24T02:56:52.9585269Z metadata.labels -> labels | |
| 2025-06-24T02:56:52.9585652Z metadata.annotations -> annotations | |
| 2025-06-24T02:56:52.9586036Z istio-token: | |
| 2025-06-24T02:56:52.9586726Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T02:56:52.9587366Z TokenExpirationSeconds: 43200 | |
| 2025-06-24T02:56:52.9587746Z istiod-ca-cert: | |
| 2025-06-24T02:56:52.9588146Z Type: ConfigMap (a volume populated by a ConfigMap) | |
| 2025-06-24T02:56:52.9588613Z Name: istio-ca-root-cert | |
| 2025-06-24T02:56:52.9588963Z Optional: false | |
| 2025-06-24T02:56:52.9589272Z kube-api-access-bl677: | |
| 2025-06-24T02:56:52.9589803Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T02:56:52.9590425Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T02:56:52.9590820Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T02:56:52.9591247Z ConfigMapOptional: <nil> | |
| 2025-06-24T02:56:52.9591615Z DownwardAPI: true | |
| 2025-06-24T02:56:52.9591981Z QoS Class: Burstable | |
| 2025-06-24T02:56:52.9592517Z Node-Selectors: <none> | |
| 2025-06-24T02:56:52.9593093Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T02:56:52.9593805Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T02:56:52.9594373Z Events: | |
| 2025-06-24T02:56:52.9594698Z Type Reason Age From Message | |
| 2025-06-24T02:56:52.9595165Z ---- ------ ---- ---- ------- | |
| 2025-06-24T02:56:52.9596359Z Normal Scheduled 28s default-scheduler Successfully assigned llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz to chart-testing-control-plane | |
| 2025-06-24T02:56:52.9598463Z Normal Pulled 27s kubelet Container image "gcr.io/istio-testing/proxyv2:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d" already present on machine | |
| 2025-06-24T02:56:52.9599648Z Normal Created 27s kubelet Created container istio-proxy | |
| 2025-06-24T02:56:52.9600405Z Normal Started 27s kubelet Started container istio-proxy | |
| 2025-06-24T02:56:52.9601143Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:52.9601940Z <== Description of pod llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz | |
| 2025-06-24T02:56:52.9602858Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:52.9604260Z >>> kubectl --request-timeout=30s get pods llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz --no-headers --namespace llm-d-pt8s89ylyl --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T02:56:53.0157654Z >>> kubectl --request-timeout=30s get pods llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz --no-headers --namespace llm-d-pt8s89ylyl --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T02:56:53.1147185Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:53.1148556Z ==> Logs of container llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz | |
| 2025-06-24T02:56:53.1149346Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:53.1150468Z >>> kubectl --request-timeout=30s logs llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz --namespace llm-d-pt8s89ylyl --container istio-proxy | |
| 2025-06-24T02:56:53.1765115Z 2025-06-24T02:56:25.472785Z info FLAG: --concurrency="0" | |
| 2025-06-24T02:56:53.1765939Z 2025-06-24T02:56:25.472864Z info FLAG: --domain="llm-d-pt8s89ylyl.svc.cluster.local" | |
| 2025-06-24T02:56:53.1766462Z 2025-06-24T02:56:25.472919Z info FLAG: --help="false" | |
| 2025-06-24T02:56:53.1766828Z 2025-06-24T02:56:25.472955Z info FLAG: --log_as_json="false" | |
| 2025-06-24T02:56:53.1767203Z 2025-06-24T02:56:25.472980Z info FLAG: --log_caller="" | |
| 2025-06-24T02:56:53.1767582Z 2025-06-24T02:56:25.473001Z info FLAG: --log_output_level="default:info" | |
| 2025-06-24T02:56:53.1768295Z 2025-06-24T02:56:25.473022Z info FLAG: --log_stacktrace_level="default:none" | |
| 2025-06-24T02:56:53.1768748Z 2025-06-24T02:56:25.473055Z info FLAG: --log_target="[stdout]" | |
| 2025-06-24T02:56:53.1769172Z 2025-06-24T02:56:25.473062Z info FLAG: --meshConfig="./etc/istio/config/mesh" | |
| 2025-06-24T02:56:53.1769583Z 2025-06-24T02:56:25.473069Z info FLAG: --outlierLogPath="" | |
| 2025-06-24T02:56:53.1769939Z 2025-06-24T02:56:25.473072Z info FLAG: --profiling="true" | |
| 2025-06-24T02:56:53.1770370Z 2025-06-24T02:56:25.473075Z info FLAG: --proxyComponentLogLevel="misc:error" | |
| 2025-06-24T02:56:53.1770815Z 2025-06-24T02:56:25.473078Z info FLAG: --proxyLogLevel="warning" | |
| 2025-06-24T02:56:53.1771259Z 2025-06-24T02:56:25.473086Z info FLAG: --serviceCluster="istio-proxy" | |
| 2025-06-24T02:56:53.1771684Z 2025-06-24T02:56:25.473089Z info FLAG: --stsPort="0" | |
| 2025-06-24T02:56:53.1772030Z 2025-06-24T02:56:25.473093Z info FLAG: --templateFile="" | |
| 2025-06-24T02:56:53.1773013Z 2025-06-24T02:56:25.473096Z info FLAG: --tokenManagerPlugin="" | |
| 2025-06-24T02:56:53.1773570Z 2025-06-24T02:56:25.473100Z info FLAG: --vklog="0" | |
| 2025-06-24T02:56:53.1774519Z 2025-06-24T02:56:25.473109Z info Version 1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d-9befed2f1439d883120f8de70fd70d84ca0ebc3d-Clean | |
| 2025-06-24T02:56:53.1775554Z 2025-06-24T02:56:25.473115Z info Set max file descriptors (ulimit -n) to: 1048576 | |
| 2025-06-24T02:56:53.1776854Z 2025-06-24T02:56:25.473492Z info Proxy role ips=[10.244.0.20] type=router id=llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz.llm-d-pt8s89ylyl domain=llm-d-pt8s89ylyl.svc.cluster.local | |
| 2025-06-24T02:56:53.1778085Z 2025-06-24T02:56:25.473557Z info Apply proxy config from env {} | |
| 2025-06-24T02:56:53.1778665Z | |
| 2025-06-24T02:56:53.1778942Z 2025-06-24T02:56:25.475421Z info cpu limit detected as 2, setting concurrency | |
| 2025-06-24T02:56:53.1779643Z 2025-06-24T02:56:25.475682Z info Effective config: binaryPath: /usr/local/bin/envoy | |
| 2025-06-24T02:56:53.1780199Z concurrency: 2 | |
| 2025-06-24T02:56:53.1780502Z configPath: ./etc/istio/proxy | |
| 2025-06-24T02:56:53.1780853Z controlPlaneAuthPolicy: MUTUAL_TLS | |
| 2025-06-24T02:56:53.1781283Z discoveryAddress: istiod.istio-system.svc:15012 | |
| 2025-06-24T02:56:53.1781692Z drainDuration: 45s | |
| 2025-06-24T02:56:53.1781981Z proxyAdminPort: 15000 | |
| 2025-06-24T02:56:53.1782281Z serviceCluster: istio-proxy | |
| 2025-06-24T02:56:53.1782765Z statNameLength: 189 | |
| 2025-06-24T02:56:53.1783041Z statusPort: 15020 | |
| 2025-06-24T02:56:53.1783337Z terminationDrainDuration: 5s | |
| 2025-06-24T02:56:53.1783556Z | |
| 2025-06-24T02:56:53.1783775Z 2025-06-24T02:56:25.475697Z info JWT policy is third-party-jwt | |
| 2025-06-24T02:56:53.1784475Z 2025-06-24T02:56:25.475702Z info using credential fetcher of JWT type in cluster.local trust domain | |
| 2025-06-24T02:56:53.1785172Z 2025-06-24T02:56:25.475867Z info platform detected is Azure | |
| 2025-06-24T02:56:53.1785664Z 2025-06-24T02:56:25.490747Z info Opening status port 15020 | |
| 2025-06-24T02:56:53.1786187Z 2025-06-24T02:56:25.490858Z info Starting default Istio SDS Server | |
| 2025-06-24T02:56:53.1786868Z 2025-06-24T02:56:25.491013Z info CA Endpoint istiod.istio-system.svc:15012, provider Citadel | |
| 2025-06-24T02:56:53.1787820Z 2025-06-24T02:56:25.491051Z info Using CA istiod.istio-system.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem | |
| 2025-06-24T02:56:53.1788973Z 2025-06-24T02:56:25.492443Z info xdsproxy Initializing with upstream address "istiod.istio-system.svc:15012" and cluster "Kubernetes" | |
| 2025-06-24T02:56:53.1789889Z 2025-06-24T02:56:25.494961Z info Pilot SAN: [istiod.istio-system.svc] | |
| 2025-06-24T02:56:53.1790463Z 2025-06-24T02:56:25.498986Z info sds Starting SDS grpc server | |
| 2025-06-24T02:56:53.1791346Z 2025-06-24T02:56:25.501190Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" | |
| 2025-06-24T02:56:53.1792258Z 2025-06-24T02:56:25.499583Z info Starting proxy agent | |
| 2025-06-24T02:56:53.1794814Z 2025-06-24T02:56:25.501368Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] | |
| 2025-06-24T02:56:53.1797940Z 2025-06-24T02:56:25.568285Z warning envoy main external/envoy/source/server/server.cc:874 Usage of the deprecated runtime key overload.global_downstream_max_connections, consider switching to `envoy.resource_monitors.global_downstream_max_connections` instead.This runtime key will be removed in future. thread=20 | |
| 2025-06-24T02:56:53.1800977Z 2025-06-24T02:56:25.568616Z warning envoy main external/envoy/source/server/server.cc:970 There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. thread=20 | |
| 2025-06-24T02:56:53.1803041Z 2025-06-24T02:56:25.574214Z info xdsproxy connected to delta upstream XDS server: istiod.istio-system.svc:15012 id=1 | |
| 2025-06-24T02:56:53.1803842Z 2025-06-24T02:56:25.593405Z info ads ADS: new connection for node:1 | |
| 2025-06-24T02:56:53.1804249Z 2025-06-24T02:56:25.594527Z info ads ADS: new connection for node:2 | |
| 2025-06-24T02:56:53.1805231Z 2025-06-24T02:56:25.611605Z info cache generated new workload certificate resourceName=default latency=117.993634ms ttl=23h59m59.388398856s | |
| 2025-06-24T02:56:53.1806213Z 2025-06-24T02:56:25.612018Z info cache Root cert has changed, start rotating root cert | |
| 2025-06-24T02:56:53.1806732Z 2025-06-24T02:56:25.612053Z info cache returned workload trust anchor from cache ttl=23h59m59.387948027s | |
| 2025-06-24T02:56:53.1807393Z 2025-06-24T02:56:25.612099Z info cache returned workload certificate from cache ttl=23h59m59.387903064s | |
| 2025-06-24T02:56:53.1808245Z 2025-06-24T02:56:25.612322Z info cache returned workload trust anchor from cache ttl=23h59m59.38767934s | |
| 2025-06-24T02:56:53.1808890Z 2025-06-24T02:56:25.612549Z info cache returned workload trust anchor from cache ttl=23h59m59.387452588s | |
| 2025-06-24T02:56:53.1809395Z 2025-06-24T02:56:26.270492Z info Readiness succeeded in 799.674187ms | |
| 2025-06-24T02:56:53.1809770Z 2025-06-24T02:56:26.270778Z info Envoy proxy is ready | |
| 2025-06-24T02:56:53.1810208Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:53.1810700Z <== Logs of container llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz | |
| 2025-06-24T02:56:53.1811301Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:53.1811932Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:53.1812764Z ==> Description of pod llm-d-pt8s89ylyl-modelservice-688cc5c6b9-fwqcm | |
| 2025-06-24T02:56:53.1813233Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:53.1813908Z >>> kubectl --request-timeout=30s describe pod llm-d-pt8s89ylyl-modelservice-688cc5c6b9-fwqcm --namespace llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:53.2348113Z Name: llm-d-pt8s89ylyl-modelservice-688cc5c6b9-fwqcm | |
| 2025-06-24T02:56:53.2348731Z Namespace: llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:53.2349108Z Priority: 0 | |
| 2025-06-24T02:56:53.2349580Z Service Account: llm-d-pt8s89ylyl-llm-d-pt8s89ylyl-modelservice | |
| 2025-06-24T02:56:53.2350176Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T02:56:53.2350654Z Start Time: Tue, 24 Jun 2025 02:56:24 +0000 | |
| 2025-06-24T02:56:53.2351135Z Labels: app.kubernetes.io/component=modelservice | |
| 2025-06-24T02:56:53.2351673Z app.kubernetes.io/instance=llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:53.2352170Z app.kubernetes.io/managed-by=Helm | |
| 2025-06-24T02:56:53.2352899Z app.kubernetes.io/name=llm-d | |
| 2025-06-24T02:56:53.2353355Z app.kubernetes.io/version=0.1 | |
| 2025-06-24T02:56:53.2353825Z control-plane=controller-manager | |
| 2025-06-24T02:56:53.2354278Z helm.sh/chart=llm-d-1.0.20 | |
| 2025-06-24T02:56:53.2355244Z pod-template-hash=688cc5c6b9 | |
| 2025-06-24T02:56:53.2355719Z Annotations: <none> | |
| 2025-06-24T02:56:53.2356030Z Status: Running | |
| 2025-06-24T02:56:53.2356315Z SeccompProfile: RuntimeDefault | |
| 2025-06-24T02:56:53.2356701Z IP: 10.244.0.19 | |
| 2025-06-24T02:56:53.2357040Z IPs: | |
| 2025-06-24T02:56:53.2357318Z IP: 10.244.0.19 | |
| 2025-06-24T02:56:53.2357832Z Controlled By: ReplicaSet/llm-d-pt8s89ylyl-modelservice-688cc5c6b9 | |
| 2025-06-24T02:56:53.2358401Z Containers: | |
| 2025-06-24T02:56:53.2358684Z manager: | |
| 2025-06-24T02:56:53.2359167Z Container ID: containerd://6c1ce958d45bed00ff315fa2118f8f1a0086e357b1faee2bb2be6376fb4dffde | |
| 2025-06-24T02:56:53.2359635Z Image: ghcr.io/llm-d/llm-d-model-service:0.0.10 | |
| 2025-06-24T02:56:53.2360160Z Image ID: ghcr.io/llm-d/llm-d-model-service@sha256:4d38789615184aa173eaf0c085ecd7f3dc0f3970af5e97ecb4b25fdfcf54b82e | |
| 2025-06-24T02:56:53.2360636Z Port: <none> | |
| 2025-06-24T02:56:53.2360832Z Host Port: <none> | |
| 2025-06-24T02:56:53.2361012Z Command: | |
| 2025-06-24T02:56:53.2361159Z /manager | |
| 2025-06-24T02:56:53.2361313Z Args: | |
| 2025-06-24T02:56:53.2361472Z --leader-elect=false | |
| 2025-06-24T02:56:53.2361693Z --health-probe-bind-address=:8081 | |
| 2025-06-24T02:56:53.2361933Z --epp-cluster-role | |
| 2025-06-24T02:56:53.2362183Z llm-d-pt8s89ylyl-modelservice-endpoint-picker | |
| 2025-06-24T02:56:53.2362722Z --epp-pull-secrets | |
| 2025-06-24T02:56:53.2362912Z | |
| 2025-06-24T02:56:53.2363068Z --pd-pull-secrets | |
| 2025-06-24T02:56:53.2363455Z | |
| 2025-06-24T02:56:53.2363605Z State: Running | |
| 2025-06-24T02:56:53.2363815Z Started: Tue, 24 Jun 2025 02:56:25 +0000 | |
| 2025-06-24T02:56:53.2364054Z Ready: True | |
| 2025-06-24T02:56:53.2364234Z Restart Count: 0 | |
| 2025-06-24T02:56:53.2364402Z Limits: | |
| 2025-06-24T02:56:53.2364549Z cpu: 250m | |
| 2025-06-24T02:56:53.2364715Z memory: 250Mi | |
| 2025-06-24T02:56:53.2364876Z Requests: | |
| 2025-06-24T02:56:53.2365041Z cpu: 100m | |
| 2025-06-24T02:56:53.2365211Z memory: 100Mi | |
| 2025-06-24T02:56:53.2365568Z Liveness: http-get http://:8081/healthz delay=15s timeout=1s period=20s #success=1 #failure=3 | |
| 2025-06-24T02:56:53.2366104Z Readiness: http-get http://:8081/readyz delay=5s timeout=1s period=10s #success=1 #failure=3 | |
| 2025-06-24T02:56:53.2366484Z Environment: <none> | |
| 2025-06-24T02:56:53.2366665Z Mounts: | |
| 2025-06-24T02:56:53.2366956Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-bkjkb (ro) | |
| 2025-06-24T02:56:53.2367316Z Conditions: | |
| 2025-06-24T02:56:53.2367474Z Type Status | |
| 2025-06-24T02:56:53.2367706Z PodReadyToStartContainers True | |
| 2025-06-24T02:56:53.2367937Z Initialized True | |
| 2025-06-24T02:56:53.2368146Z Ready True | |
| 2025-06-24T02:56:53.2368359Z ContainersReady True | |
| 2025-06-24T02:56:53.2368567Z PodScheduled True | |
| 2025-06-24T02:56:53.2368766Z Volumes: | |
| 2025-06-24T02:56:53.2368927Z kube-api-access-bkjkb: | |
| 2025-06-24T02:56:53.2369244Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T02:56:53.2369596Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T02:56:53.2369844Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T02:56:53.2370181Z ConfigMapOptional: <nil> | |
| 2025-06-24T02:56:53.2370557Z DownwardAPI: true | |
| 2025-06-24T02:56:53.2370934Z QoS Class: Burstable | |
| 2025-06-24T02:56:53.2371351Z Node-Selectors: <none> | |
| 2025-06-24T02:56:53.2371909Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T02:56:53.2372833Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T02:56:53.2373334Z Events: | |
| 2025-06-24T02:56:53.2373651Z Type Reason Age From Message | |
| 2025-06-24T02:56:53.2374323Z ---- ------ ---- ---- ------- | |
| 2025-06-24T02:56:53.2375460Z Normal Scheduled 29s default-scheduler Successfully assigned llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-modelservice-688cc5c6b9-fwqcm to chart-testing-control-plane | |
| 2025-06-24T02:56:53.2376650Z Normal Pulling 28s kubelet Pulling image "ghcr.io/llm-d/llm-d-model-service:0.0.10" | |
| 2025-06-24T02:56:53.2377386Z Normal Pulled 28s kubelet Successfully pulled image "ghcr.io/llm-d/llm-d-model-service:0.0.10" in 101ms (101ms including waiting). Image size: 115030935 bytes. | |
| 2025-06-24T02:56:53.2378035Z Normal Created 28s kubelet Created container manager | |
| 2025-06-24T02:56:53.2378405Z Normal Started 28s kubelet Started container manager | |
| 2025-06-24T02:56:53.2378788Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:53.2379176Z <== Description of pod llm-d-pt8s89ylyl-modelservice-688cc5c6b9-fwqcm | |
| 2025-06-24T02:56:53.2379560Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:53.2380305Z >>> kubectl --request-timeout=30s get pods llm-d-pt8s89ylyl-modelservice-688cc5c6b9-fwqcm --no-headers --namespace llm-d-pt8s89ylyl --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T02:56:53.2876532Z >>> kubectl --request-timeout=30s get pods llm-d-pt8s89ylyl-modelservice-688cc5c6b9-fwqcm --no-headers --namespace llm-d-pt8s89ylyl --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T02:56:53.3387174Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:53.3388112Z ==> Logs of container llm-d-pt8s89ylyl-modelservice-688cc5c6b9-fwqcm | |
| 2025-06-24T02:56:53.3388865Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:53.3390026Z >>> kubectl --request-timeout=30s logs llm-d-pt8s89ylyl-modelservice-688cc5c6b9-fwqcm --namespace llm-d-pt8s89ylyl --container manager | |
| 2025-06-24T02:56:53.3925539Z {"level":"info","ts":"2025-06-24T02:56:25.753823611Z","logger":"setup","caller":"cmd/root.go:272","msg":"starting manager"} | |
| 2025-06-24T02:56:53.3931268Z {"level":"info","ts":"2025-06-24T02:56:25.754172Z","caller":"manager/server.go:83","msg":"starting server","name":"health probe","addr":"[::]:8081"} | |
| 2025-06-24T02:56:53.3933176Z {"level":"info","ts":"2025-06-24T02:56:25.754387468Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1alpha1.ModelService"} | |
| 2025-06-24T02:56:53.3935478Z {"level":"info","ts":"2025-06-24T02:56:25.754429679Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1.Service"} | |
| 2025-06-24T02:56:53.3937676Z {"level":"info","ts":"2025-06-24T02:56:25.754427059Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1.Deployment"} | |
| 2025-06-24T02:56:53.3939947Z {"level":"info","ts":"2025-06-24T02:56:25.754445476Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1alpha2.InferenceModel"} | |
| 2025-06-24T02:56:53.3942242Z {"level":"info","ts":"2025-06-24T02:56:25.754430338Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1.ConfigMap"} | |
| 2025-06-24T02:56:53.3944873Z {"level":"info","ts":"2025-06-24T02:56:25.754404092Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1.RoleBinding"} | |
| 2025-06-24T02:56:53.3947106Z {"level":"info","ts":"2025-06-24T02:56:25.75456576Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1alpha1.ModelService"} | |
| 2025-06-24T02:56:53.3949522Z {"level":"info","ts":"2025-06-24T02:56:25.75454441Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1alpha2.InferencePool"} | |
| 2025-06-24T02:56:53.3951673Z {"level":"info","ts":"2025-06-24T02:56:25.754394431Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1.ServiceAccount"} | |
| 2025-06-24T02:56:53.3953922Z {"level":"info","ts":"2025-06-24T02:56:25.873597061Z","caller":"controller/controller.go:239","msg":"Starting Controller","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService"} | |
| 2025-06-24T02:56:53.3955797Z {"level":"info","ts":"2025-06-24T02:56:25.873640742Z","caller":"controller/controller.go:248","msg":"Starting workers","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","worker count":1} | |
| 2025-06-24T02:56:53.3956894Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:53.3957688Z <== Logs of container llm-d-pt8s89ylyl-modelservice-688cc5c6b9-fwqcm | |
| 2025-06-24T02:56:53.3958223Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:53.3958644Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:53.3959126Z ==> Description of pod llm-d-pt8s89ylyl-redis-master-66f9b5dfdf-56pqk | |
| 2025-06-24T02:56:53.3959515Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:53.3960161Z >>> kubectl --request-timeout=30s describe pod llm-d-pt8s89ylyl-redis-master-66f9b5dfdf-56pqk --namespace llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:53.4526106Z Name: llm-d-pt8s89ylyl-redis-master-66f9b5dfdf-56pqk | |
| 2025-06-24T02:56:53.4526675Z Namespace: llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:53.4527041Z Priority: 0 | |
| 2025-06-24T02:56:53.4527411Z Service Account: llm-d-pt8s89ylyl-redis-master | |
| 2025-06-24T02:56:53.4527933Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T02:56:53.4528403Z Start Time: Tue, 24 Jun 2025 02:55:35 +0000 | |
| 2025-06-24T02:56:53.4528863Z Labels: app.kubernetes.io/component=master | |
| 2025-06-24T02:56:53.4529359Z app.kubernetes.io/instance=llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:53.4529686Z app.kubernetes.io/managed-by=Helm | |
| 2025-06-24T02:56:53.4529959Z app.kubernetes.io/name=redis | |
| 2025-06-24T02:56:53.4530214Z app.kubernetes.io/version=7.4.3 | |
| 2025-06-24T02:56:53.4530459Z helm.sh/chart=redis-20.13.4 | |
| 2025-06-24T02:56:53.4530705Z pod-template-hash=66f9b5dfdf | |
| 2025-06-24T02:56:53.4531132Z Annotations: checksum/configmap: 2a9ab4a5432825504d910f022638674ce88eaefe9f9f595ad8bc107377d104fb | |
| 2025-06-24T02:56:53.4531698Z checksum/health: aff24913d801436ea469d8d374b2ddb3ec4c43ee7ab24663d5f8ff1a1b6991a9 | |
| 2025-06-24T02:56:53.4532229Z checksum/scripts: bdec350b84a1ace7cc118db113a21c9f160bde3425b07714e1c0c1da722621cf | |
| 2025-06-24T02:56:53.4532960Z checksum/secret: 44136fa355b3678a1146ad16f7e8649e94fb4fc21fe77e8310c060f61caaff8a | |
| 2025-06-24T02:56:53.4533324Z Status: Running | |
| 2025-06-24T02:56:53.4533540Z IP: 10.244.0.13 | |
| 2025-06-24T02:56:53.4533721Z IPs: | |
| 2025-06-24T02:56:53.4533874Z IP: 10.244.0.13 | |
| 2025-06-24T02:56:53.4534443Z Controlled By: ReplicaSet/llm-d-pt8s89ylyl-redis-master-66f9b5dfdf | |
| 2025-06-24T02:56:53.4534772Z Containers: | |
| 2025-06-24T02:56:53.4534920Z redis: | |
| 2025-06-24T02:56:53.4535277Z Container ID: containerd://64d3b31d9af18d11ff84b1a2339349ed72aec54db79871acfd8e1fd3a29cf400 | |
| 2025-06-24T02:56:53.4535714Z Image: quay.io/sclorg/redis-7-c9s:c9s | |
| 2025-06-24T02:56:53.4536173Z Image ID: quay.io/sclorg/redis-7-c9s@sha256:d772acab11507231a2b152850f47c8b9b859dedb6652ca624949e97cb28c5e6f | |
| 2025-06-24T02:56:53.4536612Z Port: 6379/TCP | |
| 2025-06-24T02:56:53.4536812Z Host Port: 0/TCP | |
| 2025-06-24T02:56:53.4537023Z SeccompProfile: RuntimeDefault | |
| 2025-06-24T02:56:53.4537234Z Command: | |
| 2025-06-24T02:56:53.4537387Z /bin/bash | |
| 2025-06-24T02:56:53.4537536Z Args: | |
| 2025-06-24T02:56:53.4537682Z -ec | |
| 2025-06-24T02:56:53.4537883Z /opt/bitnami/scripts/start-scripts/start-master.sh | |
| 2025-06-24T02:56:53.4538149Z State: Running | |
| 2025-06-24T02:56:53.4538365Z Started: Tue, 24 Jun 2025 02:55:40 +0000 | |
| 2025-06-24T02:56:53.4538596Z Ready: True | |
| 2025-06-24T02:56:53.4538777Z Restart Count: 0 | |
| 2025-06-24T02:56:53.4538941Z Limits: | |
| 2025-06-24T02:56:53.4539092Z cpu: 250m | |
| 2025-06-24T02:56:53.4539250Z memory: 256Mi | |
| 2025-06-24T02:56:53.4539417Z Requests: | |
| 2025-06-24T02:56:53.4539568Z cpu: 100m | |
| 2025-06-24T02:56:53.4539735Z memory: 128Mi | |
| 2025-06-24T02:56:53.4540286Z Liveness: exec [/bin/bash -ec /health/ping_liveness_local.sh 5] delay=20s timeout=6s period=5s #success=1 #failure=5 | |
| 2025-06-24T02:56:53.4541094Z Readiness: exec [/bin/bash -ec /health/ping_readiness_local.sh 1] delay=20s timeout=2s period=5s #success=1 #failure=5 | |
| 2025-06-24T02:56:53.4541524Z Environment: | |
| 2025-06-24T02:56:53.4541702Z BITNAMI_DEBUG: false | |
| 2025-06-24T02:56:53.4541935Z REDIS_REPLICATION_MODE: master | |
| 2025-06-24T02:56:53.4542161Z ALLOW_EMPTY_PASSWORD: yes | |
| 2025-06-24T02:56:53.4542569Z REDIS_TLS_ENABLED: no | |
| 2025-06-24T02:56:53.4542788Z REDIS_PORT: 6379 | |
| 2025-06-24T02:56:53.4542987Z Mounts: | |
| 2025-06-24T02:56:53.4543147Z /data from redis-data (rw) | |
| 2025-06-24T02:56:53.4543359Z /health from health (rw) | |
| 2025-06-24T02:56:53.4543669Z /opt/bitnami/redis/etc/ from empty-dir (rw,path="app-conf-dir") | |
| 2025-06-24T02:56:53.4544020Z /opt/bitnami/redis/mounted-etc from config (rw) | |
| 2025-06-24T02:56:53.4544345Z /opt/bitnami/scripts/start-scripts from start-scripts (rw) | |
| 2025-06-24T02:56:53.4544683Z /tmp from empty-dir (rw,path="tmp-dir") | |
| 2025-06-24T02:56:53.4544915Z Conditions: | |
| 2025-06-24T02:56:53.4545073Z Type Status | |
| 2025-06-24T02:56:53.4545302Z PodReadyToStartContainers True | |
| 2025-06-24T02:56:53.4545527Z Initialized True | |
| 2025-06-24T02:56:53.4545727Z Ready True | |
| 2025-06-24T02:56:53.4545936Z ContainersReady True | |
| 2025-06-24T02:56:53.4546149Z PodScheduled True | |
| 2025-06-24T02:56:53.4546346Z Volumes: | |
| 2025-06-24T02:56:53.4546493Z start-scripts: | |
| 2025-06-24T02:56:53.4546721Z Type: ConfigMap (a volume populated by a ConfigMap) | |
| 2025-06-24T02:56:53.4547012Z Name: llm-d-pt8s89ylyl-redis-scripts | |
| 2025-06-24T02:56:53.4547251Z Optional: false | |
| 2025-06-24T02:56:53.4547444Z health: | |
| 2025-06-24T02:56:53.4547797Z Type: ConfigMap (a volume populated by a ConfigMap) | |
| 2025-06-24T02:56:53.4548639Z Name: llm-d-pt8s89ylyl-redis-health | |
| 2025-06-24T02:56:53.4549087Z Optional: false | |
| 2025-06-24T02:56:53.4549402Z config: | |
| 2025-06-24T02:56:53.4549779Z Type: ConfigMap (a volume populated by a ConfigMap) | |
| 2025-06-24T02:56:53.4550340Z Name: llm-d-pt8s89ylyl-redis-configuration | |
| 2025-06-24T02:56:53.4550767Z Optional: false | |
| 2025-06-24T02:56:53.4551050Z empty-dir: | |
| 2025-06-24T02:56:53.4551464Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T02:56:53.4552037Z Medium: | |
| 2025-06-24T02:56:53.4552325Z SizeLimit: <unset> | |
| 2025-06-24T02:56:53.4552773Z redis-data: | |
| 2025-06-24T02:56:53.4553041Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T02:56:53.4553346Z Medium: | |
| 2025-06-24T02:56:53.4553609Z SizeLimit: <unset> | |
| 2025-06-24T02:56:53.4553799Z QoS Class: Burstable | |
| 2025-06-24T02:56:53.4553994Z Node-Selectors: <none> | |
| 2025-06-24T02:56:53.4554416Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T02:56:53.4554964Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T02:56:53.4555253Z Events: | |
| 2025-06-24T02:56:53.4555434Z Type Reason Age From Message | |
| 2025-06-24T02:56:53.4555712Z ---- ------ ---- ---- ------- | |
| 2025-06-24T02:56:53.4556364Z Normal Scheduled 78s default-scheduler Successfully assigned llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-redis-master-66f9b5dfdf-56pqk to chart-testing-control-plane | |
| 2025-06-24T02:56:53.4557153Z Normal Pulling 77s kubelet Pulling image "quay.io/sclorg/redis-7-c9s:c9s" | |
| 2025-06-24T02:56:53.4557817Z Normal Pulled 74s kubelet Successfully pulled image "quay.io/sclorg/redis-7-c9s:c9s" in 3.673s (3.673s including waiting). Image size: 97229638 bytes. | |
| 2025-06-24T02:56:53.4558427Z Normal Created 74s kubelet Created container redis | |
| 2025-06-24T02:56:53.4558793Z Normal Started 73s kubelet Started container redis | |
| 2025-06-24T02:56:53.4559731Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:53.4560138Z <== Description of pod llm-d-pt8s89ylyl-redis-master-66f9b5dfdf-56pqk | |
| 2025-06-24T02:56:53.4560517Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:53.4561264Z >>> kubectl --request-timeout=30s get pods llm-d-pt8s89ylyl-redis-master-66f9b5dfdf-56pqk --no-headers --namespace llm-d-pt8s89ylyl --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T02:56:53.5047373Z >>> kubectl --request-timeout=30s get pods llm-d-pt8s89ylyl-redis-master-66f9b5dfdf-56pqk --no-headers --namespace llm-d-pt8s89ylyl --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T02:56:53.5549728Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:53.5551106Z ==> Logs of container llm-d-pt8s89ylyl-redis-master-66f9b5dfdf-56pqk | |
| 2025-06-24T02:56:53.5552328Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:53.5553619Z >>> kubectl --request-timeout=30s logs llm-d-pt8s89ylyl-redis-master-66f9b5dfdf-56pqk --namespace llm-d-pt8s89ylyl --container redis | |
| 2025-06-24T02:56:53.6111914Z 1:C 24 Jun 2025 02:55:40.034 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo | |
| 2025-06-24T02:56:53.6113007Z 1:C 24 Jun 2025 02:55:40.034 # Redis version=7.0.12, bits=64, commit=00000000, modified=0, pid=1, just started | |
| 2025-06-24T02:56:53.6113696Z 1:C 24 Jun 2025 02:55:40.034 # Configuration loaded | |
| 2025-06-24T02:56:53.6114209Z 1:M 24 Jun 2025 02:55:40.034 * monotonic clock: POSIX clock_gettime | |
| 2025-06-24T02:56:53.6114769Z 1:M 24 Jun 2025 02:55:40.035 * Running mode=standalone, port=6379. | |
| 2025-06-24T02:56:53.6115153Z 1:M 24 Jun 2025 02:55:40.035 # Server initialized | |
| 2025-06-24T02:56:53.6115544Z 1:M 24 Jun 2025 02:55:40.036 * Creating AOF base file appendonly.aof.1.base.rdb on server start | |
| 2025-06-24T02:56:53.6116029Z 1:M 24 Jun 2025 02:55:40.037 * Creating AOF incr file appendonly.aof.1.incr.aof on server start | |
| 2025-06-24T02:56:53.6116413Z 1:M 24 Jun 2025 02:55:40.037 * Ready to accept connections | |
| 2025-06-24T02:56:53.6130672Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:53.6131782Z <== Logs of container llm-d-pt8s89ylyl-redis-master-66f9b5dfdf-56pqk | |
| 2025-06-24T02:56:53.6132732Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:53.6133432Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:53.6133934Z ==> Description of pod llm-d-pt8s89ylyl-test-connection | |
| 2025-06-24T02:56:53.6134472Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:53.6135367Z >>> kubectl --request-timeout=30s describe pod llm-d-pt8s89ylyl-test-connection --namespace llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:53.6699778Z Name: llm-d-pt8s89ylyl-test-connection | |
| 2025-06-24T02:56:53.6700322Z Namespace: llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:53.6700686Z Priority: 0 | |
| 2025-06-24T02:56:53.6700972Z Service Account: default | |
| 2025-06-24T02:56:53.6701382Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T02:56:53.6701849Z Start Time: Tue, 24 Jun 2025 02:56:38 +0000 | |
| 2025-06-24T02:56:53.6702228Z Labels: <none> | |
| 2025-06-24T02:56:53.6702787Z Annotations: helm.sh/hook: test | |
| 2025-06-24T02:56:53.6703161Z helm.sh/hook-weight: 1 | |
| 2025-06-24T02:56:53.6703531Z Status: Succeeded | |
| 2025-06-24T02:56:53.6703864Z SeccompProfile: RuntimeDefault | |
| 2025-06-24T02:56:53.6704220Z IP: 10.244.0.23 | |
| 2025-06-24T02:56:53.6704517Z IPs: | |
| 2025-06-24T02:56:53.6704760Z IP: 10.244.0.23 | |
| 2025-06-24T02:56:53.6705323Z Containers: | |
| 2025-06-24T02:56:53.6705574Z curl: | |
| 2025-06-24T02:56:53.6706162Z Container ID: containerd://4bbf465a73138216fbc82571c1c61c19a7dea35bf6184ad5a4461b28a97f5128 | |
| 2025-06-24T02:56:53.6706839Z Image: quay.io/curl/curl:latest | |
| 2025-06-24T02:56:53.6707506Z Image ID: quay.io/curl/curl@sha256:f95026f35f8e40ca1c11738a1c5710baadf4b8cafabab9738dadbf9fb99084a9 | |
| 2025-06-24T02:56:53.6708161Z Port: <none> | |
| 2025-06-24T02:56:53.6708473Z Host Port: <none> | |
| 2025-06-24T02:56:53.6708758Z Command: | |
| 2025-06-24T02:56:53.6709000Z /bin/sh | |
| 2025-06-24T02:56:53.6709235Z -c | |
| 2025-06-24T02:56:53.6709469Z Args: | |
| 2025-06-24T02:56:53.6710090Z echo -e "\e[32m🥷 Waiting for pods to come up\e[0m" | |
| 2025-06-24T02:56:53.6710490Z echo "" | |
| 2025-06-24T02:56:53.6711334Z curl --connect-timeout 5 --max-time 20 --retry 20 --retry-delay 10 --retry-max-time 60 --retry-all-errors http://llm-d-pt8s89ylyl-inference-gateway-istio/v1/models | |
| 2025-06-24T02:56:53.6712256Z | |
| 2025-06-24T02:56:53.6712630Z echo "" | |
| 2025-06-24T02:56:53.6712868Z echo "" | |
| 2025-06-24T02:56:53.6713273Z echo -e "\e[32m🥷 Basic chat validation\e[0m" | |
| 2025-06-24T02:56:53.6713649Z echo "" | |
| 2025-06-24T02:56:53.6714561Z curl --connect-timeout 5 --max-time 20 --retry 20 --retry-delay 10 --retry-max-time 60 --retry-all-errors http://llm-d-pt8s89ylyl-inference-gateway-istio/v1/chat/completions \ | |
| 2025-06-24T02:56:53.6715633Z -H 'accept: application/json' \ | |
| 2025-06-24T02:56:53.6716031Z -H 'Content-Type: application/json' \ | |
| 2025-06-24T02:56:53.6716623Z -d '{"model":"food-review","messages":[{"content":"Say hi","role":"user"}],"stream":false}' | |
| 2025-06-24T02:56:53.6717168Z | |
| 2025-06-24T02:56:53.6717423Z State: Terminated | |
| 2025-06-24T02:56:53.6717750Z Reason: Completed | |
| 2025-06-24T02:56:53.6718093Z Exit Code: 0 | |
| 2025-06-24T02:56:53.6718430Z Started: Tue, 24 Jun 2025 02:56:48 +0000 | |
| 2025-06-24T02:56:53.6718866Z Finished: Tue, 24 Jun 2025 02:56:51 +0000 | |
| 2025-06-24T02:56:53.6719255Z Ready: False | |
| 2025-06-24T02:56:53.6719542Z Restart Count: 0 | |
| 2025-06-24T02:56:53.6719790Z Limits: | |
| 2025-06-24T02:56:53.6720008Z cpu: 10m | |
| 2025-06-24T02:56:53.6720261Z memory: 20Mi | |
| 2025-06-24T02:56:53.6720506Z Requests: | |
| 2025-06-24T02:56:53.6720740Z cpu: 10m | |
| 2025-06-24T02:56:53.6720995Z memory: 20Mi | |
| 2025-06-24T02:56:53.6721677Z Liveness: exec [ls /usr/bin/curl] delay=0s timeout=1s period=10s #success=1 #failure=3 | |
| 2025-06-24T02:56:53.6722289Z Environment: <none> | |
| 2025-06-24T02:56:53.6722734Z Mounts: | |
| 2025-06-24T02:56:53.6723232Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-cv2pv (ro) | |
| 2025-06-24T02:56:53.6723809Z Conditions: | |
| 2025-06-24T02:56:53.6724074Z Type Status | |
| 2025-06-24T02:56:53.6724442Z PodReadyToStartContainers False | |
| 2025-06-24T02:56:53.6724833Z Initialized True | |
| 2025-06-24T02:56:53.6725196Z Ready False | |
| 2025-06-24T02:56:53.6725551Z ContainersReady False | |
| 2025-06-24T02:56:53.6725928Z PodScheduled True | |
| 2025-06-24T02:56:53.6726290Z Volumes: | |
| 2025-06-24T02:56:53.6726527Z kube-api-access-cv2pv: | |
| 2025-06-24T02:56:53.6726980Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T02:56:53.6727624Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T02:56:53.6728083Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T02:56:53.6728542Z ConfigMapOptional: <nil> | |
| 2025-06-24T02:56:53.6728945Z DownwardAPI: true | |
| 2025-06-24T02:56:53.6729316Z QoS Class: Guaranteed | |
| 2025-06-24T02:56:53.6730200Z Node-Selectors: <none> | |
| 2025-06-24T02:56:53.6730779Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T02:56:53.6731290Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T02:56:53.6731986Z Events: | |
| 2025-06-24T02:56:53.6732304Z Type Reason Age From Message | |
| 2025-06-24T02:56:53.6732930Z ---- ------ ---- ---- ------- | |
| 2025-06-24T02:56:53.6733696Z Normal Scheduled 15s default-scheduler Successfully assigned llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-test-connection to chart-testing-control-plane | |
| 2025-06-24T02:56:53.6734691Z Normal Pulled 11s kubelet Container image "quay.io/curl/curl:latest" already present on machine | |
| 2025-06-24T02:56:53.6735246Z Normal Created 11s kubelet Created container curl | |
| 2025-06-24T02:56:53.6735747Z Normal Started 5s kubelet Started container curl | |
| 2025-06-24T02:56:53.6736291Z Warning Unhealthy 2s kubelet Liveness probe failed: | |
| 2025-06-24T02:56:53.6736671Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:53.6737161Z <== Description of pod llm-d-pt8s89ylyl-test-connection | |
| 2025-06-24T02:56:53.6737501Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:53.6738361Z >>> kubectl --request-timeout=30s get pods llm-d-pt8s89ylyl-test-connection --no-headers --namespace llm-d-pt8s89ylyl --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T02:56:53.7285125Z >>> kubectl --request-timeout=30s get pods llm-d-pt8s89ylyl-test-connection --no-headers --namespace llm-d-pt8s89ylyl --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T02:56:53.7773972Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:53.7774734Z ==> Logs of container llm-d-pt8s89ylyl-test-connection | |
| 2025-06-24T02:56:53.7775407Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:53.7776264Z >>> kubectl --request-timeout=30s logs llm-d-pt8s89ylyl-test-connection --namespace llm-d-pt8s89ylyl --container curl | |
| 2025-06-24T02:56:53.8302711Z [32m🥷 Waiting for pods to come up[0m | |
| 2025-06-24T02:56:53.8303076Z | |
| 2025-06-24T02:56:53.8303354Z % Total % Received % Xferd Average Speed Time Time Time Current | |
| 2025-06-24T02:56:53.8303936Z Dload Upload Total Spent Left Speed | |
| 2025-06-24T02:56:53.8304249Z | |
| 2025-06-24T02:56:53.8304795Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 | |
| 2025-06-24T02:56:53.8305279Z 100 237 100 237 0 0 593 0 --:--:-- --:--:-- --:--:-- 790 | |
| 2025-06-24T02:56:53.8306517Z {"object":"list","data":[{"id":"food-review","object":"model","created":1750733809,"owned_by":"vllm","root":"food-review","parent":null},{"id":"","object":"model","created":1750733809,"owned_by":"vllm","root":"","parent":"food-review"}]} | |
| 2025-06-24T02:56:53.8307565Z | |
| 2025-06-24T02:56:53.8307791Z [32m🥷 Basic chat validation[0m | |
| 2025-06-24T02:56:53.8309338Z | |
| 2025-06-24T02:56:53.8309622Z % Total % Received % Xferd Average Speed Time Time Time Current | |
| 2025-06-24T02:56:53.8310189Z Dload Upload Total Spent Left Speed | |
| 2025-06-24T02:56:53.8310490Z | |
| 2025-06-24T02:56:53.8310649Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 | |
| 2025-06-24T02:56:53.8311139Z 100 297 100 211 100 86 528 215 --:--:-- --:--:-- --:--:-- 1485 | |
| 2025-06-24T02:56:53.8325972Z {"id":"chatcmpl-14c91f42-4ebe-49f9-9161-4207edd747aa","created":1750733810,"model":"food-review","choices":[{"index":0,"finish_reason":"stop","message":{"role":"assistant","content":"Testing, testing 1,2,3."}}]} | |
| 2025-06-24T02:56:53.8328421Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:53.8329263Z <== Logs of container llm-d-pt8s89ylyl-test-connection | |
| 2025-06-24T02:56:53.8329782Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:53.8331069Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:53.8331615Z ==> Description of pod llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t | |
| 2025-06-24T02:56:53.8332104Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:53.8332997Z >>> kubectl --request-timeout=30s describe pod llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t --namespace llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:53.8871733Z Name: llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t | |
| 2025-06-24T02:56:53.8872539Z Namespace: llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:53.8872971Z Priority: 0 | |
| 2025-06-24T02:56:53.8873412Z Service Account: llm-d-pt8s89ylyl-vllm-sim-sa | |
| 2025-06-24T02:56:53.8873833Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T02:56:53.8874185Z Start Time: Tue, 24 Jun 2025 02:56:03 +0000 | |
| 2025-06-24T02:56:53.8874489Z Labels: llm-d.ai/inferenceServing=true | |
| 2025-06-24T02:56:53.8874808Z llm-d.ai/model=food-review | |
| 2025-06-24T02:56:53.8875067Z llm-d.ai/role=decode | |
| 2025-06-24T02:56:53.8875331Z pod-template-hash=5c5f96db4c | |
| 2025-06-24T02:56:53.8875586Z Annotations: <none> | |
| 2025-06-24T02:56:53.8883298Z Status: Terminating (lasts <invalid>) | |
| 2025-06-24T02:56:53.8883628Z Termination Grace Period: 30s | |
| 2025-06-24T02:56:53.8883887Z IP: 10.244.0.17 | |
| 2025-06-24T02:56:53.8884100Z IPs: | |
| 2025-06-24T02:56:53.8884251Z IP: 10.244.0.17 | |
| 2025-06-24T02:56:53.8884562Z Controlled By: ReplicaSet/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c | |
| 2025-06-24T02:56:53.8884896Z Init Containers: | |
| 2025-06-24T02:56:53.8885070Z routing-proxy: | |
| 2025-06-24T02:56:53.8885573Z Container ID: containerd://6f9fa4ec931f8c2dd30fb0ec17fa45ebddb21936caf7816899afdf9b660b476f | |
| 2025-06-24T02:56:53.8886170Z Image: ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6 | |
| 2025-06-24T02:56:53.8886706Z Image ID: ghcr.io/llm-d/llm-d-routing-sidecar@sha256:7f3db0d03f3b3b16ec2a0e8d0d855bb7db83ef8d670dd9027f194e772a87856b | |
| 2025-06-24T02:56:53.8887173Z Port: 8000/TCP | |
| 2025-06-24T02:56:53.8887649Z Host Port: 0/TCP | |
| 2025-06-24T02:56:53.8887840Z Args: | |
| 2025-06-24T02:56:53.8887999Z --port=8000 | |
| 2025-06-24T02:56:53.8888172Z --vllm-port=8001 | |
| 2025-06-24T02:56:53.8888359Z State: Running | |
| 2025-06-24T02:56:53.8888568Z Started: Tue, 24 Jun 2025 02:56:11 +0000 | |
| 2025-06-24T02:56:53.8888807Z Ready: True | |
| 2025-06-24T02:56:53.8888987Z Restart Count: 0 | |
| 2025-06-24T02:56:53.8889168Z Environment: <none> | |
| 2025-06-24T02:56:53.8889354Z Mounts: | |
| 2025-06-24T02:56:53.8889643Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-55dzn (ro) | |
| 2025-06-24T02:56:53.8890005Z Containers: | |
| 2025-06-24T02:56:53.8890151Z vllm: | |
| 2025-06-24T02:56:53.8890494Z Container ID: containerd://56b39bab7112b57596d02a69b60438933cd382beb0d3e31bdd125f93fe1087fc | |
| 2025-06-24T02:56:53.8890943Z Image: ghcr.io/llm-d/llm-d-inference-sim:0.0.4 | |
| 2025-06-24T02:56:53.8891439Z Image ID: ghcr.io/llm-d/llm-d-inference-sim@sha256:5995c4dde42888844812359c121899c1d12e647588ed58fef206c3c653315338 | |
| 2025-06-24T02:56:53.8891882Z Port: 5557/TCP | |
| 2025-06-24T02:56:53.8892070Z Host Port: 0/TCP | |
| 2025-06-24T02:56:53.8892249Z Args: | |
| 2025-06-24T02:56:53.8892581Z --model | |
| 2025-06-24T02:56:53.8892749Z food-review | |
| 2025-06-24T02:56:53.8892906Z --port | |
| 2025-06-24T02:56:53.8893059Z 8001 | |
| 2025-06-24T02:56:53.8893209Z State: Running | |
| 2025-06-24T02:56:53.8893426Z Started: Tue, 24 Jun 2025 02:56:12 +0000 | |
| 2025-06-24T02:56:53.8893659Z Ready: True | |
| 2025-06-24T02:56:53.8894253Z Restart Count: 0 | |
| 2025-06-24T02:56:53.8894565Z Environment: | |
| 2025-06-24T02:56:53.8894844Z HOME: /home | |
| 2025-06-24T02:56:53.8895144Z Mounts: | |
| 2025-06-24T02:56:53.8895414Z /home from home (rw) | |
| 2025-06-24T02:56:53.8895995Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-55dzn (ro) | |
| 2025-06-24T02:56:53.8896594Z Conditions: | |
| 2025-06-24T02:56:53.8896860Z Type Status | |
| 2025-06-24T02:56:53.8897244Z PodReadyToStartContainers True | |
| 2025-06-24T02:56:53.8897647Z Initialized True | |
| 2025-06-24T02:56:53.8898011Z Ready True | |
| 2025-06-24T02:56:53.8898559Z ContainersReady True | |
| 2025-06-24T02:56:53.8898937Z PodScheduled True | |
| 2025-06-24T02:56:53.8899168Z Volumes: | |
| 2025-06-24T02:56:53.8899321Z home: | |
| 2025-06-24T02:56:53.8899578Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T02:56:53.8900093Z Medium: | |
| 2025-06-24T02:56:53.8900401Z SizeLimit: <unset> | |
| 2025-06-24T02:56:53.8900744Z kube-api-access-55dzn: | |
| 2025-06-24T02:56:53.8901124Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T02:56:53.8901533Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T02:56:53.8901852Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T02:56:53.8902104Z ConfigMapOptional: <nil> | |
| 2025-06-24T02:56:53.8902504Z DownwardAPI: true | |
| 2025-06-24T02:56:53.8902835Z QoS Class: BestEffort | |
| 2025-06-24T02:56:53.8903063Z Node-Selectors: <none> | |
| 2025-06-24T02:56:53.8903490Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T02:56:53.8903907Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T02:56:53.8904299Z Events: | |
| 2025-06-24T02:56:53.8904489Z Type Reason Age From Message | |
| 2025-06-24T02:56:53.8904754Z ---- ------ ---- ---- ------- | |
| 2025-06-24T02:56:53.8905538Z Normal Scheduled 50s default-scheduler Successfully assigned llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t to chart-testing-control-plane | |
| 2025-06-24T02:56:53.8906467Z Normal Pulling 49s kubelet Pulling image "ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6" | |
| 2025-06-24T02:56:53.8907814Z Normal Pulled 43s kubelet Successfully pulled image "ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6" in 3.074s (6.31s including waiting). Image size: 85265962 bytes. | |
| 2025-06-24T02:56:53.8908630Z Normal Created 42s kubelet Created container routing-proxy | |
| 2025-06-24T02:56:53.8909073Z Normal Started 42s kubelet Started container routing-proxy | |
| 2025-06-24T02:56:53.8909605Z Normal Pulling 42s kubelet Pulling image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" | |
| 2025-06-24T02:56:53.8910593Z Normal Pulled 41s kubelet Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" in 124ms (1.229s including waiting). Image size: 87011014 bytes. | |
| 2025-06-24T02:56:53.8911341Z Normal Created 41s kubelet Created container vllm | |
| 2025-06-24T02:56:53.8911793Z Normal Started 41s kubelet Started container vllm | |
| 2025-06-24T02:56:53.8912163Z Normal Killing 15s kubelet Stopping container routing-proxy | |
| 2025-06-24T02:56:53.8912852Z Normal Killing 15s kubelet Stopping container vllm | |
| 2025-06-24T02:56:53.8913377Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:53.8913783Z <== Description of pod llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t | |
| 2025-06-24T02:56:53.8914299Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:53.8915170Z >>> kubectl --request-timeout=30s get pods llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t --no-headers --namespace llm-d-pt8s89ylyl --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T02:56:53.9396961Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:53.9397823Z ==> Logs of init container llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t | |
| 2025-06-24T02:56:53.9398611Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:53.9399428Z >>> kubectl --request-timeout=30s logs llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t --namespace llm-d-pt8s89ylyl --container routing-proxy | |
| 2025-06-24T02:56:53.9896379Z I0624 02:56:11.118601 1 cmd.go:51] "p/d connector validated" connector="nixl" | |
| 2025-06-24T02:56:53.9897884Z I0624 02:56:11.119214 1 proxy.go:115] "starting" logger="proxy server" addr="[::]:8000" | |
| 2025-06-24T02:56:53.9918820Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:53.9919691Z <== Logs of init container llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t | |
| 2025-06-24T02:56:53.9920454Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:53.9921584Z >>> kubectl --request-timeout=30s get pods llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t --no-headers --namespace llm-d-pt8s89ylyl --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T02:56:54.0414560Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:54.0415390Z ==> Logs of container llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t | |
| 2025-06-24T02:56:54.0416144Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:54.0417228Z >>> kubectl --request-timeout=30s logs llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t --namespace llm-d-pt8s89ylyl --container vllm | |
| 2025-06-24T02:56:54.0932516Z I0624 02:56:12.768781 1 cmd.go:36] "Start vllm simulator" | |
| 2025-06-24T02:56:54.0933035Z I0624 02:56:12.768933 1 simulator.go:135] "Server starting" port=8001 | |
| 2025-06-24T02:56:54.0933458Z I0624 02:56:20.440620 1 simulator.go:195] "chat completion request received" | |
| 2025-06-24T02:56:54.0933887Z I0624 02:56:38.613673 1 simulator.go:294] "reqProcessingWorker stopped:" worker id=1 | |
| 2025-06-24T02:56:54.0934577Z I0624 02:56:38.613746 1 simulator.go:294] "reqProcessingWorker stopped:" worker id=5 | |
| 2025-06-24T02:56:54.0935021Z I0624 02:56:38.613760 1 simulator.go:294] "reqProcessingWorker stopped:" worker id=2 | |
| 2025-06-24T02:56:54.0935445Z I0624 02:56:38.613773 1 simulator.go:294] "reqProcessingWorker stopped:" worker id=4 | |
| 2025-06-24T02:56:54.0935873Z I0624 02:56:38.613793 1 simulator.go:294] "reqProcessingWorker stopped:" worker id=3 | |
| 2025-06-24T02:56:54.0952861Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:54.0953710Z <== Logs of container llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-2m45t | |
| 2025-06-24T02:56:54.0954487Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:54.0955180Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:54.0955871Z ==> Description of pod llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq | |
| 2025-06-24T02:56:54.0956537Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:54.0957504Z >>> kubectl --request-timeout=30s describe pod llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq --namespace llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:54.1524983Z Name: llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq | |
| 2025-06-24T02:56:54.1526118Z Namespace: llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:54.1526919Z Priority: 0 | |
| 2025-06-24T02:56:54.1527271Z Service Account: llm-d-pt8s89ylyl-vllm-sim-sa | |
| 2025-06-24T02:56:54.1527732Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T02:56:54.1528185Z Start Time: Tue, 24 Jun 2025 02:56:38 +0000 | |
| 2025-06-24T02:56:54.1528620Z Labels: llm-d.ai/inferenceServing=true | |
| 2025-06-24T02:56:54.1529036Z llm-d.ai/model=food-review | |
| 2025-06-24T02:56:54.1529425Z llm-d.ai/role=decode | |
| 2025-06-24T02:56:54.1529805Z pod-template-hash=5c5f96db4c | |
| 2025-06-24T02:56:54.1530195Z Annotations: <none> | |
| 2025-06-24T02:56:54.1530495Z Status: Running | |
| 2025-06-24T02:56:54.1530796Z IP: 10.244.0.24 | |
| 2025-06-24T02:56:54.1531085Z IPs: | |
| 2025-06-24T02:56:54.1531324Z IP: 10.244.0.24 | |
| 2025-06-24T02:56:54.1531809Z Controlled By: ReplicaSet/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c | |
| 2025-06-24T02:56:54.1532326Z Init Containers: | |
| 2025-06-24T02:56:54.1532877Z routing-proxy: | |
| 2025-06-24T02:56:54.1533454Z Container ID: containerd://ac841e51c6545af8b26333bb971292cadd2b1ac294faebce7349412a8522d1d1 | |
| 2025-06-24T02:56:54.1534192Z Image: ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6 | |
| 2025-06-24T02:56:54.1535010Z Image ID: ghcr.io/llm-d/llm-d-routing-sidecar@sha256:7f3db0d03f3b3b16ec2a0e8d0d855bb7db83ef8d670dd9027f194e772a87856b | |
| 2025-06-24T02:56:54.1535774Z Port: 8000/TCP | |
| 2025-06-24T02:56:54.1536084Z Host Port: 0/TCP | |
| 2025-06-24T02:56:54.1536358Z Args: | |
| 2025-06-24T02:56:54.1536595Z --port=8000 | |
| 2025-06-24T02:56:54.1536864Z --vllm-port=8001 | |
| 2025-06-24T02:56:54.1537149Z State: Running | |
| 2025-06-24T02:56:54.1537574Z Started: Tue, 24 Jun 2025 02:56:39 +0000 | |
| 2025-06-24T02:56:54.1537945Z Ready: True | |
| 2025-06-24T02:56:54.1538224Z Restart Count: 0 | |
| 2025-06-24T02:56:54.1538508Z Environment: <none> | |
| 2025-06-24T02:56:54.1538794Z Mounts: | |
| 2025-06-24T02:56:54.1539258Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-qkhd4 (ro) | |
| 2025-06-24T02:56:54.1539822Z Containers: | |
| 2025-06-24T02:56:54.1540052Z vllm: | |
| 2025-06-24T02:56:54.1540579Z Container ID: containerd://08d9925b9396541f165206e2873ca026ce334f34246513eafdd548881ef25b2d | |
| 2025-06-24T02:56:54.1541269Z Image: ghcr.io/llm-d/llm-d-inference-sim:0.0.4 | |
| 2025-06-24T02:56:54.1542247Z Image ID: ghcr.io/llm-d/llm-d-inference-sim@sha256:5995c4dde42888844812359c121899c1d12e647588ed58fef206c3c653315338 | |
| 2025-06-24T02:56:54.1543146Z Port: 5557/TCP | |
| 2025-06-24T02:56:54.1543456Z Host Port: 0/TCP | |
| 2025-06-24T02:56:54.1543733Z Args: | |
| 2025-06-24T02:56:54.1543964Z --model | |
| 2025-06-24T02:56:54.1544212Z food-review | |
| 2025-06-24T02:56:54.1544463Z --port | |
| 2025-06-24T02:56:54.1544711Z 8001 | |
| 2025-06-24T02:56:54.1544961Z State: Running | |
| 2025-06-24T02:56:54.1545302Z Started: Tue, 24 Jun 2025 02:56:39 +0000 | |
| 2025-06-24T02:56:54.1545675Z Ready: True | |
| 2025-06-24T02:56:54.1545971Z Restart Count: 0 | |
| 2025-06-24T02:56:54.1546231Z Environment: | |
| 2025-06-24T02:56:54.1546470Z HOME: /home | |
| 2025-06-24T02:56:54.1546697Z Mounts: | |
| 2025-06-24T02:56:54.1546933Z /home from home (rw) | |
| 2025-06-24T02:56:54.1547419Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-qkhd4 (ro) | |
| 2025-06-24T02:56:54.1547932Z Conditions: | |
| 2025-06-24T02:56:54.1548172Z Type Status | |
| 2025-06-24T02:56:54.1548517Z PodReadyToStartContainers True | |
| 2025-06-24T02:56:54.1548886Z Initialized True | |
| 2025-06-24T02:56:54.1549229Z Ready True | |
| 2025-06-24T02:56:54.1549579Z ContainersReady True | |
| 2025-06-24T02:56:54.1549932Z PodScheduled True | |
| 2025-06-24T02:56:54.1550264Z Volumes: | |
| 2025-06-24T02:56:54.1550490Z home: | |
| 2025-06-24T02:56:54.1550862Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T02:56:54.1551361Z Medium: | |
| 2025-06-24T02:56:54.1551832Z SizeLimit: <unset> | |
| 2025-06-24T02:56:54.1552155Z kube-api-access-qkhd4: | |
| 2025-06-24T02:56:54.1552836Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T02:56:54.1553459Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T02:56:54.1553860Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T02:56:54.1554303Z ConfigMapOptional: <nil> | |
| 2025-06-24T02:56:54.1554701Z DownwardAPI: true | |
| 2025-06-24T02:56:54.1555053Z QoS Class: BestEffort | |
| 2025-06-24T02:56:54.1555644Z Node-Selectors: <none> | |
| 2025-06-24T02:56:54.1556192Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T02:56:54.1556900Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T02:56:54.1557408Z Events: | |
| 2025-06-24T02:56:54.1557717Z Type Reason Age From Message | |
| 2025-06-24T02:56:54.1558168Z ---- ------ ---- ---- ------- | |
| 2025-06-24T02:56:54.1559115Z Normal Scheduled 16s default-scheduler Successfully assigned llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq to chart-testing-control-plane | |
| 2025-06-24T02:56:54.1560510Z Normal Pulled 15s kubelet Container image "ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6" already present on machine | |
| 2025-06-24T02:56:54.1561375Z Normal Created 15s kubelet Created container routing-proxy | |
| 2025-06-24T02:56:54.1561792Z Normal Started 15s kubelet Started container routing-proxy | |
| 2025-06-24T02:56:54.1562723Z Normal Pulled 15s kubelet Container image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" already present on machine | |
| 2025-06-24T02:56:54.1563260Z Normal Created 15s kubelet Created container vllm | |
| 2025-06-24T02:56:54.1563756Z Normal Started 15s kubelet Started container vllm | |
| 2025-06-24T02:56:54.1564123Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:54.1564674Z <== Description of pod llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq | |
| 2025-06-24T02:56:54.1565139Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:54.1566295Z >>> kubectl --request-timeout=30s get pods llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq --no-headers --namespace llm-d-pt8s89ylyl --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T02:56:54.2078740Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:54.2079591Z ==> Logs of init container llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq | |
| 2025-06-24T02:56:54.2080376Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:54.2081538Z >>> kubectl --request-timeout=30s logs llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq --namespace llm-d-pt8s89ylyl --container routing-proxy | |
| 2025-06-24T02:56:54.2582817Z I0624 02:56:39.335989 1 cmd.go:51] "p/d connector validated" connector="nixl" | |
| 2025-06-24T02:56:54.2583520Z I0624 02:56:39.336504 1 proxy.go:115] "starting" logger="proxy server" addr="[::]:8000" | |
| 2025-06-24T02:56:54.2603123Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:54.2604236Z <== Logs of init container llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq | |
| 2025-06-24T02:56:54.2605145Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:54.2606493Z >>> kubectl --request-timeout=30s get pods llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq --no-headers --namespace llm-d-pt8s89ylyl --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T02:56:54.3118932Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:54.3120207Z ==> Logs of container llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq | |
| 2025-06-24T02:56:54.3120821Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:54.3121942Z >>> kubectl --request-timeout=30s logs llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq --namespace llm-d-pt8s89ylyl --container vllm | |
| 2025-06-24T02:56:54.3648806Z I0624 02:56:39.676421 1 cmd.go:36] "Start vllm simulator" | |
| 2025-06-24T02:56:54.3649472Z I0624 02:56:39.676731 1 simulator.go:135] "Server starting" port=8001 | |
| 2025-06-24T02:56:54.3650156Z I0624 02:56:50.724959 1 simulator.go:195] "chat completion request received" | |
| 2025-06-24T02:56:54.3669918Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:54.3670725Z <== Logs of container llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq | |
| 2025-06-24T02:56:54.3671512Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:54.3672203Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:54.3673138Z ==> Description of pod llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-6lhvm | |
| 2025-06-24T02:56:54.3673604Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:54.3674276Z >>> kubectl --request-timeout=30s describe pod llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-6lhvm --namespace llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:54.4244721Z Name: llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-6lhvm | |
| 2025-06-24T02:56:54.4245255Z Namespace: llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:54.4245492Z Priority: 0 | |
| 2025-06-24T02:56:54.4245735Z Service Account: llm-d-pt8s89ylyl-vllm-sim-epp-sa | |
| 2025-06-24T02:56:54.4246107Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T02:56:54.4246413Z Start Time: Tue, 24 Jun 2025 02:56:38 +0000 | |
| 2025-06-24T02:56:54.4246971Z Labels: app.kubernetes.io/gateway=llm-d-pt8s89ylyl-inference-gateway | |
| 2025-06-24T02:56:54.4247362Z llm-d.ai/epp=llm-d-pt8s89ylyl-vllm-sim-epp | |
| 2025-06-24T02:56:54.4247796Z pod-template-hash=7978f9f65f | |
| 2025-06-24T02:56:54.4248315Z Annotations: <none> | |
| 2025-06-24T02:56:54.4248518Z Status: Running | |
| 2025-06-24T02:56:54.4248711Z IP: 10.244.0.21 | |
| 2025-06-24T02:56:54.4248897Z IPs: | |
| 2025-06-24T02:56:54.4249053Z IP: 10.244.0.21 | |
| 2025-06-24T02:56:54.4249345Z Controlled By: ReplicaSet/llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f | |
| 2025-06-24T02:56:54.4249658Z Containers: | |
| 2025-06-24T02:56:54.4249815Z epp: | |
| 2025-06-24T02:56:54.4250170Z Container ID: containerd://57bab456c04d853e5b2bebe5fce8154606ba89686d7e00a06b04263702542808 | |
| 2025-06-24T02:56:54.4250658Z Image: ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4 | |
| 2025-06-24T02:56:54.4251211Z Image ID: ghcr.io/llm-d/llm-d-inference-scheduler@sha256:d5d2492ee51c76bc78bb9dc1219dd7fba1fd70afe466c76860a6cd40ddf0c6f5 | |
| 2025-06-24T02:56:54.4251723Z Ports: 9002/TCP, 9003/TCP, 9090/TCP | |
| 2025-06-24T02:56:54.4251980Z Host Ports: 0/TCP, 0/TCP, 0/TCP | |
| 2025-06-24T02:56:54.4252198Z Args: | |
| 2025-06-24T02:56:54.4252632Z --poolName | |
| 2025-06-24T02:56:54.4252882Z llm-d-pt8s89ylyl-vllm-sim-inference-pool | |
| 2025-06-24T02:56:54.4253144Z --poolNamespace | |
| 2025-06-24T02:56:54.4253431Z llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:54.4253681Z -v | |
| 2025-06-24T02:56:54.4253837Z 4 | |
| 2025-06-24T02:56:54.4253990Z --zap-encoder | |
| 2025-06-24T02:56:54.4254165Z json | |
| 2025-06-24T02:56:54.4254313Z --grpcPort | |
| 2025-06-24T02:56:54.4254477Z 9002 | |
| 2025-06-24T02:56:54.4254640Z --grpcHealthPort | |
| 2025-06-24T02:56:54.4254813Z 9003 | |
| 2025-06-24T02:56:54.4254969Z State: Running | |
| 2025-06-24T02:56:54.4255650Z Started: Tue, 24 Jun 2025 02:56:39 +0000 | |
| 2025-06-24T02:56:54.4256016Z Ready: True | |
| 2025-06-24T02:56:54.4256300Z Restart Count: 0 | |
| 2025-06-24T02:56:54.4256568Z Requests: | |
| 2025-06-24T02:56:54.4256824Z cpu: 256m | |
| 2025-06-24T02:56:54.4257103Z memory: 128Mi | |
| 2025-06-24T02:56:54.4257766Z Liveness: grpc <pod>:9003 envoy.service.ext_proc.v3.ExternalProcessor delay=5s timeout=1s period=10s #success=1 #failure=3 | |
| 2025-06-24T02:56:54.4258860Z Readiness: grpc <pod>:9003 envoy.service.ext_proc.v3.ExternalProcessor delay=5s timeout=1s period=10s #success=1 #failure=3 | |
| 2025-06-24T02:56:54.4259496Z Environment: | |
| 2025-06-24T02:56:54.4259708Z ENABLE_KVCACHE_AWARE_SCORER: false | |
| 2025-06-24T02:56:54.4260089Z ENABLE_LOAD_AWARE_SCORER: true | |
| 2025-06-24T02:56:54.4260346Z ENABLE_PREFIX_AWARE_SCORER: true | |
| 2025-06-24T02:56:54.4260663Z ENABLE_SESSION_AWARE_SCORER: false | |
| 2025-06-24T02:56:54.4261022Z KVCACHE_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T02:56:54.4261564Z KVCACHE_INDEXER_REDIS_ADDR: llm-d-pt8s89ylyl-redis-master.llm-d-pt8s89ylyl.svc.cluster.local:8100 | |
| 2025-06-24T02:56:54.4262045Z LOAD_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T02:56:54.4262491Z PD_ENABLED: false | |
| 2025-06-24T02:56:54.4262787Z PD_PROMPT_LEN_THRESHOLD: 10 | |
| 2025-06-24T02:56:54.4263083Z PREFILL_ENABLE_KVCACHE_AWARE_SCORER: false | |
| 2025-06-24T02:56:54.4263448Z PREFILL_ENABLE_LOAD_AWARE_SCORER: false | |
| 2025-06-24T02:56:54.4263708Z PREFILL_ENABLE_PREFIX_AWARE_SCORER: false | |
| 2025-06-24T02:56:54.4264069Z PREFILL_ENABLE_SESSION_AWARE_SCORER: false | |
| 2025-06-24T02:56:54.4264523Z PREFILL_KVCACHE_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T02:56:54.4265110Z PREFILL_KVCACHE_INDEXER_REDIS_ADDR: llm-d-pt8s89ylyl-redis-master.llm-d-pt8s89ylyl.svc.cluster.local:8100 | |
| 2025-06-24T02:56:54.4265592Z PREFILL_LOAD_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T02:56:54.4265857Z PREFILL_PREFIX_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T02:56:54.4266118Z PREFILL_SESSION_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T02:56:54.4266368Z PREFIX_AWARE_SCORER_WEIGHT: 2 | |
| 2025-06-24T02:56:54.4266623Z SESSION_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T02:56:54.4266842Z Mounts: | |
| 2025-06-24T02:56:54.4269716Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-hrwzq (ro) | |
| 2025-06-24T02:56:54.4270418Z Conditions: | |
| 2025-06-24T02:56:54.4270697Z Type Status | |
| 2025-06-24T02:56:54.4271103Z PodReadyToStartContainers True | |
| 2025-06-24T02:56:54.4271490Z Initialized True | |
| 2025-06-24T02:56:54.4271850Z Ready True | |
| 2025-06-24T02:56:54.4272193Z ContainersReady True | |
| 2025-06-24T02:56:54.4272740Z PodScheduled True | |
| 2025-06-24T02:56:54.4272956Z Volumes: | |
| 2025-06-24T02:56:54.4273134Z kube-api-access-hrwzq: | |
| 2025-06-24T02:56:54.4273596Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T02:56:54.4273962Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T02:56:54.4274215Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T02:56:54.4274472Z ConfigMapOptional: <nil> | |
| 2025-06-24T02:56:54.4274700Z DownwardAPI: true | |
| 2025-06-24T02:56:54.4274912Z QoS Class: Burstable | |
| 2025-06-24T02:56:54.4275152Z Node-Selectors: <none> | |
| 2025-06-24T02:56:54.4275479Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T02:56:54.4275900Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T02:56:54.4276202Z Events: | |
| 2025-06-24T02:56:54.4276390Z Type Reason Age From Message | |
| 2025-06-24T02:56:54.4276676Z ---- ------ ---- ---- ------- | |
| 2025-06-24T02:56:54.4277343Z Normal Scheduled 16s default-scheduler Successfully assigned llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-6lhvm to chart-testing-control-plane | |
| 2025-06-24T02:56:54.4278345Z Normal Pulling 16s kubelet Pulling image "ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4" | |
| 2025-06-24T02:56:54.4279121Z Normal Pulled 15s kubelet Successfully pulled image "ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4" in 108ms (108ms including waiting). Image size: 119587259 bytes. | |
| 2025-06-24T02:56:54.4279783Z Normal Created 15s kubelet Created container epp | |
| 2025-06-24T02:56:54.4280141Z Normal Started 15s kubelet Started container epp | |
| 2025-06-24T02:56:54.4280510Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:54.4280909Z <== Description of pod llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-6lhvm | |
| 2025-06-24T02:56:54.4281300Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:54.4282048Z >>> kubectl --request-timeout=30s get pods llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-6lhvm --no-headers --namespace llm-d-pt8s89ylyl --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T02:56:54.4770131Z >>> kubectl --request-timeout=30s get pods llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-6lhvm --no-headers --namespace llm-d-pt8s89ylyl --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T02:56:54.5267758Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:54.5268609Z ==> Logs of container llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-6lhvm | |
| 2025-06-24T02:56:54.5269323Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:54.5270418Z >>> kubectl --request-timeout=30s logs llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-6lhvm --namespace llm-d-pt8s89ylyl --container epp | |
| 2025-06-24T02:56:54.5809429Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"epp/main.go:146","msg":"Flags processed","flags":{"DestinationEndpointHintMetadataNamespace":"envoy.lb","certPath":"","destinationEndpointHintKey":"x-gateway-destination-endpoint","grpcHealthPort":9003,"grpcPort":9002,"kubeconfig":"","kvCacheUsagePercentageMetric":"vllm:gpu_cache_usage_perc","loraInfoMetric":"vllm:lora_requests_info","metricsPort":9090,"poolName":"llm-d-pt8s89ylyl-vllm-sim-inference-pool","poolNamespace":"llm-d-pt8s89ylyl","refreshMetricsInterval":50000000,"refreshPrometheusMetricsInterval":5000000000,"secureServing":true,"totalQueuedRequestsMetric":"vllm:num_requests_waiting","v":4,"zap-devel":true,"zap-encoder":{},"zap-log-level":{},"zap-stacktrace-level":{},"zap-time-encoding":{}}} | |
| 2025-06-24T02:56:54.5815465Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"ENABLE_KVCACHE_AWARE_SCORER","value":"false"} | |
| 2025-06-24T02:56:54.5818786Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"KVCACHE_AWARE_SCORER"} | |
| 2025-06-24T02:56:54.5820407Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"ENABLE_LOAD_AWARE_SCORER","value":"true"} | |
| 2025-06-24T02:56:54.5822271Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"LOAD_AWARE_SCORER_WEIGHT","value":1} | |
| 2025-06-24T02:56:54.5823901Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"config/config.go:115","msg":"Initialized plugin","plugin":"LOAD_AWARE_SCORER","weight":1} | |
| 2025-06-24T02:56:54.5827051Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"ENABLE_PREFIX_AWARE_SCORER","value":"true"} | |
| 2025-06-24T02:56:54.5830167Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PREFIX_AWARE_SCORER_WEIGHT","value":2} | |
| 2025-06-24T02:56:54.5835571Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"config/config.go:115","msg":"Initialized plugin","plugin":"PREFIX_AWARE_SCORER","weight":2} | |
| 2025-06-24T02:56:54.5853041Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"ENABLE_SESSION_AWARE_SCORER","value":"false"} | |
| 2025-06-24T02:56:54.5854075Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"SESSION_AWARE_SCORER"} | |
| 2025-06-24T02:56:54.5855044Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_LEAST_KVCACHE_FILTER","defaultValue":"false"} | |
| 2025-06-24T02:56:54.5856016Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LEAST_KVCACHE_FILTER"} | |
| 2025-06-24T02:56:54.5856969Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_LEAST_QUEUE_FILTER","defaultValue":"false"} | |
| 2025-06-24T02:56:54.5857907Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LEAST_QUEUE_FILTER"} | |
| 2025-06-24T02:56:54.5859133Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_LORA_AFFINITY_FILTER","defaultValue":"false"} | |
| 2025-06-24T02:56:54.5860775Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LORA_AFFINITY_FILTER"} | |
| 2025-06-24T02:56:54.5862684Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_LOW_QUEUE_FILTER","defaultValue":"false"} | |
| 2025-06-24T02:56:54.5864512Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LOW_QUEUE_FILTER"} | |
| 2025-06-24T02:56:54.5866047Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_SHEDDABLE_CAPACITY_FILTER","defaultValue":"false"} | |
| 2025-06-24T02:56:54.5867160Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_SHEDDABLE_CAPACITY_FILTER"} | |
| 2025-06-24T02:56:54.5868358Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_KVCACHE_UTILIZATION_SCORER","defaultValue":"false"} | |
| 2025-06-24T02:56:54.5869538Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_KVCACHE_UTILIZATION_SCORER"} | |
| 2025-06-24T02:56:54.5870588Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_QUEUE_SCORER","defaultValue":"false"} | |
| 2025-06-24T02:56:54.5871755Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_QUEUE_SCORER"} | |
| 2025-06-24T02:56:54.5872915Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_PREFIX_SCORER","defaultValue":"false"} | |
| 2025-06-24T02:56:54.5874027Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_PREFIX_SCORER"} | |
| 2025-06-24T02:56:54.5874949Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PREFILL_ENABLE_KVCACHE_AWARE_SCORER","value":"false"} | |
| 2025-06-24T02:56:54.5875867Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"KVCACHE_AWARE_SCORER"} | |
| 2025-06-24T02:56:54.5877063Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PREFILL_ENABLE_LOAD_AWARE_SCORER","value":"false"} | |
| 2025-06-24T02:56:54.5878104Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"LOAD_AWARE_SCORER"} | |
| 2025-06-24T02:56:54.5879240Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PREFILL_ENABLE_PREFIX_AWARE_SCORER","value":"false"} | |
| 2025-06-24T02:56:54.5880589Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"PREFIX_AWARE_SCORER"} | |
| 2025-06-24T02:56:54.5881826Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PREFILL_ENABLE_SESSION_AWARE_SCORER","value":"false"} | |
| 2025-06-24T02:56:54.5883526Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"SESSION_AWARE_SCORER"} | |
| 2025-06-24T02:56:54.5884762Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_LEAST_KVCACHE_FILTER","defaultValue":"false"} | |
| 2025-06-24T02:56:54.5885967Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LEAST_KVCACHE_FILTER"} | |
| 2025-06-24T02:56:54.5887226Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_LEAST_QUEUE_FILTER","defaultValue":"false"} | |
| 2025-06-24T02:56:54.5888489Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LEAST_QUEUE_FILTER"} | |
| 2025-06-24T02:56:54.5890048Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_LORA_AFFINITY_FILTER","defaultValue":"false"} | |
| 2025-06-24T02:56:54.5891520Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LORA_AFFINITY_FILTER"} | |
| 2025-06-24T02:56:54.5893369Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_LOW_QUEUE_FILTER","defaultValue":"false"} | |
| 2025-06-24T02:56:54.5894613Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LOW_QUEUE_FILTER"} | |
| 2025-06-24T02:56:54.5895717Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_SHEDDABLE_CAPACITY_FILTER","defaultValue":"false"} | |
| 2025-06-24T02:56:54.5897157Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_SHEDDABLE_CAPACITY_FILTER"} | |
| 2025-06-24T02:56:54.5898269Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_KVCACHE_UTILIZATION_SCORER","defaultValue":"false"} | |
| 2025-06-24T02:56:54.5899480Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_KVCACHE_UTILIZATION_SCORER"} | |
| 2025-06-24T02:56:54.5900586Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_QUEUE_SCORER","defaultValue":"false"} | |
| 2025-06-24T02:56:54.5901677Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_QUEUE_SCORER"} | |
| 2025-06-24T02:56:54.5903253Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_PREFIX_SCORER","defaultValue":"false"} | |
| 2025-06-24T02:56:54.5904406Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_PREFIX_SCORER"} | |
| 2025-06-24T02:56:54.5905362Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PD_ENABLED","value":"false"} | |
| 2025-06-24T02:56:54.5906314Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PD_PROMPT_LEN_THRESHOLD","value":10} | |
| 2025-06-24T02:56:54.5907234Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFIX_SCORER_BLOCK_SIZE","defaultValue":256} | |
| 2025-06-24T02:56:54.5908171Z {"level":"info","ts":"2025-06-24T02:56:39Z","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"LOAD_AWARE_SCORER_QUEUE_THRESHOLD","defaultValue":128} | |
| 2025-06-24T02:56:54.5909197Z {"level":"info","ts":"2025-06-24T02:56:39Z","caller":"scorer/prefix_aware.go:154","msg":"Prefix aware scorer cleanup started"} | |
| 2025-06-24T02:56:54.5909827Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"setup","caller":"epp/main.go:224","msg":"Controller manager starting"} | |
| 2025-06-24T02:56:54.5910434Z {"level":"info","ts":"2025-06-24T02:56:39Z","caller":"manager/server.go:83","msg":"starting server","name":"metrics","addr":":9090"} | |
| 2025-06-24T02:56:54.5911126Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"controller-runtime.metrics","caller":"server/server.go:208","msg":"Starting metrics server"} | |
| 2025-06-24T02:56:54.5911975Z {"level":"info","ts":"2025-06-24T02:56:39Z","logger":"controller-runtime.metrics","caller":"server/server.go:247","msg":"Serving metrics server","bindAddress":":8080","secure":false} | |
| 2025-06-24T02:56:54.5912972Z {"level":"info","ts":"2025-06-24T02:56:39Z","caller":"runnable/grpc.go:26","msg":"gRPC server starting","name":"health"} | |
| 2025-06-24T02:56:54.5913707Z {"level":"info","ts":"2025-06-24T02:56:39Z","caller":"runnable/grpc.go:34","msg":"gRPC server listening","name":"health","port":9003} | |
| 2025-06-24T02:56:54.5914578Z {"level":"info","ts":"2025-06-24T02:56:39Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"pod","controllerGroup":"","controllerKind":"Pod","source":"kind source: *v1.Pod"} | |
| 2025-06-24T02:56:54.5915879Z {"level":"info","ts":"2025-06-24T02:56:39Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool","source":"kind source: *v1alpha2.InferencePool"} | |
| 2025-06-24T02:56:54.5917905Z {"level":"info","ts":"2025-06-24T02:56:39Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"inferencemodel","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferenceModel","source":"kind source: *v1alpha2.InferenceModel"} | |
| 2025-06-24T02:56:54.5920101Z {"level":"info","ts":"2025-06-24T02:56:39Z","caller":"controller/controller.go:239","msg":"Starting Controller","controller":"pod","controllerGroup":"","controllerKind":"Pod"} | |
| 2025-06-24T02:56:54.5921557Z {"level":"info","ts":"2025-06-24T02:56:39Z","caller":"controller/controller.go:239","msg":"Starting Controller","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool"} | |
| 2025-06-24T02:56:54.5922877Z {"level":"info","ts":"2025-06-24T02:56:39Z","caller":"controller/controller.go:248","msg":"Starting workers","controller":"pod","controllerGroup":"","controllerKind":"Pod","worker count":1} | |
| 2025-06-24T02:56:54.5924113Z {"level":"info","ts":"2025-06-24T02:56:39Z","caller":"controller/controller.go:239","msg":"Starting Controller","controller":"inferencemodel","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferenceModel"} | |
| 2025-06-24T02:56:54.5925834Z {"level":"info","ts":"2025-06-24T02:56:39Z","caller":"controller/controller.go:248","msg":"Starting workers","controller":"inferencemodel","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferenceModel","worker count":1} | |
| 2025-06-24T02:56:54.5927915Z {"level":"info","ts":"2025-06-24T02:56:39Z","caller":"controller/controller.go:248","msg":"Starting workers","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool","worker count":1} | |
| 2025-06-24T02:56:54.5931744Z {"level":"Level(-2)","ts":"2025-06-24T02:56:39Z","caller":"controller/inferencemodel_reconciler.go:47","msg":"Reconciling InferenceModel","controller":"inferencemodel","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferenceModel","InferenceModel":{"name":"llm-d-pt8s89ylyl-vllm-sim","namespace":"llm-d-pt8s89ylyl"},"namespace":"llm-d-pt8s89ylyl","name":"llm-d-pt8s89ylyl-vllm-sim","reconcileID":"57ed8e3a-d738-4cf1-8b08-44c157e486cc","inferenceModel":{"name":"llm-d-pt8s89ylyl-vllm-sim","namespace":"llm-d-pt8s89ylyl"}} | |
| 2025-06-24T02:56:54.5937821Z {"level":"Level(-2)","ts":"2025-06-24T02:56:39Z","caller":"controller/inferencepool_reconciler.go:45","msg":"Reconciling InferencePool","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool","InferencePool":{"name":"llm-d-pt8s89ylyl-vllm-sim-inference-pool","namespace":"llm-d-pt8s89ylyl"},"namespace":"llm-d-pt8s89ylyl","name":"llm-d-pt8s89ylyl-vllm-sim-inference-pool","reconcileID":"e8797228-c2f8-4e12-9995-ad7232111934","inferencePool":{"name":"llm-d-pt8s89ylyl-vllm-sim-inference-pool","namespace":"llm-d-pt8s89ylyl"}} | |
| 2025-06-24T02:56:54.5944938Z {"level":"Level(-2)","ts":"2025-06-24T02:56:39Z","caller":"controller/inferencemodel_reconciler.go:70","msg":"Added/Updated InferenceModel","controller":"inferencemodel","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferenceModel","InferenceModel":{"name":"llm-d-pt8s89ylyl-vllm-sim","namespace":"llm-d-pt8s89ylyl"},"namespace":"llm-d-pt8s89ylyl","name":"llm-d-pt8s89ylyl-vllm-sim","reconcileID":"57ed8e3a-d738-4cf1-8b08-44c157e486cc","inferenceModel":{"name":"llm-d-pt8s89ylyl-vllm-sim","namespace":"llm-d-pt8s89ylyl"},"poolRef":{"group":"inference.networking.x-k8s.io","kind":"InferencePool","name":"llm-d-pt8s89ylyl-vllm-sim-inference-pool"},"modelName":"food-review"} | |
| 2025-06-24T02:56:54.5950524Z {"level":"Level(-4)","ts":"2025-06-24T02:56:39Z","caller":"datastore/datastore.go:125","msg":"Updating inference pool endpoints","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool","InferencePool":{"name":"llm-d-pt8s89ylyl-vllm-sim-inference-pool","namespace":"llm-d-pt8s89ylyl"},"namespace":"llm-d-pt8s89ylyl","name":"llm-d-pt8s89ylyl-vllm-sim-inference-pool","reconcileID":"e8797228-c2f8-4e12-9995-ad7232111934","inferencePool":{"name":"llm-d-pt8s89ylyl-vllm-sim-inference-pool","namespace":"llm-d-pt8s89ylyl"},"selector":{"llm-d.ai/inferenceServing":"true","llm-d.ai/model":"food-review"}} | |
| 2025-06-24T02:56:54.5954497Z {"level":"Level(-3)","ts":"2025-06-24T02:56:39Z","caller":"controller/pod_reconciler.go:51","msg":"Pod being reconciled","controller":"pod","controllerGroup":"","controllerKind":"Pod","Pod":{"name":"llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq","namespace":"llm-d-pt8s89ylyl"},"namespace":"llm-d-pt8s89ylyl","name":"llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq","reconcileID":"dc06d8ce-9fed-4426-8b34-16c291712ea4","name":{"name":"llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq","namespace":"llm-d-pt8s89ylyl"}} | |
| 2025-06-24T02:56:54.5957599Z {"level":"Level(-4)","ts":"2025-06-24T02:56:39Z","caller":"controller/pod_reconciler.go:96","msg":"Pod removed or not added","controller":"pod","controllerGroup":"","controllerKind":"Pod","Pod":{"name":"llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq","namespace":"llm-d-pt8s89ylyl"},"namespace":"llm-d-pt8s89ylyl","name":"llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq","reconcileID":"dc06d8ce-9fed-4426-8b34-16c291712ea4","name":{"name":"llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq","namespace":"llm-d-pt8s89ylyl"}} | |
| 2025-06-24T02:56:54.5960672Z {"level":"Level(-3)","ts":"2025-06-24T02:56:39Z","caller":"controller/pod_reconciler.go:51","msg":"Pod being reconciled","controller":"pod","controllerGroup":"","controllerKind":"Pod","Pod":{"name":"llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj","namespace":"llm-d-pt8s89ylyl"},"namespace":"llm-d-pt8s89ylyl","name":"llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj","reconcileID":"1e241d13-f294-40ec-9d42-cfae75bb4aee","name":{"name":"llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj","namespace":"llm-d-pt8s89ylyl"}} | |
| 2025-06-24T02:56:54.5963846Z {"level":"Level(-2)","ts":"2025-06-24T02:56:39Z","caller":"controller/pod_reconciler.go:102","msg":"Pod already exists","controller":"pod","controllerGroup":"","controllerKind":"Pod","Pod":{"name":"llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj","namespace":"llm-d-pt8s89ylyl"},"namespace":"llm-d-pt8s89ylyl","name":"llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj","reconcileID":"1e241d13-f294-40ec-9d42-cfae75bb4aee","name":{"name":"llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj","namespace":"llm-d-pt8s89ylyl"}} | |
| 2025-06-24T02:56:54.5966748Z {"level":"Level(-2)","ts":"2025-06-24T02:56:39Z","caller":"metrics/pod_metrics.go:92","msg":"Starting refresher","pod":{"name":"llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj","namespace":"llm-d-pt8s89ylyl"},"pod":"{NamespacedName:llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj Address:10.244.0.22 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:prefill pod-template-hash:6b56fb4d89]}"} | |
| 2025-06-24T02:56:54.5969512Z {"level":"Level(-3)","ts":"2025-06-24T02:56:40Z","caller":"controller/pod_reconciler.go:51","msg":"Pod being reconciled","controller":"pod","controllerGroup":"","controllerKind":"Pod","Pod":{"name":"llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq","namespace":"llm-d-pt8s89ylyl"},"namespace":"llm-d-pt8s89ylyl","name":"llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq","reconcileID":"af796db3-1cfd-434d-ad78-c0c5445bbeda","name":{"name":"llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq","namespace":"llm-d-pt8s89ylyl"}} | |
| 2025-06-24T02:56:54.5972749Z {"level":"Level(-2)","ts":"2025-06-24T02:56:40Z","caller":"controller/pod_reconciler.go:102","msg":"Pod already exists","controller":"pod","controllerGroup":"","controllerKind":"Pod","Pod":{"name":"llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq","namespace":"llm-d-pt8s89ylyl"},"namespace":"llm-d-pt8s89ylyl","name":"llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq","reconcileID":"af796db3-1cfd-434d-ad78-c0c5445bbeda","name":{"name":"llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq","namespace":"llm-d-pt8s89ylyl"}} | |
| 2025-06-24T02:56:54.5977429Z {"level":"Level(-2)","ts":"2025-06-24T02:56:40Z","caller":"metrics/pod_metrics.go:92","msg":"Starting refresher","pod":{"name":"llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq","namespace":"llm-d-pt8s89ylyl"},"pod":"{NamespacedName:llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq Address:10.244.0.24 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:decode pod-template-hash:5c5f96db4c]}"} | |
| 2025-06-24T02:56:54.5981278Z {"level":"info","ts":"2025-06-24T02:56:41Z","caller":"runnable/grpc.go:19","msg":"gRPC server starting","name":"ext-proc"} | |
| 2025-06-24T02:56:54.5982554Z {"level":"info","ts":"2025-06-24T02:56:41Z","caller":"runnable/grpc.go:28","msg":"gRPC server listening","name":"ext-proc","port":9002} | |
| 2025-06-24T02:56:54.5985051Z {"level":"Level(-4)","ts":"2025-06-24T02:56:49Z","caller":"requestcontrol/director.go:150","msg":"LLM response assembled","x-request-id":"3d8a2a32-d929-4a47-bfc4-efbd55515aa9","response":{"RequestId":"","Headers":{":status":"200","content-length":"237","content-type":"application/json","date":"Tue, 24 Jun 2025 02:56:48 GMT","server":"fasthttp","x-envoy-upstream-service-time":"0"},"Body":"","IsStreaming":false,"EndOfStream":false}} | |
| 2025-06-24T02:56:54.6008040Z {"level":"Level(-4)","ts":"2025-06-24T02:56:50Z","caller":"requestcontrol/director.go:94","msg":"LLM request assembled","x-request-id":"095c4e82-9dc7-4be7-9088-4bb508e278a9","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-pt8s89ylyl-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-pt8s89ylyl-vllm-sim-inference-pool-ip-3d1931d7.llm-d-pt8s89ylyl.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC1wdDhzODl5bHlsLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTg0Yzc5OWM5ZDQta3FqbnoKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXB0OHM4OXlseWwKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXB0OHM4OXlseWwvZGVwbG95bWVudHMvbGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXB0OHM4OXlseWwtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.20~llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz.llm-d-pt8s89ylyl~llm-d-pt8s89ylyl.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:095c4e82-9dc7-4be7-9088-4bb508e278a9]"} | |
| 2025-06-24T02:56:54.6036781Z {"level":"Level(-4)","ts":"2025-06-24T02:56:50Z","logger":"PD","caller":"pd/scheduler.go:103","msg":"Disagregated prefill/decode disabled - scheduling to decode worker only","x-request-id":"095c4e82-9dc7-4be7-9088-4bb508e278a9","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-pt8s89ylyl-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-pt8s89ylyl-vllm-sim-inference-pool-ip-3d1931d7.llm-d-pt8s89ylyl.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC1wdDhzODl5bHlsLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTg0Yzc5OWM5ZDQta3FqbnoKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXB0OHM4OXlseWwKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXB0OHM4OXlseWwvZGVwbG95bWVudHMvbGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXB0OHM4OXlseWwtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.20~llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz.llm-d-pt8s89ylyl~llm-d-pt8s89ylyl.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:095c4e82-9dc7-4be7-9088-4bb508e278a9]"} | |
| 2025-06-24T02:56:54.6070827Z {"level":"Level(-4)","ts":"2025-06-24T02:56:50Z","caller":"scheduling/scheduler.go:119","msg":"Scheduling a request, Metrics: [{Pod:{NamespacedName:llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq Address:10.244.0.24 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:decode pod-template-hash:5c5f96db4c]} MetricsState:{ActiveModels:map[] WaitingModels:map[] MaxActiveModels:0 RunningQueueSize:0 WaitingQueueSize:0 KVCacheUsagePercent:0 KvCacheMaxTokenCapacity:0 UpdateTime:2025-06-24 02:56:50.700765995 +0000 UTC m=+11.447934958}} {Pod:{NamespacedName:llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj Address:10.244.0.22 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:prefill pod-template-hash:6b56fb4d89]} MetricsState:{ActiveModels:map[] WaitingModels:map[] MaxActiveModels:0 RunningQueueSize:0 WaitingQueueSize:0 KVCacheUsagePercent:0 KvCacheMaxTokenCapacity:0 UpdateTime:2025-06-24 02:56:50.6985159 +0000 UTC m=+11.445684853}}]","x-request-id":"095c4e82-9dc7-4be7-9088-4bb508e278a9","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-pt8s89ylyl-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-pt8s89ylyl-vllm-sim-inference-pool-ip-3d1931d7.llm-d-pt8s89ylyl.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC1wdDhzODl5bHlsLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTg0Yzc5OWM5ZDQta3FqbnoKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXB0OHM4OXlseWwKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXB0OHM4OXlseWwvZGVwbG95bWVudHMvbGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXB0OHM4OXlseWwtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.20~llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz.llm-d-pt8s89ylyl~llm-d-pt8s89ylyl.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:095c4e82-9dc7-4be7-9088-4bb508e278a9]"} | |
| 2025-06-24T02:56:54.6109875Z {"level":"Level(-4)","ts":"2025-06-24T02:56:50Z","caller":"scheduling/scheduler.go:149","msg":"Before running filter plugins","x-request-id":"095c4e82-9dc7-4be7-9088-4bb508e278a9","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-pt8s89ylyl-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-pt8s89ylyl-vllm-sim-inference-pool-ip-3d1931d7.llm-d-pt8s89ylyl.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC1wdDhzODl5bHlsLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTg0Yzc5OWM5ZDQta3FqbnoKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXB0OHM4OXlseWwKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXB0OHM4OXlseWwvZGVwbG95bWVudHMvbGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXB0OHM4OXlseWwtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.20~llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz.llm-d-pt8s89ylyl~llm-d-pt8s89ylyl.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:095c4e82-9dc7-4be7-9088-4bb508e278a9]","pods":[{"NamespacedName":{"Namespace":"llm-d-pt8s89ylyl","Name":"llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq"},"Address":"10.244.0.24","Labels":{"llm-d.ai/inferenceServing":"true","llm-d.ai/model":"food-review","llm-d.ai/role":"decode","pod-template-hash":"5c5f96db4c"},"ActiveModels":{},"WaitingModels":{},"MaxActiveModels":0,"RunningQueueSize":0,"WaitingQueueSize":0,"KVCacheUsagePercent":0,"KvCacheMaxTokenCapacity":0,"UpdateTime":"2025-06-24T02:56:50.700765995Z"},{"NamespacedName":{"Namespace":"llm-d-pt8s89ylyl","Name":"llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj"},"Address":"10.244.0.22","Labels":{"llm-d.ai/inferenceServing":"true","llm-d.ai/model":"food-review","llm-d.ai/role":"prefill","pod-template-hash":"6b56fb4d89"},"ActiveModels":{},"WaitingModels":{},"MaxActiveModels":0,"RunningQueueSize":0,"WaitingQueueSize":0,"KVCacheUsagePercent":0,"KvCacheMaxTokenCapacity":0,"UpdateTime":"2025-06-24T02:56:50.6985159Z"}]} | |
| 2025-06-24T02:56:54.6144548Z {"level":"Level(-4)","ts":"2025-06-24T02:56:50Z","caller":"scheduling/scheduler.go:152","msg":"Running filter plugin","x-request-id":"095c4e82-9dc7-4be7-9088-4bb508e278a9","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-pt8s89ylyl-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-pt8s89ylyl-vllm-sim-inference-pool-ip-3d1931d7.llm-d-pt8s89ylyl.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC1wdDhzODl5bHlsLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTg0Yzc5OWM5ZDQta3FqbnoKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXB0OHM4OXlseWwKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXB0OHM4OXlseWwvZGVwbG95bWVudHMvbGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXB0OHM4OXlseWwtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.20~llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz.llm-d-pt8s89ylyl~llm-d-pt8s89ylyl.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:095c4e82-9dc7-4be7-9088-4bb508e278a9]","plugin":"decode-filter"} | |
| 2025-06-24T02:56:54.6176833Z {"level":"Level(-4)","ts":"2025-06-24T02:56:50Z","caller":"scheduling/scheduler.go:156","msg":"Filter plugin result","x-request-id":"095c4e82-9dc7-4be7-9088-4bb508e278a9","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-pt8s89ylyl-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-pt8s89ylyl-vllm-sim-inference-pool-ip-3d1931d7.llm-d-pt8s89ylyl.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC1wdDhzODl5bHlsLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTg0Yzc5OWM5ZDQta3FqbnoKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXB0OHM4OXlseWwKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXB0OHM4OXlseWwvZGVwbG95bWVudHMvbGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXB0OHM4OXlseWwtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.20~llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz.llm-d-pt8s89ylyl~llm-d-pt8s89ylyl.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:095c4e82-9dc7-4be7-9088-4bb508e278a9]","plugin":"decode-filter","pods":[{"NamespacedName":{"Namespace":"llm-d-pt8s89ylyl","Name":"llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq"},"Address":"10.244.0.24","Labels":{"llm-d.ai/inferenceServing":"true","llm-d.ai/model":"food-review","llm-d.ai/role":"decode","pod-template-hash":"5c5f96db4c"},"ActiveModels":{},"WaitingModels":{},"MaxActiveModels":0,"RunningQueueSize":0,"WaitingQueueSize":0,"KVCacheUsagePercent":0,"KvCacheMaxTokenCapacity":0,"UpdateTime":"2025-06-24T02:56:50.700765995Z"}]} | |
| 2025-06-24T02:56:54.6208625Z {"level":"Level(-4)","ts":"2025-06-24T02:56:50Z","caller":"scheduling/scheduler.go:161","msg":"After running filter plugins","x-request-id":"095c4e82-9dc7-4be7-9088-4bb508e278a9","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-pt8s89ylyl-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-pt8s89ylyl-vllm-sim-inference-pool-ip-3d1931d7.llm-d-pt8s89ylyl.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC1wdDhzODl5bHlsLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTg0Yzc5OWM5ZDQta3FqbnoKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXB0OHM4OXlseWwKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXB0OHM4OXlseWwvZGVwbG95bWVudHMvbGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXB0OHM4OXlseWwtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.20~llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz.llm-d-pt8s89ylyl~llm-d-pt8s89ylyl.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:095c4e82-9dc7-4be7-9088-4bb508e278a9]"} | |
| 2025-06-24T02:56:54.6240408Z {"level":"Level(-4)","ts":"2025-06-24T02:56:50Z","caller":"scheduling/scheduler.go:168","msg":"Before running scorer plugins","x-request-id":"095c4e82-9dc7-4be7-9088-4bb508e278a9","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-pt8s89ylyl-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-pt8s89ylyl-vllm-sim-inference-pool-ip-3d1931d7.llm-d-pt8s89ylyl.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC1wdDhzODl5bHlsLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTg0Yzc5OWM5ZDQta3FqbnoKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXB0OHM4OXlseWwKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXB0OHM4OXlseWwvZGVwbG95bWVudHMvbGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXB0OHM4OXlseWwtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.20~llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz.llm-d-pt8s89ylyl~llm-d-pt8s89ylyl.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:095c4e82-9dc7-4be7-9088-4bb508e278a9]","pods":[{"NamespacedName":{"Namespace":"llm-d-pt8s89ylyl","Name":"llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq"},"Address":"10.244.0.24","Labels":{"llm-d.ai/inferenceServing":"true","llm-d.ai/model":"food-review","llm-d.ai/role":"decode","pod-template-hash":"5c5f96db4c"},"ActiveModels":{},"WaitingModels":{},"MaxActiveModels":0,"RunningQueueSize":0,"WaitingQueueSize":0,"KVCacheUsagePercent":0,"KvCacheMaxTokenCapacity":0,"UpdateTime":"2025-06-24T02:56:50.700765995Z"}]} | |
| 2025-06-24T02:56:54.6272074Z {"level":"Level(-4)","ts":"2025-06-24T02:56:50Z","caller":"scheduling/scheduler.go:176","msg":"Running scorer","x-request-id":"095c4e82-9dc7-4be7-9088-4bb508e278a9","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-pt8s89ylyl-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-pt8s89ylyl-vllm-sim-inference-pool-ip-3d1931d7.llm-d-pt8s89ylyl.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC1wdDhzODl5bHlsLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTg0Yzc5OWM5ZDQta3FqbnoKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXB0OHM4OXlseWwKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXB0OHM4OXlseWwvZGVwbG95bWVudHMvbGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXB0OHM4OXlseWwtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.20~llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz.llm-d-pt8s89ylyl~llm-d-pt8s89ylyl.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:095c4e82-9dc7-4be7-9088-4bb508e278a9]","scorer":"load-aware-scorer"} | |
| 2025-06-24T02:56:54.6301467Z {"level":"Level(-4)","ts":"2025-06-24T02:56:50Z","caller":"scheduling/scheduler.go:183","msg":"After running scorer","x-request-id":"095c4e82-9dc7-4be7-9088-4bb508e278a9","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-pt8s89ylyl-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-pt8s89ylyl-vllm-sim-inference-pool-ip-3d1931d7.llm-d-pt8s89ylyl.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC1wdDhzODl5bHlsLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTg0Yzc5OWM5ZDQta3FqbnoKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXB0OHM4OXlseWwKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXB0OHM4OXlseWwvZGVwbG95bWVudHMvbGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXB0OHM4OXlseWwtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.20~llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz.llm-d-pt8s89ylyl~llm-d-pt8s89ylyl.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:095c4e82-9dc7-4be7-9088-4bb508e278a9]","scorer":"load-aware-scorer"} | |
| 2025-06-24T02:56:54.6330592Z {"level":"Level(-4)","ts":"2025-06-24T02:56:50Z","caller":"scheduling/scheduler.go:176","msg":"Running scorer","x-request-id":"095c4e82-9dc7-4be7-9088-4bb508e278a9","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-pt8s89ylyl-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-pt8s89ylyl-vllm-sim-inference-pool-ip-3d1931d7.llm-d-pt8s89ylyl.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC1wdDhzODl5bHlsLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTg0Yzc5OWM5ZDQta3FqbnoKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXB0OHM4OXlseWwKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXB0OHM4OXlseWwvZGVwbG95bWVudHMvbGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXB0OHM4OXlseWwtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.20~llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz.llm-d-pt8s89ylyl~llm-d-pt8s89ylyl.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:095c4e82-9dc7-4be7-9088-4bb508e278a9]","scorer":"prefix-aware-scorer"} | |
| 2025-06-24T02:56:54.6346536Z {"level":"Level(-4)","ts":"2025-06-24T02:56:50Z","logger":"prefix-aware-scorer","caller":"scorer/prefix_aware.go:69","msg":"Got pod scores","x-request-id":"095c4e82-9dc7-4be7-9088-4bb508e278a9","scores":null} | |
| 2025-06-24T02:56:54.6348310Z {"level":"Level(-4)","ts":"2025-06-24T02:56:50Z","logger":"prefix-aware-scorer","caller":"scorer/prefix_aware.go:72","msg":"No scores found for pods","x-request-id":"095c4e82-9dc7-4be7-9088-4bb508e278a9"} | |
| 2025-06-24T02:56:54.6363815Z {"level":"Level(-4)","ts":"2025-06-24T02:56:50Z","caller":"scheduling/scheduler.go:183","msg":"After running scorer","x-request-id":"095c4e82-9dc7-4be7-9088-4bb508e278a9","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-pt8s89ylyl-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-pt8s89ylyl-vllm-sim-inference-pool-ip-3d1931d7.llm-d-pt8s89ylyl.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC1wdDhzODl5bHlsLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTg0Yzc5OWM5ZDQta3FqbnoKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXB0OHM4OXlseWwKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXB0OHM4OXlseWwvZGVwbG95bWVudHMvbGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXB0OHM4OXlseWwtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.20~llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz.llm-d-pt8s89ylyl~llm-d-pt8s89ylyl.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:095c4e82-9dc7-4be7-9088-4bb508e278a9]","scorer":"prefix-aware-scorer"} | |
| 2025-06-24T02:56:54.6390721Z {"level":"Level(-4)","ts":"2025-06-24T02:56:50Z","caller":"scheduling/scheduler.go:185","msg":"After running scorer plugins","x-request-id":"095c4e82-9dc7-4be7-9088-4bb508e278a9","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-pt8s89ylyl-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-pt8s89ylyl-vllm-sim-inference-pool-ip-3d1931d7.llm-d-pt8s89ylyl.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC1wdDhzODl5bHlsLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTg0Yzc5OWM5ZDQta3FqbnoKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXB0OHM4OXlseWwKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXB0OHM4OXlseWwvZGVwbG95bWVudHMvbGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXB0OHM4OXlseWwtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.20~llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz.llm-d-pt8s89ylyl~llm-d-pt8s89ylyl.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:095c4e82-9dc7-4be7-9088-4bb508e278a9]"} | |
| 2025-06-24T02:56:54.6420176Z {"level":"Level(-4)","ts":"2025-06-24T02:56:50Z","caller":"scheduling/scheduler.go:199","msg":"Before running picker plugin","x-request-id":"095c4e82-9dc7-4be7-9088-4bb508e278a9","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-pt8s89ylyl-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-pt8s89ylyl-vllm-sim-inference-pool-ip-3d1931d7.llm-d-pt8s89ylyl.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC1wdDhzODl5bHlsLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTg0Yzc5OWM5ZDQta3FqbnoKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXB0OHM4OXlseWwKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXB0OHM4OXlseWwvZGVwbG95bWVudHMvbGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXB0OHM4OXlseWwtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.20~llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz.llm-d-pt8s89ylyl~llm-d-pt8s89ylyl.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:095c4e82-9dc7-4be7-9088-4bb508e278a9]","pods weighted score":"map[{Pod:{NamespacedName:llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq Address:10.244.0.24 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:decode pod-template-hash:5c5f96db4c]} MetricsState:{ActiveModels:map[] WaitingModels:map[] MaxActiveModels:0 RunningQueueSize:0 WaitingQueueSize:0 KVCacheUsagePercent:0 KvCacheMaxTokenCapacity:0 UpdateTime:2025-06-24 02:56:50.700765995 +0000 UTC m=+11.447934958}}:0.5]"} | |
| 2025-06-24T02:56:54.6448407Z {"level":"Level(-4)","ts":"2025-06-24T02:56:50Z","caller":"picker/max_score_picker.go:47","msg":"Selecting a pod with the max score from 1 candidates: [{Pod:{NamespacedName:llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq Address:10.244.0.24 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:decode pod-template-hash:5c5f96db4c]} MetricsState:{ActiveModels:map[] WaitingModels:map[] MaxActiveModels:0 RunningQueueSize:0 WaitingQueueSize:0 KVCacheUsagePercent:0 KvCacheMaxTokenCapacity:0 UpdateTime:2025-06-24 02:56:50.700765995 +0000 UTC m=+11.447934958}}]","x-request-id":"095c4e82-9dc7-4be7-9088-4bb508e278a9","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-pt8s89ylyl-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-pt8s89ylyl-vllm-sim-inference-pool-ip-3d1931d7.llm-d-pt8s89ylyl.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC1wdDhzODl5bHlsLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTg0Yzc5OWM5ZDQta3FqbnoKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXB0OHM4OXlseWwKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXB0OHM4OXlseWwvZGVwbG95bWVudHMvbGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXB0OHM4OXlseWwtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.20~llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz.llm-d-pt8s89ylyl~llm-d-pt8s89ylyl.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:095c4e82-9dc7-4be7-9088-4bb508e278a9]"} | |
| 2025-06-24T02:56:54.6468351Z {"level":"Level(-4)","ts":"2025-06-24T02:56:50Z","caller":"scheduling/scheduler.go:203","msg":"After running picker plugin","x-request-id":"095c4e82-9dc7-4be7-9088-4bb508e278a9","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-pt8s89ylyl-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-pt8s89ylyl-vllm-sim-inference-pool-ip-3d1931d7.llm-d-pt8s89ylyl.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC1wdDhzODl5bHlsLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTg0Yzc5OWM5ZDQta3FqbnoKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXB0OHM4OXlseWwKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXB0OHM4OXlseWwvZGVwbG95bWVudHMvbGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXB0OHM4OXlseWwtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.20~llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz.llm-d-pt8s89ylyl~llm-d-pt8s89ylyl.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:095c4e82-9dc7-4be7-9088-4bb508e278a9]","result":{"TargetPod":{"Pod":{"NamespacedName":{"Namespace":"llm-d-pt8s89ylyl","Name":"llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq"},"Address":"10.244.0.24","Labels":{"llm-d.ai/inferenceServing":"true","llm-d.ai/model":"food-review","llm-d.ai/role":"decode","pod-template-hash":"5c5f96db4c"},"ActiveModels":{},"WaitingModels":{},"MaxActiveModels":0,"RunningQueueSize":0,"WaitingQueueSize":0,"KVCacheUsagePercent":0,"KvCacheMaxTokenCapacity":0,"UpdateTime":"2025-06-24T02:56:50.700765995Z"},"Score":0.5}}} | |
| 2025-06-24T02:56:54.6497803Z {"level":"Level(-4)","ts":"2025-06-24T02:56:50Z","caller":"scheduling/scheduler.go:210","msg":"Running post-schedule plugin","x-request-id":"095c4e82-9dc7-4be7-9088-4bb508e278a9","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-pt8s89ylyl-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-pt8s89ylyl-vllm-sim-inference-pool-ip-3d1931d7.llm-d-pt8s89ylyl.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC1wdDhzODl5bHlsLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTg0Yzc5OWM5ZDQta3FqbnoKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXB0OHM4OXlseWwKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXB0OHM4OXlseWwvZGVwbG95bWVudHMvbGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXB0OHM4OXlseWwtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.20~llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz.llm-d-pt8s89ylyl~llm-d-pt8s89ylyl.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:095c4e82-9dc7-4be7-9088-4bb508e278a9]","plugin":"prefix-aware-scorer"} | |
| 2025-06-24T02:56:54.6527126Z {"level":"info","ts":"2025-06-24T02:56:50Z","logger":"prefix-aware-scorer","caller":"scorer/prefix_aware.go:106","msg":"PostResponse called","x-request-id":"095c4e82-9dc7-4be7-9088-4bb508e278a9","req":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-pt8s89ylyl-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-pt8s89ylyl-vllm-sim-inference-pool-ip-3d1931d7.llm-d-pt8s89ylyl.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.23 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC1wdDhzODl5bHlsLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTg0Yzc5OWM5ZDQta3FqbnoKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXB0OHM4OXlseWwKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXB0OHM4OXlseWwvZGVwbG95bWVudHMvbGxtLWQtcHQ4czg5eWx5bC1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXB0OHM4OXlseWwtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.20~llm-d-pt8s89ylyl-inference-gateway-istio-84c799c9d4-kqjnz.llm-d-pt8s89ylyl~llm-d-pt8s89ylyl.svc.cluster.local x-forwarded-for:10.244.0.23 x-forwarded-proto:http x-request-id:095c4e82-9dc7-4be7-9088-4bb508e278a9]","pod":"{Pod:{NamespacedName:llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq Address:10.244.0.24 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:decode pod-template-hash:5c5f96db4c]} MetricsState:{ActiveModels:map[] WaitingModels:map[] MaxActiveModels:0 RunningQueueSize:0 WaitingQueueSize:0 KVCacheUsagePercent:0 KvCacheMaxTokenCapacity:0 UpdateTime:2025-06-24 02:56:50.700765995 +0000 UTC m=+11.447934958}}"} | |
| 2025-06-24T02:56:54.6547058Z {"level":"Level(-2)","ts":"2025-06-24T02:56:50Z","caller":"requestcontrol/director.go:135","msg":"Request handled","x-request-id":"095c4e82-9dc7-4be7-9088-4bb508e278a9","model":"food-review","targetModel":"food-review","endpoint":"{NamespacedName:llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-vllm-sim-decode-5c5f96db4c-zlnrq Address:10.244.0.24 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:decode pod-template-hash:5c5f96db4c]}"} | |
| 2025-06-24T02:56:54.6551798Z {"level":"Level(-4)","ts":"2025-06-24T02:56:50Z","caller":"requestcontrol/director.go:150","msg":"LLM response assembled","x-request-id":"095c4e82-9dc7-4be7-9088-4bb508e278a9","response":{"RequestId":"095c4e82-9dc7-4be7-9088-4bb508e278a9","Headers":{":status":"200","content-length":"211","content-type":"application/json","date":"Tue, 24 Jun 2025 02:56:50 GMT","server":"fasthttp","x-envoy-upstream-service-time":"0"},"Body":"","IsStreaming":false,"EndOfStream":false}} | |
| 2025-06-24T02:56:54.6554012Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:54.6554524Z <== Logs of container llm-d-pt8s89ylyl-vllm-sim-epp-7978f9f65f-6lhvm | |
| 2025-06-24T02:56:54.6554953Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:54.6555365Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:54.6555852Z ==> Description of pod llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj | |
| 2025-06-24T02:56:54.6556336Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:54.6556963Z >>> kubectl --request-timeout=30s describe pod llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj --namespace llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:54.6585177Z Name: llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj | |
| 2025-06-24T02:56:54.6585729Z Namespace: llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:54.6586092Z Priority: 0 | |
| 2025-06-24T02:56:54.6586446Z Service Account: llm-d-pt8s89ylyl-vllm-sim-sa | |
| 2025-06-24T02:56:54.6586944Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T02:56:54.6587233Z Start Time: Tue, 24 Jun 2025 02:56:38 +0000 | |
| 2025-06-24T02:56:54.6587721Z Labels: llm-d.ai/inferenceServing=true | |
| 2025-06-24T02:56:54.6587990Z llm-d.ai/model=food-review | |
| 2025-06-24T02:56:54.6588230Z llm-d.ai/role=prefill | |
| 2025-06-24T02:56:54.6588478Z pod-template-hash=6b56fb4d89 | |
| 2025-06-24T02:56:54.6588724Z Annotations: <none> | |
| 2025-06-24T02:56:54.6588909Z Status: Running | |
| 2025-06-24T02:56:54.6589104Z IP: 10.244.0.22 | |
| 2025-06-24T02:56:54.6589354Z IPs: | |
| 2025-06-24T02:56:54.6589606Z IP: 10.244.0.22 | |
| 2025-06-24T02:56:54.6590142Z Controlled By: ReplicaSet/llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89 | |
| 2025-06-24T02:56:54.6590573Z Containers: | |
| 2025-06-24T02:56:54.6590727Z vllm: | |
| 2025-06-24T02:56:54.6591076Z Container ID: containerd://42b31e0831c815bebe42270ac98812a8cd1dd7ec3fd13e19be8b56ca2cf8ce4c | |
| 2025-06-24T02:56:54.6591537Z Image: ghcr.io/llm-d/llm-d-inference-sim:0.0.4 | |
| 2025-06-24T02:56:54.6592037Z Image ID: ghcr.io/llm-d/llm-d-inference-sim@sha256:5995c4dde42888844812359c121899c1d12e647588ed58fef206c3c653315338 | |
| 2025-06-24T02:56:54.6592744Z Port: 5557/TCP | |
| 2025-06-24T02:56:54.6592945Z Host Port: 0/TCP | |
| 2025-06-24T02:56:54.6593117Z Args: | |
| 2025-06-24T02:56:54.6593264Z --model | |
| 2025-06-24T02:56:54.6593416Z food-review | |
| 2025-06-24T02:56:54.6593576Z --port | |
| 2025-06-24T02:56:54.6593721Z 8000 | |
| 2025-06-24T02:56:54.6593873Z State: Running | |
| 2025-06-24T02:56:54.6594091Z Started: Tue, 24 Jun 2025 02:56:39 +0000 | |
| 2025-06-24T02:56:54.6594342Z Ready: True | |
| 2025-06-24T02:56:54.6594528Z Restart Count: 0 | |
| 2025-06-24T02:56:54.6594706Z Environment: | |
| 2025-06-24T02:56:54.6594872Z HOME: /home | |
| 2025-06-24T02:56:54.6595030Z Mounts: | |
| 2025-06-24T02:56:54.6595186Z /home from home (rw) | |
| 2025-06-24T02:56:54.6595517Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-l745t (ro) | |
| 2025-06-24T02:56:54.6595868Z Conditions: | |
| 2025-06-24T02:56:54.6596029Z Type Status | |
| 2025-06-24T02:56:54.6596287Z PodReadyToStartContainers True | |
| 2025-06-24T02:56:54.6596510Z Initialized True | |
| 2025-06-24T02:56:54.6596715Z Ready True | |
| 2025-06-24T02:56:54.6596924Z ContainersReady True | |
| 2025-06-24T02:56:54.6597134Z PodScheduled True | |
| 2025-06-24T02:56:54.6597334Z Volumes: | |
| 2025-06-24T02:56:54.6597517Z home: | |
| 2025-06-24T02:56:54.6597995Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T02:56:54.6598316Z Medium: | |
| 2025-06-24T02:56:54.6598496Z SizeLimit: <unset> | |
| 2025-06-24T02:56:54.6598694Z kube-api-access-l745t: | |
| 2025-06-24T02:56:54.6599013Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T02:56:54.6599368Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T02:56:54.6599607Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T02:56:54.6599855Z ConfigMapOptional: <nil> | |
| 2025-06-24T02:56:54.6600074Z DownwardAPI: true | |
| 2025-06-24T02:56:54.6600288Z QoS Class: BestEffort | |
| 2025-06-24T02:56:54.6600511Z Node-Selectors: <none> | |
| 2025-06-24T02:56:54.6600834Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T02:56:54.6601240Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T02:56:54.6601530Z Events: | |
| 2025-06-24T02:56:54.6601722Z Type Reason Age From Message | |
| 2025-06-24T02:56:54.6602110Z ---- ------ ---- ---- ------- | |
| 2025-06-24T02:56:54.6602934Z Normal Scheduled 16s default-scheduler Successfully assigned llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj to chart-testing-control-plane | |
| 2025-06-24T02:56:54.6603915Z Normal Pulled 15s kubelet Container image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" already present on machine | |
| 2025-06-24T02:56:54.6604493Z Normal Created 15s kubelet Created container vllm | |
| 2025-06-24T02:56:54.6605052Z Normal Started 15s kubelet Started container vllm | |
| 2025-06-24T02:56:54.6609077Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:54.6609805Z <== Description of pod llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj | |
| 2025-06-24T02:56:54.6610522Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:54.6611844Z >>> kubectl --request-timeout=30s get pods llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj --no-headers --namespace llm-d-pt8s89ylyl --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T02:56:54.7143496Z >>> kubectl --request-timeout=30s get pods llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj --no-headers --namespace llm-d-pt8s89ylyl --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T02:56:54.7643158Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:54.7644064Z ==> Logs of container llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj | |
| 2025-06-24T02:56:54.7644830Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:54.7645658Z >>> kubectl --request-timeout=30s logs llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj --namespace llm-d-pt8s89ylyl --container vllm | |
| 2025-06-24T02:56:54.8153967Z I0624 02:56:39.237632 1 cmd.go:36] "Start vllm simulator" | |
| 2025-06-24T02:56:54.8154613Z I0624 02:56:39.237757 1 simulator.go:135] "Server starting" port=8000 | |
| 2025-06-24T02:56:54.8174626Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:54.8175539Z <== Logs of container llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-52sxj | |
| 2025-06-24T02:56:54.8176284Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:54.8177020Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:54.8177693Z ==> Description of pod llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-l5lbz | |
| 2025-06-24T02:56:54.8178474Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:54.8179217Z >>> kubectl --request-timeout=30s describe pod llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-l5lbz --namespace llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:54.8741215Z Name: llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-l5lbz | |
| 2025-06-24T02:56:54.8741805Z Namespace: llm-d-pt8s89ylyl | |
| 2025-06-24T02:56:54.8742213Z Priority: 0 | |
| 2025-06-24T02:56:54.8742750Z Service Account: llm-d-pt8s89ylyl-vllm-sim-sa | |
| 2025-06-24T02:56:54.8743086Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T02:56:54.8743423Z Start Time: Tue, 24 Jun 2025 02:56:03 +0000 | |
| 2025-06-24T02:56:54.8743724Z Labels: llm-d.ai/inferenceServing=true | |
| 2025-06-24T02:56:54.8744006Z llm-d.ai/model=food-review | |
| 2025-06-24T02:56:54.8744255Z llm-d.ai/role=prefill | |
| 2025-06-24T02:56:54.8744510Z pod-template-hash=6b56fb4d89 | |
| 2025-06-24T02:56:54.8744774Z Annotations: <none> | |
| 2025-06-24T02:56:54.8745026Z Status: Terminating (lasts <invalid>) | |
| 2025-06-24T02:56:54.8745286Z Termination Grace Period: 30s | |
| 2025-06-24T02:56:54.8745639Z IP: 10.244.0.18 | |
| 2025-06-24T02:56:54.8745923Z IPs: | |
| 2025-06-24T02:56:54.8746080Z IP: 10.244.0.18 | |
| 2025-06-24T02:56:54.8746396Z Controlled By: ReplicaSet/llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89 | |
| 2025-06-24T02:56:54.8746731Z Containers: | |
| 2025-06-24T02:56:54.8746885Z vllm: | |
| 2025-06-24T02:56:54.8747532Z Container ID: containerd://bed00afe3a258110829a37c023756b10ae20fe60f2d036745ae0394135d14917 | |
| 2025-06-24T02:56:54.8747984Z Image: ghcr.io/llm-d/llm-d-inference-sim:0.0.4 | |
| 2025-06-24T02:56:54.8748478Z Image ID: ghcr.io/llm-d/llm-d-inference-sim@sha256:5995c4dde42888844812359c121899c1d12e647588ed58fef206c3c653315338 | |
| 2025-06-24T02:56:54.8748925Z Port: 5557/TCP | |
| 2025-06-24T02:56:54.8749136Z Host Port: 0/TCP | |
| 2025-06-24T02:56:54.8749321Z Args: | |
| 2025-06-24T02:56:54.8749473Z --model | |
| 2025-06-24T02:56:54.8749628Z food-review | |
| 2025-06-24T02:56:54.8749792Z --port | |
| 2025-06-24T02:56:54.8749941Z 8000 | |
| 2025-06-24T02:56:54.8750102Z State: Running | |
| 2025-06-24T02:56:54.8750313Z Started: Tue, 24 Jun 2025 02:56:11 +0000 | |
| 2025-06-24T02:56:54.8750577Z Ready: True | |
| 2025-06-24T02:56:54.8750758Z Restart Count: 0 | |
| 2025-06-24T02:56:54.8750926Z Environment: | |
| 2025-06-24T02:56:54.8751090Z HOME: /home | |
| 2025-06-24T02:56:54.8751251Z Mounts: | |
| 2025-06-24T02:56:54.8751409Z /home from home (rw) | |
| 2025-06-24T02:56:54.8751737Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-np787 (ro) | |
| 2025-06-24T02:56:54.8752097Z Conditions: | |
| 2025-06-24T02:56:54.8752254Z Type Status | |
| 2025-06-24T02:56:54.8752692Z PodReadyToStartContainers True | |
| 2025-06-24T02:56:54.8752924Z Initialized True | |
| 2025-06-24T02:56:54.8753129Z Ready True | |
| 2025-06-24T02:56:54.8753343Z ContainersReady True | |
| 2025-06-24T02:56:54.8753553Z PodScheduled True | |
| 2025-06-24T02:56:54.8753751Z Volumes: | |
| 2025-06-24T02:56:54.8753889Z home: | |
| 2025-06-24T02:56:54.8754135Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T02:56:54.8754437Z Medium: | |
| 2025-06-24T02:56:54.8754608Z SizeLimit: <unset> | |
| 2025-06-24T02:56:54.8754797Z kube-api-access-np787: | |
| 2025-06-24T02:56:54.8755117Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T02:56:54.8755478Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T02:56:54.8755717Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T02:56:54.8755971Z ConfigMapOptional: <nil> | |
| 2025-06-24T02:56:54.8756194Z DownwardAPI: true | |
| 2025-06-24T02:56:54.8756547Z QoS Class: BestEffort | |
| 2025-06-24T02:56:54.8756947Z Node-Selectors: <none> | |
| 2025-06-24T02:56:54.8757279Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T02:56:54.8757697Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T02:56:54.8757986Z Events: | |
| 2025-06-24T02:56:54.8758174Z Type Reason Age From Message | |
| 2025-06-24T02:56:54.8758443Z ---- ------ ---- ---- ------- | |
| 2025-06-24T02:56:54.8759116Z Normal Scheduled 51s default-scheduler Successfully assigned llm-d-pt8s89ylyl/llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-l5lbz to chart-testing-control-plane | |
| 2025-06-24T02:56:54.8759907Z Normal Pulling 50s kubelet Pulling image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" | |
| 2025-06-24T02:56:54.8760625Z Normal Pulled 43s kubelet Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" in 503ms (6.76s including waiting). Image size: 87011014 bytes. | |
| 2025-06-24T02:56:54.8761267Z Normal Created 43s kubelet Created container vllm | |
| 2025-06-24T02:56:54.8761688Z Normal Started 43s kubelet Started container vllm | |
| 2025-06-24T02:56:54.8762330Z Normal Killing 16s kubelet Stopping container vllm | |
| 2025-06-24T02:56:54.8763455Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:54.8765394Z <== Description of pod llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-l5lbz | |
| 2025-06-24T02:56:54.8766229Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:56:54.8767822Z >>> kubectl --request-timeout=30s get pods llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-l5lbz --no-headers --namespace llm-d-pt8s89ylyl --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T02:56:54.9257629Z >>> kubectl --request-timeout=30s get pods llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-l5lbz --no-headers --namespace llm-d-pt8s89ylyl --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T02:56:54.9768243Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:54.9768835Z ==> Logs of container llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-l5lbz | |
| 2025-06-24T02:56:54.9769621Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:54.9770582Z >>> kubectl --request-timeout=30s logs llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-l5lbz --namespace llm-d-pt8s89ylyl --container vllm | |
| 2025-06-24T02:56:55.0283422Z I0624 02:56:11.592054 1 cmd.go:36] "Start vllm simulator" | |
| 2025-06-24T02:56:55.0284068Z I0624 02:56:11.592316 1 simulator.go:135] "Server starting" port=8000 | |
| 2025-06-24T02:56:55.0284750Z I0624 02:56:38.635000 1 simulator.go:294] "reqProcessingWorker stopped:" worker id=5 | |
| 2025-06-24T02:56:55.0285640Z I0624 02:56:38.635024 1 simulator.go:294] "reqProcessingWorker stopped:" worker id=1 | |
| 2025-06-24T02:56:55.0286345Z I0624 02:56:38.635040 1 simulator.go:294] "reqProcessingWorker stopped:" worker id=4 | |
| 2025-06-24T02:56:55.0287066Z I0624 02:56:38.635052 1 simulator.go:294] "reqProcessingWorker stopped:" worker id=3 | |
| 2025-06-24T02:56:55.0287773Z I0624 02:56:38.634930 1 simulator.go:294] "reqProcessingWorker stopped:" worker id=2 | |
| 2025-06-24T02:56:55.0305531Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:55.0306487Z <== Logs of container llm-d-pt8s89ylyl-vllm-sim-prefill-6b56fb4d89-l5lbz | |
| 2025-06-24T02:56:55.0307222Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:56:55.0307813Z ======================================================================================================================== | |
| 2025-06-24T02:56:55.0308314Z Deleting release "llm-d-pt8s89ylyl"... | |
| 2025-06-24T02:56:55.0309021Z >>> helm uninstall llm-d-pt8s89ylyl --namespace llm-d-pt8s89ylyl --timeout 500s | |
| 2025-06-24T02:56:55.6185288Z release "llm-d-pt8s89ylyl" uninstalled | |
| 2025-06-24T02:56:55.6190417Z Deleting namespace "llm-d-pt8s89ylyl"... | |
| 2025-06-24T02:56:55.6196018Z >>> kubectl --request-timeout=30s delete namespace llm-d-pt8s89ylyl --timeout 180s | |
| 2025-06-24T02:56:55.6786178Z namespace "llm-d-pt8s89ylyl" deleted | |
| 2025-06-24T02:57:32.6291332Z >>> kubectl --request-timeout=30s get namespace llm-d-pt8s89ylyl | |
| 2025-06-24T02:57:32.6797140Z Namespace "llm-d-pt8s89ylyl" terminated. | |
| 2025-06-24T02:57:32.6800431Z Testing upgrades of chart "llm-d => (version: \"1.0.20\", path: \"charts/llm-d\")" relative to previous revision "llm-d => (version: \"1.0.20\", path: \"charts/llm-d\")"... | |
| 2025-06-24T02:57:32.6801270Z | |
| 2025-06-24T02:57:32.6801803Z Installing chart "llm-d => (version: \"1.0.20\", path: \"charts/llm-d\")" with values file "charts/llm-d/ci/default-values.yaml"... | |
| 2025-06-24T02:57:32.6802734Z | |
| 2025-06-24T02:57:32.6802930Z Creating namespace "llm-d-yo6n8jk1li"... | |
| 2025-06-24T02:57:32.6803509Z >>> kubectl --request-timeout=30s create namespace llm-d-yo6n8jk1li | |
| 2025-06-24T02:57:32.7242859Z namespace/llm-d-yo6n8jk1li created | |
| 2025-06-24T02:57:32.7279204Z >>> helm install llm-d-yo6n8jk1li charts/llm-d --namespace llm-d-yo6n8jk1li --wait --values charts/llm-d/ci/default-values.yaml --timeout 500s | |
| 2025-06-24T02:57:59.8305159Z NAME: llm-d-yo6n8jk1li | |
| 2025-06-24T02:57:59.8305612Z LAST DEPLOYED: Tue Jun 24 02:57:32 2025 | |
| 2025-06-24T02:57:59.8306181Z NAMESPACE: llm-d-yo6n8jk1li | |
| 2025-06-24T02:57:59.8306925Z STATUS: deployed | |
| 2025-06-24T02:57:59.8307213Z REVISION: 1 | |
| 2025-06-24T02:57:59.8307481Z NOTES: | |
| 2025-06-24T02:57:59.8307757Z Thank you for installing llm-d. | |
| 2025-06-24T02:57:59.8308025Z | |
| 2025-06-24T02:57:59.8308196Z Your release is named `llm-d-yo6n8jk1li`. | |
| 2025-06-24T02:57:59.8308487Z | |
| 2025-06-24T02:57:59.8308633Z To learn more about the release, try: | |
| 2025-06-24T02:57:59.8308895Z | |
| 2025-06-24T02:57:59.8308997Z ```bash | |
| 2025-06-24T02:57:59.8309330Z $ helm status llm-d-yo6n8jk1li | |
| 2025-06-24T02:57:59.8309568Z $ helm get all llm-d-yo6n8jk1li | |
| 2025-06-24T02:57:59.8309779Z ``` | |
| 2025-06-24T02:57:59.8309861Z | |
| 2025-06-24T02:57:59.8309865Z | |
| 2025-06-24T02:57:59.8309987Z Following presets are available to your users: | |
| 2025-06-24T02:57:59.8310178Z | |
| 2025-06-24T02:57:59.8310182Z | |
| 2025-06-24T02:57:59.8310186Z | |
| 2025-06-24T02:57:59.8310359Z | Name | Description | | |
| 2025-06-24T02:57:59.8310861Z | ----------------------------------------------------------------- | ----------------------------------------------------------------------------------------------- | | |
| 2025-06-24T02:57:59.8311394Z | basic-gpu-preset | Basic gpu inference | | |
| 2025-06-24T02:57:59.8312019Z | basic-gpu-with-nixl-preset | GPU inference with NIXL P/D KV transfer and cache offloading | | |
| 2025-06-24T02:57:59.8313158Z | basic-gpu-with-nixl-and-redis-lookup-preset | GPU inference with NIXL P/D KV transfer, cache offloading and Redis lookup server | | |
| 2025-06-24T02:57:59.8313849Z | basic-sim-preset | Basic simulation | | |
| 2025-06-24T02:57:59.8314147Z | |
| 2025-06-24T02:57:59.8314261Z To provision a `ModelService`, create a new CR: | |
| 2025-06-24T02:57:59.8314450Z | |
| 2025-06-24T02:57:59.8314511Z ```yaml | |
| 2025-06-24T02:57:59.8314674Z apiVersion: llm-d.ai/v1alpha1 | |
| 2025-06-24T02:57:59.8314888Z kind: ModelService | |
| 2025-06-24T02:57:59.8315053Z metadata: | |
| 2025-06-24T02:57:59.8315227Z name: <name> | |
| 2025-06-24T02:57:59.8315504Z spec: | |
| 2025-06-24T02:57:59.8315669Z decoupleScaling: false | |
| 2025-06-24T02:57:59.8315870Z baseConfigMapRef: | |
| 2025-06-24T02:57:59.8316417Z name: basic-gpu-with-nixl-and-redis-lookup-preset | |
| 2025-06-24T02:57:59.8316728Z routing: | |
| 2025-06-24T02:57:59.8316890Z modelName: <model_name> | |
| 2025-06-24T02:57:59.8317184Z modelArtifacts: | |
| 2025-06-24T02:57:59.8317409Z uri: pvc://<pvc_name>/<path_to_model> | |
| 2025-06-24T02:57:59.8317637Z decode: | |
| 2025-06-24T02:57:59.8317789Z replicas: 1 | |
| 2025-06-24T02:57:59.8317955Z containers: | |
| 2025-06-24T02:57:59.8318120Z - name: "vllm" | |
| 2025-06-24T02:57:59.8318281Z args: | |
| 2025-06-24T02:57:59.8318432Z - "--model" | |
| 2025-06-24T02:57:59.8318604Z - <model_name> | |
| 2025-06-24T02:57:59.8318805Z prefill: | |
| 2025-06-24T02:57:59.8319057Z replicas: 1 | |
| 2025-06-24T02:57:59.8319225Z containers: | |
| 2025-06-24T02:57:59.8319378Z - name: "vllm" | |
| 2025-06-24T02:57:59.8319539Z args: | |
| 2025-06-24T02:57:59.8319681Z - "--model" | |
| 2025-06-24T02:57:59.8319844Z - <model_name> | |
| 2025-06-24T02:57:59.8320002Z ``` | |
| 2025-06-24T02:57:59.8342813Z >>> kubectl --request-timeout=30s get deployments --namespace llm-d-yo6n8jk1li --selector --output jsonpath={.items[*].metadata.name} | |
| 2025-06-24T02:57:59.8881867Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-yo6n8jk1li-inference-gateway-istio --namespace llm-d-yo6n8jk1li | |
| 2025-06-24T02:57:59.9483391Z deployment "llm-d-yo6n8jk1li-inference-gateway-istio" successfully rolled out | |
| 2025-06-24T02:57:59.9508358Z >>> kubectl --request-timeout=30s get deployment llm-d-yo6n8jk1li-inference-gateway-istio --namespace llm-d-yo6n8jk1li --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T02:57:59.9994521Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-yo6n8jk1li-modelservice --namespace llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:00.0529928Z deployment "llm-d-yo6n8jk1li-modelservice" successfully rolled out | |
| 2025-06-24T02:58:00.0552597Z >>> kubectl --request-timeout=30s get deployment llm-d-yo6n8jk1li-modelservice --namespace llm-d-yo6n8jk1li --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T02:58:00.1051366Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-yo6n8jk1li-redis-master --namespace llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:00.1611912Z deployment "llm-d-yo6n8jk1li-redis-master" successfully rolled out | |
| 2025-06-24T02:58:00.1634194Z >>> kubectl --request-timeout=30s get deployment llm-d-yo6n8jk1li-redis-master --namespace llm-d-yo6n8jk1li --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T02:58:00.2148153Z >>> helm test llm-d-yo6n8jk1li --namespace llm-d-yo6n8jk1li --timeout 500s | |
| 2025-06-24T02:58:14.9565720Z NAME: llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:14.9567199Z LAST DEPLOYED: Tue Jun 24 02:57:32 2025 | |
| 2025-06-24T02:58:14.9574209Z NAMESPACE: llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:14.9574585Z STATUS: deployed | |
| 2025-06-24T02:58:14.9574929Z REVISION: 1 | |
| 2025-06-24T02:58:14.9575236Z TEST SUITE: llm-d-yo6n8jk1li-test-connection | |
| 2025-06-24T02:58:14.9575532Z Last Started: Tue Jun 24 02:58:00 2025 | |
| 2025-06-24T02:58:14.9575920Z Last Completed: Tue Jun 24 02:58:14 2025 | |
| 2025-06-24T02:58:14.9576177Z Phase: Succeeded | |
| 2025-06-24T02:58:14.9576431Z TEST SUITE: llm-d-yo6n8jk1li-vllm-sim | |
| 2025-06-24T02:58:14.9576782Z Last Started: Tue Jun 24 02:58:00 2025 | |
| 2025-06-24T02:58:14.9577018Z Last Completed: Tue Jun 24 02:58:00 2025 | |
| 2025-06-24T02:58:14.9577272Z Phase: Succeeded | |
| 2025-06-24T02:58:14.9577774Z TEST SUITE: llm-d-yo6n8jk1li-vllm-sim | |
| 2025-06-24T02:58:14.9578066Z Last Started: Tue Jun 24 02:58:00 2025 | |
| 2025-06-24T02:58:14.9578413Z Last Completed: Tue Jun 24 02:58:00 2025 | |
| 2025-06-24T02:58:14.9578651Z Phase: Succeeded | |
| 2025-06-24T02:58:14.9578856Z NOTES: | |
| 2025-06-24T02:58:14.9579028Z Thank you for installing llm-d. | |
| 2025-06-24T02:58:14.9579173Z | |
| 2025-06-24T02:58:14.9579265Z Your release is named `llm-d-yo6n8jk1li`. | |
| 2025-06-24T02:58:14.9579442Z | |
| 2025-06-24T02:58:14.9579530Z To learn more about the release, try: | |
| 2025-06-24T02:58:14.9579685Z | |
| 2025-06-24T02:58:14.9579752Z ```bash | |
| 2025-06-24T02:58:14.9579913Z $ helm status llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:14.9580441Z $ helm get all llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:14.9580657Z ``` | |
| 2025-06-24T02:58:14.9580746Z | |
| 2025-06-24T02:58:14.9580751Z | |
| 2025-06-24T02:58:14.9580867Z Following presets are available to your users: | |
| 2025-06-24T02:58:14.9581064Z | |
| 2025-06-24T02:58:14.9581068Z | |
| 2025-06-24T02:58:14.9581072Z | |
| 2025-06-24T02:58:14.9581254Z | Name | Description | | |
| 2025-06-24T02:58:14.9581736Z | ----------------------------------------------------------------- | ----------------------------------------------------------------------------------------------- | | |
| 2025-06-24T02:58:14.9582277Z | basic-gpu-preset | Basic gpu inference | | |
| 2025-06-24T02:58:14.9583213Z | basic-gpu-with-nixl-preset | GPU inference with NIXL P/D KV transfer and cache offloading | | |
| 2025-06-24T02:58:14.9584043Z | basic-gpu-with-nixl-and-redis-lookup-preset | GPU inference with NIXL P/D KV transfer, cache offloading and Redis lookup server | | |
| 2025-06-24T02:58:14.9584723Z | basic-sim-preset | Basic simulation | | |
| 2025-06-24T02:58:14.9585021Z | |
| 2025-06-24T02:58:14.9585130Z To provision a `ModelService`, create a new CR: | |
| 2025-06-24T02:58:14.9585508Z | |
| 2025-06-24T02:58:14.9585572Z ```yaml | |
| 2025-06-24T02:58:14.9585741Z apiVersion: llm-d.ai/v1alpha1 | |
| 2025-06-24T02:58:14.9585950Z kind: ModelService | |
| 2025-06-24T02:58:14.9586121Z metadata: | |
| 2025-06-24T02:58:14.9586265Z name: <name> | |
| 2025-06-24T02:58:14.9586421Z spec: | |
| 2025-06-24T02:58:14.9586581Z decoupleScaling: false | |
| 2025-06-24T02:58:14.9586780Z baseConfigMapRef: | |
| 2025-06-24T02:58:14.9587015Z name: basic-gpu-with-nixl-and-redis-lookup-preset | |
| 2025-06-24T02:58:14.9587298Z routing: | |
| 2025-06-24T02:58:14.9587461Z modelName: <model_name> | |
| 2025-06-24T02:58:14.9587659Z modelArtifacts: | |
| 2025-06-24T02:58:14.9587855Z uri: pvc://<pvc_name>/<path_to_model> | |
| 2025-06-24T02:58:14.9588076Z decode: | |
| 2025-06-24T02:58:14.9588327Z replicas: 1 | |
| 2025-06-24T02:58:14.9588529Z containers: | |
| 2025-06-24T02:58:14.9588696Z - name: "vllm" | |
| 2025-06-24T02:58:14.9588856Z args: | |
| 2025-06-24T02:58:14.9589009Z - "--model" | |
| 2025-06-24T02:58:14.9589173Z - <model_name> | |
| 2025-06-24T02:58:14.9589344Z prefill: | |
| 2025-06-24T02:58:14.9589497Z replicas: 1 | |
| 2025-06-24T02:58:14.9589658Z containers: | |
| 2025-06-24T02:58:14.9589816Z - name: "vllm" | |
| 2025-06-24T02:58:14.9589969Z args: | |
| 2025-06-24T02:58:14.9590116Z - "--model" | |
| 2025-06-24T02:58:14.9590276Z - <model_name> | |
| 2025-06-24T02:58:14.9590448Z ``` | |
| 2025-06-24T02:58:14.9597166Z >>> helm upgrade llm-d-yo6n8jk1li charts/llm-d --namespace llm-d-yo6n8jk1li --reuse-values --wait --timeout 500s | |
| 2025-06-24T02:58:16.3787371Z Error: UPGRADE FAILED: cannot patch "llm-d-yo6n8jk1li-vllm-sim" with kind DestinationRule: Internal error occurred: failed calling webhook "validation.istio.io": failed to call webhook: Post "https://istiod.istio-system.svc:443/validate?timeout=10s": dial tcp 10.96.121.7:443: connect: connection refused | |
| 2025-06-24T02:58:16.3788886Z ======================================================================================================================== | |
| 2025-06-24T02:58:16.3789259Z ........................................................................................................................ | |
| 2025-06-24T02:58:16.3789654Z ==> Events of namespace llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:16.3790012Z ........................................................................................................................ | |
| 2025-06-24T02:58:16.3790620Z >>> kubectl --request-timeout=30s get events --output wide --namespace llm-d-yo6n8jk1li --sort-by lastTimestamp | |
| 2025-06-24T02:58:16.4361975Z LAST SEEN TYPE REASON OBJECT SUBOBJECT SOURCE MESSAGE FIRST SEEN COUNT NAME | |
| 2025-06-24T02:58:16.4364330Z 43s Normal ScalingReplicaSet deployment/llm-d-yo6n8jk1li-modelservice deployment-controller Scaled up replica set llm-d-yo6n8jk1li-modelservice-84c47b46f to 1 43s 1 llm-d-yo6n8jk1li-modelservice.184bdb29fcfd26fc | |
| 2025-06-24T02:58:16.4366987Z 43s Normal ScalingReplicaSet deployment/llm-d-yo6n8jk1li-redis-master deployment-controller Scaled up replica set llm-d-yo6n8jk1li-redis-master-779b4cb946 to 1 43s 1 llm-d-yo6n8jk1li-redis-master.184bdb29fd33c679 | |
| 2025-06-24T02:58:16.4369740Z 43s Normal SuccessfulCreate replicaset/llm-d-yo6n8jk1li-redis-master-779b4cb946 replicaset-controller Created pod: llm-d-yo6n8jk1li-redis-master-779b4cb946-pt75g 43s 1 llm-d-yo6n8jk1li-redis-master-779b4cb946.184bdb29fe219859 | |
| 2025-06-24T02:58:16.4373213Z 43s Normal Pulled pod/llm-d-yo6n8jk1li-redis-master-779b4cb946-pt75g spec.containers{redis} kubelet, chart-testing-control-plane Container image "quay.io/sclorg/redis-7-c9s:c9s" already present on machine 43s 1 llm-d-yo6n8jk1li-redis-master-779b4cb946-pt75g.184bdb2a1751e725 | |
| 2025-06-24T02:58:16.4376535Z 43s Normal SuccessfulCreate replicaset/llm-d-yo6n8jk1li-inference-gateway-istio-c764d8f5c replicaset-controller Created pod: llm-d-yo6n8jk1li-inference-gateway-istio-c764d8f5c-mj9h6 43s 1 llm-d-yo6n8jk1li-inference-gateway-istio-c764d8f5c.184bdb2a05959903 | |
| 2025-06-24T02:58:16.4379739Z 43s Normal ScalingReplicaSet deployment/llm-d-yo6n8jk1li-inference-gateway-istio deployment-controller Scaled up replica set llm-d-yo6n8jk1li-inference-gateway-istio-c764d8f5c to 1 43s 1 llm-d-yo6n8jk1li-inference-gateway-istio.184bdb2a03ec202b | |
| 2025-06-24T02:58:16.4383108Z 43s Normal Scheduled pod/llm-d-yo6n8jk1li-modelservice-84c47b46f-4vpmh default-scheduler Successfully assigned llm-d-yo6n8jk1li/llm-d-yo6n8jk1li-modelservice-84c47b46f-4vpmh to chart-testing-control-plane 43s 1 llm-d-yo6n8jk1li-modelservice-84c47b46f-4vpmh.184bdb29feb2c7f7 | |
| 2025-06-24T02:58:16.4385913Z 43s Normal Scheduled pod/llm-d-yo6n8jk1li-redis-master-779b4cb946-pt75g default-scheduler Successfully assigned llm-d-yo6n8jk1li/llm-d-yo6n8jk1li-redis-master-779b4cb946-pt75g to chart-testing-control-plane 43s 1 llm-d-yo6n8jk1li-redis-master-779b4cb946-pt75g.184bdb29ff45a934 | |
| 2025-06-24T02:58:16.4388018Z 43s Normal Scheduled pod/llm-d-yo6n8jk1li-inference-gateway-istio-c764d8f5c-mj9h6 default-scheduler Successfully assigned llm-d-yo6n8jk1li/llm-d-yo6n8jk1li-inference-gateway-istio-c764d8f5c-mj9h6 to chart-testing-control-plane 43s 1 llm-d-yo6n8jk1li-inference-gateway-istio-c764d8f5c-mj9h6.184bdb2a06103e1d | |
| 2025-06-24T02:58:16.4389942Z 43s Normal SuccessfulCreate replicaset/llm-d-yo6n8jk1li-modelservice-84c47b46f replicaset-controller Created pod: llm-d-yo6n8jk1li-modelservice-84c47b46f-4vpmh 43s 1 llm-d-yo6n8jk1li-modelservice-84c47b46f.184bdb29fd79a407 | |
| 2025-06-24T02:58:16.4391992Z 42s Normal Pulled pod/llm-d-yo6n8jk1li-inference-gateway-istio-c764d8f5c-mj9h6 spec.containers{istio-proxy} kubelet, chart-testing-control-plane Container image "gcr.io/istio-testing/proxyv2:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d" already present on machine 42s 1 llm-d-yo6n8jk1li-inference-gateway-istio-c764d8f5c-mj9h6.184bdb2a1e10e654 | |
| 2025-06-24T02:58:16.4394414Z 42s Normal Started pod/llm-d-yo6n8jk1li-modelservice-84c47b46f-4vpmh spec.containers{manager} kubelet, chart-testing-control-plane Started container manager 42s 1 llm-d-yo6n8jk1li-modelservice-84c47b46f-4vpmh.184bdb2a2ece299e | |
| 2025-06-24T02:58:16.4396175Z 42s Normal Created pod/llm-d-yo6n8jk1li-inference-gateway-istio-c764d8f5c-mj9h6 spec.containers{istio-proxy} kubelet, chart-testing-control-plane Created container istio-proxy 42s 1 llm-d-yo6n8jk1li-inference-gateway-istio-c764d8f5c-mj9h6.184bdb2a1e875ebc | |
| 2025-06-24T02:58:16.4398247Z 42s Normal Pulling pod/llm-d-yo6n8jk1li-modelservice-84c47b46f-4vpmh spec.containers{manager} kubelet, chart-testing-control-plane Pulling image "ghcr.io/llm-d/llm-d-model-service:0.0.10" 42s 1 llm-d-yo6n8jk1li-modelservice-84c47b46f-4vpmh.184bdb2a19882ae8 | |
| 2025-06-24T02:58:16.4400178Z 42s Normal Started pod/llm-d-yo6n8jk1li-inference-gateway-istio-c764d8f5c-mj9h6 spec.containers{istio-proxy} kubelet, chart-testing-control-plane Started container istio-proxy 42s 1 llm-d-yo6n8jk1li-inference-gateway-istio-c764d8f5c-mj9h6.184bdb2a24d76ebd | |
| 2025-06-24T02:58:16.4402124Z 42s Normal Created pod/llm-d-yo6n8jk1li-redis-master-779b4cb946-pt75g spec.containers{redis} kubelet, chart-testing-control-plane Created container redis 42s 1 llm-d-yo6n8jk1li-redis-master-779b4cb946-pt75g.184bdb2a18319caf | |
| 2025-06-24T02:58:16.4404118Z 42s Normal Started pod/llm-d-yo6n8jk1li-redis-master-779b4cb946-pt75g spec.containers{redis} kubelet, chart-testing-control-plane Started container redis 42s 1 llm-d-yo6n8jk1li-redis-master-779b4cb946-pt75g.184bdb2a28b86cf8 | |
| 2025-06-24T02:58:16.4407032Z 42s Normal Pulled pod/llm-d-yo6n8jk1li-modelservice-84c47b46f-4vpmh spec.containers{manager} kubelet, chart-testing-control-plane Successfully pulled image "ghcr.io/llm-d/llm-d-model-service:0.0.10" in 97ms (97ms including waiting). Image size: 115030935 bytes. 42s 1 llm-d-yo6n8jk1li-modelservice-84c47b46f-4vpmh.184bdb2a1f51eca2 | |
| 2025-06-24T02:58:16.4410731Z 42s Normal Created pod/llm-d-yo6n8jk1li-modelservice-84c47b46f-4vpmh spec.containers{manager} kubelet, chart-testing-control-plane Created container manager 42s 1 llm-d-yo6n8jk1li-modelservice-84c47b46f-4vpmh.184bdb2a1fdeacac | |
| 2025-06-24T02:58:16.4414055Z 16s Normal Scheduled pod/llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2 default-scheduler Successfully assigned llm-d-yo6n8jk1li/llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2 to chart-testing-control-plane 16s 1 llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2.184bdb30566a19d4 | |
| 2025-06-24T02:58:16.4417167Z 16s Normal ScalingReplicaSet deployment/llm-d-yo6n8jk1li-vllm-sim-epp deployment-controller Scaled up replica set llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477 to 1 16s 1 llm-d-yo6n8jk1li-vllm-sim-epp.184bdb304f8dceca | |
| 2025-06-24T02:58:16.4419903Z 16s Normal ScalingReplicaSet deployment/llm-d-yo6n8jk1li-vllm-sim-prefill deployment-controller Scaled up replica set llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc to 1 16s 1 llm-d-yo6n8jk1li-vllm-sim-prefill.184bdb304d09fc4c | |
| 2025-06-24T02:58:16.4423383Z 16s Normal SuccessfulCreate replicaset/llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc replicaset-controller Created pod: llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz 16s 1 llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc.184bdb305f1118a7 | |
| 2025-06-24T02:58:16.4427256Z 16s Warning FailedCreate replicaset/llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc replicaset-controller Error creating: pods "llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-" is forbidden: error looking up service account llm-d-yo6n8jk1li/llm-d-yo6n8jk1li-vllm-sim-sa: serviceaccount "llm-d-yo6n8jk1li-vllm-sim-sa" not found 16s 5 llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc.184bdb304d470071 | |
| 2025-06-24T02:58:16.4431038Z 16s Normal Scheduled pod/llm-d-yo6n8jk1li-test-connection default-scheduler Successfully assigned llm-d-yo6n8jk1li/llm-d-yo6n8jk1li-test-connection to chart-testing-control-plane 16s 1 llm-d-yo6n8jk1li-test-connection.184bdb305871dcf6 | |
| 2025-06-24T02:58:16.4434848Z 16s Normal Scheduled pod/llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz default-scheduler Successfully assigned llm-d-yo6n8jk1li/llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz to chart-testing-control-plane 16s 1 llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz.184bdb305f548652 | |
| 2025-06-24T02:58:16.4438347Z 16s Normal SuccessfulCreate replicaset/llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477 replicaset-controller Created pod: llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477-gsx8s 16s 1 llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477.184bdb30517173f3 | |
| 2025-06-24T02:58:16.4441927Z 16s Warning FailedCreate replicaset/llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477 replicaset-controller Error creating: pods "llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477-" is forbidden: error looking up service account llm-d-yo6n8jk1li/llm-d-yo6n8jk1li-vllm-sim-epp-sa: serviceaccount "llm-d-yo6n8jk1li-vllm-sim-epp-sa" not found 16s 2 llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477.184bdb304fc37cb1 | |
| 2025-06-24T02:58:16.4446079Z 16s Normal Scheduled pod/llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477-gsx8s default-scheduler Successfully assigned llm-d-yo6n8jk1li/llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477-gsx8s to chart-testing-control-plane 16s 1 llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477-gsx8s.184bdb3051fa5f03 | |
| 2025-06-24T02:58:16.4449244Z 16s Normal ScalingReplicaSet deployment/llm-d-yo6n8jk1li-vllm-sim-decode deployment-controller Scaled up replica set llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5 to 1 16s 1 llm-d-yo6n8jk1li-vllm-sim-decode.184bdb304d6df7e3 | |
| 2025-06-24T02:58:16.4452628Z 16s Normal SuccessfulCreate replicaset/llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5 replicaset-controller Created pod: llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2 16s 1 llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5.184bdb30563c0a26 | |
| 2025-06-24T02:58:16.4456496Z 16s Warning FailedCreate replicaset/llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5 replicaset-controller Error creating: pods "llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-" is forbidden: error looking up service account llm-d-yo6n8jk1li/llm-d-yo6n8jk1li-vllm-sim-sa: serviceaccount "llm-d-yo6n8jk1li-vllm-sim-sa" not found 16s 4 llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5.184bdb304d9e8515 | |
| 2025-06-24T02:58:16.4460555Z 15s Normal Created pod/llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2 spec.initContainers{routing-proxy} kubelet, chart-testing-control-plane Created container routing-proxy 15s 1 llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2.184bdb307093b6ea | |
| 2025-06-24T02:58:16.4464404Z 15s Normal Pulled pod/llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477-gsx8s spec.containers{epp} kubelet, chart-testing-control-plane Successfully pulled image "ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4" in 119ms (119ms including waiting). Image size: 119587259 bytes. 15s 1 llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477-gsx8s.184bdb3073371a68 | |
| 2025-06-24T02:58:16.4468088Z 15s Normal Started pod/llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2 spec.containers{vllm} kubelet, chart-testing-control-plane Started container vllm 15s 1 llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2.184bdb3094aa9db8 | |
| 2025-06-24T02:58:16.4471117Z 15s Normal Pulling pod/llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477-gsx8s spec.containers{epp} kubelet, chart-testing-control-plane Pulling image "ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4" 15s 1 llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477-gsx8s.184bdb306c13118d | |
| 2025-06-24T02:58:16.4474407Z 15s Normal Started pod/llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz spec.containers{vllm} kubelet, chart-testing-control-plane Started container vllm 15s 1 llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz.184bdb307ffb3fe1 | |
| 2025-06-24T02:58:16.4477306Z 15s Normal Created pod/llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477-gsx8s spec.containers{epp} kubelet, chart-testing-control-plane Created container epp 15s 1 llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477-gsx8s.184bdb3074413a58 | |
| 2025-06-24T02:58:16.4480361Z 15s Normal Started pod/llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477-gsx8s spec.containers{epp} kubelet, chart-testing-control-plane Started container epp 15s 1 llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477-gsx8s.184bdb307b2d7d58 | |
| 2025-06-24T02:58:16.4483760Z 15s Normal Pulled pod/llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2 spec.initContainers{routing-proxy} kubelet, chart-testing-control-plane Container image "ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6" already present on machine 15s 1 llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2.184bdb307027ca65 | |
| 2025-06-24T02:58:16.4488014Z 15s Normal Pulled pod/llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2 spec.containers{vllm} kubelet, chart-testing-control-plane Container image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" already present on machine 15s 1 llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2.184bdb308caf7f4f | |
| 2025-06-24T02:58:16.4491084Z 15s Normal Created pod/llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2 spec.containers{vllm} kubelet, chart-testing-control-plane Created container vllm 15s 1 llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2.184bdb308d66e095 | |
| 2025-06-24T02:58:16.4494630Z 15s Normal Started pod/llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2 spec.initContainers{routing-proxy} kubelet, chart-testing-control-plane Started container routing-proxy 15s 1 llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2.184bdb3077b7039f | |
| 2025-06-24T02:58:16.4497904Z 15s Normal Pulled pod/llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz spec.containers{vllm} kubelet, chart-testing-control-plane Container image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" already present on machine 15s 1 llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz.184bdb307a3a14cc | |
| 2025-06-24T02:58:16.4501117Z 15s Normal Created pod/llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz spec.containers{vllm} kubelet, chart-testing-control-plane Created container vllm 15s 1 llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz.184bdb307ac18833 | |
| 2025-06-24T02:58:16.4504168Z 13s Normal Pulled pod/llm-d-yo6n8jk1li-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Container image "quay.io/curl/curl:latest" already present on machine 13s 1 llm-d-yo6n8jk1li-test-connection.184bdb31096be24f | |
| 2025-06-24T02:58:16.4507001Z 13s Normal Created pod/llm-d-yo6n8jk1li-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Created container curl 13s 1 llm-d-yo6n8jk1li-test-connection.184bdb310a31b2a4 | |
| 2025-06-24T02:58:16.4509407Z 6s Normal Started pod/llm-d-yo6n8jk1li-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Started container curl 6s 1 llm-d-yo6n8jk1li-test-connection.184bdb32922cbe7f | |
| 2025-06-24T02:58:16.4511871Z 4s Warning Unhealthy pod/llm-d-yo6n8jk1li-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Liveness probe failed: 4s 1 llm-d-yo6n8jk1li-test-connection.184bdb3327adbc07 | |
| 2025-06-24T02:58:16.4513538Z ........................................................................................................................ | |
| 2025-06-24T02:58:16.4514088Z <== Events of namespace llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:16.4514606Z ........................................................................................................................ | |
| 2025-06-24T02:58:16.4515815Z >>> kubectl --request-timeout=30s get pods --no-headers --namespace llm-d-yo6n8jk1li --selector --output jsonpath={.items[*].metadata.name} | |
| 2025-06-24T02:58:16.5037982Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:16.5039223Z ==> Description of pod llm-d-yo6n8jk1li-inference-gateway-istio-c764d8f5c-mj9h6 | |
| 2025-06-24T02:58:16.5039990Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:16.5040899Z >>> kubectl --request-timeout=30s describe pod llm-d-yo6n8jk1li-inference-gateway-istio-c764d8f5c-mj9h6 --namespace llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:16.5591110Z Name: llm-d-yo6n8jk1li-inference-gateway-istio-c764d8f5c-mj9h6 | |
| 2025-06-24T02:58:16.5591696Z Namespace: llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:16.5592097Z Priority: 0 | |
| 2025-06-24T02:58:16.5592747Z Service Account: llm-d-yo6n8jk1li-inference-gateway-istio | |
| 2025-06-24T02:58:16.5593290Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T02:58:16.5593753Z Start Time: Tue, 24 Jun 2025 02:57:33 +0000 | |
| 2025-06-24T02:58:16.5594244Z Labels: app.kubernetes.io/component=inference-gateway | |
| 2025-06-24T02:58:16.5594830Z app.kubernetes.io/gateway=llm-d-yo6n8jk1li-inference-gateway | |
| 2025-06-24T02:58:16.5595406Z app.kubernetes.io/instance=llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:16.5595865Z app.kubernetes.io/managed-by=Helm | |
| 2025-06-24T02:58:16.5596290Z app.kubernetes.io/name=llm-d | |
| 2025-06-24T02:58:16.5596701Z app.kubernetes.io/version=0.1 | |
| 2025-06-24T02:58:16.5597168Z gateway.istio.io/managed=istio.io-gateway-controller | |
| 2025-06-24T02:58:16.5597815Z gateway.networking.k8s.io/gateway-name=llm-d-yo6n8jk1li-inference-gateway | |
| 2025-06-24T02:58:16.5598385Z helm.sh/chart=llm-d-1.0.20 | |
| 2025-06-24T02:58:16.5598809Z istio.io/enable-inference-extproc=true | |
| 2025-06-24T02:58:16.5599231Z pod-template-hash=c764d8f5c | |
| 2025-06-24T02:58:16.5599785Z service.istio.io/canonical-name=llm-d-yo6n8jk1li-inference-gateway-istio | |
| 2025-06-24T02:58:16.5600384Z service.istio.io/canonical-revision=latest | |
| 2025-06-24T02:58:16.5601142Z sidecar.istio.io/inject=false | |
| 2025-06-24T02:58:16.5601582Z Annotations: istio.io/rev: default | |
| 2025-06-24T02:58:16.5601981Z meta.helm.sh/release-name: llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:16.5602575Z meta.helm.sh/release-namespace: llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:16.5603043Z networking.istio.io/service-type: ClusterIP | |
| 2025-06-24T02:58:16.5603484Z prometheus.io/path: /stats/prometheus | |
| 2025-06-24T02:58:16.5603896Z prometheus.io/port: 15020 | |
| 2025-06-24T02:58:16.5604272Z prometheus.io/scrape: true | |
| 2025-06-24T02:58:16.5604651Z Status: Running | |
| 2025-06-24T02:58:16.5604940Z IP: 10.244.0.27 | |
| 2025-06-24T02:58:16.5605237Z IPs: | |
| 2025-06-24T02:58:16.5605471Z IP: 10.244.0.27 | |
| 2025-06-24T02:58:16.5605974Z Controlled By: ReplicaSet/llm-d-yo6n8jk1li-inference-gateway-istio-c764d8f5c | |
| 2025-06-24T02:58:16.5606518Z Containers: | |
| 2025-06-24T02:58:16.5606767Z istio-proxy: | |
| 2025-06-24T02:58:16.5607351Z Container ID: containerd://6550e596b2b0fd738b4821a2b1001cfe3e1be3ce9169abcd8192d9a792fa792c | |
| 2025-06-24T02:58:16.5608262Z Image: gcr.io/istio-testing/proxyv2:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d | |
| 2025-06-24T02:58:16.5609243Z Image ID: gcr.io/istio-testing/proxyv2@sha256:f8b9447198a9e52e5c928cc735536a41ad416afa2a7a674056b1e24c5789607c | |
| 2025-06-24T02:58:16.5610003Z Ports: 15020/TCP, 15021/TCP, 15090/TCP | |
| 2025-06-24T02:58:16.5610406Z Host Ports: 0/TCP, 0/TCP, 0/TCP | |
| 2025-06-24T02:58:16.5610723Z Args: | |
| 2025-06-24T02:58:16.5611184Z proxy | |
| 2025-06-24T02:58:16.5611407Z router | |
| 2025-06-24T02:58:16.5611636Z --domain | |
| 2025-06-24T02:58:16.5611909Z $(POD_NAMESPACE).svc.cluster.local | |
| 2025-06-24T02:58:16.5612260Z --proxyLogLevel | |
| 2025-06-24T02:58:16.5612662Z warning | |
| 2025-06-24T02:58:16.5612943Z --proxyComponentLogLevel | |
| 2025-06-24T02:58:16.5613279Z misc:error | |
| 2025-06-24T02:58:16.5613554Z --log_output_level | |
| 2025-06-24T02:58:16.5613868Z default:info | |
| 2025-06-24T02:58:16.5614133Z State: Running | |
| 2025-06-24T02:58:16.5614469Z Started: Tue, 24 Jun 2025 02:57:34 +0000 | |
| 2025-06-24T02:58:16.5614848Z Ready: True | |
| 2025-06-24T02:58:16.5615139Z Restart Count: 0 | |
| 2025-06-24T02:58:16.5615427Z Limits: | |
| 2025-06-24T02:58:16.5615671Z cpu: 2 | |
| 2025-06-24T02:58:16.5615939Z memory: 1Gi | |
| 2025-06-24T02:58:16.5616202Z Requests: | |
| 2025-06-24T02:58:16.5616457Z cpu: 100m | |
| 2025-06-24T02:58:16.5616724Z memory: 128Mi | |
| 2025-06-24T02:58:16.5617588Z Readiness: http-get http://:15021/healthz/ready delay=0s timeout=1s period=15s #success=1 #failure=4 | |
| 2025-06-24T02:58:16.5618664Z Startup: http-get http://:15021/healthz/ready delay=1s timeout=1s period=1s #success=1 #failure=30 | |
| 2025-06-24T02:58:16.5619362Z Environment: | |
| 2025-06-24T02:58:16.5619673Z PILOT_CERT_PROVIDER: istiod | |
| 2025-06-24T02:58:16.5620168Z CA_ADDR: istiod.istio-system.svc:15012 | |
| 2025-06-24T02:58:16.5620914Z POD_NAME: llm-d-yo6n8jk1li-inference-gateway-istio-c764d8f5c-mj9h6 (v1:metadata.name) | |
| 2025-06-24T02:58:16.5621576Z POD_NAMESPACE: llm-d-yo6n8jk1li (v1:metadata.namespace) | |
| 2025-06-24T02:58:16.5622138Z INSTANCE_IP: (v1:status.podIP) | |
| 2025-06-24T02:58:16.5623027Z SERVICE_ACCOUNT: (v1:spec.serviceAccountName) | |
| 2025-06-24T02:58:16.5623554Z HOST_IP: (v1:status.hostIP) | |
| 2025-06-24T02:58:16.5624015Z ISTIO_CPU_LIMIT: 2 (limits.cpu) | |
| 2025-06-24T02:58:16.5624427Z PROXY_CONFIG: {} | |
| 2025-06-24T02:58:16.5624806Z | |
| 2025-06-24T02:58:16.5625167Z ISTIO_META_POD_PORTS: [] | |
| 2025-06-24T02:58:16.5625570Z ISTIO_META_APP_CONTAINERS: | |
| 2025-06-24T02:58:16.5626013Z GOMEMLIMIT: 1073741824 (limits.memory) | |
| 2025-06-24T02:58:16.5626728Z GOMAXPROCS: 2 (limits.cpu) | |
| 2025-06-24T02:58:16.5627211Z ISTIO_META_CLUSTER_ID: Kubernetes | |
| 2025-06-24T02:58:16.5627688Z ISTIO_META_NODE_NAME: (v1:spec.nodeName) | |
| 2025-06-24T02:58:16.5628164Z ISTIO_META_INTERCEPTION_MODE: REDIRECT | |
| 2025-06-24T02:58:16.5628766Z ISTIO_META_WORKLOAD_NAME: llm-d-yo6n8jk1li-inference-gateway-istio | |
| 2025-06-24T02:58:16.5629939Z ISTIO_META_OWNER: kubernetes://apis/apps/v1/namespaces/llm-d-yo6n8jk1li/deployments/llm-d-yo6n8jk1li-inference-gateway-istio | |
| 2025-06-24T02:58:16.5630885Z ISTIO_META_MESH_ID: cluster.local | |
| 2025-06-24T02:58:16.5631322Z TRUST_DOMAIN: cluster.local | |
| 2025-06-24T02:58:16.5631698Z Mounts: | |
| 2025-06-24T02:58:16.5632003Z /etc/istio/pod from istio-podinfo (rw) | |
| 2025-06-24T02:58:16.5632601Z /etc/istio/proxy from istio-envoy (rw) | |
| 2025-06-24T02:58:16.5633033Z /var/lib/istio/data from istio-data (rw) | |
| 2025-06-24T02:58:16.5633578Z /var/run/secrets/credential-uds from credential-socket (rw) | |
| 2025-06-24T02:58:16.5634147Z /var/run/secrets/istio from istiod-ca-cert (rw) | |
| 2025-06-24T02:58:16.5634827Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-sdpng (ro) | |
| 2025-06-24T02:58:16.5635481Z /var/run/secrets/tokens from istio-token (rw) | |
| 2025-06-24T02:58:16.5636105Z /var/run/secrets/workload-spiffe-credentials from workload-certs (rw) | |
| 2025-06-24T02:58:16.5636840Z /var/run/secrets/workload-spiffe-uds from workload-socket (rw) | |
| 2025-06-24T02:58:16.5637356Z Conditions: | |
| 2025-06-24T02:58:16.5637849Z Type Status | |
| 2025-06-24T02:58:16.5638243Z PodReadyToStartContainers True | |
| 2025-06-24T02:58:16.5638643Z Initialized True | |
| 2025-06-24T02:58:16.5639000Z Ready True | |
| 2025-06-24T02:58:16.5639384Z ContainersReady True | |
| 2025-06-24T02:58:16.5639755Z PodScheduled True | |
| 2025-06-24T02:58:16.5640090Z Volumes: | |
| 2025-06-24T02:58:16.5640357Z workload-socket: | |
| 2025-06-24T02:58:16.5640817Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T02:58:16.5641336Z Medium: | |
| 2025-06-24T02:58:16.5641604Z SizeLimit: <unset> | |
| 2025-06-24T02:58:16.5641907Z credential-socket: | |
| 2025-06-24T02:58:16.5642522Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T02:58:16.5643062Z Medium: | |
| 2025-06-24T02:58:16.5643342Z SizeLimit: <unset> | |
| 2025-06-24T02:58:16.5643650Z workload-certs: | |
| 2025-06-24T02:58:16.5644103Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T02:58:16.5644629Z Medium: | |
| 2025-06-24T02:58:16.5644909Z SizeLimit: <unset> | |
| 2025-06-24T02:58:16.5645190Z istio-envoy: | |
| 2025-06-24T02:58:16.5645613Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T02:58:16.5646106Z Medium: Memory | |
| 2025-06-24T02:58:16.5646394Z SizeLimit: <unset> | |
| 2025-06-24T02:58:16.5646683Z istio-data: | |
| 2025-06-24T02:58:16.5647103Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T02:58:16.5647602Z Medium: | |
| 2025-06-24T02:58:16.5647868Z SizeLimit: <unset> | |
| 2025-06-24T02:58:16.5648156Z istio-podinfo: | |
| 2025-06-24T02:58:16.5648590Z Type: DownwardAPI (a volume populated by information about the pod) | |
| 2025-06-24T02:58:16.5649096Z Items: | |
| 2025-06-24T02:58:16.5649374Z metadata.labels -> labels | |
| 2025-06-24T02:58:16.5649758Z metadata.annotations -> annotations | |
| 2025-06-24T02:58:16.5650169Z istio-token: | |
| 2025-06-24T02:58:16.5650664Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T02:58:16.5651272Z TokenExpirationSeconds: 43200 | |
| 2025-06-24T02:58:16.5651642Z istiod-ca-cert: | |
| 2025-06-24T02:58:16.5652039Z Type: ConfigMap (a volume populated by a ConfigMap) | |
| 2025-06-24T02:58:16.5652703Z Name: istio-ca-root-cert | |
| 2025-06-24T02:58:16.5653083Z Optional: false | |
| 2025-06-24T02:58:16.5653727Z kube-api-access-sdpng: | |
| 2025-06-24T02:58:16.5654274Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T02:58:16.5654893Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T02:58:16.5655290Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T02:58:16.5655708Z ConfigMapOptional: <nil> | |
| 2025-06-24T02:58:16.5656093Z DownwardAPI: true | |
| 2025-06-24T02:58:16.5656472Z QoS Class: Burstable | |
| 2025-06-24T02:58:16.5656858Z Node-Selectors: <none> | |
| 2025-06-24T02:58:16.5657438Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T02:58:16.5658168Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T02:58:16.5658710Z Events: | |
| 2025-06-24T02:58:16.5659053Z Type Reason Age From Message | |
| 2025-06-24T02:58:16.5659521Z ---- ------ ---- ---- ------- | |
| 2025-06-24T02:58:16.5660723Z Normal Scheduled 43s default-scheduler Successfully assigned llm-d-yo6n8jk1li/llm-d-yo6n8jk1li-inference-gateway-istio-c764d8f5c-mj9h6 to chart-testing-control-plane | |
| 2025-06-24T02:58:16.5662692Z Normal Pulled 42s kubelet Container image "gcr.io/istio-testing/proxyv2:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d" already present on machine | |
| 2025-06-24T02:58:16.5663843Z Normal Created 42s kubelet Created container istio-proxy | |
| 2025-06-24T02:58:16.5664537Z Normal Started 42s kubelet Started container istio-proxy | |
| 2025-06-24T02:58:16.5665445Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:16.5666215Z <== Description of pod llm-d-yo6n8jk1li-inference-gateway-istio-c764d8f5c-mj9h6 | |
| 2025-06-24T02:58:16.5666956Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:16.5668372Z >>> kubectl --request-timeout=30s get pods llm-d-yo6n8jk1li-inference-gateway-istio-c764d8f5c-mj9h6 --no-headers --namespace llm-d-yo6n8jk1li --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T02:58:16.6220431Z >>> kubectl --request-timeout=30s get pods llm-d-yo6n8jk1li-inference-gateway-istio-c764d8f5c-mj9h6 --no-headers --namespace llm-d-yo6n8jk1li --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T02:58:16.6777129Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:16.6777960Z ==> Logs of container llm-d-yo6n8jk1li-inference-gateway-istio-c764d8f5c-mj9h6 | |
| 2025-06-24T02:58:16.6778587Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:16.6779495Z >>> kubectl --request-timeout=30s logs llm-d-yo6n8jk1li-inference-gateway-istio-c764d8f5c-mj9h6 --namespace llm-d-yo6n8jk1li --container istio-proxy | |
| 2025-06-24T02:58:16.7318611Z 2025-06-24T02:57:34.223471Z info FLAG: --concurrency="0" | |
| 2025-06-24T02:58:16.7319208Z 2025-06-24T02:57:34.223978Z info FLAG: --domain="llm-d-yo6n8jk1li.svc.cluster.local" | |
| 2025-06-24T02:58:16.7319687Z 2025-06-24T02:57:34.224026Z info FLAG: --help="false" | |
| 2025-06-24T02:58:16.7320019Z 2025-06-24T02:57:34.224035Z info FLAG: --log_as_json="false" | |
| 2025-06-24T02:58:16.7320531Z 2025-06-24T02:57:34.224039Z info FLAG: --log_caller="" | |
| 2025-06-24T02:58:16.7321128Z 2025-06-24T02:57:34.224042Z info FLAG: --log_output_level="default:info" | |
| 2025-06-24T02:58:16.7322742Z 2025-06-24T02:57:34.224046Z info FLAG: --log_stacktrace_level="default:none" | |
| 2025-06-24T02:58:16.7323384Z 2025-06-24T02:57:34.224058Z info FLAG: --log_target="[stdout]" | |
| 2025-06-24T02:58:16.7324066Z 2025-06-24T02:57:34.224062Z info FLAG: --meshConfig="./etc/istio/config/mesh" | |
| 2025-06-24T02:58:16.7324857Z 2025-06-24T02:57:34.224068Z info FLAG: --outlierLogPath="" | |
| 2025-06-24T02:58:16.7325499Z 2025-06-24T02:57:34.224071Z info FLAG: --profiling="true" | |
| 2025-06-24T02:58:16.7326367Z 2025-06-24T02:57:34.224074Z info FLAG: --proxyComponentLogLevel="misc:error" | |
| 2025-06-24T02:58:16.7326999Z 2025-06-24T02:57:34.224078Z info FLAG: --proxyLogLevel="warning" | |
| 2025-06-24T02:58:16.7327576Z 2025-06-24T02:57:34.224082Z info FLAG: --serviceCluster="istio-proxy" | |
| 2025-06-24T02:58:16.7328109Z 2025-06-24T02:57:34.224085Z info FLAG: --stsPort="0" | |
| 2025-06-24T02:58:16.7328576Z 2025-06-24T02:57:34.224089Z info FLAG: --templateFile="" | |
| 2025-06-24T02:58:16.7329083Z 2025-06-24T02:57:34.224092Z info FLAG: --tokenManagerPlugin="" | |
| 2025-06-24T02:58:16.7329596Z 2025-06-24T02:57:34.224096Z info FLAG: --vklog="0" | |
| 2025-06-24T02:58:16.7330554Z 2025-06-24T02:57:34.224100Z info Version 1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d-9befed2f1439d883120f8de70fd70d84ca0ebc3d-Clean | |
| 2025-06-24T02:58:16.7331635Z 2025-06-24T02:57:34.224108Z info Set max file descriptors (ulimit -n) to: 1048576 | |
| 2025-06-24T02:58:16.7333155Z 2025-06-24T02:57:34.224302Z info Proxy role ips=[10.244.0.27] type=router id=llm-d-yo6n8jk1li-inference-gateway-istio-c764d8f5c-mj9h6.llm-d-yo6n8jk1li domain=llm-d-yo6n8jk1li.svc.cluster.local | |
| 2025-06-24T02:58:16.7334364Z 2025-06-24T02:57:34.224355Z info Apply proxy config from env {} | |
| 2025-06-24T02:58:16.7334706Z | |
| 2025-06-24T02:58:16.7334976Z 2025-06-24T02:57:34.225085Z info cpu limit detected as 2, setting concurrency | |
| 2025-06-24T02:58:16.7335658Z 2025-06-24T02:57:34.225280Z info Effective config: binaryPath: /usr/local/bin/envoy | |
| 2025-06-24T02:58:16.7336192Z concurrency: 2 | |
| 2025-06-24T02:58:16.7336478Z configPath: ./etc/istio/proxy | |
| 2025-06-24T02:58:16.7337054Z controlPlaneAuthPolicy: MUTUAL_TLS | |
| 2025-06-24T02:58:16.7337480Z discoveryAddress: istiod.istio-system.svc:15012 | |
| 2025-06-24T02:58:16.7337884Z drainDuration: 45s | |
| 2025-06-24T02:58:16.7338181Z proxyAdminPort: 15000 | |
| 2025-06-24T02:58:16.7338490Z serviceCluster: istio-proxy | |
| 2025-06-24T02:58:16.7338811Z statNameLength: 189 | |
| 2025-06-24T02:58:16.7339086Z statusPort: 15020 | |
| 2025-06-24T02:58:16.7339388Z terminationDrainDuration: 5s | |
| 2025-06-24T02:58:16.7339616Z | |
| 2025-06-24T02:58:16.7339835Z 2025-06-24T02:57:34.225300Z info JWT policy is third-party-jwt | |
| 2025-06-24T02:58:16.7340566Z 2025-06-24T02:57:34.225305Z info using credential fetcher of JWT type in cluster.local trust domain | |
| 2025-06-24T02:58:16.7341276Z 2025-06-24T02:57:34.225557Z info platform detected is Azure | |
| 2025-06-24T02:58:16.7341813Z 2025-06-24T02:57:34.239500Z info Starting default Istio SDS Server | |
| 2025-06-24T02:58:16.7342666Z 2025-06-24T02:57:34.239563Z info CA Endpoint istiod.istio-system.svc:15012, provider Citadel | |
| 2025-06-24T02:58:16.7343671Z 2025-06-24T02:57:34.239612Z info Using CA istiod.istio-system.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem | |
| 2025-06-24T02:58:16.7344498Z 2025-06-24T02:57:34.240450Z info Opening status port 15020 | |
| 2025-06-24T02:58:16.7345361Z 2025-06-24T02:57:34.240773Z info xdsproxy Initializing with upstream address "istiod.istio-system.svc:15012" and cluster "Kubernetes" | |
| 2025-06-24T02:58:16.7346257Z 2025-06-24T02:57:34.241388Z info sds Starting SDS grpc server | |
| 2025-06-24T02:58:16.7347122Z 2025-06-24T02:57:34.241445Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" | |
| 2025-06-24T02:58:16.7348015Z 2025-06-24T02:57:34.242391Z info Pilot SAN: [istiod.istio-system.svc] | |
| 2025-06-24T02:58:16.7348581Z 2025-06-24T02:57:34.243339Z info Starting proxy agent | |
| 2025-06-24T02:58:16.7350597Z 2025-06-24T02:57:34.243406Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] | |
| 2025-06-24T02:58:16.7354255Z 2025-06-24T02:57:34.316938Z warning envoy main external/envoy/source/server/server.cc:874 Usage of the deprecated runtime key overload.global_downstream_max_connections, consider switching to `envoy.resource_monitors.global_downstream_max_connections` instead.This runtime key will be removed in future. thread=18 | |
| 2025-06-24T02:58:16.7357207Z 2025-06-24T02:57:34.317280Z warning envoy main external/envoy/source/server/server.cc:970 There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. thread=18 | |
| 2025-06-24T02:58:16.7359249Z 2025-06-24T02:57:34.322231Z info xdsproxy connected to delta upstream XDS server: istiod.istio-system.svc:15012 id=1 | |
| 2025-06-24T02:58:16.7360138Z 2025-06-24T02:57:34.341027Z info ads ADS: new connection for node:1 | |
| 2025-06-24T02:58:16.7360772Z 2025-06-24T02:57:34.342099Z info ads ADS: new connection for node:2 | |
| 2025-06-24T02:58:16.7361761Z 2025-06-24T02:57:34.394023Z info cache generated new workload certificate resourceName=default latency=152.45955ms ttl=23h59m59.605980747s | |
| 2025-06-24T02:58:16.7363040Z 2025-06-24T02:57:34.394391Z info cache Root cert has changed, start rotating root cert | |
| 2025-06-24T02:58:16.7363974Z 2025-06-24T02:57:34.394426Z info cache returned workload trust anchor from cache ttl=23h59m59.605575412s | |
| 2025-06-24T02:58:16.7364923Z 2025-06-24T02:57:34.394471Z info cache returned workload certificate from cache ttl=23h59m59.605530659s | |
| 2025-06-24T02:58:16.7365867Z 2025-06-24T02:57:34.394608Z info cache returned workload trust anchor from cache ttl=23h59m59.605395197s | |
| 2025-06-24T02:58:16.7366828Z 2025-06-24T02:57:34.394794Z info cache returned workload trust anchor from cache ttl=23h59m59.605207207s | |
| 2025-06-24T02:58:16.7367627Z 2025-06-24T02:57:35.013830Z info Readiness succeeded in 792.348628ms | |
| 2025-06-24T02:58:16.7368469Z 2025-06-24T02:57:35.014130Z info Envoy proxy is ready | |
| 2025-06-24T02:58:16.7369856Z 2025-06-24T02:58:00.609065Z warn xdsproxy upstream terminated with unexpected error rpc error: code = Unavailable desc = error reading from server: read tcp 10.244.0.27:33742->10.96.121.7:15012: read: connection reset by peer id=1 | |
| 2025-06-24T02:58:16.7371363Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:16.7372187Z <== Logs of container llm-d-yo6n8jk1li-inference-gateway-istio-c764d8f5c-mj9h6 | |
| 2025-06-24T02:58:16.7373160Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:16.7373888Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:16.7374614Z ==> Description of pod llm-d-yo6n8jk1li-modelservice-84c47b46f-4vpmh | |
| 2025-06-24T02:58:16.7375302Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:16.7376265Z >>> kubectl --request-timeout=30s describe pod llm-d-yo6n8jk1li-modelservice-84c47b46f-4vpmh --namespace llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:16.7923408Z Name: llm-d-yo6n8jk1li-modelservice-84c47b46f-4vpmh | |
| 2025-06-24T02:58:16.7925923Z Namespace: llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:16.7926331Z Priority: 0 | |
| 2025-06-24T02:58:16.7926818Z Service Account: llm-d-yo6n8jk1li-llm-d-yo6n8jk1li-modelservice | |
| 2025-06-24T02:58:16.7927523Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T02:58:16.7928023Z Start Time: Tue, 24 Jun 2025 02:57:33 +0000 | |
| 2025-06-24T02:58:16.7928568Z Labels: app.kubernetes.io/component=modelservice | |
| 2025-06-24T02:58:16.7929084Z app.kubernetes.io/instance=llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:16.7929603Z app.kubernetes.io/managed-by=Helm | |
| 2025-06-24T02:58:16.7930048Z app.kubernetes.io/name=llm-d | |
| 2025-06-24T02:58:16.7930496Z app.kubernetes.io/version=0.1 | |
| 2025-06-24T02:58:16.7930872Z control-plane=controller-manager | |
| 2025-06-24T02:58:16.7931137Z helm.sh/chart=llm-d-1.0.20 | |
| 2025-06-24T02:58:16.7931391Z pod-template-hash=84c47b46f | |
| 2025-06-24T02:58:16.7931647Z Annotations: <none> | |
| 2025-06-24T02:58:16.7932155Z Status: Running | |
| 2025-06-24T02:58:16.7932577Z SeccompProfile: RuntimeDefault | |
| 2025-06-24T02:58:16.7932817Z IP: 10.244.0.25 | |
| 2025-06-24T02:58:16.7933001Z IPs: | |
| 2025-06-24T02:58:16.7933151Z IP: 10.244.0.25 | |
| 2025-06-24T02:58:16.7933436Z Controlled By: ReplicaSet/llm-d-yo6n8jk1li-modelservice-84c47b46f | |
| 2025-06-24T02:58:16.7933750Z Containers: | |
| 2025-06-24T02:58:16.7933903Z manager: | |
| 2025-06-24T02:58:16.7934255Z Container ID: containerd://593663ff8a966eca841d8679bb0059adf41660060776bf9b2316f073c753e980 | |
| 2025-06-24T02:58:16.7934719Z Image: ghcr.io/llm-d/llm-d-model-service:0.0.10 | |
| 2025-06-24T02:58:16.7935251Z Image ID: ghcr.io/llm-d/llm-d-model-service@sha256:4d38789615184aa173eaf0c085ecd7f3dc0f3970af5e97ecb4b25fdfcf54b82e | |
| 2025-06-24T02:58:16.7935709Z Port: <none> | |
| 2025-06-24T02:58:16.7935899Z Host Port: <none> | |
| 2025-06-24T02:58:16.7936076Z Command: | |
| 2025-06-24T02:58:16.7936230Z /manager | |
| 2025-06-24T02:58:16.7936382Z Args: | |
| 2025-06-24T02:58:16.7936542Z --leader-elect=false | |
| 2025-06-24T02:58:16.7936755Z --health-probe-bind-address=:8081 | |
| 2025-06-24T02:58:16.7936998Z --epp-cluster-role | |
| 2025-06-24T02:58:16.7937234Z llm-d-yo6n8jk1li-modelservice-endpoint-picker | |
| 2025-06-24T02:58:16.7937510Z --epp-pull-secrets | |
| 2025-06-24T02:58:16.7937684Z | |
| 2025-06-24T02:58:16.7937839Z --pd-pull-secrets | |
| 2025-06-24T02:58:16.7938012Z | |
| 2025-06-24T02:58:16.7938155Z State: Running | |
| 2025-06-24T02:58:16.7938361Z Started: Tue, 24 Jun 2025 02:57:34 +0000 | |
| 2025-06-24T02:58:16.7938756Z Ready: True | |
| 2025-06-24T02:58:16.7938935Z Restart Count: 0 | |
| 2025-06-24T02:58:16.7939099Z Limits: | |
| 2025-06-24T02:58:16.7939252Z cpu: 250m | |
| 2025-06-24T02:58:16.7939415Z memory: 250Mi | |
| 2025-06-24T02:58:16.7939583Z Requests: | |
| 2025-06-24T02:58:16.7939738Z cpu: 100m | |
| 2025-06-24T02:58:16.7939910Z memory: 100Mi | |
| 2025-06-24T02:58:16.7940464Z Liveness: http-get http://:8081/healthz delay=15s timeout=1s period=20s #success=1 #failure=3 | |
| 2025-06-24T02:58:16.7941107Z Readiness: http-get http://:8081/readyz delay=5s timeout=1s period=10s #success=1 #failure=3 | |
| 2025-06-24T02:58:16.7941494Z Environment: <none> | |
| 2025-06-24T02:58:16.7941670Z Mounts: | |
| 2025-06-24T02:58:16.7941968Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-nxlxp (ro) | |
| 2025-06-24T02:58:16.7942317Z Conditions: | |
| 2025-06-24T02:58:16.7942625Z Type Status | |
| 2025-06-24T02:58:16.7942864Z PodReadyToStartContainers True | |
| 2025-06-24T02:58:16.7943090Z Initialized True | |
| 2025-06-24T02:58:16.7943296Z Ready True | |
| 2025-06-24T02:58:16.7943498Z ContainersReady True | |
| 2025-06-24T02:58:16.7943707Z PodScheduled True | |
| 2025-06-24T02:58:16.7943897Z Volumes: | |
| 2025-06-24T02:58:16.7944060Z kube-api-access-nxlxp: | |
| 2025-06-24T02:58:16.7944381Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T02:58:16.7945125Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T02:58:16.7945800Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T02:58:16.7946300Z ConfigMapOptional: <nil> | |
| 2025-06-24T02:58:16.7946707Z DownwardAPI: true | |
| 2025-06-24T02:58:16.7947042Z QoS Class: Burstable | |
| 2025-06-24T02:58:16.7947443Z Node-Selectors: <none> | |
| 2025-06-24T02:58:16.7947870Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T02:58:16.7948294Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T02:58:16.7948578Z Events: | |
| 2025-06-24T02:58:16.7948766Z Type Reason Age From Message | |
| 2025-06-24T02:58:16.7949072Z ---- ------ ---- ---- ------- | |
| 2025-06-24T02:58:16.7950311Z Normal Scheduled 43s default-scheduler Successfully assigned llm-d-yo6n8jk1li/llm-d-yo6n8jk1li-modelservice-84c47b46f-4vpmh to chart-testing-control-plane | |
| 2025-06-24T02:58:16.7951480Z Normal Pulling 42s kubelet Pulling image "ghcr.io/llm-d/llm-d-model-service:0.0.10" | |
| 2025-06-24T02:58:16.7952633Z Normal Pulled 42s kubelet Successfully pulled image "ghcr.io/llm-d/llm-d-model-service:0.0.10" in 97ms (97ms including waiting). Image size: 115030935 bytes. | |
| 2025-06-24T02:58:16.7953353Z Normal Created 42s kubelet Created container manager | |
| 2025-06-24T02:58:16.7953724Z Normal Started 42s kubelet Started container manager | |
| 2025-06-24T02:58:16.7954106Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:16.7954494Z <== Description of pod llm-d-yo6n8jk1li-modelservice-84c47b46f-4vpmh | |
| 2025-06-24T02:58:16.7954868Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:16.7955609Z >>> kubectl --request-timeout=30s get pods llm-d-yo6n8jk1li-modelservice-84c47b46f-4vpmh --no-headers --namespace llm-d-yo6n8jk1li --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T02:58:16.8466359Z >>> kubectl --request-timeout=30s get pods llm-d-yo6n8jk1li-modelservice-84c47b46f-4vpmh --no-headers --namespace llm-d-yo6n8jk1li --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T02:58:16.8958655Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:16.8959835Z ==> Logs of container llm-d-yo6n8jk1li-modelservice-84c47b46f-4vpmh | |
| 2025-06-24T02:58:16.8960493Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:16.8961246Z >>> kubectl --request-timeout=30s logs llm-d-yo6n8jk1li-modelservice-84c47b46f-4vpmh --namespace llm-d-yo6n8jk1li --container manager | |
| 2025-06-24T02:58:16.9501358Z {"level":"info","ts":"2025-06-24T02:57:34.47303982Z","logger":"setup","caller":"cmd/root.go:272","msg":"starting manager"} | |
| 2025-06-24T02:58:16.9502822Z {"level":"info","ts":"2025-06-24T02:57:34.507057421Z","caller":"manager/server.go:83","msg":"starting server","name":"health probe","addr":"[::]:8081"} | |
| 2025-06-24T02:58:16.9504948Z {"level":"info","ts":"2025-06-24T02:57:34.507271973Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1.ServiceAccount"} | |
| 2025-06-24T02:58:16.9507599Z {"level":"info","ts":"2025-06-24T02:57:34.507300666Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1.RoleBinding"} | |
| 2025-06-24T02:58:16.9509817Z {"level":"info","ts":"2025-06-24T02:57:34.507311544Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1.Deployment"} | |
| 2025-06-24T02:58:16.9512053Z {"level":"info","ts":"2025-06-24T02:57:34.507334222Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1alpha2.InferenceModel"} | |
| 2025-06-24T02:58:16.9514531Z {"level":"info","ts":"2025-06-24T02:57:34.507278325Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1alpha1.ModelService"} | |
| 2025-06-24T02:58:16.9516839Z {"level":"info","ts":"2025-06-24T02:57:34.507360104Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1alpha1.ModelService"} | |
| 2025-06-24T02:58:16.9519469Z {"level":"info","ts":"2025-06-24T02:57:34.507409026Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1alpha2.InferencePool"} | |
| 2025-06-24T02:58:16.9521644Z {"level":"info","ts":"2025-06-24T02:57:34.507441592Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1.ConfigMap"} | |
| 2025-06-24T02:58:16.9524131Z {"level":"info","ts":"2025-06-24T02:57:34.507470663Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1.Service"} | |
| 2025-06-24T02:58:16.9526257Z {"level":"info","ts":"2025-06-24T02:57:34.663950635Z","caller":"controller/controller.go:239","msg":"Starting Controller","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService"} | |
| 2025-06-24T02:58:16.9528256Z {"level":"info","ts":"2025-06-24T02:57:34.663982764Z","caller":"controller/controller.go:248","msg":"Starting workers","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","worker count":1} | |
| 2025-06-24T02:58:16.9529777Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:16.9530558Z <== Logs of container llm-d-yo6n8jk1li-modelservice-84c47b46f-4vpmh | |
| 2025-06-24T02:58:16.9531278Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:16.9532136Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:16.9533022Z ==> Description of pod llm-d-yo6n8jk1li-redis-master-779b4cb946-pt75g | |
| 2025-06-24T02:58:16.9533694Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:16.9534714Z >>> kubectl --request-timeout=30s describe pod llm-d-yo6n8jk1li-redis-master-779b4cb946-pt75g --namespace llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:17.0081869Z Name: llm-d-yo6n8jk1li-redis-master-779b4cb946-pt75g | |
| 2025-06-24T02:58:17.0083322Z Namespace: llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:17.0083739Z Priority: 0 | |
| 2025-06-24T02:58:17.0084126Z Service Account: llm-d-yo6n8jk1li-redis-master | |
| 2025-06-24T02:58:17.0084659Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T02:58:17.0085195Z Start Time: Tue, 24 Jun 2025 02:57:33 +0000 | |
| 2025-06-24T02:58:17.0085700Z Labels: app.kubernetes.io/component=master | |
| 2025-06-24T02:58:17.0086218Z app.kubernetes.io/instance=llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:17.0086722Z app.kubernetes.io/managed-by=Helm | |
| 2025-06-24T02:58:17.0087155Z app.kubernetes.io/name=redis | |
| 2025-06-24T02:58:17.0087597Z app.kubernetes.io/version=7.4.3 | |
| 2025-06-24T02:58:17.0088068Z helm.sh/chart=redis-20.13.4 | |
| 2025-06-24T02:58:17.0088516Z pod-template-hash=779b4cb946 | |
| 2025-06-24T02:58:17.0089301Z Annotations: checksum/configmap: 2a9ab4a5432825504d910f022638674ce88eaefe9f9f595ad8bc107377d104fb | |
| 2025-06-24T02:58:17.0089946Z checksum/health: aff24913d801436ea469d8d374b2ddb3ec4c43ee7ab24663d5f8ff1a1b6991a9 | |
| 2025-06-24T02:58:17.0090867Z checksum/scripts: bdec350b84a1ace7cc118db113a21c9f160bde3425b07714e1c0c1da722621cf | |
| 2025-06-24T02:58:17.0091489Z checksum/secret: 44136fa355b3678a1146ad16f7e8649e94fb4fc21fe77e8310c060f61caaff8a | |
| 2025-06-24T02:58:17.0092002Z Status: Running | |
| 2025-06-24T02:58:17.0092195Z IP: 10.244.0.26 | |
| 2025-06-24T02:58:17.0092615Z IPs: | |
| 2025-06-24T02:58:17.0092827Z IP: 10.244.0.26 | |
| 2025-06-24T02:58:17.0093128Z Controlled By: ReplicaSet/llm-d-yo6n8jk1li-redis-master-779b4cb946 | |
| 2025-06-24T02:58:17.0093574Z Containers: | |
| 2025-06-24T02:58:17.0094055Z redis: | |
| 2025-06-24T02:58:17.0094573Z Container ID: containerd://68bf1329a87a26a1d4b26dd3e1dc36ce3f1eccbe5ad5521c7556277850cf1a38 | |
| 2025-06-24T02:58:17.0095035Z Image: quay.io/sclorg/redis-7-c9s:c9s | |
| 2025-06-24T02:58:17.0095495Z Image ID: quay.io/sclorg/redis-7-c9s@sha256:d772acab11507231a2b152850f47c8b9b859dedb6652ca624949e97cb28c5e6f | |
| 2025-06-24T02:58:17.0096099Z Port: 6379/TCP | |
| 2025-06-24T02:58:17.0096306Z Host Port: 0/TCP | |
| 2025-06-24T02:58:17.0096517Z SeccompProfile: RuntimeDefault | |
| 2025-06-24T02:58:17.0096739Z Command: | |
| 2025-06-24T02:58:17.0096892Z /bin/bash | |
| 2025-06-24T02:58:17.0097049Z Args: | |
| 2025-06-24T02:58:17.0097192Z -ec | |
| 2025-06-24T02:58:17.0097396Z /opt/bitnami/scripts/start-scripts/start-master.sh | |
| 2025-06-24T02:58:17.0097659Z State: Running | |
| 2025-06-24T02:58:17.0097988Z Started: Tue, 24 Jun 2025 02:57:34 +0000 | |
| 2025-06-24T02:58:17.0098226Z Ready: True | |
| 2025-06-24T02:58:17.0098418Z Restart Count: 0 | |
| 2025-06-24T02:58:17.0098583Z Limits: | |
| 2025-06-24T02:58:17.0098735Z cpu: 250m | |
| 2025-06-24T02:58:17.0098896Z memory: 256Mi | |
| 2025-06-24T02:58:17.0099064Z Requests: | |
| 2025-06-24T02:58:17.0099222Z cpu: 100m | |
| 2025-06-24T02:58:17.0099384Z memory: 128Mi | |
| 2025-06-24T02:58:17.0099792Z Liveness: exec [/bin/bash -ec /health/ping_liveness_local.sh 5] delay=20s timeout=6s period=5s #success=1 #failure=5 | |
| 2025-06-24T02:58:17.0100443Z Readiness: exec [/bin/bash -ec /health/ping_readiness_local.sh 1] delay=20s timeout=2s period=5s #success=1 #failure=5 | |
| 2025-06-24T02:58:17.0101062Z Environment: | |
| 2025-06-24T02:58:17.0101235Z BITNAMI_DEBUG: false | |
| 2025-06-24T02:58:17.0101466Z REDIS_REPLICATION_MODE: master | |
| 2025-06-24T02:58:17.0101695Z ALLOW_EMPTY_PASSWORD: yes | |
| 2025-06-24T02:58:17.0101918Z REDIS_TLS_ENABLED: no | |
| 2025-06-24T02:58:17.0102131Z REDIS_PORT: 6379 | |
| 2025-06-24T02:58:17.0102330Z Mounts: | |
| 2025-06-24T02:58:17.0102828Z /data from redis-data (rw) | |
| 2025-06-24T02:58:17.0103039Z /health from health (rw) | |
| 2025-06-24T02:58:17.0103331Z /opt/bitnami/redis/etc/ from empty-dir (rw,path="app-conf-dir") | |
| 2025-06-24T02:58:17.0103670Z /opt/bitnami/redis/mounted-etc from config (rw) | |
| 2025-06-24T02:58:17.0103995Z /opt/bitnami/scripts/start-scripts from start-scripts (rw) | |
| 2025-06-24T02:58:17.0104653Z /tmp from empty-dir (rw,path="tmp-dir") | |
| 2025-06-24T02:58:17.0105211Z Conditions: | |
| 2025-06-24T02:58:17.0105525Z Type Status | |
| 2025-06-24T02:58:17.0105931Z PodReadyToStartContainers True | |
| 2025-06-24T02:58:17.0106347Z Initialized True | |
| 2025-06-24T02:58:17.0106723Z Ready True | |
| 2025-06-24T02:58:17.0107037Z ContainersReady True | |
| 2025-06-24T02:58:17.0107316Z PodScheduled True | |
| 2025-06-24T02:58:17.0107685Z Volumes: | |
| 2025-06-24T02:58:17.0107944Z start-scripts: | |
| 2025-06-24T02:58:17.0108352Z Type: ConfigMap (a volume populated by a ConfigMap) | |
| 2025-06-24T02:58:17.0108892Z Name: llm-d-yo6n8jk1li-redis-scripts | |
| 2025-06-24T02:58:17.0109337Z Optional: false | |
| 2025-06-24T02:58:17.0109654Z health: | |
| 2025-06-24T02:58:17.0110001Z Type: ConfigMap (a volume populated by a ConfigMap) | |
| 2025-06-24T02:58:17.0110530Z Name: llm-d-yo6n8jk1li-redis-health | |
| 2025-06-24T02:58:17.0110918Z Optional: false | |
| 2025-06-24T02:58:17.0111213Z config: | |
| 2025-06-24T02:58:17.0111566Z Type: ConfigMap (a volume populated by a ConfigMap) | |
| 2025-06-24T02:58:17.0112116Z Name: llm-d-yo6n8jk1li-redis-configuration | |
| 2025-06-24T02:58:17.0112702Z Optional: false | |
| 2025-06-24T02:58:17.0112997Z empty-dir: | |
| 2025-06-24T02:58:17.0113431Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T02:58:17.0113957Z Medium: | |
| 2025-06-24T02:58:17.0114252Z SizeLimit: <unset> | |
| 2025-06-24T02:58:17.0114541Z redis-data: | |
| 2025-06-24T02:58:17.0115233Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T02:58:17.0115791Z Medium: | |
| 2025-06-24T02:58:17.0116079Z SizeLimit: <unset> | |
| 2025-06-24T02:58:17.0116426Z QoS Class: Burstable | |
| 2025-06-24T02:58:17.0116766Z Node-Selectors: <none> | |
| 2025-06-24T02:58:17.0117069Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T02:58:17.0117610Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T02:58:17.0117957Z Events: | |
| 2025-06-24T02:58:17.0118221Z Type Reason Age From Message | |
| 2025-06-24T02:58:17.0118577Z ---- ------ ---- ---- ------- | |
| 2025-06-24T02:58:17.0119345Z Normal Scheduled 44s default-scheduler Successfully assigned llm-d-yo6n8jk1li/llm-d-yo6n8jk1li-redis-master-779b4cb946-pt75g to chart-testing-control-plane | |
| 2025-06-24T02:58:17.0120282Z Normal Pulled 44s kubelet Container image "quay.io/sclorg/redis-7-c9s:c9s" already present on machine | |
| 2025-06-24T02:58:17.0120902Z Normal Created 43s kubelet Created container redis | |
| 2025-06-24T02:58:17.0121260Z Normal Started 43s kubelet Started container redis | |
| 2025-06-24T02:58:17.0121718Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:17.0122097Z <== Description of pod llm-d-yo6n8jk1li-redis-master-779b4cb946-pt75g | |
| 2025-06-24T02:58:17.0122846Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:17.0124040Z >>> kubectl --request-timeout=30s get pods llm-d-yo6n8jk1li-redis-master-779b4cb946-pt75g --no-headers --namespace llm-d-yo6n8jk1li --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T02:58:17.0623795Z >>> kubectl --request-timeout=30s get pods llm-d-yo6n8jk1li-redis-master-779b4cb946-pt75g --no-headers --namespace llm-d-yo6n8jk1li --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T02:58:17.1135701Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:17.1136564Z ==> Logs of container llm-d-yo6n8jk1li-redis-master-779b4cb946-pt75g | |
| 2025-06-24T02:58:17.1137273Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:17.1138218Z >>> kubectl --request-timeout=30s logs llm-d-yo6n8jk1li-redis-master-779b4cb946-pt75g --namespace llm-d-yo6n8jk1li --container redis | |
| 2025-06-24T02:58:17.1714073Z 1:C 24 Jun 2025 02:57:34.358 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo | |
| 2025-06-24T02:58:17.1714714Z 1:C 24 Jun 2025 02:57:34.358 # Redis version=7.0.12, bits=64, commit=00000000, modified=0, pid=1, just started | |
| 2025-06-24T02:58:17.1715132Z 1:C 24 Jun 2025 02:57:34.358 # Configuration loaded | |
| 2025-06-24T02:58:17.1715499Z 1:M 24 Jun 2025 02:57:34.358 * monotonic clock: POSIX clock_gettime | |
| 2025-06-24T02:58:17.1715978Z 1:M 24 Jun 2025 02:57:34.359 * Running mode=standalone, port=6379. | |
| 2025-06-24T02:58:17.1716508Z 1:M 24 Jun 2025 02:57:34.359 # Server initialized | |
| 2025-06-24T02:58:17.1716892Z 1:M 24 Jun 2025 02:57:34.360 * Creating AOF base file appendonly.aof.1.base.rdb on server start | |
| 2025-06-24T02:58:17.1717357Z 1:M 24 Jun 2025 02:57:34.361 * Creating AOF incr file appendonly.aof.1.incr.aof on server start | |
| 2025-06-24T02:58:17.1717737Z 1:M 24 Jun 2025 02:57:34.361 * Ready to accept connections | |
| 2025-06-24T02:58:17.1733410Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:17.1735516Z <== Logs of container llm-d-yo6n8jk1li-redis-master-779b4cb946-pt75g | |
| 2025-06-24T02:58:17.1736998Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:17.1737808Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:17.1738276Z ==> Description of pod llm-d-yo6n8jk1li-test-connection | |
| 2025-06-24T02:58:17.1738625Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:17.1739335Z >>> kubectl --request-timeout=30s describe pod llm-d-yo6n8jk1li-test-connection --namespace llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:17.2292719Z Name: llm-d-yo6n8jk1li-test-connection | |
| 2025-06-24T02:58:17.2293223Z Namespace: llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:17.2293607Z Priority: 0 | |
| 2025-06-24T02:58:17.2293898Z Service Account: default | |
| 2025-06-24T02:58:17.2294282Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T02:58:17.2294736Z Start Time: Tue, 24 Jun 2025 02:58:00 +0000 | |
| 2025-06-24T02:58:17.2295126Z Labels: <none> | |
| 2025-06-24T02:58:17.2295432Z Annotations: helm.sh/hook: test | |
| 2025-06-24T02:58:17.2295806Z helm.sh/hook-weight: 1 | |
| 2025-06-24T02:58:17.2296174Z Status: Succeeded | |
| 2025-06-24T02:58:17.2296507Z SeccompProfile: RuntimeDefault | |
| 2025-06-24T02:58:17.2296849Z IP: 10.244.0.30 | |
| 2025-06-24T02:58:17.2297252Z IPs: | |
| 2025-06-24T02:58:17.2297480Z IP: 10.244.0.30 | |
| 2025-06-24T02:58:17.2297735Z Containers: | |
| 2025-06-24T02:58:17.2297983Z curl: | |
| 2025-06-24T02:58:17.2298566Z Container ID: containerd://1905f7994ffe835d1a8de47bd22dbe361ba75e3b12df4169ea82322234d2a38b | |
| 2025-06-24T02:58:17.2299273Z Image: quay.io/curl/curl:latest | |
| 2025-06-24T02:58:17.2299946Z Image ID: quay.io/curl/curl@sha256:f95026f35f8e40ca1c11738a1c5710baadf4b8cafabab9738dadbf9fb99084a9 | |
| 2025-06-24T02:58:17.2300993Z Port: <none> | |
| 2025-06-24T02:58:17.2301294Z Host Port: <none> | |
| 2025-06-24T02:58:17.2301571Z Command: | |
| 2025-06-24T02:58:17.2301808Z /bin/sh | |
| 2025-06-24T02:58:17.2302048Z -c | |
| 2025-06-24T02:58:17.2302280Z Args: | |
| 2025-06-24T02:58:17.2303057Z echo -e "\e[32m🥷 Waiting for pods to come up\e[0m" | |
| 2025-06-24T02:58:17.2303474Z echo "" | |
| 2025-06-24T02:58:17.2304316Z curl --connect-timeout 5 --max-time 20 --retry 20 --retry-delay 10 --retry-max-time 60 --retry-all-errors http://llm-d-yo6n8jk1li-inference-gateway-istio/v1/models | |
| 2025-06-24T02:58:17.2305215Z | |
| 2025-06-24T02:58:17.2305445Z echo "" | |
| 2025-06-24T02:58:17.2305676Z echo "" | |
| 2025-06-24T02:58:17.2307824Z echo -e "\e[32m🥷 Basic chat validation\e[0m" | |
| 2025-06-24T02:58:17.2308239Z echo "" | |
| 2025-06-24T02:58:17.2309157Z curl --connect-timeout 5 --max-time 20 --retry 20 --retry-delay 10 --retry-max-time 60 --retry-all-errors http://llm-d-yo6n8jk1li-inference-gateway-istio/v1/chat/completions \ | |
| 2025-06-24T02:58:17.2310185Z -H 'accept: application/json' \ | |
| 2025-06-24T02:58:17.2310585Z -H 'Content-Type: application/json' \ | |
| 2025-06-24T02:58:17.2311193Z -d '{"model":"food-review","messages":[{"content":"Say hi","role":"user"}],"stream":false}' | |
| 2025-06-24T02:58:17.2311764Z | |
| 2025-06-24T02:58:17.2312024Z State: Terminated | |
| 2025-06-24T02:58:17.2312575Z Reason: Completed | |
| 2025-06-24T02:58:17.2312880Z Exit Code: 0 | |
| 2025-06-24T02:58:17.2313170Z Started: Tue, 24 Jun 2025 02:58:10 +0000 | |
| 2025-06-24T02:58:17.2313568Z Finished: Tue, 24 Jun 2025 02:58:12 +0000 | |
| 2025-06-24T02:58:17.2313955Z Ready: False | |
| 2025-06-24T02:58:17.2314225Z Restart Count: 0 | |
| 2025-06-24T02:58:17.2314472Z Limits: | |
| 2025-06-24T02:58:17.2314689Z cpu: 10m | |
| 2025-06-24T02:58:17.2314941Z memory: 20Mi | |
| 2025-06-24T02:58:17.2315205Z Requests: | |
| 2025-06-24T02:58:17.2315471Z cpu: 10m | |
| 2025-06-24T02:58:17.2315752Z memory: 20Mi | |
| 2025-06-24T02:58:17.2316261Z Liveness: exec [ls /usr/bin/curl] delay=0s timeout=1s period=10s #success=1 #failure=3 | |
| 2025-06-24T02:58:17.2316839Z Environment: <none> | |
| 2025-06-24T02:58:17.2317133Z Mounts: | |
| 2025-06-24T02:58:17.2317608Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-tgcnf (ro) | |
| 2025-06-24T02:58:17.2318439Z Conditions: | |
| 2025-06-24T02:58:17.2318708Z Type Status | |
| 2025-06-24T02:58:17.2319095Z PodReadyToStartContainers False | |
| 2025-06-24T02:58:17.2319609Z Initialized True | |
| 2025-06-24T02:58:17.2319958Z Ready False | |
| 2025-06-24T02:58:17.2320316Z ContainersReady False | |
| 2025-06-24T02:58:17.2320679Z PodScheduled True | |
| 2025-06-24T02:58:17.2321021Z Volumes: | |
| 2025-06-24T02:58:17.2321286Z kube-api-access-tgcnf: | |
| 2025-06-24T02:58:17.2321824Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T02:58:17.2322595Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T02:58:17.2322995Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T02:58:17.2323415Z ConfigMapOptional: <nil> | |
| 2025-06-24T02:58:17.2323785Z DownwardAPI: true | |
| 2025-06-24T02:58:17.2324145Z QoS Class: Guaranteed | |
| 2025-06-24T02:58:17.2324543Z Node-Selectors: <none> | |
| 2025-06-24T02:58:17.2325101Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T02:58:17.2325790Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T02:58:17.2326189Z Events: | |
| 2025-06-24T02:58:17.2326487Z Type Reason Age From Message | |
| 2025-06-24T02:58:17.2326946Z ---- ------ ---- ---- ------- | |
| 2025-06-24T02:58:17.2327955Z Normal Scheduled 17s default-scheduler Successfully assigned llm-d-yo6n8jk1li/llm-d-yo6n8jk1li-test-connection to chart-testing-control-plane | |
| 2025-06-24T02:58:17.2329586Z Normal Pulled 14s kubelet Container image "quay.io/curl/curl:latest" already present on machine | |
| 2025-06-24T02:58:17.2330414Z Normal Created 14s kubelet Created container curl | |
| 2025-06-24T02:58:17.2331102Z Normal Started 7s kubelet Started container curl | |
| 2025-06-24T02:58:17.2331739Z Warning Unhealthy 5s kubelet Liveness probe failed: | |
| 2025-06-24T02:58:17.2332574Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:17.2333199Z <== Description of pod llm-d-yo6n8jk1li-test-connection | |
| 2025-06-24T02:58:17.2333826Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:17.2335052Z >>> kubectl --request-timeout=30s get pods llm-d-yo6n8jk1li-test-connection --no-headers --namespace llm-d-yo6n8jk1li --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T02:58:17.2865525Z >>> kubectl --request-timeout=30s get pods llm-d-yo6n8jk1li-test-connection --no-headers --namespace llm-d-yo6n8jk1li --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T02:58:17.3363929Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:17.3364708Z ==> Logs of container llm-d-yo6n8jk1li-test-connection | |
| 2025-06-24T02:58:17.3365272Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:17.3365916Z >>> kubectl --request-timeout=30s logs llm-d-yo6n8jk1li-test-connection --namespace llm-d-yo6n8jk1li --container curl | |
| 2025-06-24T02:58:17.3875548Z [32m🥷 Waiting for pods to come up[0m | |
| 2025-06-24T02:58:17.3875888Z | |
| 2025-06-24T02:58:17.3876191Z % Total % Received % Xferd Average Speed Time Time Time Current | |
| 2025-06-24T02:58:17.3876810Z Dload Upload Total Spent Left Speed | |
| 2025-06-24T02:58:17.3877125Z | |
| 2025-06-24T02:58:17.3877297Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 | |
| 2025-06-24T02:58:17.3877737Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 | |
| 2025-06-24T02:58:17.3878174Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 | |
| 2025-06-24T02:58:17.3878795Z | |
| 2025-06-24T02:58:17.3878804Z | |
| 2025-06-24T02:58:17.3879027Z [32m🥷 Basic chat validation[0m | |
| 2025-06-24T02:58:17.3879267Z | |
| 2025-06-24T02:58:17.3879529Z % Total % Received % Xferd Average Speed Time Time Time Current | |
| 2025-06-24T02:58:17.3880110Z Dload Upload Total Spent Left Speed | |
| 2025-06-24T02:58:17.3880412Z | |
| 2025-06-24T02:58:17.3880565Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 | |
| 2025-06-24T02:58:17.3881030Z 100 86 0 0 100 86 0 286 --:--:-- --:--:-- --:--:-- 430 | |
| 2025-06-24T02:58:17.3896882Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:17.3897576Z <== Logs of container llm-d-yo6n8jk1li-test-connection | |
| 2025-06-24T02:58:17.3898218Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:17.3898718Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:17.3899206Z ==> Description of pod llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2 | |
| 2025-06-24T02:58:17.3899637Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:17.3900300Z >>> kubectl --request-timeout=30s describe pod llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2 --namespace llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:17.4432654Z Name: llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2 | |
| 2025-06-24T02:58:17.4433600Z Namespace: llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:17.4433959Z Priority: 0 | |
| 2025-06-24T02:58:17.4434338Z Service Account: llm-d-yo6n8jk1li-vllm-sim-sa | |
| 2025-06-24T02:58:17.4434808Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T02:58:17.4435268Z Start Time: Tue, 24 Jun 2025 02:58:00 +0000 | |
| 2025-06-24T02:58:17.4435730Z Labels: llm-d.ai/inferenceServing=true | |
| 2025-06-24T02:58:17.4436285Z llm-d.ai/model=food-review | |
| 2025-06-24T02:58:17.4436679Z llm-d.ai/role=decode | |
| 2025-06-24T02:58:17.4437067Z pod-template-hash=68d6fb8df5 | |
| 2025-06-24T02:58:17.4437449Z Annotations: <none> | |
| 2025-06-24T02:58:17.4437751Z Status: Running | |
| 2025-06-24T02:58:17.4438058Z IP: 10.244.0.29 | |
| 2025-06-24T02:58:17.4438357Z IPs: | |
| 2025-06-24T02:58:17.4438594Z IP: 10.244.0.29 | |
| 2025-06-24T02:58:17.4439068Z Controlled By: ReplicaSet/llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5 | |
| 2025-06-24T02:58:17.4439597Z Init Containers: | |
| 2025-06-24T02:58:17.4439871Z routing-proxy: | |
| 2025-06-24T02:58:17.4440473Z Container ID: containerd://a60114f5d10ca4d461f4a6f99e7fad23962a15e249fe07f8785ade30dc088b4c | |
| 2025-06-24T02:58:17.4441216Z Image: ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6 | |
| 2025-06-24T02:58:17.4442039Z Image ID: ghcr.io/llm-d/llm-d-routing-sidecar@sha256:7f3db0d03f3b3b16ec2a0e8d0d855bb7db83ef8d670dd9027f194e772a87856b | |
| 2025-06-24T02:58:17.4442957Z Port: 8000/TCP | |
| 2025-06-24T02:58:17.4443267Z Host Port: 0/TCP | |
| 2025-06-24T02:58:17.4443546Z Args: | |
| 2025-06-24T02:58:17.4443788Z --port=8000 | |
| 2025-06-24T02:58:17.4444070Z --vllm-port=8001 | |
| 2025-06-24T02:58:17.4444372Z State: Running | |
| 2025-06-24T02:58:17.4444705Z Started: Tue, 24 Jun 2025 02:58:01 +0000 | |
| 2025-06-24T02:58:17.4445093Z Ready: True | |
| 2025-06-24T02:58:17.4445379Z Restart Count: 0 | |
| 2025-06-24T02:58:17.4445682Z Environment: <none> | |
| 2025-06-24T02:58:17.4445975Z Mounts: | |
| 2025-06-24T02:58:17.4446449Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-sksl4 (ro) | |
| 2025-06-24T02:58:17.4447022Z Containers: | |
| 2025-06-24T02:58:17.4447256Z vllm: | |
| 2025-06-24T02:58:17.4447805Z Container ID: containerd://2cac4d68b030e87745a52db68f2a235b6b22139932627e95c829ce51762744e3 | |
| 2025-06-24T02:58:17.4448537Z Image: ghcr.io/llm-d/llm-d-inference-sim:0.0.4 | |
| 2025-06-24T02:58:17.4449515Z Image ID: ghcr.io/llm-d/llm-d-inference-sim@sha256:5995c4dde42888844812359c121899c1d12e647588ed58fef206c3c653315338 | |
| 2025-06-24T02:58:17.4450263Z Port: 5557/TCP | |
| 2025-06-24T02:58:17.4450587Z Host Port: 0/TCP | |
| 2025-06-24T02:58:17.4450875Z Args: | |
| 2025-06-24T02:58:17.4451124Z --model | |
| 2025-06-24T02:58:17.4451376Z food-review | |
| 2025-06-24T02:58:17.4451632Z --port | |
| 2025-06-24T02:58:17.4451856Z 8001 | |
| 2025-06-24T02:58:17.4452083Z State: Running | |
| 2025-06-24T02:58:17.4452567Z Started: Tue, 24 Jun 2025 02:58:01 +0000 | |
| 2025-06-24T02:58:17.4452919Z Ready: True | |
| 2025-06-24T02:58:17.4453189Z Restart Count: 0 | |
| 2025-06-24T02:58:17.4453445Z Environment: | |
| 2025-06-24T02:58:17.4453695Z HOME: /home | |
| 2025-06-24T02:58:17.4453948Z Mounts: | |
| 2025-06-24T02:58:17.4454213Z /home from home (rw) | |
| 2025-06-24T02:58:17.4454765Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-sksl4 (ro) | |
| 2025-06-24T02:58:17.4455364Z Conditions: | |
| 2025-06-24T02:58:17.4455630Z Type Status | |
| 2025-06-24T02:58:17.4465389Z PodReadyToStartContainers True | |
| 2025-06-24T02:58:17.4465895Z Initialized True | |
| 2025-06-24T02:58:17.4466261Z Ready True | |
| 2025-06-24T02:58:17.4466622Z ContainersReady True | |
| 2025-06-24T02:58:17.4466878Z PodScheduled True | |
| 2025-06-24T02:58:17.4467095Z Volumes: | |
| 2025-06-24T02:58:17.4467249Z home: | |
| 2025-06-24T02:58:17.4467623Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T02:58:17.4468177Z Medium: | |
| 2025-06-24T02:58:17.4468356Z SizeLimit: <unset> | |
| 2025-06-24T02:58:17.4468563Z kube-api-access-sksl4: | |
| 2025-06-24T02:58:17.4468888Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T02:58:17.4469256Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T02:58:17.4469522Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T02:58:17.4469783Z ConfigMapOptional: <nil> | |
| 2025-06-24T02:58:17.4469999Z DownwardAPI: true | |
| 2025-06-24T02:58:17.4470219Z QoS Class: BestEffort | |
| 2025-06-24T02:58:17.4470448Z Node-Selectors: <none> | |
| 2025-06-24T02:58:17.4470771Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T02:58:17.4471217Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T02:58:17.4471513Z Events: | |
| 2025-06-24T02:58:17.4471720Z Type Reason Age From Message | |
| 2025-06-24T02:58:17.4471990Z ---- ------ ---- ---- ------- | |
| 2025-06-24T02:58:17.4472948Z Normal Scheduled 17s default-scheduler Successfully assigned llm-d-yo6n8jk1li/llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2 to chart-testing-control-plane | |
| 2025-06-24T02:58:17.4473936Z Normal Pulled 16s kubelet Container image "ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6" already present on machine | |
| 2025-06-24T02:58:17.4474807Z Normal Created 16s kubelet Created container routing-proxy | |
| 2025-06-24T02:58:17.4475530Z Normal Started 16s kubelet Started container routing-proxy | |
| 2025-06-24T02:58:17.4476294Z Normal Pulled 16s kubelet Container image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" already present on machine | |
| 2025-06-24T02:58:17.4476974Z Normal Created 16s kubelet Created container vllm | |
| 2025-06-24T02:58:17.4477418Z Normal Started 16s kubelet Started container vllm | |
| 2025-06-24T02:58:17.4477841Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:17.4478562Z <== Description of pod llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2 | |
| 2025-06-24T02:58:17.4479282Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:17.4481054Z >>> kubectl --request-timeout=30s get pods llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2 --no-headers --namespace llm-d-yo6n8jk1li --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T02:58:17.4967670Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:17.4968980Z ==> Logs of init container llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2 | |
| 2025-06-24T02:58:17.4969731Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:17.4970754Z >>> kubectl --request-timeout=30s logs llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2 --namespace llm-d-yo6n8jk1li --container routing-proxy | |
| 2025-06-24T02:58:17.5486612Z I0624 02:58:01.376559 1 cmd.go:51] "p/d connector validated" connector="nixl" | |
| 2025-06-24T02:58:17.5487433Z I0624 02:58:01.376990 1 proxy.go:115] "starting" logger="proxy server" addr="[::]:8000" | |
| 2025-06-24T02:58:17.5517051Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:17.5517880Z <== Logs of init container llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2 | |
| 2025-06-24T02:58:17.5518633Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:17.5519769Z >>> kubectl --request-timeout=30s get pods llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2 --no-headers --namespace llm-d-yo6n8jk1li --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T02:58:17.6038804Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:17.6039636Z ==> Logs of container llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2 | |
| 2025-06-24T02:58:17.6040381Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:17.6041508Z >>> kubectl --request-timeout=30s logs llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2 --namespace llm-d-yo6n8jk1li --container vllm | |
| 2025-06-24T02:58:17.6563504Z I0624 02:58:01.861953 1 cmd.go:36] "Start vllm simulator" | |
| 2025-06-24T02:58:17.6564137Z I0624 02:58:01.862117 1 simulator.go:135] "Server starting" port=8001 | |
| 2025-06-24T02:58:17.6584564Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:17.6585665Z <== Logs of container llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2 | |
| 2025-06-24T02:58:17.6587172Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:17.6587839Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:17.6588384Z ==> Description of pod llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477-gsx8s | |
| 2025-06-24T02:58:17.6588800Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:17.6589376Z >>> kubectl --request-timeout=30s describe pod llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477-gsx8s --namespace llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:17.7130931Z Name: llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477-gsx8s | |
| 2025-06-24T02:58:17.7131516Z Namespace: llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:17.7131894Z Priority: 0 | |
| 2025-06-24T02:58:17.7132288Z Service Account: llm-d-yo6n8jk1li-vllm-sim-epp-sa | |
| 2025-06-24T02:58:17.7133091Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T02:58:17.7133573Z Start Time: Tue, 24 Jun 2025 02:58:00 +0000 | |
| 2025-06-24T02:58:17.7134156Z Labels: app.kubernetes.io/gateway=llm-d-yo6n8jk1li-inference-gateway | |
| 2025-06-24T02:58:17.7134764Z llm-d.ai/epp=llm-d-yo6n8jk1li-vllm-sim-epp | |
| 2025-06-24T02:58:17.7135061Z pod-template-hash=596dd57477 | |
| 2025-06-24T02:58:17.7135685Z Annotations: <none> | |
| 2025-06-24T02:58:17.7135936Z Status: Running | |
| 2025-06-24T02:58:17.7136129Z IP: 10.244.0.28 | |
| 2025-06-24T02:58:17.7136309Z IPs: | |
| 2025-06-24T02:58:17.7136462Z IP: 10.244.0.28 | |
| 2025-06-24T02:58:17.7136750Z Controlled By: ReplicaSet/llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477 | |
| 2025-06-24T02:58:17.7137067Z Containers: | |
| 2025-06-24T02:58:17.7137218Z epp: | |
| 2025-06-24T02:58:17.7137573Z Container ID: containerd://6618193508e48d23034ad7d493932f480712d9c92b845093d0c61a7806818884 | |
| 2025-06-24T02:58:17.7138043Z Image: ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4 | |
| 2025-06-24T02:58:17.7138588Z Image ID: ghcr.io/llm-d/llm-d-inference-scheduler@sha256:d5d2492ee51c76bc78bb9dc1219dd7fba1fd70afe466c76860a6cd40ddf0c6f5 | |
| 2025-06-24T02:58:17.7139101Z Ports: 9002/TCP, 9003/TCP, 9090/TCP | |
| 2025-06-24T02:58:17.7139351Z Host Ports: 0/TCP, 0/TCP, 0/TCP | |
| 2025-06-24T02:58:17.7139565Z Args: | |
| 2025-06-24T02:58:17.7139712Z --poolName | |
| 2025-06-24T02:58:17.7139926Z llm-d-yo6n8jk1li-vllm-sim-inference-pool | |
| 2025-06-24T02:58:17.7140175Z --poolNamespace | |
| 2025-06-24T02:58:17.7140357Z llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:17.7140535Z -v | |
| 2025-06-24T02:58:17.7140678Z 4 | |
| 2025-06-24T02:58:17.7140828Z --zap-encoder | |
| 2025-06-24T02:58:17.7140987Z json | |
| 2025-06-24T02:58:17.7141138Z --grpcPort | |
| 2025-06-24T02:58:17.7141292Z 9002 | |
| 2025-06-24T02:58:17.7141444Z --grpcHealthPort | |
| 2025-06-24T02:58:17.7141609Z 9003 | |
| 2025-06-24T02:58:17.7141763Z State: Running | |
| 2025-06-24T02:58:17.7142122Z Started: Tue, 24 Jun 2025 02:58:01 +0000 | |
| 2025-06-24T02:58:17.7142595Z Ready: True | |
| 2025-06-24T02:58:17.7142901Z Restart Count: 0 | |
| 2025-06-24T02:58:17.7143179Z Requests: | |
| 2025-06-24T02:58:17.7143383Z cpu: 256m | |
| 2025-06-24T02:58:17.7143553Z memory: 128Mi | |
| 2025-06-24T02:58:17.7143995Z Liveness: grpc <pod>:9003 envoy.service.ext_proc.v3.ExternalProcessor delay=5s timeout=1s period=10s #success=1 #failure=3 | |
| 2025-06-24T02:58:17.7144700Z Readiness: grpc <pod>:9003 envoy.service.ext_proc.v3.ExternalProcessor delay=5s timeout=1s period=10s #success=1 #failure=3 | |
| 2025-06-24T02:58:17.7145161Z Environment: | |
| 2025-06-24T02:58:17.7145360Z ENABLE_KVCACHE_AWARE_SCORER: false | |
| 2025-06-24T02:58:17.7145622Z ENABLE_LOAD_AWARE_SCORER: true | |
| 2025-06-24T02:58:17.7145882Z ENABLE_PREFIX_AWARE_SCORER: true | |
| 2025-06-24T02:58:17.7146287Z ENABLE_SESSION_AWARE_SCORER: false | |
| 2025-06-24T02:58:17.7146560Z KVCACHE_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T02:58:17.7147006Z KVCACHE_INDEXER_REDIS_ADDR: llm-d-yo6n8jk1li-redis-master.llm-d-yo6n8jk1li.svc.cluster.local:8100 | |
| 2025-06-24T02:58:17.7147457Z LOAD_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T02:58:17.7147695Z PD_ENABLED: false | |
| 2025-06-24T02:58:17.7147944Z PD_PROMPT_LEN_THRESHOLD: 10 | |
| 2025-06-24T02:58:17.7148204Z PREFILL_ENABLE_KVCACHE_AWARE_SCORER: false | |
| 2025-06-24T02:58:17.7148457Z PREFILL_ENABLE_LOAD_AWARE_SCORER: false | |
| 2025-06-24T02:58:17.7148716Z PREFILL_ENABLE_PREFIX_AWARE_SCORER: false | |
| 2025-06-24T02:58:17.7148970Z PREFILL_ENABLE_SESSION_AWARE_SCORER: false | |
| 2025-06-24T02:58:17.7149224Z PREFILL_KVCACHE_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T02:58:17.7149679Z PREFILL_KVCACHE_INDEXER_REDIS_ADDR: llm-d-yo6n8jk1li-redis-master.llm-d-yo6n8jk1li.svc.cluster.local:8100 | |
| 2025-06-24T02:58:17.7150145Z PREFILL_LOAD_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T02:58:17.7150398Z PREFILL_PREFIX_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T02:58:17.7150640Z PREFILL_SESSION_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T02:58:17.7150882Z PREFIX_AWARE_SCORER_WEIGHT: 2 | |
| 2025-06-24T02:58:17.7151117Z SESSION_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T02:58:17.7151335Z Mounts: | |
| 2025-06-24T02:58:17.7151784Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-4zsr8 (ro) | |
| 2025-06-24T02:58:17.7152152Z Conditions: | |
| 2025-06-24T02:58:17.7152309Z Type Status | |
| 2025-06-24T02:58:17.7152727Z PodReadyToStartContainers True | |
| 2025-06-24T02:58:17.7152961Z Initialized True | |
| 2025-06-24T02:58:17.7153163Z Ready True | |
| 2025-06-24T02:58:17.7153373Z ContainersReady True | |
| 2025-06-24T02:58:17.7153642Z PodScheduled True | |
| 2025-06-24T02:58:17.7154016Z Volumes: | |
| 2025-06-24T02:58:17.7154311Z kube-api-access-4zsr8: | |
| 2025-06-24T02:58:17.7155174Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T02:58:17.7155828Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T02:58:17.7156268Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T02:58:17.7156720Z ConfigMapOptional: <nil> | |
| 2025-06-24T02:58:17.7157057Z DownwardAPI: true | |
| 2025-06-24T02:58:17.7157426Z QoS Class: Burstable | |
| 2025-06-24T02:58:17.7157819Z Node-Selectors: <none> | |
| 2025-06-24T02:58:17.7158371Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T02:58:17.7158907Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T02:58:17.7159290Z Events: | |
| 2025-06-24T02:58:17.7159581Z Type Reason Age From Message | |
| 2025-06-24T02:58:17.7160017Z ---- ------ ---- ---- ------- | |
| 2025-06-24T02:58:17.7160844Z Normal Scheduled 17s default-scheduler Successfully assigned llm-d-yo6n8jk1li/llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477-gsx8s to chart-testing-control-plane | |
| 2025-06-24T02:58:17.7161868Z Normal Pulling 16s kubelet Pulling image "ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4" | |
| 2025-06-24T02:58:17.7163115Z Normal Pulled 16s kubelet Successfully pulled image "ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4" in 119ms (119ms including waiting). Image size: 119587259 bytes. | |
| 2025-06-24T02:58:17.7163959Z Normal Created 16s kubelet Created container epp | |
| 2025-06-24T02:58:17.7164411Z Normal Started 16s kubelet Started container epp | |
| 2025-06-24T02:58:17.7164790Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:17.7165478Z <== Description of pod llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477-gsx8s | |
| 2025-06-24T02:58:17.7165975Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:17.7166825Z >>> kubectl --request-timeout=30s get pods llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477-gsx8s --no-headers --namespace llm-d-yo6n8jk1li --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T02:58:17.7658783Z >>> kubectl --request-timeout=30s get pods llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477-gsx8s --no-headers --namespace llm-d-yo6n8jk1li --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T02:58:17.8163492Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:17.8164336Z ==> Logs of container llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477-gsx8s | |
| 2025-06-24T02:58:17.8165079Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:17.8166164Z >>> kubectl --request-timeout=30s logs llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477-gsx8s --namespace llm-d-yo6n8jk1li --container epp | |
| 2025-06-24T02:58:17.8701151Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"epp/main.go:146","msg":"Flags processed","flags":{"DestinationEndpointHintMetadataNamespace":"envoy.lb","certPath":"","destinationEndpointHintKey":"x-gateway-destination-endpoint","grpcHealthPort":9003,"grpcPort":9002,"kubeconfig":"","kvCacheUsagePercentageMetric":"vllm:gpu_cache_usage_perc","loraInfoMetric":"vllm:lora_requests_info","metricsPort":9090,"poolName":"llm-d-yo6n8jk1li-vllm-sim-inference-pool","poolNamespace":"llm-d-yo6n8jk1li","refreshMetricsInterval":50000000,"refreshPrometheusMetricsInterval":5000000000,"secureServing":true,"totalQueuedRequestsMetric":"vllm:num_requests_waiting","v":4,"zap-devel":true,"zap-encoder":{},"zap-log-level":{},"zap-stacktrace-level":{},"zap-time-encoding":{}}} | |
| 2025-06-24T02:58:17.8705043Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"ENABLE_KVCACHE_AWARE_SCORER","value":"false"} | |
| 2025-06-24T02:58:17.8706694Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"KVCACHE_AWARE_SCORER"} | |
| 2025-06-24T02:58:17.8708172Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"ENABLE_LOAD_AWARE_SCORER","value":"true"} | |
| 2025-06-24T02:58:17.8709826Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"LOAD_AWARE_SCORER_WEIGHT","value":1} | |
| 2025-06-24T02:58:17.8711192Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"config/config.go:115","msg":"Initialized plugin","plugin":"LOAD_AWARE_SCORER","weight":1} | |
| 2025-06-24T02:58:17.8712674Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"ENABLE_PREFIX_AWARE_SCORER","value":"true"} | |
| 2025-06-24T02:58:17.8714493Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PREFIX_AWARE_SCORER_WEIGHT","value":2} | |
| 2025-06-24T02:58:17.8715504Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"config/config.go:115","msg":"Initialized plugin","plugin":"PREFIX_AWARE_SCORER","weight":2} | |
| 2025-06-24T02:58:17.8716357Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"ENABLE_SESSION_AWARE_SCORER","value":"false"} | |
| 2025-06-24T02:58:17.8717248Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"SESSION_AWARE_SCORER"} | |
| 2025-06-24T02:58:17.8718370Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_LEAST_KVCACHE_FILTER","defaultValue":"false"} | |
| 2025-06-24T02:58:17.8719523Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LEAST_KVCACHE_FILTER"} | |
| 2025-06-24T02:58:17.8720602Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_LEAST_QUEUE_FILTER","defaultValue":"false"} | |
| 2025-06-24T02:58:17.8721748Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LEAST_QUEUE_FILTER"} | |
| 2025-06-24T02:58:17.8722999Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_LORA_AFFINITY_FILTER","defaultValue":"false"} | |
| 2025-06-24T02:58:17.8724119Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LORA_AFFINITY_FILTER"} | |
| 2025-06-24T02:58:17.8725934Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_LOW_QUEUE_FILTER","defaultValue":"false"} | |
| 2025-06-24T02:58:17.8727940Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LOW_QUEUE_FILTER"} | |
| 2025-06-24T02:58:17.8729072Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_SHEDDABLE_CAPACITY_FILTER","defaultValue":"false"} | |
| 2025-06-24T02:58:17.8730314Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_SHEDDABLE_CAPACITY_FILTER"} | |
| 2025-06-24T02:58:17.8731290Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_KVCACHE_UTILIZATION_SCORER","defaultValue":"false"} | |
| 2025-06-24T02:58:17.8732248Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_KVCACHE_UTILIZATION_SCORER"} | |
| 2025-06-24T02:58:17.8733531Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_QUEUE_SCORER","defaultValue":"false"} | |
| 2025-06-24T02:58:17.8734503Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_QUEUE_SCORER"} | |
| 2025-06-24T02:58:17.8735393Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_PREFIX_SCORER","defaultValue":"false"} | |
| 2025-06-24T02:58:17.8736489Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_PREFIX_SCORER"} | |
| 2025-06-24T02:58:17.8737757Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PREFILL_ENABLE_KVCACHE_AWARE_SCORER","value":"false"} | |
| 2025-06-24T02:58:17.8739382Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"KVCACHE_AWARE_SCORER"} | |
| 2025-06-24T02:58:17.8740889Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PREFILL_ENABLE_LOAD_AWARE_SCORER","value":"false"} | |
| 2025-06-24T02:58:17.8742289Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"LOAD_AWARE_SCORER"} | |
| 2025-06-24T02:58:17.8743995Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PREFILL_ENABLE_PREFIX_AWARE_SCORER","value":"false"} | |
| 2025-06-24T02:58:17.8745587Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"PREFIX_AWARE_SCORER"} | |
| 2025-06-24T02:58:17.8747171Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PREFILL_ENABLE_SESSION_AWARE_SCORER","value":"false"} | |
| 2025-06-24T02:58:17.8748770Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"SESSION_AWARE_SCORER"} | |
| 2025-06-24T02:58:17.8750490Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_LEAST_KVCACHE_FILTER","defaultValue":"false"} | |
| 2025-06-24T02:58:17.8752131Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LEAST_KVCACHE_FILTER"} | |
| 2025-06-24T02:58:17.8754385Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_LEAST_QUEUE_FILTER","defaultValue":"false"} | |
| 2025-06-24T02:58:17.8756098Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LEAST_QUEUE_FILTER"} | |
| 2025-06-24T02:58:17.8757834Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_LORA_AFFINITY_FILTER","defaultValue":"false"} | |
| 2025-06-24T02:58:17.8759496Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LORA_AFFINITY_FILTER"} | |
| 2025-06-24T02:58:17.8761148Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_LOW_QUEUE_FILTER","defaultValue":"false"} | |
| 2025-06-24T02:58:17.8762897Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LOW_QUEUE_FILTER"} | |
| 2025-06-24T02:58:17.8764552Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_SHEDDABLE_CAPACITY_FILTER","defaultValue":"false"} | |
| 2025-06-24T02:58:17.8766461Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_SHEDDABLE_CAPACITY_FILTER"} | |
| 2025-06-24T02:58:17.8768158Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_KVCACHE_UTILIZATION_SCORER","defaultValue":"false"} | |
| 2025-06-24T02:58:17.8769834Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_KVCACHE_UTILIZATION_SCORER"} | |
| 2025-06-24T02:58:17.8772291Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_QUEUE_SCORER","defaultValue":"false"} | |
| 2025-06-24T02:58:17.8774041Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_QUEUE_SCORER"} | |
| 2025-06-24T02:58:17.8775665Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_PREFIX_SCORER","defaultValue":"false"} | |
| 2025-06-24T02:58:17.8777330Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_PREFIX_SCORER"} | |
| 2025-06-24T02:58:17.8778750Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PD_ENABLED","value":"false"} | |
| 2025-06-24T02:58:17.8780225Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PD_PROMPT_LEN_THRESHOLD","value":10} | |
| 2025-06-24T02:58:17.8781817Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFIX_SCORER_BLOCK_SIZE","defaultValue":256} | |
| 2025-06-24T02:58:17.8783652Z {"level":"info","ts":"2025-06-24T02:58:01Z","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"LOAD_AWARE_SCORER_QUEUE_THRESHOLD","defaultValue":128} | |
| 2025-06-24T02:58:17.8785188Z {"level":"info","ts":"2025-06-24T02:58:01Z","caller":"scorer/prefix_aware.go:154","msg":"Prefix aware scorer cleanup started"} | |
| 2025-06-24T02:58:17.8786250Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"setup","caller":"epp/main.go:224","msg":"Controller manager starting"} | |
| 2025-06-24T02:58:17.8787308Z {"level":"info","ts":"2025-06-24T02:58:01Z","caller":"manager/server.go:83","msg":"starting server","name":"metrics","addr":":9090"} | |
| 2025-06-24T02:58:17.8788521Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"controller-runtime.metrics","caller":"server/server.go:208","msg":"Starting metrics server"} | |
| 2025-06-24T02:58:17.8790033Z {"level":"info","ts":"2025-06-24T02:58:01Z","logger":"controller-runtime.metrics","caller":"server/server.go:247","msg":"Serving metrics server","bindAddress":":8080","secure":false} | |
| 2025-06-24T02:58:17.8791375Z {"level":"info","ts":"2025-06-24T02:58:01Z","caller":"runnable/grpc.go:26","msg":"gRPC server starting","name":"health"} | |
| 2025-06-24T02:58:17.8792632Z {"level":"info","ts":"2025-06-24T02:58:01Z","caller":"runnable/grpc.go:34","msg":"gRPC server listening","name":"health","port":9003} | |
| 2025-06-24T02:58:17.8794586Z {"level":"info","ts":"2025-06-24T02:58:01Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"inferencemodel","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferenceModel","source":"kind source: *v1alpha2.InferenceModel"} | |
| 2025-06-24T02:58:17.8797102Z {"level":"info","ts":"2025-06-24T02:58:01Z","caller":"controller/controller.go:239","msg":"Starting Controller","controller":"inferencemodel","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferenceModel"} | |
| 2025-06-24T02:58:17.8799613Z {"level":"info","ts":"2025-06-24T02:58:01Z","caller":"controller/controller.go:248","msg":"Starting workers","controller":"inferencemodel","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferenceModel","worker count":1} | |
| 2025-06-24T02:58:17.8802085Z {"level":"info","ts":"2025-06-24T02:58:01Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool","source":"kind source: *v1alpha2.InferencePool"} | |
| 2025-06-24T02:58:17.8806459Z {"level":"Level(-2)","ts":"2025-06-24T02:58:01Z","caller":"controller/inferencemodel_reconciler.go:47","msg":"Reconciling InferenceModel","controller":"inferencemodel","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferenceModel","InferenceModel":{"name":"llm-d-yo6n8jk1li-vllm-sim","namespace":"llm-d-yo6n8jk1li"},"namespace":"llm-d-yo6n8jk1li","name":"llm-d-yo6n8jk1li-vllm-sim","reconcileID":"95d8e060-e26f-4771-bd6d-4f3b087cfef6","inferenceModel":{"name":"llm-d-yo6n8jk1li-vllm-sim","namespace":"llm-d-yo6n8jk1li"}} | |
| 2025-06-24T02:58:17.8812847Z {"level":"Level(-2)","ts":"2025-06-24T02:58:01Z","caller":"controller/inferencemodel_reconciler.go:70","msg":"Added/Updated InferenceModel","controller":"inferencemodel","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferenceModel","InferenceModel":{"name":"llm-d-yo6n8jk1li-vllm-sim","namespace":"llm-d-yo6n8jk1li"},"namespace":"llm-d-yo6n8jk1li","name":"llm-d-yo6n8jk1li-vllm-sim","reconcileID":"95d8e060-e26f-4771-bd6d-4f3b087cfef6","inferenceModel":{"name":"llm-d-yo6n8jk1li-vllm-sim","namespace":"llm-d-yo6n8jk1li"},"poolRef":{"group":"inference.networking.x-k8s.io","kind":"InferencePool","name":"llm-d-yo6n8jk1li-vllm-sim-inference-pool"},"modelName":"food-review"} | |
| 2025-06-24T02:58:17.8817311Z {"level":"info","ts":"2025-06-24T02:58:01Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"pod","controllerGroup":"","controllerKind":"Pod","source":"kind source: *v1.Pod"} | |
| 2025-06-24T02:58:17.8819144Z {"level":"info","ts":"2025-06-24T02:58:01Z","caller":"controller/controller.go:239","msg":"Starting Controller","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool"} | |
| 2025-06-24T02:58:17.8820714Z {"level":"info","ts":"2025-06-24T02:58:01Z","caller":"controller/controller.go:248","msg":"Starting workers","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool","worker count":1} | |
| 2025-06-24T02:58:17.8823359Z {"level":"Level(-2)","ts":"2025-06-24T02:58:01Z","caller":"controller/inferencepool_reconciler.go:45","msg":"Reconciling InferencePool","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool","InferencePool":{"name":"llm-d-yo6n8jk1li-vllm-sim-inference-pool","namespace":"llm-d-yo6n8jk1li"},"namespace":"llm-d-yo6n8jk1li","name":"llm-d-yo6n8jk1li-vllm-sim-inference-pool","reconcileID":"dc34eddf-9d49-481f-afd2-007a04cdcc5d","inferencePool":{"name":"llm-d-yo6n8jk1li-vllm-sim-inference-pool","namespace":"llm-d-yo6n8jk1li"}} | |
| 2025-06-24T02:58:17.8826953Z {"level":"info","ts":"2025-06-24T02:58:01Z","caller":"controller/controller.go:239","msg":"Starting Controller","controller":"pod","controllerGroup":"","controllerKind":"Pod"} | |
| 2025-06-24T02:58:17.8830950Z {"level":"Level(-4)","ts":"2025-06-24T02:58:01Z","caller":"datastore/datastore.go:125","msg":"Updating inference pool endpoints","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool","InferencePool":{"name":"llm-d-yo6n8jk1li-vllm-sim-inference-pool","namespace":"llm-d-yo6n8jk1li"},"namespace":"llm-d-yo6n8jk1li","name":"llm-d-yo6n8jk1li-vllm-sim-inference-pool","reconcileID":"dc34eddf-9d49-481f-afd2-007a04cdcc5d","inferencePool":{"name":"llm-d-yo6n8jk1li-vllm-sim-inference-pool","namespace":"llm-d-yo6n8jk1li"},"selector":{"llm-d.ai/inferenceServing":"true","llm-d.ai/model":"food-review"}} | |
| 2025-06-24T02:58:17.8834040Z {"level":"info","ts":"2025-06-24T02:58:01Z","caller":"controller/controller.go:248","msg":"Starting workers","controller":"pod","controllerGroup":"","controllerKind":"Pod","worker count":1} | |
| 2025-06-24T02:58:17.8836147Z {"level":"Level(-3)","ts":"2025-06-24T02:58:01Z","caller":"controller/pod_reconciler.go:51","msg":"Pod being reconciled","controller":"pod","controllerGroup":"","controllerKind":"Pod","Pod":{"name":"llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2","namespace":"llm-d-yo6n8jk1li"},"namespace":"llm-d-yo6n8jk1li","name":"llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2","reconcileID":"8952490b-d423-4114-82ef-997092fabb2e","name":{"name":"llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2","namespace":"llm-d-yo6n8jk1li"}} | |
| 2025-06-24T02:58:17.8841229Z {"level":"Level(-4)","ts":"2025-06-24T02:58:01Z","caller":"controller/pod_reconciler.go:96","msg":"Pod removed or not added","controller":"pod","controllerGroup":"","controllerKind":"Pod","Pod":{"name":"llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2","namespace":"llm-d-yo6n8jk1li"},"namespace":"llm-d-yo6n8jk1li","name":"llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2","reconcileID":"8952490b-d423-4114-82ef-997092fabb2e","name":{"name":"llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2","namespace":"llm-d-yo6n8jk1li"}} | |
| 2025-06-24T02:58:17.8846551Z {"level":"Level(-3)","ts":"2025-06-24T02:58:01Z","caller":"controller/pod_reconciler.go:51","msg":"Pod being reconciled","controller":"pod","controllerGroup":"","controllerKind":"Pod","Pod":{"name":"llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz","namespace":"llm-d-yo6n8jk1li"},"namespace":"llm-d-yo6n8jk1li","name":"llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz","reconcileID":"855fd33c-36cb-4cb3-9b32-9e3fa7af89c3","name":{"name":"llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz","namespace":"llm-d-yo6n8jk1li"}} | |
| 2025-06-24T02:58:17.8851759Z {"level":"Level(-2)","ts":"2025-06-24T02:58:01Z","caller":"controller/pod_reconciler.go:102","msg":"Pod already exists","controller":"pod","controllerGroup":"","controllerKind":"Pod","Pod":{"name":"llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz","namespace":"llm-d-yo6n8jk1li"},"namespace":"llm-d-yo6n8jk1li","name":"llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz","reconcileID":"855fd33c-36cb-4cb3-9b32-9e3fa7af89c3","name":{"name":"llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz","namespace":"llm-d-yo6n8jk1li"}} | |
| 2025-06-24T02:58:17.8856988Z {"level":"Level(-2)","ts":"2025-06-24T02:58:01Z","caller":"metrics/pod_metrics.go:92","msg":"Starting refresher","pod":{"name":"llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz","namespace":"llm-d-yo6n8jk1li"},"pod":"{NamespacedName:llm-d-yo6n8jk1li/llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz Address:10.244.0.31 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:prefill pod-template-hash:5c9d57fbfc]}"} | |
| 2025-06-24T02:58:17.8861803Z {"level":"Level(-3)","ts":"2025-06-24T02:58:02Z","caller":"controller/pod_reconciler.go:51","msg":"Pod being reconciled","controller":"pod","controllerGroup":"","controllerKind":"Pod","Pod":{"name":"llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2","namespace":"llm-d-yo6n8jk1li"},"namespace":"llm-d-yo6n8jk1li","name":"llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2","reconcileID":"c8daa75a-81a3-4c7d-8499-71846e003bef","name":{"name":"llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2","namespace":"llm-d-yo6n8jk1li"}} | |
| 2025-06-24T02:58:17.8867166Z {"level":"Level(-2)","ts":"2025-06-24T02:58:02Z","caller":"controller/pod_reconciler.go:102","msg":"Pod already exists","controller":"pod","controllerGroup":"","controllerKind":"Pod","Pod":{"name":"llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2","namespace":"llm-d-yo6n8jk1li"},"namespace":"llm-d-yo6n8jk1li","name":"llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2","reconcileID":"c8daa75a-81a3-4c7d-8499-71846e003bef","name":{"name":"llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2","namespace":"llm-d-yo6n8jk1li"}} | |
| 2025-06-24T02:58:17.8872148Z {"level":"Level(-2)","ts":"2025-06-24T02:58:02Z","caller":"metrics/pod_metrics.go:92","msg":"Starting refresher","pod":{"name":"llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2","namespace":"llm-d-yo6n8jk1li"},"pod":"{NamespacedName:llm-d-yo6n8jk1li/llm-d-yo6n8jk1li-vllm-sim-decode-68d6fb8df5-2khq2 Address:10.244.0.29 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:decode pod-template-hash:68d6fb8df5]}"} | |
| 2025-06-24T02:58:17.8875031Z {"level":"info","ts":"2025-06-24T02:58:05Z","caller":"runnable/grpc.go:19","msg":"gRPC server starting","name":"ext-proc"} | |
| 2025-06-24T02:58:17.8876127Z {"level":"info","ts":"2025-06-24T02:58:05Z","caller":"runnable/grpc.go:28","msg":"gRPC server listening","name":"ext-proc","port":9002} | |
| 2025-06-24T02:58:17.8879195Z {"level":"Level(-2)","ts":"2025-06-24T02:58:14Z","caller":"controller/inferencepool_reconciler.go:45","msg":"Reconciling InferencePool","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool","InferencePool":{"name":"llm-d-yo6n8jk1li-vllm-sim-inference-pool","namespace":"llm-d-yo6n8jk1li"},"namespace":"llm-d-yo6n8jk1li","name":"llm-d-yo6n8jk1li-vllm-sim-inference-pool","reconcileID":"e5bf8c6c-37b5-449f-9264-2109afde5d52","inferencePool":{"name":"llm-d-yo6n8jk1li-vllm-sim-inference-pool","namespace":"llm-d-yo6n8jk1li"}} | |
| 2025-06-24T02:58:17.8882679Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:17.8883443Z <== Logs of container llm-d-yo6n8jk1li-vllm-sim-epp-596dd57477-gsx8s | |
| 2025-06-24T02:58:17.8884154Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:17.8884841Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:17.8885526Z ==> Description of pod llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz | |
| 2025-06-24T02:58:17.8886228Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:17.8887220Z >>> kubectl --request-timeout=30s describe pod llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz --namespace llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:17.9300915Z Name: llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz | |
| 2025-06-24T02:58:17.9301476Z Namespace: llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:17.9302181Z Priority: 0 | |
| 2025-06-24T02:58:17.9302702Z Service Account: llm-d-yo6n8jk1li-vllm-sim-sa | |
| 2025-06-24T02:58:17.9303029Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T02:58:17.9303324Z Start Time: Tue, 24 Jun 2025 02:58:00 +0000 | |
| 2025-06-24T02:58:17.9303601Z Labels: llm-d.ai/inferenceServing=true | |
| 2025-06-24T02:58:17.9303861Z llm-d.ai/model=food-review | |
| 2025-06-24T02:58:17.9304094Z llm-d.ai/role=prefill | |
| 2025-06-24T02:58:17.9304339Z pod-template-hash=5c9d57fbfc | |
| 2025-06-24T02:58:17.9304608Z Annotations: <none> | |
| 2025-06-24T02:58:17.9304801Z Status: Running | |
| 2025-06-24T02:58:17.9304984Z IP: 10.244.0.31 | |
| 2025-06-24T02:58:17.9305167Z IPs: | |
| 2025-06-24T02:58:17.9305317Z IP: 10.244.0.31 | |
| 2025-06-24T02:58:17.9305612Z Controlled By: ReplicaSet/llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc | |
| 2025-06-24T02:58:17.9305941Z Containers: | |
| 2025-06-24T02:58:17.9306179Z vllm: | |
| 2025-06-24T02:58:17.9306581Z Container ID: containerd://a445873bb001df62f8de6834951c3c5de5e5d8a45e0fcf263d561f60d6d6e3ec | |
| 2025-06-24T02:58:17.9307034Z Image: ghcr.io/llm-d/llm-d-inference-sim:0.0.4 | |
| 2025-06-24T02:58:17.9307534Z Image ID: ghcr.io/llm-d/llm-d-inference-sim@sha256:5995c4dde42888844812359c121899c1d12e647588ed58fef206c3c653315338 | |
| 2025-06-24T02:58:17.9307985Z Port: 5557/TCP | |
| 2025-06-24T02:58:17.9308181Z Host Port: 0/TCP | |
| 2025-06-24T02:58:17.9308361Z Args: | |
| 2025-06-24T02:58:17.9308506Z --model | |
| 2025-06-24T02:58:17.9308843Z food-review | |
| 2025-06-24T02:58:17.9309004Z --port | |
| 2025-06-24T02:58:17.9309158Z 8000 | |
| 2025-06-24T02:58:17.9309442Z State: Running | |
| 2025-06-24T02:58:17.9309736Z Started: Tue, 24 Jun 2025 02:58:01 +0000 | |
| 2025-06-24T02:58:17.9309979Z Ready: True | |
| 2025-06-24T02:58:17.9310167Z Restart Count: 0 | |
| 2025-06-24T02:58:17.9310351Z Environment: | |
| 2025-06-24T02:58:17.9310522Z HOME: /home | |
| 2025-06-24T02:58:17.9310684Z Mounts: | |
| 2025-06-24T02:58:17.9310838Z /home from home (rw) | |
| 2025-06-24T02:58:17.9311171Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-986ks (ro) | |
| 2025-06-24T02:58:17.9311519Z Conditions: | |
| 2025-06-24T02:58:17.9311682Z Type Status | |
| 2025-06-24T02:58:17.9311915Z PodReadyToStartContainers True | |
| 2025-06-24T02:58:17.9312151Z Initialized True | |
| 2025-06-24T02:58:17.9312564Z Ready True | |
| 2025-06-24T02:58:17.9312795Z ContainersReady True | |
| 2025-06-24T02:58:17.9313022Z PodScheduled True | |
| 2025-06-24T02:58:17.9313215Z Volumes: | |
| 2025-06-24T02:58:17.9313363Z home: | |
| 2025-06-24T02:58:17.9313607Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T02:58:17.9313921Z Medium: | |
| 2025-06-24T02:58:17.9314091Z SizeLimit: <unset> | |
| 2025-06-24T02:58:17.9314288Z kube-api-access-986ks: | |
| 2025-06-24T02:58:17.9314606Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T02:58:17.9314981Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T02:58:17.9315264Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T02:58:17.9315600Z ConfigMapOptional: <nil> | |
| 2025-06-24T02:58:17.9315834Z DownwardAPI: true | |
| 2025-06-24T02:58:17.9316053Z QoS Class: BestEffort | |
| 2025-06-24T02:58:17.9316295Z Node-Selectors: <none> | |
| 2025-06-24T02:58:17.9316619Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T02:58:17.9317175Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T02:58:17.9317473Z Events: | |
| 2025-06-24T02:58:17.9317662Z Type Reason Age From Message | |
| 2025-06-24T02:58:17.9317937Z ---- ------ ---- ---- ------- | |
| 2025-06-24T02:58:17.9318746Z Normal Scheduled 17s default-scheduler Successfully assigned llm-d-yo6n8jk1li/llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz to chart-testing-control-plane | |
| 2025-06-24T02:58:17.9319626Z Normal Pulled 16s kubelet Container image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" already present on machine | |
| 2025-06-24T02:58:17.9320135Z Normal Created 16s kubelet Created container vllm | |
| 2025-06-24T02:58:17.9320577Z Normal Started 16s kubelet Started container vllm | |
| 2025-06-24T02:58:17.9321988Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:17.9322925Z <== Description of pod llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz | |
| 2025-06-24T02:58:17.9323654Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T02:58:17.9324614Z >>> kubectl --request-timeout=30s get pods llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz --no-headers --namespace llm-d-yo6n8jk1li --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T02:58:17.9828596Z >>> kubectl --request-timeout=30s get pods llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz --no-headers --namespace llm-d-yo6n8jk1li --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T02:58:18.0324450Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:18.0325312Z ==> Logs of container llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz | |
| 2025-06-24T02:58:18.0326054Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:18.0327578Z >>> kubectl --request-timeout=30s logs llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz --namespace llm-d-yo6n8jk1li --container vllm | |
| 2025-06-24T02:58:18.0830450Z I0624 02:58:01.517408 1 cmd.go:36] "Start vllm simulator" | |
| 2025-06-24T02:58:18.0831070Z I0624 02:58:01.517512 1 simulator.go:135] "Server starting" port=8000 | |
| 2025-06-24T02:58:18.0851756Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:18.0852950Z <== Logs of container llm-d-yo6n8jk1li-vllm-sim-prefill-5c9d57fbfc-hjlnz | |
| 2025-06-24T02:58:18.0853511Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:18.0853888Z ======================================================================================================================== | |
| 2025-06-24T02:58:18.0854254Z Deleting release "llm-d-yo6n8jk1li"... | |
| 2025-06-24T02:58:18.0854670Z >>> helm uninstall llm-d-yo6n8jk1li --namespace llm-d-yo6n8jk1li --timeout 500s | |
| 2025-06-24T02:58:18.6404356Z release "llm-d-yo6n8jk1li" uninstalled | |
| 2025-06-24T02:58:18.6457610Z Deleting namespace "llm-d-yo6n8jk1li"... | |
| 2025-06-24T02:58:18.6458647Z >>> kubectl --request-timeout=30s delete namespace llm-d-yo6n8jk1li --timeout 180s | |
| 2025-06-24T02:58:18.7130365Z namespace "llm-d-yo6n8jk1li" deleted | |
| 2025-06-24T02:58:56.8189901Z >>> kubectl --request-timeout=30s get namespace llm-d-yo6n8jk1li | |
| 2025-06-24T02:58:56.8681925Z Namespace "llm-d-yo6n8jk1li" terminated. | |
| 2025-06-24T02:58:56.8682691Z >>> git worktree remove ./ct-previous-revision820086721 | |
| 2025-06-24T02:58:56.8865581Z | |
| 2025-06-24T02:58:56.8866032Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:56.8866810Z Error: failed installing charts: failed processing charts | |
| 2025-06-24T02:58:56.8867904Z ✖︎ llm-d => (version: "1.0.20", path: "charts/llm-d") > failed waiting for process: exit status 1 | |
| 2025-06-24T02:58:56.8868751Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T02:58:56.8869423Z failed installing charts: failed processing charts | |
| 2025-06-24T02:58:56.8889098Z ##[error]Process completed with exit code 1. | |
| 2025-06-24T02:58:56.8948523Z Post job cleanup. | |
| 2025-06-24T02:58:56.9321661Z Error response from daemon: No such container: kind-registry | |
| 2025-06-24T02:58:56.9465790Z Deleting cluster "chart-testing" ... | |
| 2025-06-24T02:58:59.4958941Z Deleted nodes: ["chart-testing-control-plane"] | |
| 2025-06-24T02:58:59.5049827Z Post job cleanup. | |
| 2025-06-24T02:58:59.5991043Z [command]/usr/bin/git version | |
| 2025-06-24T02:58:59.6029470Z git version 2.49.0 | |
| 2025-06-24T02:58:59.6074984Z Temporarily overriding HOME='/home/runner/work/_temp/f64b8015-8bd8-407d-808d-5ff190f27f12' before making global git config changes | |
| 2025-06-24T02:58:59.6076390Z Adding repository directory to the temporary git global config as a safe directory | |
| 2025-06-24T02:58:59.6087728Z [command]/usr/bin/git config --global --add safe.directory /home/runner/work/llm-d-deployer/llm-d-deployer | |
| 2025-06-24T02:58:59.6124723Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand | |
| 2025-06-24T02:58:59.6160107Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" | |
| 2025-06-24T02:58:59.6409143Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader | |
| 2025-06-24T02:58:59.6429874Z http.https://github.com/.extraheader | |
| 2025-06-24T02:58:59.6442927Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader | |
| 2025-06-24T02:58:59.6475500Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" | |
| 2025-06-24T02:58:59.6805162Z Cleaning up orphan processes |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment