Skip to content

Instantly share code, notes, and snippets.

@burdzwastaken

burdzwastaken/agent status

Created September 5, 2018 21:02
Show Gist options
  • Save burdzwastaken/b3a21bc2cd91716479d941f339730cdd to your computer and use it in GitHub Desktop.
Save burdzwastaken/b3a21bc2cd91716479d941f339730cdd to your computer and use it in GitHub Desktop.
Download ZIP
Raw
agent status
root@ip-10-17-42-179:/# agent status
Getting the status from the agent.
==============
Agent (v6.4.2)
==============
Status date: 2018-09-05 21:02:14.665416 UTC
Pid: 344
Python Version: 2.7.15
Logs:
Check Runners: 2
Log Level: WARNING
Paths
=====
Config File: /etc/datadog-agent/datadog.yaml
conf.d: /etc/datadog-agent/conf.d
checks.d: /etc/datadog-agent/checks.d
Clocks
======
NTP offset: -0.006645341 s
System UTC time: 2018-09-05 21:02:14.665416 UTC
Host Info
=========
bootTime: 2018-04-12 21:13:17.000000 UTC
kernelVersion: 3.10.0-693.11.1.el7.x86_64
os: linux
platform: debian
platformFamily: debian
platformVersion: buster/sid
procs: 73
uptime: 1.2611297e+07
virtualizationRole: guest
virtualizationSystem: xen
Hostnames
=========
ec2-hostname: ip-10-17-42-179.kdev.msap.io
hostname: i-0a60d84de82ec25c4
instance-id: i-0a60d84de82ec25c4
socket-fqdn: ip-10-17-42-179.kdev.msap.io
socket-hostname: ip-10-17-42-179.kdev.msap.io
=========
Collector
=========
Running Checks
==============
cpu
---
Total Runs: 162
Metric Samples: 6, Total: 966
Events: 0, Total: 0
Service Checks: 0, Total: 0
Average Execution Time : 0ms
disk (1.2.0)
------------
Total Runs: 162
Metric Samples: 156, Total: 25272
Events: 0, Total: 0
Service Checks: 0, Total: 0
Average Execution Time : 245ms
docker
------
Total Runs: 162
Metric Samples: 250, Total: 40500
Events: 0, Total: 1
Service Checks: 1, Total: 162
Average Execution Time : 100ms
file_handle
-----------
Total Runs: 162
Metric Samples: 1, Total: 162
Events: 0, Total: 0
Service Checks: 0, Total: 0
Average Execution Time : 0ms
io
--
Total Runs: 162
Metric Samples: 39, Total: 6291
Events: 0, Total: 0
Service Checks: 0, Total: 0
Average Execution Time : 2ms
kubelet (1.4.0)
---------------
Total Runs: 162
Metric Samples: 0, Total: 0
Events: 0, Total: 0
Service Checks: 0, Total: 0
Average Execution Time : 5ms
Error: Unable to detect the kubelet URL automatically.
Traceback (most recent call last):
File "/opt/datadog-agent/embedded/lib/python2.7/site-packages/datadog_checks/checks/base.py", line 303, in run
self.check(copy.deepcopy(self.instances[0]))
File "/opt/datadog-agent/embedded/lib/python2.7/site-packages/datadog_checks/kubelet/kubelet.py", line 86, in check
raise CheckException("Unable to detect the kubelet URL automatically.")
CheckException: Unable to detect the kubelet URL automatically.
kubernetes_apiserver
--------------------
Total Runs: 162
Metric Samples: 0, Total: 0
Events: 0, Total: 0
Service Checks: 0, Total: 0
Average Execution Time : 0ms
load
----
Total Runs: 162
Metric Samples: 6, Total: 972
Events: 0, Total: 0
Service Checks: 0, Total: 0
Average Execution Time : 0ms
memory
------
Total Runs: 162
Metric Samples: 17, Total: 2754
Events: 0, Total: 0
Service Checks: 0, Total: 0
Average Execution Time : 0ms
network (1.6.0)
---------------
Total Runs: 162
Metric Samples: 74, Total: 11988
Events: 0, Total: 0
Service Checks: 0, Total: 0
Average Execution Time : 12ms
ntp
---
Total Runs: 162
Metric Samples: 1, Total: 162
Events: 0, Total: 0
Service Checks: 1, Total: 162
Average Execution Time : 0ms
uptime
------
Total Runs: 162
Metric Samples: 1, Total: 162
Events: 0, Total: 0
Service Checks: 0, Total: 0
Average Execution Time : 0ms
========
JMXFetch
========
Initialized checks
==================
no checks
Failed checks
=============
no checks
=========
Forwarder
=========
CheckRunsV1: 163
Dropped: 0
DroppedOnInput: 0
Errors: 0
Events: 0
HostMetadata: 0
IntakeV1: 15
Metadata: 0
Requeued: 0
Retried: 0
RetryQueueSize: 0
Series: 0
ServiceChecks: 0
SketchSeries: 0
Success: 341
TimeseriesV1: 163
API Keys status
===============
https://6-4-2-app.agent.datadoghq.com,*************************cc830: API Key valid
==========
Logs Agent
==========
Logs Agent is not running
=========
DogStatsD
=========
Checks Metric Sample: 92798
Event: 2
Events Flushed: 2
Number Of Flushes: 163
Series Flushed: 71355
Service Check: 2109
Dogstatsd Metric Sample: 651
Raw
container logs
[master] burdz@~/code/core-paas-datadog: kubectl -n core-paas logs datadog-xtdfj
[s6-init] making user provided files available at /var/run/s6/etc...exited 0.
[s6-init] ensuring user provided files have correct perms...exited 0.
[fix-attrs.d] applying ownership & permissions fixes...
[fix-attrs.d] done.
[cont-init.d] executing container initialization scripts...
[cont-init.d] 01-check-apikey.sh: executing...
[cont-init.d] 01-check-apikey.sh: exited 0.
[cont-init.d] 10-dogstatsd-socket.sh: executing...
[cont-init.d] 10-dogstatsd-socket.sh: exited 0.
[cont-init.d] 50-ecs.sh: executing...
[cont-init.d] 50-ecs.sh: exited 0.
[cont-init.d] 50-kubernetes.sh: executing...
[cont-init.d] 50-kubernetes.sh: exited 0.
[cont-init.d] 50-mesos.sh: executing...
[cont-init.d] 50-mesos.sh: exited 0.
[cont-init.d] 51-docker.sh: executing...
[cont-init.d] 51-docker.sh: exited 0.
[cont-init.d] 59-defaults.sh: executing...
[cont-init.d] 59-defaults.sh: exited 0.
[cont-init.d] 60-network-check.sh: executing...
[cont-init.d] 60-network-check.sh: exited 0.
[cont-init.d] 89-copy-customfiles.sh: executing...
'/conf.d/kubernetes_state.yaml' -> '/etc/datadog-agent/conf.d/kubernetes_state.yaml'
/conf.d/..2018_09_05_20_21_24.468239539 -> /etc/datadog-agent/conf.d/..2018_09_05_20_21_24.468239539
'/conf.d/..2018_09_05_20_21_24.468239539/kubernetes_state.yaml' -> '/etc/datadog-agent/conf.d/..2018_09_05_20_21_24.468239539/kubernetes_state.yaml'
[cont-init.d] 89-copy-customfiles.sh: exited 0.
[cont-init.d] done.
[services.d] starting services
[ AGENT ] starting agent
[ TRACE ] starting trace-agent
[PROCESS] starting process-agent
[services.d] done.
[ TRACE ] 2018-09-05 20:21:27 INFO (main.go:98) - Loaded configuration: /etc/datadog-agent/datadog.yaml
[PROCESS] 2018-09-05 20:21:27 INFO (config.go:398) - overriding API key from env DD_API_KEY value
[ TRACE ] 2018-09-05 20:21:28 INFO (trace_writer.go:49) - Trace writer initializing with config: {MaxSpansPerPayload:1000 FlushPeriod:5s UpdateInfoPeriod:1m0s SenderConfig:{MaxAge:20m0s MaxQueuedBytes:67108864 MaxQueuedPayloads:-1 ExponentialB
ackoff:{MaxDuration:2m0s GrowthBase:2 Base:200ms}}}
[ TRACE ] 2018-09-05 20:21:28 INFO (stats_writer.go:42) - Stats writer initializing with config: {MaxEntriesPerPayload:12000 UpdateInfoPeriod:1m0s SenderConfig:{MaxAge:20m0s MaxQueuedBytes:67108864 MaxQueuedPayloads:-1 ExponentialBackoff:{MaxD
uration:2m0s GrowthBase:2 Base:200ms}}}
[ TRACE ] 2018-09-05 20:21:28 INFO (service_writer.go:31) - Service writer initializing with config: {FlushPeriod:5s UpdateInfoPeriod:1m0s SenderConfig:{MaxAge:20m0s MaxQueuedBytes:67108864 MaxQueuedPayloads:-1 ExponentialBackoff:{MaxDuration:
2m0s GrowthBase:2 Base:200ms}}}
[ TRACE ] 2018-09-05 20:21:28 INFO (main.go:161) - trace-agent running on host i-0a60d84de82ec25c4
[ TRACE ] 2018-09-05 20:21:28 INFO (receiver.go:140) - listening for traces at http://0.0.0.0:8126
[ AGENT ] 2018-09-05 20:21:29 UTC | WARN | (kubelet.go:417 in setupKubeletApiEndpoint) | Failed to securely reach the kubelet over HTTPS, received a status 401. Trying a non secure connection over HTTP. We highly recommend configuring TLS to a
ccess the kubelet
[ AGENT ] 2018-09-05 20:21:30 UTC | ERROR | (autoconfig.go:89 in SetupAutoConfig) | Failed to create a kubelet listener: failed to connect to kubelet, Kubernetes listener will not work: temporary failure in kubeutil, will retry later: try dela
y not elapsed yet
[ AGENT ] 2018-09-05 20:21:30 UTC | WARN | (file.go:73 in Collect) | Skipping, open /opt/datadog-agent/bin/agent/dist/conf.d: no such file or directory
[ AGENT ] 2018-09-05 20:21:30 UTC | WARN | (check.go:250 in Configure) | could not get a check instance with the new api: __init__() takes at least 4 arguments (4 given)
[ AGENT ] 2018-09-05 20:21:30 UTC | WARN | (check.go:251 in Configure) | trying to instantiate the check with the old api, passing agentConfig to the constructor
[ AGENT ] 2018-09-05 20:21:31 UTC | WARN | (check.go:276 in Configure) | passing `agentConfig` to the constructor is deprecated, please use the `get_config` function from the 'datadog_agent' package (disk).
[ AGENT ] 2018-09-05 20:21:34 UTC | WARN | (check.go:250 in Configure) | could not get a check instance with the new api: __init__() takes at least 4 arguments (4 given)
[ AGENT ] 2018-09-05 20:21:34 UTC | WARN | (check.go:251 in Configure) | trying to instantiate the check with the old api, passing agentConfig to the constructor
[ AGENT ] 2018-09-05 20:21:34 UTC | WARN | (check.go:276 in Configure) | passing `agentConfig` to the constructor is deprecated, please use the `get_config` function from the 'datadog_agent' package (kubelet).
[ AGENT ] 2018-09-05 20:21:34 UTC | WARN | (check.go:250 in Configure) | could not get a check instance with the new api: __init__() takes at least 4 arguments (4 given)
[ AGENT ] 2018-09-05 20:21:34 UTC | WARN | (check.go:251 in Configure) | trying to instantiate the check with the old api, passing agentConfig to the constructor
[ AGENT ] 2018-09-05 20:21:34 UTC | WARN | (check.go:276 in Configure) | passing `agentConfig` to the constructor is deprecated, please use the `get_config` function from the 'datadog_agent' package (network).
[ TRACE ] 2018-09-05 20:21:38 INFO (receiver.go:324) - no data received
[ AGENT ] 2018-09-05 20:21:40 UTC | ERROR | (autoconfig.go:413 in collect) | Unable to collect configurations from provider Kubernetes pod annotation: temporary failure in kubeutil, will retry later: try delay not elapsed yet
[ AGENT ] 2018-09-05 20:21:49 UTC | WARN | (datadog_agent.go:135 in LogMessage) | (base.py:163) | DEPRECATION NOTICE: `device_name` is deprecated, please use a `device:` tag in the `tags` list instead
[ AGENT ] 2018-09-05 20:21:49 UTC | ERROR | (docker_main.go:128 in fetchForDockerID) | Failed to inspect container 7330ae9627958a0996ce388786679c2e60c4048d3d9d3450b1cab4b65112d65b - Error: No such container: 7330ae9627958a0996ce388786679c2e60c
4048d3d9d3450b1cab4b65112d65b
[ AGENT ] 2018-09-05 20:21:49 UTC | WARN | (tagger.go:252 in Tag) | error collecting from docker: Error: No such container: 7330ae9627958a0996ce388786679c2e60c4048d3d9d3450b1cab4b65112d65b
[ AGENT ] 2018-09-05 20:21:49 UTC | ERROR | (kubeutil.go:50 in GetKubeletConnectionInfo) | connection to kubelet failed: temporary failure in kubeutil, will retry later: try delay not elapsed yet
[ AGENT ] 2018-09-05 20:21:49 UTC | ERROR | (runner.go:277 in work) | Error running check kubelet: [{"message": "Unable to detect the kubelet URL automatically.", "traceback": "Traceback (most recent call last):\n File \"/opt/datadog-agent/em
bedded/lib/python2.7/site-packages/datadog_checks/checks/base.py\", line 303, in run\n self.check(copy.deepcopy(self.instances[0]))\n File \"/opt/datadog-agent/embedded/lib/python2.7/site-packages/datadog_checks/kubelet/kubelet.py\", line
86, in check\n raise CheckException(\"Unable to detect the kubelet URL automatically.\")\nCheckException: Unable to detect the kubelet URL automatically.\n"}]
[ AGENT ] 2018-09-05 20:21:49 UTC | WARN | (datadog_agent.go:135 in LogMessage) | (base.py:163) | DEPRECATION NOTICE: `device_name` is deprecated, please use a `device:` tag in the `tags` list instead
[ AGENT ] 2018-09-05 20:21:50 UTC | ERROR | (autoconfig.go:413 in collect) | Unable to collect configurations from provider Kubernetes pod annotation: temporary failure in kubeutil, will retry later: try delay not elapsed yet
[ AGENT ] 2018-09-05 20:22:00 UTC | WARN | (kubelet.go:417 in setupKubeletApiEndpoint) | Failed to securely reach the kubelet over HTTPS, received a status 401. Trying a non secure connection over HTTP. We highly recommend configuring TLS to a
ccess the kubelet
[ AGENT ] 2018-09-05 20:22:00 UTC | ERROR | (autoconfig.go:413 in collect) | Unable to collect configurations from provider Kubernetes pod annotation: temporary failure in kubeutil, will retry later: cannot connect: https: %!q(<nil>), http: "G
et http://10.17.42.179:10255/pods: dial tcp 10.17.42.179:10255: connect: connection refused"
...
...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment