Skip to content

Instantly share code, notes, and snippets.

@bkuberek

bkuberek/Errors in application.log

Last active August 29, 2015 13:56
Show Gist options
  • Save bkuberek/9212925 to your computer and use it in GitHub Desktop.
Save bkuberek/9212925 to your computer and use it in GitHub Desktop.
Download ZIP
Errors in Data Warehouse application .log
Raw
Errors in application.log
bkuberek@aimee:~$ grep 'HiveCommandError' /var/log/datawarehouse/application.log | egrep -o '2014-[[:digit:]]+-[[:digit:]]+' | awk -F_ '{A[$1" :: "$2]++}END{for (i in A) print i,A[i]}' | sort
2014-01-02 :: 1
2014-01-06 :: 1
2014-01-07 :: 1
2014-01-08 :: 2
2014-01-09 :: 2
2014-01-10 :: 1
2014-01-13 :: 1
2014-01-14 :: 3
2014-01-15 :: 5
2014-01-16 :: 9
2014-01-17 :: 21
2014-01-20 :: 1
2014-01-22 :: 2
2014-01-23 :: 4
2014-01-24 :: 5
2014-01-25 :: 2
2014-01-27 :: 3
2014-01-29 :: 3
2014-01-30 :: 3
2014-02-03 :: 43
2014-02-04 :: 56
2014-02-05 :: 100
2014-02-06 :: 60
2014-02-07 :: 4
2014-02-10 :: 48
2014-02-11 :: 80
2014-02-12 :: 91
2014-02-13 :: 9
2014-02-14 :: 28
2014-02-15 :: 36
2014-02-16 :: 11
2014-02-17 :: 54
2014-02-18 :: 184
2014-02-19 :: 551
2014-02-20 :: 42
2014-02-21 :: 99
2014-02-22 :: 49
2014-02-23 :: 27
2014-02-24 :: 164
bkuberek@aimee:~$ grep 'SSL SYSCALL' /var/log/datawarehouse/application.log | egrep -o '2014-[[:digit:]]+-[[:digit:]]+' | awk -F_ '{A[$1" :: "$2]++}END{for (i in A) print i,A[i]}' | sort
2014-02-05 :: 3
2014-02-06 :: 8
2014-02-20 :: 25
2014-02-21 :: 76
2014-02-22 :: 49
2014-02-23 :: 27
2014-02-24 :: 139
bkuberek@aimee:~$
Raw
HiveCommandError.json
[
["date","HiveCommandError","count"],
["2014-01-02","HiveCommandError",1],
["2014-01-06","HiveCommandError",1],
["2014-01-07","HiveCommandError",1],
["2014-01-08","HiveCommandError",2],
["2014-01-09","HiveCommandError",2],
["2014-01-10","HiveCommandError",1],
["2014-01-13","HiveCommandError",1],
["2014-01-14","HiveCommandError",3],
["2014-01-15","HiveCommandError",5],
["2014-01-16","HiveCommandError",9],
["2014-01-17","HiveCommandError",21],
["2014-01-20","HiveCommandError",1],
["2014-01-22","HiveCommandError",2],
["2014-01-23","HiveCommandError",4],
["2014-01-24","HiveCommandError",5],
["2014-01-25","HiveCommandError",2],
["2014-01-27","HiveCommandError",3],
["2014-01-29","HiveCommandError",3],
["2014-01-30","HiveCommandError",3],
["2014-02-03","HiveCommandError",43],
["2014-02-04","HiveCommandError",56],
["2014-02-05","HiveCommandError",100],
["2014-02-06","HiveCommandError",60],
["2014-02-07","HiveCommandError",4],
["2014-02-10","HiveCommandError",48],
["2014-02-11","HiveCommandError",80],
["2014-02-12","HiveCommandError",91],
["2014-02-13","HiveCommandError",9],
["2014-02-14","HiveCommandError",28],
["2014-02-15","HiveCommandError",36],
["2014-02-16","HiveCommandError",11],
["2014-02-17","HiveCommandError",54],
["2014-02-18","HiveCommandError",184],
["2014-02-19","HiveCommandError",551],
["2014-02-20","HiveCommandError",42],
["2014-02-21","HiveCommandError",99],
["2014-02-22","HiveCommandError",49],
["2014-02-23","HiveCommandError",27],
["2014-02-24","HiveCommandError",164],
["2014-02-25","HiveCommandError",2]
]
Raw
SSL_SYSCALL_error.json
[
["date","error","count"],
["2014-02-05","SSL SYSCALL",3],
["2014-02-06","SSL SYSCALL",8],
["2014-02-20","SSL SYSCALL",25],
["2014-02-21","SSL SYSCALL",76],
["2014-02-22","SSL SYSCALL",49],
["2014-02-23","SSL SYSCALL",27],
["2014-02-24","SSL SYSCALL",139]
]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment