Skip to content

Instantly share code, notes, and snippets.

@sixtus

sixtus/gist:8437425

Created January 15, 2014 14:39
Show Gist options
  • Save sixtus/8437425 to your computer and use it in GitHub Desktop.
Save sixtus/8437425 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
2014-01-15 14:36:33,845 INFO [main] io.druid.indexer.IndexGeneratorJob - Job metrik-index-generator-[2014-01-15T09:00:00.000Z/2014-01-15T10:00:00.000Z] submitted, status available at http://hadoop2.madvertise.net:50030/jobdetails.jsp?jobid=job_201401151459_0037
2014-01-15 14:36:33,845 INFO [main] org.apache.hadoop.mapred.JobClient - Running job: job_201401151459_0037
2014-01-15 14:36:33,846 INFO [main] org.apache.hadoop.mapred.JobClient - Job complete: job_201401151459_0019
2014-01-15 14:36:33,855 INFO [main] org.apache.hadoop.mapred.JobClient - Counters: 29
2014-01-15 14:36:33,855 INFO [main] org.apache.hadoop.mapred.JobClient - Job Counters
2014-01-15 14:36:33,855 INFO [main] org.apache.hadoop.mapred.JobClient - Launched reduce tasks=1
2014-01-15 14:36:33,855 INFO [main] org.apache.hadoop.mapred.JobClient - SLOTS_MILLIS_MAPS=62605
2014-01-15 14:36:33,855 INFO [main] org.apache.hadoop.mapred.JobClient - Total time spent by all reduces waiting after reserving slots (ms)=0
2014-01-15 14:36:33,855 INFO [main] org.apache.hadoop.mapred.JobClient - Total time spent by all maps waiting after reserving slots (ms)=0
2014-01-15 14:36:33,855 INFO [main] org.apache.hadoop.mapred.JobClient - Rack-local map tasks=2
2014-01-15 14:36:33,855 INFO [main] org.apache.hadoop.mapred.JobClient - Launched map tasks=3
2014-01-15 14:36:33,855 INFO [main] org.apache.hadoop.mapred.JobClient - Data-local map tasks=1
2014-01-15 14:36:33,855 INFO [main] org.apache.hadoop.mapred.JobClient - SLOTS_MILLIS_REDUCES=10379
2014-01-15 14:36:33,855 INFO [main] org.apache.hadoop.mapred.JobClient - File Output Format Counters
2014-01-15 14:36:33,855 INFO [main] org.apache.hadoop.mapred.JobClient - Bytes Written=0
2014-01-15 14:36:33,855 INFO [main] org.apache.hadoop.mapred.JobClient - FileSystemCounters
2014-01-15 14:36:33,855 INFO [main] org.apache.hadoop.mapred.JobClient - FILE_BYTES_READ=46
2014-01-15 14:36:33,855 INFO [main] org.apache.hadoop.mapred.JobClient - HDFS_BYTES_READ=136718281
2014-01-15 14:36:33,855 INFO [main] org.apache.hadoop.mapred.JobClient - FILE_BYTES_WRITTEN=206080
2014-01-15 14:36:33,855 INFO [main] org.apache.hadoop.mapred.JobClient - File Input Format Counters
2014-01-15 14:36:33,855 INFO [main] org.apache.hadoop.mapred.JobClient - Bytes Read=136717870
2014-01-15 14:36:33,855 INFO [main] org.apache.hadoop.mapred.JobClient - Map-Reduce Framework
2014-01-15 14:36:33,855 INFO [main] org.apache.hadoop.mapred.JobClient - Map output materialized bytes=78
2014-01-15 14:36:33,856 INFO [main] org.apache.hadoop.mapred.JobClient - Map input records=2265157
2014-01-15 14:36:33,856 INFO [main] org.apache.hadoop.mapred.JobClient - Reduce shuffle bytes=78
2014-01-15 14:36:33,856 INFO [main] org.apache.hadoop.mapred.JobClient - Spilled Records=0
2014-01-15 14:36:33,856 INFO [main] org.apache.hadoop.mapred.JobClient - Map output bytes=0
2014-01-15 14:36:33,856 INFO [main] org.apache.hadoop.mapred.JobClient - Total committed heap usage (bytes)=12305039360
2014-01-15 14:36:33,856 INFO [main] org.apache.hadoop.mapred.JobClient - CPU time spent (ms)=71250
2014-01-15 14:36:33,856 INFO [main] org.apache.hadoop.mapred.JobClient - Combine input records=0
2014-01-15 14:36:33,856 INFO [main] org.apache.hadoop.mapred.JobClient - SPLIT_RAW_BYTES=411
2014-01-15 14:36:33,856 INFO [main] org.apache.hadoop.mapred.JobClient - Reduce input records=0
2014-01-15 14:36:33,856 INFO [main] org.apache.hadoop.mapred.JobClient - Reduce input groups=0
2014-01-15 14:36:33,856 INFO [main] org.apache.hadoop.mapred.JobClient - Combine output records=0
2014-01-15 14:36:33,856 INFO [main] org.apache.hadoop.mapred.JobClient - Physical memory (bytes) snapshot=11220934656
2014-01-15 14:36:33,856 INFO [main] org.apache.hadoop.mapred.JobClient - Reduce output records=0
2014-01-15 14:36:33,856 INFO [main] org.apache.hadoop.mapred.JobClient - Virtual memory (bytes) snapshot=21127303168
2014-01-15 14:36:33,856 INFO [main] org.apache.hadoop.mapred.JobClient - Map output records=0
2014-01-15 14:36:33,880 ERROR [main] io.druid.cli.CliHadoopIndexer - failure!!!!
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at io.druid.cli.CliHadoopIndexer.run(CliHadoopIndexer.java:104)
at io.druid.cli.Main.main(Main.java:91)
Caused by: java.lang.NullPointerException
at io.druid.indexer.IndexGeneratorJob.getPublishedSegments(IndexGeneratorJob.java:178)
at io.druid.indexer.DbUpdaterJob.run(DbUpdaterJob.java:58)
at io.druid.indexer.HadoopDruidIndexerJob.run(HadoopDruidIndexerJob.java:102)
at io.druid.cli.CliInternalHadoopIndexer.run(CliInternalHadoopIndexer.java:50)
at io.druid.cli.Main.main(Main.java:91)
... 6 more
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment