最新文章专题视频专题问答1问答10问答100问答1000问答2000关键字专题1关键字专题50关键字专题500关键字专题1500TAG最新视频文章推荐1 推荐3 推荐5 推荐7 推荐9 推荐11 推荐13 推荐15 推荐17 推荐19 推荐21 推荐23 推荐25 推荐27 推荐29 推荐31 推荐33 推荐35 推荐37视频文章20视频文章30视频文章40视频文章50视频文章60 视频文章70视频文章80视频文章90视频文章100视频文章120视频文章140 视频2关键字专题关键字专题tag2tag3文章专题文章专题2文章索引1文章索引2文章索引3文章索引4文章索引5123456789101112131415文章专题3
当前位置: 首页 - 科技 - 知识百科 - 正文

hadooptoomanyfiles异常处理

来源:懂视网 责编:小采 时间:2020-11-09 13:17:52
文档

hadooptoomanyfiles异常处理

hadooptoomanyfiles异常处理:今天 hadoop 集群任务执行失败了。报错信息如下 2013-10-26 08:00:03,229 ERROR server.TThreadPoolServer TThreadPoolServer.java:run182 - Error occurred during processing of message. at org.apach
推荐度:
导读hadooptoomanyfiles异常处理:今天 hadoop 集群任务执行失败了。报错信息如下 2013-10-26 08:00:03,229 ERROR server.TThreadPoolServer TThreadPoolServer.java:run182 - Error occurred during processing of message. at org.apach

今天 hadoop 集群任务执行失败了。报错信息如下 2013-10-26 08:00:03,229 ERROR server.TThreadPoolServer TThreadPoolServer.java:run182 - Error occurred during processing of message. at org.apache.hadoop.hive.service.HiveServer$ThriftHiveProcess

今天hadoop集群任务执行失败了。报错信息如下

  1. 2013-10-26 08:00:03,229 ERROR server.TThreadPoolServer (TThreadPoolServer.java:run(182)) - Error occurred during processing of message.
  2. at org.apache.hadoop.hive.service.HiveServer$ThriftHiveProcessorFactory.getProcessor(HiveServer.java:553)
  3. at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:169)
  4. at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
  5. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
  6. at java.lang.Thread.run(Thread.java:662)
  7. at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:277)
  8. at org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.init(HiveServer.java:136)
  9. at org.apache.hadoop.hive.service.HiveServer$ThriftHiveProcessorFactory.getProcessor(HiveServer.java:550)
  10. ... 4 more
  11. at org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthorizeProviderManager(HiveUtils.java:199)
  12. at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:272)
  13. ... 6 more
  14. Caused by: java.lang.RuntimeException: java.io.FileNotFoundException: /home/hadoop/hadoop-0.20.205.0/conf/mapred-site.xml (Too many open files)
  15. at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1231)
  16. at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:1093)
  17. at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:1037)
  18. at org.apache.hadoop.conf.Configuration.set(Configuration.java:438)
  19. at org.apache.hadoop.hive.conf.HiveConf.setVar(HiveConf.java:762)
  20. at org.apache.hadoop.hive.conf.HiveConf.setVar(HiveConf.java:770)
  21. at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:169)
  22. at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
  23. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
  24. at java.lang.Thread.run(Thread.java:662)
  25. Caused by: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: java.io.FileNotFoundException: /home/hadoop/hadoop-0.20.205.0/conf/core-site.xml (Too many open files)
  26. at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:277)
  27. at org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.init(HiveServer.java:136)
  28. at org.apache.hadoop.hive.service.HiveServer$ThriftHiveProcessorFactory.getProcessor(HiveServer.java:550)
  29. ... 4 more
  30. Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: java.io.FileNotFoundException: /home/hadoop/hadoop-0.20.205.0/conf/core-site.xml (Too many open files)
  31. at org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthorizeProviderManager(HiveUtils.java:199)
  32. at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:272)
  33. ... 6 more


debian系统解决方式

  1. ulimit -HSn 32768

文档

hadooptoomanyfiles异常处理

hadooptoomanyfiles异常处理:今天 hadoop 集群任务执行失败了。报错信息如下 2013-10-26 08:00:03,229 ERROR server.TThreadPoolServer TThreadPoolServer.java:run182 - Error occurred during processing of message. at org.apach
推荐度:
标签: 处理 错误 解决
  • 热门焦点

最新推荐

猜你喜欢

热门推荐

专题
Top