CDH shows abnormal exit
Check which server the HiveServer2 instance is on, and check the log /var/log/hive/hadoop-cmf-hive-HIVESERVER2-hadoop105.log.out. The log error is as follows:
2023-05-23 15:18:05,331 ERROR org.apache.hive.service.server.HiveServer2: [main]: Error starting HiveServer2
java.lang.Error: Max start attempts 30 exhausted
at org.apache.hive.service.server.HiveServer2.startHiveServer2(HiveServer2.java:609) ~[hive-service-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
at org.apache.hive.service.server.HiveServer2.access$700(HiveServer2.java:94) ~[hive-service-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
at org.apache.hive.service.server.HiveServer2$StartOptionExecutor.execute(HiveServer2.java:827) [hive-service-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
at org.apache.hive.service.server.HiveServer2.main(HiveServer2.java:696) [hive-service-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_181]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_181]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_181]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_181]
at org.apache.hadoop.util.RunJar.run(RunJar.java:313) [hadoop-common-3.0.0-cdh6.3.2.jar:?]
at org.apache.hadoop.util.RunJar.main(RunJar.java:227) [hadoop-common-3.0.0-cdh6.3.2.jar:?]
Caused by: java.lang.RuntimeException: Error applying authorization policy on hive configuration: org.apache.hadoop.security.AccessControlException: Permission denied: user=hive, access=WRITE, inode="/tmp":hdfs:supergroup :drwxr-xr-x
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:400)
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:256)
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:194)
at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1855)
at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1839)
at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkAncestorAccess(FSDirectory.java:1798)
at org.apache.hadoop.hdfs.server.namenode.FSDirMkdirOp.mkdirs(FSDirMkdirOp.java:61)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3101)
at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:1123)
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:696)
at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991)
at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:869)
at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:815)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1875)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2675)
at org.apache.hive.service.cli.CLIService.init(CLIService.java:113) ~[hive-service-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
at org.apache.hive.service.CompositeService.init(CompositeService.java:59) ~[hive-service-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
at org.apache.hive.service.server.HiveServer2.init(HiveServer2.java:136) ~[hive-service-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
at org.apache.hive.service.server.HiveServer2.startHiveServer2(HiveServer2.java:579) ~[hive-service-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
... 9 more
Caused by: java.lang.RuntimeException: org.apache.hadoop.security.AccessControlException: Permission denied: user=hive, access=WRITE, inode="/tmp":hdfs:supergroup:drwxr-xr-x
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:400)
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:256)
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:194)
at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1855)
at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1839)
at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkAncestorAccess(FSDirectory.java:1798)
at org.apache.hadoop.hdfs.server.namenode.FSDirMkdirOp.mkdirs(FSDirMkdirOp.java:61)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3101)
at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:1123)
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:696)
at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991)
at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:869)
at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:815)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1875)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2675)
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:604) ~[hive-exec-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:540) ~[hive-exec-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
at org.apache.hive.service.cli.CLIService.applyAuthorizationConfigPolicy(CLIService.java:125) ~[hive-service-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
at org.apache.hive.service.cli.CLIService.init(CLIService.java:110) ~[hive-service-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
at org.apache.hive.service.CompositeService.init(CompositeService.java:59) ~[hive-service-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
at org.apache.hive.service.server.HiveServer2.init(HiveServer2.java:136) ~[hive-service-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
at org.apache.hive.service.server.HiveServer2.startHiveServer2(HiveServer2.java:579) ~[hive-service-2.1.1-cdh6.3.2.jar:2.1.1-cdh6.3.2]
Caused by: java.lang.RuntimeException: Error applying authorization policy on hive configuration: org.apache.hadoop.security.AccessControlException: Permission denied: user=hive, access=WRITE, inode="/tmp": hdfs:supergroup:drwxr-xr-x
This error usually means that the Hive user does not have write permission in the “/tmp” directory, so Hive cannot create the required temporary files in this directory, causing it to exit abnormally.
Enter the HiveServer2 instance server and check the /tmp permission
[root@hadoop105 ~]# su - hdfs Last login: Tue May 23 15:26:02 CST 2023 on pts/1 [hdfs@hadoop105 ~]$ hdfs dfs -ls -d /tmp drwxr-xr-x - hdfs supergroup 0 2023-05-23 14:15 /tmp
Set the /tmp directory permission to “drwxrwxrwt”, otherwise hive has no permission, use the following command to modify the /tmp permission
[hdfs@hadoop105 ~]$ hdfs dfs -chmod 777 /tmp
If the hdfs user cannot be switched, please modify the /etc/passwd file and change /sbin/nologin in the hdfs column to /bin/bash