HPE Ezmeral Software platform
1820389 Members
3476 Online
109623 Solutions
New Discussion

Getting java.lang.NoSuchMethodError error while using hive with tez as execution engine

 
adi1234
Occasional Contributor

Getting java.lang.NoSuchMethodError error while using hive with tez as execution engine

Hi 

I was trying to use hive with tez as execution engine in Mapr. But when I run a query in beeline as

 select count(*) from test2;

Error: org.apache.hive.service.cli.HiveSQLException: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1, vertexId=vertex_1693940182820_0009_1_00, diagnostics=[Vertex vertex_1693940182820_0009_1_00 [Map 1] killed/failed due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: test2 initializer failed, vertex=vertex_1693940182820_0009_1_00 [Map 1], java.lang.NoSuchMethodError: org.apache.hadoop.fs.FileUtil.checkPathForSymlink(Lorg/apache/hadoop/fs/Path;Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/fs/shell/PathData;

I am getting NoSuchMethodError. I am using hive 

Hive 2.3.9-mapr-640

and Tez 0.9 version 

Is it because of version mismatch ?

 

4 REPLIES 4
Dave Olker
Neighborhood Moderator

Re: Getting java.lang.NoSuchMethodError error while using hive with tez as execution engi

This appears to be a known issue that was fixed in a mapr-patch.  Which version of Ezmeral Data Fabric are you using?  You mentioned EEP 6.4.0 but not which core version?



I work at HPE
HPE Support Center offers support for your HPE services and products when and how you need it. Get started with HPE Support Center today.
[Any personal opinions expressed are mine, and not official statements on behalf of Hewlett Packard Enterprise]
Accept or Kudo
support_s
System Recommended

Query: Getting java.lang.NoSuchMethodError error while using hive with tez as execution engine

System recommended content:

1. HPE Ezmeral Data Fabric – Customer-Managed 7.5.0 Documentation | Hive 2.3.8 - 2201 (EEP 7.1.2) Release Notes

 

Please click on "Thumbs Up/Kudo" icon to give a "Kudo".

 

Thank you for being a HPE valuable community member.


Accept or Kudo

adi1234
Occasional Contributor

Re: Getting java.lang.NoSuchMethodError error while using hive with tez as execution engi

Thank you Dave

The version that I am using is 

/opt/mapr/MapRBuildVersion

6.1.1.20210324131839.GA

 

Dave Olker
Neighborhood Moderator

Re: Getting java.lang.NoSuchMethodError error while using hive with tez as execution engi

The latest RedHat-based patch for that release is:

mapr-patch-6.1.1.20210324131839.GA-20230531095022.x86_64.rpm

The latest Debian/Ubuntu patch for that release is:

mapr-patch-6.1.1.20210324131839.GA-20230531095022.x86_64.deb

I'd recommend downloading and installing the appropriate patch for the version of Linux you are running and see if that resolves the issue.



I work at HPE
HPE Support Center offers support for your HPE services and products when and how you need it. Get started with HPE Support Center today.
[Any personal opinions expressed are mine, and not official statements on behalf of Hewlett Packard Enterprise]
Accept or Kudo