topic Query: Getting java.lang.NoSuchMethodError error while using hive with tez as execution engine in HPE Ezmeral Software platform

Getting java.lang.NoSuchMethodError error while using hive with tez as execution engine

adi1234 — Tue, 09 Jan 2024 03:45:06 GMT

I was trying to use hive with tez as execution engine in Mapr. But when I run a query in beeline as

select count(*) from test2;

Error: org.apache.hive.service.cli.HiveSQLException: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1, vertexId=vertex_1693940182820_0009_1_00, diagnostics=[Vertex vertex_1693940182820_0009_1_00 [Map 1] killed/failed due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: test2 initializer failed, vertex=vertex_1693940182820_0009_1_00 [Map 1], java.lang.NoSuchMethodError: org.apache.hadoop.fs.FileUtil.checkPathForSymlink(Lorg/apache/hadoop/fs/Path;Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/fs/shell/PathData;

I am getting NoSuchMethodError. I am using hive

Hive 2.3.9-mapr-640

and Tez 0.9 version

Is it because of version mismatch ?

Re: Getting java.lang.NoSuchMethodError error while using hive with tez as execution engi

Dave Olker — Mon, 08 Jan 2024 22:44:47 GMT

This appears to be a known issue that was fixed in a mapr-patch. Which version of Ezmeral Data Fabric are you using? You mentioned EEP 6.4.0 but not which core version?

Query: Getting java.lang.NoSuchMethodError error while using hive with tez as execution engine

support_s — Mon, 08 Jan 2024 22:54:40 GMT

System recommended content:

1. HPE Ezmeral Data Fabric – Customer-Managed 7.5.0 Documentation | Hive 2.3.8 - 2201 (EEP 7.1.2) Release Notes

Please click on "Thumbs Up/Kudo" icon to give a "Kudo".

Thank you for being a HPE valuable community member.

Re: Getting java.lang.NoSuchMethodError error while using hive with tez as execution engi

adi1234 — Mon, 08 Jan 2024 22:54:42 GMT

Thank you Dave

The version that I am using is

/opt/mapr/MapRBuildVersion

6.1.1.20210324131839.GA

Re: Getting java.lang.NoSuchMethodError error while using hive with tez as execution engi

Dave Olker — Mon, 08 Jan 2024 23:03:08 GMT

The latest RedHat-based patch for that release is:

mapr-patch-6.1.1.20210324131839.GA-20230531095022.x86_64.rpm

The latest Debian/Ubuntu patch for that release is:

mapr-patch-6.1.1.20210324131839.GA-20230531095022.x86_64.deb

I'd recommend downloading and installing the appropriate patch for the version of Linux you are running and see if that resolves the issue.