topic Spark job looking MapR ticket in only tmp directory in HPE Ezmeral Software platform

Spark job looking MapR ticket in only tmp directory

Akkism — Wed, 18 Sep 2024 18:58:36 GMT

Hi All,

I've one crazy issue, few jobs looking for mapr ticket in /tmp even though i exported "export MAPR_TICKETFILE_LOCATION=$HOME/maprticket_$UID" . It's working fine on few servers and getting issues on few servers. I did checked all servers there are no other variables overriding the property i set in every user profile. Can someone please let me know if you faced this kind of issue.

Thanks

Re: Spark job looking MapR ticket in only tmp directory

hiteshingole — Thu, 19 Sep 2024 18:49:01 GMT

You can check the following on the node where the crash occurs (referred to as the 'bad node') and compare it to a node where the job runs successfully ('good node'). I assume there is a distinct set of good and bad nodes with no overlap.

Verify the environment settings for the user running the Spark job, not just the mapr user.
Check the java.io.tmpdir configuration on these nodes.

If the issue persists after checking the above, please share the logs for both successful and failed job attempts.

Re: Spark job looking MapR ticket in only tmp directory

Saikant — Thu, 19 Sep 2024 19:05:57 GMT

Hello,

Can you please let us know how this jobs are being run?

Are you using same user or any service user? Are you using any tools? Please share sample steps in more details.

Please ensure yarn-site.xml and spark-default.conf have same values on all nodes.

Please ensure MAPR_TICKETFILE_LOCATION path location exists on all nodes.

Please check spark job logs and see env variable set for each tasks matches.

Thanks,

Saikant

Query: Spark job looking MapR ticket in only tmp directory

support_s — Mon, 23 Sep 2024 11:21:30 GMT

Hello,

Let us know if you were able to resolve the issue.

If you have no further query, and you are satisfied with the answer then kindly mark the topic as Solved so that it is helpful for all community members.

Please click on "Thumbs Up/Kudo" icon to give a "Kudo".

Thank you for being a HPE valuable community member.