Query: Spark job looking MapR ticket in only tmp directory

[Akkism]

Hi All,

I've one crazy issue, few jobs looking for mapr ticket in /tmp even though i exported "export MAPR_TICKETFILE_LOCATION=$HOME/maprticket_$UID" . It's working fine on few servers and getting issues on few servers. I did checked all servers there are no other variables overriding the property i set in every user profile. Can someone please let me know if you faced this kind of issue.

Thanks

[hiteshingole]

You can check the following on the node where the crash occurs (referred to as the 'bad node') and compare it to a node where the job runs successfully ('good node'). I assume there is a distinct set of good and bad nodes with no overlap.

• Verify the environment settings for the user running the Spark job, not just the mapr user.
• Check the java.io.tmpdir configuration on these nodes.

If the issue persists after checking the above, please share the logs for both successful and failed job attempts.

[Saikant]

Hello,

Can you please let us know how this jobs are being run?

Are you using same user or any service user? Are you using any tools? Please share sample steps in more details.

Please ensure yarn-site.xml and spark-default.conf have same values on all nodes.

Please ensure MAPR_TICKETFILE_LOCATION path location exists on all nodes.

Please check  spark job logs and see env variable set for each tasks matches.

Thanks,

Saikant 

[support_s]

Hello,

Let us know if you were able to resolve the issue.

If you have no further query, and you are satisfied with the answer then kindly mark the topic as Solved so that it is helpful for all community members.

Please click on "Thumbs Up/Kudo" icon to give a "Kudo".

Thank you for being a HPE valuable community member.