topic IMPORTANT: How to access Ezmeral Data Fabric software beginning October 1, 2023 in HPE Ezmeral Software platform

IMPORTANT: How to access Ezmeral Data Fabric software beginning October 1, 2023

Dave Olker — Tue, 19 Sep 2023 15:43:01 GMT

There is an imminent critical change to our package repositories which will take place at the end of this month (September 2023).

The repositories at https://package.mapr.com and https://package.mapr.hpe.com will be transitioned to a secure download site at https://package.ezmeral.hpe.com by September 30, 2023. This change will happen transparently via DNS so you can continue to use the current repository URLs after the migration. However, the new download site requires a valid HPE passport account and authentication token in order to access the HPE Data Fabric software.

As of October 1st, the Data Fabric software will no longer be accessible without valid credentials, so we are strongly recommending you take the necessary preparations ahead of time to avoid any negative impact.

You can access a knowledge article on this topic at:

https://support.hpe.com/hpesc/public/docDisplay?docId=sf000098690en_us&page=index.html

This page will continue to be updated with the latest documentation leading up to the cutover date. If you have any questions or concerns regarding this change and actions you need to take please let us know as soon as possible.

Please disseminate this information to any of your team members who need access to the Data Fabric software repository so they can take the necessary steps as well.

Re: IMPORTANT: How to access Ezmeral Data Fabric software beginning October 1, 2023

Tim11 — Mon, 02 Oct 2023 21:28:25 GMT

Dave,

I think I fastiduously followed the directions, but when I execute mapr-setup.sh, I keep getting errors.

First I fetched mapr-setup using

wget --user=$EMAIL --password=$TOKEN https://package.ezmeral.hpe.com/releases/installer/redhat/mapr-setup.sh -O /home/centos/mapr-setup.sh

And then when I execute mapr-setup.sh I see this

HPE Ezmeral Data Fabric Distribution Initialization and Update Copyright 2023 Hewlett Packard Enterprise Development LP., All Rights Reserved https://www.hpe.com/us/en/software/data-fabric.html Install required packages? (y/n) [y]: Installing installer package dependencies... Package curl-7.29.0-59.el7_9.1.x86_64 already installed and latest version Package net-tools-2.0-0.25.20131004git.el7.x86_64 already installed and latest version Package sudo-1.8.23-10.el7_9.3.x86_64 already installed and latest version Package wget-1.14-18.el7_6.1.x86_64 already installed and latest version Package which-2.20-7.el7.x86_64 already installed and latest version Package gnupg2-2.0.22-5.el7_5.x86_64 already installed and latest version Package tzdata-java-2023c-1.el7.noarch already installed and latest version Package coreutils-8.22-24.el7_9.2.x86_64 already installed and latest version Package openssh-clients-7.4p1-23.el7_9.x86_64 already installed and latest version Package openssh-server-7.4p1-23.el7_9.x86_64 already installed and latest version Package sshpass-1.06-2.el7.x86_64 already installed and latest version Package python-2.7.5-93.el7_9.x86_64 already installed and latest version Package sdparm-1.08-3.el7.x86_64 already installed and latest version ...Success Testing for java-1.8.0-openjdk-devel or higher... Ensuring existing JDK 1.8 is up to date... ...Success Testing connection to https://package.mapr.com/releases... ...No connection found Without connectivity to MapR Technologies (https://package.mapr.com/releases/installer), a complete set of MapR archive tarballs are required to complete this setup

And when I edit mapr-setup to change the URL to point to package.ezmeral.hpe.com I still see this

HPE Ezmeral Data Fabric Distribution Initialization and Update Copyright 2023 Hewlett Packard Enterprise Development LP., All Rights Reserved https://www.hpe.com/us/en/software/data-fabric.html Install required packages? (y/n) [y]: Installing installer package dependencies... Package curl-7.29.0-59.el7_9.1.x86_64 already installed and latest version Package net-tools-2.0-0.25.20131004git.el7.x86_64 already installed and latest version Package sudo-1.8.23-10.el7_9.3.x86_64 already installed and latest version Package wget-1.14-18.el7_6.1.x86_64 already installed and latest version Package which-2.20-7.el7.x86_64 already installed and latest version Package gnupg2-2.0.22-5.el7_5.x86_64 already installed and latest version Package openssh-clients-7.4p1-23.el7_9.x86_64 already installed and latest version Package openssh-server-7.4p1-23.el7_9.x86_64 already installed and latest version Package sshpass-1.06-2.el7.x86_64 already installed and latest version Package python-2.7.5-93.el7_9.x86_64 already installed and latest version Package sdparm-1.08-3.el7.x86_64 already installed and latest version ...Success Testing for java-1.8.0-openjdk-devel or higher... Ensuring existing JDK 1.8 is up to date... ...Success Testing connection to https://package.ezmeral.hpe.com/releases/installer... ...No connection found Without connectivity to MapR Technologies (https://package.ezmeral.hpe.com/releases/installer), a complete set of MapR archive tarballs are required to complete this setup Enter paths to MapR archives - 1 or more space separated files:

And I did create /etc/yum.repos.d/maprtech.repo but I don't think it got to the point of mattering.

And btw, I tried the mapr-setup.sh in these two folders as well as the one in redhat used above and got the same results as above

https://package.ezmeral.hpe.com/releases/installer/ and https://package.ezmeral.hpe.com/releases/installer-v1.18.0.2/

What am I doing wrong?

thank you for your help.

Tim

thanks,

Tim

Re: IMPORTANT: How to access Ezmeral Data Fabric software beginning October 1, 2023

Chanduka_N — Tue, 03 Oct 2023 08:29:58 GMT

Hi Tim,

The document https://docs.ezmeral.hpe.com/datafabric-customer-managed/74/MapRInstaller.html is incomplete.
We are sorry for the incomplete docs and we are working to have them fixed soon.
Until then we request you to follow the below steps

1. mapr-setup.sh -R https://<user>:<token>@package.ezmeral.hpe.com reload
2. mapr-setup.sh -r https://<user>:<token>@package.ezmeral.hpe.com update

The above 2 steps should resolve the issue for you.

The below 2 steps only apply to existing installs

3. if after following the above steps results in Installer GUI losing the cluster then use the below article to fix it. https://support.hpe.com/hpesc/public/docDisplay?docLocale=en_US&docId=sf000099135en_us.
4. Before you start using the installer delete the repo files /etc/yum.repos.d/mapr_core.repo and /etc/yum.repos.d/mapr_ecosystem.repo on all nodes.

Re: IMPORTANT: How to access Ezmeral Data Fabric software beginning October 1, 2023

Tim11 — Tue, 03 Oct 2023 21:40:34 GMT

Chanduka_N,

Thank you for the response. Unfortunately this is a new node so mapr-setup.sh doesn't exist yet. After about 3 hours of struggling I came up with this process. I have to make a repeatable process so an operations team can actually install a production cluster.

I realized that you can't put and email address as is in the URL. Instead you have to encode as per the spec

So in the below I would substitute in these values

EMAIL=me@company.com ENCODED_EMAIL=me%40mycompany.com TOKEN=<token>

1) Fetch mapr-setup.sh

wget --user=$EMAIL --password=$TOKEN https://package.ezmeral.hpe.com/releases/installer/mapr-setup.sh

2) Hand-edit mapr-setup.sh and replace these lines.

MAPR_DEF_PKG_URL=${MAPR_DEF_PKG_URL:-https://package.ezmeral.hpe.com/releases} MAPR_INSTALLER_URL=https://$ENCODED_EMAIL:$TOKEN@package.ezmeral.hpe.com/releases/installer if [[ "$MAPR_INSTALLER_URL" == *"package.ezmeral.hpe.com"* ]]; then MAPR_GPG_KEY_URL="https://$ENCODED_EMAIL:$TOKEN@package.ezmeral.hpe.com/releases/pub/maprgpg.key"

3) Also inside mapr-setup.sh Add this line to the bottom of the get_url_with_user_wget function. To be honest, I was too tired to fix the regular expressions.

WGET_URL="--user=$EMAIL --password=$TOKEN https://package.ezmeral.hpe.com/releases/installer"

This of course make installation by the operations team more involved, so I hope the code and docs will be 'complete' by the time they're ready to actually start the process.

thanks,

Tim

Re: IMPORTANT: How to access Ezmeral Data Fabric software beginning October 1, 2023

ldarby — Wed, 04 Oct 2023 10:49:43 GMT

Hi @Tim11,

Apologies for the confusion. Yesterday I had an auth issue and I couldn't login here to respond, so I gave the above response to @Chanduka_N for him to post, but that info which was from me was confused (i.e. this was all my fault, not his). I've now realised all 4 of those steps in that comment are only for existing installs, for new installs you need only this command:

.../mapr-setup.sh -r https://<email>:<token>@package.ezmeral.hpe.com/releases/

(without reload or update) and this command is already documented on the initial install page at https://docs.ezmeral.hpe.com/datafabric-customer-managed/74/MapRInstaller.html, and has been for some time. Also, the @ symbol in emails works in this command, there's no need to edit the script. Also I can see engineering are adding new options --repo-user and --repo-token to the mapr-setup.sh script (but I don't have an ETA on when this will be released), in addition to supporting <email> with the @ symbol in the url.

Also, the other page for existing installs at https://docs.ezmeral.hpe.com/datafabric-customer-managed/74/UpgradeGuide/c_installer_update.html has now been updated (except for step 4 in @Chanduka_N's message, I'm still working on getting docs for that published).

Regards,
Laurence Darby

Re: IMPORTANT: How to access Ezmeral Data Fabric software beginning October 1, 2023

Tim11 — Wed, 04 Oct 2023 15:09:38 GMT

Laurence,

Duh, you're so right. I must've spent all that time modifying an old version of mapr-setup.

Anyways, thank you

-Tim

Re: IMPORTANT: How to access Ezmeral Data Fabric software beginning October 1, 2023

sturns — Sun, 10 Dec 2023 22:08:34 GMT

#isitdown

Is the repository down? Visiting https://package.ezmeral.hpe.com/ and throwing in my username and credentials used to work fine, once i figured out that you're customer profile card must be fully populated with all that rando address information etc, however today now my authentication seems to spin on and timeout.

I tried refreshing my profile and updating the options within just in case on the off chance that would resolve it but no dice.

Is it down?

Re: IMPORTANT: How to access Ezmeral Data Fabric software beginning October 1, 2023

Dave Olker — Sun, 10 Dec 2023 22:57:57 GMT

#itappearstobedown

I was not able to access the repo using my credentials. It appears the authentication mechanism is having problems. I'll notify the folks on my side and see if we can give it a kick.

Dave