IMPORTANT: How to access Ezmeral Data Fabric software beginning October 1, 2023

[Dave Olker]

There is an imminent critical change to our package repositories which will take place at the end of this month (September 2023).

The repositories at https://package.mapr.com and https://package.mapr.hpe.com will be transitioned to a secure download site at https://package.ezmeral.hpe.com by September 30, 2023. This change will happen transparently via DNS so you can continue to use the current repository URLs after the migration. However, the new download site requires a valid HPE passport account and authentication token in order to access the HPE Data Fabric software.

As of October 1st, the Data Fabric software will no longer be accessible without valid credentials, so we are strongly recommending you take the necessary preparations ahead of time to avoid any negative impact.

You can access a knowledge article on this topic at:

https://support.hpe.com/hpesc/public/docDisplay?docId=sf000098690en_us&page=index.html

This page will continue to be updated with the latest documentation leading up to the cutover date. If you have any questions or concerns regarding this change and actions you need to take please let us know as soon as possible.

Please disseminate this information to any of your team members who need access to the Data Fabric software repository so they can take the necessary steps as well.

[Tim11]

Dave,

I think I fastiduously followed the directions, but when I execute mapr-setup.sh, I keep getting errors.

First I fetched mapr-setup using

wget --user=$EMAIL --password=$TOKEN https://package.ezmeral.hpe.com/releases/installer/redhat/mapr-setup.sh -O /home/centos/mapr-setup.sh

And then when I execute mapr-setup.sh I see this

                                                HPE Ezmeral Data Fabric Distribution Initialization and Update
                                                                               
                                        Copyright 2023 Hewlett Packard Enterprise Development LP., All Rights Reserved
                                                     https://www.hpe.com/us/en/software/data-fabric.html
Install required packages? (y/n) [y]: 

Installing installer package dependencies... 

Package curl-7.29.0-59.el7_9.1.x86_64 already installed and latest version
Package net-tools-2.0-0.25.20131004git.el7.x86_64 already installed and latest version
Package sudo-1.8.23-10.el7_9.3.x86_64 already installed and latest version
Package wget-1.14-18.el7_6.1.x86_64 already installed and latest version
Package which-2.20-7.el7.x86_64 already installed and latest version
Package gnupg2-2.0.22-5.el7_5.x86_64 already installed and latest version
Package tzdata-java-2023c-1.el7.noarch already installed and latest version
Package coreutils-8.22-24.el7_9.2.x86_64 already installed and latest version
Package openssh-clients-7.4p1-23.el7_9.x86_64 already installed and latest version
Package openssh-server-7.4p1-23.el7_9.x86_64 already installed and latest version
Package sshpass-1.06-2.el7.x86_64 already installed and latest version
Package python-2.7.5-93.el7_9.x86_64 already installed and latest version
Package sdparm-1.08-3.el7.x86_64 already installed and latest version

...Success 

Testing for java-1.8.0-openjdk-devel or higher... 

Ensuring existing JDK 1.8 is up to date... 

...Success 

Testing connection to https://package.mapr.com/releases...

...No connection found 

Without connectivity to MapR Technologies (https://package.mapr.com/releases/installer), a complete set of MapR archive tarballs are required to complete 
this setup 

And when I edit mapr-setup to change the URL to point to package.ezmeral.hpe.com I still see this

                                                HPE Ezmeral Data Fabric Distribution Initialization and Update
                                                                               
                                        Copyright 2023 Hewlett Packard Enterprise Development LP., All Rights Reserved
                                                     https://www.hpe.com/us/en/software/data-fabric.html
Install required packages? (y/n) [y]: 

Installing installer package dependencies... 

Package curl-7.29.0-59.el7_9.1.x86_64 already installed and latest version
Package net-tools-2.0-0.25.20131004git.el7.x86_64 already installed and latest version
Package sudo-1.8.23-10.el7_9.3.x86_64 already installed and latest version
Package wget-1.14-18.el7_6.1.x86_64 already installed and latest version
Package which-2.20-7.el7.x86_64 already installed and latest version
Package gnupg2-2.0.22-5.el7_5.x86_64 already installed and latest version
Package openssh-clients-7.4p1-23.el7_9.x86_64 already installed and latest version
Package openssh-server-7.4p1-23.el7_9.x86_64 already installed and latest version
Package sshpass-1.06-2.el7.x86_64 already installed and latest version
Package python-2.7.5-93.el7_9.x86_64 already installed and latest version
Package sdparm-1.08-3.el7.x86_64 already installed and latest version

...Success 

Testing for java-1.8.0-openjdk-devel or higher... 

Ensuring existing JDK 1.8 is up to date... 

...Success 

Testing connection to https://package.ezmeral.hpe.com/releases/installer...

...No connection found 

Without connectivity to MapR Technologies (https://package.ezmeral.hpe.com/releases/installer), a complete set of MapR archive tarballs are required to 
complete this setup 

Enter paths to MapR archives - 1 or more space separated files: 

And I did create /etc/yum.repos.d/maprtech.repo but I don't think it got to the point of mattering.

And btw, I tried the mapr-setup.sh in these two folders as well as the one in redhat used above and got the same results as above 

https://package.ezmeral.hpe.com/releases/installer/
and 
https://package.ezmeral.hpe.com/releases/installer-v1.18.0.2/

What am I doing wrong?

thank you for your help.

Tim

thanks,

Tim

[Chanduka_N]

Hi Tim,

The document https://docs.ezmeral.hpe.com/datafabric-customer-managed/74/MapRInstaller.html is incomplete.
We are sorry for the incomplete docs and we are working to have them fixed soon.
Until then we request you to follow the below steps

1. mapr-setup.sh -R https://<user>:<token>@package.ezmeral.hpe.com reload
2. mapr-setup.sh -r https://<user>:<token>@package.ezmeral.hpe.com update

The above 2 steps should resolve the issue for you.

The below 2 steps only apply to existing installs

3. if after following the above steps results in Installer GUI losing the cluster then use the below article to fix it. https://support.hpe.com/hpesc/public/docDisplay?docLocale=en_US&docId=sf000099135en_us.
4. Before you start using the installer delete the repo files /etc/yum.repos.d/mapr_core.repo and /etc/yum.repos.d/mapr_ecosystem.repo on all nodes.

[Tim11]

Chanduka_N,

Thank you for the response. Unfortunately this is a new node so mapr-setup.sh doesn't exist yet. After about 3 hours of struggling I came up with this process. I have to make a repeatable process so an operations team can actually install a production cluster.

I realized that you can't put and email address as is in the URL. Instead you have to encode as per the spec

So in the below I would substitute in these values

    EMAIL=me@company.com
    ENCODED_EMAIL=me%40mycompany.com
    TOKEN=<token>

1) Fetch mapr-setup.sh

wget --user=$EMAIL --password=$TOKEN https://package.ezmeral.hpe.com/releases/installer/mapr-setup.sh

2) Hand-edit mapr-setup.sh and replace these lines.

MAPR_DEF_PKG_URL=${MAPR_DEF_PKG_URL:-https://package.ezmeral.hpe.com/releases}

MAPR_INSTALLER_URL=https://$ENCODED_EMAIL:$TOKEN@package.ezmeral.hpe.com/releases/installer

if [[ "$MAPR_INSTALLER_URL" == *"package.ezmeral.hpe.com"* ]]; then

MAPR_GPG_KEY_URL="https://$ENCODED_EMAIL:$TOKEN@package.ezmeral.hpe.com/releases/pub/maprgpg.key"

3) Also inside mapr-setup.sh Add this line to the bottom of the get_url_with_user_wget function. To be honest, I was too tired to fix the regular expressions. 

WGET_URL="--user=$EMAIL --password=$TOKEN https://package.ezmeral.hpe.com/releases/installer"

This of course make installation by the operations team more involved, so I hope the code and docs will be 'complete' by the time they're ready to actually start the process.

thanks,

Tim

[ldarby]

Hi @Tim11,

Apologies for the confusion.  Yesterday I had an auth issue and I couldn't login here to respond, so I gave the above response to @Chanduka_N for him to post, but that info which was from me was confused (i.e. this was all my fault, not his).  I've now realised all 4 of those steps in that comment are only for existing installs, for new installs you need only this command:

.../mapr-setup.sh -r https://<email>:<token>@package.ezmeral.hpe.com/releases/

(without reload or update) and this command is already documented on the initial install page at https://docs.ezmeral.hpe.com/datafabric-customer-managed/74/MapRInstaller.html, and has been for some time.  Also, the @ symbol in emails works in this command, there's no need to edit the script.  Also I can see engineering are adding new options --repo-user and --repo-token to the mapr-setup.sh script (but I don't have an ETA on when this will be released), in addition to supporting <email> with the @ symbol in the url.

Also, the other page for existing installs at https://docs.ezmeral.hpe.com/datafabric-customer-managed/74/UpgradeGuide/c_installer_update.html has now been updated (except for step 4 in @Chanduka_N's message, I'm still working on getting docs for that published).

Regards,
Laurence Darby

[Tim11]

Laurence,

Duh, you're so right. I must've spent all that time modifying an old version of mapr-setup.

Anyways, thank you

-Tim

[sturns]

#isitdown

Is the repository down?  Visiting https://package.ezmeral.hpe.com/ and throwing in my username and credentials used to work fine, once i figured out that you're customer profile card must be fully populated with all that rando address information etc, however today now my authentication seems to spin on and timeout.

I tried refreshing my profile and updating the options within just in case on the off chance that would resolve it but no dice.  

Is it down?

[Dave Olker]

#itappearstobedown

I was not able to access the repo using my credentials.  It appears the authentication mechanism is having problems.  I'll notify the folks on my side and see if we can give it a kick.

Dave