Roadmap plan for Apache Kafka with Mapr Streams

[Harshkohli]

What is the roadmap plan for Apache Kafka with Mapr Streams?

I can see that with Mapr streams we have Apache kafka 2.1 but would b interested to know if there exists a future plan for the same?

In general: Will we with newer MapR versions also periodically upgrade to newer Kafka API versions? E. g. in MapR 6.3 to e. g. Kafka API 2.8?

[Harshkohli · Accepted solution]

I beleive I got my answer. The answer is that mapr 6.2 supports Apache KAFKA 2.1 and future MEP versions have plans for KAFKA 2.6.

Hope this helps anyone looking for answers.

[sridharpreddy]

Hi Harshkohli,

>> I can see that with Mapr streams we have Apache kafka 2.1 but would b interested to know if there exists a future plan for the same?

Yes, we are currently working on Apache Kafka 2.6.1 API and that is planned to be released soon. 

>> In general: Will we with newer MapR versions also periodically upgrade to newer Kafka API versions? E. g. in MapR 6.3 to e. g. Kafka API 2.8?

Apache packages are periodically updated generally every quarter in the MEP package. Here is the latest information on MEP https://docs.datafabric.hpe.com/62/InteropMatrix/Component_versions_all_MEPs.html

MEP and the core MapR/Ezmeral Data Fabric mapping is shown here: https://docs.datafabric.hpe.com/62/InteropMatrix/r_mep_support_core_version.html.

HTHs,

-Sridhar Reddy

[ronaldng]

May I know how to integrate Data Fabric and Kafka?  Any different from Data Fabric streaming function? 

[sridharpreddy]

Hi Roland,

https://docs.datafabric.hpe.com/70/MapROverview/c_mapr_streams.html

Ezmeral Data Fabric in the Streams product supports Kafka API to publish and consume messages from the Topics created on the Streams. This is API compatable with Kafka. For more details see the above link.

For more details:

https://developer.hpe.com/blog/kafka-vs-mapr-event-store-why-mapr/

https://docs.datafabric.hpe.com/70/EcosystemRN/EEP8.1.0.html

HTHs,

Sridhar