MapR-DB Scan Issue with PageFilter and Large Payloads (MapR 7.7)

[koo2981]

We are encountering an issue when using the HBase Java API PageFilter with MapR-DB . While PageFilter is intended to limit the number of rows returned in a scan, we've observed that when the total size of the data returned (payload) exceeds approximately 65535 bytes, the scan fails with an "Invalid argument" error.

This behavior is not observed when the PageFilter is configured to return a smaller number of rows, resulting in a payload under this size threshold. The exact same code was working correctly in EDF version 6.1. However, after upgrading to EDF version 7.7, we are now experiencing this issue. This strongly suggests a change in behavior or we may be missing some configuration requirements somewhere.

• Is there a documented limit on the size of data returned in a single scan response when using PageFilter in EDF 7.x and later?
• Is this limit configurable? If so, what is the configuration parameter and where to set it?

Snippet of error below:

2025-04-10 23:19:01,396 ERROR fs.Inode: scanNext() on '/test-etl/UH_New79' failed with error: Invalid argument (22).
2025-04-10 23:19:01,3952 ERROR Client fc/scanner.cc:951 Thread: 3321479 Invalid Scan Request for table /test-etl/UH_New79. Terminating Scan on tablet 4083.136.9902586
2025-04-10 23:19:01,3952 ERROR ApiCommon fc/api_common.cc:453 Thread: 3321479 Scanner failed to get 100 rows error = -22
Exception in thread "main" java.lang.RuntimeException: com.mapr.fs.ErrnoException: scanNext() on '/test-etl/UH_New79' failed with error: Invalid argument (22).
at com.mapr.fs.hbase.ResultScannerImpl$1.hasNext(ResultScannerImpl.java:84)
at HBaseTestRunner.getUsageScanResult(HBaseTestRunner.java:173)
at HBaseTestRunner.main(HBaseTestRunner.java:302)
Caused by: com.mapr.fs.ErrnoException: scanNext() on '/test-etl/UH_New79' failed with error: Invalid argument (22).
at com.mapr.fs.Inode.checkError(Inode.java:1869)
at com.mapr.fs.Inode.checkError(Inode.java:1828)
at com.mapr.fs.Inode.scanNext(Inode.java:1577)
at com.mapr.fs.MapRHTable.scanNext(MapRHTable.java:944)
at com.mapr.fs.MapRResultScanner.nextRows(MapRResultScanner.java:58)
at com.mapr.fs.hbase.ResultScannerImpl.next(ResultScannerImpl.java:43)
at com.mapr.fs.hbase.ResultScannerImpl.next(ResultScannerImpl.java:29)
at com.mapr.fs.hbase.ResultScannerImpl$1.hasNext(ResultScannerImpl.java:81)

[ldarby]

Hello,

Apologies for the late response here, I'm just reviewing any unanswered questions.  I was going to ask to raise a support case for this issue, but I saw you already did, and it's been escalated to engineering.

Regards,

Laurence Darby