- Community Home
- >
- Servers and Operating Systems
- >
- Operating Systems
- >
- Operating System - OpenVMS
- >
- Re: Lucene, Solr and filepaths
Categories
Company
Local Language
Forums
Discussions
Forums
- Data Protection and Retention
- Entry Storage Systems
- Legacy
- Midrange and Enterprise Storage
- Storage Networking
- HPE Nimble Storage
Discussions
Discussions
Discussions
Forums
Forums
Discussions
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
- BladeSystem Infrastructure and Application Solutions
- Appliance Servers
- Alpha Servers
- BackOffice Products
- Internet Products
- HPE 9000 and HPE e3000 Servers
- Networking
- Netservers
- Secure OS Software for Linux
- Server Management (Insight Manager 7)
- Windows Server 2003
- Operating System - Tru64 Unix
- ProLiant Deployment and Provisioning
- Linux-Based Community / Regional
- Microsoft System Center Integration
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Community
Resources
Forums
Blogs
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-16-2010 10:29 AM
тАО03-16-2010 10:29 AM
http://mail-archives.apache.org/mod_mbox/lucene-java-user/201001.mbox/<4B433F43.8040803@dymaxion.ca>
http://mail-archives.apache.org/mod_mbox/lucene-java-user/201001.mbox/<4B436182.6000207@dymaxion.ca>
I'm wondering if anyone else has tried to make Lucene or Solr work on VMS. Did you get it to work? If so, how?
Thanks,
Ben
Solved! Go to Solution.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-16-2010 11:57 AM
тАО03-16-2010 11:57 AM
SolutionFolks with Unixy expectations tend to treat the filesystem as a database with the filenames as case-sensitive primary keys that may contain anything that's not a shell metacharacter. Programs with these expectations tend to get indigestion when interacting with the VMS filesystem and its highly structured sense of where the parts of a filespec begin and end and tendency to throw in extra punctuation to avoid ambiguity. An example of the latter is the reporting of a filename with no extension as "foo." in order to avoid the bareword "foo" that could easily be confused with a logical name.
There are various feature logicals in Java and within the CRTL to work around the whole set of expectations I've referred to. I believe what you're looking for is the feature logical DECC$READDIR_DROPDOTNOTYPE, which might do the trick if Java is using the CRTL's readdir():
$ help crtl feature DECC$READDIR_DROPDOTNOTYPE
CRTL
Feature_Logical_Names
DECC$READDIR_DROPDOTNOTYPE
With DECC$READDIR_DROPDOTNOTYPE enabled, readdir when reporting
files in UNIX style only reports the trailing period (.) for
files with no file type when the file name contains a period.
With this logical name disabled, all files without a file type
are reported with a trailing period.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-16-2010 03:57 PM
тАО03-16-2010 03:57 PM
Re: Lucene, Solr and filepaths
If you only have an ODS2 disk available you may want to use the LD (or even the VD) driver to initialize and mount a container file as an ODS5 disk.
>>>
Folks with Unixy expectations ...
<<<
... expect any character in a filename except '/' and '\0'.
>>>
With DECC$READDIR_DROPDOTNOTYPE enabled, readdir when reporting files in UNIX style only reports the trailing period (.) for files with no file type when the file name contains a period.
<<<
There is no such thing like a VMS file "with no file type", try
$ write sys$output f$parse("x",,,"type")
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-16-2010 04:25 PM
тАО03-16-2010 04:25 PM
Re: Lucene, Solr and filepaths
1) Lucene creates a file like xxx123 (of course OpenVMS adds a dot) and then later tries to extracts "123" from the filename but gets "123." I solved this problem by compiling Lucene after modification of its source code.
2) Lucene fails to update the index. Error messages were not clear for me and I did not find a solution.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-16-2010 08:13 PM
тАО03-16-2010 08:13 PM
Re: Lucene, Solr and filepaths
In my opinion, JAVA$FILENAME_CONTROLS is a pain. Once upon a time, when ODS-5 and the DECC$* logicals were not as well understood or supported, it had a place. However, now it just puts more moving parts and confusion into the mix.
Tim.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-17-2010 12:58 AM
тАО03-17-2010 12:58 AM
Re: Lucene, Solr and filepaths
>>I'm wondering if anyone else has tried to >>make Lucene or Solr work on VMS. Did you >>get it to work?
Yes, we was able to make lucene work on OpenVMS. The java Setup that was used is:
$ set proc/parse=extended
$ @SYS$COMMON:[JAVA$150.COM]JAVA$150_SETUP.COM
$ define DECC$ARGV_PARSE_STYLE ENABLE
$ define DECC$EFS_CASE_PRESERVE ENABLE
$ define DECC$POSIX_SEEK_STREAM_FILE ENABLE
$ define DECC$EFS_CHARSET ENABLE
$ define DECC$ENABLE_GETENV_CACHE ENABLE
$ define DECC$FILE_PERMISSION_UNIX ENABLE
$ define DECC$FIXED_LENGTH_SEEK_TO_EOF ENABLE
$ define DECC$RENAME_NO_INHERIT ENABLE
$ define DECC$ENABLE_TO_VMS_LOGNAME_CACHE ENABLE
$ FILE_MASK = %x00000008 + %x00040000
$ DEFINE JAVA$FILENAME_CONTROLS 'file_mask'
Regards,
Rishi
I am the person you had referred to in
>>I see at least one other user has >>attempted to make Lucene work on
>>OpenVMS before, but ran into problems >>which appear to remain unresolved:
>>http://www.lucidimagination.com/search/docu>>ment/8f4a752f43f34c6a/indexer_crashes_with_>>hit_exception_during_merge#8e9ea1db106e9cea
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-18-2010 07:01 AM
тАО03-18-2010 07:01 AM
Re: Lucene, Solr and filepaths
That's the golden answer! Yes, the example that ships with Solr works fine after I DEFINEDECC$READDIR_DROPDOTNOTYPE ENABLE.
If I can't get it to go with ODS-2, enough of our clients are now on ODS-5 that we'd just make upgrading a requirement. However, we'd like to avoid that, if we can.
H.Becker,
The container file as an ODS-5 disk is an option I'll keep in mind. Though just switching to ODS-5 seems preferable, if it comes to that.
USO,
Maybe give Solr 1.4.0 a try? Granted, all I've done is run the example, so there may be other problems lurking ahead. But so far it looks good.
Tim,
For my testing this time, I just left JAVA$FILENAME_CONTROLS alone (it is set to -1). If I have any trouble with this, I'll look at the other DECC$ controls instead. Thanks.
Rishi,
Do you still have problems with large numbers of documents as indicated in that thread? I wonder if the Lucene bundled in Solr 1.4.0 has the same issue ...
Thanks, everyone!
Ben
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-18-2010 07:48 AM
тАО03-18-2010 07:48 AM
Re: Lucene, Solr and filepaths
If you also face the same issue let me know. I will dig out what we did to resolve that
Regards,
Rishi
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО07-01-2010 06:41 AM
тАО07-01-2010 06:41 AM
Re: Lucene, Solr and filepaths
no segments* file found in org.apache.luc
ene.store.FSDirectory@/rootdir/indexes/search/db.links: files:
Have any of you run into a similar issue while indexing? Is there a logical which could aid me in this or do I need to dive into the Lucene code?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО07-01-2010 10:23 AM
тАО07-01-2010 10:23 AM
Re: Lucene, Solr and filepaths
Here are my theories for
>>no segments* file found in org.apache.lucene.store.FSDirectory@/rootdir/indexes/search/db.links: files:
1. In Lucene code the Exception that is thrown is
throw new FileNotFoundException("no segments* file found in " + directory + ": files:" + s);
where "org.apache.lucene.store.FSDirectory" is the path of the class and the directory being searched is
/rootdir/indexes/search/db.links
"db.links" looks wrong here and should be "db/links"
2. Check if the wiki extension has a directory as db^.links.dir . Modify it to two seperate directories (db.dir and inside it links.dir)and see if indexing works.
3. Check if in your wiki extension the string "db.links" gets appended to the index directory path
Regards,
Rishi