The index buffer maximum memory setting affects indexing performance. This setting determines how much memory is utilized when indexed documents are buffered. When a buffer reaches the maximum limit, the data is written to the indexes and the buffer is emptied.
A large buffer size ensures that more data is indexed each time, making the disk writing phase more efficient. Reducing the number of times the indexing session has to write to disk improves performance; as appending data involves expensive file seek time. This is important especially when the buffer has a large number of items, say upwards of 100,000 items.
The default setting for the index buffer maximum memory setting is:
<SystemProperty name="omniq.index.buffer.maxMemory" value="10 MB"/>
Choose a new value for the index buffer maximum memory based on your machine specifications and the total memory allocated to the JVM setting of the container. Increase the value on an incremental basis and observe the effect on the indexing time. For example, try setting the value to 16MB or 32MB.
Sybase recommends that you keep the index buffer maximum
memory to 16MB or 32MB. This is because setting large values for
index buffer maximum memory, for example to 64 MB, involves additional
in-memory management of the index buffer size. This slows down the
indexing performance.
