Manticore Crashes with Fatal error if index_field_lengths is enabled in table settings

[mohdmsl]

Bug Description:

Manticore crashes with fatal error while inserting data on index where index_field_lengths = '1'
Crash!!! Handling signal 11

Reproducible example:

create table test ( title text ) index_exact_words='1' index_field_lengths = '1' engine='columnar';
insert into test values ( 1, 'yellow bag' ), ( 2, 'white bag' );

Manticore Search Version:

6.3.8

Operating System Version:

linux

Have you tried the latest development version?

None

Internal Checklist:

^{To be completed by the assignee. Check off tasks that have been completed or are not applicable.}

• Implementation completed
• Tests developed
• Documentation updated
• Documentation reviewed
• Changelog updated

[mohdmsl]

@sanikolaev can you please have a look here

[tomatolog]

seems columnar library does not support internal attribute token_count - you can not use index_field_lengths option with the engine='columnar'

[mohdmsl]

But it allows to create the index with this option

[tomatolog]

seems like a bug that should be fixed as:

• produce error on index create
  or
• fix mcl library to support that type of the attribute

[mohdmsl]

Option 2 would be better. if its fixed under mcl