Skip to content
GitLab
Projects Groups Topics Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
  • Register
  • Sign in
  • erp5 erp5
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributor statistics
    • Graph
    • Compare revisions
  • Issues 0
    • Issues 0
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 1
    • Merge requests 1
  • Deployments
    • Deployments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Commits
  • Issue Boards
Collapse sidebar
  • Cédric Le Ninivin
  • erp5erp5
  • Merge requests
  • !12

wip: customise full text indexation

  • Review changes

  • Download
  • Patches
  • Plain diff
Closed Xiaowu Zhang requested to merge searchable_text_property_id into skd Nov 06, 2024
  • Overview 9
  • Commits 2
  • Changes 11

actually we index almost everything in fulltext, if we updates and delete many times,like 160K SQLCatalog_deferFullTextIndexActivity, we may have

...
Trying to get some variables.
Some pointers may be invalid and cause the dump to abort.
Query (0x7f8028010170): REPLACE INTO
  full_text
VALUES
    ( 
  1385784,
  '52'
),    ( 
  2408896,
  '14'
),    ( 
  1385747,
  '89'
),    ( 
  1385758,
  '78'
),    ( 
  1385792,
  '44'
),    ( 
  1385766,
  '70'
),    ( 
  1385737,
  '99'
),    ( 
  1385739,
  '97'
),    ( 
  1385786,
  '50'
),    ( 
  1385740,
  '96'
),    ( 
  1385787,
  '49'
),    ( 
  1385785,
  '51'
),    ( 
  1385745,
  '91'
),    ( 
  1385742,
  '94'
),    ( 
  2408752,
  '158'
),    ( 
  2408759,
  '151'
),    ( 
  2408747,
  '163'
),    ( 
  2408750,
  '160'
),    ( 
  2408756,
  '154'
),    ( 
  1385752,
  '84'
),    ( 
  1385762,
  '74'
),    ( 
  1385793,
  '43'
),    ( 
  1386192,
  '244'
),    ( 
  1385749,
  '87'
),    ( 
  2408742,
  '168'
),    ( 
  1385776,
  '60'
),    ( 
  2408766,
  '144'
),    ( 
  2408753,
  '157'
),    ( 
  2408748,
  '162'
),    ( 
  2408764,
  '146'
),    ( 
  1385768,
  '68'
),    ( 
  2408755,
  '155'
),    ( 
  1385757,
  '79'
),    ( 
  1385759,
  '77'
),    ( 
  2408754,
  '156'
),    ( 
  2408893,
  '17'
),    ( 
  1385829,
  '7'
),    ( 
  1385770,
  '66'
),    ( 
  2408767,
  '143'
),    ( 
  2408770,
  '140'
),    ( 
  1385744,
  '92'
),    ( 
  1385827,
  '9'
),    ( 
  1385777,
  '59'
),    ( 
  2408744,
  '166'
),    ( 
  1385738,
  '98'
),    ( 
  1385764,
  '72'
),    ( 
  1385771,
  '65'
),    ( 
  1385780,
  '56'
),    ( 
  1385774,
  '62'
),    ( 
  1385751,
  '85'
),    ( 
  1385763,
  '73'
),    ( 
  2408763,
  '147'
),    ( 
  2408758,
  '152'
),    ( 
  1385789,
  '47'
),    ( 
  2408895,
  '15'
),    ( 
  1385794,
  '42'
),    ( 
  1385773,
  '63'
),    ( 
  1385781,
  '55'
),    ( 
  1385765,
  '71'
),    ( 
  2408757,
  '153'
),    ( 
  1385775,
  '61'
),    ( 
  1385772,
  '64'
),    ( 
  1385767,
  '69'
),    ( 
  1385741,
  '95'
),    ( 
  2408769,
  '141'
),    ( 
  1385791,
  '45'
),    ( 
  1385828,
  '8'
),    ( 
  2408765,
  '145'
),    ( 
  1385790,
  '46'
),    ( 
  2408771,
  '139'
),    ( 
  2408745,
  '165'
),    ( 
  2408760,
  '150'
),    ( 
  1385743,
  '93'
),    ( 
  1385760,
  '76'
),    ( 
  1385753,
  '83'
),    ( 
  2408768,
  '142'
),    ( 
  2408749,
  '161'
),    ( 
  1385830,
  '6'
),    ( 
  1385754,
  '82'
),    ( 
  1385750,
  '86'
),    ( 
  1385746,
  '90'
),    ( 
  1385778,
  '58'
),    ( 
  1385783,
  '53'
),    ( 
  1385755,
  '81'
),    ( 
  1385769,
  '67'
),    ( 
  2408751,
  '159'
),    ( 
  1385761,
  '75'
),    ( 
  1385782,
  '54'
),    ( 
  2408894,
  '16'
),    ( 
  1385756,
  '80'
),    ( 
  2408746,
  '164'
),    ( 
  1385788,
  '48'
),    ( 
  2408743,
  '167'
),    ( 
  1385836,
  'Blue-P3 1000074'
),    ( 
  1385779,
  '57'
),    ( 
  1385831,
  '5'
),    ( 
  2408741,
  '169'
),    ( 
  2408761,
  '149'
),    ( 
  2408762,
  '148'
),    ( 
  1385748,
  '88'
)

Connection ID (thread ID): 54
Status: NOT_KILLED

Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on

The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mariadbd/ contains
information that should help you find out what is causing the crash.
Writing a core file...
Working directory at /srv/slapgrid/slappart8/srv/runner/instance/slappart3/srv/mariadb
Resource Limits:
....

which make mariadb unavailable

to avoid this, let's first not index needless full text

Edited Nov 06, 2024 by Xiaowu Zhang
Assignee
Assign to
Reviewers
Request review from
Time tracking
Source branch: searchable_text_property_id
GitLab Nexedi Edition | About GitLab | About Nexedi | 沪ICP备2021021310号-2 | 沪ICP备2021021310号-7