Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove camel case tokenization from repo indexer #7733

Merged
merged 9 commits into from
Aug 6, 2019
Merged

Remove camel case tokenization from repo indexer #7733

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
a8d4e40
Make repository indexer tokenize by camel case selectable
Aug 3, 2019
e13dc55
Merge branch 'master' of https://github.com/go-gitea/gitea into camel…
Aug 4, 2019
ea1f22d
Revert "Make repository indexer tokenize by camel case selectable"
Aug 4, 2019
6a443bf
Remove app.ini setting, permanently remove camel case tokenizer
Aug 4, 2019
0b045e4
Merge branch 'master' into camelcaseselectable
lunny Aug 5, 2019
b222c0e
Increase repoIndexerLatestVersion to force indexes to be rebuilt
Aug 5, 2019
e316cf5
Merge branch 'master' into camelcaseselectable
lafriks Aug 5, 2019
a258ae2
Merge branch 'master' of https://github.com/go-gitea/gitea into camel…
Aug 5, 2019
2e4479c
Changes introduced by the commmand make vendor
Aug 6, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 2 additions & 3 deletions modules/indexer/repo.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,6 @@ import (

"github.com/blevesearch/bleve"
"github.com/blevesearch/bleve/analysis/analyzer/custom"
"github.com/blevesearch/bleve/analysis/token/camelcase"
"github.com/blevesearch/bleve/analysis/token/lowercase"
"github.com/blevesearch/bleve/analysis/token/unique"
"github.com/blevesearch/bleve/analysis/tokenizer/unicode"
Expand All @@ -24,7 +23,7 @@ const (
repoIndexerAnalyzer = "repoIndexerAnalyzer"
repoIndexerDocType = "repoIndexerDocType"

repoIndexerLatestVersion = 1
repoIndexerLatestVersion = 2
)

// repoIndexer (thread-safe) index for repository contents
Expand Down Expand Up @@ -111,7 +110,7 @@ func createRepoIndexer(path string, latestVersion int) error {
"type": custom.Name,
"char_filters": []string{},
"tokenizer": unicode.Name,
"token_filters": []string{unicodeNormalizeName, camelcase.Name, lowercase.Name, unique.Name},
"token_filters": []string{unicodeNormalizeName, lowercase.Name, unique.Name},
}); err != nil {
return err
}
Expand Down
78 changes: 0 additions & 78 deletions vendor/github.com/blevesearch/bleve/analysis/token/camelcase/camelcase.go
View file
Open in desktop

This file was deleted.

109 changes: 0 additions & 109 deletions vendor/github.com/blevesearch/bleve/analysis/token/camelcase/parser.go
View file
Open in desktop

This file was deleted.

87 changes: 0 additions & 87 deletions vendor/github.com/blevesearch/bleve/analysis/token/camelcase/states.go
View file
Open in desktop

This file was deleted.

1 change: 0 additions & 1 deletion vendor/modules.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,6 @@ github.com/beorn7/perks/quantile
# github.com/blevesearch/bleve v0.0.0-20190214220507-05d86ea8f6e3
github.com/blevesearch/bleve
github.com/blevesearch/bleve/analysis/analyzer/custom
github.com/blevesearch/bleve/analysis/token/camelcase
github.com/blevesearch/bleve/analysis/token/lowercase
github.com/blevesearch/bleve/analysis/token/unicodenorm
github.com/blevesearch/bleve/analysis/token/unique
Expand Down