github-starred/gitea
2
0
Fork 0
mirror of https://github.com/go-gitea/gitea.git synced 2026-03-12 10:39:38 -05:00
Code Issues 2.6k Packages Projects Releases 100 Wiki Activity

search indexer broken: ...exer/code/indexer.go:128:func2() [E] Codes indexer handler: index error for repo 29: fork/exec /usr/bin/git: argument list too long #12253

New Issue
Closed
opened 2025-11-02 10:03:29 -06:00 by GiteaMirror · 10 comments
GiteaMirror commented 2025-11-02 10:03:29 -06:00
Owner
Copy Link

Originally created by @eveslage on GitHub (Dec 22, 2023).

Description

the search indexer is not working. the gitea.log gets filled with error messages:

2023/12/22 11:27:05 ...dules/git/command.go:291:Run() [D] git.Command.RunDir(/home/git/gitea-repositories/think-cell/code.git): /usr/bin/git -c protocol.version=2 -c credential.helper= -c filter.lfs.required= -c filter.lfs.smudge= -c filter.lfs.clean= ls-tree --full-tree -l df61ef8421d86acd35e2a2f98341646c03b87a3f -- .gitignore .gitmodules [[ followed by a endless list of files, part of the repository]]

2023/12/22 11:27:33 ...exer/code/indexer.go:128:func2() [E] Codes indexer handler: index error for repo 29: fork/exec /usr/bin/git: argument list too long

Also when we try to search in the repository we receive a 500 error message

Gitea Version

1.21.3 (and earlier)

Can you reproduce the bug on the Gitea demo site?

No

Log Gist

No response

Screenshots

No response

Git Version

2.39.2

Operating System

Debian 6.1.67-1

How are you running Gitea?

we run the latest downloadable version.

Database

None

Originally created by @eveslage on GitHub (Dec 22, 2023). ### Description the search indexer is not working. the gitea.log gets filled with error messages: 2023/12/22 11:27:05 ...dules/git/command.go:291:Run() [D] git.Command.RunDir(/home/git/gitea-repositories/think-cell/code.git): /usr/bin/git -c protocol.version=2 -c credential.helper= -c filter.lfs.required= -c filter.lfs.smudge= -c filter.lfs.clean= ls-tree --full-tree -l df61ef8421d86acd35e2a2f98341646c03b87a3f -- .gitignore .gitmodules [[[[ followed by a endless list of files, part of the repository]]]] 2023/12/22 11:27:33 ...exer/code/indexer.go:128:func2() [E] Codes indexer handler: index error for repo 29: fork/exec /usr/bin/git: argument list too long Also when we try to search in the repository we receive a 500 error message ### Gitea Version 1.21.3 (and earlier) ### Can you reproduce the bug on the Gitea demo site? No ### Log Gist _No response_ ### Screenshots _No response_ ### Git Version 2.39.2 ### Operating System Debian 6.1.67-1 ### How are you running Gitea? we run the latest downloadable version. ### Database None
GiteaMirror added the type/bug label 2025-11-02 10:03:29 -06:00
GiteaMirror commented 2025-11-02 10:03:30 -06:00
Author
Owner
Copy Link

@lunny commented on GitHub (Dec 22, 2023):

Which index type are you using?

@lunny commented on GitHub (Dec 22, 2023): Which index type are you using?
GiteaMirror commented 2025-11-02 10:03:31 -06:00
Author
Owner
Copy Link

@eveslage commented on GitHub (Dec 22, 2023):

Does this answer your question? or is there another setting. I think we went for the default here

REPO_INDEXER_ENABLED = true
REPO_INDEXER_PATH = indexers/repos.bleve

@eveslage commented on GitHub (Dec 22, 2023): Does this answer your question? or is there another setting. I think we went for the default here REPO_INDEXER_ENABLED = true REPO_INDEXER_PATH = indexers/repos.bleve
GiteaMirror commented 2025-11-02 10:03:31 -06:00
Author
Owner
Copy Link

@MaxWaldorf commented on GitHub (Dec 27, 2023):

same here

Search broken... Same settings...

@MaxWaldorf commented on GitHub (Dec 27, 2023): same here Search broken... Same settings...
GiteaMirror commented 2025-11-02 10:03:31 -06:00
Author
Owner
Copy Link

@wxiaoguang commented on GitHub (Dec 27, 2023):

The problem is that the code tries to add every file into the "git" command argument list, which makes the OS unhappy.

That code is quite old, so it is a longstanding problem, it only occurs if you have a repo which has a lot of files.

image

@wxiaoguang commented on GitHub (Dec 27, 2023): The problem is that the code tries to add every file into the "git" command argument list, which makes the OS unhappy. That code is quite old, so it is a longstanding problem, it only occurs if you have a repo which has a lot of files. ![image](https://github.com/go-gitea/gitea/assets/2114189/6d0ac3b3-399b-499c-afbf-30c22038c695)
GiteaMirror commented 2025-11-02 10:03:31 -06:00
Author
Owner
Copy Link

@MaxWaldorf commented on GitHub (Dec 27, 2023):

Any recommendations for large repos for indexing tools?

@MaxWaldorf commented on GitHub (Dec 27, 2023): Any recommendations for large repos for indexing tools?
GiteaMirror commented 2025-11-02 10:03:31 -06:00
Author
Owner
Copy Link

@wxiaoguang commented on GitHub (Dec 27, 2023):

I guess no until the bug could be fixed.

@wxiaoguang commented on GitHub (Dec 27, 2023): I guess no until the bug could be fixed.
GiteaMirror commented 2025-11-02 10:03:32 -06:00
Author
Owner
Copy Link

@MaxWaldorf commented on GitHub (Dec 27, 2023):

So, no 3rd party integrations like elastic?

@MaxWaldorf commented on GitHub (Dec 27, 2023): So, no 3rd party integrations like elastic?
GiteaMirror commented 2025-11-02 10:03:32 -06:00
Author
Owner
Copy Link

@lunny commented on GitHub (Dec 28, 2023):

Elastic search is supported, but the problem is git command line has length limitation but the file names are too much.

@lunny commented on GitHub (Dec 28, 2023): Elastic search is supported, but the problem is git command line has length limitation but the file names are too much.
GiteaMirror commented 2025-11-02 10:03:32 -06:00
Author
Owner
Copy Link

@schmurtzm commented on GitHub (Mar 19, 2024):

Looking forward the fix on this issue. Any workaround ?
My repo has numerous files indeed.
My search doesn't seems to get error 500 (not sure that it stills indexing however) but I have a lot of these events :

2024/03/20 00:27:02 ...exer/code/indexer.go:128:func2() [E] Codes indexer handler: index error for repo 2: fork/exec C:\Program Files\Git\cmd\git.exe: Nom de fichier ou extension trop long.
2024/03/20 00:27:02 ...queue/workergroup.go:105:doWorkerHandle() [E] Queue "code_indexer" failed to handle batch of 1 items, backoff for a few seconds
2024/03/20 00:27:06 ...exer/code/indexer.go:128:func2() [E] Codes indexer handler: index error for repo 2: fork/exec C:\Program Files\Git\cmd\git.exe: Nom de fichier ou extension trop long.
2024/03/20 00:27:06 ...queue/workergroup.go:105:doWorkerHandle() [E] Queue "code_indexer" failed to handle batch of 1 items, backoff for a few seconds
2024/03/20 00:27:09 ...exer/code/indexer.go:128:func2() [E] Codes indexer handler: index error for repo 2: fork/exec C:\Program Files\Git\cmd\git.exe: Nom de fichier ou extension trop long.
2024/03/20 00:27:09 ...queue/workergroup.go:105:doWorkerHandle() [E] Queue "code_indexer" failed to handle batch of 1 items, backoff for a few seconds
2024/03/20 00:27:12 ...exer/code/indexer.go:128:func2() [E] Codes indexer handler: index error for repo 2: fork/exec C:\Program Files\Git\cmd\git.exe: Nom de fichier ou extension trop long.
2024/03/20 00:27:12 ...queue/workergroup.go:105:doWorkerHandle() [E] Queue "code_indexer" failed to handle batch of 1 items, backoff for a few seconds
@schmurtzm commented on GitHub (Mar 19, 2024): Looking forward the fix on this issue. Any workaround ? My repo has numerous files indeed. My search doesn't seems to get error 500 (not sure that it stills indexing however) but I have a lot of these events : ``` 2024/03/20 00:27:02 ...exer/code/indexer.go:128:func2() [E] Codes indexer handler: index error for repo 2: fork/exec C:\Program Files\Git\cmd\git.exe: Nom de fichier ou extension trop long. 2024/03/20 00:27:02 ...queue/workergroup.go:105:doWorkerHandle() [E] Queue "code_indexer" failed to handle batch of 1 items, backoff for a few seconds 2024/03/20 00:27:06 ...exer/code/indexer.go:128:func2() [E] Codes indexer handler: index error for repo 2: fork/exec C:\Program Files\Git\cmd\git.exe: Nom de fichier ou extension trop long. 2024/03/20 00:27:06 ...queue/workergroup.go:105:doWorkerHandle() [E] Queue "code_indexer" failed to handle batch of 1 items, backoff for a few seconds 2024/03/20 00:27:09 ...exer/code/indexer.go:128:func2() [E] Codes indexer handler: index error for repo 2: fork/exec C:\Program Files\Git\cmd\git.exe: Nom de fichier ou extension trop long. 2024/03/20 00:27:09 ...queue/workergroup.go:105:doWorkerHandle() [E] Queue "code_indexer" failed to handle batch of 1 items, backoff for a few seconds 2024/03/20 00:27:12 ...exer/code/indexer.go:128:func2() [E] Codes indexer handler: index error for repo 2: fork/exec C:\Program Files\Git\cmd\git.exe: Nom de fichier ou extension trop long. 2024/03/20 00:27:12 ...queue/workergroup.go:105:doWorkerHandle() [E] Queue "code_indexer" failed to handle batch of 1 items, backoff for a few seconds ```
GiteaMirror commented 2025-11-02 10:03:33 -06:00
Author
Owner
Copy Link

@lunny commented on GitHub (Mar 20, 2024):

Looking forward the fix on this issue. Any workaround ? My repo has numerous files indeed. My search doesn't seems to get error 500 (not sure that it stills indexing however) but I have a lot of these events :

2024/03/20 00:27:02 ...exer/code/indexer.go:128:func2() [E] Codes indexer handler: index error for repo 2: fork/exec C:\Program Files\Git\cmd\git.exe: Nom de fichier ou extension trop long.
2024/03/20 00:27:02 ...queue/workergroup.go:105:doWorkerHandle() [E] Queue "code_indexer" failed to handle batch of 1 items, backoff for a few seconds
2024/03/20 00:27:06 ...exer/code/indexer.go:128:func2() [E] Codes indexer handler: index error for repo 2: fork/exec C:\Program Files\Git\cmd\git.exe: Nom de fichier ou extension trop long.
2024/03/20 00:27:06 ...queue/workergroup.go:105:doWorkerHandle() [E] Queue "code_indexer" failed to handle batch of 1 items, backoff for a few seconds
2024/03/20 00:27:09 ...exer/code/indexer.go:128:func2() [E] Codes indexer handler: index error for repo 2: fork/exec C:\Program Files\Git\cmd\git.exe: Nom de fichier ou extension trop long.
2024/03/20 00:27:09 ...queue/workergroup.go:105:doWorkerHandle() [E] Queue "code_indexer" failed to handle batch of 1 items, backoff for a few seconds
2024/03/20 00:27:12 ...exer/code/indexer.go:128:func2() [E] Codes indexer handler: index error for repo 2: fork/exec C:\Program Files\Git\cmd\git.exe: Nom de fichier ou extension trop long.
2024/03/20 00:27:12 ...queue/workergroup.go:105:doWorkerHandle() [E] Queue "code_indexer" failed to handle batch of 1 items, backoff for a few seconds

Looks like you have a different error log from this issue.

@lunny commented on GitHub (Mar 20, 2024): > Looking forward the fix on this issue. Any workaround ? My repo has numerous files indeed. My search doesn't seems to get error 500 (not sure that it stills indexing however) but I have a lot of these events : > > ``` > 2024/03/20 00:27:02 ...exer/code/indexer.go:128:func2() [E] Codes indexer handler: index error for repo 2: fork/exec C:\Program Files\Git\cmd\git.exe: Nom de fichier ou extension trop long. > 2024/03/20 00:27:02 ...queue/workergroup.go:105:doWorkerHandle() [E] Queue "code_indexer" failed to handle batch of 1 items, backoff for a few seconds > 2024/03/20 00:27:06 ...exer/code/indexer.go:128:func2() [E] Codes indexer handler: index error for repo 2: fork/exec C:\Program Files\Git\cmd\git.exe: Nom de fichier ou extension trop long. > 2024/03/20 00:27:06 ...queue/workergroup.go:105:doWorkerHandle() [E] Queue "code_indexer" failed to handle batch of 1 items, backoff for a few seconds > 2024/03/20 00:27:09 ...exer/code/indexer.go:128:func2() [E] Codes indexer handler: index error for repo 2: fork/exec C:\Program Files\Git\cmd\git.exe: Nom de fichier ou extension trop long. > 2024/03/20 00:27:09 ...queue/workergroup.go:105:doWorkerHandle() [E] Queue "code_indexer" failed to handle batch of 1 items, backoff for a few seconds > 2024/03/20 00:27:12 ...exer/code/indexer.go:128:func2() [E] Codes indexer handler: index error for repo 2: fork/exec C:\Program Files\Git\cmd\git.exe: Nom de fichier ou extension trop long. > 2024/03/20 00:27:12 ...queue/workergroup.go:105:doWorkerHandle() [E] Queue "code_indexer" failed to handle batch of 1 items, backoff for a few seconds > ``` Looks like you have a different error log from this issue.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
$20
$250
$50
$500
backport/done
💎 Bounty
docs-update-needed
good first issue
hacktoberfest
issue/bounty
issue/confirmed
issue/critical
issue/duplicate
issue/needs-feedback
issue/not-a-bug
issue/regression
issue/stale
issue/workaround
lgtm/need 2
modifies/api
modifies/translation
outdated/backport/v1.18
outdated/theme/markdown
outdated/theme/timetracker
performance/bigrepo
performance/cpu
performance/memory
performance/speed
pr/breaking
proposal/accepted
proposal/rejected
pr/wip
pull-request
Mirrored from GitHub Pull Request
 reviewed/wontfix
💰 Rewarded
skip-changelog
status/blocked
topic/accessibility
topic/api
topic/authentication
topic/build
topic/code-linting
topic/commit-signing
topic/content-rendering
topic/deployment
topic/distribution
topic/federation
topic/gitea-actions
topic/issues
topic/lfs
topic/mobile
topic/moderation
topic/packages
topic/pr
topic/projects
topic/repo
topic/repo-migration
topic/security
topic/theme
topic/ui
topic/ui-interaction
topic/ux
topic/webhooks
topic/wiki
type/bug
type/deprecation
type/docs
type/enhancement
type/feature
type/miscellaneous
type/proposal
type/question
type/refactoring
type/summary
type/testing
type/upstream
No Label type/bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/gitea#12253
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?