LFS: Error 500 when merging pull request #268

@iCodeSometime commented on GitHub (Jan 24, 2019):

@fabian-z This is still happening with LFS enabled.

I'm unsure how to run gitea as a local user account.
I tried creating a new user account, and set the service to run under this account, and changing RUN_USER in the app.ini to run under that user, but the service will not start under that configuration.

@iCodeSometime commented on GitHub (Jan 24, 2019): @fabian-z This is still happening with LFS enabled. I'm unsure how to run gitea as a local user account. I tried creating a new user account, and set the service to run under this account, and changing RUN_USER in the app.ini to run under that user, but the service will not start under that configuration.

GiteaMirror commented

@terokorp commented on GitHub (Mar 16, 2019):

Got same error and here is gitea.log record:

==> gitea.log <==
2019/03/16 12:31:24 [...routers/repo/pull.go:589 MergePullRequest()] [E] Merge: git merge --no-ff --no-commit [/var/lib/gitea/data/tmp/local-repo/merge-251661747.git]: exec(11:PullRequest.Merge (git merge --no-ff --no-commit): /var/lib/gitea/data/tmp/local-repo/merge-251661747.git) failed: exit status 128(<nil>) stdout:  stderr: Downloading Assets/_myproject/Models/humanoid.fbm/tex_diffuse.png (7.1 MB)

hint: The remote resolves to a file:// URL, which can only work with a
hint: standalone transfer agent.  See section "Using a Custom Transfer Type
hint: without the API server" in custom-transfers.md for details.
Error downloading object: Assets/_myproject/Models/humanoid.fbm/tex_diffuse.png (142123c): Smudge error: Error downloading Assets/_myproject/Models/humanoid.fbm/tex_diffuse.png (142123cd5c85098a8f3c2ae5e7ac600509cc07bd9cc1d0b2591ea357512eb45e): batch request: missing protocol: "file:///home/git/gitea-repositories/team/myproject.git/info/lfs"

Errors logged to /var/lib/gitea/data/tmp/local-repo/merge-251661747.git/.git/lfs/logs/20190316T123115.744431669.log
Use 'git lfs logs last' to view the log.
error: external filter 'git-lfs filter-process' failed
fatal: Assets/_myproject/Models/humanoid.fbm/tex_diffuse.png: smudge filter lfs failed
 - Downloading Assets/_myproject/Models/humanoid.fbm/tex_diffuse.png (7.1 MB)

hint: The remote resolves to a file:// URL, which can only work with a
hint: standalone transfer agent.  See section "Using a Custom Transfer Type
hint: without the API server" in custom-transfers.md for details.
Error downloading object: Assets/_myproject/Models/humanoid.fbm/tex_diffuse.png (142123c): Smudge error: Error downloading Assets/_myproject/Models/humanoid.fbm/tex_diffuse.png (142123cd5c85098a8f3c2ae5e7ac600509cc07bd9cc1d0b2591ea357512eb45e): batch request: missing protocol: "file:///home/git/gitea-repositories/team/myproject.git/info/lfs"

Errors logged to /var/lib/gitea/data/tmp/local-repo/merge-251661747.git/.git/lfs/logs/20190316T123115.744431669.log
Use 'git lfs logs last' to view the log.
error: external filter 'git-lfs filter-process' failed
fatal: Assets/_myproject/Models/humanoid.fbm/tex_diffuse.png: smudge filter lfs failed

Application Version: 1.7.0
Installed by folloring this: https://docs.gitea.io/en-us/install-from-binary/

@terokorp commented on GitHub (Mar 16, 2019): Got same error and here is gitea.log record: ``` ==> gitea.log <== 2019/03/16 12:31:24 [...routers/repo/pull.go:589 MergePullRequest()] [E] Merge: git merge --no-ff --no-commit [/var/lib/gitea/data/tmp/local-repo/merge-251661747.git]: exec(11:PullRequest.Merge (git merge --no-ff --no-commit): /var/lib/gitea/data/tmp/local-repo/merge-251661747.git) failed: exit status 128(<nil>) stdout: stderr: Downloading Assets/_myproject/Models/humanoid.fbm/tex_diffuse.png (7.1 MB) hint: The remote resolves to a file:// URL, which can only work with a hint: standalone transfer agent. See section "Using a Custom Transfer Type hint: without the API server" in custom-transfers.md for details. Error downloading object: Assets/_myproject/Models/humanoid.fbm/tex_diffuse.png (142123c): Smudge error: Error downloading Assets/_myproject/Models/humanoid.fbm/tex_diffuse.png (142123cd5c85098a8f3c2ae5e7ac600509cc07bd9cc1d0b2591ea357512eb45e): batch request: missing protocol: "file:///home/git/gitea-repositories/team/myproject.git/info/lfs" Errors logged to /var/lib/gitea/data/tmp/local-repo/merge-251661747.git/.git/lfs/logs/20190316T123115.744431669.log Use 'git lfs logs last' to view the log. error: external filter 'git-lfs filter-process' failed fatal: Assets/_myproject/Models/humanoid.fbm/tex_diffuse.png: smudge filter lfs failed - Downloading Assets/_myproject/Models/humanoid.fbm/tex_diffuse.png (7.1 MB) hint: The remote resolves to a file:// URL, which can only work with a hint: standalone transfer agent. See section "Using a Custom Transfer Type hint: without the API server" in custom-transfers.md for details. Error downloading object: Assets/_myproject/Models/humanoid.fbm/tex_diffuse.png (142123c): Smudge error: Error downloading Assets/_myproject/Models/humanoid.fbm/tex_diffuse.png (142123cd5c85098a8f3c2ae5e7ac600509cc07bd9cc1d0b2591ea357512eb45e): batch request: missing protocol: "file:///home/git/gitea-repositories/team/myproject.git/info/lfs" Errors logged to /var/lib/gitea/data/tmp/local-repo/merge-251661747.git/.git/lfs/logs/20190316T123115.744431669.log Use 'git lfs logs last' to view the log. error: external filter 'git-lfs filter-process' failed fatal: Assets/_myproject/Models/humanoid.fbm/tex_diffuse.png: smudge filter lfs failed ``` Application Version: 1.7.0 Installed by folloring this: https://docs.gitea.io/en-us/install-from-binary/

GiteaMirror commented

@stale[bot] commented on GitHub (May 15, 2019):

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs during the next 2 weeks. Thank you for your contributions.

@stale[bot] commented on GitHub (May 15, 2019): This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs during the next 2 weeks. Thank you for your contributions.

GiteaMirror commented

@zeripath commented on GitHub (May 25, 2019):

Ah! I think I understand what's causing this!

Can anyone still reproduce this on 1.8+?

@zeripath commented on GitHub (May 25, 2019): Ah! I think I understand what's causing this! Can anyone still reproduce this on 1.8+?

GiteaMirror commented

@zeripath commented on GitHub (May 26, 2019):

I think I may finally have found the cause.

I suspect that you have git-lfs version greater than 2.3.4 installed on your server and gitea user has a .gitconfig file containing:

[filter "lfs"]
	clean = git-lfs clean -- %f
	smudge = git-lfs smudge -- %f
	process = git-lfs filter-process
	required = true

If you remove that that should act as a workaround.

@zeripath commented on GitHub (May 26, 2019): I think I may finally have found the cause. I suspect that you have git-lfs version greater than 2.3.4 installed on your server and gitea user has a .gitconfig file containing: ```ini [filter "lfs"] clean = git-lfs clean -- %f smudge = git-lfs smudge -- %f process = git-lfs filter-process required = true ``` If you remove that that should act as a workaround.

GiteaMirror commented

@zeripath commented on GitHub (May 28, 2019):

@Begounet are you able to come up with a minimal example for me? I would love to exactly figure out what is the problem here. I know it's due to the lfs smudge filter but I'd like to catch it in the act.

I think #7062 and this workaround won't be the complete solution because we do need to be aware of lfs additions on merging - i.e. What happens if you add an LFS file through a merge and then delete the adding repository - I'm highly suspicious that this file will be deleted from the LFS.

@zeripath commented on GitHub (May 28, 2019): @Begounet are you able to come up with a minimal example for me? I would love to exactly figure out what is the problem here. I know it's due to the lfs smudge filter but I'd like to catch it in the act. I think #7062 and this workaround won't be the complete solution because we do need to be aware of lfs additions on merging - i.e. What happens if you add an LFS file through a merge and then delete the adding repository - I'm highly suspicious that this file will be deleted from the LFS.

GiteaMirror commented

@Begounet commented on GitHub (May 28, 2019):

I will try to setup a server from my home, using the same LFS and Gitea versions but it will take some times since I am not really used to that kind of stuff. Unfortunately, I cannot provide access to our enterprise private servers.

But I think the most important thing is to at least have once LFS filtered file in the commit you want to merge.

And your workaround indeed worked! Thank you!

What happens if you add an LFS file through a merge and then delete the adding repository - I'm highly suspicious that this file will be deleted from the LFS.

Shouldn't be the expected behavior?

@Begounet commented on GitHub (May 28, 2019): I will try to setup a server from my home, using the same LFS and Gitea versions but it will take some times since I am not really used to that kind of stuff. Unfortunately, I cannot provide access to our enterprise private servers. But I think the most important thing is to at least have once LFS filtered file in the commit you want to merge. And your workaround indeed worked! Thank you! > What happens if you add an LFS file through a merge and then delete the adding repository - I'm highly suspicious that this file will be deleted from the LFS. Shouldn't be the expected behavior?

GiteaMirror commented

31557b1274/modules/setting/setting.go (L459-L478)

@zeripath commented on GitHub (May 28, 2019):

@Begounet Was there anything special about your filter configuration in .gitconfig? Was it exactly the same as I put in https://github.com/go-gitea/gitea/issues/732#issuecomment-495972325 ?

The other question is what version of git do you have?

It appears that my PR #7062 is unlikely to be required as we should be setting these (except for process) anyway:

@zeripath commented on GitHub (May 28, 2019): @Begounet Was there anything special about your filter configuration in .gitconfig? Was it exactly the same as I put in https://github.com/go-gitea/gitea/issues/732#issuecomment-495972325 ? The other question is what version of git do you have? It appears that my PR #7062 is unlikely to be required as we should be setting these (except for process) anyway: https://github.com/go-gitea/gitea/blob/31557b12744410633ceb6fc12b53fb09038cee35/modules/setting/setting.go#L459-L478

GiteaMirror commented

@zeripath commented on GitHub (May 28, 2019):

So perhaps you have the lfs process running...

I'll adjust #7062 to ignore the process at this point instead.

@zeripath commented on GitHub (May 28, 2019): So perhaps you have the lfs process running... I'll adjust #7062 to ignore the process at this point instead.

GiteaMirror commented

@zeripath commented on GitHub (May 28, 2019):

In terms of the potential deletion bug: Suppose you have repository A and fork B.

Say you add an LFS'd file f with OID o to B on branch to-merge.
Then merge to-merge into A
Does an LFSMetaObject get created for f in A?
What happens if you delete repo B? If there is no LFSMetaObject for f in A and there is no other user of the oid o then f will get deleted from the LFS.

You would need to check the LFS directly to see if it has disappeared.

This problem wouldn't just affect users like you who are likely affected by the lfs filter process but every user of LFS.

I think gitea needs to handle lfs filtering itself.

@zeripath commented on GitHub (May 28, 2019): In terms of the potential deletion bug: Suppose you have repository A and fork B. * Say you add an LFS'd file f with OID o to B on branch to-merge. * Then merge to-merge into A * Does an LFSMetaObject get created for f in A? * What happens if you delete repo B? If there is no LFSMetaObject for f in A and there is no other user of the oid o then f will get deleted from the LFS. You would need to check the LFS directly to see if it has disappeared. This problem wouldn't just affect users like you who are likely affected by the lfs filter process but every user of LFS. I think gitea needs to handle lfs filtering itself.

GiteaMirror commented

@Begounet commented on GitHub (May 28, 2019):

The version of the git on the server is 2.4.11 (if I've done the check correctly with <repository url>/info/refs?service=git-upload-pack).
The version of my git (client) is 2.21.0.windows.1
About the configuration file, I don't know (since I am not the admin sys - I am just relaying to him our conversation here) but I think that was these lines correctly.
He told me that there were these lines when he executed "git lfs env":

git config filter.lfs.process = "git-lfs filter-process"
git config filter.lfs.smudge = "git-lfs smudge -- %f"
git config filter.lfs.clean = "git-lfs clean -- %f"

And then he founds theses lines in the global config (/etc/gitconfig).

@Begounet commented on GitHub (May 28, 2019): - The version of the git on the server is 2.4.11 (if I've done the check correctly with `<repository url>/info/refs?service=git-upload-pack`). - The version of my git (client) is 2.21.0.windows.1 - About the configuration file, I don't know (since I am not the admin sys - I am just relaying to him our conversation here) but I think that was these lines correctly. He told me that there were these lines when he executed "git lfs env": > git config filter.lfs.process = "git-lfs filter-process" > git config filter.lfs.smudge = "git-lfs smudge -- %f" > git config filter.lfs.clean = "git-lfs clean -- %f" And then he founds theses lines in the global config (/etc/gitconfig).

GiteaMirror commented

@zeripath commented on GitHub (May 29, 2019):

FINALLY! I've managed to reproduce this, and it's stupidly easy to do.

Oh dear.

I'm so sorry this has not been fixed - I can't believe that this has been here for so long.

OK, to reproduce:

Create a repository
git lfs track '*.jpg'
git add .gitattributes
git push
- Or just add a .gitattributes file *.jpg filter=lfs diff=lfs merge=lfs -text on the web interface
Then with another user, fork the repository
Add a jpg over the web interface
create a pull-request with that jpg
BOOM

@zeripath commented on GitHub (May 29, 2019): FINALLY! I've managed to reproduce this, and it's stupidly easy to do. Oh dear. I'm so sorry this has not been fixed - I can't believe that this has been here for so long. OK, to reproduce: * Create a repository * `git lfs track '*.jpg'` * `git add .gitattributes` * `git push` - Or just add a .gitattributes file `*.jpg filter=lfs diff=lfs merge=lfs -text` on the web interface * Then with another user, fork the repository * Add a jpg over the web interface * create a pull-request with that jpg * BOOM

GiteaMirror commented

@zeripath commented on GitHub (May 31, 2019):

OK I finally have a working and complete bug fix for this in #7082

Now, the problem is that people who have been merging "successfully", i.e. not experiencing #732 won't realise that if they delete their forks their LFS objects will disappear.

@zeripath commented on GitHub (May 31, 2019): OK I finally have a working and complete bug fix for this in #7082 Now, the problem is that people who have been merging "successfully", i.e. not experiencing #732 won't realise that if they delete their forks their LFS objects will disappear.

GiteaMirror commented

@kleszcz commented on GitHub (Jul 9, 2019):

Hi, unfortunately we're experiencing this old "500" error when merging pull requests with files in lfs through Gitea.

Gitea version 1.8.3/go1.12.5
git lfs version 2.7.1
database type: sqlite3

Also it comes with error log same as reported in #4463. We've checked for the .gitconfig entries mentioned above and there are none.

@kleszcz commented on GitHub (Jul 9, 2019): Hi, unfortunately we're experiencing this old "500" error when merging pull requests with files in lfs through Gitea. - Gitea version 1.8.3/go1.12.5 - git lfs version 2.7.1 - database type: sqlite3 Also it comes with error log same as reported in #4463. We've checked for the .gitconfig entries mentioned above and there are none.

GiteaMirror commented