Can't migrate 8,8GB project #5730

New Issue

GiteaMirror · 2025-11-02T06:34:12-06:00

GiteaMirror commented

2025-11-02 06:34:12 -06:00

Originally created by @somera on GitHub (Jul 12, 2020).

Gitea version (or commit ref): 1.12.2
Git version: 2.25.1
Operating system: Linux nuc-mini-server 5.4.0-40-generic #44-Ubuntu SMP Tue Jun 23 00:01:04 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Database (use [x]):
- PostgreSQL
- MySQL
- MSSQL
- SQLite
Can you reproduce the bug at https://try.gitea.io:
- Yes (provide example URL)
- No
- Not relevant

I try mirror huge project in Gitea.

https://github.com/0ad/0ad

Localy on the machine, where Gitea is installed it needs ~15 minutes:

mini-server:/data-files/tmp$ date ; git clone https://github.com/0ad/0ad.git ; date
**So 12. Jul 19:43:50 CEST 2020**
Cloning into '0ad'...
remote: Enumerating objects: 41, done.
remote: Counting objects: 100% (41/41), done.
remote: Compressing objects: 100% (36/36), done.
remote: Total 463029 (delta 7), reused 17 (delta 5), pack-reused 462988
Receiving objects: 100% (463029/463029), 4.39 GiB | 5.46 MiB/s, done.
Resolving deltas: 100% (357807/357807), done.
Updating files: 100% (33849/33849), done.
**So 12. Jul 19:58:03 CEST 2020**

My git timeouts are set to

; Operation timeout in seconds
[git.timeout]
DEFAULT = 360
MIGRATE = 600
MIRROR = 1200
CLONE = 1200
PULL = 300
GC = 240

Why it's now working?

Originally created by @somera on GitHub (Jul 12, 2020).   - Gitea version (or commit ref): 1.12.2 - Git version: 2.25.1 - Operating system: Linux nuc-mini-server 5.4.0-40-generic #44-Ubuntu SMP Tue Jun 23 00:01:04 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux - Database (use `[x]`): - [x] PostgreSQL - [ ] MySQL - [ ] MSSQL - [ ] SQLite - Can you reproduce the bug at https://try.gitea.io: - [ ] Yes (provide example URL) - [ ] No - [x] Not relevant I try mirror huge project in Gitea. https://github.com/0ad/0ad Localy on the machine, where Gitea is installed it needs ~15 minutes: ``` mini-server:/data-files/tmp$ date ; git clone https://github.com/0ad/0ad.git ; date **So 12. Jul 19:43:50 CEST 2020** Cloning into '0ad'... remote: Enumerating objects: 41, done. remote: Counting objects: 100% (41/41), done. remote: Compressing objects: 100% (36/36), done. remote: Total 463029 (delta 7), reused 17 (delta 5), pack-reused 462988 Receiving objects: 100% (463029/463029), 4.39 GiB | 5.46 MiB/s, done. Resolving deltas: 100% (357807/357807), done. Updating files: 100% (33849/33849), done. **So 12. Jul 19:58:03 CEST 2020** ``` My git timeouts are set to ``` ; Operation timeout in seconds [git.timeout] DEFAULT = 360 MIGRATE = 600 MIRROR = 1200 CLONE = 1200 PULL = 300 GC = 240 ``` Why it's now working?

GiteaMirror added the type/bug label 2025-11-02 06:34:12 -06:00

GiteaMirror closed this issue

2025-11-02 06:34:13 -06:00

GiteaMirror commented

2025-11-02 06:34:13 -06:00

@somera commented on GitHub (Jul 24, 2020):

Ist there any solution to do this?

@somera commented on GitHub (Jul 24, 2020): Ist there any solution to do this?

GiteaMirror commented

2025-11-02 06:34:13 -06:00

@lunny commented on GitHub (Jul 24, 2020):

gitea clone is not a plain clone, it will clone all the branches, so it may spend more time than your command line.

@lunny commented on GitHub (Jul 24, 2020): gitea clone is not a plain clone, it will clone all the branches, so it may spend more time than your command line.

GiteaMirror commented

2025-11-02 06:34:13 -06:00

@somera commented on GitHub (Jul 24, 2020):

gitea clone is not a plain clone, it will clone all the branches, so it may spend more time than your command line.

Time is not the problem for me. ;)

But it's not working when I increase the timeout settings. The proces is brocken earlier. Is there other internal timeout?

@somera commented on GitHub (Jul 24, 2020): > gitea clone is not a plain clone, it will clone all the branches, so it may spend more time than your command line. Time is not the problem for me. ;) But it's not working when I increase the timeout settings. The proces is brocken earlier. Is there other internal timeout?

GiteaMirror commented

2025-11-02 06:34:14 -06:00

@lunny commented on GitHub (Jul 25, 2020):

So there should be another context to cancel the process.

@lunny commented on GitHub (Jul 25, 2020): So there should be another context to cancel the process.

GiteaMirror commented

2025-11-02 06:34:14 -06:00

@somera commented on GitHub (Aug 7, 2020):

So there should be another context to cancel the process.

Means I can't mirror it?

@somera commented on GitHub (Aug 7, 2020): > So there should be another context to cancel the process. Means I can't mirror it?

GiteaMirror commented

2025-11-02 06:34:14 -06:00

@stale[bot] commented on GitHub (Oct 7, 2020):

This issue has been automatically marked as stale because it has not had recent activity. I am here to help clear issues left open even if solved or waiting for more insight. This issue will be closed if no further activity occurs during the next 2 weeks. If the issue is still valid just add a comment to keep it alive. Thank you for your contributions.

@stale[bot] commented on GitHub (Oct 7, 2020): This issue has been automatically marked as stale because it has not had recent activity. I am here to help clear issues left open even if solved or waiting for more insight. This issue will be closed if no further activity occurs during the next 2 weeks. If the issue is still valid just add a comment to keep it alive. Thank you for your contributions.

GiteaMirror commented

2025-11-02 06:34:14 -06:00

@somera commented on GitHub (Oct 7, 2020):

@lunny and will ir be possible to mirror project like this?

@somera commented on GitHub (Oct 7, 2020): @lunny and will ir be possible to mirror project like this?

GiteaMirror commented

2025-11-02 06:34:14 -06:00

@6543 commented on GitHub (Oct 12, 2020):

This is some configuration issue i think.

it woks for me:

git config:

Migration Timeout                6000 seconds
Mirror Update Timeout         3000 seconds
Clone Operation Timeout    3000 seconds
Pull Operation Timeout        3000 seconds
GC Operation Timeout          600 seconds

if you need help with configuration pleace ask for help on your discord server ;)

@6543 commented on GitHub (Oct 12, 2020): This is some configuration issue i think. it woks for me: * https://code.obermui.de/test/0ad_migrate * https://code.obermui.de/test/0ad_mirror git config: ``` Migration Timeout 6000 seconds Mirror Update Timeout 3000 seconds Clone Operation Timeout 3000 seconds Pull Operation Timeout 3000 seconds GC Operation Timeout 600 seconds ``` if you need help with configuration pleace ask for help on your discord server ;)

GiteaMirror commented

2025-11-02 06:34:15 -06:00

@somera commented on GitHub (Oct 13, 2020):

This is some configuration issue i think.

it woks for me:

https://code.obermui.de/test/0ad_migrate

https://code.obermui.de/test/0ad_mirror

git config:
Migration Timeout                6000 seconds
Mirror Update Timeout         3000 seconds
Clone Operation Timeout    3000 seconds
Pull Operation Timeout        3000 seconds
GC Operation Timeout          600 seconds
if you need help with configuration pleace ask for help on your discord server ;)

Works for me too!

@somera commented on GitHub (Oct 13, 2020): > This is some configuration issue i think. > > it woks for me: > > * https://code.obermui.de/test/0ad_migrate > * https://code.obermui.de/test/0ad_mirror > > git config: > > ``` > Migration Timeout 6000 seconds > Mirror Update Timeout 3000 seconds > Clone Operation Timeout 3000 seconds > Pull Operation Timeout 3000 seconds > GC Operation Timeout 600 seconds > ``` > > if you need help with configuration pleace ask for help on your discord server ;) Works for me too!

Sign in to join this conversation.

Branches Tags

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/gitea#5730