mirror of
https://github.com/go-gitea/gitea.git
synced 2026-03-12 02:24:21 -05:00
Lots of database writes once an act_runner is registered and running #14252
Open
opened 2025-11-02 11:07:35 -06:00 by GiteaMirror
·
6 comments
No Branch/Tag Specified
main
release/v1.25
release/v1.24
release/v1.23
release/v1.22
release/v1.21
release/v1.20
release/v1.19
release/v1.18
release/v1.17
release/v1.16
release/v1.15
release/v1.14
release/v1.13
release/v1.12
release/v1.11
release/v1.10
release/v1.9
release/v1.8
v1.25.3
v1.25.2
v1.25.1
v1.25.0
v1.24.7
v1.25.0-rc0
v1.26.0-dev
v1.24.6
v1.24.5
v1.24.4
v1.24.3
v1.24.2
v1.24.1
v1.24.0
v1.23.8
v1.24.0-rc0
v1.25.0-dev
v1.23.7
v1.23.6
v1.23.5
v1.23.4
v1.23.3
v1.23.2
v1.23.1
v1.23.0
v1.23.0-rc0
v1.24.0-dev
v1.22.6
v1.22.5
v1.22.4
v1.22.3
v1.22.2
v1.22.1
v1.22.0
v1.23.0-dev
v1.22.0-rc1
v1.21.11
v1.22.0-rc0
v1.21.10
v1.21.9
v1.21.8
v1.21.7
v1.21.6
v1.21.5
v1.21.4
v1.21.3
v1.21.2
v1.20.6
v1.21.1
v1.21.0
v1.21.0-rc2
v1.21.0-rc1
v1.20.5
v1.22.0-dev
v1.21.0-rc0
v1.20.4
v1.20.3
v1.20.2
v1.20.1
v1.20.0
v1.19.4
v1.21.0-dev
v1.20.0-rc2
v1.20.0-rc1
v1.20.0-rc0
v1.19.3
v1.19.2
v1.19.1
v1.19.0
v1.19.0-rc1
v1.20.0-dev
v1.19.0-rc0
v1.18.5
v1.18.4
v1.18.3
v1.18.2
v1.18.1
v1.18.0
v1.17.4
v1.18.0-rc1
v1.19.0-dev
v1.18.0-rc0
v1.17.3
v1.17.2
v1.17.1
v1.17.0
v1.17.0-rc2
v1.16.9
v1.17.0-rc1
v1.18.0-dev
v1.16.8
v1.16.7
v1.16.6
v1.16.5
v1.16.4
v1.16.3
v1.16.2
v1.16.1
v1.16.0
v1.15.11
v1.17.0-dev
v1.16.0-rc1
v1.15.10
v1.15.9
v1.15.8
v1.15.7
v1.15.6
v1.15.5
v1.15.4
v1.15.3
v1.15.2
v1.15.1
v1.14.7
v1.15.0
v1.15.0-rc3
v1.14.6
v1.15.0-rc2
v1.14.5
v1.16.0-dev
v1.15.0-rc1
v1.14.4
v1.14.3
v1.14.2
v1.14.1
v1.14.0
v1.13.7
v1.14.0-rc2
v1.13.6
v1.13.5
v1.14.0-rc1
v1.15.0-dev
v1.13.4
v1.13.3
v1.13.2
v1.13.1
v1.13.0
v1.12.6
v1.13.0-rc2
v1.14.0-dev
v1.13.0-rc1
v1.12.5
v1.12.4
v1.12.3
v1.12.2
v1.12.1
v1.11.8
v1.12.0
v1.11.7
v1.12.0-rc2
v1.11.6
v1.12.0-rc1
v1.13.0-dev
v1.11.5
v1.11.4
v1.11.3
v1.10.6
v1.12.0-dev
v1.11.2
v1.10.5
v1.11.1
v1.10.4
v1.11.0
v1.11.0-rc2
v1.10.3
v1.11.0-rc1
v1.10.2
v1.10.1
v1.10.0
v1.9.6
v1.9.5
v1.10.0-rc2
v1.11.0-dev
v1.10.0-rc1
v1.9.4
v1.9.3
v1.9.2
v1.9.1
v1.9.0
v1.9.0-rc2
v1.10.0-dev
v1.9.0-rc1
v1.8.3
v1.8.2
v1.8.1
v1.8.0
v1.8.0-rc3
v1.7.6
v1.8.0-rc2
v1.7.5
v1.8.0-rc1
v1.9.0-dev
v1.7.4
v1.7.3
v1.7.2
v1.7.1
v1.7.0
v1.7.0-rc3
v1.6.4
v1.7.0-rc2
v1.6.3
v1.7.0-rc1
v1.7.0-dev
v1.6.2
v1.6.1
v1.6.0
v1.6.0-rc2
v1.5.3
v1.6.0-rc1
v1.6.0-dev
v1.5.2
v1.5.1
v1.5.0
v1.5.0-rc2
v1.5.0-rc1
v1.5.0-dev
v1.4.3
v1.4.2
v1.4.1
v1.4.0
v1.4.0-rc3
v1.4.0-rc2
v1.3.3
v1.4.0-rc1
v1.3.2
v1.3.1
v1.3.0
v1.3.0-rc2
v1.3.0-rc1
v1.2.3
v1.2.2
v1.2.1
v1.2.0
v1.2.0-rc3
v1.2.0-rc2
v1.1.4
v1.2.0-rc1
v1.1.3
v1.1.2
v1.1.1
v1.1.0
v1.0.2
v1.0.1
v1.0.0
v0.9.99
Labels
Clear labels
$20
$250
$50
$500
backport/done
💎 Bounty
docs-update-needed
good first issue
hacktoberfest
issue/bounty
issue/confirmed
issue/critical
issue/duplicate
issue/needs-feedback
issue/not-a-bug
issue/regression
issue/stale
issue/workaround
lgtm/need 2
modifies/api
modifies/translation
outdated/backport/v1.18
outdated/theme/markdown
outdated/theme/timetracker
performance/bigrepo
performance/cpu
performance/memory
performance/speed
pr/breaking
proposal/accepted
proposal/rejected
pr/wip
pull-request
reviewed/wontfix
💰 Rewarded
skip-changelog
status/blocked
topic/accessibility
topic/api
topic/authentication
topic/build
topic/code-linting
topic/commit-signing
topic/content-rendering
topic/deployment
topic/distribution
topic/federation
topic/gitea-actions
topic/issues
topic/lfs
topic/mobile
topic/moderation
topic/packages
topic/pr
topic/projects
topic/repo
topic/repo-migration
topic/security
topic/theme
topic/ui
topic/ui-interaction
topic/ux
topic/webhooks
topic/wiki
type/bug
type/deprecation
type/docs
type/enhancement
type/feature
type/miscellaneous
type/proposal
type/question
type/refactoring
type/summary
type/testing
type/upstream
Mirrored from GitHub Pull Request
No Label
topic/gitea-actions
Milestone
No items
No Milestone
Projects
Clear projects
No project
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: github-starred/gitea#14252
Reference in New Issue
Block a user
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @jhe2 on GitHub (Mar 14, 2025).
Description
As soon as there is an act_runner (v0.2.11) running (even if it is idle), there appears to be a constant flow of database updates.
As far as I can tell, this is due to the
last_onlinefield in theact_runnertable being updated all the time.By default this happens every two seconds for each act_runner. I would much prefer if there were no database writes while the runners are idle. I couldn't find a way to disable this behavior. It would be nice to have an option to disable this or possibly keep the
last_onlinevalue in memory only instead of writing it to the database.Thanks for the great work on Gitea!
Gitea Version
1.23.5
Can you reproduce the bug on the Gitea demo site?
No
Log Gist
No response
Screenshots
No response
Git Version
2.48.1
Operating System
Alpine Linux (edge)
How are you running Gitea?
I'm using the Gitea package provided by Alpine Linux.
Database
SQLite
@philiprenich commented on GitHub (Mar 27, 2025):
Curious about this as well. Realised the hdd was just constantly going and have tracked it down to this file. Would like a quieter system when idle.
@lunny commented on GitHub (Mar 27, 2025):
This isn’t a bug — it’s the intended behavior. That said, I agree it’s not a great design. The key question is: what’s the actual impact of this behavior?
@philiprenich commented on GitHub (Mar 28, 2025):
@lunny Thanks for the reply. As their is a call to the Gitea server each time, it makes for very loud logs. This makes it hard to investigate issues looking through those logs. My assumption would there is good log rotation so they aren't slowly eating up storage space? Constant log writing and database editing is going to be a bit wearing on the hardware I would imagine (though probably fairly minor).
I'm fully self-hosted (that is, a server in my living room) so while excess writes and storage isn't a crucial issue, it's a bigger deal for my situation than if I was using a cloud service provider who will swap the hardware for me in a timely (and experienced!) manner.
I'm not sure if a potential solution would be allowing the timing to be customised (feels like kicking the can down the road) or a different design.
I hope that helps! If my assumptions/worries are baseless, feel free to correct them!
@jhe2 commented on GitHub (Mar 28, 2025):
What's the purpose of those database updates? Is it just for the user to be able to see when the act_runner last talked to Gitea or is that information used for something else as well? As far as I can tell, Gitea doesn't really need this information since the act_runners actively ask for new tasks anyway, but maybe I am missing something here.
It is and on SSDs it is actually quite a bit more than what one might expect due to write amplification of SSDs and due to the fact that each database write - no matter how small it is - is followed by an fsync call. Of course using fsync makes perfect sense for a database to ensure its consistency, but that also means that the OS can't batch all those small write into fewer larger ones. Neither can the SSD do it.
I also noticed that the SSD in my server runs several degrees hotter with an act_runner active, probably because the SSD can never enter its power saving states due to the constant stream of writes.
Without act_runners active, Gitea appears to write very little to disk, if nothing is going on, which is nice.
@lunny commented on GitHub (Mar 28, 2025):
Yes, just store the last active time. Maybe the state can be stored in memory/redis.
@ashleysommer commented on GitHub (Aug 23, 2025):
I just came across this same issue. My mini home server that hosts my git forge is on my shelf right next to my desk in my office, and when its 4 hard disks are active its noticeably loud. Yesterday I enabled a runner, and since then my server has been spinning up its disks every 2 seconds to write to the sqlite db. Its very distracting, and I feel like it can't be good for my disks.
Is there a way to disable this "last online" update? or store it in memory and commit to disk on shutdown, or even once every 10 minutes?
For now, I've just shut down my runner. I'll turn it back on only when I need to use it.