github-starred/awesome-python
2
0
Fork 0
mirror of https://github.com/vinta/awesome-python.git synced 2026-03-22 14:12:18 -05:00
Code Issues 497 Packages Projects Releases Wiki Activity

[PR #1542] Add law #1341

New Issue
Open
opened 2025-11-06 13:14:18 -06:00 by GiteaMirror · 0 comments
GiteaMirror commented 2025-11-06 13:14:18 -06:00
Owner
Copy Link

📋 Pull Request Information

Original PR: https://github.com/vinta/awesome-python/pull/1542
Author: @riga
Created: 5/13/2020
Status: 🔄 Open

Base: master ← Head: master

📝 Commits (2)

📊 Changes

1 file changed (+1 additions, -0 deletions)

View changed files

📝 README.md (+1 -0)

📄 Description

What is this Python project?

Added link

  • law - Large-scale luigi workflows on distributed resources with remote storage and container support.

Description

The Luigi Analysis Workflow (law) package is a tool to build complex and large-scale task workflows as found is many scientific applications. It is build on top of luigi and adds abstractions for run locations, storage locations and software environments. Law strictly disentangles these building blocks and ensures they remain interchangeable and resource-opportunistic.

More info can be found at J. Phys.: Conf. Ser. 898 (2017) 072047. Law was and is used for several large-scale analysis in the context of high-energy physics research (CERN) and has the potential to serve many applications outside this community.

What's the difference between this Python project and similar ones?

Compared to other tools such as luigi itself, this key features of this project are:

  • Rich CLI with auto-completion and interactive status and dependency inspection.
  • Remote storage of results with automatic retries and local caching. Supports
    WebDAV, HTTP, Dropbox, SFTP, S3 and all protocols within the Worldwide LHC Computing Grid (srm, xrootd, rfio, dcap, gsiftp, ...)
  • Automatic submission of jobs to batch systems from within tasks with error detection and resubmission. Supports HTCondor, LSF, gLite, ARC, Slurm.
  • Environment sandboxing configurable on task level. Supports Docker, Singularity, Sub-Shells.

Anyone who agrees with this pull request could submit an Approve review to it or vote for it by adding a 👍 to it, and usually, the maintainer will merge it when votes reach 20.

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/vinta/awesome-python/pull/1542 **Author:** [@riga](https://github.com/riga) **Created:** 5/13/2020 **Status:** 🔄 Open **Base:** `master` ← **Head:** `master` --- ### 📝 Commits (2) - [`8f3a9c3`](https://github.com/vinta/awesome-python/commit/8f3a9c34e8286340aa15a6f8593d5ff6557b2937) Add law. - [`e83dfe0`](https://github.com/vinta/awesome-python/commit/e83dfe01e2bad9e2494d6220fd91f5217791c224) Shorten description. ### 📊 Changes **1 file changed** (+1 additions, -0 deletions) <details> <summary>View changed files</summary> 📝 `README.md` (+1 -0) </details> ### 📄 Description ## What is this Python project? #### Added link - [law](https://github.com/riga/law) - Large-scale luigi workflows on distributed resources with remote storage and container support. #### Description The Luigi Analysis Workflow (law) package is a tool to build complex and large-scale task workflows as found is many scientific applications. It is build on top of [luigi](https://github.com/spotify/luigi) and adds abstractions for run locations, storage locations and software environments. Law strictly disentangles these building blocks and ensures they remain interchangeable and resource-opportunistic. More info can be found at [*J. Phys.: Conf. Ser.* **898** (2017) 072047](https://iopscience.iop.org/article/10.1088/1742-6596/898/7/072047). Law was and is used for several large-scale analysis in the context of high-energy physics research (CERN) and has the potential to serve many applications outside this community. ## What's the difference between this Python project and similar ones? Compared to other tools such as luigi itself, this key features of this project are: - Rich CLI with auto-completion and interactive status and dependency inspection. - Remote storage of results with automatic retries and local caching. Supports WebDAV, HTTP, Dropbox, SFTP, S3 and all protocols within the [Worldwide LHC Computing Grid](https://wlcg.web.cern.ch) (srm, xrootd, rfio, dcap, gsiftp, ...) - Automatic submission of jobs to batch systems from within tasks with error detection and resubmission. Supports HTCondor, LSF, gLite, ARC, Slurm. - Environment sandboxing configurable on task level. Supports Docker, Singularity, Sub-Shells. --- Anyone who agrees with this pull request could submit an *Approve* review to it or vote for it by adding a 👍 to it, and usually, the maintainer will merge it when votes reach 20. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2025-11-06 13:14:18 -06:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
pull-request
Mirrored from GitHub Pull Request
No Label pull-request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/awesome-python#1341
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?