github-starred/flowsint
2
0
Fork 0
mirror of https://github.com/reconurge/flowsint.git synced 2026-05-07 12:26:24 -05:00
Code Issues 264 Packages Projects Releases 11 Wiki Activity

[PR #74] [MERGED] feat: type validations + transforms minification #1092

New Issue
Closed
opened 2026-05-03 01:58:13 -05:00 by GiteaMirror · 0 comments
GiteaMirror commented 2026-05-03 01:58:13 -05:00
Owner
Copy Link

📋 Pull Request Information

Original PR: https://github.com/reconurge/flowsint/pull/74
Author: @dextmorgn
Created: 11/20/2025
Status: ✅ Merged
Merged: 11/20/2025
Merged by: @dextmorgn

Base: main ← Head: feat/type-validations

📝 Commits (10+)

  • c4a3069 feat(types): types validation using pydantic directly
  • ef523bd feat(core): preprocess becomes generic
  • 79026fe feat(transforms): remove some usage of preprocess
  • caecbfe feat: type validation + simplified transform system
  • 4907a75 feat(transform): Email
  • 527c448 feat(transforms): to_domains use of new create_relationship
  • a7a6fcc feat: minifiy transform logic
  • f031af4 feat: bump versions
  • 8a6d800 fix(transforms): missing imports + remove empty lines
  • 2a92080 feat: parse httpUrl on db insert

📊 Changes

118 files changed (+4388 additions, -3049 deletions)

View changed files

📝 Makefile (+7 -1)
📝 flowsint-api/app/api/routes/sketches.py (+3 -0)
📝 flowsint-api/app/api/routes/types.py (+2 -0)
📝 flowsint-api/app/utils.py (+0 -1)
📝 flowsint-app/src/components/graphs/details-panel/details-panel.tsx (+1 -1)
📝 flowsint-core/README.md (+7 -1)
📝 flowsint-core/pyproject.toml (+1 -1)
📝 flowsint-core/src/flowsint_core/core/logger.py (+284 -79)
➕ flowsint-core/src/flowsint_core/core/logger_old.py (+90 -0)
➕ flowsint-core/src/flowsint_core/core/logger_protocols.py (+52 -0)
📝 flowsint-core/src/flowsint_core/core/models.py (+7 -2)
📝 flowsint-core/src/flowsint_core/core/registry.py (+0 -4)
📝 flowsint-core/src/flowsint_core/core/transform_base.py (+277 -72)
📝 flowsint-core/src/flowsint_core/core/vault.py (+2 -3)
📝 flowsint-core/src/flowsint_core/tasks/flow.py (+0 -1)
📝 flowsint-core/src/flowsint_core/tasks/transform.py (+0 -1)
➕ flowsint-core/tests/test_logger_singleton.py (+425 -0)
➕ flowsint-core/tests/test_transform_base_simplified_api.py (+117 -0)
➕ flowsint-core/tests/transforms/base.py (+71 -0)
📝 flowsint-core/tests/vault/test_transform_vault_integration.py (+132 -63)

...and 80 more files

📄 Description

  • handles the type logic and validation in the types directly with pydantic
  • minifies the transform logic by removing preprocess() and updating create_node() and create_relationship() methods

⚠️ Important

This might introduce some breaking changes if you had written custom made transforms. Refer to the documentation.

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/reconurge/flowsint/pull/74 **Author:** [@dextmorgn](https://github.com/dextmorgn) **Created:** 11/20/2025 **Status:** ✅ Merged **Merged:** 11/20/2025 **Merged by:** [@dextmorgn](https://github.com/dextmorgn) **Base:** `main` ← **Head:** `feat/type-validations` --- ### 📝 Commits (10+) - [`c4a3069`](https://github.com/reconurge/flowsint/commit/c4a30695b470bc62ecb4f1f68b0a616cb1b462a4) feat(types): types validation using pydantic directly - [`ef523bd`](https://github.com/reconurge/flowsint/commit/ef523bd9e195f09ab35c29df6bf285639969e7d1) feat(core): preprocess becomes generic - [`79026fe`](https://github.com/reconurge/flowsint/commit/79026fee26b0bf520278f2e5d560c53c2da6822b) feat(transforms): remove some usage of preprocess - [`caecbfe`](https://github.com/reconurge/flowsint/commit/caecbfec428209a49ad3e1073444686a6b23093e) feat: type validation + simplified transform system - [`4907a75`](https://github.com/reconurge/flowsint/commit/4907a759ed1a0521b021831169e39bea6a47423f) feat(transform): Email - [`527c448`](https://github.com/reconurge/flowsint/commit/527c44863e719279c911508383ef5b8f13f6a3d4) feat(transforms): to_domains use of new create_relationship - [`a7a6fcc`](https://github.com/reconurge/flowsint/commit/a7a6fcccac2f0f24fe980610cb15ad055fb8d081) feat: minifiy transform logic - [`f031af4`](https://github.com/reconurge/flowsint/commit/f031af4d232d2a20d7d6fda84dcd9a51dbd2d2ef) feat: bump versions - [`8a6d800`](https://github.com/reconurge/flowsint/commit/8a6d8003e8562e0eba665dd971fb56443e95409e) fix(transforms): missing imports + remove empty lines - [`2a92080`](https://github.com/reconurge/flowsint/commit/2a92080061ef4703189abb2d3c432503c6c3d0ff) feat: parse httpUrl on db insert ### 📊 Changes **118 files changed** (+4388 additions, -3049 deletions) <details> <summary>View changed files</summary> 📝 `Makefile` (+7 -1) 📝 `flowsint-api/app/api/routes/sketches.py` (+3 -0) 📝 `flowsint-api/app/api/routes/types.py` (+2 -0) 📝 `flowsint-api/app/utils.py` (+0 -1) 📝 `flowsint-app/src/components/graphs/details-panel/details-panel.tsx` (+1 -1) 📝 `flowsint-core/README.md` (+7 -1) 📝 `flowsint-core/pyproject.toml` (+1 -1) 📝 `flowsint-core/src/flowsint_core/core/logger.py` (+284 -79) ➕ `flowsint-core/src/flowsint_core/core/logger_old.py` (+90 -0) ➕ `flowsint-core/src/flowsint_core/core/logger_protocols.py` (+52 -0) 📝 `flowsint-core/src/flowsint_core/core/models.py` (+7 -2) 📝 `flowsint-core/src/flowsint_core/core/registry.py` (+0 -4) 📝 `flowsint-core/src/flowsint_core/core/transform_base.py` (+277 -72) 📝 `flowsint-core/src/flowsint_core/core/vault.py` (+2 -3) 📝 `flowsint-core/src/flowsint_core/tasks/flow.py` (+0 -1) 📝 `flowsint-core/src/flowsint_core/tasks/transform.py` (+0 -1) ➕ `flowsint-core/tests/test_logger_singleton.py` (+425 -0) ➕ `flowsint-core/tests/test_transform_base_simplified_api.py` (+117 -0) ➕ `flowsint-core/tests/transforms/base.py` (+71 -0) 📝 `flowsint-core/tests/vault/test_transform_vault_integration.py` (+132 -63) _...and 80 more files_ </details> ### 📄 Description - handles the type logic and validation in the types directly with pydantic - minifies the transform logic by removing `preprocess()` and updating `create_node()` and `create_relationship()` methods ### ⚠️ Important This might introduce some breaking changes if you had written custom made transforms. Refer to the [documentation](https://www.flowsint.io/docs/developers/getting-started). --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-05-03 01:58:14 -05:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
documentation
enhancement
pull-request
Mirrored from GitHub Pull Request
No Label pull-request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/flowsint#1092
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?