dextmorgn
fa1c8e7580
Enrichers declare InputType/OutputType as plain class attributes (NotImplemented on the base, overridden per subclass) and use them in annotations like List[InputType] and self.data.domain — the documented, intentional API (see flowsint-enricher-builder skill), not something to individually silence. mypy structurally can't verify a class attribute doubling as a type alias without making Enricher generic, which would mean touching every enricher's class declaration. Narrows the specific checks that pattern trips (valid-type, attr-defined, name-defined) via per-module overrides in flowsint-enrichers and flowsint-core's tests (MockEnricher fixtures use the same pattern). Separately, fixes real gaps in orchestrator.py surfaced once the noise cleared: several dict literals (step_result, log_entry, results, results_mapping, branch_results) were inferred as narrower types than what the code actually assigns into them; execution_log_file and the enrichers map were missing their real (Optional) types; _create_execution_log used self.execution_log_file across an assignment mypy couldn't narrow, fixed via a local variable. update_results_mapping's outputs param is typed to match what it can actually receive (dict or list, per the isinstance check upstream) with a comment on the pre-existing dict-only assumption in its body — not silently "fixed" since that would change behavior for list-shaped enricher outputs, unverified here. scan()'s Liskov-incompatible override (sync, single-dict vs the base's async/ list-of-dicts contract) is documented and suppressed, not changed — that's a behavioral call about how FlowOrchestrator is actually invoked. graph_edge_to_neo4j_dict/serializer.py's from_obj/to_obj were typed as generic BaseModel while the body only ever handles FlowsintType or GraphNode — narrowed to that Union. And prepare_enricher_inputs, which has no callers anywhere, is typed Any rather than guessing at intended behavior for dead code whose two return branches already disagree. Verified: flowsint-core's 397 tests pass unchanged.
Flowsint
Flowsint is an open-source OSINT graph exploration tool designed for ethical investigation, transparency, and verification.
Ethics: Please read ETHICS.md for responsible use guidelines.
https://github.com/user-attachments/assets/eaabfa81-d7b3-414d-8cf7-f69b4e37bab6
https://github.com/user-attachments/assets/7457d94a-cf1d-4a97-949f-f9b1d8d92644
https://github.com/user-attachments/assets/65c3f26e-7132-4853-be45-21b8933688bd
Contributing
Flowsint is still in early development and definetly needs the help of the community! Feel free to raise issues, propose features, etc.
Get started
Don't want to read ? Got it. Here's your install instructions:
Linux / macOS
1. Install pre-requisites
- Docker
- Make
2. Run install command
git clone https://github.com/reconurge/flowsint.git
cd flowsint
make prod
Windows
No Make needed. Works in both Command Prompt (cmd) and PowerShell.
1. Install pre-requisites
- Docker Desktop (make sure it is running before the next step)
- Git
2. Clone and set up environment files
git clone https://github.com/reconurge/flowsint.git
cd flowsint
copy .env.example .env
copy .env.example flowsint-api\.env
copy .env.example flowsint-core\.env
copy .env.example flowsint-app\.env
3. Start
docker compose -f docker-compose.prod.yml up -d
This pulls the pre-built images from GitHub Container Registry — no local build needed.
First login
Then go to http://localhost:5173/register and create an account. There are no credentials or account by default.
✅ OSINT investigations need a high level of privacy. Everything is stored on your machine.
Deploy on a network (team / server)
The same setup works out of the box on a server: the frontend serves the UI and proxies all API calls internally, so no extra configuration is needed for clients.
git clone https://github.com/reconurge/flowsint.git
cd flowsint
cp .env.example .env
# Edit .env — see "Before exposing to a network" below
docker compose -f docker-compose.prod.yml up -d
Anyone on the network can then access Flowsint at http://<server-ip>:5173.
Before exposing to a network, change the default secrets in .env:
AUTH_SECRET— signs authentication tokens. Generate one:openssl rand -hex 32MASTER_VAULT_KEY_V1— encrypts stored API keys. Generate one:python3 -c "import os, base64; print('base64:' + base64.b64encode(os.urandom(32)).decode())"NEO4J_PASSWORD— Neo4j database password.
Also add your server hostname/IP to the Host-header allowlist in flowsint-app/nginx.conf (look for map $http_host $is_flowsint_host). The default allowlist accepts only localhost / 127.0.0.1 / [::1], which defends single-user installs against DNS rebinding; LAN and public deploys must opt-in their own hostname. Two commented-out template lines in the same map block show the format.
Only port 5173 is exposed to the network. PostgreSQL, Redis, Neo4j and the API are bound to 127.0.0.1 on the server and reachable only through the frontend proxy.
To pin a specific version instead of latest, set FLOWSINT_VERSION in .env (e.g. FLOWSINT_VERSION=1.2.10).
HTTPS (recommended beyond a trusted LAN): put any reverse proxy in front of port 5173. Example with Caddy:
flowsint.example.com {
reverse_proxy 127.0.0.1:5173
}
When fronting with a reverse proxy, also bind the app port to localhost in docker-compose.prod.yml ("127.0.0.1:5173:8080") so clients can only go through HTTPS.
What is it?
Flowsint is a graph-based investigation tool focused on reconnaissance and OSINT (Open Source Intelligence). It allows you to explore relationships between entities through a visual graph interface and automated enrichers.
Available Enrichers
Domain Enrichers
- Reverse DNS Resolution - Find domains pointing to an IP
- DNS Resolution - Resolve domain to IP addresses
- Subdomain Discovery - Enumerate subdomains
- WHOIS Lookup - Get domain registration information
- Domain to Website - Convert domain to website entity
- Domain to Root Domain - Extract root domain
- Domain to ASN - Find ASN associated with domain
- Domain History - Retrieve historical domain data
IP Enrichers
- IP Information - Get geolocation and network details
- IP to ASN - Find ASN for IP address
ASN Enrichers
- ASN to CIDRs - Get IP ranges for an ASN
CIDR Enrichers
- CIDR to IPs - Enumerate IPs in a range
Social Media Enrichers
- Maigret - Username search across social platforms
Organization Enrichers
- Organization to ASN - Find ASNs owned by organization
- Organization Information - Get company details
- Organization to Domains - Find domains owned by organization
Cryptocurrency Enrichers
- Wallet to Transactions - Get transaction history
- Wallet to NFTs - Find NFTs owned by wallet
Website Enrichers
- Website Crawler - Crawl and map website structure
- Website to Links - Extract all links
- Website to Domain - Extract domain from URL
- Website to Webtrackers - Identify tracking scripts
- Website to Text - Extract text content
Email Enrichers
- Email to Gravatar - Find Gravatar profile
- Email to Breaches - Check data breach databases
- Email to Domains - Find associated domains
Phone Enrichers
- Phone to Breaches - Check phone number in breaches
Individual Enrichers
- Individual to Organization - Find organizational affiliations
- Individual to Domains - Find domains associated with person
Integration Enrichers
- N8n Connector - Connect to N8n workflows
Project structure
The project is organized into autonomous modules:
Core modules
- flowsint-core: Core utilities, orchestrator, vault, celery tasks, and base classes
- flowsint-types: Pydantic models and type definitions
- flowsint-enrichers: Enricher modules, scanning logic, and tools
- flowsint-api: FastAPI server, API routes, and schemas only
- flowsint-app: Frontend application
Module dependencies
flowsint-app (frontend)
↓
flowsint-api (API server)
↓
flowsint-core (orchestrator, tasks, vault)
↓
flowsint-enrichers (enrichers & tools)
↓
flowsint-types (types)
Development setup
Prerequisites
- Docker
Run
Linux / macOS (requires Make):
make dev
Windows (cmd or PowerShell, no Make — create the .env files first, see Get started):
docker compose -f docker-compose.dev.yml up -d --build
docker compose -f docker-compose.dev.yml logs -f
Development
The app is accessible at http://localhost:5173.
Module details
flowsint-core
Core utilities and base classes used by all other modules:
- Database connections (PostgreSQL, Neo4j)
- Authentication and authorization
- Logging and event handling
- Configuration management
- Base classes for enrichers and tools
- Utility functions
flowsint-types
Pydantic models for all data types:
- Domain, IP, ASN, CIDR
- Individual, Organization, Email, Phone
- Website, Social profiles, Credentials
- Crypto wallets, Transactions, NFTs
- And many more...
flowsint-enrichers
Enricher modules that process data:
- Domain enrichers (subdomains, WHOIS, resolution)
- IP enrichers (geolocation, ASN lookup)
- Social media enrichers (Maigret, Sherlock)
- Email enrichers (breaches, Gravatar)
- Crypto enrichers (transactions, NFTs)
- And many more...
flowsint-api
FastAPI server providing:
- REST API endpoints
- Authentication and user management
- Graph database integration
- Real-time event streaming
flowsint-app
Frontend application.
- Modern and UI friendly interface
- Built for performance (no lag even on thousands of nodes)
Development workflow
- Adding new types: Add to
flowsint-typesmodule - Adding new enrichers: Add to
flowsint-enrichersmodule - Adding new API endpoints: Add to
flowsint-apimodule - Adding new utilities: Add to
flowsint-coremodule
Testing
Each module has its own (incomplete) test suite:
# Test core module
cd flowsint-core
uv run pytest
# Test types module
cd ../flowsint-types
uv run pytest
# Test enrichers module
cd ../flowsint-enrichers
uv run pytest
# Test API module
cd ../flowsint-api
uv run pytest
Contributing
- Follow the modular structure
- Use Poetry for dependency management
- Write tests for new functionality
- Update documentation as needed
⚖️ Legal & Ethical Use
Ethics: Please read ETHICS.md for responsible use guidelines.
Flowsint is designed strictly for lawful, ethical investigation and research purposes.
It was created to assist:
- Cybersecurity researchers and analysts
- Journalists and OSINT investigators
- Law enforcement or fraud investigation teams
- Organizations conducting internal threat intelligence or digital risk analysis
Flowsint must not be used for:
- Unauthorized intrusion, surveillance, or data collection
- Harassment, doxxing, or targeting of individuals
- Political manipulation, misinformation, or violation of privacy laws
Any misuse of this software is strictly prohibited and goes against the ethical principles defined in ETHICS.md.
❤️ Support